2020-11-16T20:42:57.655 INFO:root:teuthology version: 1.0.0-357fd4a 2020-11-16T20:42:57.657 DEBUG:teuthology.run:Teuthology command: teuthology --lock --archive /home/teuthworker/archive/kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi/5631168 --description rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/snaps-few-objects} --verbose --name kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi --block --owner scheduled_kchai@teuthology -- /tmp/teuthology-worker.0ap7yekj.tmp 2020-11-16T20:42:57.689 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-16T20:42:57.751 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi/5631168 branch: wip-kefu-testing-2020-11-16-1845 description: rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/snaps-few-objects} email: tchaikov@gmail.com first_in_suite: false job_id: '5631168' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - volumes: count: 4 size: 10 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: wip-kefu-testing-2020-11-16-1845 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr2: false ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: osd ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async osd_pool_default_min_size: 2 osd_pool_default_size: 2 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd backoff on degraded: true osd backoff on peering: true osd debug verify cached snaps: true osd debug verify missing on start: true osd max markdown count: 1000 osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - Health detail - \(REQUEST_STUCK\) - \(MON_DOWN\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - Health detail mon_bind_msgr2: false sha1: 911cc35794d871071a8bebfb0919482263b1d18b ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 911cc35794d871071a8bebfb0919482263b1d18b workunit: branch: wip-kefu-testing-2020-11-16-1845 sha1: 911cc35794d871071a8bebfb0919482263b1d18b owner: scheduled_kchai@teuthology priority: 90 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - - mon.c - osd.8 - osd.9 - osd.10 - osd.11 - client.2 sha1: 911cc35794d871071a8bebfb0919482263b1d18b sleep_before_teardown: 0 suite: rados suite_branch: wip-kefu-testing-2020-11-16-1845 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-11-16-1845/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 911cc35794d871071a8bebfb0919482263b1d18b tasks: - install: branch: nautilus exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs - cephadm: null - exec: mon.a: - while ! ceph balancer status ; do sleep 1 ; done - ceph balancer mode crush-compat - ceph balancer on - rados: clients: - client.2 objects: 50 op_weights: copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 teuthology_branch: master timestamp: 2020-11-16_12:11:03 tube: smithi user: kchai verbose: false verify_ceph_hash: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.7066 2020-11-16T20:42:57.751 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-11-16-1845/qa; will attempt to use it 2020-11-16T20:42:57.752 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2020-11-16-1845/qa/tasks 2020-11-16T20:42:57.752 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-11-16T20:42:57.756 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-11-16T20:42:57.756 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-16T20:42:57.805 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:43:07.819 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:43:17.836 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:43:27.854 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:43:37.873 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:43:47.890 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:43:57.908 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:44:07.921 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:44:17.939 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:44:27.951 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:44:37.971 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:44:47.986 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:44:58.000 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:45:08.019 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:45:18.035 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:45:28.050 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:45:38.062 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:45:48.078 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:45:58.096 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:46:08.110 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:46:18.124 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:46:28.138 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:46:38.157 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:46:48.172 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:46:58.188 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:47:08.208 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:47:26.324 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:47:36.343 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:47:46.361 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:47:56.378 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:48:06.388 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:48:16.397 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:48:26.415 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:48:36.431 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:48:46.449 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:48:56.468 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:49:06.486 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:49:16.505 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T20:49:26.523 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T20:49:36.540 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T20:49:46.549 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T20:49:56.568 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T20:50:06.583 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T20:50:16.598 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T20:50:26.620 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T20:50:36.635 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T20:50:46.647 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:50:56.665 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:51:06.677 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:51:16.695 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:51:26.709 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:51:36.728 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:51:46.745 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:51:56.762 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:52:06.778 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:52:16.790 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:52:26.808 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:52:36.820 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:52:46.833 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:52:56.852 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:53:06.861 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T20:53:16.877 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:53:26.895 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:53:36.913 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:53:46.930 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:53:56.947 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:54:06.964 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:54:16.980 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:54:26.996 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:54:37.015 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:54:47.034 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:54:57.052 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:55:07.062 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:55:17.078 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:55:27.094 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:55:37.106 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:55:47.124 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:55:57.141 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:56:07.157 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:56:17.169 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:56:27.189 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:56:37.208 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:56:47.222 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:56:57.238 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:57:07.257 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:57:17.273 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:57:27.291 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:57:37.309 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:57:47.325 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:57:57.342 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:58:07.360 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:58:17.378 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:58:27.398 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:58:37.417 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:58:47.429 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:58:57.447 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:59:07.457 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:59:17.475 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:59:27.486 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:59:37.505 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:59:47.524 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T20:59:57.536 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:00:07.553 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:00:17.571 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:00:27.585 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:00:37.597 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:00:47.607 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:00:57.625 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:01:07.641 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:01:17.653 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:01:27.670 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:01:37.686 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:01:47.704 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:01:57.723 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:02:07.735 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:02:17.751 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:02:27.768 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:02:37.783 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:02:47.800 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:02:57.819 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:03:07.835 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:03:17.850 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:03:27.868 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:03:37.877 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:03:47.894 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:03:57.912 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:04:07.922 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:04:17.940 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:04:27.957 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:04:37.975 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:04:47.994 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:04:58.012 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:05:08.020 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:05:18.039 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:05:28.057 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:05:38.074 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:05:48.091 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:05:58.105 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:06:08.121 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:06:18.134 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:06:28.146 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:06:38.161 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:06:48.177 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:06:58.194 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:07:08.208 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:07:18.224 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:07:28.241 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:07:38.256 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:07:48.269 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:07:58.285 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:08:08.300 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:08:18.318 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:08:28.333 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:08:38.348 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:08:48.365 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:08:58.382 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:09:08.399 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:09:18.413 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:09:28.429 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:09:38.438 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:09:48.457 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:09:58.466 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:10:08.483 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:10:18.498 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:10:28.514 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:10:38.531 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:10:48.548 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:10:58.566 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:11:08.583 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:11:35.837 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:11:45.853 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:12:15.715 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:12:25.732 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:12:35.752 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:12:45.763 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:12:55.778 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:13:05.796 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:13:15.810 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:13:25.820 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:13:35.839 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:13:45.853 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:13:55.865 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:14:05.880 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:14:15.900 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:14:25.914 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:14:35.933 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:14:45.952 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:14:55.973 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:15:05.994 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:15:16.013 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:15:26.034 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:15:36.051 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:15:46.062 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:15:56.079 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:16:06.098 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:16:16.116 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:16:26.142 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:16:36.159 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:16:46.179 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:16:56.192 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:17:06.210 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:17:16.228 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:17:26.242 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:17:36.259 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:17:46.269 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:17:56.287 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:18:06.305 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:18:16.315 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:18:26.333 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:18:36.347 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:18:46.359 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:18:56.368 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:19:06.386 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:19:16.396 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:19:26.414 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:19:36.432 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:19:46.450 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:19:56.462 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:20:06.478 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:20:16.491 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:20:26.509 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:20:36.529 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:20:46.548 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:20:56.563 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:21:06.575 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:21:16.593 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:21:26.611 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:21:36.626 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:21:46.645 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:21:56.666 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:22:06.683 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:22:16.702 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:22:26.718 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:22:36.727 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:22:46.742 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:22:56.751 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:23:06.765 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:23:16.777 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:23:26.794 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:23:36.811 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:23:46.828 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-16T21:23:56.846 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:24:06.863 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:24:16.881 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:24:26.896 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:24:36.911 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:24:46.930 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:24:56.945 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:25:06.955 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:25:16.971 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:25:26.987 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:25:37.004 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:25:47.021 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:25:57.038 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:26:07.056 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-16T21:26:17.074 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:26:27.086 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:26:37.110 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:26:47.129 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:26:57.142 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:27:07.158 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:27:17.176 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:27:27.187 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:27:37.197 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:27:47.215 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:27:57.229 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:28:07.246 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:28:17.262 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:28:27.281 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:28:37.298 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:28:47.316 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:28:57.330 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:29:07.345 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:29:17.362 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:29:27.379 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:29:37.394 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:29:47.411 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:29:57.422 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:30:07.437 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:30:17.454 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:30:27.470 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:30:37.480 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:30:47.493 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:30:57.511 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:31:07.525 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-16T21:31:17.541 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_kchai@teuthology', 'count': 3, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi/5631168'} 2020-11-16T21:31:17.562 DEBUG:teuthology.lock.ops:locked ubuntu@smithi195.front.sepia.ceph.com, ubuntu@smithi016.front.sepia.ceph.com, ubuntu@smithi057.front.sepia.ceph.com 2020-11-16T21:31:17.641 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f559aa98ea0>, signals=[15]) 2020-11-16T21:31:17.852 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of ubuntu 18.04 2020-11-16T21:31:17.855 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of ubuntu 18.04 2020-11-16T21:31:17.864 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of ubuntu 18.04 2020-11-16T21:31:18.144 INFO:teuthology.orchestra.console:Power off smithi195 2020-11-16T21:31:18.145 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-16T21:31:18.162 INFO:teuthology.orchestra.console:Power off smithi016 2020-11-16T21:31:18.163 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-16T21:31:18.178 INFO:teuthology.orchestra.console:Power off smithi057 2020-11-16T21:31:18.179 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-16T21:31:18.187 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:18.197 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:18.206 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:22.219 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:22.229 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:22.239 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:26.334 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:26.344 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:26.354 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:26.545 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2020-11-16T21:31:26.555 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2020-11-16T21:31:26.565 INFO:teuthology.orchestra.console:Power off for smithi057 completed 2020-11-16T21:31:26.646 INFO:teuthology.orchestra.console:Power on smithi016 2020-11-16T21:31:26.647 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-16T21:31:26.656 INFO:teuthology.orchestra.console:Power on smithi195 2020-11-16T21:31:26.657 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-16T21:31:26.665 INFO:teuthology.orchestra.console:Power on smithi057 2020-11-16T21:31:26.666 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-16T21:31:26.675 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:26.686 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:26.696 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:30.706 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:30.715 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:30.724 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:34.818 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:34.829 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:34.839 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-16T21:31:35.030 INFO:teuthology.orchestra.console:Power on for smithi016 completed 2020-11-16T21:31:35.040 INFO:teuthology.orchestra.console:Power on for smithi195 completed 2020-11-16T21:31:35.049 INFO:teuthology.orchestra.console:Power on for smithi057 completed 2020-11-16T21:31:35.131 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2020-11-16T21:31:35.141 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2020-11-16T21:31:35.151 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2020-11-16T21:34:06.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:34:06.136 ERROR:teuthology.orchestra.connection:Error connecting to smithi016.front.sepia.ceph.com Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/connection.py", line 108, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 446, in connect passphrase, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 764, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 740, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 1580, in auth_publickey return self.auth_handler.wait_for_response(my_event) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/auth_handler.py", line 250, in wait_for_response raise e paramiko.ssh_exception.AuthenticationException: Authentication failed. 2020-11-16T21:34:22.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:34:23.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:34:32.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:34:37.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:34:41.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:34:47.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:34:50.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:34:56.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:34:59.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:35:02.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:35:09.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:35:15.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:35:18.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:35:24.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:35:27.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:35:37.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:35:37.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:35:37.497 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-11-16T21:35:43.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:35:43.511 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-11-16T21:35:49.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:35:52.552 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-11-16T21:35:58.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:35:58.638 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-16T21:35:58.641 INFO:teuthology.orchestra.run.smithi016:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-16T21:35:59.023 INFO:teuthology.provision.fog.smithi016:Node is ready 2020-11-16T21:35:59.023 INFO:teuthology.orchestra.run.smithi016:> hostname 2020-11-16T21:35:59.070 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com 2020-11-16T21:35:59.070 INFO:teuthology.orchestra.run.smithi016:> grep smithi016.front.sepia.ceph.com /etc/hosts 2020-11-16T21:35:59.119 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016 2020-11-16T21:35:59.119 INFO:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2020-11-16T21:35:59.252 INFO:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hosts 2020-11-16T21:35:59.268 INFO:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/172.21.15.16/172.21.15.16/g' /etc/hosts 2020-11-16T21:35:59.324 INFO:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hostname 2020-11-16T21:35:59.378 INFO:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2020-11-16T21:35:59.434 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2020-11-16T21:35:59.435 DEBUG:teuthology.parallel:result is None 2020-11-16T21:36:15.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:36:15.031 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-11-16T21:36:21.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:36:21.045 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-11-16T21:36:27.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:36:27.057 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-11-16T21:36:33.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:36:37.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:36:37.267 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-11-16T21:36:37.358 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-16T21:36:37.359 INFO:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-16T21:36:37.719 INFO:teuthology.provision.fog.smithi195:Node is ready 2020-11-16T21:36:37.719 INFO:teuthology.orchestra.run.smithi195:> hostname 2020-11-16T21:36:37.767 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2020-11-16T21:36:37.768 INFO:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2020-11-16T21:36:37.816 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2020-11-16T21:36:37.817 INFO:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2020-11-16T21:36:37.945 INFO:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2020-11-16T21:36:37.958 INFO:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2020-11-16T21:36:38.017 INFO:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2020-11-16T21:36:38.070 INFO:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2020-11-16T21:36:38.127 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2020-11-16T21:36:38.128 DEBUG:teuthology.parallel:result is None 2020-11-16T21:36:43.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:36:43.344 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-16T21:36:43.344 INFO:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-16T21:36:43.695 INFO:teuthology.provision.fog.smithi057:Node is ready 2020-11-16T21:36:43.695 INFO:teuthology.orchestra.run.smithi057:> hostname 2020-11-16T21:36:43.745 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2020-11-16T21:36:43.745 INFO:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2020-11-16T21:36:43.794 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2020-11-16T21:36:43.794 INFO:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2020-11-16T21:36:43.896 INFO:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2020-11-16T21:36:43.910 INFO:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2020-11-16T21:36:43.967 INFO:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2020-11-16T21:36:44.022 INFO:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2020-11-16T21:36:44.077 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2020-11-16T21:36:44.078 DEBUG:teuthology.parallel:result is None 2020-11-16T21:36:44.255 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2020-11-16T21:36:44.255 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-16T21:36:44.274 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com 2020-11-16T21:36:44.275 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-16T21:36:44.287 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2020-11-16T21:36:44.287 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-16T21:36:44.301 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2020-11-16T21:36:44.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T21:36:44.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:36:44.373 INFO:teuthology.orchestra.run.smithi195:> true 2020-11-16T21:36:44.615 INFO:teuthology.orchestra.run.smithi195:> uname -m 2020-11-16T21:36:44.663 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2020-11-16T21:36:44.664 INFO:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2020-11-16T21:36:44.711 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Ubuntu" 2020-11-16T21:36:44.711 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-11-16T21:36:44.712 INFO:teuthology.orchestra.run.smithi195.stdout:ID=ubuntu 2020-11-16T21:36:44.712 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE=debian 2020-11-16T21:36:44.712 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-11-16T21:36:44.712 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="18.04" 2020-11-16T21:36:44.712 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.ubuntu.com/" 2020-11-16T21:36:44.712 INFO:teuthology.orchestra.run.smithi195.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-11-16T21:36:44.712 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-11-16T21:36:44.713 INFO:teuthology.orchestra.run.smithi195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-11-16T21:36:44.713 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_CODENAME=bionic 2020-11-16T21:36:44.713 INFO:teuthology.orchestra.run.smithi195.stdout:UBUNTU_CODENAME=bionic 2020-11-16T21:36:44.714 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2020-11-16T21:36:44.795 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server 2020-11-16T21:36:44.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T21:36:44.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:36:44.860 INFO:teuthology.orchestra.run.smithi016:> true 2020-11-16T21:36:45.069 INFO:teuthology.orchestra.run.smithi016:> uname -m 2020-11-16T21:36:45.114 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2020-11-16T21:36:45.115 INFO:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2020-11-16T21:36:45.158 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Ubuntu" 2020-11-16T21:36:45.159 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-11-16T21:36:45.159 INFO:teuthology.orchestra.run.smithi016.stdout:ID=ubuntu 2020-11-16T21:36:45.159 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE=debian 2020-11-16T21:36:45.159 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-11-16T21:36:45.159 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="18.04" 2020-11-16T21:36:45.159 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.ubuntu.com/" 2020-11-16T21:36:45.159 INFO:teuthology.orchestra.run.smithi016.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-11-16T21:36:45.160 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-11-16T21:36:45.160 INFO:teuthology.orchestra.run.smithi016.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-11-16T21:36:45.160 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_CODENAME=bionic 2020-11-16T21:36:45.160 INFO:teuthology.orchestra.run.smithi016.stdout:UBUNTU_CODENAME=bionic 2020-11-16T21:36:45.160 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2020-11-16T21:36:45.176 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2020-11-16T21:36:45.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T21:36:45.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:36:45.252 INFO:teuthology.orchestra.run.smithi057:> true 2020-11-16T21:36:45.455 INFO:teuthology.orchestra.run.smithi057:> uname -m 2020-11-16T21:36:45.501 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2020-11-16T21:36:45.501 INFO:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2020-11-16T21:36:45.549 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2020-11-16T21:36:45.549 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-11-16T21:36:45.549 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2020-11-16T21:36:45.549 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2020-11-16T21:36:45.550 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-11-16T21:36:45.550 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="18.04" 2020-11-16T21:36:45.550 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2020-11-16T21:36:45.550 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-11-16T21:36:45.550 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-11-16T21:36:45.550 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-11-16T21:36:45.550 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=bionic 2020-11-16T21:36:45.551 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=bionic 2020-11-16T21:36:45.551 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2020-11-16T21:36:45.567 INFO:teuthology.task.internal.lock_machines:3 smithi machines locked this try, 3/3 locked so far 2020-11-16T21:36:45.623 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi016.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnyO1Yk16NmXMNp2Rygu5dwIgYCTs5y07MFPGLDLAOdyWRsnxvq+Ds4QR+ksbF4T7Au6jMZrVl75aVTrxjZDyN7S+GegUDkH9tlUCCyNiM1GjZDy0H4sizSF4VDn/La9/gWpGXrHnDEEafJ7Yh/eTNXVcXyxsMhM4lewOQ2qfTnokPlvURIVAB9L9sKjbYQObkgaONOHqGSrIO7orhMJU/t1iBW4BWBFH/y9xyUWKDMwh67PwduBJHOKFdVFE00QH2YnYEeNvb4IL1Ds6yeKILlwtrqzJkxzaZnW/MwTuX0IikhtQ+DTiyS91zImWzo6CrVeCdetn0a8lKbtYQ7XLX smithi057.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMeecbUbJ4QXBPuevYuXgAp7K2l69iUKH9dZZb5Y98/aS8J53ClD3f32cXL4IR9p5lfbzXYDiTnMbJdP0ZArxZOWUrrGOj2SENBs6I+zSrSeS0nX2YuXy+4rhsvAQKcg4glwfnpN4X03nln2YZxJ6KwbsDE17rCcVNdA0BF/RTYNroPJc4G17uGGWiEKehBGuDI8KJcQwtmj1R3Dz2j2iRaBw8UzEz5DflMYK63Cuq4VazNXT/D+yeeeUQF2rJ/inZOvFbEeiFpVjooJEr/bQesgbBLXdpdHEdKdPL3dE6TG38ByM4xRKUhg58EzJ5Rp46HuwgEfTqSJta/V1icSsJ smithi195.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ/AtkmvaCm3bNdYNaXXhWpu8JydogK30m2wQfB+7D9/m0WFX+SvV5unrmx1t/VsIPNkp1jHYsNtd4qXBIu9pjb6ecg+Td+cOYEbRROii5pZbfoexqBx1EuvQbFgb1WyryzdN8cqo2gZDppmhXBf/T7xSpCUvNzdXu2R/g5mtom8zama0saBJCgGv/J9lVmGvmPb2lRv9h/rwC46It9i0RY7unt8W806hhK6H2Zvp0Zla3WFOUg+qYT/AVsbUCv/Jqj873lOT91t8Ar3WOwYjrdYpbaY3MOndMuONfg2ebCvfYPFta4my4gvL/aqYXlSCUApsHI9cWv7u7ND2S3nuD 2020-11-16T21:36:45.623 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-16T21:36:45.681 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-11-16T21:36:45.690 INFO:teuthology.task.internal:Saving configuration 2020-11-16T21:36:45.704 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-11-16T21:36:45.715 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-11-16T21:36:45.731 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-16 21:31:17.557936', 'description': '/home/teuthworker/archive/kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi/5631168', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOVFuT6o61lpofZj5nG7/IwRTUXz6dkwqvt98ao5uf11', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi195.front.sepia.ceph.com'} 2020-11-16T21:36:45.745 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-16 21:31:17.557956', 'description': '/home/teuthworker/archive/kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi/5631168', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPtI3YRRm9Os17ILi3DLiy+DSwSXZ1B7rGJQHjRS9Mem', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi016.front.sepia.ceph.com'} 2020-11-16T21:36:45.760 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-16 21:31:17.557971', 'description': '/home/teuthworker/archive/kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi/5631168', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFna0IQl6PZ6Uf2Cb9Nu4bCS/Gg9sZvqBCfSIzwoitoK', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi057.front.sepia.ceph.com'} 2020-11-16T21:36:45.760 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-11-16T21:36:45.771 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2020-11-16T21:36:45.771 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2020-11-16T21:36:45.772 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.c', 'osd.8', 'osd.9', 'osd.10', 'osd.11', 'client.2'] 2020-11-16T21:36:45.772 INFO:teuthology.run_tasks:Running task console_log... 2020-11-16T21:36:45.864 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f559a00a158>, signals=[15]) 2020-11-16T21:36:45.865 INFO:teuthology.run_tasks:Running task internal.connect... 2020-11-16T21:36:45.876 INFO:teuthology.task.internal:Opening connections... 2020-11-16T21:36:45.876 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2020-11-16T21:36:45.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:36:45.955 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2020-11-16T21:36:45.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:36:46.028 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2020-11-16T21:36:46.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:36:46.105 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-11-16T21:36:46.116 INFO:teuthology.orchestra.run.smithi195:> uname -m 2020-11-16T21:36:46.157 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2020-11-16T21:36:46.157 INFO:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2020-11-16T21:36:46.203 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Ubuntu" 2020-11-16T21:36:46.203 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-11-16T21:36:46.203 INFO:teuthology.orchestra.run.smithi195.stdout:ID=ubuntu 2020-11-16T21:36:46.203 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE=debian 2020-11-16T21:36:46.204 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-11-16T21:36:46.204 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="18.04" 2020-11-16T21:36:46.204 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.ubuntu.com/" 2020-11-16T21:36:46.204 INFO:teuthology.orchestra.run.smithi195.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-11-16T21:36:46.204 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-11-16T21:36:46.204 INFO:teuthology.orchestra.run.smithi195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-11-16T21:36:46.204 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_CODENAME=bionic 2020-11-16T21:36:46.205 INFO:teuthology.orchestra.run.smithi195.stdout:UBUNTU_CODENAME=bionic 2020-11-16T21:36:46.205 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2020-11-16T21:36:46.220 INFO:teuthology.orchestra.run.smithi016:> uname -m 2020-11-16T21:36:46.234 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2020-11-16T21:36:46.234 INFO:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2020-11-16T21:36:46.281 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Ubuntu" 2020-11-16T21:36:46.281 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-11-16T21:36:46.281 INFO:teuthology.orchestra.run.smithi016.stdout:ID=ubuntu 2020-11-16T21:36:46.281 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE=debian 2020-11-16T21:36:46.281 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-11-16T21:36:46.282 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="18.04" 2020-11-16T21:36:46.282 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.ubuntu.com/" 2020-11-16T21:36:46.282 INFO:teuthology.orchestra.run.smithi016.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-11-16T21:36:46.282 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-11-16T21:36:46.282 INFO:teuthology.orchestra.run.smithi016.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-11-16T21:36:46.282 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_CODENAME=bionic 2020-11-16T21:36:46.283 INFO:teuthology.orchestra.run.smithi016.stdout:UBUNTU_CODENAME=bionic 2020-11-16T21:36:46.283 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2020-11-16T21:36:46.298 INFO:teuthology.orchestra.run.smithi057:> uname -m 2020-11-16T21:36:46.304 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2020-11-16T21:36:46.304 INFO:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2020-11-16T21:36:46.353 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2020-11-16T21:36:46.353 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-11-16T21:36:46.353 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2020-11-16T21:36:46.354 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2020-11-16T21:36:46.354 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-11-16T21:36:46.354 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="18.04" 2020-11-16T21:36:46.354 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2020-11-16T21:36:46.354 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-11-16T21:36:46.354 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-11-16T21:36:46.355 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-11-16T21:36:46.355 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=bionic 2020-11-16T21:36:46.355 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=bionic 2020-11-16T21:36:46.355 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2020-11-16T21:36:46.369 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-11-16T21:36:46.407 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-11-16T21:36:46.416 INFO:teuthology.task.internal:Checking for old test directory... 2020-11-16T21:36:46.416 INFO:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2020-11-16T21:36:46.418 INFO:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2020-11-16T21:36:46.420 INFO:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2020-11-16T21:36:46.426 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-11-16T21:36:46.435 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-11-16T21:36:46.436 INFO:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2020-11-16T21:36:46.465 INFO:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2020-11-16T21:36:46.469 INFO:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2020-11-16T21:36:46.478 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-11-16T21:36:46.537 INFO:teuthology.run_tasks:Running task kernel... 2020-11-16T21:36:46.555 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'osd.8': {'kdb': True, 'sha1': 'distro'}, 'osd.9': {'kdb': True, 'sha1': 'distro'}, 'osd.10': {'kdb': True, 'sha1': 'distro'}, 'osd.11': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}} 2020-11-16T21:36:46.555 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-11-16T21:36:46.556 INFO:teuthology.orchestra.run.smithi195:> uname -r 2020-11-16T21:36:46.562 INFO:teuthology.orchestra.run.smithi195.stdout:4.15.0-123-generic 2020-11-16T21:36:46.562 INFO:teuthology.task.kernel:Running kernel on smithi195: 4.15.0-123-generic 2020-11-16T21:36:46.562 INFO:teuthology.orchestra.run.smithi195:> sudo apt-get clean 2020-11-16T21:36:46.686 INFO:teuthology.orchestra.run.smithi195:> sudo apt-get update 2020-11-16T21:36:46.972 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-16T21:36:46.972 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-11-16T21:36:47.031 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-11-16T21:36:47.298 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-11-16T21:36:47.500 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,162 kB] 2020-11-16T21:36:47.849 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,761 kB] 2020-11-16T21:36:47.947 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [373 kB] 2020-11-16T21:36:47.964 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [17.4 kB] 2020-11-16T21:36:47.965 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [196 kB] 2020-11-16T21:36:47.974 INFO:teuthology.orchestra.run.smithi195.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [26.3 kB] 2020-11-16T21:36:47.974 INFO:teuthology.orchestra.run.smithi195.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,692 kB] 2020-11-16T21:36:48.018 INFO:teuthology.orchestra.run.smithi195.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,547 kB] 2020-11-16T21:36:48.068 INFO:teuthology.orchestra.run.smithi195.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [355 kB] 2020-11-16T21:36:48.075 INFO:teuthology.orchestra.run.smithi195.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [14.4 kB] 2020-11-16T21:36:48.075 INFO:teuthology.orchestra.run.smithi195.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [36.2 kB] 2020-11-16T21:36:48.076 INFO:teuthology.orchestra.run.smithi195.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [7,308 B] 2020-11-16T21:36:48.866 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 7,439 kB in 2s (3,792 kB/s) 2020-11-16T21:36:50.372 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2020-11-16T21:36:50.419 INFO:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-11-16T21:36:50.497 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2020-11-16T21:36:50.734 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2020-11-16T21:36:50.734 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2020-11-16T21:36:50.813 INFO:teuthology.orchestra.run.smithi195.stderr:E: Unable to locate package linux-image-current-generic 2020-11-16T21:36:50.815 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-11-16T21:36:50.815 INFO:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-11-16T21:36:50.892 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2020-11-16T21:36:51.157 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2020-11-16T21:36:51.158 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2020-11-16T21:36:51.329 INFO:teuthology.orchestra.run.smithi195.stdout:The following additional packages will be installed: 2020-11-16T21:36:51.329 INFO:teuthology.orchestra.run.smithi195.stdout: linux-generic linux-headers-4.15.0-124 linux-headers-4.15.0-124-generic 2020-11-16T21:36:51.330 INFO:teuthology.orchestra.run.smithi195.stdout: linux-headers-generic linux-image-4.15.0-124-generic 2020-11-16T21:36:51.330 INFO:teuthology.orchestra.run.smithi195.stdout: linux-modules-4.15.0-124-generic linux-modules-extra-4.15.0-124-generic 2020-11-16T21:36:51.331 INFO:teuthology.orchestra.run.smithi195.stdout:Suggested packages: 2020-11-16T21:36:51.332 INFO:teuthology.orchestra.run.smithi195.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-11-16T21:36:51.332 INFO:teuthology.orchestra.run.smithi195.stdout:Recommended packages: 2020-11-16T21:36:51.332 INFO:teuthology.orchestra.run.smithi195.stdout: thermald 2020-11-16T21:36:51.360 INFO:teuthology.orchestra.run.smithi195.stdout:The following NEW packages will be installed: 2020-11-16T21:36:51.360 INFO:teuthology.orchestra.run.smithi195.stdout: linux-headers-4.15.0-124 linux-headers-4.15.0-124-generic 2020-11-16T21:36:51.360 INFO:teuthology.orchestra.run.smithi195.stdout: linux-image-4.15.0-124-generic linux-modules-4.15.0-124-generic 2020-11-16T21:36:51.361 INFO:teuthology.orchestra.run.smithi195.stdout: linux-modules-extra-4.15.0-124-generic 2020-11-16T21:36:51.362 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages will be upgraded: 2020-11-16T21:36:51.363 INFO:teuthology.orchestra.run.smithi195.stdout: linux-generic linux-headers-generic linux-image-generic 2020-11-16T21:36:51.539 INFO:teuthology.orchestra.run.smithi195.stdout:3 upgraded, 5 newly installed, 0 to remove and 1 not upgraded. 2020-11-16T21:36:51.540 INFO:teuthology.orchestra.run.smithi195.stdout:Need to get 65.9 MB of archives. 2020-11-16T21:36:51.540 INFO:teuthology.orchestra.run.smithi195.stdout:After this operation, 333 MB of additional disk space will be used. 2020-11-16T21:36:51.540 INFO:teuthology.orchestra.run.smithi195.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-124-generic amd64 4.15.0-124.127 [13.1 MB] 2020-11-16T21:36:52.582 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-124-generic amd64 4.15.0-124.127 [8,012 kB] 2020-11-16T21:36:52.780 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-124-generic amd64 4.15.0-124.127 [32.8 MB] 2020-11-16T21:36:53.768 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.124.111 [1,868 B] 2020-11-16T21:36:53.769 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.124.111 [2,624 B] 2020-11-16T21:36:53.769 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-124 all 4.15.0-124.127 [10.9 MB] 2020-11-16T21:36:54.077 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-124-generic amd64 4.15.0-124.127 [1,084 kB] 2020-11-16T21:36:54.109 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.124.111 [2,520 B] 2020-11-16T21:36:54.573 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 65.9 MB in 3s (24.1 MB/s) 2020-11-16T21:36:54.715 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-modules-4.15.0-124-generic. 2020-11-16T21:36:54.755 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102077 files and directories currently installed.) 2020-11-16T21:36:54.757 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../0-linux-modules-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-16T21:36:54.800 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-modules-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:36:56.351 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-image-4.15.0-124-generic. 2020-11-16T21:36:56.364 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../1-linux-image-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-16T21:36:56.454 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-image-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:36:56.945 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-124-generic. 2020-11-16T21:36:56.957 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-16T21:36:56.987 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-modules-extra-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:37:00.612 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../3-linux-generic_4.15.0.124.111_amd64.deb ... 2020-11-16T21:37:00.723 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-generic (4.15.0.124.111) over (4.15.0.123.110) ... 2020-11-16T21:37:01.007 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.124.111_amd64.deb ... 2020-11-16T21:37:01.110 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-image-generic (4.15.0.124.111) over (4.15.0.123.110) ... 2020-11-16T21:37:01.446 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-headers-4.15.0-124. 2020-11-16T21:37:01.458 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../5-linux-headers-4.15.0-124_4.15.0-124.127_all.deb ... 2020-11-16T21:37:01.496 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-headers-4.15.0-124 (4.15.0-124.127) ... 2020-11-16T21:37:05.963 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-headers-4.15.0-124-generic. 2020-11-16T21:37:05.985 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../6-linux-headers-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-16T21:37:06.038 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-headers-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:37:08.420 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.124.111_amd64.deb ... 2020-11-16T21:37:08.543 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-headers-generic (4.15.0.124.111) over (4.15.0.123.110) ... 2020-11-16T21:37:08.878 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-modules-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:37:09.414 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-image-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:37:09.847 INFO:teuthology.orchestra.run.smithi195.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-124-generic 2020-11-16T21:37:09.847 INFO:teuthology.orchestra.run.smithi195.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-124-generic 2020-11-16T21:37:09.983 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-modules-extra-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:37:10.476 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-headers-4.15.0-124 (4.15.0-124.127) ... 2020-11-16T21:37:10.602 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-image-generic (4.15.0.124.111) ... 2020-11-16T21:37:10.729 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-headers-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:37:10.855 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-headers-generic (4.15.0.124.111) ... 2020-11-16T21:37:10.981 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-generic (4.15.0.124.111) ... 2020-11-16T21:37:11.107 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for linux-image-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:37:11.324 INFO:teuthology.orchestra.run.smithi195.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-11-16T21:37:11.324 INFO:teuthology.orchestra.run.smithi195.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-124-generic 2020-11-16T21:37:26.220 INFO:teuthology.orchestra.run.smithi195.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-11-16T21:37:26.221 INFO:teuthology.orchestra.run.smithi195.stdout:Sourcing file `/etc/default/grub' 2020-11-16T21:37:26.242 INFO:teuthology.orchestra.run.smithi195.stdout:Generating grub configuration file ... 2020-11-16T21:37:26.562 INFO:teuthology.orchestra.run.smithi195.stdout:Found linux image: /boot/vmlinuz-4.15.0-124-generic 2020-11-16T21:37:26.590 INFO:teuthology.orchestra.run.smithi195.stdout:Found initrd image: /boot/initrd.img-4.15.0-124-generic 2020-11-16T21:37:26.919 INFO:teuthology.orchestra.run.smithi195.stdout:Found linux image: /boot/vmlinuz-4.15.0-123-generic 2020-11-16T21:37:26.946 INFO:teuthology.orchestra.run.smithi195.stdout:Found initrd image: /boot/initrd.img-4.15.0-123-generic 2020-11-16T21:37:27.772 INFO:teuthology.orchestra.run.smithi195.stdout:done 2020-11-16T21:37:28.174 INFO:teuthology.orchestra.run.smithi195:> dpkg -s linux-image-generic 2020-11-16T21:37:28.197 INFO:teuthology.orchestra.run.smithi195.stdout:Package: linux-image-generic 2020-11-16T21:37:28.197 INFO:teuthology.orchestra.run.smithi195.stdout:Status: install ok installed 2020-11-16T21:37:28.198 INFO:teuthology.orchestra.run.smithi195.stdout:Priority: optional 2020-11-16T21:37:28.198 INFO:teuthology.orchestra.run.smithi195.stdout:Section: kernel 2020-11-16T21:37:28.198 INFO:teuthology.orchestra.run.smithi195.stdout:Installed-Size: 16 2020-11-16T21:37:28.198 INFO:teuthology.orchestra.run.smithi195.stdout:Maintainer: Ubuntu Kernel Team 2020-11-16T21:37:28.198 INFO:teuthology.orchestra.run.smithi195.stdout:Architecture: amd64 2020-11-16T21:37:28.198 INFO:teuthology.orchestra.run.smithi195.stdout:Source: linux-meta 2020-11-16T21:37:28.198 INFO:teuthology.orchestra.run.smithi195.stdout:Version: 4.15.0.124.111 2020-11-16T21:37:28.199 INFO:teuthology.orchestra.run.smithi195.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-11-16T21:37:28.199 INFO:teuthology.orchestra.run.smithi195.stdout:Depends: linux-image-4.15.0-124-generic, linux-modules-extra-4.15.0-124-generic, linux-firmware, intel-microcode, amd64-microcode 2020-11-16T21:37:28.199 INFO:teuthology.orchestra.run.smithi195.stdout:Recommends: thermald 2020-11-16T21:37:28.199 INFO:teuthology.orchestra.run.smithi195.stdout:Description: Generic Linux kernel image 2020-11-16T21:37:28.199 INFO:teuthology.orchestra.run.smithi195.stdout: This package will always depend on the latest generic kernel image 2020-11-16T21:37:28.199 INFO:teuthology.orchestra.run.smithi195.stdout: available. 2020-11-16T21:37:28.200 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-123-generic Expected: 4.15.0-124-generic 2020-11-16T21:37:28.200 INFO:teuthology.orchestra.run.smithi016:> uname -r 2020-11-16T21:37:28.206 INFO:teuthology.orchestra.run.smithi016.stdout:4.15.0-123-generic 2020-11-16T21:37:28.207 INFO:teuthology.task.kernel:Running kernel on smithi016: 4.15.0-123-generic 2020-11-16T21:37:28.207 INFO:teuthology.orchestra.run.smithi016:> sudo apt-get clean 2020-11-16T21:37:28.313 INFO:teuthology.orchestra.run.smithi016:> sudo apt-get update 2020-11-16T21:37:28.454 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-11-16T21:37:28.577 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-16T21:37:28.656 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-11-16T21:37:28.917 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-11-16T21:37:29.043 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,162 kB] 2020-11-16T21:37:29.405 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,761 kB] 2020-11-16T21:37:29.499 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [373 kB] 2020-11-16T21:37:29.509 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [196 kB] 2020-11-16T21:37:29.516 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [17.4 kB] 2020-11-16T21:37:29.517 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [26.3 kB] 2020-11-16T21:37:29.517 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,547 kB] 2020-11-16T21:37:29.582 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,692 kB] 2020-11-16T21:37:29.646 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [355 kB] 2020-11-16T21:37:29.653 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [36.2 kB] 2020-11-16T21:37:29.653 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [14.4 kB] 2020-11-16T21:37:29.654 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [7,308 B] 2020-11-16T21:37:30.453 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 7,439 kB in 2s (3,908 kB/s) 2020-11-16T21:37:32.024 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2020-11-16T21:37:32.073 INFO:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-11-16T21:37:32.156 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2020-11-16T21:37:32.420 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2020-11-16T21:37:32.421 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2020-11-16T21:37:32.504 INFO:teuthology.orchestra.run.smithi016.stderr:E: Unable to locate package linux-image-current-generic 2020-11-16T21:37:32.506 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-11-16T21:37:32.507 INFO:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-11-16T21:37:32.589 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2020-11-16T21:37:32.835 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2020-11-16T21:37:32.836 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2020-11-16T21:37:33.029 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2020-11-16T21:37:33.029 INFO:teuthology.orchestra.run.smithi016.stdout: linux-generic linux-headers-4.15.0-124 linux-headers-4.15.0-124-generic 2020-11-16T21:37:33.029 INFO:teuthology.orchestra.run.smithi016.stdout: linux-headers-generic linux-image-4.15.0-124-generic 2020-11-16T21:37:33.030 INFO:teuthology.orchestra.run.smithi016.stdout: linux-modules-4.15.0-124-generic linux-modules-extra-4.15.0-124-generic 2020-11-16T21:37:33.031 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2020-11-16T21:37:33.031 INFO:teuthology.orchestra.run.smithi016.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-11-16T21:37:33.032 INFO:teuthology.orchestra.run.smithi016.stdout:Recommended packages: 2020-11-16T21:37:33.032 INFO:teuthology.orchestra.run.smithi016.stdout: thermald 2020-11-16T21:37:33.059 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2020-11-16T21:37:33.059 INFO:teuthology.orchestra.run.smithi016.stdout: linux-headers-4.15.0-124 linux-headers-4.15.0-124-generic 2020-11-16T21:37:33.059 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-4.15.0-124-generic linux-modules-4.15.0-124-generic 2020-11-16T21:37:33.059 INFO:teuthology.orchestra.run.smithi016.stdout: linux-modules-extra-4.15.0-124-generic 2020-11-16T21:37:33.061 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages will be upgraded: 2020-11-16T21:37:33.062 INFO:teuthology.orchestra.run.smithi016.stdout: linux-generic linux-headers-generic linux-image-generic 2020-11-16T21:37:33.239 INFO:teuthology.orchestra.run.smithi016.stdout:3 upgraded, 5 newly installed, 0 to remove and 1 not upgraded. 2020-11-16T21:37:33.239 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 65.9 MB of archives. 2020-11-16T21:37:33.240 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 333 MB of additional disk space will be used. 2020-11-16T21:37:33.240 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-124-generic amd64 4.15.0-124.127 [13.1 MB] 2020-11-16T21:37:34.348 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-124-generic amd64 4.15.0-124.127 [8,012 kB] 2020-11-16T21:37:34.589 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-124-generic amd64 4.15.0-124.127 [32.8 MB] 2020-11-16T21:37:35.493 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.124.111 [1,868 B] 2020-11-16T21:37:35.493 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.124.111 [2,624 B] 2020-11-16T21:37:35.493 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-124 all 4.15.0-124.127 [10.9 MB] 2020-11-16T21:37:35.796 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-124-generic amd64 4.15.0-124.127 [1,084 kB] 2020-11-16T21:37:35.814 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.124.111 [2,520 B] 2020-11-16T21:37:36.356 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 65.9 MB in 3s (24.1 MB/s) 2020-11-16T21:37:36.530 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-modules-4.15.0-124-generic. 2020-11-16T21:37:36.566 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102077 files and directories currently installed.) 2020-11-16T21:37:36.569 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../0-linux-modules-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-16T21:37:36.631 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-modules-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:37:38.425 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-image-4.15.0-124-generic. 2020-11-16T21:37:38.437 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../1-linux-image-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-16T21:37:38.532 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-image-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:37:39.095 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-124-generic. 2020-11-16T21:37:39.107 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-16T21:37:39.145 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-modules-extra-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:37:43.261 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../3-linux-generic_4.15.0.124.111_amd64.deb ... 2020-11-16T21:37:43.382 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-generic (4.15.0.124.111) over (4.15.0.123.110) ... 2020-11-16T21:37:43.680 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.124.111_amd64.deb ... 2020-11-16T21:37:43.802 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-image-generic (4.15.0.124.111) over (4.15.0.123.110) ... 2020-11-16T21:37:44.147 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-headers-4.15.0-124. 2020-11-16T21:37:44.160 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../5-linux-headers-4.15.0-124_4.15.0-124.127_all.deb ... 2020-11-16T21:37:44.196 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-headers-4.15.0-124 (4.15.0-124.127) ... 2020-11-16T21:37:49.078 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-headers-4.15.0-124-generic. 2020-11-16T21:37:49.099 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../6-linux-headers-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-16T21:37:49.136 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-headers-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:37:51.639 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.124.111_amd64.deb ... 2020-11-16T21:37:51.765 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-headers-generic (4.15.0.124.111) over (4.15.0.123.110) ... 2020-11-16T21:37:52.100 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-modules-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:37:52.671 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-image-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:37:53.149 INFO:teuthology.orchestra.run.smithi016.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-124-generic 2020-11-16T21:37:53.150 INFO:teuthology.orchestra.run.smithi016.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-124-generic 2020-11-16T21:37:53.289 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-modules-extra-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:37:53.783 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-headers-4.15.0-124 (4.15.0-124.127) ... 2020-11-16T21:37:53.909 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-image-generic (4.15.0.124.111) ... 2020-11-16T21:37:54.035 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-headers-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:37:54.161 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-headers-generic (4.15.0.124.111) ... 2020-11-16T21:37:54.262 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-generic (4.15.0.124.111) ... 2020-11-16T21:37:54.372 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for linux-image-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:37:54.613 INFO:teuthology.orchestra.run.smithi016.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-11-16T21:37:54.613 INFO:teuthology.orchestra.run.smithi016.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-124-generic 2020-11-16T21:38:10.725 INFO:teuthology.orchestra.run.smithi016.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-11-16T21:38:10.725 INFO:teuthology.orchestra.run.smithi016.stdout:Sourcing file `/etc/default/grub' 2020-11-16T21:38:10.752 INFO:teuthology.orchestra.run.smithi016.stdout:Generating grub configuration file ... 2020-11-16T21:38:11.129 INFO:teuthology.orchestra.run.smithi016.stdout:Found linux image: /boot/vmlinuz-4.15.0-124-generic 2020-11-16T21:38:11.161 INFO:teuthology.orchestra.run.smithi016.stdout:Found initrd image: /boot/initrd.img-4.15.0-124-generic 2020-11-16T21:38:11.480 INFO:teuthology.orchestra.run.smithi016.stdout:Found linux image: /boot/vmlinuz-4.15.0-123-generic 2020-11-16T21:38:11.511 INFO:teuthology.orchestra.run.smithi016.stdout:Found initrd image: /boot/initrd.img-4.15.0-123-generic 2020-11-16T21:38:12.515 INFO:teuthology.orchestra.run.smithi016.stdout:done 2020-11-16T21:38:12.926 INFO:teuthology.orchestra.run.smithi016:> dpkg -s linux-image-generic 2020-11-16T21:38:12.949 INFO:teuthology.orchestra.run.smithi016.stdout:Package: linux-image-generic 2020-11-16T21:38:12.949 INFO:teuthology.orchestra.run.smithi016.stdout:Status: install ok installed 2020-11-16T21:38:12.949 INFO:teuthology.orchestra.run.smithi016.stdout:Priority: optional 2020-11-16T21:38:12.949 INFO:teuthology.orchestra.run.smithi016.stdout:Section: kernel 2020-11-16T21:38:12.949 INFO:teuthology.orchestra.run.smithi016.stdout:Installed-Size: 16 2020-11-16T21:38:12.950 INFO:teuthology.orchestra.run.smithi016.stdout:Maintainer: Ubuntu Kernel Team 2020-11-16T21:38:12.950 INFO:teuthology.orchestra.run.smithi016.stdout:Architecture: amd64 2020-11-16T21:38:12.950 INFO:teuthology.orchestra.run.smithi016.stdout:Source: linux-meta 2020-11-16T21:38:12.950 INFO:teuthology.orchestra.run.smithi016.stdout:Version: 4.15.0.124.111 2020-11-16T21:38:12.950 INFO:teuthology.orchestra.run.smithi016.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-11-16T21:38:12.950 INFO:teuthology.orchestra.run.smithi016.stdout:Depends: linux-image-4.15.0-124-generic, linux-modules-extra-4.15.0-124-generic, linux-firmware, intel-microcode, amd64-microcode 2020-11-16T21:38:12.950 INFO:teuthology.orchestra.run.smithi016.stdout:Recommends: thermald 2020-11-16T21:38:12.951 INFO:teuthology.orchestra.run.smithi016.stdout:Description: Generic Linux kernel image 2020-11-16T21:38:12.951 INFO:teuthology.orchestra.run.smithi016.stdout: This package will always depend on the latest generic kernel image 2020-11-16T21:38:12.951 INFO:teuthology.orchestra.run.smithi016.stdout: available. 2020-11-16T21:38:12.952 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-123-generic Expected: 4.15.0-124-generic 2020-11-16T21:38:12.952 INFO:teuthology.orchestra.run.smithi057:> uname -r 2020-11-16T21:38:12.958 INFO:teuthology.orchestra.run.smithi057.stdout:4.15.0-123-generic 2020-11-16T21:38:12.958 INFO:teuthology.task.kernel:Running kernel on smithi057: 4.15.0-123-generic 2020-11-16T21:38:12.959 INFO:teuthology.orchestra.run.smithi057:> sudo apt-get clean 2020-11-16T21:38:13.075 INFO:teuthology.orchestra.run.smithi057:> sudo apt-get update 2020-11-16T21:38:13.352 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-16T21:38:13.353 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-11-16T21:38:13.412 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-11-16T21:38:13.724 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-11-16T21:38:13.906 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,162 kB] 2020-11-16T21:38:14.262 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,761 kB] 2020-11-16T21:38:14.365 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [373 kB] 2020-11-16T21:38:14.380 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [17.4 kB] 2020-11-16T21:38:14.381 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [196 kB] 2020-11-16T21:38:14.390 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [26.3 kB] 2020-11-16T21:38:14.391 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,692 kB] 2020-11-16T21:38:14.436 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,547 kB] 2020-11-16T21:38:14.477 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [355 kB] 2020-11-16T21:38:14.495 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [36.2 kB] 2020-11-16T21:38:14.496 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [14.4 kB] 2020-11-16T21:38:14.496 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [7,308 B] 2020-11-16T21:38:15.338 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 7,439 kB in 2s (3,638 kB/s) 2020-11-16T21:38:16.905 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2020-11-16T21:38:16.953 INFO:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-11-16T21:38:17.034 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2020-11-16T21:38:17.272 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2020-11-16T21:38:17.273 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2020-11-16T21:38:17.356 INFO:teuthology.orchestra.run.smithi057.stderr:E: Unable to locate package linux-image-current-generic 2020-11-16T21:38:17.358 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-11-16T21:38:17.358 INFO:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-11-16T21:38:17.441 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2020-11-16T21:38:17.700 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2020-11-16T21:38:17.701 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2020-11-16T21:38:17.886 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2020-11-16T21:38:17.886 INFO:teuthology.orchestra.run.smithi057.stdout: linux-generic linux-headers-4.15.0-124 linux-headers-4.15.0-124-generic 2020-11-16T21:38:17.886 INFO:teuthology.orchestra.run.smithi057.stdout: linux-headers-generic linux-image-4.15.0-124-generic 2020-11-16T21:38:17.887 INFO:teuthology.orchestra.run.smithi057.stdout: linux-modules-4.15.0-124-generic linux-modules-extra-4.15.0-124-generic 2020-11-16T21:38:17.888 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2020-11-16T21:38:17.889 INFO:teuthology.orchestra.run.smithi057.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-11-16T21:38:17.889 INFO:teuthology.orchestra.run.smithi057.stdout:Recommended packages: 2020-11-16T21:38:17.889 INFO:teuthology.orchestra.run.smithi057.stdout: thermald 2020-11-16T21:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2020-11-16T21:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: linux-headers-4.15.0-124 linux-headers-4.15.0-124-generic 2020-11-16T21:38:17.916 INFO:teuthology.orchestra.run.smithi057.stdout: linux-image-4.15.0-124-generic linux-modules-4.15.0-124-generic 2020-11-16T21:38:17.917 INFO:teuthology.orchestra.run.smithi057.stdout: linux-modules-extra-4.15.0-124-generic 2020-11-16T21:38:17.918 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2020-11-16T21:38:17.919 INFO:teuthology.orchestra.run.smithi057.stdout: linux-generic linux-headers-generic linux-image-generic 2020-11-16T21:38:18.097 INFO:teuthology.orchestra.run.smithi057.stdout:3 upgraded, 5 newly installed, 0 to remove and 1 not upgraded. 2020-11-16T21:38:18.097 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 65.9 MB of archives. 2020-11-16T21:38:18.097 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 333 MB of additional disk space will be used. 2020-11-16T21:38:18.097 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-124-generic amd64 4.15.0-124.127 [13.1 MB] 2020-11-16T21:38:19.081 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-124-generic amd64 4.15.0-124.127 [8,012 kB] 2020-11-16T21:38:19.327 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-124-generic amd64 4.15.0-124.127 [32.8 MB] 2020-11-16T21:38:20.296 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.124.111 [1,868 B] 2020-11-16T21:38:20.297 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.124.111 [2,624 B] 2020-11-16T21:38:20.297 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-124 all 4.15.0-124.127 [10.9 MB] 2020-11-16T21:38:20.602 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-124-generic amd64 4.15.0-124.127 [1,084 kB] 2020-11-16T21:38:20.647 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.124.111 [2,520 B] 2020-11-16T21:38:21.133 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 65.9 MB in 3s (24.3 MB/s) 2020-11-16T21:38:21.281 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-modules-4.15.0-124-generic. 2020-11-16T21:38:21.320 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102077 files and directories currently installed.) 2020-11-16T21:38:21.323 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../0-linux-modules-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-16T21:38:21.366 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-modules-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:38:22.927 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-image-4.15.0-124-generic. 2020-11-16T21:38:22.940 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../1-linux-image-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-16T21:38:23.049 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-image-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:38:23.580 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-124-generic. 2020-11-16T21:38:23.593 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-16T21:38:23.630 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-modules-extra-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:38:27.343 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../3-linux-generic_4.15.0.124.111_amd64.deb ... 2020-11-16T21:38:27.472 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-generic (4.15.0.124.111) over (4.15.0.123.110) ... 2020-11-16T21:38:27.802 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.124.111_amd64.deb ... 2020-11-16T21:38:27.916 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-image-generic (4.15.0.124.111) over (4.15.0.123.110) ... 2020-11-16T21:38:28.344 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-headers-4.15.0-124. 2020-11-16T21:38:28.357 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../5-linux-headers-4.15.0-124_4.15.0-124.127_all.deb ... 2020-11-16T21:38:28.394 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-4.15.0-124 (4.15.0-124.127) ... 2020-11-16T21:38:33.147 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-headers-4.15.0-124-generic. 2020-11-16T21:38:33.170 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../6-linux-headers-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-16T21:38:33.213 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:38:35.693 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.124.111_amd64.deb ... 2020-11-16T21:38:35.817 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-generic (4.15.0.124.111) over (4.15.0.123.110) ... 2020-11-16T21:38:36.134 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-modules-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:38:36.721 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-image-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:38:37.173 INFO:teuthology.orchestra.run.smithi057.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-124-generic 2020-11-16T21:38:37.173 INFO:teuthology.orchestra.run.smithi057.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-124-generic 2020-11-16T21:38:37.306 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-modules-extra-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:38:37.799 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-4.15.0-124 (4.15.0-124.127) ... 2020-11-16T21:38:37.925 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-image-generic (4.15.0.124.111) ... 2020-11-16T21:38:38.051 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:38:38.160 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-generic (4.15.0.124.111) ... 2020-11-16T21:38:38.261 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-generic (4.15.0.124.111) ... 2020-11-16T21:38:38.929 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for linux-image-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-16T21:38:39.138 INFO:teuthology.orchestra.run.smithi057.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-11-16T21:38:39.139 INFO:teuthology.orchestra.run.smithi057.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-124-generic 2020-11-16T21:38:53.809 INFO:teuthology.orchestra.run.smithi057.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-11-16T21:38:53.810 INFO:teuthology.orchestra.run.smithi057.stdout:Sourcing file `/etc/default/grub' 2020-11-16T21:38:53.829 INFO:teuthology.orchestra.run.smithi057.stdout:Generating grub configuration file ... 2020-11-16T21:38:54.152 INFO:teuthology.orchestra.run.smithi057.stdout:Found linux image: /boot/vmlinuz-4.15.0-124-generic 2020-11-16T21:38:54.179 INFO:teuthology.orchestra.run.smithi057.stdout:Found initrd image: /boot/initrd.img-4.15.0-124-generic 2020-11-16T21:38:58.299 INFO:teuthology.orchestra.run.smithi057.stdout:Found linux image: /boot/vmlinuz-4.15.0-123-generic 2020-11-16T21:38:58.300 INFO:teuthology.orchestra.run.smithi057.stdout:Found initrd image: /boot/initrd.img-4.15.0-123-generic 2020-11-16T21:38:58.300 INFO:teuthology.orchestra.run.smithi057.stdout:done 2020-11-16T21:38:58.300 INFO:teuthology.orchestra.run.smithi057:> dpkg -s linux-image-generic 2020-11-16T21:38:58.323 INFO:teuthology.orchestra.run.smithi057.stdout:Package: linux-image-generic 2020-11-16T21:38:58.323 INFO:teuthology.orchestra.run.smithi057.stdout:Status: install ok installed 2020-11-16T21:38:58.324 INFO:teuthology.orchestra.run.smithi057.stdout:Priority: optional 2020-11-16T21:38:58.324 INFO:teuthology.orchestra.run.smithi057.stdout:Section: kernel 2020-11-16T21:38:58.324 INFO:teuthology.orchestra.run.smithi057.stdout:Installed-Size: 16 2020-11-16T21:38:58.324 INFO:teuthology.orchestra.run.smithi057.stdout:Maintainer: Ubuntu Kernel Team 2020-11-16T21:38:58.324 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: amd64 2020-11-16T21:38:58.324 INFO:teuthology.orchestra.run.smithi057.stdout:Source: linux-meta 2020-11-16T21:38:58.325 INFO:teuthology.orchestra.run.smithi057.stdout:Version: 4.15.0.124.111 2020-11-16T21:38:58.325 INFO:teuthology.orchestra.run.smithi057.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-11-16T21:38:58.325 INFO:teuthology.orchestra.run.smithi057.stdout:Depends: linux-image-4.15.0-124-generic, linux-modules-extra-4.15.0-124-generic, linux-firmware, intel-microcode, amd64-microcode 2020-11-16T21:38:58.325 INFO:teuthology.orchestra.run.smithi057.stdout:Recommends: thermald 2020-11-16T21:38:58.325 INFO:teuthology.orchestra.run.smithi057.stdout:Description: Generic Linux kernel image 2020-11-16T21:38:58.325 INFO:teuthology.orchestra.run.smithi057.stdout: This package will always depend on the latest generic kernel image 2020-11-16T21:38:58.325 INFO:teuthology.orchestra.run.smithi057.stdout: available. 2020-11-16T21:38:58.326 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-123-generic Expected: 4.15.0-124-generic 2020-11-16T21:38:58.326 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-11-16T21:38:58.326 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-11-16T21:38:58.326 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-11-16T21:38:58.326 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-11-16T21:38:58.327 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2020-11-16T21:38:58.327 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi195.front.sepia.ceph.com, path=None, version=distro) 2020-11-16T21:38:58.327 INFO:teuthology.orchestra.run.smithi195:> sudo apt-get clean 2020-11-16T21:38:58.379 INFO:teuthology.orchestra.run.smithi195:> sudo apt-get update 2020-11-16T21:38:58.504 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-11-16T21:38:58.615 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-16T21:38:58.693 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-11-16T21:38:58.772 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-11-16T21:39:00.387 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2020-11-16T21:39:00.435 INFO:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-11-16T21:39:00.513 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2020-11-16T21:39:00.760 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2020-11-16T21:39:00.760 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2020-11-16T21:39:00.840 INFO:teuthology.orchestra.run.smithi195.stderr:E: Unable to locate package linux-image-current-generic 2020-11-16T21:39:00.842 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-11-16T21:39:00.842 INFO:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-11-16T21:39:00.917 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2020-11-16T21:39:01.145 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2020-11-16T21:39:01.146 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2020-11-16T21:39:01.341 INFO:teuthology.orchestra.run.smithi195.stdout:linux-image-generic is already the newest version (4.15.0.124.111). 2020-11-16T21:39:01.341 INFO:teuthology.orchestra.run.smithi195.stdout:0 upgraded, 0 newly installed, 0 to remove and 1 not upgraded. 2020-11-16T21:39:01.343 INFO:teuthology.orchestra.run.smithi195:> dpkg -s linux-image-generic 2020-11-16T21:39:01.363 INFO:teuthology.orchestra.run.smithi195.stdout:Package: linux-image-generic 2020-11-16T21:39:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:Status: install ok installed 2020-11-16T21:39:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:Priority: optional 2020-11-16T21:39:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:Section: kernel 2020-11-16T21:39:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:Installed-Size: 16 2020-11-16T21:39:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:Maintainer: Ubuntu Kernel Team 2020-11-16T21:39:01.364 INFO:teuthology.orchestra.run.smithi195.stdout:Architecture: amd64 2020-11-16T21:39:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:Source: linux-meta 2020-11-16T21:39:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:Version: 4.15.0.124.111 2020-11-16T21:39:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-11-16T21:39:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:Depends: linux-image-4.15.0-124-generic, linux-modules-extra-4.15.0-124-generic, linux-firmware, intel-microcode, amd64-microcode 2020-11-16T21:39:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:Recommends: thermald 2020-11-16T21:39:01.365 INFO:teuthology.orchestra.run.smithi195.stdout:Description: Generic Linux kernel image 2020-11-16T21:39:01.365 INFO:teuthology.orchestra.run.smithi195.stdout: This package will always depend on the latest generic kernel image 2020-11-16T21:39:01.366 INFO:teuthology.orchestra.run.smithi195.stdout: available. 2020-11-16T21:39:01.366 INFO:teuthology.orchestra.run.smithi195:> mktemp 2020-11-16T21:39:01.412 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.Dx9TnBNiCQ 2020-11-16T21:39:01.413 INFO:teuthology.orchestra.run.smithi195:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Dx9TnBNiCQ 2020-11-16T21:39:01.470 INFO:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.Dx9TnBNiCQ 2020-11-16T21:39:01.584 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.Dx9TnBNiCQ is 8KB 2020-11-16T21:39:01.632 INFO:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.Dx9TnBNiCQ 2020-11-16T21:39:01.638 INFO:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-11-16T21:39:01.693 INFO:teuthology.orchestra.run.smithi195:> set -ex 2020-11-16T21:39:01.694 INFO:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/grub.d/01_ceph_kernel 2020-11-16T21:39:01.694 INFO:teuthology.orchestra.run.smithi195:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-11-16T21:39:01.739 INFO:teuthology.orchestra.run.smithi195.stderr:+ sudo dd of=/etc/grub.d/01_ceph_kernel 2020-11-16T21:39:01.751 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2020-11-16T21:39:01.752 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2020-11-16T21:39:01.752 INFO:teuthology.orchestra.run.smithi195.stderr:93 bytes copied, 3.0389e-05 s, 3.1 MB/s 2020-11-16T21:39:01.752 INFO:teuthology.orchestra.run.smithi195.stderr:+ sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-11-16T21:39:01.762 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-124-generic 2020-11-16T21:39:01.763 INFO:teuthology.orchestra.run.smithi195:> sudo update-grub 2020-11-16T21:39:02.985 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub' 2020-11-16T21:39:03.010 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2020-11-16T21:39:03.256 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-4.15.0-124-generic 2020-11-16T21:39:03.267 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-4.15.0-124-generic 2020-11-16T21:39:03.571 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-4.15.0-123-generic 2020-11-16T21:39:03.584 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-4.15.0-123-generic 2020-11-16T21:39:04.179 INFO:teuthology.orchestra.run.smithi195.stderr:done 2020-11-16T21:39:04.181 INFO:teuthology.orchestra.run.smithi195:> sudo shutdown -r now 2020-11-16T21:39:04.183 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2020-11-16T21:39:04.184 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi016.front.sepia.ceph.com, path=None, version=distro) 2020-11-16T21:39:04.184 INFO:teuthology.orchestra.run.smithi016:> sudo apt-get clean 2020-11-16T21:39:04.285 INFO:teuthology.orchestra.run.smithi016:> sudo apt-get update 2020-11-16T21:39:04.419 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-11-16T21:39:04.533 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-16T21:39:04.612 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-11-16T21:39:04.692 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-11-16T21:39:06.359 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2020-11-16T21:39:06.409 INFO:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-11-16T21:39:06.488 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2020-11-16T21:39:06.736 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2020-11-16T21:39:06.737 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2020-11-16T21:39:06.822 INFO:teuthology.orchestra.run.smithi016.stderr:E: Unable to locate package linux-image-current-generic 2020-11-16T21:39:06.824 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-11-16T21:39:06.824 INFO:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-11-16T21:39:06.906 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2020-11-16T21:39:07.147 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2020-11-16T21:39:07.148 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2020-11-16T21:39:07.357 INFO:teuthology.orchestra.run.smithi016.stdout:linux-image-generic is already the newest version (4.15.0.124.111). 2020-11-16T21:39:07.357 INFO:teuthology.orchestra.run.smithi016.stdout:0 upgraded, 0 newly installed, 0 to remove and 1 not upgraded. 2020-11-16T21:39:07.359 INFO:teuthology.orchestra.run.smithi016:> dpkg -s linux-image-generic 2020-11-16T21:39:07.380 INFO:teuthology.orchestra.run.smithi016.stdout:Package: linux-image-generic 2020-11-16T21:39:07.381 INFO:teuthology.orchestra.run.smithi016.stdout:Status: install ok installed 2020-11-16T21:39:07.381 INFO:teuthology.orchestra.run.smithi016.stdout:Priority: optional 2020-11-16T21:39:07.381 INFO:teuthology.orchestra.run.smithi016.stdout:Section: kernel 2020-11-16T21:39:07.381 INFO:teuthology.orchestra.run.smithi016.stdout:Installed-Size: 16 2020-11-16T21:39:07.381 INFO:teuthology.orchestra.run.smithi016.stdout:Maintainer: Ubuntu Kernel Team 2020-11-16T21:39:07.381 INFO:teuthology.orchestra.run.smithi016.stdout:Architecture: amd64 2020-11-16T21:39:07.381 INFO:teuthology.orchestra.run.smithi016.stdout:Source: linux-meta 2020-11-16T21:39:07.382 INFO:teuthology.orchestra.run.smithi016.stdout:Version: 4.15.0.124.111 2020-11-16T21:39:07.382 INFO:teuthology.orchestra.run.smithi016.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-11-16T21:39:07.382 INFO:teuthology.orchestra.run.smithi016.stdout:Depends: linux-image-4.15.0-124-generic, linux-modules-extra-4.15.0-124-generic, linux-firmware, intel-microcode, amd64-microcode 2020-11-16T21:39:07.382 INFO:teuthology.orchestra.run.smithi016.stdout:Recommends: thermald 2020-11-16T21:39:07.382 INFO:teuthology.orchestra.run.smithi016.stdout:Description: Generic Linux kernel image 2020-11-16T21:39:07.382 INFO:teuthology.orchestra.run.smithi016.stdout: This package will always depend on the latest generic kernel image 2020-11-16T21:39:07.383 INFO:teuthology.orchestra.run.smithi016.stdout: available. 2020-11-16T21:39:07.383 INFO:teuthology.orchestra.run.smithi016:> mktemp 2020-11-16T21:39:07.426 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.W8Lhvy70AJ 2020-11-16T21:39:07.427 INFO:teuthology.orchestra.run.smithi016:> sudo cp /boot/grub/grub.cfg /tmp/tmp.W8Lhvy70AJ 2020-11-16T21:39:07.494 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.W8Lhvy70AJ 2020-11-16T21:39:07.612 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.W8Lhvy70AJ is 8KB 2020-11-16T21:39:07.621 INFO:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.W8Lhvy70AJ 2020-11-16T21:39:07.628 INFO:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-11-16T21:39:07.685 INFO:teuthology.orchestra.run.smithi016:> set -ex 2020-11-16T21:39:07.687 INFO:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/grub.d/01_ceph_kernel 2020-11-16T21:39:07.687 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-11-16T21:39:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:+ sudo dd of=/etc/grub.d/01_ceph_kernel 2020-11-16T21:39:07.797 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2020-11-16T21:39:07.797 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2020-11-16T21:39:07.799 INFO:teuthology.orchestra.run.smithi016.stderr:93 bytes copied, 0.032822 s, 2.8 kB/s 2020-11-16T21:39:07.800 INFO:teuthology.orchestra.run.smithi016.stderr:+ sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-11-16T21:39:07.808 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-124-generic 2020-11-16T21:39:07.809 INFO:teuthology.orchestra.run.smithi016:> sudo update-grub 2020-11-16T21:39:09.253 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub' 2020-11-16T21:39:09.269 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2020-11-16T21:39:09.515 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-4.15.0-124-generic 2020-11-16T21:39:09.527 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-4.15.0-124-generic 2020-11-16T21:39:09.886 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-4.15.0-123-generic 2020-11-16T21:39:09.899 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-4.15.0-123-generic 2020-11-16T21:39:10.507 INFO:teuthology.orchestra.run.smithi016.stderr:done 2020-11-16T21:39:10.508 INFO:teuthology.orchestra.run.smithi016:> sudo shutdown -r now 2020-11-16T21:39:10.511 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2020-11-16T21:39:10.511 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi057.front.sepia.ceph.com, path=None, version=distro) 2020-11-16T21:39:10.511 INFO:teuthology.orchestra.run.smithi057:> sudo apt-get clean 2020-11-16T21:39:10.553 INFO:teuthology.orchestra.run.smithi057:> sudo apt-get update 2020-11-16T21:39:10.844 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-16T21:39:10.844 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:2 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-11-16T21:39:10.911 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-11-16T21:39:10.996 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-11-16T21:39:12.775 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2020-11-16T21:39:12.823 INFO:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-11-16T21:39:12.903 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2020-11-16T21:39:13.150 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2020-11-16T21:39:13.150 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2020-11-16T21:39:13.233 INFO:teuthology.orchestra.run.smithi057.stderr:E: Unable to locate package linux-image-current-generic 2020-11-16T21:39:13.235 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-11-16T21:39:13.236 INFO:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-11-16T21:39:13.313 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2020-11-16T21:39:13.550 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2020-11-16T21:39:13.550 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2020-11-16T21:39:13.757 INFO:teuthology.orchestra.run.smithi057.stdout:linux-image-generic is already the newest version (4.15.0.124.111). 2020-11-16T21:39:13.757 INFO:teuthology.orchestra.run.smithi057.stdout:0 upgraded, 0 newly installed, 0 to remove and 1 not upgraded. 2020-11-16T21:39:13.759 INFO:teuthology.orchestra.run.smithi057:> dpkg -s linux-image-generic 2020-11-16T21:39:13.780 INFO:teuthology.orchestra.run.smithi057.stdout:Package: linux-image-generic 2020-11-16T21:39:13.780 INFO:teuthology.orchestra.run.smithi057.stdout:Status: install ok installed 2020-11-16T21:39:13.780 INFO:teuthology.orchestra.run.smithi057.stdout:Priority: optional 2020-11-16T21:39:13.780 INFO:teuthology.orchestra.run.smithi057.stdout:Section: kernel 2020-11-16T21:39:13.780 INFO:teuthology.orchestra.run.smithi057.stdout:Installed-Size: 16 2020-11-16T21:39:13.780 INFO:teuthology.orchestra.run.smithi057.stdout:Maintainer: Ubuntu Kernel Team 2020-11-16T21:39:13.781 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: amd64 2020-11-16T21:39:13.781 INFO:teuthology.orchestra.run.smithi057.stdout:Source: linux-meta 2020-11-16T21:39:13.781 INFO:teuthology.orchestra.run.smithi057.stdout:Version: 4.15.0.124.111 2020-11-16T21:39:13.781 INFO:teuthology.orchestra.run.smithi057.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-11-16T21:39:13.781 INFO:teuthology.orchestra.run.smithi057.stdout:Depends: linux-image-4.15.0-124-generic, linux-modules-extra-4.15.0-124-generic, linux-firmware, intel-microcode, amd64-microcode 2020-11-16T21:39:13.781 INFO:teuthology.orchestra.run.smithi057.stdout:Recommends: thermald 2020-11-16T21:39:13.781 INFO:teuthology.orchestra.run.smithi057.stdout:Description: Generic Linux kernel image 2020-11-16T21:39:13.782 INFO:teuthology.orchestra.run.smithi057.stdout: This package will always depend on the latest generic kernel image 2020-11-16T21:39:13.782 INFO:teuthology.orchestra.run.smithi057.stdout: available. 2020-11-16T21:39:13.782 INFO:teuthology.orchestra.run.smithi057:> mktemp 2020-11-16T21:39:13.826 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.TwjKcTflqi 2020-11-16T21:39:13.827 INFO:teuthology.orchestra.run.smithi057:> sudo cp /boot/grub/grub.cfg /tmp/tmp.TwjKcTflqi 2020-11-16T21:39:13.892 INFO:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.TwjKcTflqi 2020-11-16T21:39:14.007 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.TwjKcTflqi is 8KB 2020-11-16T21:39:14.017 INFO:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.TwjKcTflqi 2020-11-16T21:39:14.023 INFO:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-11-16T21:39:14.079 INFO:teuthology.orchestra.run.smithi057:> set -ex 2020-11-16T21:39:14.079 INFO:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/grub.d/01_ceph_kernel 2020-11-16T21:39:14.080 INFO:teuthology.orchestra.run.smithi057:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-11-16T21:39:14.125 INFO:teuthology.orchestra.run.smithi057.stderr:+ sudo dd of=/etc/grub.d/01_ceph_kernel 2020-11-16T21:39:14.141 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records in 2020-11-16T21:39:14.142 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records out 2020-11-16T21:39:14.142 INFO:teuthology.orchestra.run.smithi057.stderr:93 bytes copied, 3.3489e-05 s, 2.8 MB/s 2020-11-16T21:39:14.142 INFO:teuthology.orchestra.run.smithi057.stderr:+ sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-11-16T21:39:14.152 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-124-generic 2020-11-16T21:39:14.153 INFO:teuthology.orchestra.run.smithi057:> sudo update-grub 2020-11-16T21:39:15.279 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub' 2020-11-16T21:39:15.292 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2020-11-16T21:39:15.515 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-4.15.0-124-generic 2020-11-16T21:39:15.528 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-4.15.0-124-generic 2020-11-16T21:39:15.829 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-4.15.0-123-generic 2020-11-16T21:39:15.843 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-4.15.0-123-generic 2020-11-16T21:39:16.445 INFO:teuthology.orchestra.run.smithi057.stderr:done 2020-11-16T21:39:16.447 INFO:teuthology.orchestra.run.smithi057:> sudo shutdown -r now 2020-11-16T21:39:46.450 INFO:teuthology.misc:Re-opening connections... 2020-11-16T21:39:46.451 INFO:teuthology.misc:trying to connect to ubuntu@smithi195.front.sepia.ceph.com 2020-11-16T21:39:46.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T21:39:46.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:40:04.798 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2020-11-16T21:40:04.799 INFO:teuthology.misc:trying to connect to ubuntu@smithi016.front.sepia.ceph.com 2020-11-16T21:40:04.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T21:40:04.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:40:36.286 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2020-11-16T21:40:36.287 INFO:teuthology.misc:trying to connect to ubuntu@smithi057.front.sepia.ceph.com 2020-11-16T21:40:36.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T21:40:36.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:40:51.646 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2020-11-16T21:40:51.647 DEBUG:teuthology.misc:waited 65.19605469703674 2020-11-16T21:40:52.648 INFO:teuthology.misc:trying to connect to ubuntu@smithi195.front.sepia.ceph.com 2020-11-16T21:40:52.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T21:40:52.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:40:52.802 INFO:teuthology.orchestra.run.smithi195:> true 2020-11-16T21:40:53.147 INFO:teuthology.misc:trying to connect to ubuntu@smithi057.front.sepia.ceph.com 2020-11-16T21:40:53.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T21:40:53.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:40:53.149 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2020-11-16T21:40:53.150 DEBUG:teuthology.misc:waited 66.69878149032593 2020-11-16T21:40:54.150 INFO:teuthology.misc:trying to connect to ubuntu@smithi016.front.sepia.ceph.com 2020-11-16T21:40:54.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T21:40:54.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:40:54.229 INFO:teuthology.orchestra.run.smithi016:> true 2020-11-16T21:40:54.571 DEBUG:teuthology.misc:waited 68.11969327926636 2020-11-16T21:40:55.572 INFO:teuthology.misc:trying to connect to ubuntu@smithi057.front.sepia.ceph.com 2020-11-16T21:40:55.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T21:40:55.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:40:55.574 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2020-11-16T21:40:55.574 DEBUG:teuthology.misc:waited 69.12357139587402 2020-11-16T21:40:56.575 INFO:teuthology.misc:trying to connect to ubuntu@smithi057.front.sepia.ceph.com 2020-11-16T21:40:56.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T21:40:56.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:40:56.789 DEBUG:teuthology.orchestra.remote:No existing session 2020-11-16T21:40:56.789 DEBUG:teuthology.misc:waited 70.33843183517456 2020-11-16T21:40:57.790 INFO:teuthology.misc:trying to connect to ubuntu@smithi057.front.sepia.ceph.com 2020-11-16T21:40:57.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T21:40:57.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:40:57.853 INFO:teuthology.orchestra.run.smithi057:> true 2020-11-16T21:40:58.550 DEBUG:teuthology.misc:waited 72.09913945198059 2020-11-16T21:40:59.551 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2020-11-16T21:40:59.552 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.15.0-124-generic"... 2020-11-16T21:40:59.552 INFO:teuthology.orchestra.run.smithi195:> uname -r 2020-11-16T21:40:59.558 INFO:teuthology.orchestra.run.smithi195.stdout:4.15.0-124-generic 2020-11-16T21:40:59.559 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-124-generic vs 4.15.0-124-generic 2020-11-16T21:40:59.559 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-11-16T21:40:59.559 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2020-11-16T21:40:59.560 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2020-11-16T21:40:59.560 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.15.0-124-generic"... 2020-11-16T21:40:59.560 INFO:teuthology.orchestra.run.smithi016:> uname -r 2020-11-16T21:40:59.566 INFO:teuthology.orchestra.run.smithi016.stdout:4.15.0-124-generic 2020-11-16T21:40:59.566 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-124-generic vs 4.15.0-124-generic 2020-11-16T21:40:59.566 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-11-16T21:40:59.567 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2020-11-16T21:40:59.567 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2020-11-16T21:40:59.567 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "4.15.0-124-generic"... 2020-11-16T21:40:59.567 INFO:teuthology.orchestra.run.smithi057:> uname -r 2020-11-16T21:40:59.573 INFO:teuthology.orchestra.run.smithi057.stdout:4.15.0-124-generic 2020-11-16T21:40:59.574 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-124-generic vs 4.15.0-124-generic 2020-11-16T21:40:59.574 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-11-16T21:40:59.574 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2020-11-16T21:41:00.575 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-11-16T21:41:00.575 INFO:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-11-16T21:41:00.663 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2020-11-16T21:41:00.686 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-11-16T21:41:00.686 INFO:teuthology.orchestra.run.smithi016:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-11-16T21:41:00.721 INFO:teuthology.orchestra.run.smithi016.stdout:ttyS1 2020-11-16T21:41:00.747 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2020-11-16T21:41:00.748 INFO:teuthology.orchestra.run.smithi057:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-11-16T21:41:00.782 INFO:teuthology.orchestra.run.smithi057.stdout:ttyS1 2020-11-16T21:41:00.806 INFO:teuthology.run_tasks:Running task internal.base... 2020-11-16T21:41:00.815 INFO:teuthology.task.internal:Creating test directory... 2020-11-16T21:41:00.815 INFO:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-16T21:41:00.818 INFO:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-16T21:41:00.849 INFO:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-16T21:41:00.855 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-11-16T21:41:00.862 INFO:teuthology.run_tasks:Running task internal.archive... 2020-11-16T21:41:00.874 INFO:teuthology.task.internal:Creating archive directory... 2020-11-16T21:41:00.875 INFO:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-16T21:41:00.877 INFO:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-16T21:41:00.897 INFO:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-16T21:41:00.910 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-11-16T21:41:00.917 INFO:teuthology.task.internal:Enabling coredump saving... 2020-11-16T21:41:00.918 INFO:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-16T21:41:00.927 INFO:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-16T21:41:00.949 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-16T21:41:00.953 INFO:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-16T21:41:00.956 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-16T21:41:00.972 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-16T21:41:00.973 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-16T21:41:00.979 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-16T21:41:00.981 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-16T21:41:00.981 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-11-16T21:41:00.988 INFO:teuthology.task.internal:Configuring sudo... 2020-11-16T21:41:00.989 INFO:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-16T21:41:01.002 INFO:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-16T21:41:01.025 INFO:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-16T21:41:01.041 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-11-16T21:41:01.049 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-11-16T21:41:01.049 INFO:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-16T21:41:01.058 INFO:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-16T21:41:01.081 INFO:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-16T21:41:01.090 INFO:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-16T21:41:01.138 INFO:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-16T21:41:01.186 INFO:teuthology.orchestra.run.smithi195:> set -ex 2020-11-16T21:41:01.186 INFO:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-16T21:41:01.232 INFO:teuthology.orchestra.run.smithi195.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-16T21:41:01.249 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2020-11-16T21:41:01.250 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2020-11-16T21:41:01.250 INFO:teuthology.orchestra.run.smithi195.stderr:152 bytes copied, 3.2302e-05 s, 4.7 MB/s 2020-11-16T21:41:01.251 INFO:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-16T21:41:01.257 INFO:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-16T21:41:01.307 INFO:teuthology.orchestra.run.smithi016:> set -ex 2020-11-16T21:41:01.308 INFO:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-16T21:41:01.353 INFO:teuthology.orchestra.run.smithi016.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-16T21:41:01.373 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2020-11-16T21:41:01.374 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2020-11-16T21:41:01.374 INFO:teuthology.orchestra.run.smithi016.stderr:152 bytes copied, 3.3279e-05 s, 4.6 MB/s 2020-11-16T21:41:01.375 INFO:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-16T21:41:01.381 INFO:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-16T21:41:01.430 INFO:teuthology.orchestra.run.smithi057:> set -ex 2020-11-16T21:41:01.430 INFO:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-16T21:41:01.476 INFO:teuthology.orchestra.run.smithi057.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-16T21:41:01.491 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records in 2020-11-16T21:41:01.492 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records out 2020-11-16T21:41:01.492 INFO:teuthology.orchestra.run.smithi057.stderr:152 bytes copied, 3.2794e-05 s, 4.6 MB/s 2020-11-16T21:41:01.492 INFO:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2020-11-16T21:41:01.495 INFO:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2020-11-16T21:41:01.537 INFO:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2020-11-16T21:41:01.591 INFO:teuthology.run_tasks:Running task internal.timer... 2020-11-16T21:41:01.603 INFO:teuthology.task.internal:Starting timer... 2020-11-16T21:41:01.604 INFO:teuthology.run_tasks:Running task pcp... 2020-11-16T21:41:01.619 INFO:teuthology.run_tasks:Running task selinux... 2020-11-16T21:41:01.630 DEBUG:teuthology.task.selinux:Excluding smithi195: OS 'ubuntu' does not support SELinux 2020-11-16T21:41:01.630 DEBUG:teuthology.task.selinux:Excluding smithi016: OS 'ubuntu' does not support SELinux 2020-11-16T21:41:01.630 DEBUG:teuthology.task.selinux:Excluding smithi057: OS 'ubuntu' does not support SELinux 2020-11-16T21:41:01.631 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-11-16T21:41:01.631 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2020-11-16T21:41:01.631 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-11-16T21:41:01.631 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-11-16T21:41:01.640 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2020-11-16T21:41:01.647 INFO:teuthology.repo_utils:Fetching master from origin 2020-11-16T21:41:01.699 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-11-16T21:41:01.712 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-11-16T21:41:01.714 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi195.front.sepia.ceph.com,smithi016.front.sepia.ceph.com,smithi057.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-11-16T21:41:02.014 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-11-16T21:41:02.787 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-11-16T21:41:09.075 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-11-16T21:41:09.093 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:09 +0000 (0:00:00.063) 0:00:00.063 ******* 2020-11-16T21:41:13.241 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:13 +0000 (0:00:04.148) 0:00:04.211 ******* 2020-11-16T21:41:17.377 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:17 +0000 (0:00:04.135) 0:00:08.347 ******* 2020-11-16T21:41:23.105 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi057.front.sepia.ceph.com] 2020-11-16T21:41:23.115 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] 2020-11-16T21:41:23.206 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:23 +0000 (0:00:05.829) 0:00:14.177 ******* 2020-11-16T21:41:23.240 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:23 +0000 (0:00:00.033) 0:00:14.210 ******* 2020-11-16T21:41:23.251 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] 2020-11-16T21:41:23.326 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:23 +0000 (0:00:00.085) 0:00:14.296 ******* 2020-11-16T21:41:23.458 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-11-16T21:41:23.459 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-11-16T21:41:23.460 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-11-16T21:41:23.492 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:23 +0000 (0:00:00.166) 0:00:14.462 ******* 2020-11-16T21:41:23.524 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:23 +0000 (0:00:00.032) 0:00:14.494 ******* 2020-11-16T21:41:23.531 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-11-16T21:41:23.568 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:23 +0000 (0:00:00.043) 0:00:14.538 ******* 2020-11-16T21:41:23.977 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-11-16T21:41:23.979 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} changed: [smithi057.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-16T21:41:24.013 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:24 +0000 (0:00:00.444) 0:00:14.983 ******* 2020-11-16T21:41:24.044 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:24 +0000 (0:00:00.031) 0:00:15.014 ******* 2020-11-16T21:41:24.072 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-16T21:41:24.106 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:24 +0000 (0:00:00.062) 0:00:15.077 ******* 2020-11-16T21:41:28.457 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-11-16T21:41:28.459 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.076041", "end": "2020-11-16 21:41:28.594949", "rc": 0, "start": "2020-11-16 21:41:28.518908", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.074756", "end": "2020-11-16 21:41:28.362730", "rc": 0, "start": "2020-11-16 21:41:28.287974", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-11-16T21:41:28.491 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:28 +0000 (0:00:04.384) 0:00:19.461 ******* 2020-11-16T21:41:28.521 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:28 +0000 (0:00:00.030) 0:00:19.491 ******* 2020-11-16T21:41:28.527 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.114323", "end": "2020-11-16 21:41:28.484497", "rc": 0, "start": "2020-11-16 21:41:28.370174", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-11-16T21:41:28.561 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:28 +0000 (0:00:00.040) 0:00:19.532 ******* 2020-11-16T21:41:28.731 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-11-16T21:41:28.733 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi057.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T21:41:28.766 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:28 +0000 (0:00:00.204) 0:00:19.736 ******* 2020-11-16T21:41:28.799 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:28 +0000 (0:00:00.032) 0:00:19.769 ******* 2020-11-16T21:41:28.830 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:28 +0000 (0:00:00.030) 0:00:19.800 ******* 2020-11-16T21:41:35.128 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-11-16T21:41:35.130 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605562888.8479989-136107998152602/source", "state": "file", "uid": 0} changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605562888.7798488-218139885113701/source", "state": "file", "uid": 0} 2020-11-16T21:41:35.161 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:35 +0000 (0:00:06.331) 0:00:26.132 ******* 2020-11-16T21:41:35.192 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:35 +0000 (0:00:00.030) 0:00:26.162 ******* 2020-11-16T21:41:41.922 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605562888.8127067-57688372280822/source", "state": "file", "uid": 0} 2020-11-16T21:41:41.956 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:41 +0000 (0:00:06.763) 0:00:32.926 ******* 2020-11-16T21:41:42.117 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-11-16T21:41:42.119 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-16T21:41:42.120 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-16T21:41:43.721 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-16T21:41:43.723 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-16T21:41:43.786 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-16T21:41:43.788 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-16T21:41:43.875 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-11-16T21:41:43.881 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-11-16T21:41:44.019 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:44 +0000 (0:00:02.063) 0:00:34.990 ******* 2020-11-16T21:41:44.051 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:44 +0000 (0:00:00.031) 0:00:35.021 ******* 2020-11-16T21:41:44.081 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:44 +0000 (0:00:00.030) 0:00:35.052 ******* 2020-11-16T21:41:44.837 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-11-16T21:41:44.839 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] 2020-11-16T21:41:44.956 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-11-16T21:41:44.958 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:44 +0000 (0:00:00.875) 0:00:35.927 ******* 2020-11-16T21:41:45.765 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] 2020-11-16T21:41:45.838 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:45 +0000 (0:00:00.881) 0:00:36.809 ******* 2020-11-16T21:41:57.561 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] 2020-11-16T21:41:57.633 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:57 +0000 (0:00:11.794) 0:00:48.603 ******* 2020-11-16T21:41:57.954 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-11-16T21:41:57.956 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:08.612074", "end": "2020-11-16 21:41:57.927833", "rc": 0, "start": "2020-11-16 21:41:49.315759", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-16T21:41:57.987 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:57 +0000 (0:00:00.354) 0:00:48.958 ******* 2020-11-16T21:41:58.010 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.180108", "end": "2020-11-16 21:41:57.975907", "rc": 0, "start": "2020-11-16 21:41:57.795799", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-16T21:41:58.044 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:58 +0000 (0:00:00.056) 0:00:49.014 ******* 2020-11-16T21:41:58.135 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-11-16T21:41:58.136 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.022290", "end": "2020-11-16 21:41:58.062179", "failed_when_result": false, "rc": 0, "start": "2020-11-16 21:41:58.039889", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-16T21:41:58.169 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:58 +0000 (0:00:00.125) 0:00:49.140 ******* 2020-11-16T21:41:58.188 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014039", "end": "2020-11-16 21:41:58.316133", "failed_when_result": false, "rc": 0, "start": "2020-11-16 21:41:58.302094", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-16T21:41:58.221 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:58 +0000 (0:00:00.051) 0:00:49.191 ******* 2020-11-16T21:41:58.226 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-11-16T21:41:58.228 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-11-16T21:41:58.260 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:58 +0000 (0:00:00.040) 0:00:49.231 ******* 2020-11-16T21:41:58.268 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-11-16T21:41:58.300 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:58 +0000 (0:00:00.039) 0:00:49.271 ******* 2020-11-16T21:41:58.306 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-11-16T21:41:58.308 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:41:58.340 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:58 +0000 (0:00:00.039) 0:00:49.310 ******* 2020-11-16T21:41:58.345 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:41:58.378 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:58 +0000 (0:00:00.038) 0:00:49.349 ******* 2020-11-16T21:41:58.383 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-11-16T21:41:58.385 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:41:58.416 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:58 +0000 (0:00:00.037) 0:00:49.387 ******* 2020-11-16T21:41:58.422 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:41:58.455 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:58 +0000 (0:00:00.038) 0:00:49.425 ******* 2020-11-16T21:41:58.460 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-11-16T21:41:58.461 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:41:58.493 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:58 +0000 (0:00:00.038) 0:00:49.463 ******* 2020-11-16T21:41:58.500 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:41:58.532 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:58 +0000 (0:00:00.038) 0:00:49.502 ******* 2020-11-16T21:41:58.537 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-11-16T21:41:58.539 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:41:58.571 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:58 +0000 (0:00:00.038) 0:00:49.541 ******* 2020-11-16T21:41:58.577 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:41:58.614 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:58 +0000 (0:00:00.043) 0:00:49.585 ******* 2020-11-16T21:41:58.621 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-11-16T21:41:58.623 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:41:58.655 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:58 +0000 (0:00:00.040) 0:00:49.626 ******* 2020-11-16T21:41:58.664 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:41:58.699 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:41:58 +0000 (0:00:00.043) 0:00:49.669 ******* 2020-11-16T21:42:07.034 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:07.036 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:07.038 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:07.038 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr 2020-11-16T21:42:07.040 INFO:teuthology.task.ansible.out:+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:07.040 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-11-16T21:42:07.040 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph 2020-11-16T21:42:07.042 INFO:teuthology.task.ansible.out:/keys HEAD | awk '{ print $1 }'", "delta": "0:00:08.597829", "end": "2020-11-16 21:41:58.707185", "rc": 0, "start": "2020-11-16 21:41:50.109356", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:07.076 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:07 +0000 (0:00:08.377) 0:00:58.046 ******* 2020-11-16T21:42:07.083 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:07.084 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:07.086 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:07.086 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIw 2020-11-16T21:42:07.087 INFO:teuthology.task.ansible.out:AAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d6932535 2020-11-16T21:42:07.089 INFO:teuthology.task.ansible.out:11d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY 2020-11-16T21:42:07.091 INFO:teuthology.task.ansible.out:1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844 2020-11-16T21:42:07.092 INFO:teuthology.task.ansible.out:863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional r 2020-11-16T21:42:07.094 INFO:teuthology.task.ansible.out:esult was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 495 2020-11-16T21:42:07.096 INFO:teuthology.task.ansible.out:22899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jo 2020-11-16T21:42:07.097 INFO:teuthology.task.ansible.out:ao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result 2020-11-16T21:42:07.099 INFO:teuthology.task.ansible.out:was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kc 2020-11-16T21:42:07.100 INFO:teuthology.task.ansible.out:hai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP 2020-11-16T21:42:07.102 INFO:teuthology.task.ansible.out:1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"a 2020-11-16T21:42:07.103 INFO:teuthology.task.ansible.out:nsible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Condit 2020-11-16T21:42:07.105 INFO:teuthology.task.ansible.out:ional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.f 2020-11-16T21:42:07.106 INFO:teuthology.task.ansible.out:ront.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZ 2020-11-16T21:42:07.108 INFO:teuthology.task.ansible.out:MjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reaso 2020-11-16T21:42:07.109 INFO:teuthology.task.ansible.out:n": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": 2020-11-16T21:42:07.111 INFO:teuthology.task.ansible.out: false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 z 2020-11-16T21:42:07.112 INFO:teuthology.task.ansible.out:dJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9a 2020-11-16T21:42:07.114 INFO:teuthology.task.ansible.out:d77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, " 2020-11-16T21:42:07.115 INFO:teuthology.task.ansible.out:skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f 2020-11-16T21:42:07.117 INFO:teuthology.task.ansible.out:1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_ 2020-11-16T21:42:07.118 INFO:teuthology.task.ansible.out:var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.c 2020-11-16T21:42:07.120 INFO:teuthology.task.ansible.out:om] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHs 2020-11-16T21:42:07.121 INFO:teuthology.task.ansible.out:Lgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_re 2020-11-16T21:42:07.123 INFO:teuthology.task.ansible.out:ason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"na 2020-11-16T21:42:07.124 INFO:teuthology.task.ansible.out:me": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@ 2020-11-16T21:42:07.126 INFO:teuthology.task.ansible.out:thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a 2020-11-16T21:42:07.127 INFO:teuthology.task.ansible.out:2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebo 2020-11-16T21:42:07.129 INFO:teuthology.task.ansible.out:ok LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": 2020-11-16T21:42:07.130 INFO:teuthology.task.ansible.out: "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smit 2020-11-16T21:42:07.132 INFO:teuthology.task.ansible.out:hi057.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": 2020-11-16T21:42:07.133 INFO:teuthology.task.ansible.out:false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'dorinda', 'ovpn': 'dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14"}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:07.147 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:07.148 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166a 2020-11-16T21:42:07.150 INFO:teuthology.task.ansible.out:f59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: 2020-11-16T21:42:07.152 INFO:teuthology.task.ansible.out: [smithi195.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAB 2020-11-16T21:42:07.153 INFO:teuthology.task.ansible.out:AQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", 2020-11-16T21:42:07.154 INFO:teuthology.task.ansible.out: "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 2020-11-16T21:42:07.156 INFO:teuthology.task.ansible.out: 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c 2020-11-16T21:42:07.157 INFO:teuthology.task.ansible.out:1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepi 2020-11-16T21:42:07.159 INFO:teuthology.task.ansible.out:a.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:07.189 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:07 +0000 (0:00:00.113) 0:00:58.160 ******* 2020-11-16T21:42:11.374 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.375 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.377 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.377 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.377 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d8 2020-11-16T21:42:11.379 INFO:teuthology.task.ansible.out:9bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.380 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.380 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxiche 2020-11-16T21:42:11.382 INFO:teuthology.task.ansible.out:n", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@es 2020-11-16T21:42:11.383 INFO:teuthology.task.ansible.out:presso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.384 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.384 INFO:teuthology.task.ansible.out:skipping: [smithi195.fron 2020-11-16T21:42:11.385 INFO:teuthology.task.ansible.out:t.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.386 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe 2020-11-16T21:42:11.387 INFO:teuthology.task.ansible.out:8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-11-16T21:42:11.388 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014100", "end": "2020-11-16 21:42:11.374463", "failed_when_result": false, "rc": 0, "start": "2020-11-16 21:42:11.360363", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c 2020-11-16T21:42:11.389 INFO:teuthology.task.ansible.out:2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.390 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'pdonnell 2020-11-16T21:42:11.392 INFO:teuthology.task.ansible.out:', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOk 2020-11-16T21:42:11.393 INFO:teuthology.task.ansible.out:K3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001 2020-11-16T21:42:11.395 INFO:teuthology.task.ansible.out:e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.395 INFO:teuthology.task.ansible.out:ski 2020-11-16T21:42:11.396 INFO:teuthology.task.ansible.out:pping: [smithi195.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.398 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.399 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} TASK [users : Create all users without sudo access.] *************************** TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:11.400 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.400 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.401 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.402 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.403 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.405 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.405 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "chang 2020-11-16T21:42:11.407 INFO:teuthology.task.ansible.out:ed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.407 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "ch 2020-11-16T21:42:11.409 INFO:teuthology.task.ansible.out:anged": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a20 2020-11-16T21:42:11.410 INFO:teuthology.task.ansible.out:00477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi 2020-11-16T21:42:11.412 INFO:teuthology.task.ansible.out:98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.412 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", " 2020-11-16T21:42:11.414 INFO:teuthology.task.ansible.out:ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.415 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.415 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.416 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "z 2020-11-16T21:42:11.417 INFO:teuthology.task.ansible.out:dover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.418 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.418 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b53 2020-11-16T21:42:11.419 INFO:teuthology.task.ansible.out:9a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.420 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Cond 2020-11-16T21:42:11.421 INFO:teuthology.task.ansible.out:itional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.422 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.423 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.423 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": 2020-11-16T21:42:11.424 INFO:teuthology.task.ansible.out: "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190d 2020-11-16T21:42:11.426 INFO:teuthology.task.ansible.out:e4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSiz 2020-11-16T21:42:11.427 INFO:teuthology.task.ansible.out:dX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1N 2020-11-16T21:42:11.429 INFO:teuthology.task.ansible.out:INj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'dorinda', 'ovpn': 'dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14"}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.475 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:11 +0000 (0:00:04.286) 0:01:02.446 ******* 2020-11-16T21:42:11.507 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:11 +0000 (0:00:00.031) 0:01:02.477 ******* 2020-11-16T21:42:11.536 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:11 +0000 (0:00:00.029) 0:01:02.506 ******* 2020-11-16T21:42:11.541 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-11-16T21:42:11.542 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.575 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:11 +0000 (0:00:00.038) 0:01:02.545 ******* 2020-11-16T21:42:11.608 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:11 +0000 (0:00:00.032) 0:01:02.578 ******* 2020-11-16T21:42:11.613 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-11-16T21:42:11.615 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.648 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:11 +0000 (0:00:00.040) 0:01:02.619 ******* 2020-11-16T21:42:11.678 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:11 +0000 (0:00:00.029) 0:01:02.649 ******* 2020-11-16T21:42:11.685 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-11-16T21:42:11.686 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.718 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:11 +0000 (0:00:00.040) 0:01:02.689 ******* 2020-11-16T21:42:11.750 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:11 +0000 (0:00:00.031) 0:01:02.721 ******* 2020-11-16T21:42:11.756 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-11-16T21:42:11.758 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_users list] *********************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.791 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:11 +0000 (0:00:00.040) 0:01:02.761 ******* 2020-11-16T21:42:11.824 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:11 +0000 (0:00:00.033) 0:01:02.795 ******* 2020-11-16T21:42:11.831 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T21:42:11.833 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.866 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:11 +0000 (0:00:00.041) 0:01:02.836 ******* 2020-11-16T21:42:11.899 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:11 +0000 (0:00:00.032) 0:01:02.869 ******* 2020-11-16T21:42:11.905 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-11-16T21:42:11.907 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:11.940 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:11 +0000 (0:00:00.040) 0:01:02.910 ******* 2020-11-16T21:42:11.972 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:11 +0000 (0:00:00.031) 0:01:02.942 ******* 2020-11-16T21:42:11.978 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-16T21:42:11.980 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.013 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:12 +0000 (0:00:00.041) 0:01:02.984 ******* 2020-11-16T21:42:12.021 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:12.022 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.023 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ 2020-11-16T21:42:12.024 INFO:teuthology.task.ansible.out:ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:12.024 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0 2020-11-16T21:42:12.026 INFO:teuthology.task.ansible.out:374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.026 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditiona 2020-11-16T21:42:12.028 INFO:teuthology.task.ansible.out:l result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRF 2020-11-16T21:42:12.029 INFO:teuthology.task.ansible.out:sQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.060 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:12 +0000 (0:00:00.046) 0:01:03.030 ******* 2020-11-16T21:42:12.066 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.068 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-11-16T21:42:12.068 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.068 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.070 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23 2020-11-16T21:42:12.071 INFO:teuthology.task.ansible.out:cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansib 2020-11-16T21:42:12.073 INFO:teuthology.task.ansible.out:le_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.105 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:12 +0000 (0:00:00.044) 0:01:03.075 ******* 2020-11-16T21:42:12.111 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.112 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.114 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.114 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip 2020-11-16T21:42:12.116 INFO:teuthology.task.ansible.out:_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G sh 2020-11-16T21:42:12.117 INFO:teuthology.task.ansible.out:isK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.151 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:12 +0000 (0:00:00.046) 0:01:03.122 ******* 2020-11-16T21:42:12.159 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.160 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.161 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.162 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:12.162 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.162 INFO:teuthology.task.ansible.out:skipp 2020-11-16T21:42:12.164 INFO:teuthology.task.ansible.out:ing: [smithi016.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:12.164 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.164 INFO:teuthology.task.ansible.out: TASK [users : Remove rev 2020-11-16T21:42:12.166 INFO:teuthology.task.ansible.out:oked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.166 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.166 INFO:teuthology.task.ansible.out: TASK [users : Create all adm 2020-11-16T21:42:12.168 INFO:teuthology.task.ansible.out:in users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.177 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.179 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.180 INFO:teuthology.task.ansible.out: TASK [users : Create all admin us 2020-11-16T21:42:12.181 INFO:teuthology.task.ansible.out:ers with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.214 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:12 +0000 (0:00:00.062) 0:01:03.184 ******* 2020-11-16T21:42:12.221 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:12.222 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.223 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:12.223 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.223 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.223 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:12.224 INFO:teuthology.task.ansible.out:skipping: [smithi016.front 2020-11-16T21:42:12.225 INFO:teuthology.task.ansible.out:.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:12.226 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] *************************** 2020-11-16T21:42:12.227 INFO:teuthology.task.ansible.out:***************** skipping: [smithi057.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** 2020-11-16T21:42:12.228 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:12.228 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMd 2020-11-16T21:42:12.229 INFO:teuthology.task.ansible.out:XOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.239 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:12.241 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:12.241 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditi 2020-11-16T21:42:12.243 INFO:teuthology.task.ansible.out:onal result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.253 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.255 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.255 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.256 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd3903 2020-11-16T21:42:12.257 INFO:teuthology.task.ansible.out:02adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.268 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T21:42:12.269 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.269 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": " 2020-11-16T21:42:12.271 INFO:teuthology.task.ansible.out:Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.282 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T21:42:12.283 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.284 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.284 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=asheplyakov) => {"ansib 2020-11-16T21:42:12.285 INFO:teuthology.task.ansible.out:le_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.295 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T21:42:12.296 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.297 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.297 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "ite 2020-11-16T21:42:12.299 INFO:teuthology.task.ansible.out:m", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.309 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:12.311 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi057.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** 2020-11-16T21:42:12.311 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.311 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.312 INFO:teuthology.task.ansible.out:ski 2020-11-16T21:42:12.313 INFO:teuthology.task.ansible.out:pping: [smithi195.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.323 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T21:42:12.324 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.325 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.325 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", 2020-11-16T21:42:12.326 INFO:teuthology.task.ansible.out: "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.336 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:12.338 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.338 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejO 2020-11-16T21:42:12.340 INFO:teuthology.task.ansible.out:W2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.378 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:12 +0000 (0:00:00.163) 0:01:03.348 ******* 2020-11-16T21:42:12.385 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:12.386 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.387 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:12.388 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.388 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.389 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result w 2020-11-16T21:42:12.391 INFO:teuthology.task.ansible.out:as False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:12.391 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var 2020-11-16T21:42:12.393 INFO:teuthology.task.ansible.out:": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] *************** 2020-11-16T21:42:12.395 INFO:teuthology.task.ansible.out:***************************** skipping: [smithi195.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha 2020-11-16T21:42:12.397 INFO:teuthology.task.ansible.out:@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was Fal 2020-11-16T21:42:12.398 INFO:teuthology.task.ansible.out:se"} skipping: [smithi195.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.407 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.409 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.419 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T21:42:12.421 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.421 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"an 2020-11-16T21:42:12.422 INFO:teuthology.task.ansible.out:sible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.432 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T21:42:12.433 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.433 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.434 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] *********** 2020-11-16T21:42:12.435 INFO:teuthology.task.ansible.out:************* skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.444 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.446 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.484 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:12 +0000 (0:00:00.106) 0:01:03.454 ******* 2020-11-16T21:42:12.491 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-16T21:42:12.492 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.493 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.493 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.493 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "z 2020-11-16T21:42:12.495 INFO:teuthology.task.ansible.out:dover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.495 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.495 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b53 2020-11-16T21:42:12.497 INFO:teuthology.task.ansible.out:9a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.507 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.508 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.518 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.520 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.529 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.531 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.540 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.542 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.552 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.554 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.563 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.565 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.575 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.576 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.586 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.588 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.597 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.599 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.609 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.610 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.620 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.621 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'dorinda', 'ovpn': 'dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dorinda", "ovpn": "dorinda@ideapad /BLvrh5FMYG1lXzwak5Z+w d028380a40a95f162324dfbb024cfa98b5771a1b90741fbfc908cad93ef09a14"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.632 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:12.680 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:12 +0000 (0:00:00.196) 0:01:03.651 ******* 2020-11-16T21:42:20.954 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-11-16T21:42:20.987 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:20 +0000 (0:00:08.306) 0:01:11.957 ******* 2020-11-16T21:42:21.024 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-11-16T21:42:21.026 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.066 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:21 +0000 (0:00:00.078) 0:01:12.036 ******* 2020-11-16T21:42:21.093 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-11-16T21:42:21.095 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.126 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:21 +0000 (0:00:00.060) 0:01:12.096 ******* 2020-11-16T21:42:21.153 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-16T21:42:21.154 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.186 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:21 +0000 (0:00:00.059) 0:01:12.156 ******* 2020-11-16T21:42:21.212 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-16T21:42:21.214 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.247 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:21 +0000 (0:00:00.061) 0:01:12.218 ******* 2020-11-16T21:42:21.264 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-11-16T21:42:21.266 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2020-11-16T21:42:21.266 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.299 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:21 +0000 (0:00:00.051) 0:01:12.269 ******* 2020-11-16T21:42:21.332 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:21 +0000 (0:00:00.032) 0:01:12.302 ******* 2020-11-16T21:42:21.366 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:21 +0000 (0:00:00.033) 0:01:12.336 ******* 2020-11-16T21:42:21.373 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-16T21:42:21.375 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.375 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-16T21:42:21.375 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => { "msg": "Host smithi057.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-11-16T21:42:21.376 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi016.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.376 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.376 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.376 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.412 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:21 +0000 (0:00:00.046) 0:01:12.382 ******* 2020-11-16T21:42:21.419 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.420 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.421 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi195.front.sepia.ceph.com] => { "msg": "Host smithi195.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-11-16T21:42:21.421 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi016.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.422 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.422 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.423 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.424 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.458 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:21 +0000 (0:00:00.046) 0:01:12.429 ******* 2020-11-16T21:42:21.465 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.466 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.466 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.468 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} TASK [common : Including major version specific variables.] ******************** ok: [smithi057.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-11-16T21:42:21.469 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi016.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.470 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.470 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.505 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:21 +0000 (0:00:00.046) 0:01:12.475 ******* 2020-11-16T21:42:21.512 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.513 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.513 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.515 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} TASK [common : Including major version specific variables.] ******************** ok: [smithi195.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-11-16T21:42:21.516 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi016.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.516 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.517 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.517 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.551 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:21 +0000 (0:00:00.046) 0:01:12.521 ******* 2020-11-16T21:42:21.559 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.561 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.561 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-16T21:42:21.561 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.562 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi016.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.562 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.562 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.563 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.563 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.563 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.564 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:21.601 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:21 +0000 (0:00:00.050) 0:01:12.572 ******* 2020-11-16T21:42:21.637 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:21 +0000 (0:00:00.034) 0:01:12.607 ******* 2020-11-16T21:42:25.734 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-16T21:42:25.736 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:25.778 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:25 +0000 (0:00:04.141) 0:01:16.748 ******* 2020-11-16T21:42:25.784 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-11-16T21:42:25.785 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:25.818 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:25 +0000 (0:00:00.039) 0:01:16.788 ******* 2020-11-16T21:42:25.825 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:25.858 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:25 +0000 (0:00:00.040) 0:01:16.829 ******* 2020-11-16T21:42:25.866 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-11-16T21:42:25.868 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:25.901 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:25 +0000 (0:00:00.042) 0:01:16.871 ******* 2020-11-16T21:42:25.908 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:25.942 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:25 +0000 (0:00:00.041) 0:01:16.913 ******* 2020-11-16T21:42:25.949 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-16T21:42:25.950 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:25.983 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:25 +0000 (0:00:00.040) 0:01:16.953 ******* 2020-11-16T21:42:25.990 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:26.023 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.040) 0:01:16.994 ******* 2020-11-16T21:42:26.030 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-11-16T21:42:26.031 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:26.065 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.041) 0:01:17.035 ******* 2020-11-16T21:42:26.096 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.031) 0:01:17.066 ******* 2020-11-16T21:42:26.104 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:26.106 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi016.front.sepia.ceph.com] => { "msg": "Host smithi016.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-11-16T21:42:26.137 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.041) 0:01:17.108 ******* 2020-11-16T21:42:26.169 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.031) 0:01:17.139 ******* 2020-11-16T21:42:26.176 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-16T21:42:26.177 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Including major version specific variables.] ******************** ok: [smithi016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-11-16T21:42:26.211 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.041) 0:01:17.181 ******* 2020-11-16T21:42:26.242 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.031) 0:01:17.212 ******* 2020-11-16T21:42:26.249 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-16T21:42:26.250 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:26.283 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.040) 0:01:17.253 ******* 2020-11-16T21:42:26.314 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.031) 0:01:17.285 ******* 2020-11-16T21:42:26.321 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-16T21:42:26.322 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:26.359 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.044) 0:01:17.329 ******* 2020-11-16T21:42:26.391 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.031) 0:01:17.361 ******* 2020-11-16T21:42:26.398 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-16T21:42:26.399 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:26.431 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.040) 0:01:17.401 ******* 2020-11-16T21:42:26.462 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.031) 0:01:17.433 ******* 2020-11-16T21:42:26.469 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-16T21:42:26.471 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:26.504 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.041) 0:01:17.475 ******* 2020-11-16T21:42:26.536 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.031) 0:01:17.506 ******* 2020-11-16T21:42:26.542 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-16T21:42:26.543 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:26.578 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.042) 0:01:17.548 ******* 2020-11-16T21:42:26.610 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.031) 0:01:17.580 ******* 2020-11-16T21:42:26.615 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-16T21:42:26.617 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi057.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:26.651 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.041) 0:01:17.622 ******* 2020-11-16T21:42:26.683 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.031) 0:01:17.653 ******* 2020-11-16T21:42:26.690 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-16T21:42:26.692 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi195.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:26.725 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.042) 0:01:17.696 ******* 2020-11-16T21:42:26.759 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.033) 0:01:17.729 ******* 2020-11-16T21:42:26.764 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-11-16T21:42:26.766 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:26.800 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.041) 0:01:17.770 ******* 2020-11-16T21:42:26.832 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.031) 0:01:17.802 ******* 2020-11-16T21:42:26.837 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-11-16T21:42:26.839 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi016.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-16T21:42:26.876 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.043) 0:01:17.846 ******* 2020-11-16T21:42:26.908 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.032) 0:01:17.879 ******* 2020-11-16T21:42:26.914 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-16T21:42:26.916 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set have_entitlements] ****************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:26.949 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.040) 0:01:17.919 ******* 2020-11-16T21:42:26.978 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:26 +0000 (0:00:00.029) 0:01:17.949 ******* 2020-11-16T21:42:26.985 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-16T21:42:26.987 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:27.019 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.040) 0:01:17.989 ******* 2020-11-16T21:42:27.050 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.031) 0:01:18.021 ******* 2020-11-16T21:42:27.057 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-16T21:42:27.058 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-16T21:42:27.091 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.040) 0:01:18.062 ******* 2020-11-16T21:42:27.123 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.031) 0:01:18.093 ******* 2020-11-16T21:42:27.129 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-16T21:42:27.131 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:27.164 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.041) 0:01:18.134 ******* 2020-11-16T21:42:27.195 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.031) 0:01:18.166 ******* 2020-11-16T21:42:27.201 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:27.202 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-16T21:42:27.202 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-16T21:42:27.235 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.039) 0:01:18.206 ******* 2020-11-16T21:42:27.266 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.030) 0:01:18.236 ******* 2020-11-16T21:42:27.272 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-16T21:42:27.273 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:27.306 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.040) 0:01:18.277 ******* 2020-11-16T21:42:27.338 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.031) 0:01:18.308 ******* 2020-11-16T21:42:27.344 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-16T21:42:27.345 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : List CDN releases available to system] ************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:27.378 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.040) 0:01:18.349 ******* 2020-11-16T21:42:27.413 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.034) 0:01:18.383 ******* 2020-11-16T21:42:27.420 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-16T21:42:27.421 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:27.454 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.040) 0:01:18.424 ******* 2020-11-16T21:42:27.486 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.032) 0:01:18.457 ******* 2020-11-16T21:42:27.493 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-16T21:42:27.494 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:27.527 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.040) 0:01:18.497 ******* 2020-11-16T21:42:27.558 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.031) 0:01:18.529 ******* 2020-11-16T21:42:27.565 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-16T21:42:27.567 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-16T21:42:27.599 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.040) 0:01:18.569 ******* 2020-11-16T21:42:27.631 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.032) 0:01:18.601 ******* 2020-11-16T21:42:27.637 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-16T21:42:27.639 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:27.672 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.041) 0:01:18.642 ******* 2020-11-16T21:42:27.703 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.031) 0:01:18.674 ******* 2020-11-16T21:42:27.710 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-16T21:42:27.712 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:27.748 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.044) 0:01:18.718 ******* 2020-11-16T21:42:27.779 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.031) 0:01:18.749 ******* 2020-11-16T21:42:27.787 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-16T21:42:27.788 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Store list of enabled repos] ************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:27.820 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.040) 0:01:18.790 ******* 2020-11-16T21:42:27.851 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.030) 0:01:18.821 ******* 2020-11-16T21:42:27.857 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-16T21:42:27.859 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:27.891 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.040) 0:01:18.862 ******* 2020-11-16T21:42:27.922 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.030) 0:01:18.893 ******* 2020-11-16T21:42:27.928 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-11-16T21:42:27.930 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:27.966 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.043) 0:01:18.936 ******* 2020-11-16T21:42:27.997 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:27 +0000 (0:00:00.031) 0:01:18.967 ******* 2020-11-16T21:42:28.003 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-11-16T21:42:28.005 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:28.042 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:28 +0000 (0:00:00.045) 0:01:19.013 ******* 2020-11-16T21:42:28.074 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:28 +0000 (0:00:00.032) 0:01:19.045 ******* 2020-11-16T21:42:28.081 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-16T21:42:28.083 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-16T21:42:28.115 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:28 +0000 (0:00:00.040) 0:01:19.085 ******* 2020-11-16T21:42:28.146 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:28 +0000 (0:00:00.031) 0:01:19.117 ******* 2020-11-16T21:42:32.307 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-16T21:42:32.309 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:32.343 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:32 +0000 (0:00:04.196) 0:01:23.313 ******* 2020-11-16T21:42:32.375 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:32 +0000 (0:00:00.031) 0:01:23.345 ******* 2020-11-16T21:42:32.380 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-16T21:42:32.382 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:32.414 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:32 +0000 (0:00:00.039) 0:01:23.384 ******* 2020-11-16T21:42:32.444 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:32 +0000 (0:00:00.029) 0:01:23.414 ******* 2020-11-16T21:42:32.450 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-16T21:42:32.452 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:32.484 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:32 +0000 (0:00:00.040) 0:01:23.454 ******* 2020-11-16T21:42:32.515 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:32 +0000 (0:00:00.031) 0:01:23.485 ******* 2020-11-16T21:42:40.784 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-16T21:42:40.785 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:40.786 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:40.820 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:40 +0000 (0:00:08.305) 0:01:31.791 ******* 2020-11-16T21:42:40.854 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:40 +0000 (0:00:00.033) 0:01:31.825 ******* 2020-11-16T21:42:40.862 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-16T21:42:40.864 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi016.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:40.897 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:40 +0000 (0:00:00.043) 0:01:31.868 ******* 2020-11-16T21:42:40.933 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:40 +0000 (0:00:00.035) 0:01:31.903 ******* 2020-11-16T21:42:40.940 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-16T21:42:40.941 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:40.974 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:40 +0000 (0:00:00.041) 0:01:31.945 ******* 2020-11-16T21:42:41.128 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.153) 0:01:32.098 ******* 2020-11-16T21:42:41.137 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-16T21:42:41.139 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:41.173 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.045) 0:01:32.144 ******* 2020-11-16T21:42:41.178 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-11-16T21:42:41.180 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:41.213 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.039) 0:01:32.183 ******* 2020-11-16T21:42:41.221 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:41.254 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.041) 0:01:32.225 ******* 2020-11-16T21:42:41.260 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-16T21:42:41.261 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.013663", "end": "2020-11-16 21:42:41.237892", "rc": 0, "start": "2020-11-16 21:42:41.224229", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-16T21:42:41.295 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.040) 0:01:32.266 ******* 2020-11-16T21:42:41.328 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.032) 0:01:32.298 ******* 2020-11-16T21:42:41.335 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-16T21:42:41.336 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:41.370 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.041) 0:01:32.340 ******* 2020-11-16T21:42:41.402 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.031) 0:01:32.372 ******* 2020-11-16T21:42:41.408 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-11-16T21:42:41.410 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:41.450 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.048) 0:01:32.420 ******* 2020-11-16T21:42:41.498 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.047) 0:01:32.468 ******* 2020-11-16T21:42:41.505 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-11-16T21:42:41.507 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:41.539 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.041) 0:01:32.509 ******* 2020-11-16T21:42:41.571 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.031) 0:01:32.541 ******* 2020-11-16T21:42:41.576 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-11-16T21:42:41.578 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set the timezone] *********************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:41.612 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.041) 0:01:32.583 ******* 2020-11-16T21:42:41.644 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.031) 0:01:32.614 ******* 2020-11-16T21:42:41.651 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-11-16T21:42:41.652 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:41.689 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.044) 0:01:32.659 ******* 2020-11-16T21:42:41.720 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.031) 0:01:32.691 ******* 2020-11-16T21:42:41.727 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-16T21:42:41.729 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:41.762 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.041) 0:01:32.732 ******* 2020-11-16T21:42:41.793 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.030) 0:01:32.763 ******* 2020-11-16T21:42:41.800 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-16T21:42:41.801 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Refresh repos] ************************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:41.835 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.041) 0:01:32.805 ******* 2020-11-16T21:42:41.870 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.034) 0:01:32.840 ******* 2020-11-16T21:42:41.876 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-11-16T21:42:41.878 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:41.911 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.041) 0:01:32.881 ******* 2020-11-16T21:42:41.917 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:41.950 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.039) 0:01:32.920 ******* 2020-11-16T21:42:41.955 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-16T21:42:41.956 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:41.988 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:41 +0000 (0:00:00.038) 0:01:32.959 ******* 2020-11-16T21:42:41.994 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:42.029 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.040) 0:01:32.999 ******* 2020-11-16T21:42:42.036 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-16T21:42:42.037 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:42.074 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.044) 0:01:33.044 ******* 2020-11-16T21:42:42.080 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:42.080 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:42.117 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.043) 0:01:33.087 ******* 2020-11-16T21:42:42.123 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-16T21:42:42.125 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:42.160 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.043) 0:01:33.131 ******* 2020-11-16T21:42:42.168 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:42.168 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-11-16T21:42:42.202 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.042) 0:01:33.173 ******* 2020-11-16T21:42:42.208 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-16T21:42:42.210 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:42.244 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.041) 0:01:33.214 ******* 2020-11-16T21:42:42.251 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:42.291 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.046) 0:01:33.261 ******* 2020-11-16T21:42:42.391 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-16T21:42:42.393 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.014536", "end": "2020-11-16 21:42:42.334147", "rc": 0, "start": "2020-11-16 21:42:42.319611", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-16T21:42:42.426 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.135) 0:01:33.397 ******* 2020-11-16T21:42:42.453 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-11-16T21:42:42.454 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:42.486 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.059) 0:01:33.456 ******* 2020-11-16T21:42:42.513 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-16T21:42:42.514 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.545941", "end": "2020-11-16 21:42:42.500427", "rc": 0, "start": "2020-11-16 21:42:41.954486", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:42.548 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.061) 0:01:33.518 ******* 2020-11-16T21:42:42.579 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.031) 0:01:33.549 ******* 2020-11-16T21:42:42.586 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-16T21:42:42.587 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:42.619 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.040) 0:01:33.590 ******* 2020-11-16T21:42:42.627 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-16T21:42:42.629 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:42.662 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.042) 0:01:33.633 ******* 2020-11-16T21:42:42.690 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-16T21:42:42.691 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:42.723 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.060) 0:01:33.694 ******* 2020-11-16T21:42:42.750 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-16T21:42:42.752 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:42.784 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.060) 0:01:33.754 ******* 2020-11-16T21:42:42.791 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-16T21:42:42.793 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.036702", "end": "2020-11-16 21:42:42.774912", "rc": 0, "start": "2020-11-16 21:42:42.738210", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:42:42.825 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.041) 0:01:33.796 ******* 2020-11-16T21:42:42.832 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-16T21:42:42.834 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:42.867 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.041) 0:01:33.837 ******* 2020-11-16T21:42:42.894 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-11-16T21:42:42.896 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:42.927 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:42 +0000 (0:00:00.060) 0:01:33.898 ******* 2020-11-16T21:42:51.554 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-16T21:42:51.555 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.189212", "end": "2020-11-16 21:42:51.500378", "rc": 0, "start": "2020-11-16 21:42:51.311166", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:42:51.587 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:51 +0000 (0:00:08.659) 0:01:42.557 ******* 2020-11-16T21:42:51.611 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-16T21:42:51.613 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:51.644 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:51 +0000 (0:00:00.057) 0:01:42.614 ******* 2020-11-16T21:42:51.807 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-16T21:42:51.808 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.039595", "end": "2020-11-16 21:42:51.757479", "rc": 0, "start": "2020-11-16 21:42:51.717884", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:42:51.840 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:51 +0000 (0:00:00.196) 0:01:42.811 ******* 2020-11-16T21:42:54.924 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-16T21:42:54.926 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1605562650, "cache_updated": false, "changed": false} 2020-11-16T21:42:54.960 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:54 +0000 (0:00:03.120) 0:01:45.931 ******* 2020-11-16T21:42:55.049 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-16T21:42:55.051 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.017611", "end": "2020-11-16 21:42:55.145242", "rc": 0, "start": "2020-11-16 21:42:55.127631", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-16T21:42:55.085 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:55 +0000 (0:00:00.124) 0:01:46.055 ******* 2020-11-16T21:42:55.112 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:55.146 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:55 +0000 (0:00:00.060) 0:01:46.116 ******* 2020-11-16T21:42:55.172 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-11-16T21:42:55.173 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:55.205 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:55 +0000 (0:00:00.059) 0:01:46.175 ******* 2020-11-16T21:42:55.232 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-16T21:42:55.233 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:55.265 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:55 +0000 (0:00:00.059) 0:01:46.235 ******* 2020-11-16T21:42:55.291 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-16T21:42:55.292 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:55.323 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:55 +0000 (0:00:00.058) 0:01:46.294 ******* 2020-11-16T21:42:55.349 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-16T21:42:55.351 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:55.382 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:55 +0000 (0:00:00.058) 0:01:46.352 ******* 2020-11-16T21:42:55.388 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-16T21:42:55.390 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1605562695, "cache_updated": false, "changed": false} 2020-11-16T21:42:55.423 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:55 +0000 (0:00:00.041) 0:01:46.394 ******* 2020-11-16T21:42:55.430 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-16T21:42:55.431 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:55.464 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:55 +0000 (0:00:00.041) 0:01:46.435 ******* 2020-11-16T21:42:55.491 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-11-16T21:42:55.492 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:55.523 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:55 +0000 (0:00:00.058) 0:01:46.493 ******* 2020-11-16T21:42:55.839 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-16T21:42:55.841 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1605562650, "cache_updated": false, "changed": false} 2020-11-16T21:42:55.874 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:55 +0000 (0:00:00.350) 0:01:46.844 ******* 2020-11-16T21:42:55.900 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-16T21:42:55.902 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:55.933 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:55 +0000 (0:00:00.059) 0:01:46.904 ******* 2020-11-16T21:42:56.248 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-16T21:42:56.250 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-11-16T21:42:56.282 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:56 +0000 (0:00:00.348) 0:01:47.253 ******* 2020-11-16T21:42:56.404 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-16T21:42:56.406 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.757484", "end": "2020-11-16 21:42:56.500919", "rc": 0, "start": "2020-11-16 21:42:55.743435", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:42:56.439 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:56 +0000 (0:00:00.156) 0:01:47.409 ******* 2020-11-16T21:42:56.466 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-16T21:42:56.468 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:42:56.500 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:56 +0000 (0:00:00.060) 0:01:47.470 ******* 2020-11-16T21:42:56.844 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-16T21:42:56.846 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1605562695, "cache_updated": false, "changed": false} 2020-11-16T21:42:56.879 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:42:56 +0000 (0:00:00.378) 0:01:47.849 ******* 2020-11-16T21:43:05.199 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-16T21:43:05.201 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1605562650, "cache_updated": false, "changed": false} 2020-11-16T21:43:05.202 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-16T21:43:05.204 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.095202", "end": "2020-11-16 21:43:05.066933", "rc": 0, "start": "2020-11-16 21:43:04.971731", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:43:05.237 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:05 +0000 (0:00:08.358) 0:01:56.207 ******* 2020-11-16T21:43:05.269 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:05 +0000 (0:00:00.031) 0:01:56.239 ******* 2020-11-16T21:43:05.276 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-16T21:43:05.277 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:05.312 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:05 +0000 (0:00:00.042) 0:01:56.282 ******* 2020-11-16T21:43:05.567 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-16T21:43:05.568 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-11-16T21:43:05.630 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-16T21:43:05.632 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-11-16T21:43:05.663 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:05 +0000 (0:00:00.351) 0:01:56.634 ******* 2020-11-16T21:43:05.855 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-16T21:43:05.857 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-11-16T21:43:06.115 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-11-16T21:43:06.155 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:06 +0000 (0:00:00.491) 0:01:57.125 ******* 2020-11-16T21:43:06.275 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-16T21:43:06.277 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-11-16T21:43:06.308 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:06 +0000 (0:00:00.153) 0:01:57.279 ******* 2020-11-16T21:43:06.583 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-16T21:43:06.585 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1605562695, "cache_updated": false, "changed": false} 2020-11-16T21:43:06.618 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:06 +0000 (0:00:00.309) 0:01:57.588 ******* 2020-11-16T21:43:06.624 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-16T21:43:06.626 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-11-16T21:43:06.875 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-11-16T21:43:06.949 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-16T21:43:06.950 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-11-16T21:43:07.151 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-16T21:43:07.153 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-11-16T21:43:07.192 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:07 +0000 (0:00:00.573) 0:01:58.162 ******* 2020-11-16T21:43:11.463 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-16T21:43:11.465 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1605562608, "cache_updated": false, "changed": false} 2020-11-16T21:43:11.500 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:11 +0000 (0:00:04.307) 0:02:02.470 ******* 2020-11-16T21:43:11.508 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-16T21:43:11.509 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi057.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-11-16T21:43:11.544 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:11 +0000 (0:00:00.044) 0:02:02.514 ******* 2020-11-16T21:43:11.572 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-16T21:43:11.573 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:11.606 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:11 +0000 (0:00:00.061) 0:02:02.576 ******* 2020-11-16T21:43:11.632 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-16T21:43:11.633 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-16T21:43:11.665 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:11 +0000 (0:00:00.059) 0:02:02.635 ******* 2020-11-16T21:43:11.702 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-16T21:43:11.704 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-16T21:43:11.713 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-16T21:43:11.724 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-16T21:43:11.758 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:11 +0000 (0:00:00.093) 0:02:02.728 ******* 2020-11-16T21:43:11.775 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-16T21:43:11.776 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-11-16T21:43:11.810 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:11 +0000 (0:00:00.052) 0:02:02.781 ******* 2020-11-16T21:43:11.816 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-16T21:43:11.818 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:11.853 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:11 +0000 (0:00:00.042) 0:02:02.823 ******* 2020-11-16T21:43:11.940 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-16T21:43:11.942 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-11-16T21:43:11.974 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:11 +0000 (0:00:00.121) 0:02:02.944 ******* 2020-11-16T21:43:12.272 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-16T21:43:12.273 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-11-16T21:43:12.398 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-16T21:43:12.400 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"cache_update_time": 1605562608, "cache_updated": false, "changed": false} 2020-11-16T21:43:12.432 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:12 +0000 (0:00:00.458) 0:02:03.403 ******* 2020-11-16T21:43:12.460 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-16T21:43:12.461 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:12.493 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:12 +0000 (0:00:00.060) 0:02:03.463 ******* 2020-11-16T21:43:12.533 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-16T21:43:12.535 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-11-16T21:43:12.764 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-16T21:43:12.765 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1605562650, "cache_updated": false, "changed": false} 2020-11-16T21:43:12.798 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:12 +0000 (0:00:00.305) 0:02:03.769 ******* 2020-11-16T21:43:21.356 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-16T21:43:21.358 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-11-16T21:43:21.389 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:21 +0000 (0:00:08.591) 0:02:12.360 ******* 2020-11-16T21:43:21.696 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-16T21:43:21.698 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-11-16T21:43:21.729 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:21 +0000 (0:00:00.340) 0:02:12.700 ******* 2020-11-16T21:43:21.871 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-16T21:43:21.873 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-11-16T21:43:21.988 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-11-16T21:43:22.022 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:22 +0000 (0:00:00.292) 0:02:12.992 ******* 2020-11-16T21:43:22.049 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-16T21:43:22.051 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:22.082 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:22 +0000 (0:00:00.059) 0:02:13.052 ******* 2020-11-16T21:43:22.108 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-16T21:43:22.110 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-16T21:43:22.142 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:22 +0000 (0:00:00.060) 0:02:13.112 ******* 2020-11-16T21:43:22.169 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-16T21:43:22.171 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:22.202 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:22 +0000 (0:00:00.059) 0:02:13.172 ******* 2020-11-16T21:43:26.687 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-16T21:43:26.689 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2020-11-16T21:43:26.721 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:26 +0000 (0:00:04.519) 0:02:17.692 ******* 2020-11-16T21:43:27.349 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-16T21:43:27.350 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-11-16 21:40:40 UTC", "ActiveEnterTimestampMonotonic": "18386906", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice systemd-tmpfiles-setup.service sysinit.target basic.target network.target var-run.mount systemd-journald.socket nss-lookup.target remote-fs.target time-sync.target local-fs.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-11-16 21:40:40 UTC", "AssertTimestampMonotonic": "18386116", "Before": "multi-user.target xdm.service plymouth-quit.service getty@tty1.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-11-16 21:40:40 UTC", "ConditionTimestampMonotonic": "18386116", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-11-16T21:43:27.352 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1411", "ExecMainStartTimestamp": "Mon 2020-11-16 21:40:40 UTC", "ExecMainStartTimestampMonotonic": "18386875", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2020-11-16 21:40:40 UTC] ; stop_time=[n/a] ; pid=1411 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-11-16 21:40:40 UTC", "InactiveExitTimestampMonotonic": "18386906", "InvocationID": "9b1572c3f42b49bf8052cad7b14a4d96", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2020-11-16T21:43:27.353 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1411", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2020-11-16T21:43:27.355 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-11-16 21:40:40 UTC", "StateChangeTimestampMonotonic": "18386906", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-11-16 21:40:40 UTC", "WatchdogTimestampMonotonic": "18386905", "WatchdogUSec": "0"}} 2020-11-16T21:43:27.384 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:27 +0000 (0:00:00.663) 0:02:18.355 ******* 2020-11-16T21:43:27.411 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-16T21:43:27.413 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:27.444 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:27 +0000 (0:00:00.059) 0:02:18.415 ******* 2020-11-16T21:43:27.471 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-16T21:43:27.473 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:27.504 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:27 +0000 (0:00:00.059) 0:02:18.475 ******* 2020-11-16T21:43:27.531 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-16T21:43:27.533 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:27.564 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:27 +0000 (0:00:00.060) 0:02:18.535 ******* 2020-11-16T21:43:27.592 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-16T21:43:27.593 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:27.625 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:27 +0000 (0:00:00.060) 0:02:18.595 ******* 2020-11-16T21:43:27.652 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-16T21:43:27.654 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:27.686 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:27 +0000 (0:00:00.060) 0:02:18.656 ******* 2020-11-16T21:43:27.713 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-16T21:43:27.715 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:27.748 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:27 +0000 (0:00:00.062) 0:02:18.718 ******* 2020-11-16T21:43:27.775 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-16T21:43:27.776 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:27.808 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:27 +0000 (0:00:00.060) 0:02:18.779 ******* 2020-11-16T21:43:27.834 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-16T21:43:27.836 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:27.867 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:27 +0000 (0:00:00.058) 0:02:18.838 ******* 2020-11-16T21:43:27.893 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-16T21:43:27.895 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:27.926 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:27 +0000 (0:00:00.058) 0:02:18.896 ******* 2020-11-16T21:43:27.952 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-16T21:43:27.954 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:27.985 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:27 +0000 (0:00:00.058) 0:02:18.955 ******* 2020-11-16T21:43:28.011 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-16T21:43:28.013 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-11-16T21:43:28.044 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:28 +0000 (0:00:00.059) 0:02:19.015 ******* 2020-11-16T21:43:28.082 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-16T21:43:28.084 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-11-16T21:43:28.116 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:28 +0000 (0:00:00.071) 0:02:19.087 ******* 2020-11-16T21:43:28.154 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-16T21:43:28.155 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-11-16T21:43:28.187 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:28 +0000 (0:00:00.071) 0:02:19.158 ******* 2020-11-16T21:43:28.225 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-16T21:43:28.226 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-16T21:43:28.260 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:28 +0000 (0:00:00.072) 0:02:19.230 ******* 2020-11-16T21:43:28.392 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-16T21:43:28.393 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-11-16T21:43:28.424 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:28 +0000 (0:00:00.164) 0:02:19.395 ******* 2020-11-16T21:43:28.555 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-16T21:43:28.557 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-16T21:43:28.589 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:28 +0000 (0:00:00.164) 0:02:19.560 ******* 2020-11-16T21:43:28.618 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-16T21:43:28.619 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:28.650 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:28 +0000 (0:00:00.061) 0:02:19.621 ******* 2020-11-16T21:43:28.688 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-16T21:43:28.690 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:28.723 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:28 +0000 (0:00:00.072) 0:02:19.694 ******* 2020-11-16T21:43:28.876 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-16T21:43:28.877 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-11-16T21:43:28.909 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:28 +0000 (0:00:00.185) 0:02:19.879 ******* 2020-11-16T21:43:29.277 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-16T21:43:29.279 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-11-16T21:43:29.311 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:29 +0000 (0:00:00.402) 0:02:20.281 ******* 2020-11-16T21:43:29.327 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-16T21:43:29.328 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi057.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-11-16T21:43:29.363 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:29 +0000 (0:00:00.052) 0:02:20.334 ******* 2020-11-16T21:43:29.395 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:29 +0000 (0:00:00.032) 0:02:20.366 ******* 2020-11-16T21:43:29.403 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-16T21:43:29.404 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi016"}, "changed": false} TASK [common : Include apt_system vars] **************************************** ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-11-16T21:43:29.439 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:29 +0000 (0:00:00.043) 0:02:20.410 ******* 2020-11-16T21:43:29.471 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:29 +0000 (0:00:00.032) 0:02:20.442 ******* 2020-11-16T21:43:29.499 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-16T21:43:29.501 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:29.532 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:29 +0000 (0:00:00.060) 0:02:20.502 ******* 2020-11-16T21:43:29.560 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-16T21:43:29.562 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-16T21:43:29.592 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:29 +0000 (0:00:00.060) 0:02:20.563 ******* 2020-11-16T21:43:29.631 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-16T21:43:29.633 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-16T21:43:29.642 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-16T21:43:29.653 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-16T21:43:29.687 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:29 +0000 (0:00:00.094) 0:02:20.658 ******* 2020-11-16T21:43:29.715 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-16T21:43:29.716 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:29.748 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:29 +0000 (0:00:00.061) 0:02:20.719 ******* 2020-11-16T21:43:37.994 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-16T21:43:37.996 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"cache_update_time": 1605562608, "cache_updated": false, "changed": false} TASK [testnode : Set the system's hostname] ************************************ changed: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi016.front.sepia.ceph.com", "ansible_hostname": "smithi016", "ansible_nodename": "smithi016"}, "changed": true, "name": "smithi016"} 2020-11-16T21:43:38.035 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:38 +0000 (0:00:08.286) 0:02:29.005 ******* 2020-11-16T21:43:38.068 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:38 +0000 (0:00:00.032) 0:02:29.038 ******* 2020-11-16T21:43:46.372 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-16T21:43:46.374 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1605562695, "cache_updated": false, "changed": false} 2020-11-16T21:43:46.410 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:46 +0000 (0:00:08.342) 0:02:37.380 ******* 2020-11-16T21:43:46.655 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-16T21:43:46.657 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-11-16T21:43:46.690 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:46 +0000 (0:00:00.280) 0:02:37.661 ******* 2020-11-16T21:43:46.729 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-16T21:43:46.731 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-11-16T21:43:46.765 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:46 +0000 (0:00:00.075) 0:02:37.736 ******* 2020-11-16T21:43:46.783 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi195.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-11-16T21:43:51.798 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-16T21:43:51.799 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-16T21:43:51.800 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-11-16T21:43:51.801 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-11-16T21:43:51.835 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:51 +0000 (0:00:05.069) 0:02:42.805 ******* 2020-11-16T21:43:51.867 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:51 +0000 (0:00:00.032) 0:02:42.837 ******* 2020-11-16T21:43:51.900 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:51 +0000 (0:00:00.033) 0:02:42.870 ******* 2020-11-16T21:43:52.010 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-16T21:43:52.012 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-11-16T21:43:52.022 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-16T21:43:52.024 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-11-16T21:43:52.058 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:52 +0000 (0:00:00.158) 0:02:43.029 ******* 2020-11-16T21:43:52.118 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-16T21:43:52.119 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-11-16T21:43:52.155 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:52 +0000 (0:00:00.097) 0:02:43.126 ******* 2020-11-16T21:43:52.183 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:52.215 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:52 +0000 (0:00:00.060) 0:02:43.186 ******* 2020-11-16T21:43:52.249 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-16T21:43:52.251 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-16T21:43:52.281 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:52 +0000 (0:00:00.065) 0:02:43.252 ******* 2020-11-16T21:43:52.309 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-16T21:43:52.311 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:52.344 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:52 +0000 (0:00:00.063) 0:02:43.315 ******* 2020-11-16T21:43:52.372 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-16T21:43:52.374 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-11-16T21:43:52.468 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-16T21:43:52.470 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-16T21:43:52.506 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:52 +0000 (0:00:00.161) 0:02:43.477 ******* 2020-11-16T21:43:52.535 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-16T21:43:52.537 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:52.570 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:52 +0000 (0:00:00.063) 0:02:43.540 ******* 2020-11-16T21:43:52.597 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-16T21:43:52.598 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:52.631 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:52 +0000 (0:00:00.060) 0:02:43.601 ******* 2020-11-16T21:43:52.650 INFO:teuthology.task.ansible.out: 2020-11-16T21:43:52.652 INFO:teuthology.task.ansible.out:TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi195.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-11-16T21:43:52.652 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2020-11-16T21:43:52.691 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:52 +0000 (0:00:00.059) 0:02:43.661 ******* 2020-11-16T21:43:52.698 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-16T21:43:52.700 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:52.733 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:52 +0000 (0:00:00.042) 0:02:43.703 ******* 2020-11-16T21:43:52.760 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-16T21:43:52.762 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:52.794 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:52 +0000 (0:00:00.060) 0:02:43.764 ******* 2020-11-16T21:43:52.821 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:52.886 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:52 +0000 (0:00:00.091) 0:02:43.856 ******* 2020-11-16T21:43:52.904 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-16T21:43:52.906 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-11-16 21:40:56 UTC", "ActiveEnterTimestampMonotonic": "17910157", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount system.slice network.target sysinit.target -.mount nss-lookup.target local-fs.target time-sync.target systemd-tmpfiles-setup.service remote-fs.target basic.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-11-16 21:40:56 UTC", "AssertTimestampMonotonic": "17909011", "Before": "multi-user.target plymouth-quit.service getty@tty1.service xdm.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-11-16 21:40:56 UTC", "ConditionTimestampMonotonic": "17909011", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-11-16T21:43:52.908 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1306", "ExecMainStartTimestamp": "Mon 2020-11-16 21:40:56 UTC", "ExecMainStartTimestampMonotonic": "17910118", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2020-11-16 21:40:56 UTC] ; stop_time=[n/a] ; pid=1306 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-11-16 21:40:56 UTC", "InactiveExitTimestampMonotonic": "17910157", "InvocationID": "5922066ad90c4e809763a145d6034d59", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2020-11-16T21:43:52.909 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1306", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2020-11-16T21:43:52.911 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-11-16 21:40:56 UTC", "StateChangeTimestampMonotonic": "17910157", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-11-16 21:40:56 UTC", "WatchdogTimestampMonotonic": "17910156", "WatchdogUSec": "0"}} TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi195.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "f 2020-11-16T21:43:52.912 INFO:teuthology.task.ansible.out:ile", "uid": 0} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:52.943 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:52 +0000 (0:00:00.057) 0:02:43.914 ******* 2020-11-16T21:43:52.974 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:52 +0000 (0:00:00.030) 0:02:43.944 ******* 2020-11-16T21:43:53.006 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.032) 0:02:43.976 ******* 2020-11-16T21:43:53.011 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-16T21:43:53.013 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get SELinux status] ********************************************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:53.047 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.040) 0:02:44.017 ******* 2020-11-16T21:43:53.080 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.033) 0:02:44.050 ******* 2020-11-16T21:43:53.085 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-16T21:43:53.087 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:53.126 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.046) 0:02:44.096 ******* 2020-11-16T21:43:53.157 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.031) 0:02:44.127 ******* 2020-11-16T21:43:53.162 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-16T21:43:53.164 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-16T21:43:53.197 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.040) 0:02:44.167 ******* 2020-11-16T21:43:53.228 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.030) 0:02:44.198 ******* 2020-11-16T21:43:53.233 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-16T21:43:53.235 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-16T21:43:53.267 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.039) 0:02:44.238 ******* 2020-11-16T21:43:53.299 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.031) 0:02:44.269 ******* 2020-11-16T21:43:53.304 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-16T21:43:53.306 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable copr repos] ******************************************** 2020-11-16T21:43:53.341 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.042) 0:02:44.311 ******* 2020-11-16T21:43:53.373 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.031) 0:02:44.343 ******* 2020-11-16T21:43:53.379 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-16T21:43:53.380 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [testnode : Install GPG] ************************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:53.432 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.059) 0:02:44.403 ******* 2020-11-16T21:43:53.464 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.031) 0:02:44.434 ******* 2020-11-16T21:43:53.471 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-16T21:43:53.472 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi016.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-16T21:43:53.533 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.068) 0:02:44.503 ******* 2020-11-16T21:43:53.544 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-16T21:43:53.546 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-16T21:43:53.546 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-16T21:43:53.547 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-16T21:43:53.581 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.048) 0:02:44.551 ******* 2020-11-16T21:43:53.613 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.032) 0:02:44.583 ******* 2020-11-16T21:43:53.620 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-16T21:43:53.621 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:53.656 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.042) 0:02:44.626 ******* 2020-11-16T21:43:53.688 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.032) 0:02:44.658 ******* 2020-11-16T21:43:53.703 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-16T21:43:53.704 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:53.737 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.048) 0:02:44.707 ******* 2020-11-16T21:43:53.769 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.032) 0:02:44.739 ******* 2020-11-16T21:43:53.775 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-16T21:43:53.776 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:53.831 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.061) 0:02:44.801 ******* 2020-11-16T21:43:53.866 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.035) 0:02:44.836 ******* 2020-11-16T21:43:53.872 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-16T21:43:53.873 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:53.907 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.041) 0:02:44.877 ******* 2020-11-16T21:43:53.913 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-16T21:43:53.914 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:53.948 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.040) 0:02:44.918 ******* 2020-11-16T21:43:53.954 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-16T21:43:53.956 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:53.990 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:53 +0000 (0:00:00.041) 0:02:44.960 ******* 2020-11-16T21:43:53.996 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-16T21:43:53.998 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:54.031 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:54 +0000 (0:00:00.041) 0:02:45.001 ******* 2020-11-16T21:43:54.036 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-16T21:43:54.038 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:54.071 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:54 +0000 (0:00:00.039) 0:02:45.041 ******* 2020-11-16T21:43:54.077 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-16T21:43:54.078 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:54.112 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:54 +0000 (0:00:00.040) 0:02:45.082 ******* 2020-11-16T21:43:54.118 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-16T21:43:54.119 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:54.152 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:54 +0000 (0:00:00.040) 0:02:45.123 ******* 2020-11-16T21:43:54.158 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-16T21:43:54.159 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:54.193 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:54 +0000 (0:00:00.040) 0:02:45.163 ******* 2020-11-16T21:43:54.200 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-16T21:43:54.202 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:43:54.239 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:43:54 +0000 (0:00:00.046) 0:02:45.210 ******* 2020-11-16T21:44:02.498 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-16T21:44:02.500 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** ok: [smithi195.front.sepia.ceph.com] => {"cache_update_time": 1605562608, "cache_updated": false, "changed": false} 2020-11-16T21:44:02.533 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:02 +0000 (0:00:08.293) 0:02:53.504 ******* 2020-11-16T21:44:02.564 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:02 +0000 (0:00:00.030) 0:02:53.535 ******* 2020-11-16T21:44:02.572 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-16T21:44:02.574 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including distro specific variables.] ************************* ok: [smithi057.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-11-16T21:44:02.610 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:02 +0000 (0:00:00.045) 0:02:53.580 ******* 2020-11-16T21:44:02.643 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:02 +0000 (0:00:00.033) 0:02:53.614 ******* 2020-11-16T21:44:02.651 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-16T21:44:02.653 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:02.687 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:02 +0000 (0:00:00.043) 0:02:53.658 ******* 2020-11-16T21:44:02.693 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-16T21:44:02.695 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-11-16T21:44:02.729 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:02 +0000 (0:00:00.041) 0:02:53.699 ******* 2020-11-16T21:44:02.736 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-16T21:44:02.737 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:02.771 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:02 +0000 (0:00:00.042) 0:02:53.742 ******* 2020-11-16T21:44:02.778 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-16T21:44:02.780 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-16T21:44:02.813 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:02 +0000 (0:00:00.041) 0:02:53.783 ******* 2020-11-16T21:44:02.819 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-16T21:44:02.821 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:02.855 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:02 +0000 (0:00:00.042) 0:02:53.825 ******* 2020-11-16T21:44:02.882 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-16T21:44:02.884 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:02.916 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:02 +0000 (0:00:00.060) 0:02:53.886 ******* 2020-11-16T21:44:11.124 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-16T21:44:11.126 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-11-16T21:44:11.159 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:11 +0000 (0:00:08.242) 0:03:02.129 ******* 2020-11-16T21:44:11.166 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-16T21:44:11.167 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:11.201 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:11 +0000 (0:00:00.042) 0:03:02.171 ******* 2020-11-16T21:44:11.233 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:11 +0000 (0:00:00.032) 0:03:02.204 ******* 2020-11-16T21:44:11.239 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-16T21:44:11.241 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:11.275 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:11 +0000 (0:00:00.041) 0:03:02.245 ******* 2020-11-16T21:44:19.613 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-16T21:44:19.614 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-16T21:44:19.646 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:19 +0000 (0:00:08.371) 0:03:10.616 ******* 2020-11-16T21:44:19.652 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-11-16T21:44:19.653 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:19.686 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:19 +0000 (0:00:00.040) 0:03:10.657 ******* 2020-11-16T21:44:19.693 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-16T21:44:19.695 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:19.727 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:19 +0000 (0:00:00.040) 0:03:10.697 ******* 2020-11-16T21:44:19.732 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-16T21:44:19.734 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:19.765 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:19 +0000 (0:00:00.038) 0:03:10.736 ******* 2020-11-16T21:44:19.771 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-16T21:44:19.772 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:19.805 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:19 +0000 (0:00:00.040) 0:03:10.776 ******* 2020-11-16T21:44:19.812 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-16T21:44:19.814 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:19.847 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:19 +0000 (0:00:00.041) 0:03:10.817 ******* 2020-11-16T21:44:32.324 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-16T21:44:32.326 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-11-16T21:44:32.358 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:32 +0000 (0:00:12.511) 0:03:23.329 ******* 2020-11-16T21:44:32.365 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-16T21:44:32.366 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:32.400 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:32 +0000 (0:00:00.041) 0:03:23.371 ******* 2020-11-16T21:44:32.432 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:32 +0000 (0:00:00.032) 0:03:23.403 ******* 2020-11-16T21:44:32.438 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-16T21:44:32.440 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:32.474 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:32 +0000 (0:00:00.041) 0:03:23.444 ******* 2020-11-16T21:44:32.491 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-16T21:44:32.493 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-11-16T21:44:32.597 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-11-16T21:44:32.632 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:32 +0000 (0:00:00.157) 0:03:23.602 ******* 2020-11-16T21:44:32.638 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-16T21:44:32.640 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005207", "end": "2020-11-16 21:44:32.607747", "rc": 0, "start": "2020-11-16 21:44:32.602540", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:44:32.672 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:32 +0000 (0:00:00.040) 0:03:23.643 ******* 2020-11-16T21:44:32.680 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-16T21:44:32.681 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:32.712 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:32 +0000 (0:00:00.039) 0:03:23.683 ******* 2020-11-16T21:44:32.718 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-16T21:44:32.753 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:32 +0000 (0:00:00.040) 0:03:23.723 ******* 2020-11-16T21:44:32.758 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-16T21:44:32.760 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-16T21:44:32.798 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:32 +0000 (0:00:00.045) 0:03:23.768 ******* 2020-11-16T21:44:32.815 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-16T21:44:32.817 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-11-16T21:44:32.849 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:32 +0000 (0:00:00.051) 0:03:23.820 ******* 2020-11-16T21:44:32.856 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-16T21:44:32.857 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:32.890 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:32 +0000 (0:00:00.040) 0:03:23.860 ******* 2020-11-16T21:44:32.896 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-16T21:44:32.898 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi057"}, "changed": false} 2020-11-16T21:44:32.931 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:32 +0000 (0:00:00.041) 0:03:23.902 ******* 2020-11-16T21:44:33.073 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-16T21:44:33.075 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-11-16T21:44:33.108 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:33 +0000 (0:00:00.176) 0:03:24.078 ******* 2020-11-16T21:44:33.136 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-16T21:44:33.138 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:33.169 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:33 +0000 (0:00:00.060) 0:03:24.139 ******* 2020-11-16T21:44:33.206 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-16T21:44:33.208 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2020-11-16T21:44:33.241 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:33 +0000 (0:00:00.072) 0:03:24.211 ******* 2020-11-16T21:44:33.383 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-11-16T21:44:33.385 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi057.front.sepia.ceph.com", "ansible_hostname": "smithi057", "ansible_nodename": "smithi057"}, "changed": true, "name": "smithi057"} 2020-11-16T21:44:33.418 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:33 +0000 (0:00:00.177) 0:03:24.389 ******* 2020-11-16T21:44:33.469 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-16T21:44:33.471 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-11-16 21:40:42 UTC", "ActiveEnterTimestampMonotonic": "19038894", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target basic.target systemd-tmpfiles-setup.service local-fs.target -.mount systemd-journald.socket time-sync.target network.target system.slice remote-fs.target var-run.mount sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-11-16 21:40:42 UTC", "AssertTimestampMonotonic": "19038121", "Before": "shutdown.target plymouth-quit.service xdm.service getty@tty1.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-11-16 21:40:42 UTC", "ConditionTimestampMonotonic": "19038121", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-11-16T21:44:33.472 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1285", "ExecMainStartTimestamp": "Mon 2020-11-16 21:40:42 UTC", "ExecMainStartTimestampMonotonic": "19038834", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2020-11-16 21:40:42 UTC] ; stop_time=[n/a] ; pid=1285 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-11-16 21:40:42 UTC", "InactiveExitTimestampMonotonic": "19038894", "InvocationID": "af328bdef4244246aa88386a5ead1fab", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2020-11-16T21:44:33.474 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1285", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2020-11-16T21:44:33.475 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-11-16 21:40:42 UTC", "StateChangeTimestampMonotonic": "19038894", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-11-16 21:40:42 UTC", "WatchdogTimestampMonotonic": "19038894", "WatchdogUSec": "0"}} 2020-11-16T21:44:33.506 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:33 +0000 (0:00:00.087) 0:03:24.477 ******* 2020-11-16T21:44:33.533 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-16T21:44:33.535 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:33.566 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:33 +0000 (0:00:00.060) 0:03:24.537 ******* 2020-11-16T21:44:33.593 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-16T21:44:33.595 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:33.626 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:33 +0000 (0:00:00.059) 0:03:24.597 ******* 2020-11-16T21:44:37.765 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-16T21:44:37.767 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:37.798 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:37 +0000 (0:00:04.171) 0:03:28.768 ******* 2020-11-16T21:44:37.824 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-16T21:44:37.825 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:37.863 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:37 +0000 (0:00:00.064) 0:03:28.833 ******* 2020-11-16T21:44:37.890 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-16T21:44:37.891 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:37.923 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:37 +0000 (0:00:00.059) 0:03:28.893 ******* 2020-11-16T21:44:37.940 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-16T21:44:37.941 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-11-16T21:44:37.974 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:37 +0000 (0:00:00.050) 0:03:28.944 ******* 2020-11-16T21:44:37.980 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-16T21:44:37.982 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:38.017 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:38 +0000 (0:00:00.042) 0:03:28.987 ******* 2020-11-16T21:44:38.044 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-16T21:44:38.045 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:38.077 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:38 +0000 (0:00:00.060) 0:03:29.048 ******* 2020-11-16T21:44:38.104 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-16T21:44:38.106 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:38.143 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:38 +0000 (0:00:00.065) 0:03:29.113 ******* 2020-11-16T21:44:38.171 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-16T21:44:38.173 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:38.204 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:38 +0000 (0:00:00.061) 0:03:29.174 ******* 2020-11-16T21:44:38.231 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-16T21:44:38.232 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:38.263 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:38 +0000 (0:00:00.059) 0:03:29.234 ******* 2020-11-16T21:44:38.290 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-11-16T21:44:38.292 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} TASK [testnode : Include package type specific vars.] ************************** ok: [smithi195.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-11-16T21:44:38.324 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:38 +0000 (0:00:00.060) 0:03:29.294 ******* 2020-11-16T21:44:38.355 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:38 +0000 (0:00:00.030) 0:03:29.325 ******* 2020-11-16T21:44:38.393 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-16T21:44:38.394 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-11-16T21:44:38.428 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:38 +0000 (0:00:00.073) 0:03:29.399 ******* 2020-11-16T21:44:38.467 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-16T21:44:38.469 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-11-16T21:44:38.504 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:38 +0000 (0:00:00.075) 0:03:29.474 ******* 2020-11-16T21:44:38.563 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-16T21:44:38.565 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-16T21:44:38.603 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:38 +0000 (0:00:00.099) 0:03:29.573 ******* 2020-11-16T21:44:38.692 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-16T21:44:38.694 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-11-16T21:44:38.735 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-16T21:44:38.736 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-11-16T21:44:38.768 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:38 +0000 (0:00:00.164) 0:03:29.738 ******* 2020-11-16T21:44:38.867 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-16T21:44:38.869 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-16T21:44:38.903 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:38 +0000 (0:00:00.134) 0:03:29.873 ******* 2020-11-16T21:44:38.931 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-16T21:44:38.932 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:38.965 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:38 +0000 (0:00:00.062) 0:03:29.935 ******* 2020-11-16T21:44:43.154 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-16T21:44:43.156 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:43.187 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:43 +0000 (0:00:04.222) 0:03:34.158 ******* 2020-11-16T21:44:43.215 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-16T21:44:43.217 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:43.249 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:43 +0000 (0:00:00.061) 0:03:34.219 ******* 2020-11-16T21:44:43.278 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-16T21:44:43.280 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:43.311 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:43 +0000 (0:00:00.062) 0:03:34.282 ******* 2020-11-16T21:44:43.339 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-16T21:44:43.340 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:43.372 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:43 +0000 (0:00:00.060) 0:03:34.342 ******* 2020-11-16T21:44:43.398 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-16T21:44:43.400 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:43.431 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:43 +0000 (0:00:00.058) 0:03:34.401 ******* 2020-11-16T21:44:43.457 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-16T21:44:43.458 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:43.490 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:43 +0000 (0:00:00.059) 0:03:34.460 ******* 2020-11-16T21:44:43.517 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:43.550 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:43 +0000 (0:00:00.060) 0:03:34.520 ******* 2020-11-16T21:44:43.577 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-16T21:44:43.610 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:43 +0000 (0:00:00.059) 0:03:34.580 ******* 2020-11-16T21:44:43.636 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-16T21:44:43.672 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:43 +0000 (0:00:00.062) 0:03:34.643 ******* 2020-11-16T21:44:43.700 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-16T21:44:43.732 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:43 +0000 (0:00:00.059) 0:03:34.703 ******* 2020-11-16T21:44:43.769 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-16T21:44:43.770 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:43.802 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:43 +0000 (0:00:00.069) 0:03:34.772 ******* 2020-11-16T21:44:43.851 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-16T21:44:43.852 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-16T21:44:43.862 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-16T21:44:43.896 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:43 +0000 (0:00:00.093) 0:03:34.866 ******* 2020-11-16T21:44:43.923 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-16T21:44:43.924 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:43.956 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:43 +0000 (0:00:00.059) 0:03:34.926 ******* 2020-11-16T21:44:43.982 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:44:43.983 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:44.015 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:44 +0000 (0:00:00.059) 0:03:34.985 ******* 2020-11-16T21:44:44.042 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-16T21:44:44.043 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:44.076 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:44 +0000 (0:00:00.060) 0:03:35.046 ******* 2020-11-16T21:44:44.102 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-16T21:44:44.103 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:44.135 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:44 +0000 (0:00:00.059) 0:03:35.105 ******* 2020-11-16T21:44:44.161 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-16T21:44:44.163 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:44.194 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:44 +0000 (0:00:00.059) 0:03:35.164 ******* 2020-11-16T21:44:44.221 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-16T21:44:44.223 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:44.254 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:44 +0000 (0:00:00.059) 0:03:35.224 ******* 2020-11-16T21:44:44.281 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-16T21:44:44.282 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:44.314 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:44 +0000 (0:00:00.060) 0:03:35.285 ******* 2020-11-16T21:44:44.342 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-16T21:44:44.344 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:44.375 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:44 +0000 (0:00:00.060) 0:03:35.346 ******* 2020-11-16T21:44:44.401 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-16T21:44:44.403 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:44.437 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:44 +0000 (0:00:00.062) 0:03:35.408 ******* 2020-11-16T21:44:44.465 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-16T21:44:44.467 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:44.499 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:44 +0000 (0:00:00.061) 0:03:35.469 ******* 2020-11-16T21:44:44.526 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-16T21:44:44.528 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:44.559 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:44 +0000 (0:00:00.060) 0:03:35.530 ******* 2020-11-16T21:44:44.586 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-16T21:44:44.588 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:44.620 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:44 +0000 (0:00:00.060) 0:03:35.590 ******* 2020-11-16T21:44:44.647 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-16T21:44:44.649 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:44.681 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:44 +0000 (0:00:00.060) 0:03:35.651 ******* 2020-11-16T21:44:44.708 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-11-16T21:44:44.710 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:44.742 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:44 +0000 (0:00:00.060) 0:03:35.712 ******* 2020-11-16T21:44:44.768 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-16T21:44:44.770 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:44.802 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:44 +0000 (0:00:00.060) 0:03:35.773 ******* 2020-11-16T21:44:44.828 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-11-16T21:44:44.830 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:44.861 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:44 +0000 (0:00:00.059) 0:03:35.832 ******* 2020-11-16T21:44:44.888 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-16T21:44:44.889 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:44.921 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:44 +0000 (0:00:00.059) 0:03:35.891 ******* 2020-11-16T21:44:44.947 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:44.980 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:44 +0000 (0:00:00.059) 0:03:35.951 ******* 2020-11-16T21:44:45.008 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:45.040 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:45 +0000 (0:00:00.059) 0:03:36.011 ******* 2020-11-16T21:44:45.066 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-16T21:44:45.068 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:45.099 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:45 +0000 (0:00:00.058) 0:03:36.069 ******* 2020-11-16T21:44:45.229 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-16T21:44:45.231 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005363", "end": "2020-11-16 21:44:45.225821", "rc": 0, "start": "2020-11-16 21:44:45.220458", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:44:45.265 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:45 +0000 (0:00:00.166) 0:03:36.236 ******* 2020-11-16T21:44:45.294 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-16T21:44:45.327 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:45 +0000 (0:00:00.061) 0:03:36.298 ******* 2020-11-16T21:44:45.646 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-16T21:44:45.648 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-11-16T21:44:45.679 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:45 +0000 (0:00:00.352) 0:03:36.650 ******* 2020-11-16T21:44:45.707 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-16T21:44:45.708 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:45.740 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:45 +0000 (0:00:00.060) 0:03:36.710 ******* 2020-11-16T21:44:46.739 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-16T21:44:46.741 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-11-16T21:44:51.301 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-16T21:44:51.302 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-16T21:44:51.339 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:51 +0000 (0:00:05.599) 0:03:42.309 ******* 2020-11-16T21:44:51.367 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-16T21:44:51.369 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:51.401 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:51 +0000 (0:00:00.062) 0:03:42.371 ******* 2020-11-16T21:44:51.428 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-16T21:44:51.430 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:51.462 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:51 +0000 (0:00:00.060) 0:03:42.432 ******* 2020-11-16T21:44:51.613 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-16T21:44:51.615 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-11-16T21:44:51.647 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:51 +0000 (0:00:00.185) 0:03:42.618 ******* 2020-11-16T21:44:51.819 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-16T21:44:51.820 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-11-16T21:44:51.856 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:51 +0000 (0:00:00.208) 0:03:42.826 ******* 2020-11-16T21:44:52.020 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-16T21:44:52.021 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-11-16T21:44:52.055 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:52 +0000 (0:00:00.198) 0:03:43.025 ******* 2020-11-16T21:44:52.061 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-16T21:44:52.063 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-11-16T21:44:52.098 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:52 +0000 (0:00:00.043) 0:03:43.068 ******* 2020-11-16T21:44:52.104 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-16T21:44:52.106 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi195"}, "changed": false} 2020-11-16T21:44:52.139 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:52 +0000 (0:00:00.041) 0:03:43.109 ******* 2020-11-16T21:44:52.604 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-11-16T21:44:52.606 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi195.front.sepia.ceph.com", "ansible_hostname": "smithi195", "ansible_nodename": "smithi195"}, "changed": true, "name": "smithi195"} 2020-11-16T21:44:52.637 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:52 +0000 (0:00:00.498) 0:03:43.608 ******* 2020-11-16T21:44:52.768 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-16T21:44:52.770 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1605562695, "cache_updated": false, "changed": false} 2020-11-16T21:44:52.803 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:52 +0000 (0:00:00.165) 0:03:43.773 ******* 2020-11-16T21:44:52.831 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-16T21:44:52.864 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:52 +0000 (0:00:00.060) 0:03:43.834 ******* 2020-11-16T21:44:52.953 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-16T21:44:52.955 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-11-16T21:44:52.988 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:52 +0000 (0:00:00.124) 0:03:43.958 ******* 2020-11-16T21:44:53.015 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-16T21:44:53.017 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1605562650, "cache_updated": false, "changed": false} 2020-11-16T21:44:53.051 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:53 +0000 (0:00:00.063) 0:03:44.021 ******* 2020-11-16T21:44:53.059 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-16T21:44:53.060 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.034118", "end": "2020-11-16 21:44:53.020274", "rc": 0, "start": "2020-11-16 21:44:52.986156", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:44:53.098 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:53 +0000 (0:00:00.047) 0:03:44.069 ******* 2020-11-16T21:44:53.106 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-16T21:44:53.140 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:53 +0000 (0:00:00.041) 0:03:44.110 ******* 2020-11-16T21:44:53.303 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-16T21:44:53.305 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.032424", "end": "2020-11-16 21:44:53.299088", "rc": 0, "start": "2020-11-16 21:44:53.266664", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-11-16T21:44:53.338 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:53 +0000 (0:00:00.198) 0:03:44.309 ******* 2020-11-16T21:44:53.374 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:53 +0000 (0:00:00.035) 0:03:44.345 ******* 2020-11-16T21:44:53.881 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-16T21:44:53.882 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-16T21:44:53.934 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:53 +0000 (0:00:00.560) 0:03:44.905 ******* 2020-11-16T21:44:53.962 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-16T21:44:53.964 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:53.997 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:53 +0000 (0:00:00.062) 0:03:44.967 ******* 2020-11-16T21:44:54.024 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-16T21:44:54.026 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:54.058 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:54 +0000 (0:00:00.060) 0:03:45.028 ******* 2020-11-16T21:44:54.086 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-16T21:44:54.088 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:54.120 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:54 +0000 (0:00:00.061) 0:03:45.090 ******* 2020-11-16T21:44:54.147 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-16T21:44:54.148 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:54.180 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:54 +0000 (0:00:00.060) 0:03:45.150 ******* 2020-11-16T21:44:54.207 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-16T21:44:54.209 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:54.240 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:54 +0000 (0:00:00.060) 0:03:45.211 ******* 2020-11-16T21:44:54.269 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-16T21:44:54.270 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:54.302 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:54 +0000 (0:00:00.061) 0:03:45.272 ******* 2020-11-16T21:44:54.329 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-16T21:44:54.331 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:54.366 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:54 +0000 (0:00:00.063) 0:03:45.336 ******* 2020-11-16T21:44:54.394 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:44:54.428 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:54 +0000 (0:00:00.061) 0:03:45.398 ******* 2020-11-16T21:44:54.455 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-16T21:44:54.491 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:54 +0000 (0:00:00.062) 0:03:45.460 ******* 2020-11-16T21:44:54.518 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-16T21:44:54.551 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:54 +0000 (0:00:00.061) 0:03:45.521 ******* 2020-11-16T21:44:54.578 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-16T21:44:54.611 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:44:54 +0000 (0:00:00.060) 0:03:45.582 ******* 2020-11-16T21:45:07.011 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-11-16T21:45:07.012 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1605562695, "cache_updated": false, "changed": false} 2020-11-16T21:45:07.047 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:07 +0000 (0:00:12.435) 0:03:58.017 ******* 2020-11-16T21:45:07.055 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1605562650, "cache_updated": false, "changed": false} 2020-11-16T21:45:07.056 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-16T21:45:07.058 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:07.093 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:07 +0000 (0:00:00.046) 0:03:58.064 ******* 2020-11-16T21:45:11.280 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:11 +0000 (0:00:04.186) 0:04:02.250 ******* 2020-11-16T21:45:11.320 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-16T21:45:11.322 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-16T21:45:11.354 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:11 +0000 (0:00:00.074) 0:04:02.325 ******* 2020-11-16T21:45:11.382 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-16T21:45:11.383 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:11.415 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:11 +0000 (0:00:00.060) 0:04:02.385 ******* 2020-11-16T21:45:11.442 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:45:11.444 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:11.475 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:11 +0000 (0:00:00.060) 0:04:02.446 ******* 2020-11-16T21:45:11.503 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-16T21:45:11.504 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:11.536 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:11 +0000 (0:00:00.061) 0:04:02.507 ******* 2020-11-16T21:45:11.563 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-16T21:45:11.565 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:11.596 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:11 +0000 (0:00:00.059) 0:04:02.567 ******* 2020-11-16T21:45:11.624 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-16T21:45:11.625 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:11.662 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:11 +0000 (0:00:00.065) 0:04:02.632 ******* 2020-11-16T21:45:11.688 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-16T21:45:11.690 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:11.721 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:11 +0000 (0:00:00.059) 0:04:02.691 ******* 2020-11-16T21:45:11.748 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-16T21:45:11.750 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:11.781 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:11 +0000 (0:00:00.059) 0:04:02.751 ******* 2020-11-16T21:45:11.807 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-16T21:45:11.808 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:11.840 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:11 +0000 (0:00:00.059) 0:04:02.810 ******* 2020-11-16T21:45:11.867 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-16T21:45:11.869 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:11.900 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:11 +0000 (0:00:00.059) 0:04:02.870 ******* 2020-11-16T21:45:11.926 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-16T21:45:11.927 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:11.959 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:11 +0000 (0:00:00.059) 0:04:02.930 ******* 2020-11-16T21:45:11.986 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-16T21:45:11.988 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:12.021 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:12 +0000 (0:00:00.061) 0:04:02.992 ******* 2020-11-16T21:45:12.049 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-16T21:45:12.050 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:12.083 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:12 +0000 (0:00:00.061) 0:04:03.053 ******* 2020-11-16T21:45:12.109 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-16T21:45:12.110 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:12.142 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:12 +0000 (0:00:00.058) 0:04:03.112 ******* 2020-11-16T21:45:12.168 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-11-16T21:45:12.169 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:12.200 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:12 +0000 (0:00:00.058) 0:04:03.171 ******* 2020-11-16T21:45:12.227 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-16T21:45:12.228 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:12.260 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:12 +0000 (0:00:00.059) 0:04:03.230 ******* 2020-11-16T21:45:12.286 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-11-16T21:45:12.288 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:12.319 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:12 +0000 (0:00:00.059) 0:04:03.290 ******* 2020-11-16T21:45:12.346 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-16T21:45:12.348 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:12.384 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:12 +0000 (0:00:00.064) 0:04:03.354 ******* 2020-11-16T21:45:12.411 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-16T21:45:12.413 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:12.445 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:12 +0000 (0:00:00.061) 0:04:03.416 ******* 2020-11-16T21:45:12.471 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-11-16T21:45:12.473 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:12.505 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:12 +0000 (0:00:00.059) 0:04:03.475 ******* 2020-11-16T21:45:12.531 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-16T21:45:12.532 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:12.564 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:12 +0000 (0:00:00.059) 0:04:03.534 ******* 2020-11-16T21:45:20.332 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-11-16T21:45:20.334 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 1 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137606 files and directories 2020-11-16T21:45:20.335 INFO:teuthology.task.ansible.out: currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 1 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2020-11-16T21:45:20.337 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137606 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2020-11-16T21:45:20.367 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:20 +0000 (0:00:07.802) 0:04:11.337 ******* 2020-11-16T21:45:20.417 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 1 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137606 files and directories 2020-11-16T21:45:20.418 INFO:teuthology.task.ansible.out: currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 1 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2020-11-16T21:45:20.420 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137606 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2020-11-16T21:45:20.452 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:20 +0000 (0:00:00.085) 0:04:11.422 ******* 2020-11-16T21:45:21.009 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-16T21:45:21.011 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005158", "end": "2020-11-16 21:45:21.007721", "rc": 0, "start": "2020-11-16 21:45:21.002563", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:45:21.044 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:21 +0000 (0:00:00.591) 0:04:12.014 ******* 2020-11-16T21:45:21.072 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-16T21:45:21.112 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:21 +0000 (0:00:00.067) 0:04:12.082 ******* 2020-11-16T21:45:27.832 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-16T21:45:27.834 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-11-16T21:45:27.866 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:27 +0000 (0:00:06.754) 0:04:18.836 ******* 2020-11-16T21:45:32.039 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-16T21:45:32.041 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:32.073 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:32 +0000 (0:00:04.206) 0:04:23.043 ******* 2020-11-16T21:45:33.089 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-16T21:45:33.091 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-11-16T21:45:33.835 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-16T21:45:33.836 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1605562650, "cache_updated": false, "changed": false} 2020-11-16T21:45:33.869 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:33 +0000 (0:00:01.796) 0:04:24.839 ******* 2020-11-16T21:45:33.897 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-16T21:45:33.899 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:33.934 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:33 +0000 (0:00:00.065) 0:04:24.905 ******* 2020-11-16T21:45:33.941 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-16T21:45:33.943 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1605562695, "cache_updated": false, "changed": false} 2020-11-16T21:45:33.978 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:33 +0000 (0:00:00.043) 0:04:24.948 ******* 2020-11-16T21:45:34.005 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:34.040 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:34 +0000 (0:00:00.061) 0:04:25.010 ******* 2020-11-16T21:45:34.047 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-16T21:45:34.048 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-11-16T21:45:34.083 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:34 +0000 (0:00:00.043) 0:04:25.054 ******* 2020-11-16T21:45:34.994 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-16T21:45:34.996 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"cache_update_time": 1605562608, "cache_updated": false, "changed": false} 2020-11-16T21:45:35.027 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:35 +0000 (0:00:00.944) 0:04:25.998 ******* 2020-11-16T21:45:35.054 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-16T21:45:35.087 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:35 +0000 (0:00:00.059) 0:04:26.058 ******* 2020-11-16T21:45:35.249 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-16T21:45:35.251 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.033388", "end": "2020-11-16 21:45:35.241472", "rc": 0, "start": "2020-11-16 21:45:35.208084", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:45:35.283 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:35 +0000 (0:00:00.195) 0:04:26.253 ******* 2020-11-16T21:45:38.225 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-11-16T21:45:38.227 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"cache_update_time": 1605562608, "cache_updated": false, "changed": false} 2020-11-16T21:45:38.259 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:38 +0000 (0:00:02.975) 0:04:29.229 ******* 2020-11-16T21:45:46.561 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-16T21:45:46.562 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1605562650, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 1 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.33 [40.1 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.33 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.33 [5193 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.33 [873 kB]\nFetched 10.4 MB in 1s (9750 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 2020-11-16T21:45:46.564 INFO:teuthology.task.ansible.out: 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137464 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu 2020-11-16T21:45:46.565 INFO:teuthology.task.ansible.out:1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 1 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.33 [40.1 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.33 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.33 [5193 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.33 [873 kB]", "Fetched 10.4 MB in 1s (9750 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Rea 2020-11-16T21:45:46.566 INFO:teuthology.task.ansible.out:ding database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137464 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} changed: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1605562695, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow 2020-11-16T21:45:46.568 INFO:teuthology.task.ansible.out: instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 1 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.33 [40.1 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.33 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.33 [5193 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.33 [873 kB]\nFetched 10.4 MB in 1s (9951 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading d 2020-11-16T21:45:46.569 INFO:teuthology.task.ansible.out:atabase ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137464 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additio 2020-11-16T21:45:46.571 INFO:teuthology.task.ansible.out:nal packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 1 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.33 [40.1 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.33 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.33 [5193 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.33 [873 kB]", "Fetched 10.4 MB in 1s (9951 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137464 files and directories currently installed.)", "Preparing to unp 2020-11-16T21:45:46.572 INFO:teuthology.task.ansible.out:ack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2020-11-16T21:45:46.600 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:46 +0000 (0:00:08.341) 0:04:37.571 ******* 2020-11-16T21:45:46.636 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:46 +0000 (0:00:00.035) 0:04:37.606 ******* 2020-11-16T21:45:47.508 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-11-16T21:45:47.509 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1605562650, "cache_updated": false, "changed": false} 2020-11-16T21:45:47.542 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:47 +0000 (0:00:00.905) 0:04:38.512 ******* 2020-11-16T21:45:47.548 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1605562695, "cache_updated": false, "changed": false} 2020-11-16T21:45:47.583 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:47 +0000 (0:00:00.041) 0:04:38.553 ******* 2020-11-16T21:45:47.663 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-16T21:45:47.665 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-11-16T21:45:47.697 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:47 +0000 (0:00:00.114) 0:04:38.668 ******* 2020-11-16T21:45:47.724 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-11-16T21:45:47.726 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:47.757 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:47 +0000 (0:00:00.059) 0:04:38.728 ******* 2020-11-16T21:45:51.814 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-16T21:45:51.816 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-11-16T21:45:51.849 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:51 +0000 (0:00:04.091) 0:04:42.819 ******* 2020-11-16T21:45:51.876 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-11-16T21:45:51.878 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:45:51.909 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:51 +0000 (0:00:00.060) 0:04:42.880 ******* 2020-11-16T21:45:52.029 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-11-16T21:45:52.031 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-11-16T21:45:52.068 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:52 +0000 (0:00:00.158) 0:04:43.038 ******* 2020-11-16T21:45:52.074 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-11-16T21:45:52.110 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:52 +0000 (0:00:00.042) 0:04:43.080 ******* 2020-11-16T21:45:58.532 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-11-16T21:45:58.534 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 1 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137606 files and directories 2020-11-16T21:45:58.536 INFO:teuthology.task.ansible.out: currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 1 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2020-11-16T21:45:58.537 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137606 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} TASK [testnode : Upload /etc/fuse.conf.] *************************************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-11-16T21:45:58.567 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:58 +0000 (0:00:06.457) 0:04:49.538 ******* 2020-11-16T21:45:58.602 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:58 +0000 (0:00:00.034) 0:04:49.572 ******* 2020-11-16T21:45:58.634 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:58 +0000 (0:00:00.031) 0:04:49.604 ******* 2020-11-16T21:45:58.723 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-11-16T21:45:58.725 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-16T21:45:58.761 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:58 +0000 (0:00:00.127) 0:04:49.731 ******* 2020-11-16T21:45:58.768 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-16T21:45:58.817 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:58 +0000 (0:00:00.056) 0:04:49.787 ******* 2020-11-16T21:45:58.898 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-11-16T21:45:58.900 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T21:45:58.934 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:58 +0000 (0:00:00.117) 0:04:49.905 ******* 2020-11-16T21:45:58.953 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T21:45:58.987 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:58 +0000 (0:00:00.052) 0:04:49.957 ******* 2020-11-16T21:45:59.225 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-11-16T21:45:59.226 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2020-11-16 21:40:40 UTC", "ActiveEnterTimestampMonotonic": "18769574", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target nss-lookup.target systemd-journald.socket sysinit.target remote-fs.target systemd-tmpfiles-setup.service basic.target system.slice -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-11-16 21:40:40 UTC", "AssertTimestampMonotonic": "18384521", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-11-16 21:40:40 UTC", "ConditionTimestampMonotonic": "18384521", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-11-16T21:45:59.228 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1500", "ExecMainStartTimestamp": "Mon 2020-11-16 21:40:40 UTC", "ExecMainStartTimestampMonotonic": "18769556", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-11-16 21:40:40 UTC", "InactiveExitTimestampMonotonic": "18385394", "InvocationID": "c10289285141434082b9eb94e9a04acd", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-11-16T21:45:59.229 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1500", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2020-11-16T21:45:59.231 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-11-16 21:40:40 UTC", "StateChangeTimestampMonotonic": "18769574", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-11-16 21:40:40 UTC", "WatchdogTimestampMonotonic": "18769572", "WatchdogUSec": "0"}} 2020-11-16T21:45:59.263 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:45:59 +0000 (0:00:00.275) 0:04:50.233 ******* 2020-11-16T21:46:03.545 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-16T21:46:03.547 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"cache_update_time": 1605562608, "cache_updated": false, "changed": false} 2020-11-16T21:46:03.579 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:03 +0000 (0:00:04.316) 0:04:54.550 ******* 2020-11-16T21:46:03.586 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-11-16T21:46:03.587 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2020-11-16 21:40:57 UTC", "ActiveEnterTimestampMonotonic": "18316068", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket system.slice nss-lookup.target network.target systemd-tmpfiles-setup.service basic.target -.mount remote-fs.target sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-11-16 21:40:56 UTC", "AssertTimestampMonotonic": "17906688", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-11-16 21:40:56 UTC", "ConditionTimestampMonotonic": "17906687", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-11-16T21:46:03.589 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1371", "ExecMainStartTimestamp": "Mon 2020-11-16 21:40:57 UTC", "ExecMainStartTimestampMonotonic": "18316057", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-11-16 21:40:56 UTC", "InactiveExitTimestampMonotonic": "17907387", "InvocationID": "ec4c79ef2042443282d60226fdcf5e15", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-11-16T21:46:03.590 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1371", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2020-11-16T21:46:03.592 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-11-16 21:40:57 UTC", "StateChangeTimestampMonotonic": "18316068", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-11-16 21:40:57 UTC", "WatchdogTimestampMonotonic": "18316067", "WatchdogUSec": "0"}} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:03.621 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:03 +0000 (0:00:00.042) 0:04:54.592 ******* 2020-11-16T21:46:03.652 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:03 +0000 (0:00:00.030) 0:04:54.623 ******* 2020-11-16T21:46:03.658 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-16T21:46:03.660 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:03.692 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:03 +0000 (0:00:00.039) 0:04:54.662 ******* 2020-11-16T21:46:03.723 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:03 +0000 (0:00:00.030) 0:04:54.693 ******* 2020-11-16T21:46:03.729 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-16T21:46:03.731 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:03.765 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:03 +0000 (0:00:00.042) 0:04:54.735 ******* 2020-11-16T21:46:03.800 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:03 +0000 (0:00:00.034) 0:04:54.770 ******* 2020-11-16T21:46:03.807 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-16T21:46:03.808 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:03.841 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:03 +0000 (0:00:00.041) 0:04:54.811 ******* 2020-11-16T21:46:03.848 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-16T21:46:03.849 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:03.882 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:03 +0000 (0:00:00.040) 0:04:54.852 ******* 2020-11-16T21:46:03.890 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-16T21:46:03.891 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:03.923 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:03 +0000 (0:00:00.041) 0:04:54.893 ******* 2020-11-16T21:46:03.930 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-16T21:46:03.931 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:03.969 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:03 +0000 (0:00:00.046) 0:04:54.940 ******* 2020-11-16T21:46:03.977 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-16T21:46:03.978 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.010 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.041) 0:04:54.981 ******* 2020-11-16T21:46:04.019 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-16T21:46:04.021 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.052 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.041) 0:04:55.022 ******* 2020-11-16T21:46:04.059 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-16T21:46:04.061 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.094 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.041) 0:04:55.064 ******* 2020-11-16T21:46:04.101 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-16T21:46:04.103 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.135 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.040) 0:04:55.105 ******* 2020-11-16T21:46:04.141 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-16T21:46:04.142 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.174 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.038) 0:04:55.144 ******* 2020-11-16T21:46:04.179 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-16T21:46:04.181 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.213 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.038) 0:04:55.183 ******* 2020-11-16T21:46:04.218 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:46:04.220 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.251 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.038) 0:04:55.222 ******* 2020-11-16T21:46:04.259 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-16T21:46:04.260 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.292 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.040) 0:04:55.262 ******* 2020-11-16T21:46:04.298 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-16T21:46:04.300 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.332 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.040) 0:04:55.303 ******* 2020-11-16T21:46:04.338 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-16T21:46:04.340 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.372 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.039) 0:04:55.342 ******* 2020-11-16T21:46:04.378 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-16T21:46:04.380 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.414 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.042) 0:04:55.384 ******* 2020-11-16T21:46:04.421 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.455 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.040) 0:04:55.425 ******* 2020-11-16T21:46:04.462 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-16T21:46:04.463 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.496 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.040) 0:04:55.466 ******* 2020-11-16T21:46:04.503 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-16T21:46:04.505 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.537 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.040) 0:04:55.507 ******* 2020-11-16T21:46:04.543 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-16T21:46:04.544 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.581 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.043) 0:04:55.551 ******* 2020-11-16T21:46:04.587 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-16T21:46:04.588 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.621 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.040) 0:04:55.591 ******* 2020-11-16T21:46:04.628 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-16T21:46:04.629 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.660 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.039) 0:04:55.631 ******* 2020-11-16T21:46:04.667 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-16T21:46:04.668 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.701 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.040) 0:04:55.671 ******* 2020-11-16T21:46:04.707 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-16T21:46:04.708 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.741 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.039) 0:04:55.711 ******* 2020-11-16T21:46:04.746 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-16T21:46:04.748 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.780 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.039) 0:04:55.750 ******* 2020-11-16T21:46:04.785 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-16T21:46:04.787 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.819 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.039) 0:04:55.790 ******* 2020-11-16T21:46:04.825 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-16T21:46:04.826 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.858 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.038) 0:04:55.828 ******* 2020-11-16T21:46:04.865 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-16T21:46:04.866 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.897 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.039) 0:04:55.868 ******* 2020-11-16T21:46:04.903 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-16T21:46:04.905 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.938 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.041) 0:04:55.909 ******* 2020-11-16T21:46:04.946 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-16T21:46:04.947 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:04.980 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:04 +0000 (0:00:00.041) 0:04:55.950 ******* 2020-11-16T21:46:04.985 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-16T21:46:04.987 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.019 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.038) 0:04:55.989 ******* 2020-11-16T21:46:05.024 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-16T21:46:05.025 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.057 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.038) 0:04:56.028 ******* 2020-11-16T21:46:05.063 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-16T21:46:05.065 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.097 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.040) 0:04:56.068 ******* 2020-11-16T21:46:05.105 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-16T21:46:05.106 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.139 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.042) 0:04:56.110 ******* 2020-11-16T21:46:05.147 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-16T21:46:05.149 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.185 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.046) 0:04:56.156 ******* 2020-11-16T21:46:05.191 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-16T21:46:05.193 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.225 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.039) 0:04:56.195 ******* 2020-11-16T21:46:05.232 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-16T21:46:05.233 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.264 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.039) 0:04:56.235 ******* 2020-11-16T21:46:05.270 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-16T21:46:05.271 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.304 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.039) 0:04:56.274 ******* 2020-11-16T21:46:05.309 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-16T21:46:05.311 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.344 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.039) 0:04:56.314 ******* 2020-11-16T21:46:05.350 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-16T21:46:05.352 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.385 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.040) 0:04:56.355 ******* 2020-11-16T21:46:05.392 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-16T21:46:05.393 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.425 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.040) 0:04:56.395 ******* 2020-11-16T21:46:05.432 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-16T21:46:05.433 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.466 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.041) 0:04:56.436 ******* 2020-11-16T21:46:05.474 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-16T21:46:05.476 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.507 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.041) 0:04:56.478 ******* 2020-11-16T21:46:05.514 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-16T21:46:05.516 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.548 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.040) 0:04:56.518 ******* 2020-11-16T21:46:05.554 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-16T21:46:05.556 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.588 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.039) 0:04:56.558 ******* 2020-11-16T21:46:05.595 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-11-16T21:46:05.597 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.628 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.040) 0:04:56.599 ******* 2020-11-16T21:46:05.635 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-16T21:46:05.637 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.670 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.042) 0:04:56.641 ******* 2020-11-16T21:46:05.701 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-16T21:46:05.703 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:05.733 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.062) 0:04:56.704 ******* 2020-11-16T21:46:05.761 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-11-16T21:46:05.763 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-11-16T21:46:05.797 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.064) 0:04:56.768 ******* 2020-11-16T21:46:05.829 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.031) 0:04:56.799 ******* 2020-11-16T21:46:05.962 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-11-16T21:46:05.995 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:05 +0000 (0:00:00.165) 0:04:56.965 ******* 2020-11-16T21:46:12.995 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-16T21:46:12.997 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"cache_update_time": 1605562608, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 1 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.33 [40.1 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.33 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.33 [5193 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.33 [873 kB]\nFetched 10.4 MB in 1s (8492 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 2020-11-16T21:46:12.998 INFO:teuthology.task.ansible.out: 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137464 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu 2020-11-16T21:46:13.000 INFO:teuthology.task.ansible.out:1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 1 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.33 [40.1 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.33 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.33 [5193 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.33 [873 kB]", "Fetched 10.4 MB in 1s (8492 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Rea 2020-11-16T21:46:13.001 INFO:teuthology.task.ansible.out:ding database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137464 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2020-11-16T21:46:13.031 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:13 +0000 (0:00:07.036) 0:05:04.002 ******* 2020-11-16T21:46:22.250 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-11-16T21:46:22.252 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"cache_update_time": 1605562608, "cache_updated": false, "changed": false} 2020-11-16T21:46:22.284 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:22 +0000 (0:00:09.253) 0:05:13.255 ******* 2020-11-16T21:46:22.404 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-16T21:46:22.406 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-11-16T21:46:22.438 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:22 +0000 (0:00:00.153) 0:05:13.408 ******* 2020-11-16T21:46:22.464 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-11-16T21:46:22.466 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:22.497 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:22 +0000 (0:00:00.058) 0:05:13.467 ******* 2020-11-16T21:46:22.596 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-16T21:46:22.597 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-11-16T21:46:22.630 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:22 +0000 (0:00:00.133) 0:05:13.601 ******* 2020-11-16T21:46:22.638 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-11-16T21:46:22.639 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-11-16T21:46:22.672 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:22 +0000 (0:00:00.041) 0:05:13.642 ******* 2020-11-16T21:46:22.678 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-16T21:46:22.680 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:22.714 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:22 +0000 (0:00:00.041) 0:05:13.684 ******* 2020-11-16T21:46:22.793 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-16T21:46:22.795 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-11-16T21:46:22.828 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:22 +0000 (0:00:00.114) 0:05:13.799 ******* 2020-11-16T21:46:22.854 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-16T21:46:22.856 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:22.888 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:22 +0000 (0:00:00.059) 0:05:13.858 ******* 2020-11-16T21:46:22.977 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-11-16T21:46:22.978 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-11-16T21:46:23.012 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:23 +0000 (0:00:00.123) 0:05:13.982 ******* 2020-11-16T21:46:23.028 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-11-16T21:46:23.029 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-11-16T21:46:23.062 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:23 +0000 (0:00:00.050) 0:05:14.033 ******* 2020-11-16T21:46:23.162 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-11-16T21:46:23.164 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-16T21:46:23.197 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:23 +0000 (0:00:00.134) 0:05:14.167 ******* 2020-11-16T21:46:23.213 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-11-16T21:46:23.215 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-11-16T21:46:23.256 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:23 +0000 (0:00:00.059) 0:05:14.227 ******* 2020-11-16T21:46:23.336 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-11-16T21:46:23.338 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T21:46:23.372 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:23 +0000 (0:00:00.115) 0:05:14.342 ******* 2020-11-16T21:46:23.378 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-16T21:46:23.380 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-11-16T21:46:23.414 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:23 +0000 (0:00:00.042) 0:05:14.384 ******* 2020-11-16T21:46:23.577 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-11-16T21:46:23.611 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:23 +0000 (0:00:00.197) 0:05:14.581 ******* 2020-11-16T21:46:23.660 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-11-16T21:46:23.661 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2020-11-16 21:40:43 UTC", "ActiveEnterTimestampMonotonic": "19500060", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target nss-lookup.target sysinit.target system.slice network.target systemd-journald.socket basic.target systemd-tmpfiles-setup.service -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-11-16 21:40:42 UTC", "AssertTimestampMonotonic": "19039633", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-11-16 21:40:42 UTC", "ConditionTimestampMonotonic": "19039633", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-11-16T21:46:23.663 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1394", "ExecMainStartTimestamp": "Mon 2020-11-16 21:40:43 UTC", "ExecMainStartTimestampMonotonic": "19500043", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-11-16 21:40:42 UTC", "InactiveExitTimestampMonotonic": "19040383", "InvocationID": "1acc32b7f8474cc7a13ab0b04878494c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-11-16T21:46:23.664 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1394", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2020-11-16T21:46:23.666 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-11-16 21:40:43 UTC", "StateChangeTimestampMonotonic": "19500060", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-11-16 21:40:43 UTC", "WatchdogTimestampMonotonic": "19500059", "WatchdogUSec": "0"}} 2020-11-16T21:46:23.697 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:23 +0000 (0:00:00.085) 0:05:14.667 ******* 2020-11-16T21:46:23.723 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-16T21:46:23.725 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-11-16T21:46:23.759 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:23 +0000 (0:00:00.062) 0:05:14.730 ******* 2020-11-16T21:46:23.791 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:23 +0000 (0:00:00.031) 0:05:14.761 ******* 2020-11-16T21:46:23.819 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-16T21:46:23.820 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:23.852 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:23 +0000 (0:00:00.061) 0:05:14.823 ******* 2020-11-16T21:46:23.879 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-16T21:46:23.881 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:23.913 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:23 +0000 (0:00:00.060) 0:05:14.883 ******* 2020-11-16T21:46:23.921 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-11-16T21:46:23.922 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T21:46:23.924 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-11-16T21:46:23.956 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:23 +0000 (0:00:00.043) 0:05:14.927 ******* 2020-11-16T21:46:23.987 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:23 +0000 (0:00:00.030) 0:05:14.957 ******* 2020-11-16T21:46:23.992 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-16T21:46:23.994 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.027 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.040) 0:05:14.998 ******* 2020-11-16T21:46:24.070 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.042) 0:05:15.040 ******* 2020-11-16T21:46:24.077 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-16T21:46:24.078 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.112 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.041) 0:05:15.082 ******* 2020-11-16T21:46:24.119 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-16T21:46:24.121 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi057.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T21:46:24.156 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.043) 0:05:15.126 ******* 2020-11-16T21:46:24.187 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.031) 0:05:15.157 ******* 2020-11-16T21:46:24.194 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-16T21:46:24.195 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.229 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.041) 0:05:15.199 ******* 2020-11-16T21:46:24.260 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.031) 0:05:15.231 ******* 2020-11-16T21:46:24.267 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-16T21:46:24.269 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.301 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.040) 0:05:15.271 ******* 2020-11-16T21:46:24.333 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.031) 0:05:15.303 ******* 2020-11-16T21:46:24.338 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-16T21:46:24.340 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.375 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.042) 0:05:15.346 ******* 2020-11-16T21:46:24.410 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.035) 0:05:15.381 ******* 2020-11-16T21:46:24.418 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-16T21:46:24.419 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-16T21:46:24.461 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.050) 0:05:15.431 ******* 2020-11-16T21:46:24.493 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.032) 0:05:15.463 ******* 2020-11-16T21:46:24.500 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-16T21:46:24.502 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi016.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.535 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.042) 0:05:15.506 ******* 2020-11-16T21:46:24.543 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.544 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.544 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-16T21:46:24.545 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.545 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.545 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.545 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.546 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-16T21:46:24.582 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.046) 0:05:15.553 ******* 2020-11-16T21:46:24.593 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.594 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.595 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.597 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi016.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.597 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.598 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.599 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.662 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.079) 0:05:15.632 ******* 2020-11-16T21:46:24.693 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.031) 0:05:15.664 ******* 2020-11-16T21:46:24.700 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:46:24.702 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.737 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.043) 0:05:15.708 ******* 2020-11-16T21:46:24.744 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-11-16T21:46:24.745 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.780 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.042) 0:05:15.750 ******* 2020-11-16T21:46:24.787 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-16T21:46:24.788 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.822 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.042) 0:05:15.792 ******* 2020-11-16T21:46:24.828 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:46:24.830 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-16T21:46:24.863 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.040) 0:05:15.833 ******* 2020-11-16T21:46:24.869 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-16T21:46:24.871 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi016.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003584", "end": "2020-11-16 21:46:24.821260", "rc": 0, "start": "2020-11-16 21:46:24.817676", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-16T21:46:24.910 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.047) 0:05:15.880 ******* 2020-11-16T21:46:24.942 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.032) 0:05:15.913 ******* 2020-11-16T21:46:24.948 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-16T21:46:24.950 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.951 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.952 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** ok: [smithi057.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-16T21:46:24.952 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.953 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.990 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:24 +0000 (0:00:00.047) 0:05:15.960 ******* 2020-11-16T21:46:24.996 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-16T21:46:24.998 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-16T21:46:24.998 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.999 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.999 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:24.999 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:25.000 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:25.000 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:25.038 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:25 +0000 (0:00:00.048) 0:05:16.009 ******* 2020-11-16T21:46:25.080 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:25 +0000 (0:00:00.041) 0:05:16.050 ******* 2020-11-16T21:46:25.087 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-16T21:46:25.088 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:25.123 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:25 +0000 (0:00:00.042) 0:05:16.093 ******* 2020-11-16T21:46:25.130 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-16T21:46:25.131 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:25.166 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:25 +0000 (0:00:00.042) 0:05:16.136 ******* 2020-11-16T21:46:25.171 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-16T21:46:25.173 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:25.212 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:25 +0000 (0:00:00.046) 0:05:16.183 ******* 2020-11-16T21:46:25.219 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-16T21:46:25.221 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:25.255 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:25 +0000 (0:00:00.042) 0:05:16.225 ******* 2020-11-16T21:46:25.263 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-16T21:46:25.264 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003942", "end": "2020-11-16 21:46:25.203876", "rc": 0, "start": "2020-11-16 21:46:25.199934", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-16T21:46:25.301 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:25 +0000 (0:00:00.046) 0:05:16.271 ******* 2020-11-16T21:46:25.307 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-16T21:46:25.309 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:25.342 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:25 +0000 (0:00:00.040) 0:05:16.312 ******* 2020-11-16T21:46:25.348 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-11-16T21:46:25.349 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:25.385 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:25 +0000 (0:00:00.043) 0:05:16.356 ******* 2020-11-16T21:46:25.392 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-16T21:46:25.393 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:25.426 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:25 +0000 (0:00:00.040) 0:05:16.397 ******* 2020-11-16T21:46:25.432 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-16T21:46:25.433 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:25.466 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:25 +0000 (0:00:00.039) 0:05:16.436 ******* 2020-11-16T21:46:25.472 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-16T21:46:25.473 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:25.505 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:25 +0000 (0:00:00.039) 0:05:16.476 ******* 2020-11-16T21:46:25.511 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-16T21:46:25.513 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:25.545 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:25 +0000 (0:00:00.039) 0:05:16.515 ******* 2020-11-16T21:46:25.550 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-16T21:46:25.552 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:25.586 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:25 +0000 (0:00:00.041) 0:05:16.556 ******* 2020-11-16T21:46:33.899 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-16T21:46:33.901 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1605562650, "cache_updated": false, "changed": false} 2020-11-16T21:46:33.934 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:33 +0000 (0:00:08.348) 0:05:24.905 ******* 2020-11-16T21:46:33.941 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-16T21:46:33.943 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:33.975 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:33 +0000 (0:00:00.040) 0:05:24.946 ******* 2020-11-16T21:46:33.981 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-16T21:46:33.983 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:34.017 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:34 +0000 (0:00:00.041) 0:05:24.987 ******* 2020-11-16T21:46:34.024 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-16T21:46:34.026 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:34.065 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:34 +0000 (0:00:00.048) 0:05:25.036 ******* 2020-11-16T21:46:34.071 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-16T21:46:34.073 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={'block_used': 13753468, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341640, 'size_available': 927095357440, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149529, 'block_size': 4096, 'inode_available': 60905447}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341640, "block_size": 4096, "block_total": 240095108, "block_used": 13753468, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905447, "inode_total": 61054976, "inode_used": 149529, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927095357440, "size_total": 983429562368, "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}} 2020-11-16T21:46:34.106 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:34 +0000 (0:00:00.040) 0:05:25.076 ******* 2020-11-16T21:46:34.115 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-16T21:46:34.116 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:34.148 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:34 +0000 (0:00:00.042) 0:05:25.119 ******* 2020-11-16T21:46:34.177 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:34.211 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:34 +0000 (0:00:00.061) 0:05:25.181 ******* 2020-11-16T21:46:34.237 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-16T21:46:34.238 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.008271", "end": "2020-11-16 21:46:34.236843", "rc": 0, "start": "2020-11-16 21:46:34.228572", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:46:34.270 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:34 +0000 (0:00:00.059) 0:05:25.241 ******* 2020-11-16T21:46:34.301 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:34 +0000 (0:00:00.030) 0:05:25.271 ******* 2020-11-16T21:46:34.317 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-16T21:46:34.318 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'block_used': 13753468, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341640, 'size_available': 927095357440, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149529, 'block_size': 4096, 'inode_available': 60905447}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341640, "block_size": 4096, "block_total": 240095108, "block_used": 13753468, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905447, "inode_total": 61054976, "inode_used": 149529, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927095357440, "size_total": 983429562368, "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:34.351 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:34 +0000 (0:00:00.049) 0:05:25.321 ******* 2020-11-16T21:46:34.356 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-16T21:46:34.358 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:34.389 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:34 +0000 (0:00:00.038) 0:05:25.360 ******* 2020-11-16T21:46:34.395 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-16T21:46:34.430 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:34 +0000 (0:00:00.040) 0:05:25.400 ******* 2020-11-16T21:46:34.437 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-16T21:46:34.439 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:34.474 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:34 +0000 (0:00:00.043) 0:05:25.444 ******* 2020-11-16T21:46:34.482 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-16T21:46:34.484 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:34.495 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-11-16T21:46:34.496 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:34.529 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:34 +0000 (0:00:00.055) 0:05:25.499 ******* 2020-11-16T21:46:34.776 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-16T21:46:34.777 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1605562695, "cache_updated": false, "changed": false} 2020-11-16T21:46:34.810 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:34 +0000 (0:00:00.281) 0:05:25.780 ******* 2020-11-16T21:46:34.837 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-16T21:46:34.839 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:34.870 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:34 +0000 (0:00:00.060) 0:05:25.841 ******* 2020-11-16T21:46:34.918 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-16T21:46:34.920 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item={'block_used': 13755510, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226339598, 'size_available': 927086993408, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149530, 'block_size': 4096, 'inode_available': 60905446}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226339598, "block_size": 4096, "block_total": 240095108, "block_used": 13755510, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905446, "inode_total": 61054976, "inode_used": 149530, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927086993408, "size_total": 983429562368, "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}} 2020-11-16T21:46:34.958 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:34 +0000 (0:00:00.087) 0:05:25.929 ******* 2020-11-16T21:46:35.099 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-16T21:46:35.101 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009924", "end": "2020-11-16 21:46:35.089679", "rc": 0, "start": "2020-11-16 21:46:35.079755", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:46:35.133 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:35 +0000 (0:00:00.174) 0:05:26.103 ******* 2020-11-16T21:46:35.170 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-16T21:46:35.172 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'block_used': 13755510, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226339598, 'size_available': 927086993408, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149530, 'block_size': 4096, 'inode_available': 60905446}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226339598, "block_size": 4096, "block_total": 240095108, "block_used": 13755510, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905446, "inode_total": 61054976, "inode_used": 149530, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927086993408, "size_total": 983429562368, "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:35.204 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:35 +0000 (0:00:00.071) 0:05:26.174 ******* 2020-11-16T21:46:35.231 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-16T21:46:35.263 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:35 +0000 (0:00:00.059) 0:05:26.234 ******* 2020-11-16T21:46:35.311 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-16T21:46:35.313 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:35.812 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGG6gBPqZ7j0MD5uMDCg0hcIiYVAB7f2JnT'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.207585", "end": "2020-11-16 21:46:35.792974", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGG6gBPqZ7j0MD5uMDCg0hcIiYVAB7f2JnT"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:34.585389", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T21:46:35.823 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:35.824 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:46.956 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-11-16T21:46:46.958 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-11-16T21:46:46.991 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:46 +0000 (0:00:11.727) 0:05:37.961 ******* 2020-11-16T21:46:47.298 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-16T21:46:47.300 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-11-16T21:46:47.332 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:47 +0000 (0:00:00.341) 0:05:38.302 ******* 2020-11-16T21:46:47.358 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-16T21:46:47.360 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:47.392 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:47 +0000 (0:00:00.059) 0:05:38.362 ******* 2020-11-16T21:46:47.792 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-11-16T21:46:47.793 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-11-16T21:46:47.825 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:47 +0000 (0:00:00.433) 0:05:38.795 ******* 2020-11-16T21:46:48.143 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-16T21:46:48.145 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-11-16T21:46:48.177 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:48 +0000 (0:00:00.351) 0:05:39.147 ******* 2020-11-16T21:46:48.969 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-16T21:46:48.970 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu966Xa0h05obObBcajV0LhvDOYbmfT3KwfD'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.162641", "end": "2020-11-16 21:46:48.952777", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu966Xa0h05obObBcajV0LhvDOYbmfT3KwfD"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:47.790136", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T21:46:48.971 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1' 2020-11-16T21:46:48.972 INFO:teuthology.task.ansible.out:, 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:48.982 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:49.437 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGG6Ldgrd7OkcGSoD65LTnBLpXztlHgrLli'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.109285", "end": "2020-11-16 21:46:49.417268", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGG6Ldgrd7OkcGSoD65LTnBLpXztlHgrLli"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:48.307983", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T21:46:49.438 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HKZ5', 'wwn-0x5000c50087198ecb'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HKZ5-part1', 'wwn-0x5000c50087198ecb-part1'], 'uuids': ['5b37dc69-d2db-44bf-9122-6cf42a1bab47']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50087198ecb', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HKZ5', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HKZ5", "wwn-0x5000c50087198ecb"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HKZ5-part1", "wwn-0x5000c50087198ecb-part1"], "labels": [], "masters": [], "uuids": ["5b37dc69-d2db-44bf-9122-6cf42a1bab47"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HKZ5", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087198ecb"}}, "skip_reason": 2020-11-16T21:46:49.440 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-11-16T21:46:53.746 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-11-16T21:46:53.748 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-11-16T21:46:53.779 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:53 +0000 (0:00:05.601) 0:05:44.749 ******* 2020-11-16T21:46:53.912 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-11-16T21:46:53.913 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T21:46:53.945 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:53 +0000 (0:00:00.166) 0:05:44.916 ******* 2020-11-16T21:46:53.972 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.005 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:53 +0000 (0:00:00.059) 0:05:44.975 ******* 2020-11-16T21:46:54.031 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.064 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:54 +0000 (0:00:00.058) 0:05:45.034 ******* 2020-11-16T21:46:54.090 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-16T21:46:54.092 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.124 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:54 +0000 (0:00:00.060) 0:05:45.095 ******* 2020-11-16T21:46:54.151 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-11-16T21:46:54.153 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.184 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:54 +0000 (0:00:00.059) 0:05:45.155 ******* 2020-11-16T21:46:54.210 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.243 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:54 +0000 (0:00:00.059) 0:05:45.214 ******* 2020-11-16T21:46:54.270 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi195.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-16T21:46:54.304 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:54 +0000 (0:00:00.060) 0:05:45.275 ******* 2020-11-16T21:46:54.331 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-16T21:46:54.333 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu96uBqAGhB0KzHmz1KyEHOX4lKtq73aH07p'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.107035", "end": "2020-11-16 21:46:54.322662", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu96uBqAGhB0KzHmz1KyEHOX4lKtq73aH07p"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:53.215627", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T21:46:54.343 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQFM', 'wwn-0x5000c500871a80ed'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQFM-part1', 'wwn-0x5000c500871a80ed-part1'], 'uuids': ['5b37dc69-d2db-44bf-9122-6cf42a1bab47']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a80ed', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HQFM', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQFM", "wwn-0x5000c500871a80ed"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQFM-part1", "wwn-0x5000c500871a80ed-part1"], "labels": [], "masters": [], "uuids": ["5b37dc69-d2db-44bf-9122-6cf42a1bab47"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQFM", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a80ed"}}, "skip_reason": 2020-11-16T21:46:54.345 INFO:teuthology.task.ansible.out:"Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi195.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.355 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.366 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.367 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.377 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.378 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.388 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-16T21:46:54.399 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.401 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.410 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.412 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.421 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.423 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.432 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.443 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.481 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:54 +0000 (0:00:00.177) 0:05:45.452 ******* 2020-11-16T21:46:54.677 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-16T21:46:54.679 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003738", "end": "2020-11-16 21:46:54.651068", "rc": 0, "start": "2020-11-16 21:46:54.647330", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-16T21:46:54.714 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:54 +0000 (0:00:00.232) 0:05:45.684 ******* 2020-11-16T21:46:54.750 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-11-16T21:46:54.752 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.790 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:54 +0000 (0:00:00.075) 0:05:45.760 ******* 2020-11-16T21:46:54.820 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-16T21:46:54.822 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.853 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:54 +0000 (0:00:00.063) 0:05:45.824 ******* 2020-11-16T21:46:54.880 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-16T21:46:54.882 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:54.913 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:54 +0000 (0:00:00.059) 0:05:45.884 ******* 2020-11-16T21:46:55.001 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-16T21:46:55.003 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-QLrfGN-WKez-sTzn-Lai3-ZbHF-J4Ex-NimcI0', 'nvme-INTEL_SSDPED1D480GA_PHMB7513002C480DGN', 'nvme-nvme.8086-50484d42373531333030324334383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.247293", "end": "2020-11-16 21:46:54.985992", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-QLrfGN-WKez-sTzn-Lai3-ZbHF-J4Ex-NimcI0", "nvme-INTEL_SSDPED1D480GA_PHMB7513002C480DGN", "nvme-nvme.8086-50484d42373531333030324334383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:53.738699", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now pa 2020-11-16T21:46:55.005 INFO:teuthology.task.ansible.out:rtition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T21:46:55.013 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:55.014 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:55.609 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '7814037168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-Z36zhT-WeAY-cgcg-ROEm-to3W-vq6Y-A22IzF', 'nvme-INTEL_SSDPEDKE040T7_BTLE7361049H4P0KGN', 'nvme-eui.0100000001000000e4d25c000034df14'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Express Flash NVMe P4500/P4600', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDKE040T7', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '3.64 TB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.139546", "end": "2020-11-16 21:46:55.591129", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Express Flash NVMe P4500/P4600", "links": {"ids": ["lvm-pv-uuid-Z36zhT-WeAY-cgcg-ROEm-to3W-vq6Y-A22IzF", "nvme-INTEL_SSDPEDKE040T7_BTLE7361049H4P0KGN", "nvme-eui.0100000001000000e4d25c000034df14"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDKE040T7", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "7814037168", "sectorsize": "512", "size": "3.64 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:54.451583", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT 2020-11-16T21:46:55.611 INFO:teuthology.task.ansible.out: data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:55.621 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:55.797 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-16T21:46:55.799 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"cache_update_time": 1605562608, "cache_updated": false, "changed": false} 2020-11-16T21:46:55.830 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:55 +0000 (0:00:00.917) 0:05:46.801 ******* 2020-11-16T21:46:55.856 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-16T21:46:55.858 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:55.889 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:55 +0000 (0:00:00.058) 0:05:46.859 ******* 2020-11-16T21:46:55.925 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-16T21:46:55.927 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => (item={'block_used': 13753471, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341637, 'size_available': 927095345152, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149530, 'block_size': 4096, 'inode_available': 60905446}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341637, "block_size": 4096, "block_total": 240095108, "block_used": 13753471, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905446, "inode_total": 61054976, "inode_used": 149530, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927095345152, "size_total": 983429562368, "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}} 2020-11-16T21:46:55.960 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:55 +0000 (0:00:00.070) 0:05:46.930 ******* 2020-11-16T21:46:56.090 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-16T21:46:56.092 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009563", "end": "2020-11-16 21:46:56.086919", "rc": 0, "start": "2020-11-16 21:46:56.077356", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:46:56.123 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:56 +0000 (0:00:00.162) 0:05:47.093 ******* 2020-11-16T21:46:56.159 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-16T21:46:56.161 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'block_used': 13753471, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341637, 'size_available': 927095345152, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149530, 'block_size': 4096, 'inode_available': 60905446}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341637, "block_size": 4096, "block_total": 240095108, "block_used": 13753471, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905446, "inode_total": 61054976, "inode_used": 149530, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927095345152, "size_total": 983429562368, "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:56.193 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:56 +0000 (0:00:00.069) 0:05:47.163 ******* 2020-11-16T21:46:56.220 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-16T21:46:56.253 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:56 +0000 (0:00:00.060) 0:05:47.224 ******* 2020-11-16T21:46:56.270 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-16T21:46:56.271 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGGzcNfWkklnhnyFBIn5YF1ted7HNfdDVIV'], 'uuids': ['22869e98-a655-48f1-a887-0b486bde3497']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.129148", "end": "2020-11-16 21:46:56.252357", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGGzcNfWkklnhnyFBIn5YF1ted7HNfdDVIV"], "labels": [], "masters": [], "uuids": ["22869e98-a655-48f1-a887-0b486bde3497"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:55.123209", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi016.front.sepia.ceph.com] => (i 2020-11-16T21:46:56.273 INFO:teuthology.task.ansible.out:tem={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:56.283 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:56.305 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:56.982 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu96wTnOkYbe7sbrviPycBKDGAQvUO4BFXbR'], 'uuids': ['d07236df-801e-45fa-81e6-704d12b587fb']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.244420", "end": "2020-11-16 21:46:56.972807", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu96wTnOkYbe7sbrviPycBKDGAQvUO4BFXbR"], "labels": [], "masters": [], "uuids": ["d07236df-801e-45fa-81e6-704d12b587fb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:55.728387", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T21:46:56.993 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:57.005 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:57.522 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGG0fZ4mq0efr0H08KYR5cdJe8maHxDYS03'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.115032", "end": "2020-11-16 21:46:57.510529", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGG0fZ4mq0efr0H08KYR5cdJe8maHxDYS03"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:56.395497", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T21:46:57.534 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:57.638 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme5Q6xKq2LgIgxdOTaP15GBWPxnnJGBJT1z'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.213877", "end": "2020-11-16 21:46:57.626141", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme5Q6xKq2LgIgxdOTaP15GBWPxnnJGBJT1z"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:56.412264", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T21:46:57.639 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:57.650 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:58.211 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu96NhSXEec03DmyZCXPu1igKs024fb6m2O4'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.095243", "end": "2020-11-16 21:46:58.206169", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu96NhSXEec03DmyZCXPu1igKs024fb6m2O4"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:57.110926", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T21:46:58.222 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:58.772 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGGLFLtns5tPogGxDet64PXVO1whDSpjuK5'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.118393", "end": "2020-11-16 21:46:58.760710", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGGLFLtns5tPogGxDet64PXVO1whDSpjuK5"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:57.642317", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T21:46:58.815 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:58 +0000 (0:00:02.562) 0:05:49.786 ******* 2020-11-16T21:46:58.864 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-16T21:46:58.866 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:59.103 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGG6gBPqZ7j0MD5uMDCg0hcIiYVAB7f2JnT'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.110324", "end": "2020-11-16 21:46:59.084832", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGG6gBPqZ7j0MD5uMDCg0hcIiYVAB7f2JnT"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:58.974508", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.107291 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.107291 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T21:46:59.104 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:59.115 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:59.138 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-16T21:46:59.139 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme5sgZn7grkdG8SU4Omsd5rvp4zjaN0ZHKB'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.364604", "end": "2020-11-16 21:46:59.122461", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme5sgZn7grkdG8SU4Omsd5rvp4zjaN0ZHKB"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:57.757857", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', ' 2020-11-16T21:46:59.141 INFO:teuthology.task.ansible.out:vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLZZ', 'wwn-0x5000c50092934caa'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLZZ-part1', 'wwn-0x5000c50092934caa-part1'], 'uuids': ['5b37dc69-d2db-44bf-9122-6cf42a1bab47']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092934caa', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XLZZ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLZZ", "wwn-0x5000c50092934caa"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLZZ-part1", "wwn-0x5000c50092934caa-part1"], "labels": [], "masters": [], "uuids": ["5b37dc69-d2db-44bf-9122-6cf42a1bab47"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XLZZ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092934caa"}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:59.336 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-16T21:46:59.338 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGG6Ldgrd7OkcGSoD65LTnBLpXztlHgrLli'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.113416", "end": "2020-11-16 21:46:59.329314", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGG6Ldgrd7OkcGSoD65LTnBLpXztlHgrLli"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:59.215898", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.108662 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.108662 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T21:46:59.348 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HKZ5', 'wwn-0x5000c50087198ecb'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HKZ5-part1', 'wwn-0x5000c50087198ecb-part1'], 'uuids': ['5b37dc69-d2db-44bf-9122-6cf42a1bab47']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50087198ecb', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HKZ5', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HKZ5", "wwn-0x5000c50087198ecb"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HKZ5-part1", "wwn-0x5000c50087198ecb-part1"], "labels": [], "masters": [], "uuids": ["5b37dc69-d2db-44bf-9122-6cf42a1bab47"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HKZ5", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087198ecb"}}, "skip_reason": 2020-11-16T21:46:59.349 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-11-16T21:46:59.442 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-16T21:46:59.444 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu96GFzgmbnD2Z7KREZhMwCcjxHaEPqMgv3Q'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.103133", "end": "2020-11-16 21:46:59.431861", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu96GFzgmbnD2Z7KREZhMwCcjxHaEPqMgv3Q"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:58.328728", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T21:46:59.485 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:46:59 +0000 (0:00:00.669) 0:05:50.455 ******* 2020-11-16T21:46:59.512 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-16T21:46:59.514 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-QLrfGN-WKez-sTzn-Lai3-ZbHF-J4Ex-NimcI0', 'nvme-INTEL_SSDPED1D480GA_PHMB7513002C480DGN', 'nvme-nvme.8086-50484d42373531333030324334383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.050611", "end": "2020-11-16 21:46:59.503994", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-QLrfGN-WKez-sTzn-Lai3-ZbHF-J4Ex-NimcI0", "nvme-INTEL_SSDPED1D480GA_PHMB7513002C480DGN", "nvme-nvme.8086-50484d42373531333030324334383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:59.453383", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0459027 s, 2.5 GB/s", "stderr_lines": [" 2020-11-16T21:46:59.515 INFO:teuthology.task.ansible.out:110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0459027 s, 2.5 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T21:46:59.524 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:59.536 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:59.537 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:59.765 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGGzcNfWkklnhnyFBIn5YF1ted7HNfdDVIV'], 'uuids': ['22869e98-a655-48f1-a887-0b486bde3497']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.110356", "end": "2020-11-16 21:46:59.749490", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGGzcNfWkklnhnyFBIn5YF1ted7HNfdDVIV"], "labels": [], "masters": [], "uuids": ["22869e98-a655-48f1-a887-0b486bde3497"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:59.639134", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.106454 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.106454 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T21:46:59.776 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:59.777 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:59.831 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu966Xa0h05obObBcajV0LhvDOYbmfT3KwfD'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.178703", "end": "2020-11-16 21:46:59.822675", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu966Xa0h05obObBcajV0LhvDOYbmfT3KwfD"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:59.643972", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.173916 s, 663 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.173916 s, 663 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T21:46:59.842 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:46:59.843 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:00.009 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGG0fZ4mq0efr0H08KYR5cdJe8maHxDYS03'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.109283", "end": "2020-11-16 21:46:59.998206", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGG0fZ4mq0efr0H08KYR5cdJe8maHxDYS03"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:59.888923", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.104438 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.104438 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:00.021 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:00.136 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu96uBqAGhB0KzHmz1KyEHOX4lKtq73aH07p'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.173237", "end": "2020-11-16 21:47:00.127677", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu96uBqAGhB0KzHmz1KyEHOX4lKtq73aH07p"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:59.954440", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.16854 s, 684 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.16854 s, 684 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:00.148 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQFM', 'wwn-0x5000c500871a80ed'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQFM-part1', 'wwn-0x5000c500871a80ed-part1'], 'uuids': ['5b37dc69-d2db-44bf-9122-6cf42a1bab47']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a80ed', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HQFM', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQFM", "wwn-0x5000c500871a80ed"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQFM-part1", "wwn-0x5000c500871a80ed-part1"], "labels": [], "masters": [], "uuids": ["5b37dc69-d2db-44bf-9122-6cf42a1bab47"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQFM", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a80ed"}}, "skip_reason": 2020-11-16T21:47:00.149 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-11-16T21:47:00.242 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGGLFLtns5tPogGxDet64PXVO1whDSpjuK5'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.111416", "end": "2020-11-16 21:47:00.234541", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-4Kv0PZ9Aou8M4OwJ13Ck7fQkQoycpDGGLFLtns5tPogGxDet64PXVO1whDSpjuK5"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:47:00.123125", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.106838 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.106838 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:00.285 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:00 +0000 (0:00:00.800) 0:05:51.256 ******* 2020-11-16T21:47:00.314 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '7814037168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-Z36zhT-WeAY-cgcg-ROEm-to3W-vq6Y-A22IzF', 'nvme-INTEL_SSDPEDKE040T7_BTLE7361049H4P0KGN', 'nvme-eui.0100000001000000e4d25c000034df14'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Express Flash NVMe P4500/P4600', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDKE040T7', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '3.64 TB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.053316", "end": "2020-11-16 21:47:00.305954", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Express Flash NVMe P4500/P4600", "links": {"ids": ["lvm-pv-uuid-Z36zhT-WeAY-cgcg-ROEm-to3W-vq6Y-A22IzF", "nvme-INTEL_SSDPEDKE040T7_BTLE7361049H4P0KGN", "nvme-eui.0100000001000000e4d25c000034df14"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDKE040T7", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "7814037168", "sectorsize": "512", "size": "3.64 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:47:00.252638", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0487519 s, 2.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0487519 s, 2.4 GB 2020-11-16T21:47:00.316 INFO:teuthology.task.ansible.out:/s"], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:00.326 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:00.337 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:00.577 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-16T21:47:00.579 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.157800", "end": "2020-11-16 21:47:00.566001", "rc": 0, "start": "2020-11-16 21:47:00.408201", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:00.611 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:00 +0000 (0:00:00.325) 0:05:51.581 ******* 2020-11-16T21:47:00.618 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-16T21:47:00.620 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-KdSg9N-CT1I-L4gx-2twi-SRLC-ydzz-P6dcel', 'nvme-INTEL_SSDPED1D480GA_PHMB751300FS480DGN', 'nvme-nvme.8086-50484d42373531333030465334383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.342078", "end": "2020-11-16 21:47:00.589707", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-KdSg9N-CT1I-L4gx-2twi-SRLC-ydzz-P6dcel", "nvme-INTEL_SSDPED1D480GA_PHMB751300FS480DGN", "nvme-nvme.8086-50484d42373531333030465334383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:46:59.247629", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now pa 2020-11-16T21:47:00.621 INFO:teuthology.task.ansible.out:rtition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:00.623 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:00.634 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-16T21:47:00.634 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu96wTnOkYbe7sbrviPycBKDGAQvUO4BFXbR'], 'uuids': ['d07236df-801e-45fa-81e6-704d12b587fb']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.181888", "end": "2020-11-16 21:47:00.622898", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu96wTnOkYbe7sbrviPycBKDGAQvUO4BFXbR"], "labels": [], "masters": [], "uuids": ["d07236df-801e-45fa-81e6-704d12b587fb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:47:00.441010", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.178843 s, 645 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.178843 s, 645 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:00.646 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:00.658 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:00.793 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-16T21:47:00.795 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.049856", "end": "2020-11-16 21:47:00.781554", "rc": 0, "start": "2020-11-16 21:47:00.731698", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:00.827 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:00 +0000 (0:00:00.216) 0:05:51.797 ******* 2020-11-16T21:47:00.854 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-16T21:47:00.892 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:00 +0000 (0:00:00.065) 0:05:51.862 ******* 2020-11-16T21:47:00.920 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-16T21:47:00.922 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:00.956 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:00 +0000 (0:00:00.064) 0:05:51.927 ******* 2020-11-16T21:47:00.964 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-16T21:47:00.965 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu96NhSXEec03DmyZCXPu1igKs024fb6m2O4'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.168006", "end": "2020-11-16 21:47:00.928914", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu96NhSXEec03DmyZCXPu1igKs024fb6m2O4"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:47:00.760908", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.164912 s, 699 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.164912 s, 699 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:00.967 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:00.979 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-16T21:47:00.981 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:01.012 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:01 +0000 (0:00:00.055) 0:05:51.982 ******* 2020-11-16T21:47:01.039 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:01.077 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:01 +0000 (0:00:00.065) 0:05:52.047 ******* 2020-11-16T21:47:01.103 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-16T21:47:01.105 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:01.137 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:01 +0000 (0:00:00.059) 0:05:52.107 ******* 2020-11-16T21:47:01.216 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-16T21:47:01.217 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu96GFzgmbnD2Z7KREZhMwCcjxHaEPqMgv3Q'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.143345", "end": "2020-11-16 21:47:01.202471", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-i82C80OKOw0XmCFnAwaJg59XB1yudu96GFzgmbnD2Z7KREZhMwCcjxHaEPqMgv3Q"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:47:01.059126", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138633 s, 832 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138633 s, 832 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:01.261 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:01 +0000 (0:00:00.124) 0:05:52.232 ******* 2020-11-16T21:47:01.579 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-16T21:47:01.581 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.183562", "end": "2020-11-16 21:47:01.567192", "rc": 0, "start": "2020-11-16 21:47:01.383630", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:01.612 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:01 +0000 (0:00:00.350) 0:05:52.583 ******* 2020-11-16T21:47:01.804 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-16T21:47:01.806 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.063316", "end": "2020-11-16 21:47:01.797201", "rc": 0, "start": "2020-11-16 21:47:01.733885", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:01.837 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:01 +0000 (0:00:00.225) 0:05:52.808 ******* 2020-11-16T21:47:01.864 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-16T21:47:01.899 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:01 +0000 (0:00:00.061) 0:05:52.869 ******* 2020-11-16T21:47:01.926 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-16T21:47:01.927 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:01.961 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:01 +0000 (0:00:00.061) 0:05:52.931 ******* 2020-11-16T21:47:01.987 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-16T21:47:01.988 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:02.021 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:02 +0000 (0:00:00.060) 0:05:52.991 ******* 2020-11-16T21:47:02.040 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-16T21:47:02.041 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:02.075 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:02 +0000 (0:00:00.054) 0:05:53.045 ******* 2020-11-16T21:47:02.083 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-16T21:47:02.084 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme5x6CMFQCyyw68EW2T60PchcCy4OFOyTT7'], 'uuids': ['ce86046f-5f4e-4796-8e62-09b4927dac9f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.338447", "end": "2020-11-16 21:47:02.068292", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme5x6CMFQCyyw68EW2T60PchcCy4OFOyTT7"], "labels": [], "masters": [], "uuids": ["ce86046f-5f4e-4796-8e62-09b4927dac9f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:47:00.729845", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T21:47:02.085 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:02.097 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:02.108 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-16T21:47:02.110 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:02.145 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:02 +0000 (0:00:00.069) 0:05:53.115 ******* 2020-11-16T21:47:02.276 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-16T21:47:02.278 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T21:47:02.309 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:02 +0000 (0:00:00.164) 0:05:53.280 ******* 2020-11-16T21:47:02.348 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-16T21:47:02.349 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'block_used': 13755510, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226339598, 'size_available': 927086993408, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149530, 'block_size': 4096, 'inode_available': 60905446}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226339598, "block_size": 4096, "block_total": 240095108, "block_used": 13755510, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905446, "inode_total": 61054976, "inode_used": 149530, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927086993408, "size_total": 983429562368, "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:02.381 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:02 +0000 (0:00:00.071) 0:05:53.352 ******* 2020-11-16T21:47:02.408 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-16T21:47:02.410 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:02.442 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:02 +0000 (0:00:00.060) 0:05:53.412 ******* 2020-11-16T21:47:02.469 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:47:02.471 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:02.503 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:02 +0000 (0:00:00.060) 0:05:53.473 ******* 2020-11-16T21:47:02.529 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:47:02.531 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:02.563 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:02 +0000 (0:00:00.060) 0:05:53.533 ******* 2020-11-16T21:47:02.590 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:02.623 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:02 +0000 (0:00:00.060) 0:05:53.594 ******* 2020-11-16T21:47:02.650 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:02.684 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:02 +0000 (0:00:00.060) 0:05:53.654 ******* 2020-11-16T21:47:02.711 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-16T21:47:02.713 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:02.744 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:02 +0000 (0:00:00.060) 0:05:53.715 ******* 2020-11-16T21:47:08.175 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-16T21:47:08.177 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme54LTGw24YfsT5ZvkEQpC1T6nZkEygqhrn'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.114657", "end": "2020-11-16 21:47:07.467852", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme54LTGw24YfsT5ZvkEQpC1T6nZkEygqhrn"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:47:06.353195", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1' 2020-11-16T21:47:08.178 INFO:teuthology.task.ansible.out:, 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Create volume group(s)] *************************************** changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-16T21:47:08.210 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:08 +0000 (0:00:05.465) 0:05:59.180 ******* 2020-11-16T21:47:08.761 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-16T21:47:08.763 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T21:47:08.949 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-16T21:47:08.951 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme5PJyHxZAZY35kOD9fPozNzdUbq077yasE'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.346456", "end": "2020-11-16 21:47:08.935412", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme5PJyHxZAZY35kOD9fPozNzdUbq077yasE"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:47:07.588956", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-16T21:47:08.992 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:08 +0000 (0:00:00.781) 0:05:59.962 ******* 2020-11-16T21:47:08.999 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-16T21:47:09.001 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T21:47:09.032 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-16T21:47:09.034 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:09.241 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-16T21:47:09.243 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T21:47:09.274 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-16T21:47:09.275 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme5Q6xKq2LgIgxdOTaP15GBWPxnnJGBJT1z'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.116396", "end": "2020-11-16 21:47:09.263300", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme5Q6xKq2LgIgxdOTaP15GBWPxnnJGBJT1z"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:47:09.146904", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.111705 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.111705 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:09.286 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:09.287 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:09.505 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-16T21:47:09.507 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T21:47:09.528 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-16T21:47:09.529 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme5sgZn7grkdG8SU4Omsd5rvp4zjaN0ZHKB'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.116353", "end": "2020-11-16 21:47:09.513714", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme5sgZn7grkdG8SU4Omsd5rvp4zjaN0ZHKB"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:47:09.397361", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.112201 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.112201 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLZZ', 'wwn-0x5000c50092934caa'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLZZ-part1', 'wwn-0x5000c50092934c 2020-11-16T21:47:09.531 INFO:teuthology.task.ansible.out:aa-part1'], 'uuids': ['5b37dc69-d2db-44bf-9122-6cf42a1bab47']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092934caa', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XLZZ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLZZ", "wwn-0x5000c50092934caa"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLZZ-part1", "wwn-0x5000c50092934caa-part1"], "labels": [], "masters": [], "uuids": ["5b37dc69-d2db-44bf-9122-6cf42a1bab47"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XLZZ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092934caa"}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:09.561 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-16T21:47:09.563 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T21:47:09.596 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:09 +0000 (0:00:00.604) 0:06:00.566 ******* 2020-11-16T21:47:09.634 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-16T21:47:09.636 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'block_used': 13753468, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341640, 'size_available': 927095357440, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149529, 'block_size': 4096, 'inode_available': 60905447}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341640, "block_size": 4096, "block_total": 240095108, "block_used": 13753468, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905447, "inode_total": 61054976, "inode_used": 149529, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927095357440, "size_total": 983429562368, "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:09.669 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:09 +0000 (0:00:00.072) 0:06:00.639 ******* 2020-11-16T21:47:09.695 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-16T21:47:09.697 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:09.729 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:09 +0000 (0:00:00.060) 0:06:00.699 ******* 2020-11-16T21:47:09.736 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-16T21:47:09.738 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-KdSg9N-CT1I-L4gx-2twi-SRLC-ydzz-P6dcel', 'nvme-INTEL_SSDPED1D480GA_PHMB751300FS480DGN', 'nvme-nvme.8086-50484d42373531333030465334383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.053088", "end": "2020-11-16 21:47:09.694390", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-KdSg9N-CT1I-L4gx-2twi-SRLC-ydzz-P6dcel", "nvme-INTEL_SSDPED1D480GA_PHMB751300FS480DGN", "nvme-nvme.8086-50484d42373531333030465334383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:47:09.641302", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0483843 s, 2.4 GB/s", "stderr_lines": [" 2020-11-16T21:47:09.739 INFO:teuthology.task.ansible.out:110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0483843 s, 2.4 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:09.750 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-16T21:47:09.752 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T21:47:09.753 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:09.786 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:09 +0000 (0:00:00.057) 0:06:00.756 ******* 2020-11-16T21:47:09.818 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:09 +0000 (0:00:00.031) 0:06:00.788 ******* 2020-11-16T21:47:09.825 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:47:09.827 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:09.860 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:09 +0000 (0:00:00.042) 0:06:00.831 ******* 2020-11-16T21:47:09.898 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:09.930 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:09 +0000 (0:00:00.069) 0:06:00.901 ******* 2020-11-16T21:47:09.948 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-16T21:47:09.949 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme5x6CMFQCyyw68EW2T60PchcCy4OFOyTT7'], 'uuids': ['ce86046f-5f4e-4796-8e62-09b4927dac9f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.112212", "end": "2020-11-16 21:47:09.934573", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme5x6CMFQCyyw68EW2T60PchcCy4OFOyTT7"], "labels": [], "masters": [], "uuids": ["ce86046f-5f4e-4796-8e62-09b4927dac9f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:47:09.822361", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.108586 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.108586 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-16T21:47:09.982 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:09 +0000 (0:00:00.052) 0:06:00.953 ******* 2020-11-16T21:47:09.989 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-16T21:47:09.991 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:09.991 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-16T21:47:09.991 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes 2020-11-16T21:47:09.993 INFO:teuthology.task.ansible.out:", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:10.026 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:10 +0000 (0:00:00.043) 0:06:00.996 ******* 2020-11-16T21:47:10.053 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-16T21:47:10.055 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:10.087 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:10 +0000 (0:00:00.061) 0:06:01.057 ******* 2020-11-16T21:47:10.126 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-16T21:47:10.127 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T21:47:10.190 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-16T21:47:10.192 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme54LTGw24YfsT5ZvkEQpC1T6nZkEygqhrn'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.116831", "end": "2020-11-16 21:47:10.182428", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme54LTGw24YfsT5ZvkEQpC1T6nZkEygqhrn"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:47:10.065597", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.112269 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.112269 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:10.202 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:10.244 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-16T21:47:10.246 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T21:47:10.352 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T21:47:10.384 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-11-16T21:47:10.386 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-16T21:47:10.418 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:10 +0000 (0:00:00.331) 0:06:01.388 ******* 2020-11-16T21:47:10.435 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-16T21:47:10.435 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme5PJyHxZAZY35kOD9fPozNzdUbq077yasE'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.116214", "end": "2020-11-16 21:47:10.423904", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-p3Suvpx0IINWZ9FePi9TejQP52FYCme5PJyHxZAZY35kOD9fPozNzdUbq077yasE"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-16 21:47:10.307690", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.111461 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.111461 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:10.479 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:10 +0000 (0:00:00.060) 0:06:01.449 ******* 2020-11-16T21:47:10.486 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-16T21:47:10.488 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [smithi057.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:10.525 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:10 +0000 (0:00:00.046) 0:06:01.496 ******* 2020-11-16T21:47:10.656 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-16T21:47:10.658 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-11-16T21:47:10.690 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:10 +0000 (0:00:00.165) 0:06:01.661 ******* 2020-11-16T21:47:10.706 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-16T21:47:10.708 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T21:47:10.718 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-11-16T21:47:10.753 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:10 +0000 (0:00:00.062) 0:06:01.723 ******* 2020-11-16T21:47:10.770 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-16T21:47:10.772 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.153807", "end": "2020-11-16 21:47:10.753829", "rc": 0, "start": "2020-11-16 21:47:10.600022", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:10.804 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:10 +0000 (0:00:00.051) 0:06:01.775 ******* 2020-11-16T21:47:10.935 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-16T21:47:10.937 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T21:47:11.078 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-16T21:47:11.079 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.140302", "end": "2020-11-16 21:47:11.067318", "rc": 0, "start": "2020-11-16 21:47:10.927016", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:11.110 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:11 +0000 (0:00:00.305) 0:06:02.080 ******* 2020-11-16T21:47:11.136 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-16T21:47:11.171 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:11 +0000 (0:00:00.061) 0:06:02.141 ******* 2020-11-16T21:47:11.177 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-16T21:47:11.178 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T21:47:11.199 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-16T21:47:11.200 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:11.234 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:11 +0000 (0:00:00.062) 0:06:02.204 ******* 2020-11-16T21:47:11.261 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-16T21:47:11.262 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:11.294 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:11 +0000 (0:00:00.060) 0:06:02.265 ******* 2020-11-16T21:47:11.321 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-16T21:47:11.322 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:11.384 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:11 +0000 (0:00:00.089) 0:06:02.354 ******* 2020-11-16T21:47:11.401 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-16T21:47:11.403 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T21:47:11.413 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-16T21:47:11.414 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:11.445 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:11 +0000 (0:00:00.061) 0:06:02.416 ******* 2020-11-16T21:47:11.629 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-16T21:47:11.630 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T21:47:11.665 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:11 +0000 (0:00:00.219) 0:06:02.636 ******* 2020-11-16T21:47:19.815 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-16T21:47:19.817 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true} 2020-11-16T21:47:19.851 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:19 +0000 (0:00:08.185) 0:06:10.821 ******* 2020-11-16T21:47:19.972 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-16T21:47:19.974 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-16T21:47:20.006 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:20 +0000 (0:00:00.155) 0:06:10.977 ******* 2020-11-16T21:47:20.044 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-16T21:47:20.046 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'block_used': 13753471, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341637, 'size_available': 927095345152, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149530, 'block_size': 4096, 'inode_available': 60905446}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341637, "block_size": 4096, "block_total": 240095108, "block_used": 13753471, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905446, "inode_total": 61054976, "inode_used": 149530, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927095345152, "size_total": 983429562368, "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:20.078 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:20 +0000 (0:00:00.071) 0:06:11.049 ******* 2020-11-16T21:47:20.105 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-16T21:47:20.106 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:20.138 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:20 +0000 (0:00:00.060) 0:06:11.109 ******* 2020-11-16T21:47:20.165 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:47:20.167 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:20.200 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:20 +0000 (0:00:00.061) 0:06:11.170 ******* 2020-11-16T21:47:20.206 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-16T21:47:20.207 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-16T21:47:20.240 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:20 +0000 (0:00:00.040) 0:06:11.211 ******* 2020-11-16T21:47:20.248 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:47:20.249 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:20.282 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:20 +0000 (0:00:00.041) 0:06:11.253 ******* 2020-11-16T21:47:20.299 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-16T21:47:20.300 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-16T21:47:20.333 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:20 +0000 (0:00:00.050) 0:06:11.303 ******* 2020-11-16T21:47:20.340 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-16T21:47:20.342 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:20.376 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:20 +0000 (0:00:00.042) 0:06:11.346 ******* 2020-11-16T21:47:20.392 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-16T21:47:20.394 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T21:47:20.404 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-16T21:47:20.406 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:20.437 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:20 +0000 (0:00:00.061) 0:06:11.407 ******* 2020-11-16T21:47:20.464 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:20.465 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-16T21:47:20.465 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-11-16T21:47:20.499 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:20 +0000 (0:00:00.062) 0:06:11.469 ******* 2020-11-16T21:47:20.532 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:20 +0000 (0:00:00.032) 0:06:11.502 ******* 2020-11-16T21:47:20.538 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-16T21:47:20.538 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T21:47:20.614 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T21:47:20.625 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-16T21:47:20.627 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-11-16T21:47:20.659 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:20 +0000 (0:00:00.126) 0:06:11.629 ******* 2020-11-16T21:47:20.727 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-16T21:47:20.729 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T21:47:20.739 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:20.775 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:20 +0000 (0:00:00.116) 0:06:11.746 ******* 2020-11-16T21:47:20.844 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-11-16T21:47:20.845 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-16T21:47:20.879 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:20 +0000 (0:00:00.103) 0:06:11.849 ******* 2020-11-16T21:47:20.905 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-16T21:47:20.907 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-11-16T21:47:20.939 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:20 +0000 (0:00:00.060) 0:06:11.910 ******* 2020-11-16T21:47:20.967 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-16T21:47:20.968 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-11-16T21:47:21.000 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:20 +0000 (0:00:00.060) 0:06:11.971 ******* 2020-11-16T21:47:21.006 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-16T21:47:21.008 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1236, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-11-16T21:47:21.041 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:21 +0000 (0:00:00.041) 0:06:12.012 ******* 2020-11-16T21:47:21.152 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-16T21:47:21.153 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T21:47:21.359 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-16T21:47:21.361 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-11-16T21:47:21.392 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:21 +0000 (0:00:00.350) 0:06:12.362 ******* 2020-11-16T21:47:21.399 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-16T21:47:21.401 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T21:47:21.627 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T21:47:21.856 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T21:47:22.063 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-16T21:47:22.099 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:22 +0000 (0:00:00.707) 0:06:13.070 ******* 2020-11-16T21:47:22.158 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-16T21:47:22.160 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true} 2020-11-16T21:47:22.193 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:22 +0000 (0:00:00.093) 0:06:13.163 ******* 2020-11-16T21:47:22.231 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-16T21:47:22.233 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-16T21:47:22.266 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:22 +0000 (0:00:00.073) 0:06:13.237 ******* 2020-11-16T21:47:22.325 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-11-16T21:47:22.327 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1605562695, "cache_updated": false, "changed": false} 2020-11-16T21:47:22.359 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:22 +0000 (0:00:00.092) 0:06:13.330 ******* 2020-11-16T21:47:22.408 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-16T21:47:22.409 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T21:47:22.443 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:22 +0000 (0:00:00.083) 0:06:13.414 ******* 2020-11-16T21:47:22.522 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T21:47:22.534 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-11-16T21:47:22.535 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.047784", "end": "2020-11-16 21:47:22.532226", "rc": 0, "start": "2020-11-16 21:47:22.484442", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-11-16T21:47:22.568 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:22 +0000 (0:00:00.124) 0:06:13.538 ******* 2020-11-16T21:47:22.585 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-16T21:47:22.587 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-11-16T21:47:22.619 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:22 +0000 (0:00:00.051) 0:06:13.590 ******* 2020-11-16T21:47:22.626 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-11-16T21:47:22.628 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:22.662 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:22 +0000 (0:00:00.042) 0:06:13.632 ******* 2020-11-16T21:47:22.669 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-16T21:47:22.670 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T21:47:22.691 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:22.729 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:22 +0000 (0:00:00.067) 0:06:13.699 ******* 2020-11-16T21:47:22.746 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-16T21:47:22.748 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-16T21:47:22.758 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:22.795 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:22 +0000 (0:00:00.066) 0:06:13.765 ******* 2020-11-16T21:47:22.802 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-16T21:47:22.804 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-11-16T21:47:22.839 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:22 +0000 (0:00:00.044) 0:06:13.809 ******* 2020-11-16T21:47:22.929 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-16T21:47:22.931 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-11-16T21:47:22.965 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:22 +0000 (0:00:00.125) 0:06:13.935 ******* 2020-11-16T21:47:23.003 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-16T21:47:23.005 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-11-16T21:47:23.036 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:23 +0000 (0:00:00.071) 0:06:14.007 ******* 2020-11-16T21:47:23.167 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-16T21:47:23.169 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1236, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-11-16T21:47:23.202 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:23 +0000 (0:00:00.165) 0:06:14.172 ******* 2020-11-16T21:47:23.529 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-16T21:47:23.531 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-11-16T21:47:23.563 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:23 +0000 (0:00:00.361) 0:06:14.534 ******* 2020-11-16T21:47:23.591 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-16T21:47:23.592 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1605562695, "cache_updated": false, "changed": false} 2020-11-16T21:47:23.626 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:23 +0000 (0:00:00.062) 0:06:14.596 ******* 2020-11-16T21:47:23.652 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-11-16T21:47:23.654 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:23.685 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:23 +0000 (0:00:00.059) 0:06:14.655 ******* 2020-11-16T21:47:24.001 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-16T21:47:24.003 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-11-16T21:47:24.034 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:24 +0000 (0:00:00.349) 0:06:15.005 ******* 2020-11-16T21:47:24.061 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-16T21:47:24.063 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:24.093 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:24 +0000 (0:00:00.059) 0:06:15.064 ******* 2020-11-16T21:47:24.203 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-16T21:47:24.205 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"changed": true} 2020-11-16T21:47:24.242 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:24 +0000 (0:00:00.148) 0:06:15.213 ******* 2020-11-16T21:47:24.303 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-16T21:47:24.304 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-11-16 21:41:02 UTC", "ActiveEnterTimestampMonotonic": "24169238", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service systemd-journald.socket system.slice basic.target sysinit.target -.mount network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-11-16 21:40:56 UTC", "AssertTimestampMonotonic": "17620044", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-11-16 21:40:56 UTC", "ConditionTimestampMonotonic": "17620044", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-11-16T21:47:24.306 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1991", "ExecMainStartTimestamp": "Mon 2020-11-16 21:41:02 UTC", "ExecMainStartTimestampMonotonic": "24169224", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-11-16 21:40:56 UTC", "InactiveExitTimestampMonotonic": "17620826", "InvocationID": "0f24896a51c74f6182e6d1eb062101c8", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-11-16T21:47:24.307 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1991", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-11-16 21:41:02 UTC", "S 2020-11-16T21:47:24.309 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "24169238", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-11-16 21:41:02 UTC", "WatchdogTimestampMonotonic": "24169236", "WatchdogUSec": "0"}} 2020-11-16T21:47:24.489 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:24 +0000 (0:00:00.246) 0:06:15.459 ******* 2020-11-16T21:47:24.495 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-11-16T21:47:24.497 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1605562650, "cache_updated": false, "changed": false} 2020-11-16T21:47:24.530 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:24 +0000 (0:00:00.041) 0:06:15.501 ******* 2020-11-16T21:47:24.537 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:47:24.539 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi195.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-16T21:47:24.573 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:24 +0000 (0:00:00.042) 0:06:15.543 ******* 2020-11-16T21:47:24.604 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:24 +0000 (0:00:00.031) 0:06:15.574 ******* 2020-11-16T21:47:24.611 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:47:24.612 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:24.646 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:24 +0000 (0:00:00.042) 0:06:15.617 ******* 2020-11-16T21:47:24.672 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-16T21:47:24.674 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:24.706 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:24 +0000 (0:00:00.059) 0:06:15.676 ******* 2020-11-16T21:47:24.714 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-11-16T21:47:24.715 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.046427", "end": "2020-11-16 21:47:24.701579", "rc": 0, "start": "2020-11-16 21:47:24.655152", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-11-16T21:47:24.749 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:24 +0000 (0:00:00.043) 0:06:15.719 ******* 2020-11-16T21:47:24.755 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-16T21:47:24.757 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-11-16T21:47:24.791 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:24 +0000 (0:00:00.041) 0:06:15.761 ******* 2020-11-16T21:47:24.798 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-11-16T21:47:24.799 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:24.832 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:24 +0000 (0:00:00.041) 0:06:15.803 ******* 2020-11-16T21:47:24.860 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-16T21:47:24.861 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:24.892 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:24 +0000 (0:00:00.059) 0:06:15.863 ******* 2020-11-16T21:47:24.919 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-16T21:47:24.920 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-11-16T21:47:24.953 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:24 +0000 (0:00:00.060) 0:06:15.923 ******* 2020-11-16T21:47:25.622 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-16T21:47:25.624 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"cache_update_time": 1605562695, "cache_updated": false, "changed": false} 2020-11-16T21:47:25.661 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:25 +0000 (0:00:00.708) 0:06:16.632 ******* 2020-11-16T21:47:25.688 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:25.722 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:25 +0000 (0:00:00.060) 0:06:16.693 ******* 2020-11-16T21:47:25.780 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-16T21:47:25.781 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1605562650, "cache_updated": false, "changed": false} 2020-11-16T21:47:25.814 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:25 +0000 (0:00:00.092) 0:06:16.785 ******* 2020-11-16T21:47:25.841 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-11-16T21:47:25.843 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:25.874 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:25 +0000 (0:00:00.059) 0:06:16.844 ******* 2020-11-16T21:47:37.642 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-16T21:47:37.644 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1236, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-11-16T21:47:37.677 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:37 +0000 (0:00:11.803) 0:06:28.647 ******* 2020-11-16T21:47:38.004 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-16T21:47:38.006 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-11-16T21:47:38.038 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:38 +0000 (0:00:00.360) 0:06:29.008 ******* 2020-11-16T21:47:38.241 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-16T21:47:38.243 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-11-16T21:47:38.276 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:38 +0000 (0:00:00.238) 0:06:29.246 ******* 2020-11-16T21:47:38.627 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-16T21:47:38.628 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-11-16T21:47:38.660 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:38 +0000 (0:00:00.384) 0:06:29.631 ******* 2020-11-16T21:47:38.668 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-16T21:47:38.668 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-11-16T21:47:38.704 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:38 +0000 (0:00:00.043) 0:06:29.675 ******* 2020-11-16T21:47:38.733 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-16T21:47:38.735 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:38.767 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:38 +0000 (0:00:00.062) 0:06:29.737 ******* 2020-11-16T21:47:38.930 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-11-16T21:47:38.932 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"cache_update_time": 1605562608, "cache_updated": false, "changed": false} 2020-11-16T21:47:38.965 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:38 +0000 (0:00:00.198) 0:06:29.935 ******* 2020-11-16T21:47:38.983 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-16T21:47:38.984 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-11-16 21:40:45 UTC", "ActiveEnterTimestampMonotonic": "24548376", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target network.target systemd-tmpfiles-setup.service basic.target -.mount system.slice systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-11-16 21:40:39 UTC", "AssertTimestampMonotonic": "18028110", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-11-16 21:40:39 UTC", "ConditionTimestampMonotonic": "18028110", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-11-16T21:47:38.985 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1890", "ExecMainStartTimestamp": "Mon 2020-11-16 21:40:45 UTC", "ExecMainStartTimestampMonotonic": "24548363", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-11-16 21:40:39 UTC", "InactiveExitTimestampMonotonic": "18028850", "InvocationID": "2f8ed1a54eda42398f5eb6265efdc593", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-11-16T21:47:38.987 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1890", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-11-16 21:40:45 UTC", "S 2020-11-16T21:47:38.988 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "24548376", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-11-16 21:40:45 UTC", "WatchdogTimestampMonotonic": "24548374", "WatchdogUSec": "0"}} 2020-11-16T21:47:39.019 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:39 +0000 (0:00:00.054) 0:06:29.990 ******* 2020-11-16T21:47:39.047 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:47:39.048 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-16T21:47:39.080 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:39 +0000 (0:00:00.060) 0:06:30.050 ******* 2020-11-16T21:47:43.245 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-11-16T21:47:43.247 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.045176", "end": "2020-11-16 21:47:39.132394", "rc": 0, "start": "2020-11-16 21:47:39.087218", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} TASK [testnode : Install packages via pip] ************************************* ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-16T21:47:43.247 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:43.280 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:43 +0000 (0:00:04.200) 0:06:34.251 ******* 2020-11-16T21:47:43.318 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:43 +0000 (0:00:00.037) 0:06:34.288 ******* 2020-11-16T21:47:43.350 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:43 +0000 (0:00:00.031) 0:06:34.320 ******* 2020-11-16T21:47:43.357 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-16T21:47:43.359 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:43.394 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:43 +0000 (0:00:00.044) 0:06:34.364 ******* 2020-11-16T21:47:43.401 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-11-16T21:47:43.403 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:43.437 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:43 +0000 (0:00:00.042) 0:06:34.407 ******* 2020-11-16T21:47:47.512 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-16T21:47:47.514 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false} 2020-11-16T21:47:47.546 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:47 +0000 (0:00:04.108) 0:06:38.516 ******* 2020-11-16T21:47:47.553 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-16T21:47:47.555 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:47.588 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:47 +0000 (0:00:00.042) 0:06:38.558 ******* 2020-11-16T21:47:47.595 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-16T21:47:47.597 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-11-16T21:47:47.631 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:47 +0000 (0:00:00.042) 0:06:38.601 ******* 2020-11-16T21:47:51.739 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-16T21:47:51.741 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1605562650, "cache_updated": false, "changed": false} 2020-11-16T21:47:51.776 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:51 +0000 (0:00:04.144) 0:06:42.746 ******* 2020-11-16T21:47:51.805 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-16T21:47:51.807 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:51.838 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:51 +0000 (0:00:00.062) 0:06:42.809 ******* 2020-11-16T21:47:51.888 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-16T21:47:51.889 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1605562588.2933407, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1605562588.2893407, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 2817, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1605562588.2893407, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "2282523401", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-11-16T21:47:51.922 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:51 +0000 (0:00:00.083) 0:06:42.893 ******* 2020-11-16T21:47:51.971 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-16T21:47:51.972 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-11-16T21:47:52.004 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:51 +0000 (0:00:00.082) 0:06:42.975 ******* 2020-11-16T21:47:52.177 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-16T21:47:52.179 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-11-16T21:47:52.212 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:52 +0000 (0:00:00.207) 0:06:43.183 ******* 2020-11-16T21:47:52.250 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-16T21:47:52.252 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-16T21:47:52.289 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:52 +0000 (0:00:00.076) 0:06:43.259 ******* 2020-11-16T21:47:52.316 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-16T21:47:52.318 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:52.349 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:52 +0000 (0:00:00.060) 0:06:43.319 ******* 2020-11-16T21:47:52.356 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-16T21:47:52.358 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-11-16T21:47:52.393 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:52 +0000 (0:00:00.043) 0:06:43.363 ******* 2020-11-16T21:47:52.483 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-16T21:47:52.485 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-16T21:47:52.519 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:52 +0000 (0:00:00.125) 0:06:43.489 ******* 2020-11-16T21:47:52.577 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-16T21:47:52.579 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"cache_update_time": 1605562608, "cache_updated": false, "changed": false} 2020-11-16T21:47:52.612 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:52 +0000 (0:00:00.093) 0:06:43.583 ******* 2020-11-16T21:47:52.640 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-11-16T21:47:52.642 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi057.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-16T21:47:52.674 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:52 +0000 (0:00:00.062) 0:06:43.645 ******* 2020-11-16T21:47:52.706 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:52 +0000 (0:00:00.031) 0:06:43.676 ******* 2020-11-16T21:47:52.713 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-16T21:47:52.715 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:52.749 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:52 +0000 (0:00:00.042) 0:06:43.719 ******* 2020-11-16T21:47:52.786 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-16T21:47:52.790 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} skipping: [smithi057.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-16T21:47:52.798 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-16T21:47:52.800 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-11-16T21:47:52.833 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:52 +0000 (0:00:00.084) 0:06:43.803 ******* 2020-11-16T21:47:52.862 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-16T21:47:52.864 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:52.873 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:52.874 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:52.885 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:52.886 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:52.920 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:52 +0000 (0:00:00.087) 0:06:43.891 ******* 2020-11-16T21:47:52.948 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:47:52.950 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:52.983 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:52 +0000 (0:00:00.062) 0:06:43.953 ******* 2020-11-16T21:47:53.010 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-11-16T21:47:53.012 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-11-16T21:47:53.044 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:53 +0000 (0:00:00.061) 0:06:44.015 ******* 2020-11-16T21:47:53.075 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:53 +0000 (0:00:00.030) 0:06:44.045 ******* 2020-11-16T21:47:53.080 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-16T21:47:53.088 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:53.122 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:53 +0000 (0:00:00.047) 0:06:44.093 ******* 2020-11-16T21:47:53.130 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-16T21:47:53.131 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:53.163 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:53 +0000 (0:00:00.040) 0:06:44.134 ******* 2020-11-16T21:47:53.170 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-16T21:47:53.171 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:53.205 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:53 +0000 (0:00:00.041) 0:06:44.175 ******* 2020-11-16T21:47:53.222 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-16T21:47:53.223 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-16T21:47:53.255 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:53 +0000 (0:00:00.050) 0:06:44.226 ******* 2020-11-16T21:47:53.263 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-11-16T21:47:53.264 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:53.304 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:53 +0000 (0:00:00.048) 0:06:44.274 ******* 2020-11-16T21:47:53.331 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-16T21:47:53.333 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:53.367 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:53 +0000 (0:00:00.063) 0:06:44.338 ******* 2020-11-16T21:47:53.374 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-16T21:47:53.376 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2020-11-16 21:40:49 UTC", "ActiveEnterTimestampMonotonic": "25467508", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service sysinit.target systemd-journald.socket system.slice network.target -.mount basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2020-11-16 21:40:42 UTC", "AssertTimestampMonotonic": "18888117", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2020-11-16 21:40:42 UTC", "ConditionTimestampMonotonic": "18888117", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-11-16T21:47:53.378 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1794", "ExecMainStartTimestamp": "Mon 2020-11-16 21:40:49 UTC", "ExecMainStartTimestampMonotonic": "25467479", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2020-11-16 21:40:42 UTC", "InactiveExitTimestampMonotonic": "18888877", "InvocationID": "7f1f32f0d9204f7592f80198ec54b065", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-11-16T21:47:53.379 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1794", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2020-11-16 21:40:49 UTC", "S 2020-11-16T21:47:53.381 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "25467508", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2020-11-16 21:40:49 UTC", "WatchdogTimestampMonotonic": "25467504", "WatchdogUSec": "0"}} 2020-11-16T21:47:53.411 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:53 +0000 (0:00:00.043) 0:06:44.381 ******* 2020-11-16T21:47:53.417 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-11-16T21:47:53.419 INFO:teuthology.task.ansible.out:skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:53.453 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:53 +0000 (0:00:00.041) 0:06:44.423 ******* 2020-11-16T21:47:53.459 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:47:53.460 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-16T21:47:53.492 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:53 +0000 (0:00:00.039) 0:06:44.463 ******* 2020-11-16T21:47:53.498 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi057.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:53.533 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:53 +0000 (0:00:00.040) 0:06:44.503 ******* 2020-11-16T21:47:53.544 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:47:53.546 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:53.580 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:53 +0000 (0:00:00.046) 0:06:44.550 ******* 2020-11-16T21:47:53.609 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-16T21:47:53.611 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:53.644 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:53 +0000 (0:00:00.064) 0:06:44.615 ******* 2020-11-16T21:47:53.692 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-16T21:47:53.694 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011125", "end": "2020-11-16 21:47:53.673099", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-16 21:47:53.661974", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:53.776 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-16T21:47:53.778 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false} 2020-11-16T21:47:53.810 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:53 +0000 (0:00:00.165) 0:06:44.780 ******* 2020-11-16T21:47:53.837 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-16T21:47:53.839 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-11-16T21:47:53.870 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:53 +0000 (0:00:00.060) 0:06:44.840 ******* 2020-11-16T21:47:57.904 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-16T21:47:57.906 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006077", "end": "2020-11-16 21:47:57.886493", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-16 21:47:57.880416", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:58.018 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005651", "end": "2020-11-16 21:47:58.006968", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-16 21:47:58.001317", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:58.030 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-16T21:47:58.031 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1605562547.71188, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1605562547.7078822, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 2817, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1605562547.7078822, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "2282523401", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-11-16T21:47:58.063 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:58 +0000 (0:00:04.192) 0:06:49.033 ******* 2020-11-16T21:47:58.163 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-16T21:47:58.165 INFO:teuthology.task.ansible.out:ok: [smithi057.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.031374", "end": "2020-11-16 21:47:58.147798", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-16 21:47:58.116424", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:47:58.199 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:58 +0000 (0:00:00.136) 0:06:49.170 ******* 2020-11-16T21:47:58.217 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-16T21:47:58.219 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-11-16T21:47:58.251 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:58 +0000 (0:00:00.051) 0:06:49.221 ******* 2020-11-16T21:47:58.260 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-16T21:47:58.295 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:58 +0000 (0:00:00.043) 0:06:49.265 ******* 2020-11-16T21:47:58.305 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-16T21:47:58.306 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-16T21:47:58.346 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:58 +0000 (0:00:00.050) 0:06:49.316 ******* 2020-11-16T21:47:58.375 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-16T21:47:58.376 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:47:58.409 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:47:58 +0000 (0:00:00.063) 0:06:49.379 ******* 2020-11-16T21:48:06.474 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-11-16T21:48:06.476 INFO:teuthology.task.ansible.out:changed: [smithi057.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-11-16T21:48:06.510 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-16T21:48:06.511 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"cache_update_time": 1605562608, "cache_updated": false, "changed": false} 2020-11-16T21:48:06.564 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:06 +0000 (0:00:08.155) 0:06:57.535 ******* 2020-11-16T21:48:10.611 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-16T21:48:10.612 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-16T21:48:10.645 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:10 +0000 (0:00:04.080) 0:07:01.616 ******* 2020-11-16T21:48:10.653 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-16T21:48:10.654 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:10.688 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:10 +0000 (0:00:00.042) 0:07:01.658 ******* 2020-11-16T21:48:10.774 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-11-16T21:48:10.776 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-16T21:48:10.807 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:10 +0000 (0:00:00.119) 0:07:01.778 ******* 2020-11-16T21:48:10.825 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-16T21:48:10.827 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-11-16T21:48:10.859 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:10 +0000 (0:00:00.051) 0:07:01.829 ******* 2020-11-16T21:48:10.864 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-16T21:48:10.866 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:10.899 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:10 +0000 (0:00:00.039) 0:07:01.869 ******* 2020-11-16T21:48:10.936 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-16T21:48:10.938 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-16T21:48:10.948 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-16T21:48:10.950 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-11-16T21:48:10.981 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:10 +0000 (0:00:00.082) 0:07:01.952 ******* 2020-11-16T21:48:11.010 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-16T21:48:11.012 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:11.021 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:11.023 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:11.033 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:11.034 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:11.067 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:11 +0000 (0:00:00.085) 0:07:02.037 ******* 2020-11-16T21:48:11.094 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:48:11.096 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:11.128 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:11 +0000 (0:00:00.061) 0:07:02.099 ******* 2020-11-16T21:48:11.156 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:11.189 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:11 +0000 (0:00:00.061) 0:07:02.160 ******* 2020-11-16T21:48:11.217 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-16T21:48:11.219 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:11.251 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:11 +0000 (0:00:00.061) 0:07:02.221 ******* 2020-11-16T21:48:11.258 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-16T21:48:11.260 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-11-16T21:48:11.293 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:11 +0000 (0:00:00.042) 0:07:02.263 ******* 2020-11-16T21:48:11.300 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-16T21:48:11.301 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:11.334 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:11 +0000 (0:00:00.041) 0:07:02.305 ******* 2020-11-16T21:48:11.362 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:11.398 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:11 +0000 (0:00:00.063) 0:07:02.368 ******* 2020-11-16T21:48:11.426 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-16T21:48:11.428 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:11.466 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:11 +0000 (0:00:00.068) 0:07:02.436 ******* 2020-11-16T21:48:11.494 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-11-16T21:48:11.495 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:11.528 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:11 +0000 (0:00:00.062) 0:07:02.499 ******* 2020-11-16T21:48:11.556 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:11.588 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:11 +0000 (0:00:00.059) 0:07:02.559 ******* 2020-11-16T21:48:11.741 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-16T21:48:11.743 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011214", "end": "2020-11-16 21:48:11.727251", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-16 21:48:11.716037", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:48:11.856 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006146", "end": "2020-11-16 21:48:11.851491", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-16 21:48:11.845345", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:48:11.981 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005553", "end": "2020-11-16 21:48:11.968400", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-16 21:48:11.962847", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-16T21:48:12.096 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-16T21:48:12.097 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-16T21:48:12.129 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:12 +0000 (0:00:00.540) 0:07:03.100 ******* 2020-11-16T21:48:12.136 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-16T21:48:12.137 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.020073", "end": "2020-11-16 21:48:12.094362", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-16 21:48:12.074289", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:48:12.173 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:12 +0000 (0:00:00.043) 0:07:03.143 ******* 2020-11-16T21:48:12.201 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-16T21:48:12.234 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:12 +0000 (0:00:00.060) 0:07:03.204 ******* 2020-11-16T21:48:12.355 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-11-16T21:48:12.357 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-11-16T21:48:12.644 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-16T21:48:12.646 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false} 2020-11-16T21:48:12.676 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:12 +0000 (0:00:00.442) 0:07:03.647 ******* 2020-11-16T21:48:12.704 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-16T21:48:12.706 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-16T21:48:12.737 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:12 +0000 (0:00:00.060) 0:07:03.707 ******* 2020-11-16T21:48:12.878 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-16T21:48:12.880 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1605562577.9918668, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1605562577.9878669, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 2817, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1605562577.9878669, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "2282523401", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-11-16T21:48:12.914 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:12 +0000 (0:00:00.177) 0:07:03.885 ******* 2020-11-16T21:48:13.045 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-16T21:48:13.046 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-11-16T21:48:13.078 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:13 +0000 (0:00:00.163) 0:07:04.048 ******* 2020-11-16T21:48:13.105 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-16T21:48:13.106 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-16T21:48:13.138 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:13 +0000 (0:00:00.059) 0:07:04.108 ******* 2020-11-16T21:48:13.165 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:13.197 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:13 +0000 (0:00:00.059) 0:07:04.167 ******* 2020-11-16T21:48:13.316 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-16T21:48:13.318 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-16T21:48:13.349 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:13 +0000 (0:00:00.151) 0:07:04.319 ******* 2020-11-16T21:48:13.469 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-11-16T21:48:13.471 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-16T21:48:13.503 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:13 +0000 (0:00:00.153) 0:07:04.473 ******* 2020-11-16T21:48:13.529 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-16T21:48:13.531 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:13.562 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:13 +0000 (0:00:00.059) 0:07:04.533 ******* 2020-11-16T21:48:13.589 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-16T21:48:13.591 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-11-16T21:48:13.600 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-11-16T21:48:13.602 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-16T21:48:13.612 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-11-16T21:48:13.613 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-16T21:48:13.645 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:13 +0000 (0:00:00.082) 0:07:04.616 ******* 2020-11-16T21:48:13.681 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-16T21:48:13.683 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi195.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:13.693 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:13.695 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:13.727 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:13 +0000 (0:00:00.082) 0:07:04.698 ******* 2020-11-16T21:48:13.754 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-16T21:48:13.755 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:13.788 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:13 +0000 (0:00:00.060) 0:07:04.759 ******* 2020-11-16T21:48:13.815 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-11-16T21:48:13.817 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:13.848 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:13 +0000 (0:00:00.059) 0:07:04.818 ******* 2020-11-16T21:48:13.875 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-16T21:48:13.876 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:13.909 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:13 +0000 (0:00:00.061) 0:07:04.880 ******* 2020-11-16T21:48:13.936 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-16T21:48:13.938 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:13.972 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:13 +0000 (0:00:00.062) 0:07:04.942 ******* 2020-11-16T21:48:13.999 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-11-16T21:48:14.000 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:14.033 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:14 +0000 (0:00:00.060) 0:07:05.003 ******* 2020-11-16T21:48:14.060 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-16T21:48:14.061 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:14.094 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:14 +0000 (0:00:00.061) 0:07:05.065 ******* 2020-11-16T21:48:14.121 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-11-16T21:48:14.123 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:14.155 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:14 +0000 (0:00:00.060) 0:07:05.125 ******* 2020-11-16T21:48:14.180 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-16T21:48:14.182 INFO:teuthology.task.ansible.out:skipping: [smithi195.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-16T21:48:14.213 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:14 +0000 (0:00:00.058) 0:07:05.183 ******* 2020-11-16T21:48:14.364 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-16T21:48:14.366 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011023", "end": "2020-11-16 21:48:14.349780", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-16 21:48:14.338757", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:48:14.478 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005275", "end": "2020-11-16 21:48:14.467262", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-16 21:48:14.461987", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:48:14.583 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005475", "end": "2020-11-16 21:48:14.579533", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-16 21:48:14.574058", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-16T21:48:14.780 INFO:teuthology.task.ansible.out:ok: [smithi195.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.081363", "end": "2020-11-16 21:48:14.766032", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-16 21:48:14.684669", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-16T21:48:14.815 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:14 +0000 (0:00:00.601) 0:07:05.785 ******* 2020-11-16T21:48:14.841 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-16T21:48:14.874 INFO:teuthology.task.ansible.out:Monday 16 November 2020 21:48:14 +0000 (0:00:00.059) 0:07:05.844 ******* 2020-11-16T21:48:15.003 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-11-16T21:48:15.005 INFO:teuthology.task.ansible.out:changed: [smithi195.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-11-16T21:48:15.094 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-11-16T21:48:15.098 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-11-16T21:48:15.104 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2020-11-16T21:48:15.105 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi016.front.sepia.ceph.com : ok=108 changed=27 unreachable=0 failed=0 skipped=181 rescued=0 ignored=0 smithi057.front.sepia.ceph.com : ok=108 changed=27 unreachable=0 failed=0 skipped=181 rescued=0 ignored=0 smithi195.front.sepia.ceph.com : ok=108 changed=27 unreachable=0 failed=0 skipped=181 rescued=0 ignored=0 Monday 16 November 2020 21:48:15 +0000 (0:00:00.230) 0:07:06.075 ******* =============================================================================== testnode : Install GPG ------------------------------------------------- 12.44s testnode : Install non aarch64 packages --------------------------------- 9.25s testnode : Include hostname in /etc/sysconfig/network ------------------- 8.35s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 8.34s testnode : Ensure packages are not present. ----------------------------- 8.34s users : Create all users without sudo access. --------------------------- 8.31s common : Get list of enabled RHSM repos --------------------------------- 8.31s testnode : Check for custom repos --------------------------------------- 7.80s testnode : Set apt preferences ------------------------------------------ 6.75s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 6.33s Gathering Facts --------------------------------------------------------- 5.83s testnode : Enable kernel modules to load at boot time. ------------------ 5.60s ansible-managed : Delete the ansible users password. -------------------- 4.38s testnode : Add sources list --------------------------------------------- 4.21s common : nrpe - Ensure SELinux policy is up to date --------------------- 4.17s testnode : Install ntp package on rpm based systems. -------------------- 4.11s testnode : Install python-pip on zypper based systems. ------------------ 2020-11-16T21:48:15.107 INFO:teuthology.task.ansible.out: 4.08s testnode : Update apt cache. -------------------------------------------- 2.98s testnode : Zap all non-root disks --------------------------------------- 2.56s ansible-managed : Add authorized keys for the ansible user. ------------- 2.06s 2020-11-16T21:48:15.430 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi195.front.sepia.ceph.com'), Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi057.front.sepia.ceph.com')] 2020-11-16T21:48:15.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T21:48:15.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:48:15.510 INFO:teuthology.orchestra.run.smithi195:> true 2020-11-16T21:48:15.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T21:48:15.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:48:15.827 INFO:teuthology.orchestra.run.smithi016:> true 2020-11-16T21:48:16.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-16T21:48:16.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-16T21:48:16.103 INFO:teuthology.orchestra.run.smithi057:> true 2020-11-16T21:48:16.291 INFO:teuthology.run_tasks:Running task clock... 2020-11-16T21:48:16.301 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-11-16T21:48:16.301 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-16T21:48:16.302 INFO:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-16T21:48:16.354 INFO:teuthology.orchestra.run.smithi195.stdout:16 Nov 21:48:16 ntpd[5830]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-11-16T21:48:16.355 INFO:teuthology.orchestra.run.smithi195.stdout:16 Nov 21:48:16 ntpd[5830]: Command line: ntpd -gq 2020-11-16T21:48:16.356 INFO:teuthology.orchestra.run.smithi195.stdout:16 Nov 21:48:16 ntpd[5830]: proto: precision = 0.123 usec (-23) 2020-11-16T21:48:16.356 INFO:teuthology.orchestra.run.smithi195.stdout:16 Nov 21:48:16 ntpd[5830]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-11-16T21:48:16.356 INFO:teuthology.orchestra.run.smithi195.stdout:16 Nov 21:48:16 ntpd[5830]: restrict ::: KOD does nothing without LIMITED. 2020-11-16T21:48:16.356 INFO:teuthology.orchestra.run.smithi195.stdout:16 Nov 21:48:16 ntpd[5830]: Listen and drop on 0 v6wildcard [::]:123 2020-11-16T21:48:16.356 INFO:teuthology.orchestra.run.smithi195.stdout:16 Nov 21:48:16 ntpd[5830]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-11-16T21:48:16.357 INFO:teuthology.orchestra.run.smithi195.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-11-16T21:48:16.357 INFO:teuthology.orchestra.run.smithi195.stderr:restrict ::: KOD does nothing without LIMITED. 2020-11-16T21:48:16.357 INFO:teuthology.orchestra.run.smithi195.stdout:16 Nov 21:48:16 ntpd[5830]: Listen normally on 2 lo 127.0.0.1:123 2020-11-16T21:48:16.358 INFO:teuthology.orchestra.run.smithi195.stdout:16 Nov 21:48:16 ntpd[5830]: Listen normally on 3 enp3s0f1 172.21.15.195:123 2020-11-16T21:48:16.358 INFO:teuthology.orchestra.run.smithi195.stdout:16 Nov 21:48:16 ntpd[5830]: Listen normally on 4 lo [::1]:123 2020-11-16T21:48:16.358 INFO:teuthology.orchestra.run.smithi195.stdout:16 Nov 21:48:16 ntpd[5830]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8081%5]:123 2020-11-16T21:48:16.358 INFO:teuthology.orchestra.run.smithi195.stdout:16 Nov 21:48:16 ntpd[5830]: Listening on routing socket on fd #22 for interface updates 2020-11-16T21:48:19.355 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:19 ntpd[5830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:19.356 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:19 ntpd[5830]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:19.356 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:19 ntpd[5830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:19.356 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:19 ntpd[5830]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:19.356 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:19 ntpd[5830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:19.356 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:19 ntpd[5830]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:19.356 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:19 ntpd[5830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:19.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:19 ntpd[5830]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:19.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:19 ntpd[5830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:19.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:19 ntpd[5830]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:19.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:19 ntpd[5830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:19.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:19 ntpd[5830]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:21.355 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:21 ntpd[5830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:21.356 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:21 ntpd[5830]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:21.356 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:21 ntpd[5830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:21.356 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:21 ntpd[5830]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:21.356 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:21 ntpd[5830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:21.356 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:21 ntpd[5830]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:21.356 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:21 ntpd[5830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:21.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:21 ntpd[5830]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:21.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:21 ntpd[5830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:21.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:21 ntpd[5830]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:21.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:21 ntpd[5830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:21.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:21 ntpd[5830]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:21.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:21 ntpd[5830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:21.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:21 ntpd[5830]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:21.358 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:21 ntpd[5830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:21.358 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:21 ntpd[5830]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:23.356 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:23 ntpd[5830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:23.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:23 ntpd[5830]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:23.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:23 ntpd[5830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:23.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:23 ntpd[5830]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:23.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:23 ntpd[5830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:23.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:23 ntpd[5830]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:23.357 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:23 ntpd[5830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:23.358 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:23 ntpd[5830]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:23.358 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:23 ntpd[5830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:23.358 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:23 ntpd[5830]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:23.358 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:23 ntpd[5830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:23.359 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:23 ntpd[5830]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:23.359 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:23 ntpd[5830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:23.359 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:23 ntpd[5830]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:23.359 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:23 ntpd[5830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:23.359 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:23 ntpd[5830]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:25.355 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:25 ntpd[5830]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:25.355 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:25 ntpd[5830]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:25.355 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:25 ntpd[5830]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:25.356 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:25 ntpd[5830]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:25.356 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:25 ntpd[5830]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-11-16T21:48:25.356 INFO:teuthology.orchestra.run.smithi195.stderr:16 Nov 21:48:25 ntpd[5830]: can't open /var/log/ntpstats/loopstats.20201116: Permission denied 2020-11-16T21:48:25.356 INFO:teuthology.orchestra.run.smithi195.stdout:16 Nov 21:48:25 ntpd[5830]: ntpd: time slew -0.004815 s 2020-11-16T21:48:25.356 INFO:teuthology.orchestra.run.smithi195.stdout:ntpd: time slew -0.004815s 2020-11-16T21:48:25.402 INFO:teuthology.orchestra.run.smithi195.stdout: remote refid st t when poll reach delay offset jitter 2020-11-16T21:48:25.402 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================== 2020-11-16T21:48:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-16T21:48:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-16T21:48:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-16T21:48:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-16T21:48:25.403 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-16T21:48:25.404 INFO:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-16T21:48:25.460 INFO:teuthology.orchestra.run.smithi016.stdout:16 Nov 21:48:25 ntpd[5924]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-11-16T21:48:25.460 INFO:teuthology.orchestra.run.smithi016.stdout:16 Nov 21:48:25 ntpd[5924]: Command line: ntpd -gq 2020-11-16T21:48:25.461 INFO:teuthology.orchestra.run.smithi016.stdout:16 Nov 21:48:25 ntpd[5924]: proto: precision = 0.127 usec (-23) 2020-11-16T21:48:25.462 INFO:teuthology.orchestra.run.smithi016.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-11-16T21:48:25.462 INFO:teuthology.orchestra.run.smithi016.stderr:restrict ::: KOD does nothing without LIMITED. 2020-11-16T21:48:25.462 INFO:teuthology.orchestra.run.smithi016.stdout:16 Nov 21:48:25 ntpd[5924]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-11-16T21:48:25.462 INFO:teuthology.orchestra.run.smithi016.stdout:16 Nov 21:48:25 ntpd[5924]: restrict ::: KOD does nothing without LIMITED. 2020-11-16T21:48:25.462 INFO:teuthology.orchestra.run.smithi016.stdout:16 Nov 21:48:25 ntpd[5924]: Listen and drop on 0 v6wildcard [::]:123 2020-11-16T21:48:25.463 INFO:teuthology.orchestra.run.smithi016.stdout:16 Nov 21:48:25 ntpd[5924]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-11-16T21:48:25.463 INFO:teuthology.orchestra.run.smithi016.stdout:16 Nov 21:48:25 ntpd[5924]: Listen normally on 2 lo 127.0.0.1:123 2020-11-16T21:48:25.463 INFO:teuthology.orchestra.run.smithi016.stdout:16 Nov 21:48:25 ntpd[5924]: Listen normally on 3 ens1f0 172.21.15.16:123 2020-11-16T21:48:25.464 INFO:teuthology.orchestra.run.smithi016.stdout:16 Nov 21:48:25 ntpd[5924]: Listen normally on 4 lo [::1]:123 2020-11-16T21:48:25.464 INFO:teuthology.orchestra.run.smithi016.stdout:16 Nov 21:48:25 ntpd[5924]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1564%3]:123 2020-11-16T21:48:25.464 INFO:teuthology.orchestra.run.smithi016.stdout:16 Nov 21:48:25 ntpd[5924]: Listening on routing socket on fd #22 for interface updates 2020-11-16T21:48:26.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:26 ntpd[5924]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:26.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:26 ntpd[5924]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:26.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:26 ntpd[5924]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:26.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:26 ntpd[5924]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:26.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:26 ntpd[5924]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:26.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:26 ntpd[5924]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:26.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:26 ntpd[5924]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:26.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:26 ntpd[5924]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:27.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:27 ntpd[5924]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:27.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:27 ntpd[5924]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:27.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:27 ntpd[5924]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:27.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:27 ntpd[5924]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:28.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:28 ntpd[5924]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:28.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:28 ntpd[5924]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:28 ntpd[5924]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:28 ntpd[5924]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:28 ntpd[5924]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:28 ntpd[5924]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:28 ntpd[5924]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:28 ntpd[5924]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:28.463 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:28 ntpd[5924]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:28.463 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:28 ntpd[5924]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:28.463 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:28 ntpd[5924]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:28.463 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:28 ntpd[5924]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:29.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:29 ntpd[5924]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:29.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:29 ntpd[5924]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:29.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:29 ntpd[5924]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:29.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:29 ntpd[5924]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:30.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:30 ntpd[5924]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:30.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:30 ntpd[5924]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:30.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:30 ntpd[5924]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:30.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:30 ntpd[5924]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:30.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:30 ntpd[5924]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:30.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:30 ntpd[5924]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:30.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:30 ntpd[5924]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:30.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:30 ntpd[5924]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:30.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:30 ntpd[5924]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:30.463 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:30 ntpd[5924]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:30.463 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:30 ntpd[5924]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:30.463 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:30 ntpd[5924]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:31.460 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:31 ntpd[5924]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:31.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:31 ntpd[5924]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:31.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:31 ntpd[5924]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:31.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:31 ntpd[5924]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:32.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:32 ntpd[5924]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:32.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:32 ntpd[5924]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:32.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:32 ntpd[5924]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:32.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:32 ntpd[5924]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:32.461 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:32 ntpd[5924]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-11-16T21:48:32.462 INFO:teuthology.orchestra.run.smithi016.stderr:16 Nov 21:48:32 ntpd[5924]: can't open /var/log/ntpstats/loopstats.20201116: Permission denied 2020-11-16T21:48:32.462 INFO:teuthology.orchestra.run.smithi016.stdout:16 Nov 21:48:32 ntpd[5924]: ntpd: time slew -0.007066 s 2020-11-16T21:48:32.462 INFO:teuthology.orchestra.run.smithi016.stdout:ntpd: time slew -0.007066s 2020-11-16T21:48:32.512 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2020-11-16T21:48:32.512 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2020-11-16T21:48:32.512 INFO:teuthology.orchestra.run.smithi016.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-16T21:48:32.513 INFO:teuthology.orchestra.run.smithi016.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-16T21:48:32.513 INFO:teuthology.orchestra.run.smithi016.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-16T21:48:32.513 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-16T21:48:32.513 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-16T21:48:32.514 INFO:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-16T21:48:32.560 INFO:teuthology.orchestra.run.smithi057.stdout:16 Nov 21:48:32 ntpd[5923]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-11-16T21:48:32.560 INFO:teuthology.orchestra.run.smithi057.stdout:16 Nov 21:48:32 ntpd[5923]: Command line: ntpd -gq 2020-11-16T21:48:32.561 INFO:teuthology.orchestra.run.smithi057.stdout:16 Nov 21:48:32 ntpd[5923]: proto: precision = 0.103 usec (-23) 2020-11-16T21:48:32.562 INFO:teuthology.orchestra.run.smithi057.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-11-16T21:48:32.562 INFO:teuthology.orchestra.run.smithi057.stderr:restrict ::: KOD does nothing without LIMITED. 2020-11-16T21:48:32.562 INFO:teuthology.orchestra.run.smithi057.stdout:16 Nov 21:48:32 ntpd[5923]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-11-16T21:48:32.562 INFO:teuthology.orchestra.run.smithi057.stdout:16 Nov 21:48:32 ntpd[5923]: restrict ::: KOD does nothing without LIMITED. 2020-11-16T21:48:32.562 INFO:teuthology.orchestra.run.smithi057.stdout:16 Nov 21:48:32 ntpd[5923]: Listen and drop on 0 v6wildcard [::]:123 2020-11-16T21:48:32.563 INFO:teuthology.orchestra.run.smithi057.stdout:16 Nov 21:48:32 ntpd[5923]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-11-16T21:48:32.563 INFO:teuthology.orchestra.run.smithi057.stdout:16 Nov 21:48:32 ntpd[5923]: Listen normally on 2 lo 127.0.0.1:123 2020-11-16T21:48:32.563 INFO:teuthology.orchestra.run.smithi057.stdout:16 Nov 21:48:32 ntpd[5923]: Listen normally on 3 ens1f0 172.21.15.57:123 2020-11-16T21:48:32.563 INFO:teuthology.orchestra.run.smithi057.stdout:16 Nov 21:48:32 ntpd[5923]: Listen normally on 4 lo [::1]:123 2020-11-16T21:48:32.563 INFO:teuthology.orchestra.run.smithi057.stdout:16 Nov 21:48:32 ntpd[5923]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1562%2]:123 2020-11-16T21:48:32.563 INFO:teuthology.orchestra.run.smithi057.stdout:16 Nov 21:48:32 ntpd[5923]: Listening on routing socket on fd #22 for interface updates 2020-11-16T21:48:33.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:33 ntpd[5923]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:33.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:33 ntpd[5923]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:33.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:33 ntpd[5923]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:33.562 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:33 ntpd[5923]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:34.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:34 ntpd[5923]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:34.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:34 ntpd[5923]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:34.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:34 ntpd[5923]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:34.562 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:34 ntpd[5923]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:35.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:35 ntpd[5923]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:35.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:35 ntpd[5923]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:35.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:35 ntpd[5923]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:35.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:35 ntpd[5923]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:36.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:36 ntpd[5923]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:36.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:36 ntpd[5923]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:36.562 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:36 ntpd[5923]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:36.562 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:36 ntpd[5923]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:36.562 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:36 ntpd[5923]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:36.562 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:36 ntpd[5923]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:36.562 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:36 ntpd[5923]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:36.562 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:36 ntpd[5923]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:37.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:37 ntpd[5923]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:37.562 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:37 ntpd[5923]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:37.562 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:37 ntpd[5923]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:37.563 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:37 ntpd[5923]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:37.563 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:37 ntpd[5923]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:37.563 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:37 ntpd[5923]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:37.563 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:37 ntpd[5923]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:37.564 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:37 ntpd[5923]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:38.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:38 ntpd[5923]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:38.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:38 ntpd[5923]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:38.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:38 ntpd[5923]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:38.562 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:38 ntpd[5923]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:38.562 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:38 ntpd[5923]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:38.562 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:38 ntpd[5923]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:38.562 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:38 ntpd[5923]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:38.562 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:38 ntpd[5923]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:39.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:39 ntpd[5923]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-16T21:48:39.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:39 ntpd[5923]: can't open /var/log/ntpstats/rawstats.20201116: Permission denied 2020-11-16T21:48:39.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:39 ntpd[5923]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-16T21:48:39.561 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:39 ntpd[5923]: can't open /var/log/ntpstats/peerstats.20201116: Permission denied 2020-11-16T21:48:39.562 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:39 ntpd[5923]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-11-16T21:48:39.562 INFO:teuthology.orchestra.run.smithi057.stderr:16 Nov 21:48:39 ntpd[5923]: can't open /var/log/ntpstats/loopstats.20201116: Permission denied 2020-11-16T21:48:39.562 INFO:teuthology.orchestra.run.smithi057.stdout:16 Nov 21:48:39 ntpd[5923]: ntpd: time slew -0.006598 s 2020-11-16T21:48:39.562 INFO:teuthology.orchestra.run.smithi057.stdout:ntpd: time slew -0.006598s 2020-11-16T21:48:39.620 INFO:teuthology.orchestra.run.smithi057.stdout: remote refid st t when poll reach delay offset jitter 2020-11-16T21:48:39.621 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================== 2020-11-16T21:48:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-16T21:48:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-16T21:48:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-16T21:48:39.621 INFO:teuthology.orchestra.run.smithi057.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-16T21:48:39.622 INFO:teuthology.run_tasks:Running task install... 2020-11-16T21:48:39.631 DEBUG:teuthology.task.install:project ceph 2020-11-16T21:48:39.632 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '911cc35794d871071a8bebfb0919482263b1d18b'}} 2020-11-16T21:48:39.632 DEBUG:teuthology.task.install:config {'branch': 'nautilus', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'sha1': '911cc35794d871071a8bebfb0919482263b1d18b'} 2020-11-16T21:48:39.632 INFO:teuthology.task.install:Using flavor: basic 2020-11-16T21:48:39.639 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-11-16T21:48:39.639 INFO:teuthology.task.install:extra packages: ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'] 2020-11-16T21:48:39.640 INFO:teuthology.orchestra.run.smithi195:> sudo lsb_release -is 2020-11-16T21:48:39.685 INFO:teuthology.orchestra.run.smithi195.stdout:Ubuntu 2020-11-16T21:48:39.690 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-16T21:48:39.690 INFO:teuthology.orchestra.run.smithi016:> sudo lsb_release -is 2020-11-16T21:48:39.691 INFO:teuthology.orchestra.run.smithi195:> sudo apt-key list | grep Ceph 2020-11-16T21:48:39.745 INFO:teuthology.orchestra.run.smithi016.stdout:Ubuntu 2020-11-16T21:48:39.751 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-16T21:48:39.751 INFO:teuthology.orchestra.run.smithi057:> sudo lsb_release -is 2020-11-16T21:48:39.752 INFO:teuthology.orchestra.run.smithi016:> sudo apt-key list | grep Ceph 2020-11-16T21:48:39.803 INFO:teuthology.orchestra.run.smithi057.stdout:Ubuntu 2020-11-16T21:48:39.808 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-16T21:48:39.808 INFO:teuthology.orchestra.run.smithi057:> sudo apt-key list | grep Ceph 2020-11-16T21:48:39.829 INFO:teuthology.orchestra.run.smithi195.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-11-16T21:48:39.845 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-11-16T21:48:39.886 INFO:teuthology.orchestra.run.smithi195.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-11-16T21:48:39.886 INFO:teuthology.orchestra.run.smithi195.stdout:uid [ unknown] Ceph.com (release key) 2020-11-16T21:48:39.887 INFO:teuthology.orchestra.run.smithi195:> sudo lsb_release -is 2020-11-16T21:48:39.901 INFO:teuthology.orchestra.run.smithi057.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-11-16T21:48:39.908 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-11-16T21:48:39.908 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph.com (release key) 2020-11-16T21:48:39.909 INFO:teuthology.orchestra.run.smithi016:> sudo lsb_release -is 2020-11-16T21:48:39.941 INFO:teuthology.orchestra.run.smithi195.stdout:Ubuntu 2020-11-16T21:48:39.946 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-16T21:48:39.946 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python-rados, python-rgw, python-rbd, python-cephfs on remote deb x86_64 2020-11-16T21:48:39.947 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-11-16T21:48:39.947 INFO:teuthology.packaging:ref: None 2020-11-16T21:48:39.947 INFO:teuthology.packaging:tag: None 2020-11-16T21:48:39.947 INFO:teuthology.packaging:branch: nautilus 2020-11-16T21:48:39.947 INFO:teuthology.packaging:sha1: 911cc35794d871071a8bebfb0919482263b1d18b 2020-11-16T21:48:39.948 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=nautilus 2020-11-16T21:48:39.959 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-11-16T21:48:39.959 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph.com (release key) 2020-11-16T21:48:39.960 INFO:teuthology.orchestra.run.smithi016.stdout:Ubuntu 2020-11-16T21:48:39.961 INFO:teuthology.orchestra.run.smithi057:> sudo lsb_release -is 2020-11-16T21:48:39.964 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-16T21:48:39.965 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python-rados, python-rgw, python-rbd, python-cephfs on remote deb x86_64 2020-11-16T21:48:39.965 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-11-16T21:48:39.965 INFO:teuthology.packaging:ref: None 2020-11-16T21:48:39.965 INFO:teuthology.packaging:tag: None 2020-11-16T21:48:39.966 INFO:teuthology.packaging:branch: nautilus 2020-11-16T21:48:39.966 INFO:teuthology.packaging:sha1: 911cc35794d871071a8bebfb0919482263b1d18b 2020-11-16T21:48:39.966 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=nautilus 2020-11-16T21:48:40.019 INFO:teuthology.orchestra.run.smithi057.stdout:Ubuntu 2020-11-16T21:48:40.025 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-16T21:48:40.025 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python-rados, python-rgw, python-rbd, python-cephfs on remote deb x86_64 2020-11-16T21:48:40.025 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-11-16T21:48:40.025 INFO:teuthology.packaging:ref: None 2020-11-16T21:48:40.026 INFO:teuthology.packaging:tag: None 2020-11-16T21:48:40.026 INFO:teuthology.packaging:branch: nautilus 2020-11-16T21:48:40.026 INFO:teuthology.packaging:sha1: 911cc35794d871071a8bebfb0919482263b1d18b 2020-11-16T21:48:40.026 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=nautilus 2020-11-16T21:48:40.254 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default/ 2020-11-16T21:48:40.255 INFO:teuthology.task.install.deb:Package version is 14.2.13-54-g53ad2a5c-1bionic 2020-11-16T21:48:40.335 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default/ 2020-11-16T21:48:40.336 INFO:teuthology.task.install.deb:Package version is 14.2.13-54-g53ad2a5c-1bionic 2020-11-16T21:48:40.353 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default/ 2020-11-16T21:48:40.354 INFO:teuthology.task.install.deb:Package version is 14.2.13-54-g53ad2a5c-1bionic 2020-11-16T21:48:40.387 INFO:teuthology.orchestra.run.smithi195:> set -ex 2020-11-16T21:48:40.387 INFO:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-11-16T21:48:40.392 INFO:teuthology.orchestra.run.smithi195.stderr:+ sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-11-16T21:48:40.401 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2020-11-16T21:48:40.401 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2020-11-16T21:48:40.402 INFO:teuthology.orchestra.run.smithi195.stderr:144 bytes copied, 6.8528e-05 s, 2.1 MB/s 2020-11-16T21:48:40.402 INFO:teuthology.orchestra.run.smithi195:> sudo apt-get update 2020-11-16T21:48:40.454 INFO:teuthology.orchestra.run.smithi057:> set -ex 2020-11-16T21:48:40.455 INFO:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-11-16T21:48:40.459 INFO:teuthology.orchestra.run.smithi057.stderr:+ sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-11-16T21:48:40.466 INFO:teuthology.orchestra.run.smithi016:> set -ex 2020-11-16T21:48:40.466 INFO:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-11-16T21:48:40.467 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records in 2020-11-16T21:48:40.468 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records out 2020-11-16T21:48:40.468 INFO:teuthology.orchestra.run.smithi057.stderr:144 bytes copied, 3.8927e-05 s, 3.7 MB/s 2020-11-16T21:48:40.469 INFO:teuthology.orchestra.run.smithi057:> sudo apt-get update 2020-11-16T21:48:40.471 INFO:teuthology.orchestra.run.smithi016.stderr:+ sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-11-16T21:48:40.481 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2020-11-16T21:48:40.481 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2020-11-16T21:48:40.481 INFO:teuthology.orchestra.run.smithi016.stderr:144 bytes copied, 6.9399e-05 s, 2.1 MB/s 2020-11-16T21:48:40.482 INFO:teuthology.orchestra.run.smithi016:> sudo apt-get update 2020-11-16T21:48:40.633 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-11-16T21:48:40.664 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-11-16T21:48:40.725 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-11-16T21:48:40.725 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-16T21:48:40.749 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-16T21:48:40.766 INFO:teuthology.orchestra.run.smithi195.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic InRelease 2020-11-16T21:48:40.766 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic InRelease 2020-11-16T21:48:40.776 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-16T21:48:40.793 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2020-11-16T21:48:40.793 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2020-11-16T21:48:40.796 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic InRelease 2020-11-16T21:48:40.798 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-11-16T21:48:40.818 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic Release.gpg 2020-11-16T21:48:40.818 INFO:teuthology.orchestra.run.smithi195.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic Release.gpg 2020-11-16T21:48:40.819 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2020-11-16T21:48:40.827 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:6 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-11-16T21:48:40.846 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,579 B] 2020-11-16T21:48:40.846 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,579 B] 2020-11-16T21:48:40.847 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic Release.gpg 2020-11-16T21:48:40.854 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:6 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-11-16T21:48:40.874 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.7 kB] 2020-11-16T21:48:40.878 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-11-16T21:48:40.894 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.7 kB] 2020-11-16T21:48:40.894 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.7 kB] 2020-11-16T21:48:40.905 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-11-16T21:48:40.913 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,579 B] 2020-11-16T21:48:40.932 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-11-16T21:48:41.212 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 25.9 kB in 1s (47.6 kB/s) 2020-11-16T21:48:41.265 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 25.9 kB in 1s (45.0 kB/s) 2020-11-16T21:48:41.351 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 25.9 kB in 1s (34.9 kB/s) 2020-11-16T21:48:42.531 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2020-11-16T21:48:42.579 INFO:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.13-54-g53ad2a5c-1bionic ceph-mds=14.2.13-54-g53ad2a5c-1bionic ceph-mgr=14.2.13-54-g53ad2a5c-1bionic ceph-common=14.2.13-54-g53ad2a5c-1bionic ceph-fuse=14.2.13-54-g53ad2a5c-1bionic ceph-test=14.2.13-54-g53ad2a5c-1bionic radosgw=14.2.13-54-g53ad2a5c-1bionic libcephfs2=14.2.13-54-g53ad2a5c-1bionic libcephfs-dev=14.2.13-54-g53ad2a5c-1bionic librados2=14.2.13-54-g53ad2a5c-1bionic librbd1=14.2.13-54-g53ad2a5c-1bionic rbd-fuse=14.2.13-54-g53ad2a5c-1bionic python-rados=14.2.13-54-g53ad2a5c-1bionic python-rgw=14.2.13-54-g53ad2a5c-1bionic python-rbd=14.2.13-54-g53ad2a5c-1bionic python-cephfs=14.2.13-54-g53ad2a5c-1bionic 2020-11-16T21:48:42.582 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2020-11-16T21:48:42.597 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2020-11-16T21:48:42.625 INFO:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.13-54-g53ad2a5c-1bionic ceph-mds=14.2.13-54-g53ad2a5c-1bionic ceph-mgr=14.2.13-54-g53ad2a5c-1bionic ceph-common=14.2.13-54-g53ad2a5c-1bionic ceph-fuse=14.2.13-54-g53ad2a5c-1bionic ceph-test=14.2.13-54-g53ad2a5c-1bionic radosgw=14.2.13-54-g53ad2a5c-1bionic libcephfs2=14.2.13-54-g53ad2a5c-1bionic libcephfs-dev=14.2.13-54-g53ad2a5c-1bionic librados2=14.2.13-54-g53ad2a5c-1bionic librbd1=14.2.13-54-g53ad2a5c-1bionic rbd-fuse=14.2.13-54-g53ad2a5c-1bionic python-rados=14.2.13-54-g53ad2a5c-1bionic python-rgw=14.2.13-54-g53ad2a5c-1bionic python-rbd=14.2.13-54-g53ad2a5c-1bionic python-cephfs=14.2.13-54-g53ad2a5c-1bionic 2020-11-16T21:48:42.644 INFO:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.13-54-g53ad2a5c-1bionic ceph-mds=14.2.13-54-g53ad2a5c-1bionic ceph-mgr=14.2.13-54-g53ad2a5c-1bionic ceph-common=14.2.13-54-g53ad2a5c-1bionic ceph-fuse=14.2.13-54-g53ad2a5c-1bionic ceph-test=14.2.13-54-g53ad2a5c-1bionic radosgw=14.2.13-54-g53ad2a5c-1bionic libcephfs2=14.2.13-54-g53ad2a5c-1bionic libcephfs-dev=14.2.13-54-g53ad2a5c-1bionic librados2=14.2.13-54-g53ad2a5c-1bionic librbd1=14.2.13-54-g53ad2a5c-1bionic rbd-fuse=14.2.13-54-g53ad2a5c-1bionic python-rados=14.2.13-54-g53ad2a5c-1bionic python-rgw=14.2.13-54-g53ad2a5c-1bionic python-rbd=14.2.13-54-g53ad2a5c-1bionic python-cephfs=14.2.13-54-g53ad2a5c-1bionic 2020-11-16T21:48:42.655 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2020-11-16T21:48:42.701 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2020-11-16T21:48:42.723 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2020-11-16T21:48:42.893 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2020-11-16T21:48:42.893 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2020-11-16T21:48:42.939 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2020-11-16T21:48:42.940 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2020-11-16T21:48:42.986 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2020-11-16T21:48:42.987 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2020-11-16T21:48:43.070 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2020-11-16T21:48:43.070 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-11-16T21:48:43.070 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh 2020-11-16T21:48:43.071 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc libjs-underscore 2020-11-16T21:48:43.071 INFO:teuthology.orchestra.run.smithi057.stdout: libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 2020-11-16T21:48:43.071 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr python-bcrypt 2020-11-16T21:48:43.072 INFO:teuthology.orchestra.run.smithi057.stdout: python-bs4 python-ceph-argparse python-certifi python-chardet 2020-11-16T21:48:43.072 INFO:teuthology.orchestra.run.smithi057.stdout: python-cherrypy3 python-decorator python-dnspython python-fasteners 2020-11-16T21:48:43.072 INFO:teuthology.orchestra.run.smithi057.stdout: python-formencode python-funcsigs python-html5lib python-httplib2 2020-11-16T21:48:43.072 INFO:teuthology.orchestra.run.smithi057.stdout: python-joblib python-jwt python-kubernetes python-logutils python-lxml 2020-11-16T21:48:43.072 INFO:teuthology.orchestra.run.smithi057.stdout: python-mako python-markupsafe python-monotonic python-oauth2client 2020-11-16T21:48:43.072 INFO:teuthology.orchestra.run.smithi057.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-11-16T21:48:43.072 INFO:teuthology.orchestra.run.smithi057.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-pluggy 2020-11-16T21:48:43.073 INFO:teuthology.orchestra.run.smithi057.stdout: python-prettytable python-py python-pyasn1 python-pyasn1-modules 2020-11-16T21:48:43.073 INFO:teuthology.orchestra.run.smithi057.stdout: python-pyinotify python-pytest python-repoze.lru python-requests 2020-11-16T21:48:43.073 INFO:teuthology.orchestra.run.smithi057.stdout: python-routes python-rsa python-scgi python-scipy python-simplegeneric 2020-11-16T21:48:43.073 INFO:teuthology.orchestra.run.smithi057.stdout: python-simplejson python-singledispatch python-sklearn python-sklearn-lib 2020-11-16T21:48:43.073 INFO:teuthology.orchestra.run.smithi057.stdout: python-sqlalchemy python-sqlalchemy-ext python-tempita python-uritemplate 2020-11-16T21:48:43.073 INFO:teuthology.orchestra.run.smithi057.stdout: python-urllib3 python-waitress python-webencodings python-webob 2020-11-16T21:48:43.073 INFO:teuthology.orchestra.run.smithi057.stdout: python-websocket python-webtest python-werkzeug python-yaml socat xmlstarlet 2020-11-16T21:48:43.074 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2020-11-16T21:48:43.074 INFO:teuthology.orchestra.run.smithi057.stdout: python-influxdb python-attr-doc python-egenix-mxdatetime python-funcsigs-doc 2020-11-16T21:48:43.074 INFO:teuthology.orchestra.run.smithi057.stdout: python-genshi python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2020-11-16T21:48:43.074 INFO:teuthology.orchestra.run.smithi057.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2020-11-16T21:48:43.074 INFO:teuthology.orchestra.run.smithi057.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2020-11-16T21:48:43.075 INFO:teuthology.orchestra.run.smithi057.stdout: python-cherrypy python-flup python-pecan-doc subversion python-pytest-xdist 2020-11-16T21:48:43.075 INFO:teuthology.orchestra.run.smithi057.stdout: python-pyinotify-doc python-mock python-socks python-scipy-doc python-dap 2020-11-16T21:48:43.075 INFO:teuthology.orchestra.run.smithi057.stdout: python-scikits-optimization python-sklearn-doc ipython python-sqlalchemy-doc 2020-11-16T21:48:43.075 INFO:teuthology.orchestra.run.smithi057.stdout: python-psycopg2 python-pymysql python-fdb python-pymssql python-ntlm 2020-11-16T21:48:43.075 INFO:teuthology.orchestra.run.smithi057.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-pyquery 2020-11-16T21:48:43.075 INFO:teuthology.orchestra.run.smithi057.stdout: python-redis python-pylibmc | python-memcache python-termcolor 2020-11-16T21:48:43.075 INFO:teuthology.orchestra.run.smithi057.stdout: python-watchdog python-werkzeug-doc 2020-11-16T21:48:43.103 INFO:teuthology.orchestra.run.smithi195.stdout:The following additional packages will be installed: 2020-11-16T21:48:43.103 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-11-16T21:48:43.104 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh 2020-11-16T21:48:43.105 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc libjs-underscore 2020-11-16T21:48:43.105 INFO:teuthology.orchestra.run.smithi195.stdout: libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 2020-11-16T21:48:43.105 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr python-bcrypt 2020-11-16T21:48:43.105 INFO:teuthology.orchestra.run.smithi195.stdout: python-bs4 python-ceph-argparse python-certifi python-chardet 2020-11-16T21:48:43.106 INFO:teuthology.orchestra.run.smithi195.stdout: python-cherrypy3 python-decorator python-dnspython python-fasteners 2020-11-16T21:48:43.106 INFO:teuthology.orchestra.run.smithi195.stdout: python-formencode python-funcsigs python-html5lib python-httplib2 2020-11-16T21:48:43.106 INFO:teuthology.orchestra.run.smithi195.stdout: python-joblib python-jwt python-kubernetes python-logutils python-lxml 2020-11-16T21:48:43.106 INFO:teuthology.orchestra.run.smithi195.stdout: python-mako python-markupsafe python-monotonic python-oauth2client 2020-11-16T21:48:43.106 INFO:teuthology.orchestra.run.smithi195.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-11-16T21:48:43.106 INFO:teuthology.orchestra.run.smithi195.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-pluggy 2020-11-16T21:48:43.106 INFO:teuthology.orchestra.run.smithi195.stdout: python-prettytable python-py python-pyasn1 python-pyasn1-modules 2020-11-16T21:48:43.107 INFO:teuthology.orchestra.run.smithi195.stdout: python-pyinotify python-pytest python-repoze.lru python-requests 2020-11-16T21:48:43.107 INFO:teuthology.orchestra.run.smithi195.stdout: python-routes python-rsa python-scgi python-scipy python-simplegeneric 2020-11-16T21:48:43.107 INFO:teuthology.orchestra.run.smithi195.stdout: python-simplejson python-singledispatch python-sklearn python-sklearn-lib 2020-11-16T21:48:43.107 INFO:teuthology.orchestra.run.smithi195.stdout: python-sqlalchemy python-sqlalchemy-ext python-tempita python-uritemplate 2020-11-16T21:48:43.107 INFO:teuthology.orchestra.run.smithi195.stdout: python-urllib3 python-waitress python-webencodings python-webob 2020-11-16T21:48:43.107 INFO:teuthology.orchestra.run.smithi195.stdout: python-websocket python-webtest python-werkzeug python-yaml socat xmlstarlet 2020-11-16T21:48:43.108 INFO:teuthology.orchestra.run.smithi195.stdout:Suggested packages: 2020-11-16T21:48:43.108 INFO:teuthology.orchestra.run.smithi195.stdout: python-influxdb python-attr-doc python-egenix-mxdatetime python-funcsigs-doc 2020-11-16T21:48:43.108 INFO:teuthology.orchestra.run.smithi195.stdout: python-genshi python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2020-11-16T21:48:43.108 INFO:teuthology.orchestra.run.smithi195.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2020-11-16T21:48:43.108 INFO:teuthology.orchestra.run.smithi195.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2020-11-16T21:48:43.109 INFO:teuthology.orchestra.run.smithi195.stdout: python-cherrypy python-flup python-pecan-doc subversion python-pytest-xdist 2020-11-16T21:48:43.109 INFO:teuthology.orchestra.run.smithi195.stdout: python-pyinotify-doc python-mock python-socks python-scipy-doc python-dap 2020-11-16T21:48:43.109 INFO:teuthology.orchestra.run.smithi195.stdout: python-scikits-optimization python-sklearn-doc ipython python-sqlalchemy-doc 2020-11-16T21:48:43.109 INFO:teuthology.orchestra.run.smithi195.stdout: python-psycopg2 python-pymysql python-fdb python-pymssql python-ntlm 2020-11-16T21:48:43.109 INFO:teuthology.orchestra.run.smithi195.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-pyquery 2020-11-16T21:48:43.109 INFO:teuthology.orchestra.run.smithi195.stdout: python-redis python-pylibmc | python-memcache python-termcolor 2020-11-16T21:48:43.109 INFO:teuthology.orchestra.run.smithi195.stdout: python-watchdog python-werkzeug-doc 2020-11-16T21:48:43.164 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2020-11-16T21:48:43.164 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-11-16T21:48:43.165 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh 2020-11-16T21:48:43.165 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc libjs-underscore 2020-11-16T21:48:43.166 INFO:teuthology.orchestra.run.smithi016.stdout: libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 2020-11-16T21:48:43.166 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr python-bcrypt 2020-11-16T21:48:43.166 INFO:teuthology.orchestra.run.smithi016.stdout: python-bs4 python-ceph-argparse python-certifi python-chardet 2020-11-16T21:48:43.166 INFO:teuthology.orchestra.run.smithi016.stdout: python-cherrypy3 python-decorator python-dnspython python-fasteners 2020-11-16T21:48:43.166 INFO:teuthology.orchestra.run.smithi016.stdout: python-formencode python-funcsigs python-html5lib python-httplib2 2020-11-16T21:48:43.166 INFO:teuthology.orchestra.run.smithi016.stdout: python-joblib python-jwt python-kubernetes python-logutils python-lxml 2020-11-16T21:48:43.166 INFO:teuthology.orchestra.run.smithi016.stdout: python-mako python-markupsafe python-monotonic python-oauth2client 2020-11-16T21:48:43.167 INFO:teuthology.orchestra.run.smithi016.stdout: python-openid python-openssl python-paste python-pastedeploy 2020-11-16T21:48:43.167 INFO:teuthology.orchestra.run.smithi016.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-pluggy 2020-11-16T21:48:43.167 INFO:teuthology.orchestra.run.smithi016.stdout: python-prettytable python-py python-pyasn1 python-pyasn1-modules 2020-11-16T21:48:43.167 INFO:teuthology.orchestra.run.smithi016.stdout: python-pyinotify python-pytest python-repoze.lru python-requests 2020-11-16T21:48:43.167 INFO:teuthology.orchestra.run.smithi016.stdout: python-routes python-rsa python-scgi python-scipy python-simplegeneric 2020-11-16T21:48:43.167 INFO:teuthology.orchestra.run.smithi016.stdout: python-simplejson python-singledispatch python-sklearn python-sklearn-lib 2020-11-16T21:48:43.167 INFO:teuthology.orchestra.run.smithi016.stdout: python-sqlalchemy python-sqlalchemy-ext python-tempita python-uritemplate 2020-11-16T21:48:43.168 INFO:teuthology.orchestra.run.smithi016.stdout: python-urllib3 python-waitress python-webencodings python-webob 2020-11-16T21:48:43.168 INFO:teuthology.orchestra.run.smithi016.stdout: python-websocket python-webtest python-werkzeug python-yaml socat xmlstarlet 2020-11-16T21:48:43.168 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2020-11-16T21:48:43.169 INFO:teuthology.orchestra.run.smithi057.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-dashboard 2020-11-16T21:48:43.169 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local 2020-11-16T21:48:43.169 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh ceph-mon ceph-osd ceph-test 2020-11-16T21:48:43.169 INFO:teuthology.orchestra.run.smithi057.stdout: formencode-i18n jq libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc 2020-11-16T21:48:43.169 INFO:teuthology.orchestra.run.smithi057.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2020-11-16T21:48:43.169 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2020-11-16T21:48:43.170 INFO:teuthology.orchestra.run.smithi016.stdout: python-influxdb python-attr-doc python-egenix-mxdatetime python-funcsigs-doc 2020-11-16T21:48:43.170 INFO:teuthology.orchestra.run.smithi016.stdout: python-genshi python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2020-11-16T21:48:43.170 INFO:teuthology.orchestra.run.smithi016.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2020-11-16T21:48:43.170 INFO:teuthology.orchestra.run.smithi016.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2020-11-16T21:48:43.170 INFO:teuthology.orchestra.run.smithi016.stdout: python-cherrypy python-flup python-pecan-doc subversion python-pytest-xdist 2020-11-16T21:48:43.170 INFO:teuthology.orchestra.run.smithi016.stdout: python-pyinotify-doc python-mock python-socks python-scipy-doc python-dap 2020-11-16T21:48:43.170 INFO:teuthology.orchestra.run.smithi016.stdout: python-scikits-optimization python-sklearn-doc ipython python-sqlalchemy-doc 2020-11-16T21:48:43.171 INFO:teuthology.orchestra.run.smithi016.stdout: python-psycopg2 python-pymysql python-fdb python-pymssql python-ntlm 2020-11-16T21:48:43.171 INFO:teuthology.orchestra.run.smithi016.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-pyquery 2020-11-16T21:48:43.171 INFO:teuthology.orchestra.run.smithi016.stdout: python-redis python-pylibmc | python-memcache python-termcolor 2020-11-16T21:48:43.171 INFO:teuthology.orchestra.run.smithi016.stdout: python-watchdog python-werkzeug-doc 2020-11-16T21:48:43.172 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr 2020-11-16T21:48:43.172 INFO:teuthology.orchestra.run.smithi057.stdout: python-bcrypt python-bs4 python-ceph-argparse python-cephfs python-certifi 2020-11-16T21:48:43.172 INFO:teuthology.orchestra.run.smithi057.stdout: python-chardet python-cherrypy3 python-decorator python-dnspython 2020-11-16T21:48:43.172 INFO:teuthology.orchestra.run.smithi057.stdout: python-fasteners python-formencode python-funcsigs python-html5lib 2020-11-16T21:48:43.172 INFO:teuthology.orchestra.run.smithi057.stdout: python-httplib2 python-joblib python-jwt python-kubernetes python-logutils 2020-11-16T21:48:43.173 INFO:teuthology.orchestra.run.smithi057.stdout: python-lxml python-mako python-markupsafe python-monotonic 2020-11-16T21:48:43.173 INFO:teuthology.orchestra.run.smithi057.stdout: python-oauth2client python-openid python-openssl python-paste 2020-11-16T21:48:43.173 INFO:teuthology.orchestra.run.smithi057.stdout: python-pastedeploy python-pastedeploy-tpl python-pastescript python-pecan 2020-11-16T21:48:43.173 INFO:teuthology.orchestra.run.smithi057.stdout: python-pluggy python-prettytable python-py python-pyasn1 2020-11-16T21:48:43.173 INFO:teuthology.orchestra.run.smithi057.stdout: python-pyasn1-modules python-pyinotify python-pytest python-rados python-rbd 2020-11-16T21:48:43.173 INFO:teuthology.orchestra.run.smithi057.stdout: python-repoze.lru python-requests python-rgw python-routes python-rsa 2020-11-16T21:48:43.173 INFO:teuthology.orchestra.run.smithi057.stdout: python-scgi python-scipy python-simplegeneric python-simplejson 2020-11-16T21:48:43.173 INFO:teuthology.orchestra.run.smithi057.stdout: python-singledispatch python-sklearn python-sklearn-lib python-sqlalchemy 2020-11-16T21:48:43.174 INFO:teuthology.orchestra.run.smithi057.stdout: python-sqlalchemy-ext python-tempita python-uritemplate python-urllib3 2020-11-16T21:48:43.174 INFO:teuthology.orchestra.run.smithi057.stdout: python-waitress python-webencodings python-webob python-websocket 2020-11-16T21:48:43.174 INFO:teuthology.orchestra.run.smithi057.stdout: python-webtest python-werkzeug python-yaml radosgw rbd-fuse socat xmlstarlet 2020-11-16T21:48:43.174 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2020-11-16T21:48:43.174 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 librbd1 2020-11-16T21:48:43.196 INFO:teuthology.orchestra.run.smithi195.stdout:The following NEW packages will be installed: 2020-11-16T21:48:43.196 INFO:teuthology.orchestra.run.smithi195.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-dashboard 2020-11-16T21:48:43.196 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local 2020-11-16T21:48:43.196 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh ceph-mon ceph-osd ceph-test 2020-11-16T21:48:43.198 INFO:teuthology.orchestra.run.smithi195.stdout: formencode-i18n jq libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc 2020-11-16T21:48:43.198 INFO:teuthology.orchestra.run.smithi195.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2020-11-16T21:48:43.198 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr 2020-11-16T21:48:43.198 INFO:teuthology.orchestra.run.smithi195.stdout: python-bcrypt python-bs4 python-ceph-argparse python-cephfs python-certifi 2020-11-16T21:48:43.198 INFO:teuthology.orchestra.run.smithi195.stdout: python-chardet python-cherrypy3 python-decorator python-dnspython 2020-11-16T21:48:43.198 INFO:teuthology.orchestra.run.smithi195.stdout: python-fasteners python-formencode python-funcsigs python-html5lib 2020-11-16T21:48:43.198 INFO:teuthology.orchestra.run.smithi195.stdout: python-httplib2 python-joblib python-jwt python-kubernetes python-logutils 2020-11-16T21:48:43.199 INFO:teuthology.orchestra.run.smithi195.stdout: python-lxml python-mako python-markupsafe python-monotonic 2020-11-16T21:48:43.199 INFO:teuthology.orchestra.run.smithi195.stdout: python-oauth2client python-openid python-openssl python-paste 2020-11-16T21:48:43.199 INFO:teuthology.orchestra.run.smithi195.stdout: python-pastedeploy python-pastedeploy-tpl python-pastescript python-pecan 2020-11-16T21:48:43.199 INFO:teuthology.orchestra.run.smithi195.stdout: python-pluggy python-prettytable python-py python-pyasn1 2020-11-16T21:48:43.199 INFO:teuthology.orchestra.run.smithi195.stdout: python-pyasn1-modules python-pyinotify python-pytest python-rados python-rbd 2020-11-16T21:48:43.199 INFO:teuthology.orchestra.run.smithi195.stdout: python-repoze.lru python-requests python-rgw python-routes python-rsa 2020-11-16T21:48:43.199 INFO:teuthology.orchestra.run.smithi195.stdout: python-scgi python-scipy python-simplegeneric python-simplejson 2020-11-16T21:48:43.200 INFO:teuthology.orchestra.run.smithi195.stdout: python-singledispatch python-sklearn python-sklearn-lib python-sqlalchemy 2020-11-16T21:48:43.200 INFO:teuthology.orchestra.run.smithi195.stdout: python-sqlalchemy-ext python-tempita python-uritemplate python-urllib3 2020-11-16T21:48:43.200 INFO:teuthology.orchestra.run.smithi195.stdout: python-waitress python-webencodings python-webob python-websocket 2020-11-16T21:48:43.200 INFO:teuthology.orchestra.run.smithi195.stdout: python-webtest python-werkzeug python-yaml radosgw rbd-fuse socat xmlstarlet 2020-11-16T21:48:43.200 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages will be upgraded: 2020-11-16T21:48:43.201 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 librbd1 2020-11-16T21:48:43.265 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2020-11-16T21:48:43.266 INFO:teuthology.orchestra.run.smithi016.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-dashboard 2020-11-16T21:48:43.266 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local 2020-11-16T21:48:43.266 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh ceph-mon ceph-osd ceph-test 2020-11-16T21:48:43.267 INFO:teuthology.orchestra.run.smithi016.stdout: formencode-i18n jq libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc 2020-11-16T21:48:43.267 INFO:teuthology.orchestra.run.smithi016.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2020-11-16T21:48:43.267 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr 2020-11-16T21:48:43.267 INFO:teuthology.orchestra.run.smithi016.stdout: python-bcrypt python-bs4 python-ceph-argparse python-cephfs python-certifi 2020-11-16T21:48:43.268 INFO:teuthology.orchestra.run.smithi016.stdout: python-chardet python-cherrypy3 python-decorator python-dnspython 2020-11-16T21:48:43.268 INFO:teuthology.orchestra.run.smithi016.stdout: python-fasteners python-formencode python-funcsigs python-html5lib 2020-11-16T21:48:43.268 INFO:teuthology.orchestra.run.smithi016.stdout: python-httplib2 python-joblib python-jwt python-kubernetes python-logutils 2020-11-16T21:48:43.268 INFO:teuthology.orchestra.run.smithi016.stdout: python-lxml python-mako python-markupsafe python-monotonic 2020-11-16T21:48:43.268 INFO:teuthology.orchestra.run.smithi016.stdout: python-oauth2client python-openid python-openssl python-paste 2020-11-16T21:48:43.268 INFO:teuthology.orchestra.run.smithi016.stdout: python-pastedeploy python-pastedeploy-tpl python-pastescript python-pecan 2020-11-16T21:48:43.268 INFO:teuthology.orchestra.run.smithi016.stdout: python-pluggy python-prettytable python-py python-pyasn1 2020-11-16T21:48:43.269 INFO:teuthology.orchestra.run.smithi016.stdout: python-pyasn1-modules python-pyinotify python-pytest python-rados python-rbd 2020-11-16T21:48:43.269 INFO:teuthology.orchestra.run.smithi016.stdout: python-repoze.lru python-requests python-rgw python-routes python-rsa 2020-11-16T21:48:43.269 INFO:teuthology.orchestra.run.smithi016.stdout: python-scgi python-scipy python-simplegeneric python-simplejson 2020-11-16T21:48:43.269 INFO:teuthology.orchestra.run.smithi016.stdout: python-singledispatch python-sklearn python-sklearn-lib python-sqlalchemy 2020-11-16T21:48:43.269 INFO:teuthology.orchestra.run.smithi016.stdout: python-sqlalchemy-ext python-tempita python-uritemplate python-urllib3 2020-11-16T21:48:43.269 INFO:teuthology.orchestra.run.smithi016.stdout: python-waitress python-webencodings python-webob python-websocket 2020-11-16T21:48:43.269 INFO:teuthology.orchestra.run.smithi016.stdout: python-webtest python-werkzeug python-yaml radosgw rbd-fuse socat xmlstarlet 2020-11-16T21:48:43.270 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages will be upgraded: 2020-11-16T21:48:43.270 INFO:teuthology.orchestra.run.smithi016.stdout: librados2 librbd1 2020-11-16T21:48:43.344 INFO:teuthology.orchestra.run.smithi057.stdout:2 upgraded, 100 newly installed, 0 to remove and 1 not upgraded. 2020-11-16T21:48:43.344 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 109 MB of archives. 2020-11-16T21:48:43.344 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 483 MB of additional disk space will be used. 2020-11-16T21:48:43.344 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 14.2.13-54-g53ad2a5c-1bionic [1,477 kB] 2020-11-16T21:48:43.357 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-uritemplate all 0.6-1ubuntu1 [5,042 B] 2020-11-16T21:48:43.373 INFO:teuthology.orchestra.run.smithi195.stdout:2 upgraded, 100 newly installed, 0 to remove and 1 not upgraded. 2020-11-16T21:48:43.373 INFO:teuthology.orchestra.run.smithi195.stdout:Need to get 109 MB of archives. 2020-11-16T21:48:43.373 INFO:teuthology.orchestra.run.smithi195.stdout:After this operation, 483 MB of additional disk space will be used. 2020-11-16T21:48:43.374 INFO:teuthology.orchestra.run.smithi195.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 14.2.13-54-g53ad2a5c-1bionic [1,477 kB] 2020-11-16T21:48:43.387 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-uritemplate all 0.6-1ubuntu1 [5,042 B] 2020-11-16T21:48:43.436 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-11-16T21:48:43.459 INFO:teuthology.orchestra.run.smithi016.stdout:2 upgraded, 100 newly installed, 0 to remove and 1 not upgraded. 2020-11-16T21:48:43.459 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 109 MB of archives. 2020-11-16T21:48:43.459 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 483 MB of additional disk space will be used. 2020-11-16T21:48:43.459 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-uritemplate all 0.6-1ubuntu1 [5,042 B] 2020-11-16T21:48:43.467 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-11-16T21:48:43.540 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-11-16T21:48:43.554 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 14.2.13-54-g53ad2a5c-1bionic [1,477 kB] 2020-11-16T21:48:43.556 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 14.2.13-54-g53ad2a5c-1bionic [3,013 kB] 2020-11-16T21:48:43.680 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2020-11-16T21:48:43.686 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-11-16T21:48:43.697 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 14.2.13-54-g53ad2a5c-1bionic [441 kB] 2020-11-16T21:48:43.702 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-11-16T21:48:43.709 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-11-16T21:48:43.714 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 14.2.13-54-g53ad2a5c-1bionic [289 kB] 2020-11-16T21:48:43.719 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2020-11-16T21:48:43.724 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse all 14.2.13-54-g53ad2a5c-1bionic [20.1 kB] 2020-11-16T21:48:43.724 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 14.2.13-54-g53ad2a5c-1bionic [123 kB] 2020-11-16T21:48:43.726 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-11-16T21:48:43.729 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 14.2.13-54-g53ad2a5c-1bionic [264 kB] 2020-11-16T21:48:43.738 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-11-16T21:48:43.740 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-11-16T21:48:43.758 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 14.2.13-54-g53ad2a5c-1bionic [4,291 kB] 2020-11-16T21:48:43.771 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-11-16T21:48:43.779 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2020-11-16T21:48:43.780 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2020-11-16T21:48:43.785 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2020-11-16T21:48:43.788 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-11-16T21:48:43.796 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-11-16T21:48:43.798 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-11-16T21:48:43.810 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-11-16T21:48:43.817 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2020-11-16T21:48:43.818 INFO:teuthology.orchestra.run.smithi195.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2020-11-16T21:48:43.833 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-jwt all 1.5.3+ds1-1 [15.8 kB] 2020-11-16T21:48:43.836 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2020-11-16T21:48:43.846 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2020-11-16T21:48:43.849 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2020-11-16T21:48:43.851 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2020-11-16T21:48:43.858 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2020-11-16T21:48:43.872 INFO:teuthology.orchestra.run.smithi195.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-jwt all 1.5.3+ds1-1 [15.8 kB] 2020-11-16T21:48:43.876 INFO:teuthology.orchestra.run.smithi195.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2020-11-16T21:48:43.880 INFO:teuthology.orchestra.run.smithi195.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 14.2.13-54-g53ad2a5c-1bionic [3,013 kB] 2020-11-16T21:48:43.882 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-11-16T21:48:43.890 INFO:teuthology.orchestra.run.smithi195.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2020-11-16T21:48:43.892 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2020-11-16T21:48:43.892 INFO:teuthology.orchestra.run.smithi195.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2020-11-16T21:48:43.895 INFO:teuthology.orchestra.run.smithi195.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2020-11-16T21:48:43.898 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2020-11-16T21:48:43.901 INFO:teuthology.orchestra.run.smithi195.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2020-11-16T21:48:43.914 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2020-11-16T21:48:43.915 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2020-11-16T21:48:43.921 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-11-16T21:48:43.927 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2020-11-16T21:48:43.944 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-jwt all 1.5.3+ds1-1 [15.8 kB] 2020-11-16T21:48:43.947 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2020-11-16T21:48:43.955 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2020-11-16T21:48:43.958 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2020-11-16T21:48:43.960 INFO:teuthology.orchestra.run.smithi195.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2020-11-16T21:48:43.961 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2020-11-16T21:48:43.962 INFO:teuthology.orchestra.run.smithi195.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2020-11-16T21:48:43.966 INFO:teuthology.orchestra.run.smithi195.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-11-16T21:48:43.971 INFO:teuthology.orchestra.run.smithi195.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2020-11-16T21:48:43.972 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2020-11-16T21:48:43.976 INFO:teuthology.orchestra.run.smithi195.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2020-11-16T21:48:43.981 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 14.2.13-54-g53ad2a5c-1bionic [3,013 kB] 2020-11-16T21:48:43.993 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2020-11-16T21:48:43.996 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2020-11-16T21:48:44.001 INFO:teuthology.orchestra.run.smithi057.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2020-11-16T21:48:44.002 INFO:teuthology.orchestra.run.smithi057.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2020-11-16T21:48:44.003 INFO:teuthology.orchestra.run.smithi057.stdout:Get:32 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 14.2.13-54-g53ad2a5c-1bionic [99.0 kB] 2020-11-16T21:48:44.006 INFO:teuthology.orchestra.run.smithi057.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2020-11-16T21:48:44.006 INFO:teuthology.orchestra.run.smithi057.stdout:Get:34 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 14.2.13-54-g53ad2a5c-1bionic [327 kB] 2020-11-16T21:48:44.007 INFO:teuthology.orchestra.run.smithi057.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-11-16T21:48:44.027 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2020-11-16T21:48:44.027 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2020-11-16T21:48:44.032 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-11-16T21:48:44.038 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2020-11-16T21:48:44.039 INFO:teuthology.orchestra.run.smithi057.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 14.2.13-54-g53ad2a5c-1bionic [15.4 MB] 2020-11-16T21:48:44.040 INFO:teuthology.orchestra.run.smithi195.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2020-11-16T21:48:44.047 INFO:teuthology.orchestra.run.smithi195.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2020-11-16T21:48:44.047 INFO:teuthology.orchestra.run.smithi195.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2020-11-16T21:48:44.052 INFO:teuthology.orchestra.run.smithi195.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2020-11-16T21:48:44.053 INFO:teuthology.orchestra.run.smithi195.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-11-16T21:48:44.071 INFO:teuthology.orchestra.run.smithi057.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-11-16T21:48:44.071 INFO:teuthology.orchestra.run.smithi057.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2020-11-16T21:48:44.073 INFO:teuthology.orchestra.run.smithi057.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2020-11-16T21:48:44.075 INFO:teuthology.orchestra.run.smithi057.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2020-11-16T21:48:44.107 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2020-11-16T21:48:44.110 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2020-11-16T21:48:44.117 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2020-11-16T21:48:44.118 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2020-11-16T21:48:44.119 INFO:teuthology.orchestra.run.smithi195.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-11-16T21:48:44.120 INFO:teuthology.orchestra.run.smithi195.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2020-11-16T21:48:44.122 INFO:teuthology.orchestra.run.smithi195.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2020-11-16T21:48:44.124 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2020-11-16T21:48:44.124 INFO:teuthology.orchestra.run.smithi195.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2020-11-16T21:48:44.124 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-11-16T21:48:44.132 INFO:teuthology.orchestra.run.smithi195.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2020-11-16T21:48:44.149 INFO:teuthology.orchestra.run.smithi057.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2020-11-16T21:48:44.156 INFO:teuthology.orchestra.run.smithi057.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2020-11-16T21:48:44.159 INFO:teuthology.orchestra.run.smithi057.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.2 [86.0 kB] 2020-11-16T21:48:44.161 INFO:teuthology.orchestra.run.smithi057.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2020-11-16T21:48:44.163 INFO:teuthology.orchestra.run.smithi057.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-11-16T21:48:44.170 INFO:teuthology.orchestra.run.smithi057.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2020-11-16T21:48:44.186 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-11-16T21:48:44.186 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2020-11-16T21:48:44.188 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2020-11-16T21:48:44.189 INFO:teuthology.orchestra.run.smithi195.stdout:Get:33 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 14.2.13-54-g53ad2a5c-1bionic [441 kB] 2020-11-16T21:48:44.190 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2020-11-16T21:48:44.199 INFO:teuthology.orchestra.run.smithi195.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2020-11-16T21:48:44.202 INFO:teuthology.orchestra.run.smithi195.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.2 [86.0 kB] 2020-11-16T21:48:44.206 INFO:teuthology.orchestra.run.smithi195.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2020-11-16T21:48:44.209 INFO:teuthology.orchestra.run.smithi195.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-11-16T21:48:44.216 INFO:teuthology.orchestra.run.smithi195.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2020-11-16T21:48:44.227 INFO:teuthology.orchestra.run.smithi057.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2020-11-16T21:48:44.229 INFO:teuthology.orchestra.run.smithi057.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2020-11-16T21:48:44.231 INFO:teuthology.orchestra.run.smithi057.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2020-11-16T21:48:44.234 INFO:teuthology.orchestra.run.smithi057.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-decorator all 4.1.2-1 [9,300 B] 2020-11-16T21:48:44.242 INFO:teuthology.orchestra.run.smithi195.stdout:Get:39 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 14.2.13-54-g53ad2a5c-1bionic [289 kB] 2020-11-16T21:48:44.252 INFO:teuthology.orchestra.run.smithi195.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse all 14.2.13-54-g53ad2a5c-1bionic [20.1 kB] 2020-11-16T21:48:44.253 INFO:teuthology.orchestra.run.smithi195.stdout:Get:41 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 14.2.13-54-g53ad2a5c-1bionic [123 kB] 2020-11-16T21:48:44.257 INFO:teuthology.orchestra.run.smithi195.stdout:Get:42 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 14.2.13-54-g53ad2a5c-1bionic [264 kB] 2020-11-16T21:48:44.265 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2020-11-16T21:48:44.271 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2020-11-16T21:48:44.274 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.2 [86.0 kB] 2020-11-16T21:48:44.277 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2020-11-16T21:48:44.278 INFO:teuthology.orchestra.run.smithi195.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2020-11-16T21:48:44.279 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-11-16T21:48:44.280 INFO:teuthology.orchestra.run.smithi195.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2020-11-16T21:48:44.284 INFO:teuthology.orchestra.run.smithi195.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2020-11-16T21:48:44.286 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2020-11-16T21:48:44.288 INFO:teuthology.orchestra.run.smithi195.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-decorator all 4.1.2-1 [9,300 B] 2020-11-16T21:48:44.288 INFO:teuthology.orchestra.run.smithi195.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-scipy amd64 0.19.1-2ubuntu1 [9,689 kB] 2020-11-16T21:48:44.305 INFO:teuthology.orchestra.run.smithi057.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-scipy amd64 0.19.1-2ubuntu1 [9,689 kB] 2020-11-16T21:48:44.309 INFO:teuthology.orchestra.run.smithi195.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 14.2.13-54-g53ad2a5c-1bionic [4,291 kB] 2020-11-16T21:48:44.345 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2020-11-16T21:48:44.347 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2020-11-16T21:48:44.350 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2020-11-16T21:48:44.354 INFO:teuthology.orchestra.run.smithi016.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-decorator all 4.1.2-1 [9,300 B] 2020-11-16T21:48:44.425 INFO:teuthology.orchestra.run.smithi016.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-scipy amd64 0.19.1-2ubuntu1 [9,689 kB] 2020-11-16T21:48:44.596 INFO:teuthology.orchestra.run.smithi195.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn-lib amd64 0.19.1-3 [1,521 kB] 2020-11-16T21:48:44.610 INFO:teuthology.orchestra.run.smithi057.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn-lib amd64 0.19.1-3 [1,521 kB] 2020-11-16T21:48:44.628 INFO:teuthology.orchestra.run.smithi195.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-joblib all 0.11-1 [112 kB] 2020-11-16T21:48:44.629 INFO:teuthology.orchestra.run.smithi195.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn all 0.19.1-3 [1,373 kB] 2020-11-16T21:48:44.641 INFO:teuthology.orchestra.run.smithi057.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-joblib all 0.11-1 [112 kB] 2020-11-16T21:48:44.644 INFO:teuthology.orchestra.run.smithi057.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn all 0.19.1-3 [1,373 kB] 2020-11-16T21:48:44.675 INFO:teuthology.orchestra.run.smithi195.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-monotonic all 1.1-2 [5,262 B] 2020-11-16T21:48:44.675 INFO:teuthology.orchestra.run.smithi195.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-fasteners all 0.12.0-3 [13.4 kB] 2020-11-16T21:48:44.675 INFO:teuthology.orchestra.run.smithi195.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [34.8 kB] 2020-11-16T21:48:44.676 INFO:teuthology.orchestra.run.smithi195.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1 all 0.4.2-3 [46.7 kB] 2020-11-16T21:48:44.677 INFO:teuthology.orchestra.run.smithi195.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1-modules all 0.2.1-0.2 [32.8 kB] 2020-11-16T21:48:44.678 INFO:teuthology.orchestra.run.smithi195.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-rsa all 3.4.2-1 [28.9 kB] 2020-11-16T21:48:44.678 INFO:teuthology.orchestra.run.smithi195.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy all 1.1.11+ds1-1ubuntu1 [682 kB] 2020-11-16T21:48:44.686 INFO:teuthology.orchestra.run.smithi057.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-monotonic all 1.1-2 [5,262 B] 2020-11-16T21:48:44.687 INFO:teuthology.orchestra.run.smithi057.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-fasteners all 0.12.0-3 [13.4 kB] 2020-11-16T21:48:44.687 INFO:teuthology.orchestra.run.smithi057.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [34.8 kB] 2020-11-16T21:48:44.688 INFO:teuthology.orchestra.run.smithi057.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1 all 0.4.2-3 [46.7 kB] 2020-11-16T21:48:44.689 INFO:teuthology.orchestra.run.smithi057.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1-modules all 0.2.1-0.2 [32.8 kB] 2020-11-16T21:48:44.690 INFO:teuthology.orchestra.run.smithi057.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-rsa all 3.4.2-1 [28.9 kB] 2020-11-16T21:48:44.690 INFO:teuthology.orchestra.run.smithi057.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy all 1.1.11+ds1-1ubuntu1 [682 kB] 2020-11-16T21:48:44.739 INFO:teuthology.orchestra.run.smithi016.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn-lib amd64 0.19.1-3 [1,521 kB] 2020-11-16T21:48:44.756 INFO:teuthology.orchestra.run.smithi195.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-oauth2client all 4.1.2-3 [61.4 kB] 2020-11-16T21:48:44.758 INFO:teuthology.orchestra.run.smithi195.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-11-16T21:48:44.759 INFO:teuthology.orchestra.run.smithi195.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-yaml amd64 3.12-1build2 [115 kB] 2020-11-16T21:48:44.763 INFO:teuthology.orchestra.run.smithi195.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-11-16T21:48:44.767 INFO:teuthology.orchestra.run.smithi057.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-oauth2client all 4.1.2-3 [61.4 kB] 2020-11-16T21:48:44.767 INFO:teuthology.orchestra.run.smithi195.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-11-16T21:48:44.768 INFO:teuthology.orchestra.run.smithi057.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-11-16T21:48:44.769 INFO:teuthology.orchestra.run.smithi057.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-yaml amd64 3.12-1build2 [115 kB] 2020-11-16T21:48:44.772 INFO:teuthology.orchestra.run.smithi057.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-11-16T21:48:44.775 INFO:teuthology.orchestra.run.smithi016.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-joblib all 0.11-1 [112 kB] 2020-11-16T21:48:44.775 INFO:teuthology.orchestra.run.smithi057.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-11-16T21:48:44.778 INFO:teuthology.orchestra.run.smithi016.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn all 0.19.1-3 [1,373 kB] 2020-11-16T21:48:44.796 INFO:teuthology.orchestra.run.smithi016.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-monotonic all 1.1-2 [5,262 B] 2020-11-16T21:48:44.797 INFO:teuthology.orchestra.run.smithi016.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-fasteners all 0.12.0-3 [13.4 kB] 2020-11-16T21:48:44.797 INFO:teuthology.orchestra.run.smithi016.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [34.8 kB] 2020-11-16T21:48:44.816 INFO:teuthology.orchestra.run.smithi016.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1 all 0.4.2-3 [46.7 kB] 2020-11-16T21:48:44.819 INFO:teuthology.orchestra.run.smithi016.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1-modules all 0.2.1-0.2 [32.8 kB] 2020-11-16T21:48:44.820 INFO:teuthology.orchestra.run.smithi016.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-rsa all 3.4.2-1 [28.9 kB] 2020-11-16T21:48:44.821 INFO:teuthology.orchestra.run.smithi016.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy all 1.1.11+ds1-1ubuntu1 [682 kB] 2020-11-16T21:48:44.836 INFO:teuthology.orchestra.run.smithi195.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-11-16T21:48:44.840 INFO:teuthology.orchestra.run.smithi195.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-11-16T21:48:44.841 INFO:teuthology.orchestra.run.smithi195.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-11-16T21:48:44.845 INFO:teuthology.orchestra.run.smithi057.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-11-16T21:48:44.849 INFO:teuthology.orchestra.run.smithi057.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-11-16T21:48:44.850 INFO:teuthology.orchestra.run.smithi195.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-11-16T21:48:44.850 INFO:teuthology.orchestra.run.smithi057.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-11-16T21:48:44.852 INFO:teuthology.orchestra.run.smithi195.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-11-16T21:48:44.858 INFO:teuthology.orchestra.run.smithi057.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-11-16T21:48:44.860 INFO:teuthology.orchestra.run.smithi057.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-11-16T21:48:44.901 INFO:teuthology.orchestra.run.smithi016.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-oauth2client all 4.1.2-3 [61.4 kB] 2020-11-16T21:48:44.903 INFO:teuthology.orchestra.run.smithi016.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-11-16T21:48:44.904 INFO:teuthology.orchestra.run.smithi016.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-yaml amd64 3.12-1build2 [115 kB] 2020-11-16T21:48:44.908 INFO:teuthology.orchestra.run.smithi016.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-11-16T21:48:44.913 INFO:teuthology.orchestra.run.smithi016.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-11-16T21:48:44.915 INFO:teuthology.orchestra.run.smithi016.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-11-16T21:48:44.916 INFO:teuthology.orchestra.run.smithi195.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1 [183 kB] 2020-11-16T21:48:44.916 INFO:teuthology.orchestra.run.smithi016.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-11-16T21:48:44.917 INFO:teuthology.orchestra.run.smithi016.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-11-16T21:48:44.923 INFO:teuthology.orchestra.run.smithi195.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-11-16T21:48:44.923 INFO:teuthology.orchestra.run.smithi057.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1 [183 kB] 2020-11-16T21:48:44.924 INFO:teuthology.orchestra.run.smithi195.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-11-16T21:48:44.924 INFO:teuthology.orchestra.run.smithi195.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2020-11-16T21:48:44.925 INFO:teuthology.orchestra.run.smithi195.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2020-11-16T21:48:44.930 INFO:teuthology.orchestra.run.smithi057.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-11-16T21:48:44.931 INFO:teuthology.orchestra.run.smithi057.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-11-16T21:48:44.933 INFO:teuthology.orchestra.run.smithi057.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2020-11-16T21:48:44.933 INFO:teuthology.orchestra.run.smithi057.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2020-11-16T21:48:44.950 INFO:teuthology.orchestra.run.smithi057.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 14.2.13-54-g53ad2a5c-1bionic [4,074 kB] 2020-11-16T21:48:44.980 INFO:teuthology.orchestra.run.smithi016.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-11-16T21:48:44.986 INFO:teuthology.orchestra.run.smithi016.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-11-16T21:48:44.995 INFO:teuthology.orchestra.run.smithi195.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.1 [1,075 kB] 2020-11-16T21:48:45.001 INFO:teuthology.orchestra.run.smithi057.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.1 [1,075 kB] 2020-11-16T21:48:45.018 INFO:teuthology.orchestra.run.smithi195.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2020-11-16T21:48:45.019 INFO:teuthology.orchestra.run.smithi195.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2020-11-16T21:48:45.020 INFO:teuthology.orchestra.run.smithi195.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-11-16T21:48:45.020 INFO:teuthology.orchestra.run.smithi195.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-11-16T21:48:45.022 INFO:teuthology.orchestra.run.smithi057.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2020-11-16T21:48:45.023 INFO:teuthology.orchestra.run.smithi057.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2020-11-16T21:48:45.023 INFO:teuthology.orchestra.run.smithi057.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-11-16T21:48:45.024 INFO:teuthology.orchestra.run.smithi057.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-11-16T21:48:45.060 INFO:teuthology.orchestra.run.smithi016.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1 [183 kB] 2020-11-16T21:48:45.067 INFO:teuthology.orchestra.run.smithi016.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-11-16T21:48:45.068 INFO:teuthology.orchestra.run.smithi016.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-11-16T21:48:45.069 INFO:teuthology.orchestra.run.smithi016.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2020-11-16T21:48:45.070 INFO:teuthology.orchestra.run.smithi016.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2020-11-16T21:48:45.072 INFO:teuthology.orchestra.run.smithi016.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.1 [1,075 kB] 2020-11-16T21:48:45.075 INFO:teuthology.orchestra.run.smithi195.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2020-11-16T21:48:45.076 INFO:teuthology.orchestra.run.smithi195.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-11-16T21:48:45.079 INFO:teuthology.orchestra.run.smithi057.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2020-11-16T21:48:45.080 INFO:teuthology.orchestra.run.smithi195.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2020-11-16T21:48:45.080 INFO:teuthology.orchestra.run.smithi057.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-11-16T21:48:45.081 INFO:teuthology.orchestra.run.smithi195.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy-ext amd64 1.1.11+ds1-1ubuntu1 [13.4 kB] 2020-11-16T21:48:45.083 INFO:teuthology.orchestra.run.smithi057.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 14.2.13-54-g53ad2a5c-1bionic [1,389 kB] 2020-11-16T21:48:45.083 INFO:teuthology.orchestra.run.smithi057.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2020-11-16T21:48:45.084 INFO:teuthology.orchestra.run.smithi057.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy-ext amd64 1.1.11+ds1-1ubuntu1 [13.4 kB] 2020-11-16T21:48:45.085 INFO:teuthology.orchestra.run.smithi016.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2020-11-16T21:48:45.086 INFO:teuthology.orchestra.run.smithi016.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2020-11-16T21:48:45.140 INFO:teuthology.orchestra.run.smithi016.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-11-16T21:48:45.140 INFO:teuthology.orchestra.run.smithi016.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-11-16T21:48:45.190 INFO:teuthology.orchestra.run.smithi057.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 14.2.13-54-g53ad2a5c-1bionic [3,223 kB] 2020-11-16T21:48:45.219 INFO:teuthology.orchestra.run.smithi016.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2020-11-16T21:48:45.220 INFO:teuthology.orchestra.run.smithi016.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-11-16T21:48:45.224 INFO:teuthology.orchestra.run.smithi016.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2020-11-16T21:48:45.225 INFO:teuthology.orchestra.run.smithi016.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy-ext amd64 1.1.11+ds1-1ubuntu1 [13.4 kB] 2020-11-16T21:48:45.295 INFO:teuthology.orchestra.run.smithi057.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 14.2.13-54-g53ad2a5c-1bionic [17.3 MB] 2020-11-16T21:48:45.918 INFO:teuthology.orchestra.run.smithi195.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 14.2.13-54-g53ad2a5c-1bionic [99.0 kB] 2020-11-16T21:48:45.922 INFO:teuthology.orchestra.run.smithi195.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 14.2.13-54-g53ad2a5c-1bionic [327 kB] 2020-11-16T21:48:45.935 INFO:teuthology.orchestra.run.smithi057.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 14.2.13-54-g53ad2a5c-1bionic [3,944 B] 2020-11-16T21:48:45.935 INFO:teuthology.orchestra.run.smithi057.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 14.2.13-54-g53ad2a5c-1bionic [528 kB] 2020-11-16T21:48:45.955 INFO:teuthology.orchestra.run.smithi057.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 14.2.13-54-g53ad2a5c-1bionic [1,802 kB] 2020-11-16T21:48:45.996 INFO:teuthology.orchestra.run.smithi195.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 14.2.13-54-g53ad2a5c-1bionic [15.4 MB] 2020-11-16T21:48:46.021 INFO:teuthology.orchestra.run.smithi057.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 14.2.13-54-g53ad2a5c-1bionic [3,457 kB] 2020-11-16T21:48:46.119 INFO:teuthology.orchestra.run.smithi016.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 14.2.13-54-g53ad2a5c-1bionic [441 kB] 2020-11-16T21:48:46.234 INFO:teuthology.orchestra.run.smithi016.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 14.2.13-54-g53ad2a5c-1bionic [289 kB] 2020-11-16T21:48:46.479 INFO:teuthology.orchestra.run.smithi057.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 14.2.13-54-g53ad2a5c-1bionic [34.5 kB] 2020-11-16T21:48:46.479 INFO:teuthology.orchestra.run.smithi057.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 14.2.13-54-g53ad2a5c-1bionic [1,094 kB] 2020-11-16T21:48:46.515 INFO:teuthology.orchestra.run.smithi057.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 14.2.13-54-g53ad2a5c-1bionic [4,056 B] 2020-11-16T21:48:46.515 INFO:teuthology.orchestra.run.smithi057.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 14.2.13-54-g53ad2a5c-1bionic [12.5 kB] 2020-11-16T21:48:46.515 INFO:teuthology.orchestra.run.smithi057.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-ssh all 14.2.13-54-g53ad2a5c-1bionic [12.9 kB] 2020-11-16T21:48:46.516 INFO:teuthology.orchestra.run.smithi057.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 14.2.13-54-g53ad2a5c-1bionic [26.0 MB] 2020-11-16T21:48:47.095 INFO:teuthology.orchestra.run.smithi016.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse all 14.2.13-54-g53ad2a5c-1bionic [20.1 kB] 2020-11-16T21:48:47.162 INFO:teuthology.orchestra.run.smithi016.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 14.2.13-54-g53ad2a5c-1bionic [123 kB] 2020-11-16T21:48:47.290 INFO:teuthology.orchestra.run.smithi016.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 14.2.13-54-g53ad2a5c-1bionic [264 kB] 2020-11-16T21:48:47.458 INFO:teuthology.orchestra.run.smithi057.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 14.2.13-54-g53ad2a5c-1bionic [17.9 kB] 2020-11-16T21:48:47.458 INFO:teuthology.orchestra.run.smithi057.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 14.2.13-54-g53ad2a5c-1bionic [4,890 kB] 2020-11-16T21:48:47.509 INFO:teuthology.orchestra.run.smithi016.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 14.2.13-54-g53ad2a5c-1bionic [4,291 kB] 2020-11-16T21:48:51.014 INFO:teuthology.orchestra.run.smithi057.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 14.2.13-54-g53ad2a5c-1bionic [62.7 kB] 2020-11-16T21:48:51.793 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 109 MB in 8s (13.9 MB/s) 2020-11-16T21:48:51.912 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-uritemplate. 2020-11-16T21:48:51.956 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137607 files and directories currently installed.) 2020-11-16T21:48:51.959 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../000-python-uritemplate_0.6-1ubuntu1_all.deb ... 2020-11-16T21:48:52.003 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-uritemplate (0.6-1ubuntu1) ... 2020-11-16T21:48:52.330 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-11-16T21:48:52.344 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../001-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-11-16T21:48:52.469 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-11-16T21:48:52.814 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../002-librbd1_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:48:52.968 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librbd1 (14.2.13-54-g53ad2a5c-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-11-16T21:48:53.248 INFO:teuthology.orchestra.run.smithi195.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 14.2.13-54-g53ad2a5c-1bionic [4,074 kB] 2020-11-16T21:48:53.393 INFO:teuthology.orchestra.run.smithi016.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 14.2.13-54-g53ad2a5c-1bionic [99.0 kB] 2020-11-16T21:48:53.434 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../003-librados2_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:48:53.441 INFO:teuthology.orchestra.run.smithi016.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 14.2.13-54-g53ad2a5c-1bionic [327 kB] 2020-11-16T21:48:53.555 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librados2 (14.2.13-54-g53ad2a5c-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-11-16T21:48:53.641 INFO:teuthology.orchestra.run.smithi016.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 14.2.13-54-g53ad2a5c-1bionic [15.4 MB] 2020-11-16T21:48:53.979 INFO:teuthology.orchestra.run.smithi195.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 14.2.13-54-g53ad2a5c-1bionic [1,389 kB] 2020-11-16T21:48:54.234 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs2. 2020-11-16T21:48:54.247 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../004-libcephfs2_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:48:54.284 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs2 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:48:54.286 INFO:teuthology.orchestra.run.smithi195.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 14.2.13-54-g53ad2a5c-1bionic [3,223 kB] 2020-11-16T21:48:54.586 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-rados. 2020-11-16T21:48:54.600 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../005-python-rados_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:48:54.644 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-rados (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:48:54.724 INFO:teuthology.orchestra.run.smithi195.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 14.2.13-54-g53ad2a5c-1bionic [17.3 MB] 2020-11-16T21:48:54.930 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-ceph-argparse. 2020-11-16T21:48:54.946 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../006-python-ceph-argparse_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:48:54.979 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-ceph-argparse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:48:55.290 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-cephfs. 2020-11-16T21:48:55.304 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../007-python-cephfs_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:48:55.340 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-cephfs (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:48:55.668 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-prettytable. 2020-11-16T21:48:55.682 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../008-python-prettytable_0.7.2-3_all.deb ... 2020-11-16T21:48:55.740 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-prettytable (0.7.2-3) ... 2020-11-16T21:48:55.996 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-rbd. 2020-11-16T21:48:56.009 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../009-python-rbd_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:48:56.054 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-rbd (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:48:56.407 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-11-16T21:48:56.422 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../010-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-11-16T21:48:56.456 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-11-16T21:48:56.818 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librgw2. 2020-11-16T21:48:56.834 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../011-librgw2_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:48:56.876 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librgw2 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:48:57.182 INFO:teuthology.orchestra.run.smithi195.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 14.2.13-54-g53ad2a5c-1bionic [3,944 B] 2020-11-16T21:48:57.185 INFO:teuthology.orchestra.run.smithi195.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 14.2.13-54-g53ad2a5c-1bionic [528 kB] 2020-11-16T21:48:57.258 INFO:teuthology.orchestra.run.smithi195.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 14.2.13-54-g53ad2a5c-1bionic [1,802 kB] 2020-11-16T21:48:57.512 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-rgw. 2020-11-16T21:48:57.523 INFO:teuthology.orchestra.run.smithi195.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 14.2.13-54-g53ad2a5c-1bionic [3,457 kB] 2020-11-16T21:48:57.525 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../012-python-rgw_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:48:57.562 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-rgw (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:48:57.872 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-11-16T21:48:57.889 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../013-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-11-16T21:48:57.922 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-11-16T21:48:58.047 INFO:teuthology.orchestra.run.smithi195.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 14.2.13-54-g53ad2a5c-1bionic [34.5 kB] 2020-11-16T21:48:58.049 INFO:teuthology.orchestra.run.smithi195.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 14.2.13-54-g53ad2a5c-1bionic [1,094 kB] 2020-11-16T21:48:58.195 INFO:teuthology.orchestra.run.smithi195.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 14.2.13-54-g53ad2a5c-1bionic [4,056 B] 2020-11-16T21:48:58.195 INFO:teuthology.orchestra.run.smithi195.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 14.2.13-54-g53ad2a5c-1bionic [12.5 kB] 2020-11-16T21:48:58.196 INFO:teuthology.orchestra.run.smithi195.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-ssh all 14.2.13-54-g53ad2a5c-1bionic [12.9 kB] 2020-11-16T21:48:58.197 INFO:teuthology.orchestra.run.smithi195.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 14.2.13-54-g53ad2a5c-1bionic [26.0 MB] 2020-11-16T21:48:58.242 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-11-16T21:48:58.256 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../014-libleveldb1v5_1.20-2_amd64.deb ... 2020-11-16T21:48:58.300 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-11-16T21:48:58.728 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liboath0. 2020-11-16T21:48:58.742 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../015-liboath0_2.6.1-1_amd64.deb ... 2020-11-16T21:48:58.778 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-11-16T21:48:59.106 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libradosstriper1. 2020-11-16T21:48:59.120 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../016-libradosstriper1_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:48:59.156 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libradosstriper1 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:48:59.576 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-common. 2020-11-16T21:48:59.589 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../017-ceph-common_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:48:59.634 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-common (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:48:59.975 INFO:teuthology.orchestra.run.smithi016.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 14.2.13-54-g53ad2a5c-1bionic [4,074 kB] 2020-11-16T21:49:00.440 INFO:teuthology.orchestra.run.smithi016.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 14.2.13-54-g53ad2a5c-1bionic [1,389 kB] 2020-11-16T21:49:00.585 INFO:teuthology.orchestra.run.smithi016.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 14.2.13-54-g53ad2a5c-1bionic [3,223 kB] 2020-11-16T21:49:00.634 INFO:teuthology.orchestra.run.smithi195.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 14.2.13-54-g53ad2a5c-1bionic [17.9 kB] 2020-11-16T21:49:00.634 INFO:teuthology.orchestra.run.smithi195.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 14.2.13-54-g53ad2a5c-1bionic [4,890 kB] 2020-11-16T21:49:00.878 INFO:teuthology.orchestra.run.smithi195.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 14.2.13-54-g53ad2a5c-1bionic [62.7 kB] 2020-11-16T21:49:00.908 INFO:teuthology.orchestra.run.smithi016.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 14.2.13-54-g53ad2a5c-1bionic [17.3 MB] 2020-11-16T21:49:01.281 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-base. 2020-11-16T21:49:01.294 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../018-ceph-base_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:01.365 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-base (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:01.576 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 109 MB in 18s (6,187 kB/s) 2020-11-16T21:49:01.701 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-uritemplate. 2020-11-16T21:49:01.754 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137607 files and directories currently installed.) 2020-11-16T21:49:01.758 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../000-python-uritemplate_0.6-1ubuntu1_all.deb ... 2020-11-16T21:49:01.800 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-uritemplate (0.6-1ubuntu1) ... 2020-11-16T21:49:02.103 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-11-16T21:49:02.117 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../001-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-11-16T21:49:02.212 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-11-16T21:49:02.269 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-bcrypt. 2020-11-16T21:49:02.282 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../019-python-bcrypt_3.1.4-2_amd64.deb ... 2020-11-16T21:49:02.318 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2020-11-16T21:49:02.441 INFO:teuthology.orchestra.run.smithi016.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 14.2.13-54-g53ad2a5c-1bionic [3,944 B] 2020-11-16T21:49:02.442 INFO:teuthology.orchestra.run.smithi016.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 14.2.13-54-g53ad2a5c-1bionic [528 kB] 2020-11-16T21:49:02.482 INFO:teuthology.orchestra.run.smithi016.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 14.2.13-54-g53ad2a5c-1bionic [1,802 kB] 2020-11-16T21:49:02.562 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../002-librbd1_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:02.621 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-cherrypy3. 2020-11-16T21:49:02.634 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../020-python-cherrypy3_8.9.1-2_all.deb ... 2020-11-16T21:49:02.636 INFO:teuthology.orchestra.run.smithi016.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 14.2.13-54-g53ad2a5c-1bionic [3,457 kB] 2020-11-16T21:49:02.671 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2020-11-16T21:49:02.690 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librbd1 (14.2.13-54-g53ad2a5c-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-11-16T21:49:02.904 INFO:teuthology.orchestra.run.smithi016.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 14.2.13-54-g53ad2a5c-1bionic [34.5 kB] 2020-11-16T21:49:02.909 INFO:teuthology.orchestra.run.smithi016.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 14.2.13-54-g53ad2a5c-1bionic [1,094 kB] 2020-11-16T21:49:02.986 INFO:teuthology.orchestra.run.smithi016.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 14.2.13-54-g53ad2a5c-1bionic [4,056 B] 2020-11-16T21:49:02.986 INFO:teuthology.orchestra.run.smithi016.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 14.2.13-54-g53ad2a5c-1bionic [12.5 kB] 2020-11-16T21:49:02.987 INFO:teuthology.orchestra.run.smithi016.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-ssh all 14.2.13-54-g53ad2a5c-1bionic [12.9 kB] 2020-11-16T21:49:02.988 INFO:teuthology.orchestra.run.smithi016.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 14.2.13-54-g53ad2a5c-1bionic [26.0 MB] 2020-11-16T21:49:03.057 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-jwt. 2020-11-16T21:49:03.071 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../021-python-jwt_1.5.3+ds1-1_all.deb ... 2020-11-16T21:49:03.108 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-jwt (1.5.3+ds1-1) ... 2020-11-16T21:49:03.166 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../003-librados2_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:03.291 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librados2 (14.2.13-54-g53ad2a5c-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-11-16T21:49:03.427 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-openssl. 2020-11-16T21:49:03.443 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../022-python-openssl_17.5.0-1ubuntu1_all.deb ... 2020-11-16T21:49:03.486 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2020-11-16T21:49:03.822 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-logutils. 2020-11-16T21:49:03.838 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../023-python-logutils_0.3.3-5_all.deb ... 2020-11-16T21:49:03.880 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-logutils (0.3.3-5) ... 2020-11-16T21:49:03.931 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libcephfs2. 2020-11-16T21:49:03.945 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../004-libcephfs2_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:03.990 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libcephfs2 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:04.241 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-markupsafe. 2020-11-16T21:49:04.249 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../024-python-markupsafe_1.0-1build1_amd64.deb ... 2020-11-16T21:49:04.291 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2020-11-16T21:49:04.292 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-rados. 2020-11-16T21:49:04.305 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../005-python-rados_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:04.342 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-rados (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:04.603 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-ceph-argparse. 2020-11-16T21:49:04.617 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../006-python-ceph-argparse_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:04.654 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-ceph-argparse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:04.815 INFO:teuthology.orchestra.run.smithi016.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 14.2.13-54-g53ad2a5c-1bionic [17.9 kB] 2020-11-16T21:49:04.816 INFO:teuthology.orchestra.run.smithi016.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 14.2.13-54-g53ad2a5c-1bionic [4,890 kB] 2020-11-16T21:49:04.852 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-mako. 2020-11-16T21:49:04.866 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../025-python-mako_1.0.7+ds1-1_all.deb ... 2020-11-16T21:49:04.902 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2020-11-16T21:49:04.939 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-cephfs. 2020-11-16T21:49:04.955 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../007-python-cephfs_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:04.997 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-cephfs (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:05.118 INFO:teuthology.orchestra.run.smithi016.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/nautilus/53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 14.2.13-54-g53ad2a5c-1bionic [62.7 kB] 2020-11-16T21:49:05.263 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-simplegeneric. 2020-11-16T21:49:05.277 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../026-python-simplegeneric_0.8.1-1_all.deb ... 2020-11-16T21:49:05.321 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2020-11-16T21:49:05.325 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-prettytable. 2020-11-16T21:49:05.340 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../008-python-prettytable_0.7.2-3_all.deb ... 2020-11-16T21:49:05.384 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-prettytable (0.7.2-3) ... 2020-11-16T21:49:05.599 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-singledispatch. 2020-11-16T21:49:05.613 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../027-python-singledispatch_3.4.0.3-2_all.deb ... 2020-11-16T21:49:05.619 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-rbd. 2020-11-16T21:49:05.635 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../009-python-rbd_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:05.649 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2020-11-16T21:49:05.669 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-rbd (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:05.836 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 109 MB in 22s (5,006 kB/s) 2020-11-16T21:49:05.935 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-simplejson. 2020-11-16T21:49:05.950 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../028-python-simplejson_3.13.2-1_amd64.deb ... 2020-11-16T21:49:05.962 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-uritemplate. 2020-11-16T21:49:06.005 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-11-16T21:49:06.015 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137607 files and directories currently installed.) 2020-11-16T21:49:06.018 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-simplejson (3.13.2-1) ... 2020-11-16T21:49:06.019 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../010-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-11-16T21:49:06.019 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../000-python-uritemplate_0.6-1ubuntu1_all.deb ... 2020-11-16T21:49:06.056 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-11-16T21:49:06.061 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-uritemplate (0.6-1ubuntu1) ... 2020-11-16T21:49:06.363 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-webob. 2020-11-16T21:49:06.377 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../029-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-11-16T21:49:06.389 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-11-16T21:49:06.392 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librgw2. 2020-11-16T21:49:06.404 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../001-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-11-16T21:49:06.405 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../011-librgw2_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:06.421 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2020-11-16T21:49:06.450 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librgw2 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:06.489 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-11-16T21:49:06.757 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-bs4. 2020-11-16T21:49:06.770 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../030-python-bs4_4.6.0-1_all.deb ... 2020-11-16T21:49:06.807 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-bs4 (4.6.0-1) ... 2020-11-16T21:49:06.815 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../002-librbd1_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:06.918 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librbd1 (14.2.13-54-g53ad2a5c-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-11-16T21:49:07.077 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-rgw. 2020-11-16T21:49:07.092 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../012-python-rgw_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:07.127 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-rgw (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:07.168 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-waitress. 2020-11-16T21:49:07.182 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../031-python-waitress_1.0.1-1_all.deb ... 2020-11-16T21:49:07.226 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-waitress (1.0.1-1) ... 2020-11-16T21:49:07.422 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../003-librados2_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:07.449 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-11-16T21:49:07.464 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../013-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-11-16T21:49:07.507 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-11-16T21:49:07.547 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librados2 (14.2.13-54-g53ad2a5c-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-11-16T21:49:07.579 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-dnspython. 2020-11-16T21:49:07.593 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../032-python-dnspython_1.15.0-1_all.deb ... 2020-11-16T21:49:07.637 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-dnspython (1.15.0-1) ... 2020-11-16T21:49:07.802 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-11-16T21:49:07.816 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../014-libleveldb1v5_1.20-2_amd64.deb ... 2020-11-16T21:49:07.860 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-11-16T21:49:07.932 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package formencode-i18n. 2020-11-16T21:49:07.947 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../033-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2020-11-16T21:49:07.982 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2020-11-16T21:49:08.143 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs2. 2020-11-16T21:49:08.156 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../004-libcephfs2_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:08.163 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liboath0. 2020-11-16T21:49:08.179 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../015-liboath0_2.6.1-1_amd64.deb ... 2020-11-16T21:49:08.193 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs2 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:08.213 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-11-16T21:49:08.293 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-formencode. 2020-11-16T21:49:08.306 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../034-python-formencode_1.3.0-0ubuntu5_all.deb ... 2020-11-16T21:49:08.343 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2020-11-16T21:49:08.495 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-rados. 2020-11-16T21:49:08.509 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../005-python-rados_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:08.553 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-rados (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:08.682 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libradosstriper1. 2020-11-16T21:49:08.695 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-tempita. 2020-11-16T21:49:08.697 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../016-libradosstriper1_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:08.711 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../035-python-tempita_0.5.2-2_all.deb ... 2020-11-16T21:49:08.741 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libradosstriper1 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:08.754 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-tempita (0.5.2-2) ... 2020-11-16T21:49:08.864 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-ceph-argparse. 2020-11-16T21:49:08.877 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../006-python-ceph-argparse_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:08.914 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-ceph-argparse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:09.090 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-paste. 2020-11-16T21:49:09.106 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../036-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-11-16T21:49:09.148 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-11-16T21:49:09.152 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-common. 2020-11-16T21:49:09.167 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../017-ceph-common_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:09.192 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-cephfs. 2020-11-16T21:49:09.207 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../007-python-cephfs_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:09.210 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-common (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:09.242 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-cephfs (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:09.501 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-11-16T21:49:09.503 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-prettytable. 2020-11-16T21:49:09.514 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../037-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-11-16T21:49:09.518 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../008-python-prettytable_0.7.2-3_all.deb ... 2020-11-16T21:49:09.553 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-prettytable (0.7.2-3) ... 2020-11-16T21:49:09.560 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-11-16T21:49:09.806 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-rbd. 2020-11-16T21:49:09.821 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../009-python-rbd_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:09.862 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-pastedeploy. 2020-11-16T21:49:09.864 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-rbd (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:09.878 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../038-python-pastedeploy_1.5.2-4_all.deb ... 2020-11-16T21:49:09.920 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2020-11-16T21:49:10.215 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-webtest. 2020-11-16T21:49:10.231 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../039-python-webtest_2.0.28-1ubuntu1_all.deb ... 2020-11-16T21:49:10.233 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-11-16T21:49:10.248 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../010-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-11-16T21:49:10.292 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-11-16T21:49:10.298 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2020-11-16T21:49:10.603 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librgw2. 2020-11-16T21:49:10.609 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-pecan. 2020-11-16T21:49:10.617 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../011-librgw2_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:10.625 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../040-python-pecan_1.2.1-2_all.deb ... 2020-11-16T21:49:10.653 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librgw2 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:10.662 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-pecan (1.2.1-2) ... 2020-11-16T21:49:10.774 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-base. 2020-11-16T21:49:10.789 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../018-ceph-base_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:10.842 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-base (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:10.972 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-certifi. 2020-11-16T21:49:10.987 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../041-python-certifi_2018.1.18-2_all.deb ... 2020-11-16T21:49:11.022 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-certifi (2018.1.18-2) ... 2020-11-16T21:49:11.281 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-rgw. 2020-11-16T21:49:11.295 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../012-python-rgw_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:11.339 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-rgw (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:11.358 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-chardet. 2020-11-16T21:49:11.373 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../042-python-chardet_3.0.4-1_all.deb ... 2020-11-16T21:49:11.417 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-chardet (3.0.4-1) ... 2020-11-16T21:49:11.654 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-bcrypt. 2020-11-16T21:49:11.658 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-11-16T21:49:11.670 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../019-python-bcrypt_3.1.4-2_amd64.deb ... 2020-11-16T21:49:11.672 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../013-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-11-16T21:49:11.712 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2020-11-16T21:49:11.717 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-11-16T21:49:11.770 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-urllib3. 2020-11-16T21:49:11.785 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../043-python-urllib3_1.22-1ubuntu0.18.04.2_all.deb ... 2020-11-16T21:49:11.828 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2020-11-16T21:49:11.986 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-11-16T21:49:12.000 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../014-libleveldb1v5_1.20-2_amd64.deb ... 2020-11-16T21:49:12.023 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-cherrypy3. 2020-11-16T21:49:12.036 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-11-16T21:49:12.037 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../020-python-cherrypy3_8.9.1-2_all.deb ... 2020-11-16T21:49:12.082 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2020-11-16T21:49:12.198 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-requests. 2020-11-16T21:49:12.213 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../044-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2020-11-16T21:49:12.256 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2020-11-16T21:49:12.397 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liboath0. 2020-11-16T21:49:12.412 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../015-liboath0_2.6.1-1_amd64.deb ... 2020-11-16T21:49:12.443 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-jwt. 2020-11-16T21:49:12.457 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../021-python-jwt_1.5.3+ds1-1_all.deb ... 2020-11-16T21:49:12.472 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-11-16T21:49:12.493 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-jwt (1.5.3+ds1-1) ... 2020-11-16T21:49:12.559 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-werkzeug. 2020-11-16T21:49:12.575 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../045-python-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-11-16T21:49:12.634 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1) ... 2020-11-16T21:49:12.808 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libradosstriper1. 2020-11-16T21:49:12.821 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-openssl. 2020-11-16T21:49:12.825 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../016-libradosstriper1_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:12.836 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../022-python-openssl_17.5.0-1ubuntu1_all.deb ... 2020-11-16T21:49:12.867 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libradosstriper1 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:12.880 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2020-11-16T21:49:13.029 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr. 2020-11-16T21:49:13.042 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../046-ceph-mgr_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:13.095 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:13.199 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-logutils. 2020-11-16T21:49:13.215 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../023-python-logutils_0.3.3-5_all.deb ... 2020-11-16T21:49:13.245 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-common. 2020-11-16T21:49:13.258 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-logutils (0.3.3-5) ... 2020-11-16T21:49:13.261 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../017-ceph-common_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:13.295 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-common (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:13.599 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mon. 2020-11-16T21:49:13.614 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../047-ceph-mon_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:13.658 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mon (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:14.403 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-osd. 2020-11-16T21:49:14.416 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../048-ceph-osd_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:14.461 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-osd (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:14.486 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-markupsafe. 2020-11-16T21:49:14.501 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../024-python-markupsafe_1.0-1build1_amd64.deb ... 2020-11-16T21:49:14.536 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2020-11-16T21:49:14.822 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-mako. 2020-11-16T21:49:14.838 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../025-python-mako_1.0.7+ds1-1_all.deb ... 2020-11-16T21:49:14.880 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2020-11-16T21:49:14.901 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-base. 2020-11-16T21:49:14.915 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../018-ceph-base_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:14.968 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-base (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:15.225 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-simplegeneric. 2020-11-16T21:49:15.240 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../026-python-simplegeneric_0.8.1-1_all.deb ... 2020-11-16T21:49:15.283 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2020-11-16T21:49:15.595 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-singledispatch. 2020-11-16T21:49:15.609 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../027-python-singledispatch_3.4.0.3-2_all.deb ... 2020-11-16T21:49:15.653 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2020-11-16T21:49:15.722 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-bcrypt. 2020-11-16T21:49:15.735 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../019-python-bcrypt_3.1.4-2_amd64.deb ... 2020-11-16T21:49:15.764 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2020-11-16T21:49:15.948 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-simplejson. 2020-11-16T21:49:15.962 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../028-python-simplejson_3.13.2-1_amd64.deb ... 2020-11-16T21:49:15.974 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph. 2020-11-16T21:49:15.988 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../049-ceph_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:16.006 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-simplejson (3.13.2-1) ... 2020-11-16T21:49:16.076 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:16.325 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-webob. 2020-11-16T21:49:16.340 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../029-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-11-16T21:49:16.384 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2020-11-16T21:49:16.410 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-fuse. 2020-11-16T21:49:16.424 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../050-ceph-fuse_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:16.468 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-fuse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:16.695 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-bs4. 2020-11-16T21:49:16.709 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../030-python-bs4_4.6.0-1_all.deb ... 2020-11-16T21:49:16.753 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-bs4 (4.6.0-1) ... 2020-11-16T21:49:16.817 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-cherrypy3. 2020-11-16T21:49:16.831 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../020-python-cherrypy3_8.9.1-2_all.deb ... 2020-11-16T21:49:16.854 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mds. 2020-11-16T21:49:16.871 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../051-ceph-mds_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:16.875 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2020-11-16T21:49:16.912 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mds (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:17.081 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-waitress. 2020-11-16T21:49:17.096 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../031-python-waitress_1.0.1-1_all.deb ... 2020-11-16T21:49:17.148 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-waitress (1.0.1-1) ... 2020-11-16T21:49:17.237 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-jwt. 2020-11-16T21:49:17.251 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../021-python-jwt_1.5.3+ds1-1_all.deb ... 2020-11-16T21:49:17.295 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-jwt (1.5.3+ds1-1) ... 2020-11-16T21:49:17.374 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-repoze.lru. 2020-11-16T21:49:17.390 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../052-python-repoze.lru_0.7-1_all.deb ... 2020-11-16T21:49:17.449 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-repoze.lru (0.7-1) ... 2020-11-16T21:49:17.467 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-dnspython. 2020-11-16T21:49:17.483 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../032-python-dnspython_1.15.0-1_all.deb ... 2020-11-16T21:49:17.526 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-dnspython (1.15.0-1) ... 2020-11-16T21:49:17.581 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-openssl. 2020-11-16T21:49:17.596 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../022-python-openssl_17.5.0-1ubuntu1_all.deb ... 2020-11-16T21:49:17.631 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2020-11-16T21:49:17.710 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjs-underscore. 2020-11-16T21:49:17.724 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../053-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2020-11-16T21:49:17.768 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2020-11-16T21:49:17.828 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package formencode-i18n. 2020-11-16T21:49:17.842 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../033-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2020-11-16T21:49:17.870 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2020-11-16T21:49:17.993 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-logutils. 2020-11-16T21:49:18.007 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../023-python-logutils_0.3.3-5_all.deb ... 2020-11-16T21:49:18.051 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-logutils (0.3.3-5) ... 2020-11-16T21:49:18.095 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjs-sphinxdoc. 2020-11-16T21:49:18.110 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../054-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2020-11-16T21:49:18.140 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-formencode. 2020-11-16T21:49:18.154 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-11-16T21:49:18.156 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../034-python-formencode_1.3.0-0ubuntu5_all.deb ... 2020-11-16T21:49:18.198 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2020-11-16T21:49:18.429 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-markupsafe. 2020-11-16T21:49:18.442 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../024-python-markupsafe_1.0-1build1_amd64.deb ... 2020-11-16T21:49:18.479 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2020-11-16T21:49:18.490 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-routes. 2020-11-16T21:49:18.505 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../055-python-routes_2.4.1-1_all.deb ... 2020-11-16T21:49:18.556 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-routes (2.4.1-1) ... 2020-11-16T21:49:18.559 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-tempita. 2020-11-16T21:49:18.575 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../035-python-tempita_0.5.2-2_all.deb ... 2020-11-16T21:49:18.626 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-tempita (0.5.2-2) ... 2020-11-16T21:49:18.773 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-mako. 2020-11-16T21:49:18.789 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../025-python-mako_1.0.7+ds1-1_all.deb ... 2020-11-16T21:49:18.823 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2020-11-16T21:49:18.926 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-11-16T21:49:18.937 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-paste. 2020-11-16T21:49:18.941 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:18.952 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../036-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-11-16T21:49:18.984 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-dashboard (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:18.995 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-11-16T21:49:19.193 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-simplegeneric. 2020-11-16T21:49:19.209 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../026-python-simplegeneric_0.8.1-1_all.deb ... 2020-11-16T21:49:19.251 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2020-11-16T21:49:19.332 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-11-16T21:49:19.347 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../037-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-11-16T21:49:19.399 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-11-16T21:49:19.554 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-singledispatch. 2020-11-16T21:49:19.568 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../027-python-singledispatch_3.4.0.3-2_all.deb ... 2020-11-16T21:49:19.612 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2020-11-16T21:49:19.702 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-pastedeploy. 2020-11-16T21:49:19.717 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../038-python-pastedeploy_1.5.2-4_all.deb ... 2020-11-16T21:49:19.760 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2020-11-16T21:49:19.874 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-simplejson. 2020-11-16T21:49:19.890 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../028-python-simplejson_3.13.2-1_amd64.deb ... 2020-11-16T21:49:19.923 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-simplejson (3.13.2-1) ... 2020-11-16T21:49:19.924 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-11-16T21:49:19.938 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../057-ceph-mgr-diskprediction-cloud_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:19.982 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-diskprediction-cloud (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:20.071 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-webtest. 2020-11-16T21:49:20.085 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../039-python-webtest_2.0.28-1ubuntu1_all.deb ... 2020-11-16T21:49:20.129 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2020-11-16T21:49:20.218 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-webob. 2020-11-16T21:49:20.232 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../029-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-11-16T21:49:20.268 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2020-11-16T21:49:20.318 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-decorator. 2020-11-16T21:49:20.333 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../058-python-decorator_4.1.2-1_all.deb ... 2020-11-16T21:49:20.377 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-decorator (4.1.2-1) ... 2020-11-16T21:49:20.525 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-pecan. 2020-11-16T21:49:20.541 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../040-python-pecan_1.2.1-2_all.deb ... 2020-11-16T21:49:20.585 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-pecan (1.2.1-2) ... 2020-11-16T21:49:20.604 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-bs4. 2020-11-16T21:49:20.619 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../030-python-bs4_4.6.0-1_all.deb ... 2020-11-16T21:49:20.662 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-bs4 (4.6.0-1) ... 2020-11-16T21:49:20.721 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-scipy. 2020-11-16T21:49:20.738 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../059-python-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-11-16T21:49:20.779 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-scipy (0.19.1-2ubuntu1) ... 2020-11-16T21:49:20.938 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-certifi. 2020-11-16T21:49:20.953 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../041-python-certifi_2018.1.18-2_all.deb ... 2020-11-16T21:49:20.982 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-waitress. 2020-11-16T21:49:20.996 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-certifi (2018.1.18-2) ... 2020-11-16T21:49:20.998 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../031-python-waitress_1.0.1-1_all.deb ... 2020-11-16T21:49:21.040 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-waitress (1.0.1-1) ... 2020-11-16T21:49:21.316 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-chardet. 2020-11-16T21:49:21.331 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../042-python-chardet_3.0.4-1_all.deb ... 2020-11-16T21:49:21.374 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-chardet (3.0.4-1) ... 2020-11-16T21:49:21.377 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-dnspython. 2020-11-16T21:49:21.391 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../032-python-dnspython_1.15.0-1_all.deb ... 2020-11-16T21:49:21.435 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-dnspython (1.15.0-1) ... 2020-11-16T21:49:21.702 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-urllib3. 2020-11-16T21:49:21.717 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../043-python-urllib3_1.22-1ubuntu0.18.04.2_all.deb ... 2020-11-16T21:49:21.738 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package formencode-i18n. 2020-11-16T21:49:21.752 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../033-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2020-11-16T21:49:21.760 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2020-11-16T21:49:21.797 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2020-11-16T21:49:22.099 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-formencode. 2020-11-16T21:49:22.105 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-sklearn-lib. 2020-11-16T21:49:22.113 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../034-python-formencode_1.3.0-0ubuntu5_all.deb ... 2020-11-16T21:49:22.113 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-requests. 2020-11-16T21:49:22.121 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../060-python-sklearn-lib_0.19.1-3_amd64.deb ... 2020-11-16T21:49:22.128 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../044-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2020-11-16T21:49:22.149 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2020-11-16T21:49:22.163 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-sklearn-lib (0.19.1-3) ... 2020-11-16T21:49:22.172 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2020-11-16T21:49:22.483 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-werkzeug. 2020-11-16T21:49:22.497 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../045-python-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-11-16T21:49:22.502 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-tempita. 2020-11-16T21:49:22.516 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../035-python-tempita_0.5.2-2_all.deb ... 2020-11-16T21:49:22.541 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1) ... 2020-11-16T21:49:22.561 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-tempita (0.5.2-2) ... 2020-11-16T21:49:22.666 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-joblib. 2020-11-16T21:49:22.683 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../061-python-joblib_0.11-1_all.deb ... 2020-11-16T21:49:22.733 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-joblib (0.11-1) ... 2020-11-16T21:49:22.872 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-paste. 2020-11-16T21:49:22.887 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../036-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-11-16T21:49:22.894 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr. 2020-11-16T21:49:22.910 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../046-ceph-mgr_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:22.930 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-11-16T21:49:22.953 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:23.086 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-sklearn. 2020-11-16T21:49:23.100 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../062-python-sklearn_0.19.1-3_all.deb ... 2020-11-16T21:49:23.169 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-sklearn (0.19.1-3) ... 2020-11-16T21:49:23.242 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-11-16T21:49:23.255 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../037-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-11-16T21:49:23.292 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-11-16T21:49:23.441 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mon. 2020-11-16T21:49:23.455 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../047-ceph-mon_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:23.499 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mon (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:23.594 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pastedeploy. 2020-11-16T21:49:23.608 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../038-python-pastedeploy_1.5.2-4_all.deb ... 2020-11-16T21:49:23.653 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2020-11-16T21:49:23.767 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-11-16T21:49:23.781 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-local_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:23.825 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-diskprediction-local (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:23.956 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-webtest. 2020-11-16T21:49:23.972 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../039-python-webtest_2.0.28-1ubuntu1_all.deb ... 2020-11-16T21:49:24.014 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2020-11-16T21:49:24.211 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-osd. 2020-11-16T21:49:24.225 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../048-ceph-osd_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:24.269 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-osd (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:24.384 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pecan. 2020-11-16T21:49:24.400 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../040-python-pecan_1.2.1-2_all.deb ... 2020-11-16T21:49:24.445 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pecan (1.2.1-2) ... 2020-11-16T21:49:24.553 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-monotonic. 2020-11-16T21:49:24.569 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../064-python-monotonic_1.1-2_all.deb ... 2020-11-16T21:49:24.611 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-monotonic (1.1-2) ... 2020-11-16T21:49:28.607 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph. 2020-11-16T21:49:28.607 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../049-ceph_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:28.607 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:28.607 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-fuse. 2020-11-16T21:49:28.608 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../050-ceph-fuse_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:28.608 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-fuse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:28.608 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mds. 2020-11-16T21:49:28.608 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../051-ceph-mds_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:28.608 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mds (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:28.608 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-repoze.lru. 2020-11-16T21:49:28.608 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../052-python-repoze.lru_0.7-1_all.deb ... 2020-11-16T21:49:28.609 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-repoze.lru (0.7-1) ... 2020-11-16T21:49:28.609 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libjs-underscore. 2020-11-16T21:49:28.609 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../053-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2020-11-16T21:49:28.609 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2020-11-16T21:49:28.609 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libjs-sphinxdoc. 2020-11-16T21:49:28.609 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../054-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2020-11-16T21:49:28.609 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-11-16T21:49:28.610 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-routes. 2020-11-16T21:49:28.610 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../055-python-routes_2.4.1-1_all.deb ... 2020-11-16T21:49:28.610 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-routes (2.4.1-1) ... 2020-11-16T21:49:28.610 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-11-16T21:49:28.610 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:28.610 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-certifi. 2020-11-16T21:49:28.611 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../041-python-certifi_2018.1.18-2_all.deb ... 2020-11-16T21:49:28.611 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-certifi (2018.1.18-2) ... 2020-11-16T21:49:28.611 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-chardet. 2020-11-16T21:49:28.611 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../042-python-chardet_3.0.4-1_all.deb ... 2020-11-16T21:49:28.611 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-chardet (3.0.4-1) ... 2020-11-16T21:49:28.611 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-urllib3. 2020-11-16T21:49:28.611 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../043-python-urllib3_1.22-1ubuntu0.18.04.2_all.deb ... 2020-11-16T21:49:28.612 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2020-11-16T21:49:28.612 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-requests. 2020-11-16T21:49:28.612 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../044-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2020-11-16T21:49:28.612 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2020-11-16T21:49:28.612 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-werkzeug. 2020-11-16T21:49:28.612 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../045-python-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-11-16T21:49:28.612 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1) ... 2020-11-16T21:49:28.612 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr. 2020-11-16T21:49:28.613 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../046-ceph-mgr_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:28.613 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:28.613 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mon. 2020-11-16T21:49:28.613 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../047-ceph-mon_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:28.613 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mon (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:28.613 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-osd. 2020-11-16T21:49:28.613 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../048-ceph-osd_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:28.614 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-osd (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:28.614 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-fasteners. 2020-11-16T21:49:28.614 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../065-python-fasteners_0.12.0-3_all.deb ... 2020-11-16T21:49:28.614 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-fasteners (0.12.0-3) ... 2020-11-16T21:49:28.614 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-httplib2. 2020-11-16T21:49:28.614 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../066-python-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2020-11-16T21:49:28.614 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-11-16T21:49:28.615 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-pyasn1. 2020-11-16T21:49:28.615 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../067-python-pyasn1_0.4.2-3_all.deb ... 2020-11-16T21:49:28.615 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-pyasn1 (0.4.2-3) ... 2020-11-16T21:49:28.615 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-pyasn1-modules. 2020-11-16T21:49:28.615 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../068-python-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-11-16T21:49:28.615 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-pyasn1-modules (0.2.1-0.2) ... 2020-11-16T21:49:28.615 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-rsa. 2020-11-16T21:49:28.616 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../069-python-rsa_3.4.2-1_all.deb ... 2020-11-16T21:49:28.616 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-rsa (3.4.2-1) ... 2020-11-16T21:49:28.616 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-sqlalchemy. 2020-11-16T21:49:28.616 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../070-python-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-11-16T21:49:28.616 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-11-16T21:49:28.616 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-oauth2client. 2020-11-16T21:49:28.616 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../071-python-oauth2client_4.1.2-3_all.deb ... 2020-11-16T21:49:28.617 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-oauth2client (4.1.2-3) ... 2020-11-16T21:49:28.617 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-websocket. 2020-11-16T21:49:28.617 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../072-python-websocket_0.44.0-0ubuntu2_all.deb ... 2020-11-16T21:49:28.617 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-websocket (0.44.0-0ubuntu2) ... 2020-11-16T21:49:28.617 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-yaml. 2020-11-16T21:49:28.617 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../073-python-yaml_3.12-1build2_amd64.deb ... 2020-11-16T21:49:28.617 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-yaml (3.12-1build2) ... 2020-11-16T21:49:28.618 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-dashboard (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:28.724 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-kubernetes. 2020-11-16T21:49:28.740 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../074-python-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-11-16T21:49:28.783 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-kubernetes (2.0.0-2ubuntu1) ... 2020-11-16T21:49:29.253 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-11-16T21:49:29.267 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../075-ceph-mgr-k8sevents_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:29.320 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-k8sevents (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:29.450 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-11-16T21:49:29.466 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../057-ceph-mgr-diskprediction-cloud_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:29.508 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-diskprediction-cloud (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:29.656 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-11-16T21:49:29.669 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../076-ceph-mgr-rook_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:29.714 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-rook (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:29.811 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-decorator. 2020-11-16T21:49:29.825 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../058-python-decorator_4.1.2-1_all.deb ... 2020-11-16T21:49:29.867 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph. 2020-11-16T21:49:29.869 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-decorator (4.1.2-1) ... 2020-11-16T21:49:29.884 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../049-ceph_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:29.936 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:30.058 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-ssh. 2020-11-16T21:49:30.073 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../077-ceph-mgr-ssh_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:30.116 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-ssh (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:30.163 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-scipy. 2020-11-16T21:49:30.179 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../059-python-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-11-16T21:49:30.221 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-scipy (0.19.1-2ubuntu1) ... 2020-11-16T21:49:30.286 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-fuse. 2020-11-16T21:49:30.300 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../050-ceph-fuse_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:30.336 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-fuse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:30.469 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libonig4:amd64. 2020-11-16T21:49:30.482 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../078-libonig4_6.7.0-1_amd64.deb ... 2020-11-16T21:49:30.527 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-11-16T21:49:30.732 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mds. 2020-11-16T21:49:30.747 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../051-ceph-mds_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:30.790 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mds (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:30.914 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjq1:amd64. 2020-11-16T21:49:30.929 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../079-libjq1_1.5+dfsg-2_amd64.deb ... 2020-11-16T21:49:30.972 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-11-16T21:49:31.241 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package jq. 2020-11-16T21:49:31.256 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../080-jq_1.5+dfsg-2_amd64.deb ... 2020-11-16T21:49:31.268 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-repoze.lru. 2020-11-16T21:49:31.283 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../052-python-repoze.lru_0.7-1_all.deb ... 2020-11-16T21:49:31.326 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-repoze.lru (0.7-1) ... 2020-11-16T21:49:31.393 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-11-16T21:49:31.539 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-sklearn-lib. 2020-11-16T21:49:31.553 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../060-python-sklearn-lib_0.19.1-3_amd64.deb ... 2020-11-16T21:49:31.562 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjs-underscore. 2020-11-16T21:49:31.577 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../053-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2020-11-16T21:49:31.597 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-sklearn-lib (0.19.1-3) ... 2020-11-16T21:49:31.621 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2020-11-16T21:49:31.671 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package socat. 2020-11-16T21:49:31.686 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../081-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-11-16T21:49:31.729 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-11-16T21:49:31.915 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjs-sphinxdoc. 2020-11-16T21:49:31.928 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../054-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2020-11-16T21:49:31.965 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-11-16T21:49:32.059 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-joblib. 2020-11-16T21:49:32.074 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../061-python-joblib_0.11-1_all.deb ... 2020-11-16T21:49:32.117 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-joblib (0.11-1) ... 2020-11-16T21:49:32.166 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-11-16T21:49:32.181 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../082-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-11-16T21:49:32.224 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-11-16T21:49:32.293 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-routes. 2020-11-16T21:49:32.306 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../055-python-routes_2.4.1-1_all.deb ... 2020-11-16T21:49:32.342 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-routes (2.4.1-1) ... 2020-11-16T21:49:32.479 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-sklearn. 2020-11-16T21:49:32.493 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../062-python-sklearn_0.19.1-3_all.deb ... 2020-11-16T21:49:32.519 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package xmlstarlet. 2020-11-16T21:49:32.535 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../083-xmlstarlet_1.6.1-2_amd64.deb ... 2020-11-16T21:49:32.537 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-sklearn (0.19.1-3) ... 2020-11-16T21:49:32.577 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-11-16T21:49:32.687 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-11-16T21:49:32.700 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:32.737 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-dashboard (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:32.948 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-test. 2020-11-16T21:49:32.963 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../084-ceph-test_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:33.014 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-test (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:33.077 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-11-16T21:49:33.094 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-local_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:33.135 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-diskprediction-local (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:33.570 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-11-16T21:49:33.584 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../057-ceph-mgr-diskprediction-cloud_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:33.629 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-diskprediction-cloud (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:33.855 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-monotonic. 2020-11-16T21:49:33.869 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../064-python-monotonic_1.1-2_all.deb ... 2020-11-16T21:49:33.913 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-monotonic (1.1-2) ... 2020-11-16T21:49:33.973 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-decorator. 2020-11-16T21:49:33.987 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../058-python-decorator_4.1.2-1_all.deb ... 2020-11-16T21:49:34.065 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-decorator (4.1.2-1) ... 2020-11-16T21:49:34.216 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-fasteners. 2020-11-16T21:49:34.230 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../065-python-fasteners_0.12.0-3_all.deb ... 2020-11-16T21:49:34.358 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-fasteners (0.12.0-3) ... 2020-11-16T21:49:34.385 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-scipy. 2020-11-16T21:49:34.399 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../059-python-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-11-16T21:49:34.443 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-scipy (0.19.1-2ubuntu1) ... 2020-11-16T21:49:34.694 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-httplib2. 2020-11-16T21:49:34.709 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../066-python-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2020-11-16T21:49:34.753 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-11-16T21:49:35.056 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-pyasn1. 2020-11-16T21:49:35.069 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../067-python-pyasn1_0.4.2-3_all.deb ... 2020-11-16T21:49:35.114 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-pyasn1 (0.4.2-3) ... 2020-11-16T21:49:35.434 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-pyasn1-modules. 2020-11-16T21:49:35.447 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../068-python-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-11-16T21:49:35.492 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-pyasn1-modules (0.2.1-0.2) ... 2020-11-16T21:49:35.544 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-sklearn-lib. 2020-11-16T21:49:35.558 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../060-python-sklearn-lib_0.19.1-3_amd64.deb ... 2020-11-16T21:49:35.602 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-sklearn-lib (0.19.1-3) ... 2020-11-16T21:49:35.635 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs-dev. 2020-11-16T21:49:35.649 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../085-libcephfs-dev_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:35.693 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs-dev (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:35.828 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-rsa. 2020-11-16T21:49:35.842 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../069-python-rsa_3.4.2-1_all.deb ... 2020-11-16T21:49:35.895 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-rsa (3.4.2-1) ... 2020-11-16T21:49:35.962 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package nvme-cli. 2020-11-16T21:49:35.977 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../086-nvme-cli_1.5-1ubuntu1_amd64.deb ... 2020-11-16T21:49:36.021 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking nvme-cli (1.5-1ubuntu1) ... 2020-11-16T21:49:36.097 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-joblib. 2020-11-16T21:49:36.113 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../061-python-joblib_0.11-1_all.deb ... 2020-11-16T21:49:36.156 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-joblib (0.11-1) ... 2020-11-16T21:49:36.223 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-sqlalchemy. 2020-11-16T21:49:36.237 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../070-python-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-11-16T21:49:36.281 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-11-16T21:49:36.425 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-attr. 2020-11-16T21:49:36.442 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../087-python-attr_17.4.0-2_all.deb ... 2020-11-16T21:49:36.483 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-attr (17.4.0-2) ... 2020-11-16T21:49:36.501 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-sklearn. 2020-11-16T21:49:36.516 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../062-python-sklearn_0.19.1-3_all.deb ... 2020-11-16T21:49:36.559 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-sklearn (0.19.1-3) ... 2020-11-16T21:49:36.728 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-oauth2client. 2020-11-16T21:49:36.742 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../071-python-oauth2client_4.1.2-3_all.deb ... 2020-11-16T21:49:36.786 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-oauth2client (4.1.2-3) ... 2020-11-16T21:49:36.819 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-funcsigs. 2020-11-16T21:49:36.833 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../088-python-funcsigs_1.0.2-4_all.deb ... 2020-11-16T21:49:36.886 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-11-16T21:49:37.164 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-websocket. 2020-11-16T21:49:37.178 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../072-python-websocket_0.44.0-0ubuntu2_all.deb ... 2020-11-16T21:49:37.197 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-webencodings. 2020-11-16T21:49:37.212 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../089-python-webencodings_0.5-2_all.deb ... 2020-11-16T21:49:37.222 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-websocket (0.44.0-0ubuntu2) ... 2020-11-16T21:49:37.255 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-webencodings (0.5-2) ... 2020-11-16T21:49:37.508 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-11-16T21:49:37.523 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-local_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:37.534 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-yaml. 2020-11-16T21:49:37.549 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../073-python-yaml_3.12-1build2_amd64.deb ... 2020-11-16T21:49:37.566 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-diskprediction-local (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:37.566 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-html5lib. 2020-11-16T21:49:37.583 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../090-python-html5lib_0.999999999-1_all.deb ... 2020-11-16T21:49:37.592 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-yaml (3.12-1build2) ... 2020-11-16T21:49:37.624 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-html5lib (0.999999999-1) ... 2020-11-16T21:49:37.954 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-kubernetes. 2020-11-16T21:49:37.969 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../074-python-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-11-16T21:49:38.003 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-lxml:amd64. 2020-11-16T21:49:38.011 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-kubernetes (2.0.0-2ubuntu1) ... 2020-11-16T21:49:38.017 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../091-python-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-11-16T21:49:38.060 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-11-16T21:49:38.319 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-monotonic. 2020-11-16T21:49:38.336 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../064-python-monotonic_1.1-2_all.deb ... 2020-11-16T21:49:38.378 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-monotonic (1.1-2) ... 2020-11-16T21:49:38.441 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-11-16T21:49:38.456 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../075-ceph-mgr-k8sevents_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:38.499 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-k8sevents (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:38.515 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-openid. 2020-11-16T21:49:38.531 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../092-python-openid_2.2.5-6_all.deb ... 2020-11-16T21:49:38.572 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-openid (2.2.5-6) ... 2020-11-16T21:49:38.664 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-fasteners. 2020-11-16T21:49:38.680 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../065-python-fasteners_0.12.0-3_all.deb ... 2020-11-16T21:49:38.722 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-fasteners (0.12.0-3) ... 2020-11-16T21:49:38.793 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-11-16T21:49:38.809 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../076-ceph-mgr-rook_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:38.852 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-rook (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:38.934 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-pastescript. 2020-11-16T21:49:38.951 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../093-python-pastescript_2.0.2-2_all.deb ... 2020-11-16T21:49:38.992 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-pastescript (2.0.2-2) ... 2020-11-16T21:49:39.017 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-httplib2. 2020-11-16T21:49:39.033 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../066-python-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2020-11-16T21:49:39.075 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-11-16T21:49:39.163 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-ssh. 2020-11-16T21:49:39.177 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../077-ceph-mgr-ssh_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:39.221 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-ssh (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:39.345 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-pluggy. 2020-11-16T21:49:39.363 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../094-python-pluggy_0.6.0-1_all.deb ... 2020-11-16T21:49:39.386 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pyasn1. 2020-11-16T21:49:39.402 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../067-python-pyasn1_0.4.2-3_all.deb ... 2020-11-16T21:49:39.428 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-11-16T21:49:39.445 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pyasn1 (0.4.2-3) ... 2020-11-16T21:49:39.731 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-py. 2020-11-16T21:49:39.746 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../095-python-py_1.5.2-1_all.deb ... 2020-11-16T21:49:39.790 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-py (1.5.2-1) ... 2020-11-16T21:49:39.798 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pyasn1-modules. 2020-11-16T21:49:39.814 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../068-python-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-11-16T21:49:39.856 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pyasn1-modules (0.2.1-0.2) ... 2020-11-16T21:49:39.882 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libonig4:amd64. 2020-11-16T21:49:39.895 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../078-libonig4_6.7.0-1_amd64.deb ... 2020-11-16T21:49:39.949 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-11-16T21:49:40.143 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-pyinotify. 2020-11-16T21:49:40.157 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../096-python-pyinotify_0.9.6-1_all.deb ... 2020-11-16T21:49:40.176 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-rsa. 2020-11-16T21:49:40.193 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../069-python-rsa_3.4.2-1_all.deb ... 2020-11-16T21:49:40.201 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2020-11-16T21:49:40.234 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-rsa (3.4.2-1) ... 2020-11-16T21:49:40.302 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libjq1:amd64. 2020-11-16T21:49:40.317 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../079-libjq1_1.5+dfsg-2_amd64.deb ... 2020-11-16T21:49:40.360 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-11-16T21:49:40.537 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-pytest. 2020-11-16T21:49:40.546 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-sqlalchemy. 2020-11-16T21:49:40.554 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../097-python-pytest_3.3.2-2_all.deb ... 2020-11-16T21:49:40.560 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../070-python-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-11-16T21:49:40.595 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-11-16T21:49:40.604 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-11-16T21:49:40.646 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package jq. 2020-11-16T21:49:40.659 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../080-jq_1.5+dfsg-2_amd64.deb ... 2020-11-16T21:49:40.782 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-11-16T21:49:40.973 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-scgi. 2020-11-16T21:49:40.989 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../098-python-scgi_1.13-1.1build1_amd64.deb ... 2020-11-16T21:49:41.032 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2020-11-16T21:49:41.043 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package socat. 2020-11-16T21:49:41.057 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../081-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-11-16T21:49:41.067 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-oauth2client. 2020-11-16T21:49:41.083 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../071-python-oauth2client_4.1.2-3_all.deb ... 2020-11-16T21:49:41.101 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-11-16T21:49:41.126 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-oauth2client (4.1.2-3) ... 2020-11-16T21:49:41.326 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-sqlalchemy-ext. 2020-11-16T21:49:41.340 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../099-python-sqlalchemy-ext_1.1.11+ds1-1ubuntu1_amd64.deb ... 2020-11-16T21:49:41.392 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2020-11-16T21:49:41.487 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-websocket. 2020-11-16T21:49:41.503 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../072-python-websocket_0.44.0-0ubuntu2_all.deb ... 2020-11-16T21:49:41.505 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-11-16T21:49:41.520 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../082-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-11-16T21:49:41.546 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-websocket (0.44.0-0ubuntu2) ... 2020-11-16T21:49:41.555 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-11-16T21:49:41.787 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package radosgw. 2020-11-16T21:49:41.801 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../100-radosgw_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:41.841 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package xmlstarlet. 2020-11-16T21:49:41.845 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking radosgw (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:41.857 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../083-xmlstarlet_1.6.1-2_amd64.deb ... 2020-11-16T21:49:41.900 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-11-16T21:49:41.941 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-yaml. 2020-11-16T21:49:41.956 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../073-python-yaml_3.12-1build2_amd64.deb ... 2020-11-16T21:49:42.007 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-yaml (3.12-1build2) ... 2020-11-16T21:49:42.246 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-test. 2020-11-16T21:49:42.260 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../084-ceph-test_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:42.304 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-test (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:42.335 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-kubernetes. 2020-11-16T21:49:42.352 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../074-python-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-11-16T21:49:42.393 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-kubernetes (2.0.0-2ubuntu1) ... 2020-11-16T21:49:42.532 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package rbd-fuse. 2020-11-16T21:49:42.545 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../101-rbd-fuse_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:42.590 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking rbd-fuse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:42.798 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-11-16T21:49:42.812 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../075-ceph-mgr-k8sevents_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:42.856 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-k8sevents (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:42.901 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-dnspython (1.15.0-1) ... 2020-11-16T21:49:43.151 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-11-16T21:49:43.166 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../076-ceph-mgr-rook_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:43.170 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-simplejson (3.13.2-1) ... 2020-11-16T21:49:43.217 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-rook (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:43.379 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-repoze.lru (0.7-1) ... 2020-11-16T21:49:43.512 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-ssh. 2020-11-16T21:49:43.529 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../077-ceph-mgr-ssh_14.2.13-54-g53ad2a5c-1bionic_all.deb ... 2020-11-16T21:49:43.570 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-ssh (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:43.580 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-11-16T21:49:43.931 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libonig4:amd64. 2020-11-16T21:49:43.949 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../078-libonig4_6.7.0-1_amd64.deb ... 2020-11-16T21:49:43.998 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-11-16T21:49:44.066 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-openid (2.2.5-6) ... 2020-11-16T21:49:44.292 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-prettytable (0.7.2-3) ... 2020-11-16T21:49:44.368 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjq1:amd64. 2020-11-16T21:49:44.381 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../079-libjq1_1.5+dfsg-2_amd64.deb ... 2020-11-16T21:49:44.426 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-11-16T21:49:44.433 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libcephfs-dev. 2020-11-16T21:49:44.450 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../085-libcephfs-dev_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:44.491 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libcephfs-dev (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:44.493 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2020-11-16T21:49:44.704 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package jq. 2020-11-16T21:49:44.718 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../080-jq_1.5+dfsg-2_amd64.deb ... 2020-11-16T21:49:44.728 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-yaml (3.12-1build2) ... 2020-11-16T21:49:44.769 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package nvme-cli. 2020-11-16T21:49:44.786 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../086-nvme-cli_1.5-1ubuntu1_amd64.deb ... 2020-11-16T21:49:44.827 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking nvme-cli (1.5-1ubuntu1) ... 2020-11-16T21:49:44.848 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-11-16T21:49:44.962 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2020-11-16T21:49:45.118 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package socat. 2020-11-16T21:49:45.132 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../081-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-11-16T21:49:45.172 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-chardet (3.0.4-1) ... 2020-11-16T21:49:45.176 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-11-16T21:49:45.182 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-attr. 2020-11-16T21:49:45.198 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../087-python-attr_17.4.0-2_all.deb ... 2020-11-16T21:49:45.240 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-attr (17.4.0-2) ... 2020-11-16T21:49:45.440 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-attr (17.4.0-2) ... 2020-11-16T21:49:45.553 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-funcsigs. 2020-11-16T21:49:45.555 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-11-16T21:49:45.567 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../088-python-funcsigs_1.0.2-4_all.deb ... 2020-11-16T21:49:45.569 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../082-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-11-16T21:49:45.611 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-11-16T21:49:45.613 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-11-16T21:49:45.632 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2020-11-16T21:49:45.792 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2020-11-16T21:49:45.897 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-webencodings. 2020-11-16T21:49:45.914 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../089-python-webencodings_0.5-2_all.deb ... 2020-11-16T21:49:45.916 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package xmlstarlet. 2020-11-16T21:49:45.933 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../083-xmlstarlet_1.6.1-2_amd64.deb ... 2020-11-16T21:49:45.955 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-webencodings (0.5-2) ... 2020-11-16T21:49:45.974 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-11-16T21:49:46.001 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-11-16T21:49:46.144 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-pyasn1 (0.4.2-3) ... 2020-11-16T21:49:46.275 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-html5lib. 2020-11-16T21:49:46.289 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../090-python-html5lib_0.999999999-1_all.deb ... 2020-11-16T21:49:46.321 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-test. 2020-11-16T21:49:46.333 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-html5lib (0.999999999-1) ... 2020-11-16T21:49:46.336 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../084-ceph-test_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:46.379 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-test (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:46.412 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-py (1.5.2-1) ... 2020-11-16T21:49:46.638 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-monotonic (1.1-2) ... 2020-11-16T21:49:46.679 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-lxml:amd64. 2020-11-16T21:49:46.693 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../091-python-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-11-16T21:49:46.737 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-11-16T21:49:46.864 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-joblib (0.11-1) ... 2020-11-16T21:49:47.116 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-11-16T21:49:47.157 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-openid. 2020-11-16T21:49:47.170 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../092-python-openid_2.2.5-6_all.deb ... 2020-11-16T21:49:47.215 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-openid (2.2.5-6) ... 2020-11-16T21:49:47.267 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-11-16T21:49:47.459 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-certifi (2018.1.18-2) ... 2020-11-16T21:49:47.560 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-pastescript. 2020-11-16T21:49:47.574 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../093-python-pastescript_2.0.2-2_all.deb ... 2020-11-16T21:49:47.618 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-pastescript (2.0.2-2) ... 2020-11-16T21:49:47.686 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2020-11-16T21:49:47.812 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-11-16T21:49:47.938 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2020-11-16T21:49:47.963 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-pluggy. 2020-11-16T21:49:47.978 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../094-python-pluggy_0.6.0-1_all.deb ... 2020-11-16T21:49:48.022 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-11-16T21:49:48.164 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-ceph-argparse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:48.290 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-waitress (1.0.1-1) ... 2020-11-16T21:49:48.346 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-py. 2020-11-16T21:49:48.363 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../095-python-py_1.5.2-1_all.deb ... 2020-11-16T21:49:48.408 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-py (1.5.2-1) ... 2020-11-16T21:49:48.509 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs-dev. 2020-11-16T21:49:48.523 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../085-libcephfs-dev_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:48.566 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs-dev (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:48.624 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-11-16T21:49:48.745 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-pyinotify. 2020-11-16T21:49:48.760 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../096-python-pyinotify_0.9.6-1_all.deb ... 2020-11-16T21:49:48.803 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2020-11-16T21:49:48.834 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-pyasn1-modules (0.2.1-0.2) ... 2020-11-16T21:49:48.869 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package nvme-cli. 2020-11-16T21:49:48.884 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../086-nvme-cli_1.5-1ubuntu1_amd64.deb ... 2020-11-16T21:49:48.928 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking nvme-cli (1.5-1ubuntu1) ... 2020-11-16T21:49:49.068 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-fasteners (0.12.0-3) ... 2020-11-16T21:49:49.089 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-pytest. 2020-11-16T21:49:49.104 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../097-python-pytest_3.3.2-2_all.deb ... 2020-11-16T21:49:49.147 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-11-16T21:49:49.278 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-jwt (1.5.3+ds1-1) ... 2020-11-16T21:49:49.291 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-attr. 2020-11-16T21:49:49.306 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../087-python-attr_17.4.0-2_all.deb ... 2020-11-16T21:49:49.349 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-attr (17.4.0-2) ... 2020-11-16T21:49:49.487 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-markupsafe (1.0-1build1) ... 2020-11-16T21:49:49.500 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-scgi. 2020-11-16T21:49:49.516 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../098-python-scgi_1.13-1.1build1_amd64.deb ... 2020-11-16T21:49:49.575 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2020-11-16T21:49:49.661 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-funcsigs. 2020-11-16T21:49:49.677 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../088-python-funcsigs_1.0.2-4_all.deb ... 2020-11-16T21:49:49.680 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1) ... 2020-11-16T21:49:49.736 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-11-16T21:49:49.937 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-sqlalchemy-ext. 2020-11-16T21:49:49.939 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-pyinotify (0.9.6-1) ... 2020-11-16T21:49:49.952 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../099-python-sqlalchemy-ext_1.1.11+ds1-1ubuntu1_amd64.deb ... 2020-11-16T21:49:49.995 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2020-11-16T21:49:50.038 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-webencodings. 2020-11-16T21:49:50.052 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../089-python-webencodings_0.5-2_all.deb ... 2020-11-16T21:49:50.105 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-webencodings (0.5-2) ... 2020-11-16T21:49:50.141 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-scgi (1.13-1.1build1) ... 2020-11-16T21:49:50.367 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-websocket (0.44.0-0ubuntu2) ... 2020-11-16T21:49:50.373 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package radosgw. 2020-11-16T21:49:50.388 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../100-radosgw_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:50.416 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-html5lib. 2020-11-16T21:49:50.431 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../090-python-html5lib_0.999999999-1_all.deb ... 2020-11-16T21:49:50.439 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking radosgw (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:50.456 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/python2-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-11-16T21:49:50.474 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-html5lib (0.999999999-1) ... 2020-11-16T21:49:50.610 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-11-16T21:49:50.744 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up nvme-cli (1.5-1ubuntu1) ... 2020-11-16T21:49:50.812 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-lxml:amd64. 2020-11-16T21:49:50.828 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../091-python-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-11-16T21:49:50.869 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-11-16T21:49:50.903 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-11-16T21:49:51.076 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package rbd-fuse. 2020-11-16T21:49:51.090 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../101-rbd-fuse_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:51.096 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-11-16T21:49:51.134 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking rbd-fuse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:51.222 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-bs4 (4.6.0-1) ... 2020-11-16T21:49:51.298 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-openid. 2020-11-16T21:49:51.314 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../092-python-openid_2.2.5-6_all.deb ... 2020-11-16T21:49:51.356 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-openid (2.2.5-6) ... 2020-11-16T21:49:51.419 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-dnspython (1.15.0-1) ... 2020-11-16T21:49:51.482 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2020-11-16T21:49:51.689 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-simplejson (3.13.2-1) ... 2020-11-16T21:49:51.718 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pastescript. 2020-11-16T21:49:51.732 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../093-python-pastescript_2.0.2-2_all.deb ... 2020-11-16T21:49:51.750 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-sklearn-lib (0.19.1-3) ... 2020-11-16T21:49:51.776 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pastescript (2.0.2-2) ... 2020-11-16T21:49:51.875 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-11-16T21:49:51.899 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-repoze.lru (0.7-1) ... 2020-11-16T21:49:52.001 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-11-16T21:49:52.116 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-11-16T21:49:52.138 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pluggy. 2020-11-16T21:49:52.153 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../094-python-pluggy_0.6.0-1_all.deb ... 2020-11-16T21:49:52.197 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-11-16T21:49:52.228 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2020-11-16T21:49:52.354 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-11-16T21:49:52.516 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-py. 2020-11-16T21:49:52.531 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../095-python-py_1.5.2-1_all.deb ... 2020-11-16T21:49:52.547 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2020-11-16T21:49:52.583 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-py (1.5.2-1) ... 2020-11-16T21:49:52.594 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-openid (2.2.5-6) ... 2020-11-16T21:49:52.798 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-uritemplate (0.6-1ubuntu1) ... 2020-11-16T21:49:52.820 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-prettytable (0.7.2-3) ... 2020-11-16T21:49:52.920 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pyinotify. 2020-11-16T21:49:52.933 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../096-python-pyinotify_0.9.6-1_all.deb ... 2020-11-16T21:49:52.978 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2020-11-16T21:49:52.990 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-decorator (4.1.2-1) ... 2020-11-16T21:49:53.021 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2020-11-16T21:49:53.217 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liboath0 (2.6.1-1) ... 2020-11-16T21:49:53.248 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-yaml (3.12-1build2) ... 2020-11-16T21:49:53.281 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pytest. 2020-11-16T21:49:53.295 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../097-python-pytest_3.3.2-2_all.deb ... 2020-11-16T21:49:53.339 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-11-16T21:49:53.393 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2020-11-16T21:49:53.474 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2020-11-16T21:49:53.619 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-11-16T21:49:53.658 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-chardet (3.0.4-1) ... 2020-11-16T21:49:53.693 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-scgi. 2020-11-16T21:49:53.709 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../098-python-scgi_1.13-1.1build1_amd64.deb ... 2020-11-16T21:49:53.751 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2020-11-16T21:49:53.770 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-11-16T21:49:53.896 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-tempita (0.5.2-2) ... 2020-11-16T21:49:53.935 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-attr (17.4.0-2) ... 2020-11-16T21:49:54.021 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-sqlalchemy-ext. 2020-11-16T21:49:54.037 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../099-python-sqlalchemy-ext_1.1.11+ds1-1ubuntu1_amd64.deb ... 2020-11-16T21:49:54.079 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2020-11-16T21:49:54.097 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-11-16T21:49:54.136 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2020-11-16T21:49:54.223 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-webencodings (0.5-2) ... 2020-11-16T21:49:54.262 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2020-11-16T21:49:54.416 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2020-11-16T21:49:54.432 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package radosgw. 2020-11-16T21:49:54.445 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../100-radosgw_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:54.472 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-11-16T21:49:54.490 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking radosgw (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:54.598 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-pyasn1 (0.4.2-3) ... 2020-11-16T21:49:54.701 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-bcrypt (3.1.4-2) ... 2020-11-16T21:49:54.841 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-py (1.5.2-1) ... 2020-11-16T21:49:54.901 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-logutils (0.3.3-5) ... 2020-11-16T21:49:55.075 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-monotonic (1.1-2) ... 2020-11-16T21:49:55.111 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-routes (2.4.1-1) ... 2020-11-16T21:49:55.160 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package rbd-fuse. 2020-11-16T21:49:55.175 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../101-rbd-fuse_14.2.13-54-g53ad2a5c-1bionic_amd64.deb ... 2020-11-16T21:49:55.219 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking rbd-fuse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:55.293 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-joblib (0.11-1) ... 2020-11-16T21:49:55.337 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2020-11-16T21:49:55.523 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-dnspython (1.15.0-1) ... 2020-11-16T21:49:55.545 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-11-16T21:49:55.572 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up jq (1.5+dfsg-2) ... 2020-11-16T21:49:55.671 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-11-16T21:49:55.698 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-scipy (0.19.1-2ubuntu1) ... 2020-11-16T21:49:55.799 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-simplejson (3.13.2-1) ... 2020-11-16T21:49:55.864 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-certifi (2018.1.18-2) ... 2020-11-16T21:49:56.025 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-repoze.lru (0.7-1) ... 2020-11-16T21:49:56.048 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2020-11-16T21:49:56.183 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-11-16T21:49:56.218 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-11-16T21:49:56.308 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2020-11-16T21:49:56.543 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-ceph-argparse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:56.669 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-waitress (1.0.1-1) ... 2020-11-16T21:49:56.712 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-openid (2.2.5-6) ... 2020-11-16T21:49:56.777 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-rsa (3.4.2-1) ... 2020-11-16T21:49:56.939 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-prettytable (0.7.2-3) ... 2020-11-16T21:49:56.995 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-11-16T21:49:57.062 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-11-16T21:49:57.140 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2020-11-16T21:49:57.239 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-pyasn1-modules (0.2.1-0.2) ... 2020-11-16T21:49:57.309 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-pytest (3.3.2-2) ... 2020-11-16T21:49:57.375 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-yaml (3.12-1build2) ... 2020-11-16T21:49:57.473 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-fasteners (0.12.0-3) ... 2020-11-16T21:49:57.564 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-oauth2client (4.1.2-3) ... 2020-11-16T21:49:57.593 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2020-11-16T21:49:57.683 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-jwt (1.5.3+ds1-1) ... 2020-11-16T21:49:57.794 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-chardet (3.0.4-1) ... 2020-11-16T21:49:57.798 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-11-16T21:49:57.884 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-markupsafe (1.0-1build1) ... 2020-11-16T21:49:57.924 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-11-16T21:49:58.050 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librados2 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:58.079 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-attr (17.4.0-2) ... 2020-11-16T21:49:58.085 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1) ... 2020-11-16T21:49:58.193 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs2 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:58.280 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2020-11-16T21:49:58.344 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-sklearn (0.19.1-3) ... 2020-11-16T21:49:58.345 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-pyinotify (0.9.6-1) ... 2020-11-16T21:49:58.406 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2020-11-16T21:49:58.546 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-scgi (1.13-1.1build1) ... 2020-11-16T21:49:58.616 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-11-16T21:49:58.755 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-websocket (0.44.0-0ubuntu2) ... 2020-11-16T21:49:58.767 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pyasn1 (0.4.2-3) ... 2020-11-16T21:49:58.870 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/python2-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-11-16T21:49:59.002 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-py (1.5.2-1) ... 2020-11-16T21:49:59.024 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-11-16T21:49:59.073 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs-dev (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:49:59.150 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up nvme-cli (1.5-1ubuntu1) ... 2020-11-16T21:49:59.228 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-monotonic (1.1-2) ... 2020-11-16T21:49:59.231 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-kubernetes (2.0.0-2ubuntu1) ... 2020-11-16T21:49:59.275 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-11-16T21:49:59.421 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-joblib (0.11-1) ... 2020-11-16T21:49:59.485 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-11-16T21:49:59.611 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-bs4 (4.6.0-1) ... 2020-11-16T21:49:59.714 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-11-16T21:49:59.792 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-html5lib (0.999999999-1) ... 2020-11-16T21:49:59.838 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2020-11-16T21:49:59.840 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-11-16T21:50:00.035 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-rados (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:00.041 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-certifi (2018.1.18-2) ... 2020-11-16T21:50:00.064 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-sklearn-lib (0.19.1-3) ... 2020-11-16T21:50:00.186 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-cephfs (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:00.189 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-11-16T21:50:00.251 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2020-11-16T21:50:00.332 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-11-16T21:50:00.385 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2020-11-16T21:50:00.421 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libradosstriper1 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:00.512 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2020-11-16T21:50:00.550 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2020-11-16T21:50:00.580 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librgw2 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:00.677 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-11-16T21:50:00.706 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-rgw (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:00.738 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-ceph-argparse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:00.832 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2020-11-16T21:50:00.872 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-waitress (1.0.1-1) ... 2020-11-16T21:50:00.894 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2020-11-16T21:50:01.066 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-fuse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:01.096 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-uritemplate (0.6-1ubuntu1) ... 2020-11-16T21:50:01.228 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-11-16T21:50:01.288 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-decorator (4.1.2-1) ... 2020-11-16T21:50:01.290 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-11-16T21:50:01.290 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-11-16T21:50:01.442 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pyasn1-modules (0.2.1-0.2) ... 2020-11-16T21:50:01.481 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liboath0 (2.6.1-1) ... 2020-11-16T21:50:01.576 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librbd1 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:01.666 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2020-11-16T21:50:01.684 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-fasteners (0.12.0-3) ... 2020-11-16T21:50:01.702 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-pastescript (2.0.2-2) ... 2020-11-16T21:50:01.859 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-11-16T21:50:01.894 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-jwt (1.5.3+ds1-1) ... 2020-11-16T21:50:01.949 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-rbd (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:01.985 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-11-16T21:50:02.096 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-markupsafe (1.0-1build1) ... 2020-11-16T21:50:02.111 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-tempita (0.5.2-2) ... 2020-11-16T21:50:02.150 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-common (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:02.288 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1) ... 2020-11-16T21:50:02.304 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-11-16T21:50:02.446 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-webencodings (0.5-2) ... 2020-11-16T21:50:02.548 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pyinotify (0.9.6-1) ... 2020-11-16T21:50:02.639 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2020-11-16T21:50:02.734 INFO:teuthology.orchestra.run.smithi057.stdout:Adding group ceph....done 2020-11-16T21:50:02.757 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-scgi (1.13-1.1build1) ... 2020-11-16T21:50:02.899 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-bcrypt (3.1.4-2) ... 2020-11-16T21:50:03.084 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-websocket (0.44.0-0ubuntu2) ... 2020-11-16T21:50:03.092 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-logutils (0.3.3-5) ... 2020-11-16T21:50:03.182 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/python2-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-11-16T21:50:03.214 INFO:teuthology.orchestra.run.smithi057.stdout:Adding system user ceph....done 2020-11-16T21:50:03.284 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-routes (2.4.1-1) ... 2020-11-16T21:50:03.327 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-11-16T21:50:03.439 INFO:teuthology.orchestra.run.smithi057.stdout:Setting system user ceph properties....done 2020-11-16T21:50:03.478 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up nvme-cli (1.5-1ubuntu1) ... 2020-11-16T21:50:03.486 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2020-11-16T21:50:03.604 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-11-16T21:50:03.605 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-11-16T21:50:03.729 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up jq (1.5+dfsg-2) ... 2020-11-16T21:50:03.816 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-11-16T21:50:03.855 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-scipy (0.19.1-2ubuntu1) ... 2020-11-16T21:50:03.922 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-11-16T21:50:04.048 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-bs4 (4.6.0-1) ... 2020-11-16T21:50:04.112 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up radosgw (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:04.283 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2020-11-16T21:50:04.384 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-11-16T21:50:04.384 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-11-16T21:50:04.509 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-sklearn-lib (0.19.1-3) ... 2020-11-16T21:50:04.636 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-11-16T21:50:04.762 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-11-16T21:50:04.876 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-rsa (3.4.2-1) ... 2020-11-16T21:50:04.923 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up rbd-fuse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:05.049 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2020-11-16T21:50:05.072 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2020-11-16T21:50:05.085 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-11-16T21:50:05.197 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-11-16T21:50:05.275 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-test (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:05.362 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-pytest (3.3.2-2) ... 2020-11-16T21:50:05.399 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2020-11-16T21:50:05.402 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-base (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:05.616 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-uritemplate (0.6-1ubuntu1) ... 2020-11-16T21:50:05.621 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-oauth2client (4.1.2-3) ... 2020-11-16T21:50:05.769 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-11-16T21:50:05.818 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-decorator (4.1.2-1) ... 2020-11-16T21:50:05.840 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-11-16T21:50:05.966 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-11-16T21:50:06.019 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liboath0 (2.6.1-1) ... 2020-11-16T21:50:06.117 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librados2 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:06.195 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2020-11-16T21:50:06.212 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-pecan (1.2.1-2) ... 2020-11-16T21:50:06.259 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libcephfs2 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:06.310 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-11-16T21:50:06.351 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-11-16T21:50:06.377 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-sklearn (0.19.1-3) ... 2020-11-16T21:50:06.388 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-11-16T21:50:06.514 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-11-16T21:50:06.640 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-osd (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:06.641 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-tempita (0.5.2-2) ... 2020-11-16T21:50:06.833 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-11-16T21:50:06.968 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-webencodings (0.5-2) ... 2020-11-16T21:50:07.089 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libcephfs-dev (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:07.177 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2020-11-16T21:50:07.215 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-kubernetes (2.0.0-2ubuntu1) ... 2020-11-16T21:50:07.242 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-11-16T21:50:07.243 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-11-16T21:50:07.526 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mds (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:07.637 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-bcrypt (3.1.4-2) ... 2020-11-16T21:50:07.742 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-html5lib (0.999999999-1) ... 2020-11-16T21:50:07.748 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-11-16T21:50:07.749 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-11-16T21:50:07.822 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-logutils (0.3.3-5) ... 2020-11-16T21:50:07.985 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-rados (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:08.014 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-routes (2.4.1-1) ... 2020-11-16T21:50:08.019 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mon (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:08.111 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-cephfs (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:08.216 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2020-11-16T21:50:08.263 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-11-16T21:50:08.263 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-11-16T21:50:08.304 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libradosstriper1 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:08.430 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librgw2 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:08.450 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up jq (1.5+dfsg-2) ... 2020-11-16T21:50:08.556 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-rgw (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:08.571 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:08.593 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-scipy (0.19.1-2ubuntu1) ... 2020-11-16T21:50:08.682 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2020-11-16T21:50:08.796 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-11-16T21:50:08.796 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-11-16T21:50:08.892 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-fuse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:09.089 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-diskprediction-local (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:09.116 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-11-16T21:50:09.117 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-11-16T21:50:09.232 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-diskprediction-cloud (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:09.375 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-rook (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:09.393 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librbd1 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:09.519 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-pastescript (2.0.2-2) ... 2020-11-16T21:50:09.543 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:09.669 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-k8sevents (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:09.706 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-rsa (3.4.2-1) ... 2020-11-16T21:50:09.762 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-rbd (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:09.795 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-ssh (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:09.924 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2020-11-16T21:50:09.965 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-common (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:09.988 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-dashboard (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:10.140 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.3) ... 2020-11-16T21:50:10.225 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pytest (3.3.2-2) ... 2020-11-16T21:50:10.267 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2020-11-16T21:50:10.485 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-oauth2client (4.1.2-3) ... 2020-11-16T21:50:10.493 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-11-16T21:50:10.704 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-11-16T21:50:10.830 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-11-16T21:50:10.916 INFO:teuthology.orchestra.run.smithi195.stdout:Adding group ceph....done 2020-11-16T21:50:10.956 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librados2 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:11.082 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs2 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:11.241 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-sklearn (0.19.1-3) ... 2020-11-16T21:50:11.353 INFO:teuthology.orchestra.run.smithi195.stdout:Adding system user ceph....done 2020-11-16T21:50:11.553 INFO:teuthology.orchestra.run.smithi195.stdout:Setting system user ceph properties....done 2020-11-16T21:50:11.717 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-11-16T21:50:11.940 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-11-16T21:50:11.961 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs-dev (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:12.087 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-kubernetes (2.0.0-2ubuntu1) ... 2020-11-16T21:50:12.226 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up radosgw (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:12.480 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-11-16T21:50:12.481 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-11-16T21:50:12.561 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-11-16T21:50:12.604 INFO:teuthology.orchestra.run.smithi057.stdout:ureadahead will be reprofiled on next reboot 2020-11-16T21:50:12.623 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-html5lib (0.999999999-1) ... 2020-11-16T21:50:12.866 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-rados (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:12.945 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up rbd-fuse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:12.993 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-cephfs (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:13.007 INFO:teuthology.orchestra.run.smithi057.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-11-16T21:50:13.010 DEBUG:teuthology.parallel:result is None 2020-11-16T21:50:13.071 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2020-11-16T21:50:13.219 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libradosstriper1 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:13.289 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-test (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:13.347 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librgw2 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:13.415 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-base (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:13.473 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-rgw (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:13.599 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2020-11-16T21:50:13.741 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-11-16T21:50:13.817 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-fuse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:14.041 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-11-16T21:50:14.041 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-11-16T21:50:14.050 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-pecan (1.2.1-2) ... 2020-11-16T21:50:14.157 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-11-16T21:50:14.189 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-11-16T21:50:14.343 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librbd1 (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:14.378 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-osd (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:14.494 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pastescript (2.0.2-2) ... 2020-11-16T21:50:14.713 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-rbd (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:14.932 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-common (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:14.952 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-11-16T21:50:14.952 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-11-16T21:50:15.206 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mds (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:15.416 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-11-16T21:50:15.416 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-11-16T21:50:15.541 INFO:teuthology.orchestra.run.smithi016.stdout:Adding group ceph....done 2020-11-16T21:50:15.707 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mon (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:15.925 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-11-16T21:50:15.926 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-11-16T21:50:16.003 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user ceph....done 2020-11-16T21:50:16.205 INFO:teuthology.orchestra.run.smithi016.stdout:Setting system user ceph properties....done 2020-11-16T21:50:16.225 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:16.354 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-11-16T21:50:16.464 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-11-16T21:50:16.464 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-11-16T21:50:16.576 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-11-16T21:50:16.744 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-diskprediction-local (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:16.869 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up radosgw (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:16.886 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-diskprediction-cloud (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:17.029 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-rook (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:17.171 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-11-16T21:50:17.172 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-11-16T21:50:17.172 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:17.298 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-k8sevents (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:17.424 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-ssh (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:17.558 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-dashboard (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:17.613 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up rbd-fuse (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:17.676 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.3) ... 2020-11-16T21:50:17.739 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2020-11-16T21:50:17.804 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2020-11-16T21:50:17.990 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-test (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:18.004 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-11-16T21:50:18.116 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-base (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:18.458 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-11-16T21:50:18.710 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pecan (1.2.1-2) ... 2020-11-16T21:50:18.791 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-11-16T21:50:18.832 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-11-16T21:50:19.021 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-osd (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:19.601 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-11-16T21:50:19.601 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-11-16T21:50:19.882 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mds (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:20.014 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-11-16T21:50:20.057 INFO:teuthology.orchestra.run.smithi195.stdout:ureadahead will be reprofiled on next reboot 2020-11-16T21:50:20.104 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-11-16T21:50:20.104 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-11-16T21:50:20.392 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mon (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:20.421 INFO:teuthology.orchestra.run.smithi195.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-11-16T21:50:20.423 DEBUG:teuthology.parallel:result is None 2020-11-16T21:50:20.614 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-11-16T21:50:20.615 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-11-16T21:50:20.934 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:21.144 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-11-16T21:50:21.144 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-11-16T21:50:21.445 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-diskprediction-local (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:21.588 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-diskprediction-cloud (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:21.731 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-rook (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:21.873 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:21.999 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-k8sevents (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:22.125 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-ssh (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:22.268 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-dashboard (14.2.13-54-g53ad2a5c-1bionic) ... 2020-11-16T21:50:22.395 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.3) ... 2020-11-16T21:50:22.514 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2020-11-16T21:50:22.731 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-11-16T21:50:24.867 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-11-16T21:50:24.909 INFO:teuthology.orchestra.run.smithi016.stdout:ureadahead will be reprofiled on next reboot 2020-11-16T21:50:25.284 INFO:teuthology.orchestra.run.smithi016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-11-16T21:50:25.287 DEBUG:teuthology.parallel:result is None 2020-11-16T21:50:25.287 INFO:teuthology.orchestra.run.smithi195:> sudo lsb_release -is 2020-11-16T21:50:25.341 INFO:teuthology.orchestra.run.smithi195.stdout:Ubuntu 2020-11-16T21:50:25.370 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-16T21:50:25.370 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-11-16T21:50:25.371 INFO:teuthology.packaging:ref: None 2020-11-16T21:50:25.371 INFO:teuthology.packaging:tag: None 2020-11-16T21:50:25.371 INFO:teuthology.packaging:branch: nautilus 2020-11-16T21:50:25.372 INFO:teuthology.packaging:sha1: 911cc35794d871071a8bebfb0919482263b1d18b 2020-11-16T21:50:25.372 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=nautilus 2020-11-16T21:50:25.657 INFO:teuthology.orchestra.run.smithi195:> dpkg-query -W -f '${Version}' ceph 2020-11-16T21:50:25.681 INFO:teuthology.orchestra.run.smithi195.stdout:14.2.13-54-g53ad2a5c-1bionic 2020-11-16T21:50:25.681 INFO:teuthology.packaging:The installed version of ceph is 14.2.13-54-g53ad2a5c-1bionic 2020-11-16T21:50:25.682 INFO:teuthology.task.install:The correct ceph version 14.2.13-54-g53ad2a5c-1bionic is installed. 2020-11-16T21:50:25.682 INFO:teuthology.orchestra.run.smithi016:> sudo lsb_release -is 2020-11-16T21:50:25.736 INFO:teuthology.orchestra.run.smithi016.stdout:Ubuntu 2020-11-16T21:50:25.741 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-16T21:50:25.742 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-11-16T21:50:25.743 INFO:teuthology.packaging:ref: None 2020-11-16T21:50:25.743 INFO:teuthology.packaging:tag: None 2020-11-16T21:50:25.743 INFO:teuthology.packaging:branch: nautilus 2020-11-16T21:50:25.743 INFO:teuthology.packaging:sha1: 911cc35794d871071a8bebfb0919482263b1d18b 2020-11-16T21:50:25.744 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=nautilus 2020-11-16T21:50:26.046 INFO:teuthology.orchestra.run.smithi016:> dpkg-query -W -f '${Version}' ceph 2020-11-16T21:50:26.071 INFO:teuthology.orchestra.run.smithi016.stdout:14.2.13-54-g53ad2a5c-1bionic 2020-11-16T21:50:26.072 INFO:teuthology.packaging:The installed version of ceph is 14.2.13-54-g53ad2a5c-1bionic 2020-11-16T21:50:26.072 INFO:teuthology.task.install:The correct ceph version 14.2.13-54-g53ad2a5c-1bionic is installed. 2020-11-16T21:50:26.073 INFO:teuthology.orchestra.run.smithi057:> sudo lsb_release -is 2020-11-16T21:50:26.122 INFO:teuthology.orchestra.run.smithi057.stdout:Ubuntu 2020-11-16T21:50:26.127 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-16T21:50:26.127 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-11-16T21:50:26.128 INFO:teuthology.packaging:ref: None 2020-11-16T21:50:26.128 INFO:teuthology.packaging:tag: None 2020-11-16T21:50:26.128 INFO:teuthology.packaging:branch: nautilus 2020-11-16T21:50:26.128 INFO:teuthology.packaging:sha1: 911cc35794d871071a8bebfb0919482263b1d18b 2020-11-16T21:50:26.129 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=nautilus 2020-11-16T21:50:26.443 INFO:teuthology.orchestra.run.smithi057:> dpkg-query -W -f '${Version}' ceph 2020-11-16T21:50:26.468 INFO:teuthology.orchestra.run.smithi057.stdout:14.2.13-54-g53ad2a5c-1bionic 2020-11-16T21:50:26.469 INFO:teuthology.packaging:The installed version of ceph is 14.2.13-54-g53ad2a5c-1bionic 2020-11-16T21:50:26.469 INFO:teuthology.task.install:The correct ceph version 14.2.13-54-g53ad2a5c-1bionic is installed. 2020-11-16T21:50:26.469 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-11-16T21:50:26.470 INFO:teuthology.orchestra.run.smithi195:> set -ex 2020-11-16T21:50:26.470 INFO:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-16T21:50:26.475 INFO:teuthology.orchestra.run.smithi195.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-16T21:50:26.484 INFO:teuthology.orchestra.run.smithi195.stderr:24+1 records in 2020-11-16T21:50:26.484 INFO:teuthology.orchestra.run.smithi195.stderr:24+1 records out 2020-11-16T21:50:26.484 INFO:teuthology.orchestra.run.smithi195.stderr:12667 bytes (13 kB, 12 KiB) copied, 0.000180818 s, 70.1 MB/s 2020-11-16T21:50:26.485 INFO:teuthology.orchestra.run.smithi016:> set -ex 2020-11-16T21:50:26.486 INFO:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-16T21:50:26.490 INFO:teuthology.orchestra.run.smithi016.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-16T21:50:26.500 INFO:teuthology.orchestra.run.smithi016.stderr:24+1 records in 2020-11-16T21:50:26.500 INFO:teuthology.orchestra.run.smithi016.stderr:24+1 records out 2020-11-16T21:50:26.500 INFO:teuthology.orchestra.run.smithi016.stderr:12667 bytes (13 kB, 12 KiB) copied, 0.000225876 s, 56.1 MB/s 2020-11-16T21:50:26.501 INFO:teuthology.orchestra.run.smithi057:> set -ex 2020-11-16T21:50:26.501 INFO:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-16T21:50:26.514 INFO:teuthology.orchestra.run.smithi057.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-16T21:50:26.524 INFO:teuthology.orchestra.run.smithi057.stderr:24+1 records in 2020-11-16T21:50:26.524 INFO:teuthology.orchestra.run.smithi057.stderr:24+1 records out 2020-11-16T21:50:26.524 INFO:teuthology.orchestra.run.smithi057.stderr:12667 bytes (13 kB, 12 KiB) copied, 0.000220394 s, 57.5 MB/s 2020-11-16T21:50:26.525 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-11-16T21:50:26.525 INFO:teuthology.orchestra.run.smithi195:> set -ex 2020-11-16T21:50:26.526 INFO:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2020-11-16T21:50:26.530 INFO:teuthology.orchestra.run.smithi195.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-16T21:50:26.539 INFO:teuthology.orchestra.run.smithi195.stderr:5+1 records in 2020-11-16T21:50:26.539 INFO:teuthology.orchestra.run.smithi195.stderr:5+1 records out 2020-11-16T21:50:26.540 INFO:teuthology.orchestra.run.smithi195.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 9.302e-05 s, 32.9 MB/s 2020-11-16T21:50:26.540 INFO:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-16T21:50:26.599 INFO:teuthology.orchestra.run.smithi016:> set -ex 2020-11-16T21:50:26.599 INFO:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2020-11-16T21:50:26.604 INFO:teuthology.orchestra.run.smithi016.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-16T21:50:26.613 INFO:teuthology.orchestra.run.smithi016.stderr:5+1 records in 2020-11-16T21:50:26.613 INFO:teuthology.orchestra.run.smithi016.stderr:5+1 records out 2020-11-16T21:50:26.613 INFO:teuthology.orchestra.run.smithi016.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 0.000104147 s, 29.4 MB/s 2020-11-16T21:50:26.614 INFO:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-16T21:50:26.671 INFO:teuthology.orchestra.run.smithi057:> set -ex 2020-11-16T21:50:26.671 INFO:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2020-11-16T21:50:26.676 INFO:teuthology.orchestra.run.smithi057.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-16T21:50:26.685 INFO:teuthology.orchestra.run.smithi057.stderr:5+1 records in 2020-11-16T21:50:26.685 INFO:teuthology.orchestra.run.smithi057.stderr:5+1 records out 2020-11-16T21:50:26.685 INFO:teuthology.orchestra.run.smithi057.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 0.00010527 s, 29.0 MB/s 2020-11-16T21:50:26.686 INFO:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-16T21:50:26.741 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-11-16T21:50:26.741 INFO:teuthology.orchestra.run.smithi195:> set -ex 2020-11-16T21:50:26.742 INFO:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-16T21:50:26.746 INFO:teuthology.orchestra.run.smithi195.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-16T21:50:26.755 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2020-11-16T21:50:26.756 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2020-11-16T21:50:26.756 INFO:teuthology.orchestra.run.smithi195.stderr:299 bytes copied, 7.121e-05 s, 4.2 MB/s 2020-11-16T21:50:26.757 INFO:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-16T21:50:26.812 INFO:teuthology.orchestra.run.smithi016:> set -ex 2020-11-16T21:50:26.812 INFO:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-16T21:50:26.817 INFO:teuthology.orchestra.run.smithi016.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-16T21:50:26.826 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2020-11-16T21:50:26.826 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2020-11-16T21:50:26.826 INFO:teuthology.orchestra.run.smithi016.stderr:299 bytes copied, 6.5654e-05 s, 4.6 MB/s 2020-11-16T21:50:26.827 INFO:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-16T21:50:26.884 INFO:teuthology.orchestra.run.smithi057:> set -ex 2020-11-16T21:50:26.884 INFO:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-16T21:50:26.889 INFO:teuthology.orchestra.run.smithi057.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-16T21:50:26.899 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records in 2020-11-16T21:50:26.899 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records out 2020-11-16T21:50:26.899 INFO:teuthology.orchestra.run.smithi057.stderr:299 bytes copied, 7.3736e-05 s, 4.1 MB/s 2020-11-16T21:50:26.900 INFO:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-16T21:50:26.956 INFO:teuthology.run_tasks:Running task cephadm... 2020-11-16T21:50:27.032 INFO:tasks.cephadm:Config: {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'osd', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd backoff on degraded': True, 'osd backoff on peering': True, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd max markdown count': 1000, 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'Health detail', '\\(REQUEST_STUCK\\)', '\\(MON_DOWN\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'Health detail'], 'mon_bind_msgr2': False, 'sha1': '911cc35794d871071a8bebfb0919482263b1d18b'} 2020-11-16T21:50:27.033 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b 2020-11-16T21:50:27.034 INFO:tasks.cephadm:Cluster fsid is bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:50:27.034 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2020-11-16T21:50:27.035 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '[v1:172.21.15.195:6789]', 'mon.b': '[v1:172.21.15.16:6789]', 'mon.c': '[v1:172.21.15.57:6789]'} 2020-11-16T21:50:27.035 INFO:tasks.cephadm:First mon is mon.a on smithi195 2020-11-16T21:50:27.035 INFO:tasks.cephadm:First mgr is y 2020-11-16T21:50:27.035 INFO:tasks.cephadm:Normalizing hostnames... 2020-11-16T21:50:27.036 INFO:teuthology.orchestra.run.smithi016:> sudo hostname $(hostname -s) 2020-11-16T21:50:27.052 INFO:teuthology.orchestra.run.smithi057:> sudo hostname $(hostname -s) 2020-11-16T21:50:27.069 INFO:teuthology.orchestra.run.smithi195:> sudo hostname $(hostname -s) 2020-11-16T21:50:27.084 INFO:tasks.cephadm:Downloading cephadm (repo git://git.ceph.com/ceph-ci.git ref 911cc35794d871071a8bebfb0919482263b1d18b)... 2020-11-16T21:50:27.085 INFO:teuthology.orchestra.run.smithi016:> git archive --remote=git://git.ceph.com/ceph-ci.git 911cc35794d871071a8bebfb0919482263b1d18b src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2020-11-16T21:50:27.214 INFO:teuthology.orchestra.run.smithi057:> git archive --remote=git://git.ceph.com/ceph-ci.git 911cc35794d871071a8bebfb0919482263b1d18b src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2020-11-16T21:50:27.336 INFO:teuthology.orchestra.run.smithi195:> git archive --remote=git://git.ceph.com/ceph-ci.git 911cc35794d871071a8bebfb0919482263b1d18b src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2020-11-16T21:50:27.456 INFO:teuthology.orchestra.run.smithi016:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2020-11-16T21:50:27.465 INFO:teuthology.orchestra.run.smithi057:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2020-11-16T21:50:27.474 INFO:teuthology.orchestra.run.smithi195:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2020-11-16T21:50:27.495 INFO:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph 2020-11-16T21:50:27.520 INFO:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph 2020-11-16T21:50:27.535 INFO:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph 2020-11-16T21:50:27.551 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 777 /etc/ceph 2020-11-16T21:50:27.574 INFO:teuthology.orchestra.run.smithi057:> sudo chmod 777 /etc/ceph 2020-11-16T21:50:27.592 INFO:teuthology.orchestra.run.smithi195:> sudo chmod 777 /etc/ceph 2020-11-16T21:50:27.608 INFO:tasks.cephadm:Adding local image mirror vossi04.front.sepia.ceph.com:5000 2020-11-16T21:50:27.608 INFO:teuthology.orchestra.run.smithi195:> set -ex 2020-11-16T21:50:27.608 INFO:teuthology.orchestra.run.smithi195:> dd if=/etc/containers/registries.conf of=/dev/stdout 2020-11-16T21:50:27.654 INFO:teuthology.orchestra.run.smithi195.stderr:+ dd if=/etc/containers/registries.conf of=/dev/stdout 2020-11-16T21:50:27.656 INFO:teuthology.orchestra.run.smithi195.stderr:dd: failed to open '/etc/containers/registries.conf': No such file or directory 2020-11-16T21:50:27.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-16T21:50:27.656 INFO:tasks.cephadm:Failed to add mirror: [Errno 2] Cannot find file on the remote 'ubuntu@smithi195.front.sepia.ceph.com': '/etc/containers/registries.conf' 2020-11-16T21:50:27.657 INFO:teuthology.orchestra.run.smithi016:> set -ex 2020-11-16T21:50:27.657 INFO:teuthology.orchestra.run.smithi016:> dd if=/etc/containers/registries.conf of=/dev/stdout 2020-11-16T21:50:27.661 INFO:teuthology.orchestra.run.smithi016.stderr:+ dd if=/etc/containers/registries.conf of=/dev/stdout 2020-11-16T21:50:27.663 INFO:teuthology.orchestra.run.smithi016.stderr:dd: failed to open '/etc/containers/registries.conf': No such file or directory 2020-11-16T21:50:27.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-16T21:50:27.663 INFO:tasks.cephadm:Failed to add mirror: [Errno 2] Cannot find file on the remote 'ubuntu@smithi016.front.sepia.ceph.com': '/etc/containers/registries.conf' 2020-11-16T21:50:27.663 INFO:teuthology.orchestra.run.smithi057:> set -ex 2020-11-16T21:50:27.664 INFO:teuthology.orchestra.run.smithi057:> dd if=/etc/containers/registries.conf of=/dev/stdout 2020-11-16T21:50:27.668 INFO:teuthology.orchestra.run.smithi057.stderr:+ dd if=/etc/containers/registries.conf of=/dev/stdout 2020-11-16T21:50:27.670 INFO:teuthology.orchestra.run.smithi057.stderr:dd: failed to open '/etc/containers/registries.conf': No such file or directory 2020-11-16T21:50:27.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-16T21:50:27.670 INFO:tasks.cephadm:Failed to add mirror: [Errno 2] Cannot find file on the remote 'ubuntu@smithi057.front.sepia.ceph.com': '/etc/containers/registries.conf' 2020-11-16T21:50:27.670 INFO:tasks.cephadm:Writing seed config... 2020-11-16T21:50:27.671 INFO:tasks.cephadm: override: [global] mon client directed command retry = 5 2020-11-16T21:50:27.672 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2020-11-16T21:50:27.672 INFO:tasks.cephadm: override: [global] ms bind msgr2 = False 2020-11-16T21:50:27.672 INFO:tasks.cephadm: override: [global] ms inject delay max = 1 2020-11-16T21:50:27.672 INFO:tasks.cephadm: override: [global] ms inject delay probability = 0.005 2020-11-16T21:50:27.673 INFO:tasks.cephadm: override: [global] ms inject delay type = osd 2020-11-16T21:50:27.673 INFO:tasks.cephadm: override: [global] ms inject internal delays = 0.002 2020-11-16T21:50:27.673 INFO:tasks.cephadm: override: [global] ms inject socket failures = 2500 2020-11-16T21:50:27.673 INFO:tasks.cephadm: override: [global] ms type = async 2020-11-16T21:50:27.673 INFO:tasks.cephadm: override: [global] osd_pool_default_min_size = 2 2020-11-16T21:50:27.674 INFO:tasks.cephadm: override: [global] osd_pool_default_size = 2 2020-11-16T21:50:27.674 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2020-11-16T21:50:27.674 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2020-11-16T21:50:27.674 INFO:tasks.cephadm: override: [mon] debug mon = 20 2020-11-16T21:50:27.674 INFO:tasks.cephadm: override: [mon] debug ms = 1 2020-11-16T21:50:27.675 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2020-11-16T21:50:27.675 INFO:tasks.cephadm: override: [osd] debug filestore = 20 2020-11-16T21:50:27.675 INFO:tasks.cephadm: override: [osd] debug journal = 20 2020-11-16T21:50:27.675 INFO:tasks.cephadm: override: [osd] debug ms = 20 2020-11-16T21:50:27.676 INFO:tasks.cephadm: override: [osd] debug osd = 25 2020-11-16T21:50:27.676 INFO:tasks.cephadm: override: [osd] osd backoff on degraded = True 2020-11-16T21:50:27.676 INFO:tasks.cephadm: override: [osd] osd backoff on peering = True 2020-11-16T21:50:27.676 INFO:tasks.cephadm: override: [osd] osd debug verify cached snaps = True 2020-11-16T21:50:27.677 INFO:tasks.cephadm: override: [osd] osd debug verify missing on start = True 2020-11-16T21:50:27.677 INFO:tasks.cephadm: override: [osd] osd max markdown count = 1000 2020-11-16T21:50:27.677 INFO:tasks.cephadm: override: [osd] osd op queue = debug_random 2020-11-16T21:50:27.677 INFO:tasks.cephadm: override: [osd] osd op queue cut off = debug_random 2020-11-16T21:50:27.677 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2020-11-16T21:50:27.678 INFO:teuthology.orchestra.run.smithi195:> set -ex 2020-11-16T21:50:27.678 INFO:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2020-11-16T21:50:27.702 INFO:teuthology.orchestra.run.smithi195.stderr:+ dd of=/home/ubuntu/cephtest/seed.ceph.conf 2020-11-16T21:50:27.704 INFO:teuthology.orchestra.run.smithi195.stderr:5+1 records in 2020-11-16T21:50:27.704 INFO:teuthology.orchestra.run.smithi195.stderr:5+1 records out 2020-11-16T21:50:27.704 INFO:teuthology.orchestra.run.smithi195.stderr:2649 bytes (2.6 kB, 2.6 KiB) copied, 0.000106943 s, 24.8 MB/s 2020-11-16T21:50:27.704 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = bcd5108e-2855-11eb-a2b2-001a4aab830c mon client directed command retry = 5 mon election default strategy = 1 ms bind msgr2 = False ms inject delay max = 1 ms inject delay probability = 0.005 ms inject delay type = osd ms inject internal delays = 0.002 ms inject socket failures = 2500 ms type = async osd_pool_default_min_size = 2 osd_pool_default_size = 2 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = True osd debug verify missing on start = True osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug filestore = 20 debug journal = 20 debug ms = 20 debug osd = 25 osd backoff on degraded = True osd backoff on peering = True osd max markdown count = 1000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2020-11-16T21:50:27.705 INFO:teuthology.orchestra.run.smithi195:mon.a> sudo journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mon.a.service 2020-11-16T21:50:27.748 INFO:teuthology.orchestra.run.smithi195:mgr.y> sudo journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mgr.y.service 2020-11-16T21:50:27.791 INFO:tasks.cephadm:Bootstrapping... 2020-11-16T21:50:27.792 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -v bootstrap --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.195:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2020-11-16T21:50:27.809 INFO:journalctl@ceph.mon.a.smithi195.stdout:-- Logs begin at Sun 2020-11-15 12:21:41 UTC. -- 2020-11-16T21:50:27.812 INFO:journalctl@ceph.mgr.y.smithi195.stdout:-- Logs begin at Sun 2020-11-15 12:21:41 UTC. -- 2020-11-16T21:50:28.093 INFO:teuthology.orchestra.run.smithi195.stderr:Could not locate podman: podman not found 2020-11-16T21:50:28.093 INFO:teuthology.orchestra.run.smithi195.stderr:Verifying podman|docker is present... 2020-11-16T21:50:28.093 INFO:teuthology.orchestra.run.smithi195.stderr:Verifying lvm2 is present... 2020-11-16T21:50:28.094 INFO:teuthology.orchestra.run.smithi195.stderr:Verifying time synchronization is in place... 2020-11-16T21:50:28.094 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-enabled chrony.service 2020-11-16T21:50:28.100 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2020-11-16T21:50:28.101 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-active chrony.service 2020-11-16T21:50:28.108 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stdout inactive 2020-11-16T21:50:28.108 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-enabled chronyd.service 2020-11-16T21:50:28.114 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stderr Failed to get unit file state for chronyd.service: No such file or directory 2020-11-16T21:50:28.115 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-active chronyd.service 2020-11-16T21:50:28.122 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stdout inactive 2020-11-16T21:50:28.122 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-enabled systemd-timesyncd.service 2020-11-16T21:50:28.130 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stdout enabled 2020-11-16T21:50:28.131 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-active systemd-timesyncd.service 2020-11-16T21:50:28.138 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stdout inactive 2020-11-16T21:50:28.139 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-enabled ntpd.service 2020-11-16T21:50:28.144 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stderr Failed to get unit file state for ntpd.service: No such file or directory 2020-11-16T21:50:28.145 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-active ntpd.service 2020-11-16T21:50:28.151 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stdout inactive 2020-11-16T21:50:28.152 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-enabled ntp.service 2020-11-16T21:50:28.159 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stdout enabled 2020-11-16T21:50:28.159 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-active ntp.service 2020-11-16T21:50:28.166 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stdout active 2020-11-16T21:50:28.167 INFO:teuthology.orchestra.run.smithi195.stderr:Unit ntp.service is enabled and running 2020-11-16T21:50:28.167 INFO:teuthology.orchestra.run.smithi195.stderr:Repeating the final host check... 2020-11-16T21:50:28.167 INFO:teuthology.orchestra.run.smithi195.stderr:Could not locate podman: podman not found 2020-11-16T21:50:28.168 INFO:teuthology.orchestra.run.smithi195.stderr:podman|docker (/usr/bin/docker) is present 2020-11-16T21:50:28.168 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl is present 2020-11-16T21:50:28.168 INFO:teuthology.orchestra.run.smithi195.stderr:lvcreate is present 2020-11-16T21:50:28.168 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-enabled chrony.service 2020-11-16T21:50:28.175 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2020-11-16T21:50:28.175 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-active chrony.service 2020-11-16T21:50:28.182 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stdout inactive 2020-11-16T21:50:28.183 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-enabled chronyd.service 2020-11-16T21:50:28.189 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stderr Failed to get unit file state for chronyd.service: No such file or directory 2020-11-16T21:50:28.190 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-active chronyd.service 2020-11-16T21:50:28.197 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stdout inactive 2020-11-16T21:50:28.197 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-enabled systemd-timesyncd.service 2020-11-16T21:50:28.205 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stdout enabled 2020-11-16T21:50:28.205 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-active systemd-timesyncd.service 2020-11-16T21:50:28.212 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stdout inactive 2020-11-16T21:50:28.213 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-enabled ntpd.service 2020-11-16T21:50:28.219 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stderr Failed to get unit file state for ntpd.service: No such file or directory 2020-11-16T21:50:28.220 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-active ntpd.service 2020-11-16T21:50:28.228 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stdout inactive 2020-11-16T21:50:28.228 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-enabled ntp.service 2020-11-16T21:50:28.237 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stdout enabled 2020-11-16T21:50:28.237 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl is-active ntp.service 2020-11-16T21:50:28.243 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stdout active 2020-11-16T21:50:28.244 INFO:teuthology.orchestra.run.smithi195.stderr:Unit ntp.service is enabled and running 2020-11-16T21:50:28.244 INFO:teuthology.orchestra.run.smithi195.stderr:Host looks OK 2020-11-16T21:50:28.244 INFO:teuthology.orchestra.run.smithi195.stderr:Cluster fsid: bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:50:28.245 INFO:teuthology.orchestra.run.smithi195.stderr:Acquiring lock 139821507717160 on /run/cephadm/bcd5108e-2855-11eb-a2b2-001a4aab830c.lock 2020-11-16T21:50:28.245 INFO:teuthology.orchestra.run.smithi195.stderr:Lock 139821507717160 acquired on /run/cephadm/bcd5108e-2855-11eb-a2b2-001a4aab830c.lock 2020-11-16T21:50:28.245 INFO:teuthology.orchestra.run.smithi195.stderr:Verifying IP 172.21.15.195 port 6789 ... 2020-11-16T21:50:28.246 INFO:teuthology.orchestra.run.smithi195.stderr:Base mon IP is 172.21.15.195, final addrv is [v1:172.21.15.195:6789] 2020-11-16T21:50:28.246 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /sbin/ip route ls 2020-11-16T21:50:28.248 INFO:teuthology.orchestra.run.smithi195.stderr:/sbin/ip:stdout default via 172.21.15.254 dev enp3s0f1 2020-11-16T21:50:28.249 INFO:teuthology.orchestra.run.smithi195.stderr:/sbin/ip:stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.195 2020-11-16T21:50:28.250 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /sbin/ip -6 route ls 2020-11-16T21:50:28.252 INFO:teuthology.orchestra.run.smithi195.stderr:/sbin/ip:stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2020-11-16T21:50:28.252 INFO:teuthology.orchestra.run.smithi195.stderr:/sbin/ip:stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1609sec hoplimit 64 pref medium 2020-11-16T21:50:28.253 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /sbin/ip -6 addr ls 2020-11-16T21:50:28.255 INFO:teuthology.orchestra.run.smithi195.stderr:/sbin/ip:stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2020-11-16T21:50:28.255 INFO:teuthology.orchestra.run.smithi195.stderr:/sbin/ip:stdout inet6 ::1/128 scope host 2020-11-16T21:50:28.256 INFO:teuthology.orchestra.run.smithi195.stderr:/sbin/ip:stdout valid_lft forever preferred_lft forever 2020-11-16T21:50:28.256 INFO:teuthology.orchestra.run.smithi195.stderr:/sbin/ip:stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2020-11-16T21:50:28.256 INFO:teuthology.orchestra.run.smithi195.stderr:/sbin/ip:stdout inet6 fe80::ec4:7aff:fe88:8081/64 scope link 2020-11-16T21:50:28.256 INFO:teuthology.orchestra.run.smithi195.stderr:/sbin/ip:stdout valid_lft forever preferred_lft forever 2020-11-16T21:50:28.257 INFO:teuthology.orchestra.run.smithi195.stderr:Mon IP 172.21.15.195 is in CIDR network 172.21.0.0/20 2020-11-16T21:50:28.258 INFO:teuthology.orchestra.run.smithi195.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b... 2020-11-16T21:50:28.258 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker pull quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b 2020-11-16T21:50:33.525 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/docker:stdout 911cc35794d871071a8bebfb0919482263b1d18b: Pulling from ceph-ci/ceph 2020-11-16T21:50:33.525 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/docker:stdout 670545126cfd: Pulling fs layer 2020-11-16T21:50:33.526 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/docker:stdout 3f2f4b202cb4: Pulling fs layer 2020-11-16T21:50:34.196 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/docker:stdout 670545126cfd: Verifying Checksum 2020-11-16T21:50:34.197 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/docker:stdout 670545126cfd: Download complete 2020-11-16T21:50:35.767 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/docker:stdout 3f2f4b202cb4: Verifying Checksum 2020-11-16T21:50:35.767 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/docker:stdout 3f2f4b202cb4: Download complete 2020-11-16T21:50:36.862 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/docker:stdout 670545126cfd: Pull complete 2020-11-16T21:50:45.400 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/docker:stdout 3f2f4b202cb4: Pull complete 2020-11-16T21:50:45.476 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/docker:stdout Digest: sha256:36772338efd2a92e0297ab750b23ee2468cda1ac9f75c30b71ac996d1ab608af 2020-11-16T21:50:45.526 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/docker:stdout Status: Downloaded newer image for quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b 2020-11-16T21:50:45.527 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/docker:stdout quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b 2020-11-16T21:50:45.530 INFO:teuthology.orchestra.run.smithi195.stderr:Extracting ceph user uid/gid from container image... 2020-11-16T21:50:45.530 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint stat -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -c %u %g /var/lib/ceph 2020-11-16T21:50:53.157 INFO:teuthology.orchestra.run.smithi195.stderr:stat:stdout 167 167 2020-11-16T21:50:53.741 INFO:teuthology.orchestra.run.smithi195.stderr:Creating initial keys... 2020-11-16T21:50:53.742 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b --gen-print-key 2020-11-16T21:50:54.610 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-authtool:stdout AQA+9LJfB582JRAA58iDrRp5W8mav4SURtGJ3A== 2020-11-16T21:50:55.143 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b --gen-print-key 2020-11-16T21:50:55.959 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-authtool:stdout AQA/9LJf3C35ORAAG+q0ODXnI2d4Vxy0W3H9Rg== 2020-11-16T21:50:56.490 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b --gen-print-key 2020-11-16T21:50:57.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-authtool:stdout AQBB9LJfaVypEhAATYAKX5LjhpRlXTOqSZmy0Q== 2020-11-16T21:50:57.821 INFO:teuthology.orchestra.run.smithi195.stderr:Creating initial monmap... 2020-11-16T21:50:57.821 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/monmaptool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /tmp/ceph-tmpr6oqbjj6:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b --create --clobber --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c --addv a [v1:172.21.15.195:6789] /tmp/monmap 2020-11-16T21:50:58.747 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2020-11-16T21:50:58.747 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: set fsid to bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:50:58.747 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2020-11-16T21:50:59.327 INFO:teuthology.orchestra.run.smithi195.stderr:Creating mon... 2020-11-16T21:50:59.328 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-mon -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmp2oyl7e54:/tmp/keyring:z -v /tmp/ceph-tmpr6oqbjj6:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b --mkfs -i a --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2020-11-16T21:51:00.241 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 0 set uid:gid to 167:167 (ceph:ceph) 2020-11-16T21:51:00.241 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 1 imported monmap: 2020-11-16T21:51:00.242 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr epoch 0 2020-11-16T21:51:00.242 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr fsid bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:51:00.242 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr last_changed 2020-11-16T21:50:58.760728+0000 2020-11-16T21:51:00.242 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr created 2020-11-16T21:50:58.760728+0000 2020-11-16T21:51:00.243 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr min_mon_release 0 (unknown) 2020-11-16T21:51:00.243 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr election_strategy: 1 2020-11-16T21:51:00.243 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 0: v1:172.21.15.195:6789/0 mon.a 2020-11-16T21:51:00.244 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.244 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 0 /usr/bin/ceph-mon: set fsid to bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:51:00.244 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: RocksDB version: 6.8.1 2020-11-16T21:51:00.244 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.244 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2020-11-16T21:51:00.245 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Compile date Nov 16 2020 2020-11-16T21:51:00.245 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: DB SUMMARY 2020-11-16T21:51:00.245 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.245 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2020-11-16T21:51:00.245 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.245 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2020-11-16T21:51:00.245 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.246 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.error_if_exists: 0 2020-11-16T21:51:00.246 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.create_if_missing: 1 2020-11-16T21:51:00.246 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.paranoid_checks: 1 2020-11-16T21:51:00.262 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.env: 0x5624a9b22100 2020-11-16T21:51:00.263 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.fs: Posix File System 2020-11-16T21:51:00.263 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.info_log: 0x5624ab9a6b60 2020-11-16T21:51:00.263 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.max_file_opening_threads: 16 2020-11-16T21:51:00.263 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.statistics: (nil) 2020-11-16T21:51:00.263 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.use_fsync: 0 2020-11-16T21:51:00.263 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.max_log_file_size: 0 2020-11-16T21:51:00.264 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2020-11-16T21:51:00.264 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.log_file_time_to_roll: 0 2020-11-16T21:51:00.264 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.keep_log_file_num: 1000 2020-11-16T21:51:00.264 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.recycle_log_file_num: 0 2020-11-16T21:51:00.264 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.allow_fallocate: 1 2020-11-16T21:51:00.264 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.allow_mmap_reads: 0 2020-11-16T21:51:00.264 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.allow_mmap_writes: 0 2020-11-16T21:51:00.265 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.use_direct_reads: 0 2020-11-16T21:51:00.265 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2020-11-16T21:51:00.265 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.create_missing_column_families: 0 2020-11-16T21:51:00.265 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.db_log_dir: 2020-11-16T21:51:00.265 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2020-11-16T21:51:00.265 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.table_cache_numshardbits: 6 2020-11-16T21:51:00.265 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.max_subcompactions: 1 2020-11-16T21:51:00.266 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.max_background_flushes: -1 2020-11-16T21:51:00.266 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.WAL_ttl_seconds: 0 2020-11-16T21:51:00.266 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.WAL_size_limit_MB: 0 2020-11-16T21:51:00.266 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2020-11-16T21:51:00.266 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2020-11-16T21:51:00.266 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.is_fd_close_on_exec: 1 2020-11-16T21:51:00.266 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.advise_random_on_open: 1 2020-11-16T21:51:00.267 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.db_write_buffer_size: 0 2020-11-16T21:51:00.267 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.write_buffer_manager: 0x5624ab966f00 2020-11-16T21:51:00.267 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2020-11-16T21:51:00.267 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2020-11-16T21:51:00.267 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2020-11-16T21:51:00.267 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.use_adaptive_mutex: 0 2020-11-16T21:51:00.268 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.rate_limiter: (nil) 2020-11-16T21:51:00.268 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2020-11-16T21:51:00.268 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.wal_recovery_mode: 2 2020-11-16T21:51:00.268 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.enable_thread_tracking: 0 2020-11-16T21:51:00.268 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.enable_pipelined_write: 0 2020-11-16T21:51:00.268 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.unordered_write: 0 2020-11-16T21:51:00.268 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2020-11-16T21:51:00.269 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2020-11-16T21:51:00.269 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2020-11-16T21:51:00.269 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2020-11-16T21:51:00.269 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.row_cache: None 2020-11-16T21:51:00.269 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.wal_filter: None 2020-11-16T21:51:00.269 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2020-11-16T21:51:00.269 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.allow_ingest_behind: 0 2020-11-16T21:51:00.270 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.preserve_deletes: 0 2020-11-16T21:51:00.270 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.two_write_queues: 0 2020-11-16T21:51:00.270 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.manual_wal_flush: 0 2020-11-16T21:51:00.270 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.atomic_flush: 0 2020-11-16T21:51:00.270 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2020-11-16T21:51:00.270 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.persist_stats_to_disk: 0 2020-11-16T21:51:00.270 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.write_dbid_to_manifest: 0 2020-11-16T21:51:00.271 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.log_readahead_size: 0 2020-11-16T21:51:00.271 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2020-11-16T21:51:00.271 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.max_background_jobs: 2 2020-11-16T21:51:00.271 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.max_background_compactions: -1 2020-11-16T21:51:00.271 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2020-11-16T21:51:00.271 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2020-11-16T21:51:00.271 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.delayed_write_rate : 16777216 2020-11-16T21:51:00.272 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.max_total_wal_size: 0 2020-11-16T21:51:00.272 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2020-11-16T21:51:00.272 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.stats_dump_period_sec: 600 2020-11-16T21:51:00.272 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.stats_persist_period_sec: 600 2020-11-16T21:51:00.272 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2020-11-16T21:51:00.272 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.max_open_files: -1 2020-11-16T21:51:00.272 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.bytes_per_sync: 0 2020-11-16T21:51:00.273 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.wal_bytes_per_sync: 0 2020-11-16T21:51:00.273 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.strict_bytes_per_sync: 0 2020-11-16T21:51:00.273 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Options.compaction_readahead_size: 0 2020-11-16T21:51:00.273 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Compression algorithms supported: 2020-11-16T21:51:00.273 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2020-11-16T21:51:00.273 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: kZSTD supported: 0 2020-11-16T21:51:00.273 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: kXpressCompression supported: 0 2020-11-16T21:51:00.274 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: kLZ4HCCompression supported: 1 2020-11-16T21:51:00.274 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: kLZ4Compression supported: 1 2020-11-16T21:51:00.274 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: kBZip2Compression supported: 0 2020-11-16T21:51:00.274 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: kZlibCompression supported: 1 2020-11-16T21:51:00.274 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: kSnappyCompression supported: 1 2020-11-16T21:51:00.274 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: Fast CRC32 supported: Supported on x86 2020-11-16T21:51:00.275 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.252+0000 7fd534567700 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2020-11-16T21:51:00.275 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.275 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2020-11-16T21:51:00.275 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.275 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2020-11-16T21:51:00.275 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.275 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2020-11-16T21:51:00.276 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.merge_operator: 2020-11-16T21:51:00.276 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compaction_filter: None 2020-11-16T21:51:00.276 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compaction_filter_factory: None 2020-11-16T21:51:00.276 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.memtable_factory: SkipListFactory 2020-11-16T21:51:00.276 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.table_factory: BlockBasedTable 2020-11-16T21:51:00.276 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5624ab8bfbc0) 2020-11-16T21:51:00.276 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks: 1 2020-11-16T21:51:00.277 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks_with_high_priority: 1 2020-11-16T21:51:00.277 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr pin_l0_filter_and_index_blocks_in_cache: 0 2020-11-16T21:51:00.277 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr pin_top_level_index_and_filter: 1 2020-11-16T21:51:00.277 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr index_type: 0 2020-11-16T21:51:00.277 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr data_block_index_type: 0 2020-11-16T21:51:00.277 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr index_shortening: 1 2020-11-16T21:51:00.277 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr data_block_hash_table_util_ratio: 0.750000 2020-11-16T21:51:00.278 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr hash_index_allow_collision: 1 2020-11-16T21:51:00.278 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr checksum: 1 2020-11-16T21:51:00.278 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr no_block_cache: 0 2020-11-16T21:51:00.278 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr block_cache: 0x5624ab8f6510 2020-11-16T21:51:00.278 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr block_cache_name: BinnedLRUCache 2020-11-16T21:51:00.278 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr block_cache_options: 2020-11-16T21:51:00.278 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr capacity : 536870912 2020-11-16T21:51:00.279 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr num_shard_bits : 4 2020-11-16T21:51:00.279 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr strict_capacity_limit : 0 2020-11-16T21:51:00.279 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr high_pri_pool_ratio: 0.000 2020-11-16T21:51:00.279 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr block_cache_compressed: (nil) 2020-11-16T21:51:00.279 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr persistent_cache: (nil) 2020-11-16T21:51:00.279 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr block_size: 4096 2020-11-16T21:51:00.279 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr block_size_deviation: 10 2020-11-16T21:51:00.280 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr block_restart_interval: 16 2020-11-16T21:51:00.280 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr index_block_restart_interval: 1 2020-11-16T21:51:00.280 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr metadata_block_size: 4096 2020-11-16T21:51:00.280 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr partition_filters: 0 2020-11-16T21:51:00.280 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr use_delta_encoding: 1 2020-11-16T21:51:00.280 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr filter_policy: rocksdb.BuiltinBloomFilter 2020-11-16T21:51:00.280 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr whole_key_filtering: 1 2020-11-16T21:51:00.281 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr verify_compression: 0 2020-11-16T21:51:00.281 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr read_amp_bytes_per_bit: 0 2020-11-16T21:51:00.281 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr format_version: 2 2020-11-16T21:51:00.281 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr enable_index_compression: 1 2020-11-16T21:51:00.281 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr block_align: 0 2020-11-16T21:51:00.281 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.281 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.write_buffer_size: 33554432 2020-11-16T21:51:00.282 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.max_write_buffer_number: 2 2020-11-16T21:51:00.282 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compression: NoCompression 2020-11-16T21:51:00.282 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.bottommost_compression: Disabled 2020-11-16T21:51:00.282 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.prefix_extractor: nullptr 2020-11-16T21:51:00.282 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2020-11-16T21:51:00.282 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.num_levels: 7 2020-11-16T21:51:00.282 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2020-11-16T21:51:00.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2020-11-16T21:51:00.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2020-11-16T21:51:00.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2020-11-16T21:51:00.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2020-11-16T21:51:00.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2020-11-16T21:51:00.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2020-11-16T21:51:00.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2020-11-16T21:51:00.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2020-11-16T21:51:00.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compression_opts.window_bits: -14 2020-11-16T21:51:00.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compression_opts.level: 32767 2020-11-16T21:51:00.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compression_opts.strategy: 0 2020-11-16T21:51:00.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2020-11-16T21:51:00.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2020-11-16T21:51:00.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compression_opts.enabled: false 2020-11-16T21:51:00.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2020-11-16T21:51:00.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2020-11-16T21:51:00.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2020-11-16T21:51:00.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.target_file_size_base: 67108864 2020-11-16T21:51:00.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.target_file_size_multiplier: 1 2020-11-16T21:51:00.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2020-11-16T21:51:00.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2020-11-16T21:51:00.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2020-11-16T21:51:00.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2020-11-16T21:51:00.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2020-11-16T21:51:00.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2020-11-16T21:51:00.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2020-11-16T21:51:00.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2020-11-16T21:51:00.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2020-11-16T21:51:00.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2020-11-16T21:51:00.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2020-11-16T21:51:00.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2020-11-16T21:51:00.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.arena_block_size: 4194304 2020-11-16T21:51:00.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2020-11-16T21:51:00.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2020-11-16T21:51:00.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2020-11-16T21:51:00.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.disable_auto_compactions: 0 2020-11-16T21:51:00.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2020-11-16T21:51:00.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2020-11-16T21:51:00.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2020-11-16T21:51:00.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2020-11-16T21:51:00.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2020-11-16T21:51:00.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2020-11-16T21:51:00.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2020-11-16T21:51:00.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2020-11-16T21:51:00.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2020-11-16T21:51:00.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2020-11-16T21:51:00.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.table_properties_collectors: 2020-11-16T21:51:00.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.inplace_update_support: 0 2020-11-16T21:51:00.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.inplace_update_num_locks: 10000 2020-11-16T21:51:00.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2020-11-16T21:51:00.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2020-11-16T21:51:00.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.memtable_huge_page_size: 0 2020-11-16T21:51:00.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.bloom_locality: 0 2020-11-16T21:51:00.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.max_successive_merges: 0 2020-11-16T21:51:00.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.optimize_filters_for_hits: 0 2020-11-16T21:51:00.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.paranoid_file_checks: 0 2020-11-16T21:51:00.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.force_consistency_checks: 0 2020-11-16T21:51:00.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.report_bg_io_stats: 0 2020-11-16T21:51:00.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.ttl: 2592000 2020-11-16T21:51:00.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: Options.periodic_compaction_seconds: 0 2020-11-16T21:51:00.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2020-11-16T21:51:00.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.256+0000 7fd534567700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2020-11-16T21:51:00.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.260+0000 7fd534567700 4 rocksdb: DB pointer 0x5624ab947800 2020-11-16T21:51:00.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.260+0000 7fd51d426700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2020-11-16T21:51:00.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.260+0000 7fd51d426700 4 rocksdb: [db_impl/db_impl.cc:851] 2020-11-16T21:51:00.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr ** DB Stats ** 2020-11-16T21:51:00.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2020-11-16T21:51:00.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2020-11-16T21:51:00.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2020-11-16T21:51:00.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2020-11-16T21:51:00.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2020-11-16T21:51:00.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2020-11-16T21:51:00.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2020-11-16T21:51:00.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2020-11-16T21:51:00.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-11-16T21:51:00.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-11-16T21:51:00.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-11-16T21:51:00.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-11-16T21:51:00.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2020-11-16T21:51:00.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-11-16T21:51:00.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-11-16T21:51:00.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2020-11-16T21:51:00.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2020-11-16T21:51:00.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2020-11-16T21:51:00.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2020-11-16T21:51:00.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2020-11-16T21:51:00.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2020-11-16T21:51:00.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-11-16T21:51:00.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-11-16T21:51:00.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-11-16T21:51:00.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2020-11-16T21:51:00.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2020-11-16T21:51:00.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-11-16T21:51:00.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-11-16T21:51:00.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-11-16T21:51:00.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-11-16T21:51:00.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2020-11-16T21:51:00.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-11-16T21:51:00.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-11-16T21:51:00.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2020-11-16T21:51:00.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2020-11-16T21:51:00.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2020-11-16T21:51:00.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2020-11-16T21:51:00.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2020-11-16T21:51:00.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2020-11-16T21:51:00.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-11-16T21:51:00.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-11-16T21:51:00.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-11-16T21:51:00.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2020-11-16T21:51:00.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr 2020-11-16T21:51:00.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.264+0000 7fd534567700 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2020-11-16T21:51:00.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.264+0000 7fd534567700 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2020-11-16T21:51:00.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph-mon:stderr "debug "2020-11-16T21:51:00.264+0000 7fd534567700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2020-11-16T21:51:00.808 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:51:00.815 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl disable ceph.target 2020-11-16T21:51:00.825 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2020-11-16T21:51:00.941 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl enable ceph.target 2020-11-16T21:51:00.948 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2020-11-16T21:51:01.064 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl start ceph.target 2020-11-16T21:51:01.072 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl enable ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c.target 2020-11-16T21:51:01.078 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c.target -> /etc/systemd/system/ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c.target. 2020-11-16T21:51:01.078 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c.target -> /etc/systemd/system/ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c.target. 2020-11-16T21:51:01.191 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl start ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c.target 2020-11-16T21:51:01.199 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl daemon-reload 2020-11-16T21:51:01.318 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mon.a 2020-11-16T21:51:01.327 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl reset-failed ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mon.a 2020-11-16T21:51:01.334 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stderr Failed to reset failed state of unit ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mon.a.service: Unit ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mon.a.service is not loaded. 2020-11-16T21:51:01.335 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl enable ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mon.a 2020-11-16T21:51:01.341 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stderr Created symlink /etc/systemd/system/ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c.target.wants/ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mon.a.service -> /etc/systemd/system/ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@.service. 2020-11-16T21:51:01.466 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl start ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mon.a 2020-11-16T21:51:01.521 INFO:teuthology.orchestra.run.smithi195.stderr:firewalld does not appear to be present 2020-11-16T21:51:01.522 INFO:teuthology.orchestra.run.smithi195.stderr:Not possible to enable service . firewalld.service is not available 2020-11-16T21:51:01.522 INFO:teuthology.orchestra.run.smithi195.stderr:Not possible to open ports <[]>. firewalld.service is not available 2020-11-16T21:51:01.522 INFO:teuthology.orchestra.run.smithi195.stderr:Waiting for mon to start... 2020-11-16T21:51:01.523 INFO:teuthology.orchestra.run.smithi195.stderr:Waiting for mon... 2020-11-16T21:51:01.523 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b status 2020-11-16T21:51:01.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:01 smithi195 systemd[1]: Started Ceph mon.a for bcd5108e-2855-11eb-a2b2-001a4aab830c. 2020-11-16T21:51:01.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:01 smithi195 bash[9750]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-mon.a 2020-11-16T21:51:02.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:02 smithi195 bash[9750]: cluster 2020-11-16T21:51:02.723037+0000 mon.a (mon.0) 0 : [INF] mkfs bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:51:02.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:02 smithi195 bash[9750]: cluster 2020-11-16T21:51:02.718373+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2020-11-16T21:51:03.141 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout cluster: 2020-11-16T21:51:03.141 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout id: bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:51:03.142 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout health: HEALTH_OK 2020-11-16T21:51:03.142 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout 2020-11-16T21:51:03.143 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout services: 2020-11-16T21:51:03.143 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout mon: 1 daemons, quorum a (age 0.432184s) 2020-11-16T21:51:03.143 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout mgr: no daemons active 2020-11-16T21:51:03.143 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout osd: 0 osds: 0 up, 0 in 2020-11-16T21:51:03.144 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout 2020-11-16T21:51:03.144 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout data: 2020-11-16T21:51:03.144 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout pools: 0 pools, 0 pgs 2020-11-16T21:51:03.144 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout objects: 0 objects, 0 B 2020-11-16T21:51:03.144 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout usage: 0 B used, 0 B / 0 B avail 2020-11-16T21:51:03.144 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout pgs: 2020-11-16T21:51:03.144 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout 2020-11-16T21:51:03.726 INFO:teuthology.orchestra.run.smithi195.stderr:mon is available 2020-11-16T21:51:03.726 INFO:teuthology.orchestra.run.smithi195.stderr:Assimilating anything we can from ceph.conf... 2020-11-16T21:51:03.727 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z -v /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2020-11-16T21:51:04.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:03 smithi195 bash[9750]: cluster 2020-11-16T21:51:02.722359+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2020-11-16T21:51:04.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:03 smithi195 bash[9750]: cluster 2020-11-16T21:51:02.722494+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=v1:172.21.15.195:6789/0} 2020-11-16T21:51:04.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:03 smithi195 bash[9750]: cluster 2020-11-16T21:51:02.724656+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2020-11-16T21:51:04.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:03 smithi195 bash[9750]: cluster 2020-11-16T21:51:02.727429+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2020-11-16T21:51:04.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:03 smithi195 bash[9750]: cluster 2020-11-16T21:51:02.728117+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2020-11-16T21:51:04.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:03 smithi195 bash[9750]: audit 2020-11-16T21:51:03.154481+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? v1:172.21.15.195:0/2620818204' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2020-11-16T21:51:04.922 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout 2020-11-16T21:51:04.923 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout [global] 2020-11-16T21:51:04.923 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout fsid = bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:51:04.923 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout mon_host = [v1:172.21.15.195:6789] 2020-11-16T21:51:04.923 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout mon_osd_allow_pg_remap = true 2020-11-16T21:51:04.923 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout mon_osd_allow_primary_affinity = true 2020-11-16T21:51:04.923 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout mon_warn_on_no_sortbitwise = false 2020-11-16T21:51:04.924 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout osd_crush_chooseleaf_type = 0 2020-11-16T21:51:04.924 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout 2020-11-16T21:51:04.924 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout [mgr] 2020-11-16T21:51:04.925 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout mgr/telemetry/nag = false 2020-11-16T21:51:04.925 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout 2020-11-16T21:51:04.925 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout [osd] 2020-11-16T21:51:04.925 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout osd_map_max_advance = 10 2020-11-16T21:51:04.925 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout osd_sloppy_crc = true 2020-11-16T21:51:05.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:04 smithi195 bash[9750]: audit 2020-11-16T21:51:04.929572+0000 mon.a (mon.0) 8 : audit [INF] from='client.? v1:172.21.15.195:0/357916694' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2020-11-16T21:51:05.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:04 smithi195 bash[9750]: audit 2020-11-16T21:51:04.935522+0000 mon.a (mon.0) 9 : audit [INF] from='client.? v1:172.21.15.195:0/357916694' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2020-11-16T21:51:05.524 INFO:teuthology.orchestra.run.smithi195.stderr:Generating new minimal ceph.conf... 2020-11-16T21:51:05.524 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z -v /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2020-11-16T21:51:07.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:06 smithi195 bash[9750]: audit 2020-11-16T21:51:06.741952+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? v1:172.21.15.195:0/2972136146' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:51:07.281 INFO:teuthology.orchestra.run.smithi195.stderr:Restarting the monitor... 2020-11-16T21:51:07.282 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl restart ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mon.a 2020-11-16T21:51:07.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:07 smithi195 systemd[1]: Stopping Ceph mon.a for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T21:51:07.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:07 smithi195 bash[9750]: debug 2020-11-16T21:51:07.404+0000 7f3e26d50700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-11-16T21:51:07.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:07 smithi195 bash[9750]: debug 2020-11-16T21:51:07.404+0000 7f3e26d50700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2020-11-16T21:51:08.041 INFO:teuthology.orchestra.run.smithi195.stderr:Setting mon public_network... 2020-11-16T21:51:08.041 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b config set mon public_network 172.21.0.0/20 2020-11-16T21:51:08.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:07 smithi195 docker[10170]: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-mon.a 2020-11-16T21:51:08.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:08 smithi195 systemd[1]: Stopped Ceph mon.a for bcd5108e-2855-11eb-a2b2-001a4aab830c. 2020-11-16T21:51:08.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:08 smithi195 systemd[1]: Starting Ceph mon.a for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T21:51:08.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:08 smithi195 docker[10205]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-mon.a 2020-11-16T21:51:08.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:08 smithi195 systemd[1]: Started Ceph mon.a for bcd5108e-2855-11eb-a2b2-001a4aab830c. 2020-11-16T21:51:08.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:08 smithi195 bash[10218]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-mon.a 2020-11-16T21:51:09.356 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.352+0000 7f5d5b08c700 0 set uid:gid to 167:167 (ceph:ceph) 2020-11-16T21:51:09.357 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.352+0000 7f5d5b08c700 0 ceph version 16.0.0-7219-g911cc357 (911cc35794d871071a8bebfb0919482263b1d18b) pacific (dev), process ceph-mon, pid 1 2020-11-16T21:51:09.357 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.352+0000 7f5d5b08c700 0 pidfile_write: ignore empty --pid-file 2020-11-16T21:51:09.357 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 0 load: jerasure load: lrc load: isa 2020-11-16T21:51:09.357 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: RocksDB version: 6.8.1 2020-11-16T21:51:09.357 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2020-11-16T21:51:09.357 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Compile date Nov 16 2020 2020-11-16T21:51:09.358 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: DB SUMMARY 2020-11-16T21:51:09.358 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: CURRENT file: CURRENT 2020-11-16T21:51:09.358 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: IDENTITY file: IDENTITY 2020-11-16T21:51:09.358 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2020-11-16T21:51:09.358 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2020-11-16T21:51:09.358 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 71561 ; 2020-11-16T21:51:09.359 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.error_if_exists: 0 2020-11-16T21:51:09.359 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.create_if_missing: 0 2020-11-16T21:51:09.359 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.paranoid_checks: 1 2020-11-16T21:51:09.359 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.env: 0x55eef62f8100 2020-11-16T21:51:09.359 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.fs: Posix File System 2020-11-16T21:51:09.359 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.info_log: 0x55eef8042a60 2020-11-16T21:51:09.359 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_file_opening_threads: 16 2020-11-16T21:51:09.360 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.statistics: (nil) 2020-11-16T21:51:09.360 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.use_fsync: 0 2020-11-16T21:51:09.360 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_log_file_size: 0 2020-11-16T21:51:09.360 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2020-11-16T21:51:09.360 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.log_file_time_to_roll: 0 2020-11-16T21:51:09.360 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.keep_log_file_num: 1000 2020-11-16T21:51:09.360 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.recycle_log_file_num: 0 2020-11-16T21:51:09.360 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.allow_fallocate: 1 2020-11-16T21:51:09.361 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.allow_mmap_reads: 0 2020-11-16T21:51:09.361 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.allow_mmap_writes: 0 2020-11-16T21:51:09.361 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.use_direct_reads: 0 2020-11-16T21:51:09.361 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2020-11-16T21:51:09.361 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.create_missing_column_families: 0 2020-11-16T21:51:09.361 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.db_log_dir: 2020-11-16T21:51:09.361 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2020-11-16T21:51:09.362 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.table_cache_numshardbits: 6 2020-11-16T21:51:09.362 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_subcompactions: 1 2020-11-16T21:51:09.362 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_background_flushes: -1 2020-11-16T21:51:09.362 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.WAL_ttl_seconds: 0 2020-11-16T21:51:09.362 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.WAL_size_limit_MB: 0 2020-11-16T21:51:09.362 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2020-11-16T21:51:09.363 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2020-11-16T21:51:09.363 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.is_fd_close_on_exec: 1 2020-11-16T21:51:09.363 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.advise_random_on_open: 1 2020-11-16T21:51:09.363 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.db_write_buffer_size: 0 2020-11-16T21:51:09.363 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.write_buffer_manager: 0x55eef808f8f0 2020-11-16T21:51:09.363 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2020-11-16T21:51:09.363 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2020-11-16T21:51:09.363 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2020-11-16T21:51:09.364 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.use_adaptive_mutex: 0 2020-11-16T21:51:09.364 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.rate_limiter: (nil) 2020-11-16T21:51:09.364 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2020-11-16T21:51:09.364 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.wal_recovery_mode: 2 2020-11-16T21:51:09.364 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.enable_thread_tracking: 0 2020-11-16T21:51:09.365 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.enable_pipelined_write: 0 2020-11-16T21:51:09.366 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.unordered_write: 0 2020-11-16T21:51:09.366 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2020-11-16T21:51:09.366 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2020-11-16T21:51:09.366 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2020-11-16T21:51:09.366 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2020-11-16T21:51:09.366 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.row_cache: None 2020-11-16T21:51:09.367 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.wal_filter: None 2020-11-16T21:51:09.367 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2020-11-16T21:51:09.367 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.allow_ingest_behind: 0 2020-11-16T21:51:09.367 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.preserve_deletes: 0 2020-11-16T21:51:09.367 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.two_write_queues: 0 2020-11-16T21:51:09.367 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.manual_wal_flush: 0 2020-11-16T21:51:09.367 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.atomic_flush: 0 2020-11-16T21:51:09.367 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2020-11-16T21:51:09.368 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.persist_stats_to_disk: 0 2020-11-16T21:51:09.368 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.write_dbid_to_manifest: 0 2020-11-16T21:51:09.368 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.log_readahead_size: 0 2020-11-16T21:51:09.368 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2020-11-16T21:51:09.368 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_background_jobs: 2 2020-11-16T21:51:09.368 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_background_compactions: -1 2020-11-16T21:51:09.368 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2020-11-16T21:51:09.369 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2020-11-16T21:51:09.369 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.delayed_write_rate : 16777216 2020-11-16T21:51:09.369 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_total_wal_size: 0 2020-11-16T21:51:09.369 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2020-11-16T21:51:09.369 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.stats_dump_period_sec: 600 2020-11-16T21:51:09.369 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.stats_persist_period_sec: 600 2020-11-16T21:51:09.369 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2020-11-16T21:51:09.370 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_open_files: -1 2020-11-16T21:51:09.370 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.bytes_per_sync: 0 2020-11-16T21:51:09.370 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.wal_bytes_per_sync: 0 2020-11-16T21:51:09.370 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.strict_bytes_per_sync: 0 2020-11-16T21:51:09.370 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compaction_readahead_size: 0 2020-11-16T21:51:09.370 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Compression algorithms supported: 2020-11-16T21:51:09.370 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2020-11-16T21:51:09.371 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: kZSTD supported: 0 2020-11-16T21:51:09.371 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: kXpressCompression supported: 0 2020-11-16T21:51:09.371 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: kLZ4HCCompression supported: 1 2020-11-16T21:51:09.371 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: kLZ4Compression supported: 1 2020-11-16T21:51:09.371 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: kBZip2Compression supported: 0 2020-11-16T21:51:09.371 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: kZlibCompression supported: 1 2020-11-16T21:51:09.371 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: kSnappyCompression supported: 1 2020-11-16T21:51:09.371 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Fast CRC32 supported: Supported on x86 2020-11-16T21:51:09.372 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2020-11-16T21:51:09.372 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2020-11-16T21:51:09.372 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2020-11-16T21:51:09.372 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.merge_operator: 2020-11-16T21:51:09.372 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compaction_filter: None 2020-11-16T21:51:09.372 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compaction_filter_factory: None 2020-11-16T21:51:09.372 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.memtable_factory: SkipListFactory 2020-11-16T21:51:09.373 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.table_factory: BlockBasedTable 2020-11-16T21:51:09.373 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55eef7fe7bb8) 2020-11-16T21:51:09.373 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: cache_index_and_filter_blocks: 1 2020-11-16T21:51:09.373 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: cache_index_and_filter_blocks_with_high_priority: 1 2020-11-16T21:51:09.373 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: pin_l0_filter_and_index_blocks_in_cache: 0 2020-11-16T21:51:09.373 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: pin_top_level_index_and_filter: 1 2020-11-16T21:51:09.373 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: index_type: 0 2020-11-16T21:51:09.373 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: data_block_index_type: 0 2020-11-16T21:51:09.374 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: index_shortening: 1 2020-11-16T21:51:09.374 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: data_block_hash_table_util_ratio: 0.750000 2020-11-16T21:51:09.374 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: hash_index_allow_collision: 1 2020-11-16T21:51:09.374 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: checksum: 1 2020-11-16T21:51:09.374 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: no_block_cache: 0 2020-11-16T21:51:09.374 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: block_cache: 0x55eef801e610 2020-11-16T21:51:09.374 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: block_cache_name: BinnedLRUCache 2020-11-16T21:51:09.375 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: block_cache_options: 2020-11-16T21:51:09.375 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: capacity : 536870912 2020-11-16T21:51:09.375 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: num_shard_bits : 4 2020-11-16T21:51:09.375 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: strict_capacity_limit : 0 2020-11-16T21:51:09.375 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: high_pri_pool_ratio: 0.000 2020-11-16T21:51:09.375 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: block_cache_compressed: (nil) 2020-11-16T21:51:09.375 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: persistent_cache: (nil) 2020-11-16T21:51:09.376 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: block_size: 4096 2020-11-16T21:51:09.376 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: block_size_deviation: 10 2020-11-16T21:51:09.376 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: block_restart_interval: 16 2020-11-16T21:51:09.376 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: index_block_restart_interval: 1 2020-11-16T21:51:09.376 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: metadata_block_size: 4096 2020-11-16T21:51:09.376 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: partition_filters: 0 2020-11-16T21:51:09.376 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: use_delta_encoding: 1 2020-11-16T21:51:09.376 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: filter_policy: rocksdb.BuiltinBloomFilter 2020-11-16T21:51:09.377 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: whole_key_filtering: 1 2020-11-16T21:51:09.377 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: verify_compression: 0 2020-11-16T21:51:09.377 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: read_amp_bytes_per_bit: 0 2020-11-16T21:51:09.377 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: format_version: 2 2020-11-16T21:51:09.377 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: enable_index_compression: 1 2020-11-16T21:51:09.377 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: block_align: 0 2020-11-16T21:51:09.377 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.write_buffer_size: 33554432 2020-11-16T21:51:09.378 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_write_buffer_number: 2 2020-11-16T21:51:09.378 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compression: NoCompression 2020-11-16T21:51:09.378 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.bottommost_compression: Disabled 2020-11-16T21:51:09.378 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.prefix_extractor: nullptr 2020-11-16T21:51:09.378 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2020-11-16T21:51:09.378 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.num_levels: 7 2020-11-16T21:51:09.378 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2020-11-16T21:51:09.378 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2020-11-16T21:51:09.379 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2020-11-16T21:51:09.379 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2020-11-16T21:51:09.379 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2020-11-16T21:51:09.379 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2020-11-16T21:51:09.379 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2020-11-16T21:51:09.379 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2020-11-16T21:51:09.379 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2020-11-16T21:51:09.380 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compression_opts.window_bits: -14 2020-11-16T21:51:09.380 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compression_opts.level: 32767 2020-11-16T21:51:09.380 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compression_opts.strategy: 0 2020-11-16T21:51:09.380 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2020-11-16T21:51:09.380 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2020-11-16T21:51:09.380 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compression_opts.enabled: false 2020-11-16T21:51:09.380 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2020-11-16T21:51:09.381 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2020-11-16T21:51:09.381 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2020-11-16T21:51:09.381 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.target_file_size_base: 67108864 2020-11-16T21:51:09.381 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.target_file_size_multiplier: 1 2020-11-16T21:51:09.381 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2020-11-16T21:51:09.381 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2020-11-16T21:51:09.381 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2020-11-16T21:51:09.382 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2020-11-16T21:51:09.382 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2020-11-16T21:51:09.382 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2020-11-16T21:51:09.382 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2020-11-16T21:51:09.382 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2020-11-16T21:51:09.382 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2020-11-16T21:51:09.382 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2020-11-16T21:51:09.382 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2020-11-16T21:51:09.383 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2020-11-16T21:51:09.383 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.arena_block_size: 4194304 2020-11-16T21:51:09.383 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2020-11-16T21:51:09.383 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2020-11-16T21:51:09.383 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2020-11-16T21:51:09.383 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.disable_auto_compactions: 0 2020-11-16T21:51:09.383 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2020-11-16T21:51:09.384 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2020-11-16T21:51:09.384 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2020-11-16T21:51:09.384 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2020-11-16T21:51:09.384 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2020-11-16T21:51:09.384 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2020-11-16T21:51:09.384 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2020-11-16T21:51:09.384 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2020-11-16T21:51:09.384 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2020-11-16T21:51:09.385 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2020-11-16T21:51:09.385 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.table_properties_collectors: 2020-11-16T21:51:09.385 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.inplace_update_support: 0 2020-11-16T21:51:09.385 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.inplace_update_num_locks: 10000 2020-11-16T21:51:09.385 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2020-11-16T21:51:09.385 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2020-11-16T21:51:09.385 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.memtable_huge_page_size: 0 2020-11-16T21:51:09.386 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.bloom_locality: 0 2020-11-16T21:51:09.386 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.max_successive_merges: 0 2020-11-16T21:51:09.386 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.optimize_filters_for_hits: 0 2020-11-16T21:51:09.386 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.paranoid_file_checks: 0 2020-11-16T21:51:09.386 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.force_consistency_checks: 0 2020-11-16T21:51:09.386 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.report_bg_io_stats: 0 2020-11-16T21:51:09.386 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.ttl: 2592000 2020-11-16T21:51:09.387 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: Options.periodic_compaction_seconds: 0 2020-11-16T21:51:09.387 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2020-11-16T21:51:09.387 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2020-11-16T21:51:09.387 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1605563469360671, "job": 1, "event": "recovery_started", "log_files": [6]} 2020-11-16T21:51:09.387 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.356+0000 7f5d5b08c700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2020-11-16T21:51:09.387 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.360+0000 7f5d5b08c700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2020-11-16T21:51:09.387 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.360+0000 7f5d5b08c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1605563469361863, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 67660, "table_properties": {"data_size": 65957, "index_size": 308, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 581, "raw_key_size": 10452, "raw_average_key_size": 48, "raw_value_size": 60207, "raw_average_value_size": 280, "num_data_blocks": 10, "num_entries": 215, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1605563469, "oldest_key_time": 3, "file_creation_time": 0}} 2020-11-16T21:51:09.388 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.360+0000 7f5d5b08c700 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2020-11-16T21:51:09.388 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.360+0000 7f5d5b08c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1605563469364692, "job": 1, "event": "recovery_finished"} 2020-11-16T21:51:09.388 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.364+0000 7f5d5b08c700 4 rocksdb: DB pointer 0x55eef806f800 2020-11-16T21:51:09.388 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.364+0000 7f5d41ece700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2020-11-16T21:51:09.388 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.364+0000 7f5d41ece700 4 rocksdb: [db_impl/db_impl.cc:851] 2020-11-16T21:51:09.388 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: ** DB Stats ** 2020-11-16T21:51:09.388 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Uptime(secs): 0.0 total, 0.0 interval 2020-11-16T21:51:09.388 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2020-11-16T21:51:09.389 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2020-11-16T21:51:09.389 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2020-11-16T21:51:09.389 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2020-11-16T21:51:09.389 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2020-11-16T21:51:09.389 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2020-11-16T21:51:09.389 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: ** Compaction Stats [default] ** 2020-11-16T21:51:09.389 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-11-16T21:51:09.390 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-11-16T21:51:09.390 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: L0 2/0 67.69 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.1 0.00 0.00 1 0.001 0 0 2020-11-16T21:51:09.390 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Sum 2/0 67.69 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.1 0.00 0.00 1 0.001 0 0 2020-11-16T21:51:09.390 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.1 0.00 0.00 1 0.001 0 0 2020-11-16T21:51:09.390 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: ** Compaction Stats [default] ** 2020-11-16T21:51:09.390 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-11-16T21:51:09.390 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-11-16T21:51:09.391 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 72.1 0.00 0.00 1 0.001 0 0 2020-11-16T21:51:09.391 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Uptime(secs): 0.0 total, 0.0 interval 2020-11-16T21:51:09.391 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Flush(GB): cumulative 0.000, interval 0.000 2020-11-16T21:51:09.391 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: AddFile(GB): cumulative 0.000, interval 0.000 2020-11-16T21:51:09.391 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: AddFile(Total Files): cumulative 0, interval 0 2020-11-16T21:51:09.391 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: AddFile(L0 Files): cumulative 0, interval 0 2020-11-16T21:51:09.391 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: AddFile(Keys): cumulative 0, interval 0 2020-11-16T21:51:09.391 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Cumulative compaction: 0.00 GB write, 9.83 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-11-16T21:51:09.392 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Interval compaction: 0.00 GB write, 9.83 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-11-16T21:51:09.392 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-11-16T21:51:09.392 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: ** File Read Latency Histogram By Level [default] ** 2020-11-16T21:51:09.392 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: ** Compaction Stats [default] ** 2020-11-16T21:51:09.392 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-11-16T21:51:09.392 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-11-16T21:51:09.392 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: L0 2/0 67.69 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.1 0.00 0.00 1 0.001 0 0 2020-11-16T21:51:09.393 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Sum 2/0 67.69 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.1 0.00 0.00 1 0.001 0 0 2020-11-16T21:51:09.393 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-11-16T21:51:09.393 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: ** Compaction Stats [default] ** 2020-11-16T21:51:09.393 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-11-16T21:51:09.393 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-11-16T21:51:09.393 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 72.1 0.00 0.00 1 0.001 0 0 2020-11-16T21:51:09.393 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Uptime(secs): 0.0 total, 0.0 interval 2020-11-16T21:51:09.393 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Flush(GB): cumulative 0.000, interval 0.000 2020-11-16T21:51:09.394 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: AddFile(GB): cumulative 0.000, interval 0.000 2020-11-16T21:51:09.394 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: AddFile(Total Files): cumulative 0, interval 0 2020-11-16T21:51:09.394 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: AddFile(L0 Files): cumulative 0, interval 0 2020-11-16T21:51:09.394 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: AddFile(Keys): cumulative 0, interval 0 2020-11-16T21:51:09.394 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Cumulative compaction: 0.00 GB write, 9.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-11-16T21:51:09.394 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-11-16T21:51:09.394 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-11-16T21:51:09.395 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: ** File Read Latency Histogram By Level [default] ** 2020-11-16T21:51:09.395 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.364+0000 7f5d5b08c700 0 starting mon.a rank 0 at public addrs v1:172.21.15.195:6789/0 at bind addrs v1:172.21.15.195:6789/0 mon_data /var/lib/ceph/mon/ceph-a fsid bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:51:09.395 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.364+0000 7f5d5b08c700 1 mon.a@-1(???) e1 preinit fsid bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:51:09.395 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.364+0000 7f5d5b08c700 0 mon.a@-1(???).mds e1 new map 2020-11-16T21:51:09.395 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.364+0000 7f5d5b08c700 0 mon.a@-1(???).mds e1 print_map 2020-11-16T21:51:09.395 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: e1 2020-11-16T21:51:09.395 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: enable_multiple, ever_enabled_multiple: 0,0 2020-11-16T21:51:09.396 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2020-11-16T21:51:09.396 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: legacy client fscid: -1 2020-11-16T21:51:09.396 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: 2020-11-16T21:51:09.396 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: No filesystems configured 2020-11-16T21:51:09.396 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.364+0000 7f5d5b08c700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2020-11-16T21:51:09.396 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.368+0000 7f5d5b08c700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2020-11-16T21:51:09.396 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.368+0000 7f5d5b08c700 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2020-11-16T21:51:09.396 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.368+0000 7f5d5b08c700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2020-11-16T21:51:09.397 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: audit 2020-11-16T21:51:06.741952+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? v1:172.21.15.195:0/2972136146' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:51:09.397 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.368+0000 7f5d5b08c700 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2020-11-16T21:51:09.397 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.368+0000 7f5d5b08c700 20 expand_channel_meta expand map: {default=false} 2020-11-16T21:51:09.397 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.368+0000 7f5d5b08c700 20 expand_channel_meta from 'false' to 'false' 2020-11-16T21:51:09.397 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.368+0000 7f5d5b08c700 20 expand_channel_meta expanded map: {default=false} 2020-11-16T21:51:09.397 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.368+0000 7f5d5b08c700 20 expand_channel_meta expand map: {default=info} 2020-11-16T21:51:09.397 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.368+0000 7f5d5b08c700 20 expand_channel_meta from 'info' to 'info' 2020-11-16T21:51:09.398 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.368+0000 7f5d5b08c700 20 expand_channel_meta expanded map: {default=info} 2020-11-16T21:51:09.398 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.368+0000 7f5d5b08c700 20 expand_channel_meta expand map: {default=daemon} 2020-11-16T21:51:09.398 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.368+0000 7f5d5b08c700 20 expand_channel_meta from 'daemon' to 'daemon' 2020-11-16T21:51:09.398 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.368+0000 7f5d5b08c700 20 expand_channel_meta expanded map: {default=daemon} 2020-11-16T21:51:09.398 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.368+0000 7f5d5b08c700 20 expand_channel_meta expand map: {default=debug} 2020-11-16T21:51:09.398 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.368+0000 7f5d5b08c700 20 expand_channel_meta from 'debug' to 'debug' 2020-11-16T21:51:09.398 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:09 smithi195 bash[10218]: debug 2020-11-16T21:51:09.368+0000 7f5d5b08c700 20 expand_channel_meta expanded map: {default=debug} 2020-11-16T21:51:10.260 INFO:teuthology.orchestra.run.smithi195.stderr:Creating mgr... 2020-11-16T21:51:10.261 INFO:teuthology.orchestra.run.smithi195.stderr:Verifying port 9283 ... 2020-11-16T21:51:10.263 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl daemon-reload 2020-11-16T21:51:10.372 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mgr.y 2020-11-16T21:51:10.381 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl reset-failed ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mgr.y 2020-11-16T21:51:10.387 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stderr Failed to reset failed state of unit ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mgr.y.service: Unit ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mgr.y.service is not loaded. 2020-11-16T21:51:10.388 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl enable ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mgr.y 2020-11-16T21:51:10.395 INFO:teuthology.orchestra.run.smithi195.stderr:systemctl:stderr Created symlink /etc/systemd/system/ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c.target.wants/ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mgr.y.service -> /etc/systemd/system/ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@.service. 2020-11-16T21:51:10.518 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: systemctl start ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mgr.y 2020-11-16T21:51:10.525 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:10 smithi195 bash[10218]: cluster 2020-11-16T21:51:09.373837+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2020-11-16T21:51:10.526 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:10 smithi195 bash[10218]: cluster 2020-11-16T21:51:09.373907+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=v1:172.21.15.195:6789/0} 2020-11-16T21:51:10.526 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:10 smithi195 bash[10218]: cluster 2020-11-16T21:51:09.373945+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2020-11-16T21:51:10.526 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:10 smithi195 bash[10218]: cluster 2020-11-16T21:51:09.373975+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2020-11-16T21:51:10.526 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:10 smithi195 bash[10218]: cluster 2020-11-16T21:51:09.374318+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2020-11-16T21:51:10.526 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:10 smithi195 bash[10218]: audit 2020-11-16T21:51:09.618971+0000 mon.a (mon.0) 6 : audit [INF] from='client.? v1:172.21.15.195:0/2185857873' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]: dispatch 2020-11-16T21:51:10.526 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:10 smithi195 bash[10218]: audit 2020-11-16T21:51:09.621543+0000 mon.a (mon.0) 7 : audit [INF] from='client.? v1:172.21.15.195:0/2185857873' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]': finished 2020-11-16T21:51:10.575 INFO:teuthology.orchestra.run.smithi195.stderr:firewalld does not appear to be present 2020-11-16T21:51:10.576 INFO:teuthology.orchestra.run.smithi195.stderr:Not possible to enable service . firewalld.service is not available 2020-11-16T21:51:10.576 INFO:teuthology.orchestra.run.smithi195.stderr:Not possible to open ports <[]>. firewalld.service is not available 2020-11-16T21:51:10.576 INFO:teuthology.orchestra.run.smithi195.stderr:firewalld does not appear to be present 2020-11-16T21:51:10.577 INFO:teuthology.orchestra.run.smithi195.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2020-11-16T21:51:10.577 INFO:teuthology.orchestra.run.smithi195.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2020-11-16T21:51:10.577 INFO:teuthology.orchestra.run.smithi195.stderr:Wrote config to /etc/ceph/ceph.conf 2020-11-16T21:51:10.578 INFO:teuthology.orchestra.run.smithi195.stderr:Waiting for mgr to start... 2020-11-16T21:51:10.578 INFO:teuthology.orchestra.run.smithi195.stderr:Waiting for mgr... 2020-11-16T21:51:10.578 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b status -f json-pretty 2020-11-16T21:51:10.847 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:10 smithi195 systemd[1]: Started Ceph mgr.y for bcd5108e-2855-11eb-a2b2-001a4aab830c. 2020-11-16T21:51:10.847 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:10 smithi195 bash[10493]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-mgr.y 2020-11-16T21:51:12.411 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout 2020-11-16T21:51:12.412 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:12.412 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "fsid": "bcd5108e-2855-11eb-a2b2-001a4aab830c", 2020-11-16T21:51:12.412 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "health": { 2020-11-16T21:51:12.412 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2020-11-16T21:51:12.412 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "checks": {}, 2020-11-16T21:51:12.413 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "mutes": [] 2020-11-16T21:51:12.413 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:12.413 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "election_epoch": 5, 2020-11-16T21:51:12.413 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "quorum": [ 2020-11-16T21:51:12.413 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout 0 2020-11-16T21:51:12.413 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:12.413 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "quorum_names": [ 2020-11-16T21:51:12.414 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "a" 2020-11-16T21:51:12.414 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:12.414 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "quorum_age": 3, 2020-11-16T21:51:12.414 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "monmap": { 2020-11-16T21:51:12.414 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "epoch": 1, 2020-11-16T21:51:12.414 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min_mon_release_name": "pacific", 2020-11-16T21:51:12.414 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_mons": 1 2020-11-16T21:51:12.415 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:12.415 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "osdmap": { 2020-11-16T21:51:12.415 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "epoch": 1, 2020-11-16T21:51:12.415 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_osds": 0, 2020-11-16T21:51:12.415 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_up_osds": 0, 2020-11-16T21:51:12.415 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "osd_up_since": 0, 2020-11-16T21:51:12.418 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_in_osds": 0, 2020-11-16T21:51:12.418 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "osd_in_since": 0, 2020-11-16T21:51:12.418 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2020-11-16T21:51:12.418 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:12.418 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pgmap": { 2020-11-16T21:51:12.418 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pgs_by_state": [], 2020-11-16T21:51:12.419 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_pgs": 0, 2020-11-16T21:51:12.419 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_pools": 0, 2020-11-16T21:51:12.419 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_objects": 0, 2020-11-16T21:51:12.419 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "data_bytes": 0, 2020-11-16T21:51:12.419 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "bytes_used": 0, 2020-11-16T21:51:12.419 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "bytes_avail": 0, 2020-11-16T21:51:12.419 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "bytes_total": 0 2020-11-16T21:51:12.419 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:12.420 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "fsmap": { 2020-11-16T21:51:12.420 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "epoch": 1, 2020-11-16T21:51:12.420 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "by_rank": [], 2020-11-16T21:51:12.420 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "up:standby": 0 2020-11-16T21:51:12.420 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:12.420 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "mgrmap": { 2020-11-16T21:51:12.420 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "available": false, 2020-11-16T21:51:12.421 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_standbys": 0, 2020-11-16T21:51:12.421 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "modules": [ 2020-11-16T21:51:12.421 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "iostat", 2020-11-16T21:51:12.421 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "restful" 2020-11-16T21:51:12.421 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:12.421 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "services": {} 2020-11-16T21:51:12.421 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:12.421 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "servicemap": { 2020-11-16T21:51:12.422 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "epoch": 1, 2020-11-16T21:51:12.422 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "modified": "2020-11-16T21:51:02.723704+0000", 2020-11-16T21:51:12.422 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "services": {} 2020-11-16T21:51:12.422 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:12.422 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "progress_events": {} 2020-11-16T21:51:12.422 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:12.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:12 smithi195 bash[10218]: audit 2020-11-16T21:51:12.423930+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? v1:172.21.15.195:0/3499785786' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2020-11-16T21:51:13.055 INFO:teuthology.orchestra.run.smithi195.stderr:mgr not available, waiting (1/10)... 2020-11-16T21:51:14.057 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b status -f json-pretty 2020-11-16T21:51:15.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout 2020-11-16T21:51:15.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:15.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "fsid": "bcd5108e-2855-11eb-a2b2-001a4aab830c", 2020-11-16T21:51:15.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "health": { 2020-11-16T21:51:15.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2020-11-16T21:51:15.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "checks": {}, 2020-11-16T21:51:15.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "mutes": [] 2020-11-16T21:51:15.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:15.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "election_epoch": 5, 2020-11-16T21:51:15.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "quorum": [ 2020-11-16T21:51:15.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout 0 2020-11-16T21:51:15.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:15.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "quorum_names": [ 2020-11-16T21:51:15.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "a" 2020-11-16T21:51:15.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:15.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "quorum_age": 5, 2020-11-16T21:51:15.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "monmap": { 2020-11-16T21:51:15.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "epoch": 1, 2020-11-16T21:51:15.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min_mon_release_name": "pacific", 2020-11-16T21:51:15.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_mons": 1 2020-11-16T21:51:15.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:15.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "osdmap": { 2020-11-16T21:51:15.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "epoch": 1, 2020-11-16T21:51:15.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_osds": 0, 2020-11-16T21:51:15.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_up_osds": 0, 2020-11-16T21:51:15.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "osd_up_since": 0, 2020-11-16T21:51:15.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_in_osds": 0, 2020-11-16T21:51:15.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "osd_in_since": 0, 2020-11-16T21:51:15.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2020-11-16T21:51:15.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:15.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pgmap": { 2020-11-16T21:51:15.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pgs_by_state": [], 2020-11-16T21:51:15.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_pgs": 0, 2020-11-16T21:51:15.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_pools": 0, 2020-11-16T21:51:15.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_objects": 0, 2020-11-16T21:51:15.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "data_bytes": 0, 2020-11-16T21:51:15.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "bytes_used": 0, 2020-11-16T21:51:15.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "bytes_avail": 0, 2020-11-16T21:51:15.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "bytes_total": 0 2020-11-16T21:51:15.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:15.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "fsmap": { 2020-11-16T21:51:15.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "epoch": 1, 2020-11-16T21:51:15.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "by_rank": [], 2020-11-16T21:51:15.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "up:standby": 0 2020-11-16T21:51:15.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:15.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "mgrmap": { 2020-11-16T21:51:15.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "available": false, 2020-11-16T21:51:15.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_standbys": 0, 2020-11-16T21:51:15.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "modules": [ 2020-11-16T21:51:15.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "iostat", 2020-11-16T21:51:15.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "restful" 2020-11-16T21:51:15.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:15.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "services": {} 2020-11-16T21:51:15.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:15.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "servicemap": { 2020-11-16T21:51:15.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "epoch": 1, 2020-11-16T21:51:15.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "modified": "2020-11-16T21:51:02.723704+0000", 2020-11-16T21:51:15.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "services": {} 2020-11-16T21:51:15.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:15.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "progress_events": {} 2020-11-16T21:51:15.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:15.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:15 smithi195 bash[10218]: audit 2020-11-16T21:51:15.310070+0000 mon.a (mon.0) 9 : audit [DBG] from='client.? v1:172.21.15.195:0/3475390666' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2020-11-16T21:51:15.849 INFO:teuthology.orchestra.run.smithi195.stderr:mgr not available, waiting (2/10)... 2020-11-16T21:51:16.850 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b status -f json-pretty 2020-11-16T21:51:17.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:17 smithi195 bash[10218]: cluster 2020-11-16T21:51:16.994407+0000 mon.a (mon.0) 10 : cluster [INF] Activating manager daemon y 2020-11-16T21:51:17.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:17 smithi195 bash[10218]: cluster 2020-11-16T21:51:17.000468+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00616524s) 2020-11-16T21:51:17.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:17 smithi195 bash[10218]: audit 2020-11-16T21:51:17.003712+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 v1:172.21.15.195:0/3465528799' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-11-16T21:51:17.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:17 smithi195 bash[10218]: audit 2020-11-16T21:51:17.003947+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 v1:172.21.15.195:0/3465528799' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-11-16T21:51:17.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:17 smithi195 bash[10218]: audit 2020-11-16T21:51:17.004160+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 v1:172.21.15.195:0/3465528799' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-11-16T21:51:17.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:17 smithi195 bash[10218]: audit 2020-11-16T21:51:17.004410+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 v1:172.21.15.195:0/3465528799' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-11-16T21:51:17.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:17 smithi195 bash[10218]: audit 2020-11-16T21:51:17.004633+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.14100 v1:172.21.15.195:0/3465528799' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-11-16T21:51:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:17 smithi195 bash[10218]: audit 2020-11-16T21:51:17.004851+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.14100 v1:172.21.15.195:0/3465528799' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-11-16T21:51:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:17 smithi195 bash[10218]: audit 2020-11-16T21:51:17.005308+0000 mon.a (mon.0) 18 : audit [DBG] from='mgr.14100 v1:172.21.15.195:0/3465528799' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2020-11-16T21:51:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:17 smithi195 bash[10218]: audit 2020-11-16T21:51:17.005832+0000 mon.a (mon.0) 19 : audit [DBG] from='mgr.14100 v1:172.21.15.195:0/3465528799' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-11-16T21:51:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:17 smithi195 bash[10218]: cluster 2020-11-16T21:51:17.009690+0000 mon.a (mon.0) 20 : cluster [INF] Manager daemon y is now available 2020-11-16T21:51:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:17 smithi195 bash[10218]: audit 2020-11-16T21:51:17.019189+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 v1:172.21.15.195:0/3465528799' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20201116-215117"}]: dispatch 2020-11-16T21:51:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:17 smithi195 bash[10218]: audit 2020-11-16T21:51:17.022437+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.14100 v1:172.21.15.195:0/3465528799' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20201116-215117"}]': finished 2020-11-16T21:51:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:17 smithi195 bash[10218]: audit 2020-11-16T21:51:17.035238+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 v1:172.21.15.195:0/3465528799' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:51:17.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:17 smithi195 bash[10218]: audit 2020-11-16T21:51:17.037553+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 v1:172.21.15.195:0/3465528799' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2020-11-16T21:51:17.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:17 smithi195 bash[10218]: audit 2020-11-16T21:51:17.041281+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 v1:172.21.15.195:0/3465528799' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"f63c1a05-f725-4c69-b343-52ed0165da6e"}]: dispatch 2020-11-16T21:51:17.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:17 smithi195 bash[10218]: audit 2020-11-16T21:51:17.044319+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.14100 v1:172.21.15.195:0/3465528799' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"f63c1a05-f725-4c69-b343-52ed0165da6e"}]': finished 2020-11-16T21:51:18.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:18 smithi195 bash[10218]: audit 2020-11-16T21:51:17.045286+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 v1:172.21.15.195:0/3465528799' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"c852e241-7038-423c-87de-58d23ee75b78"}]: dispatch 2020-11-16T21:51:18.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:18 smithi195 bash[10218]: audit 2020-11-16T21:51:17.048037+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.14100 v1:172.21.15.195:0/3465528799' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"c852e241-7038-423c-87de-58d23ee75b78"}]': finished 2020-11-16T21:51:18.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:18 smithi195 bash[10218]: cluster 2020-11-16T21:51:18.005415+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e3: y(active, since 1.0111s) 2020-11-16T21:51:18.437 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout 2020-11-16T21:51:18.437 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:18.438 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "fsid": "bcd5108e-2855-11eb-a2b2-001a4aab830c", 2020-11-16T21:51:18.438 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "health": { 2020-11-16T21:51:18.439 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2020-11-16T21:51:18.439 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "checks": {}, 2020-11-16T21:51:18.439 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "mutes": [] 2020-11-16T21:51:18.439 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:18.439 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "election_epoch": 5, 2020-11-16T21:51:18.439 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "quorum": [ 2020-11-16T21:51:18.441 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout 0 2020-11-16T21:51:18.441 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:18.441 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "quorum_names": [ 2020-11-16T21:51:18.441 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "a" 2020-11-16T21:51:18.441 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:18.441 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "quorum_age": 9, 2020-11-16T21:51:18.442 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "monmap": { 2020-11-16T21:51:18.442 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "epoch": 1, 2020-11-16T21:51:18.442 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min_mon_release_name": "pacific", 2020-11-16T21:51:18.442 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_mons": 1 2020-11-16T21:51:18.442 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:18.442 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "osdmap": { 2020-11-16T21:51:18.442 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "epoch": 1, 2020-11-16T21:51:18.443 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_osds": 0, 2020-11-16T21:51:18.443 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_up_osds": 0, 2020-11-16T21:51:18.443 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "osd_up_since": 0, 2020-11-16T21:51:18.445 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_in_osds": 0, 2020-11-16T21:51:18.445 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "osd_in_since": 0, 2020-11-16T21:51:18.445 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2020-11-16T21:51:18.446 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:18.446 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pgmap": { 2020-11-16T21:51:18.446 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pgs_by_state": [], 2020-11-16T21:51:18.446 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_pgs": 0, 2020-11-16T21:51:18.446 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_pools": 0, 2020-11-16T21:51:18.446 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_objects": 0, 2020-11-16T21:51:18.446 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "data_bytes": 0, 2020-11-16T21:51:18.447 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "bytes_used": 0, 2020-11-16T21:51:18.447 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "bytes_avail": 0, 2020-11-16T21:51:18.447 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "bytes_total": 0 2020-11-16T21:51:18.447 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:18.447 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "fsmap": { 2020-11-16T21:51:18.447 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "epoch": 1, 2020-11-16T21:51:18.447 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "by_rank": [], 2020-11-16T21:51:18.448 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "up:standby": 0 2020-11-16T21:51:18.448 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:18.448 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "mgrmap": { 2020-11-16T21:51:18.448 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "available": true, 2020-11-16T21:51:18.448 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_standbys": 0, 2020-11-16T21:51:18.448 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "modules": [ 2020-11-16T21:51:18.448 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "iostat", 2020-11-16T21:51:18.448 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "restful" 2020-11-16T21:51:18.449 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:18.449 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "services": {} 2020-11-16T21:51:18.449 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:18.449 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "servicemap": { 2020-11-16T21:51:18.449 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "epoch": 1, 2020-11-16T21:51:18.449 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "modified": "2020-11-16T21:51:02.723704+0000", 2020-11-16T21:51:18.449 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "services": {} 2020-11-16T21:51:18.450 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:18.450 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "progress_events": {} 2020-11-16T21:51:18.450 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:19.056 INFO:teuthology.orchestra.run.smithi195.stderr:mgr is available 2020-11-16T21:51:19.056 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b config-key set mgr/cephadm/ssh_user root 2020-11-16T21:51:19.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:19 smithi195 bash[10218]: audit 2020-11-16T21:51:18.451299+0000 mon.a (mon.0) 30 : audit [DBG] from='client.14110 v1:172.21.15.195:0/2201186504' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2020-11-16T21:51:20.346 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:20 smithi195 bash[10218]: cluster 2020-11-16T21:51:19.060090+0000 mon.a (mon.0) 31 : cluster [DBG] mgrmap e4: y(active, since 2s) 2020-11-16T21:51:20.692 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stderr set mgr/cephadm/ssh_user 2020-11-16T21:51:21.189 INFO:teuthology.orchestra.run.smithi195.stderr:Enabling cephadm module... 2020-11-16T21:51:21.190 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b mgr module enable cephadm 2020-11-16T21:51:21.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:21 smithi195 bash[10218]: audit 2020-11-16T21:51:20.701731+0000 mon.a (mon.0) 32 : audit [INF] from='client.14112 v1:172.21.15.195:0/2535426106' entity='client.admin' cmd=[{"prefix": "config-key set", "key": "mgr/cephadm/ssh_user", "val": "root"}]: dispatch 2020-11-16T21:51:21.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:21 smithi195 bash[10218]: audit 2020-11-16T21:51:20.703755+0000 mon.a (mon.0) 33 : audit [INF] from='client.14112 v1:172.21.15.195:0/2535426106' entity='client.admin' cmd='[{"prefix": "config-key set", "key": "mgr/cephadm/ssh_user", "val": "root"}]': finished 2020-11-16T21:51:23.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:22 smithi195 bash[10218]: audit 2020-11-16T21:51:22.731523+0000 mon.a (mon.0) 34 : audit [INF] from='client.? v1:172.21.15.195:0/929415427' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2020-11-16T21:51:23.098 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:22 smithi195 bash[10493]: ignoring --setuser ceph since I am not root 2020-11-16T21:51:23.098 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:22 smithi195 bash[10493]: ignoring --setgroup ceph since I am not root 2020-11-16T21:51:23.099 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:22 smithi195 bash[10493]: debug 2020-11-16T21:51:22.824+0000 7f80e763d700 1 -- 172.21.15.195:0/1411881992 <== mon.0 v1:172.21.15.195:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (unknown 1068842100 0 0) 0x5616e6e484e0 con 0x5616e6f32800 2020-11-16T21:51:23.293 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b mgr dump 2020-11-16T21:51:24.086 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:23 smithi195 bash[10218]: audit 2020-11-16T21:51:22.785121+0000 mon.a (mon.0) 35 : audit [INF] from='client.? v1:172.21.15.195:0/929415427' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2020-11-16T21:51:24.087 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:23 smithi195 bash[10218]: cluster 2020-11-16T21:51:22.785197+0000 mon.a (mon.0) 36 : cluster [DBG] mgrmap e5: y(active, since 5s) 2020-11-16T21:51:24.688 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:24.689 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "epoch": 5, 2020-11-16T21:51:24.689 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "active_gid": 14100, 2020-11-16T21:51:24.689 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "active_name": "y", 2020-11-16T21:51:24.689 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "active_addrs": { 2020-11-16T21:51:24.689 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "addrvec": [ 2020-11-16T21:51:24.689 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:24.690 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "v1", 2020-11-16T21:51:24.690 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "addr": "172.21.15.195:6800", 2020-11-16T21:51:24.690 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "nonce": 4059900539 2020-11-16T21:51:24.690 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:24.690 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ] 2020-11-16T21:51:24.690 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:24.691 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "active_addr": "172.21.15.195:6800/4059900539", 2020-11-16T21:51:24.692 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "active_change": "2020-11-16T21:51:16.994283+0000", 2020-11-16T21:51:24.692 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "active_mgr_features": 4540138297136906239, 2020-11-16T21:51:24.692 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "available": true, 2020-11-16T21:51:24.692 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "standbys": [], 2020-11-16T21:51:24.692 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "modules": [ 2020-11-16T21:51:24.693 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "cephadm", 2020-11-16T21:51:24.693 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "iostat", 2020-11-16T21:51:24.693 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "restful" 2020-11-16T21:51:24.693 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:24.693 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "available_modules": [ 2020-11-16T21:51:24.693 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:24.694 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "alerts", 2020-11-16T21:51:24.703 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:24.703 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:24.703 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:24.703 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "interval": { 2020-11-16T21:51:24.703 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "interval", 2020-11-16T21:51:24.703 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:24.704 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:24.704 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:24.704 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "60", 2020-11-16T21:51:24.704 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:24.704 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:24.704 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:24.705 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2020-11-16T21:51:24.705 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:24.705 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:24.705 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:24.705 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:24.705 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:24.706 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:24.706 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:24.706 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:24.706 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:24.706 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:24.706 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:24.707 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:24.707 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:24.707 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:24.707 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:24.707 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:24.707 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:24.707 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:24.707 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:24.708 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:24.708 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:24.708 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:24.708 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:24.708 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:24.708 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:24.708 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:24.709 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:24.709 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:24.709 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:24.709 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:24.709 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:24.709 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:24.709 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:24.709 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:24.710 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:24.710 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:24.710 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:24.710 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:24.710 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:24.710 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:24.710 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:24.711 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:24.711 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:24.711 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:24.711 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:24.711 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:24.711 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:24.711 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:24.712 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:24.712 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:24.712 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:24.712 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:24.712 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:24.712 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:24.712 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:24.712 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:24.713 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:24.713 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:24.713 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:24.713 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:24.713 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:24.713 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:24.713 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:24.714 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:24.714 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:24.714 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:24.714 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:24.714 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:24.714 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:24.714 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:24.714 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:24.715 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:24.715 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:24.715 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:24.715 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "smtp_destination": { 2020-11-16T21:51:24.715 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "smtp_destination", 2020-11-16T21:51:24.715 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:24.715 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:24.716 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:24.716 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:24.716 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:24.716 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:24.716 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:24.716 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2020-11-16T21:51:24.716 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:24.717 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:24.717 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:24.717 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:24.717 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "smtp_from_name": { 2020-11-16T21:51:24.717 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "smtp_from_name", 2020-11-16T21:51:24.717 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:24.717 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:24.717 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:24.718 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "Ceph", 2020-11-16T21:51:24.718 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:24.718 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:24.718 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:24.718 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Email From: name", 2020-11-16T21:51:24.718 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:24.718 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:24.719 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:24.719 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:24.719 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "smtp_host": { 2020-11-16T21:51:24.719 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "smtp_host", 2020-11-16T21:51:24.719 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:24.719 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:24.719 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:24.719 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:24.720 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:24.720 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:24.720 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:24.720 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "SMTP server", 2020-11-16T21:51:24.720 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:24.720 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:24.720 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:24.721 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:24.721 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "smtp_password": { 2020-11-16T21:51:24.721 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "smtp_password", 2020-11-16T21:51:24.721 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:24.721 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:24.721 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:24.721 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:24.721 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:24.722 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:24.722 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:24.722 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2020-11-16T21:51:24.722 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:24.722 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:24.722 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.012 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.012 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "smtp_port": { 2020-11-16T21:51:25.012 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "smtp_port", 2020-11-16T21:51:25.012 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:25.013 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.013 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.013 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "465", 2020-11-16T21:51:25.013 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.013 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.013 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.013 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "SMTP port", 2020-11-16T21:51:25.014 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.014 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.014 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.014 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.014 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "smtp_sender": { 2020-11-16T21:51:25.014 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "smtp_sender", 2020-11-16T21:51:25.014 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.015 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.015 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.015 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:25.015 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.015 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.015 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.015 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2020-11-16T21:51:25.016 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.016 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.016 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.016 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.016 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "smtp_ssl": { 2020-11-16T21:51:25.016 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "smtp_ssl", 2020-11-16T21:51:25.016 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.016 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.017 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.017 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.017 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.017 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.017 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.017 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2020-11-16T21:51:25.017 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.018 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.018 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.018 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.018 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "smtp_user": { 2020-11-16T21:51:25.018 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "smtp_user", 2020-11-16T21:51:25.018 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.018 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.019 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.019 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:25.019 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.019 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.019 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.019 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2020-11-16T21:51:25.019 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.019 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.020 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.020 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:25.020 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:25.020 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.020 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:25.020 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "balancer", 2020-11-16T21:51:25.020 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:25.021 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:25.021 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:25.021 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "active": { 2020-11-16T21:51:25.021 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "active", 2020-11-16T21:51:25.021 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.021 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.021 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.021 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.022 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.022 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.022 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.022 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2020-11-16T21:51:25.022 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.022 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.022 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.023 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.023 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "begin_time": { 2020-11-16T21:51:25.023 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "begin_time", 2020-11-16T21:51:25.023 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.023 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.023 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.023 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "0000", 2020-11-16T21:51:25.024 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.024 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.024 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.024 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2020-11-16T21:51:25.024 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2020-11-16T21:51:25.024 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.024 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.024 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.025 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "begin_weekday": { 2020-11-16T21:51:25.025 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "begin_weekday", 2020-11-16T21:51:25.025 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "uint", 2020-11-16T21:51:25.025 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.025 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.025 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "0", 2020-11-16T21:51:25.025 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "0", 2020-11-16T21:51:25.025 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "7", 2020-11-16T21:51:25.026 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.026 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2020-11-16T21:51:25.026 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2020-11-16T21:51:25.026 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.026 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.026 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.026 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2020-11-16T21:51:25.027 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2020-11-16T21:51:25.027 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "uint", 2020-11-16T21:51:25.027 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.027 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.027 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "25", 2020-11-16T21:51:25.027 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "1", 2020-11-16T21:51:25.027 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "250", 2020-11-16T21:51:25.028 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.028 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2020-11-16T21:51:25.028 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.028 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.028 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.028 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.028 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "crush_compat_metrics": { 2020-11-16T21:51:25.028 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2020-11-16T21:51:25.029 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.029 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.029 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.029 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2020-11-16T21:51:25.029 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.029 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.029 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.029 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2020-11-16T21:51:25.030 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2020-11-16T21:51:25.030 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.030 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.030 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.030 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "crush_compat_step": { 2020-11-16T21:51:25.030 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "crush_compat_step", 2020-11-16T21:51:25.030 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "float", 2020-11-16T21:51:25.031 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.031 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.031 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "0.5", 2020-11-16T21:51:25.031 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "0.001", 2020-11-16T21:51:25.031 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "0.999", 2020-11-16T21:51:25.031 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.031 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2020-11-16T21:51:25.032 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2020-11-16T21:51:25.032 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.032 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.032 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.032 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "end_time": { 2020-11-16T21:51:25.032 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "end_time", 2020-11-16T21:51:25.032 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.033 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.033 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.033 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "2400", 2020-11-16T21:51:25.033 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.033 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.033 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.033 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2020-11-16T21:51:25.033 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2020-11-16T21:51:25.034 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.034 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.034 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.034 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "end_weekday": { 2020-11-16T21:51:25.034 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "end_weekday", 2020-11-16T21:51:25.034 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "uint", 2020-11-16T21:51:25.034 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.035 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.035 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "7", 2020-11-16T21:51:25.035 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "0", 2020-11-16T21:51:25.035 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "7", 2020-11-16T21:51:25.035 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.035 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2020-11-16T21:51:25.035 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2020-11-16T21:51:25.035 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.036 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.036 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.036 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:25.036 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:25.036 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.036 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.036 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.037 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:25.037 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.037 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.037 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:25.037 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:25.037 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:25.037 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:25.037 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:25.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:25.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:25.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:25.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:25.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:25.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:25.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:25.041 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:25.041 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.041 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.041 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.041 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:25.041 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.041 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.042 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:25.042 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:25.042 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:25.042 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:25.042 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:25.042 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:25.042 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:25.042 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:25.043 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.043 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.043 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.043 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.043 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.043 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:25.043 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:25.044 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.044 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.044 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.044 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:25.044 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.044 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.044 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.044 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.045 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.045 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.045 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.045 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.045 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min_score": { 2020-11-16T21:51:25.045 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "min_score", 2020-11-16T21:51:25.045 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "float", 2020-11-16T21:51:25.045 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.046 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.046 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "0", 2020-11-16T21:51:25.046 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.046 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.046 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.046 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2020-11-16T21:51:25.046 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.047 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.047 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.047 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.047 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "mode": { 2020-11-16T21:51:25.047 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "mode", 2020-11-16T21:51:25.047 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.047 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.047 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.048 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "upmap", 2020-11-16T21:51:25.048 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.048 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.048 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:25.048 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "crush-compat", 2020-11-16T21:51:25.048 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "none", 2020-11-16T21:51:25.048 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "upmap" 2020-11-16T21:51:25.049 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:25.049 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Balancer mode", 2020-11-16T21:51:25.049 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.049 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.049 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.049 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.049 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pool_ids": { 2020-11-16T21:51:25.049 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "pool_ids", 2020-11-16T21:51:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.050 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.051 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2020-11-16T21:51:25.051 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.051 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.051 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.051 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.051 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "sleep_interval": { 2020-11-16T21:51:25.051 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-11-16T21:51:25.051 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:25.052 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.052 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.052 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "60", 2020-11-16T21:51:25.052 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.052 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.052 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.052 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2020-11-16T21:51:25.053 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.053 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.053 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.053 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.053 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "upmap_max_deviation": { 2020-11-16T21:51:25.053 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2020-11-16T21:51:25.053 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:25.053 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.054 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.054 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "5", 2020-11-16T21:51:25.054 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "1", 2020-11-16T21:51:25.054 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.054 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.054 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2020-11-16T21:51:25.054 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2020-11-16T21:51:25.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2020-11-16T21:51:25.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2020-11-16T21:51:25.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "uint", 2020-11-16T21:51:25.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "10", 2020-11-16T21:51:25.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2020-11-16T21:51:25.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:25.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:25.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:25.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "cephadm", 2020-11-16T21:51:25.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:25.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:25.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:25.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "allow_ptrace": { 2020-11-16T21:51:25.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "allow_ptrace", 2020-11-16T21:51:25.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:25.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2020-11-16T21:51:25.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2020-11-16T21:51:25.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "config_dashboard": { 2020-11-16T21:51:25.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "config_dashboard", 2020-11-16T21:51:25.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.061 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.061 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.061 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "manage configs like API endpoints in Dashboard.", 2020-11-16T21:51:25.061 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.061 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.061 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.061 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.061 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "container_image_alertmanager": { 2020-11-16T21:51:25.062 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "container_image_alertmanager", 2020-11-16T21:51:25.062 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.062 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.062 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.062 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "docker.io/prom/alertmanager:v0.20.0", 2020-11-16T21:51:25.062 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.062 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.063 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.063 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Prometheus container image", 2020-11-16T21:51:25.063 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.063 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.063 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.063 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.063 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "container_image_base": { 2020-11-16T21:51:25.063 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "container_image_base", 2020-11-16T21:51:25.064 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.064 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.064 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.064 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "docker.io/ceph/ceph", 2020-11-16T21:51:25.064 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.064 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.064 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.064 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2020-11-16T21:51:25.065 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.065 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.065 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.065 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.065 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "container_image_grafana": { 2020-11-16T21:51:25.065 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "container_image_grafana", 2020-11-16T21:51:25.065 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.066 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.066 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.066 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "docker.io/ceph/ceph-grafana:6.6.2", 2020-11-16T21:51:25.066 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.066 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.066 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.066 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Prometheus container image", 2020-11-16T21:51:25.066 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.067 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.067 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.067 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.067 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "container_image_node_exporter": { 2020-11-16T21:51:25.067 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "container_image_node_exporter", 2020-11-16T21:51:25.067 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.067 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.068 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.068 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "docker.io/prom/node-exporter:v0.18.1", 2020-11-16T21:51:25.068 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.068 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.068 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.068 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Prometheus container image", 2020-11-16T21:51:25.068 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.069 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.069 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.069 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.069 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "container_image_prometheus": { 2020-11-16T21:51:25.069 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "container_image_prometheus", 2020-11-16T21:51:25.069 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.069 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.069 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.070 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "docker.io/prom/prometheus:v2.18.1", 2020-11-16T21:51:25.070 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.070 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.070 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.070 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Prometheus container image", 2020-11-16T21:51:25.070 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.070 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.071 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.071 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.071 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "container_init": { 2020-11-16T21:51:25.071 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "container_init", 2020-11-16T21:51:25.071 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.071 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.071 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.071 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:25.072 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.072 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.072 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.072 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Run podman/docker with `--init`", 2020-11-16T21:51:25.072 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.072 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.072 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.072 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.073 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2020-11-16T21:51:25.073 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2020-11-16T21:51:25.073 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:25.073 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.073 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.073 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "600", 2020-11-16T21:51:25.073 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.074 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.074 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.074 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2020-11-16T21:51:25.074 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.074 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.074 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.074 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.074 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "device_cache_timeout": { 2020-11-16T21:51:25.075 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2020-11-16T21:51:25.075 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:25.075 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.075 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.075 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "1800", 2020-11-16T21:51:25.075 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.075 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.076 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.076 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2020-11-16T21:51:25.076 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.076 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.076 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.076 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.076 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "host_check_interval": { 2020-11-16T21:51:25.076 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "host_check_interval", 2020-11-16T21:51:25.077 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:25.077 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.077 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.077 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "600", 2020-11-16T21:51:25.077 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.077 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.077 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.077 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2020-11-16T21:51:25.078 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.078 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.078 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.078 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.078 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:25.078 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:25.079 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.079 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.079 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.079 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:25.079 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.079 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.079 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:25.079 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:25.080 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:25.080 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:25.080 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:25.080 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:25.080 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:25.080 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:25.080 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.080 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.081 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.081 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.081 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.081 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:25.081 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:25.081 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.081 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.082 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.082 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.082 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.082 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.082 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.082 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2020-11-16T21:51:25.082 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.083 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.083 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.083 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.083 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:25.083 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:25.083 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.083 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.083 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.084 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:25.084 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.084 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.084 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:25.084 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:25.085 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:25.085 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:25.085 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:25.085 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:25.085 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:25.085 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:25.085 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.086 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.086 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.086 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.086 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.086 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:25.086 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:25.086 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.087 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.087 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.087 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:25.087 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.087 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.087 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.087 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.088 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.088 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.088 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.088 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.088 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "manage_etc_ceph_ceph_conf": { 2020-11-16T21:51:25.088 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "manage_etc_ceph_ceph_conf", 2020-11-16T21:51:25.088 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.088 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.089 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.089 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:25.089 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.089 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.089 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.089 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2020-11-16T21:51:25.089 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.089 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.090 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.090 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.090 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "migration_current": { 2020-11-16T21:51:25.090 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "migration_current", 2020-11-16T21:51:25.090 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:25.090 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.090 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.091 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:25.091 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.091 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.091 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.091 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "internal - do not modify", 2020-11-16T21:51:25.091 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.091 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.092 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.092 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.092 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "mode": { 2020-11-16T21:51:25.092 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "mode", 2020-11-16T21:51:25.092 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.092 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.092 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.092 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "root", 2020-11-16T21:51:25.093 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.093 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.093 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:25.093 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "cephadm-package", 2020-11-16T21:51:25.093 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "root" 2020-11-16T21:51:25.093 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:25.093 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2020-11-16T21:51:25.094 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.094 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.094 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.094 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.094 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "prometheus_alerts_path": { 2020-11-16T21:51:25.094 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "prometheus_alerts_path", 2020-11-16T21:51:25.094 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.094 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.095 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.095 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2020-11-16T21:51:25.095 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.095 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.095 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.095 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "location of alerts to include in prometheus deployments", 2020-11-16T21:51:25.095 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.096 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.096 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.096 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.096 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "registry_password": { 2020-11-16T21:51:25.096 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "registry_password", 2020-11-16T21:51:25.096 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.096 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.096 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.097 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:25.097 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.097 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.097 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.097 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Custom repository password", 2020-11-16T21:51:25.097 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.097 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.097 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.098 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.098 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "registry_url": { 2020-11-16T21:51:25.098 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "registry_url", 2020-11-16T21:51:25.098 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.098 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.098 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.098 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:25.099 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.099 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.099 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.099 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Custom repository url", 2020-11-16T21:51:25.099 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.099 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.099 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.099 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.100 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "registry_username": { 2020-11-16T21:51:25.100 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "registry_username", 2020-11-16T21:51:25.100 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.100 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.100 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.100 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:25.100 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.101 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.101 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.101 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Custom repository username", 2020-11-16T21:51:25.101 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.101 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.101 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.101 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.101 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ssh_config_file": { 2020-11-16T21:51:25.102 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ssh_config_file", 2020-11-16T21:51:25.102 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.102 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.102 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.102 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:25.102 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.102 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.102 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.103 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2020-11-16T21:51:25.103 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.103 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.103 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.103 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.103 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "use_repo_digest": { 2020-11-16T21:51:25.103 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "use_repo_digest", 2020-11-16T21:51:25.104 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.104 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.104 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.104 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:25.104 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.104 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.104 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.104 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2020-11-16T21:51:25.105 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.105 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.105 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.105 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.105 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2020-11-16T21:51:25.105 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2020-11-16T21:51:25.105 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.106 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.106 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.106 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.106 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.106 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.106 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.106 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2020-11-16T21:51:25.107 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.107 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.107 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.107 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.107 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2020-11-16T21:51:25.107 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2020-11-16T21:51:25.107 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.107 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.108 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.108 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.108 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.108 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.108 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.108 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2020-11-16T21:51:25.108 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.109 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.109 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.109 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.109 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2020-11-16T21:51:25.109 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2020-11-16T21:51:25.109 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.109 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.109 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.110 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.110 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.110 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.110 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.110 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2020-11-16T21:51:25.110 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.110 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.110 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.111 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:25.111 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:25.111 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.111 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:25.111 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "crash", 2020-11-16T21:51:25.111 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:25.111 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:25.112 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:25.112 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:25.112 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:25.112 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.112 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.112 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.112 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:25.112 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.113 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.113 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:25.113 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:25.113 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:25.113 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:25.113 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:25.113 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:25.114 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:25.114 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:25.114 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.114 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.114 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.114 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.114 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.114 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:25.115 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:25.115 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.115 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.115 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.115 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:25.115 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.115 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.115 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.116 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.116 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.116 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.116 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.116 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.116 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:25.116 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:25.117 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.117 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.117 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.117 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:25.117 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.117 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.117 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:25.117 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:25.118 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:25.118 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:25.118 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:25.118 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:25.118 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:25.118 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:25.118 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.119 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.119 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.119 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.119 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.119 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:25.119 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:25.119 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.119 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.120 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.120 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:25.120 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.120 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.120 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.120 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.120 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.121 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.121 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.121 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.121 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "retain_interval": { 2020-11-16T21:51:25.121 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "retain_interval", 2020-11-16T21:51:25.121 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:25.121 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.121 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.122 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "31536000", 2020-11-16T21:51:25.122 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.122 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.122 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.122 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2020-11-16T21:51:25.122 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.122 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.122 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.123 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.123 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warn_recent_interval": { 2020-11-16T21:51:25.123 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2020-11-16T21:51:25.123 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:25.123 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.123 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:25.123 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "1209600", 2020-11-16T21:51:25.124 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.124 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.124 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.124 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2020-11-16T21:51:25.124 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.124 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.124 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.125 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:25.125 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:25.125 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.125 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:25.125 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "dashboard", 2020-11-16T21:51:25.125 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:25.125 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:25.125 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:25.126 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2020-11-16T21:51:25.126 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2020-11-16T21:51:25.126 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.126 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.126 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.126 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:25.126 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.127 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.127 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.127 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.127 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.127 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.127 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.127 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.127 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ALERTMANAGER_API_SSL_VERIFY": { 2020-11-16T21:51:25.128 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_SSL_VERIFY", 2020-11-16T21:51:25.128 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.128 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.128 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.128 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.128 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.128 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.129 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.129 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.129 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.129 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.129 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.129 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.129 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2020-11-16T21:51:25.129 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2020-11-16T21:51:25.130 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.130 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.130 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.130 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:25.130 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.130 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.130 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.131 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.131 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.131 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.131 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.131 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.131 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2020-11-16T21:51:25.131 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2020-11-16T21:51:25.131 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.132 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.132 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.132 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.132 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.132 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.132 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.132 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.132 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.133 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.133 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.133 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.133 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2020-11-16T21:51:25.133 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2020-11-16T21:51:25.133 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.134 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.134 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.134 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.134 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.134 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.134 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.134 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.134 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.135 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.135 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.135 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.135 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2020-11-16T21:51:25.135 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2020-11-16T21:51:25.135 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.135 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.136 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.136 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.136 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.136 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.136 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.136 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.136 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.136 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.137 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.137 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.137 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2020-11-16T21:51:25.137 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2020-11-16T21:51:25.137 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.137 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.137 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.137 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.138 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.138 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.138 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.138 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.138 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.138 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.138 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.139 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.139 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2020-11-16T21:51:25.139 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2020-11-16T21:51:25.139 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.139 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.139 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.139 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.139 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.140 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.140 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.140 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.140 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.140 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.140 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.140 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.141 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2020-11-16T21:51:25.141 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2020-11-16T21:51:25.141 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.141 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.141 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.141 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.141 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.141 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.142 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.142 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.142 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.142 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.142 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.142 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.142 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2020-11-16T21:51:25.142 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2020-11-16T21:51:25.143 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.143 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.143 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.143 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.143 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.143 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.143 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.144 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.144 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.144 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.144 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.144 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.144 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2020-11-16T21:51:25.144 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2020-11-16T21:51:25.144 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.145 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.145 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.145 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.145 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.145 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.145 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.145 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.146 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.146 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.146 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.146 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.146 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2020-11-16T21:51:25.146 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2020-11-16T21:51:25.146 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.147 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.147 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.147 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:25.147 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.147 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.147 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.147 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.147 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.148 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.148 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.148 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.148 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2020-11-16T21:51:25.148 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2020-11-16T21:51:25.148 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.148 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.148 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.149 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "admin", 2020-11-16T21:51:25.149 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.149 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.149 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.149 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.149 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.149 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.150 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.150 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.150 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2020-11-16T21:51:25.150 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2020-11-16T21:51:25.150 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.150 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.150 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.150 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.151 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.151 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.151 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.151 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.151 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.151 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.151 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.152 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.152 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2020-11-16T21:51:25.152 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2020-11-16T21:51:25.152 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.152 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.152 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.152 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:25.152 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.153 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.153 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.153 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.153 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.153 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.153 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.153 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.153 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2020-11-16T21:51:25.154 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2020-11-16T21:51:25.154 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.154 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.154 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.154 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "admin", 2020-11-16T21:51:25.154 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.154 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.155 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.155 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.155 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.155 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.155 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.155 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.155 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2020-11-16T21:51:25.155 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2020-11-16T21:51:25.156 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.156 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.156 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.156 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:25.156 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.156 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.156 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.157 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.157 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.157 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.157 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.157 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.157 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2020-11-16T21:51:25.157 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2020-11-16T21:51:25.157 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.158 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.158 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.158 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.158 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.158 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.362 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.362 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.363 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.363 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.363 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.363 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.363 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2020-11-16T21:51:25.363 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2020-11-16T21:51:25.363 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.364 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.364 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.364 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:25.364 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.364 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.364 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.364 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.365 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.365 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.365 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.365 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.365 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PROMETHEUS_API_SSL_VERIFY": { 2020-11-16T21:51:25.365 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_SSL_VERIFY", 2020-11-16T21:51:25.365 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.365 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.366 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.366 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.366 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.366 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.366 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.366 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.367 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.367 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.367 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.367 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.367 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2020-11-16T21:51:25.367 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2020-11-16T21:51:25.367 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.367 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.368 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.368 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:25.368 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.368 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.368 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.368 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.368 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.369 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.369 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.369 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.369 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2020-11-16T21:51:25.369 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2020-11-16T21:51:25.369 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.369 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.369 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.370 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:25.370 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.370 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.370 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.370 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.370 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.370 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.371 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.371 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.371 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2020-11-16T21:51:25.371 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2020-11-16T21:51:25.371 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.371 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.371 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.372 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.372 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.372 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.372 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.372 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.372 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.372 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.372 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.373 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.373 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2020-11-16T21:51:25.373 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2020-11-16T21:51:25.373 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.373 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.373 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.373 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.374 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.374 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.374 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.374 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.374 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.374 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.374 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.374 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.375 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2020-11-16T21:51:25.375 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2020-11-16T21:51:25.375 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.375 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.375 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:25.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2020-11-16T21:51:25.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2020-11-16T21:51:25.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:25.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2020-11-16T21:51:25.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2020-11-16T21:51:25.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:25.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2020-11-16T21:51:25.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2020-11-16T21:51:25.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:25.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:25.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2020-11-16T21:51:25.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2020-11-16T21:51:25.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2020-11-16T21:51:25.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2020-11-16T21:51:25.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2020-11-16T21:51:25.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:25.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "10", 2020-11-16T21:51:25.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2020-11-16T21:51:25.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2020-11-16T21:51:25.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:25.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "8", 2020-11-16T21:51:25.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2020-11-16T21:51:25.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2020-11-16T21:51:25.798 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:25.798 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.798 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.798 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "45", 2020-11-16T21:51:25.799 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.799 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.799 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.799 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.799 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.799 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.799 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.800 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.800 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2020-11-16T21:51:25.800 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2020-11-16T21:51:25.800 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.800 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.800 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.800 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:25.801 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.801 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.801 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.801 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.801 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.801 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.801 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.801 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.802 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2020-11-16T21:51:25.802 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2020-11-16T21:51:25.802 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.802 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.802 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.802 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "admin", 2020-11-16T21:51:25.802 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.803 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.803 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.803 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.803 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.803 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.803 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.803 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.804 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "RGW_API_HOST": { 2020-11-16T21:51:25.804 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2020-11-16T21:51:25.804 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.804 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.804 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.804 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:25.804 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.804 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.805 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.805 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.805 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.805 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.805 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.805 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.805 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "RGW_API_PORT": { 2020-11-16T21:51:25.806 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2020-11-16T21:51:25.806 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:25.806 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.806 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.806 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "80", 2020-11-16T21:51:25.806 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.806 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.807 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.807 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.807 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.807 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.807 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.807 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.807 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2020-11-16T21:51:25.807 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2020-11-16T21:51:25.808 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.808 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.808 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.808 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "http", 2020-11-16T21:51:25.808 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.808 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.808 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.809 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.809 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.809 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.809 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.809 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:25.809 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2020-11-16T21:51:25.809 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2020-11-16T21:51:25.809 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:25.810 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:25.810 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:25.810 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:25.810 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:25.810 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:25.810 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:25.810 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:25.811 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:25.811 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:25.811 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:25.811 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.014 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2020-11-16T21:51:26.014 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2020-11-16T21:51:26.014 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.014 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.015 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.015 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:26.015 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.015 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.015 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.015 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.015 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.016 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.016 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.016 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.016 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2020-11-16T21:51:26.016 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2020-11-16T21:51:26.016 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.016 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.017 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.017 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:26.017 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.017 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.017 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.017 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.017 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.018 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.018 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.018 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.018 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2020-11-16T21:51:26.018 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2020-11-16T21:51:26.018 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:26.018 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.019 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.019 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "0", 2020-11-16T21:51:26.019 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.019 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.019 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.019 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.019 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.019 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.020 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.020 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.020 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2020-11-16T21:51:26.020 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2020-11-16T21:51:26.020 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:26.020 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.020 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.021 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "10", 2020-11-16T21:51:26.021 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.021 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.021 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.021 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.021 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.021 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.021 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.022 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.022 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2020-11-16T21:51:26.022 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2020-11-16T21:51:26.022 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:26.022 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.022 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.022 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "5", 2020-11-16T21:51:26.023 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.023 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.023 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.023 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.023 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.023 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.023 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.024 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.024 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "crt_file": { 2020-11-16T21:51:26.024 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "crt_file", 2020-11-16T21:51:26.024 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.024 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.024 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.024 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:26.024 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.025 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.025 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.025 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.025 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.025 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.025 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.025 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.026 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug": { 2020-11-16T21:51:26.026 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "debug", 2020-11-16T21:51:26.026 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.026 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.026 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.026 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:26.026 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.026 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.027 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.027 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2020-11-16T21:51:26.027 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.027 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.027 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.027 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.027 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "jwt_token_ttl": { 2020-11-16T21:51:26.028 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2020-11-16T21:51:26.028 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:26.028 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.028 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.028 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "28800", 2020-11-16T21:51:26.028 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.028 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.028 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.029 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.029 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.029 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.029 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.029 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.029 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "key_file": { 2020-11-16T21:51:26.029 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "key_file", 2020-11-16T21:51:26.030 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.030 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.030 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.030 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:26.030 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.030 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.030 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.030 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.031 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.031 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.031 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.031 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.031 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:26.031 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:26.031 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.032 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.032 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.032 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:26.032 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.032 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.032 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:26.032 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:26.032 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:26.033 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:26.033 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:26.033 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:26.033 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:26.033 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:26.033 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.033 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.034 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.034 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.034 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.034 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:26.034 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:26.034 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.035 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.035 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.035 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:26.035 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.035 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.035 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.035 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.036 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.036 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.036 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.036 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.036 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:26.036 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:26.036 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.036 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.037 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.037 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:26.037 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.037 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.037 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:26.037 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:26.037 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:26.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:26.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:26.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:26.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:26.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:26.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:26.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:26.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:26.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.242 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.242 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.242 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "password": { 2020-11-16T21:51:26.243 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "password", 2020-11-16T21:51:26.243 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.243 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.243 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.243 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:26.243 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.243 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.244 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.244 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.244 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.244 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.244 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.244 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.244 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "server_addr": { 2020-11-16T21:51:26.245 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "server_addr", 2020-11-16T21:51:26.245 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.245 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.245 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.245 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "::", 2020-11-16T21:51:26.245 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.245 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.245 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.246 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.246 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.246 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.246 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.246 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.246 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "server_port": { 2020-11-16T21:51:26.246 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "server_port", 2020-11-16T21:51:26.247 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:26.247 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.247 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.247 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "8080", 2020-11-16T21:51:26.247 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.247 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.247 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.248 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.248 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.248 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.248 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.248 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.248 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ssl": { 2020-11-16T21:51:26.248 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ssl", 2020-11-16T21:51:26.248 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.249 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.249 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.249 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:26.249 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.249 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.249 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.249 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.250 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.250 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.250 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.250 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.250 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ssl_server_port": { 2020-11-16T21:51:26.250 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ssl_server_port", 2020-11-16T21:51:26.250 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:26.250 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.251 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.251 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "8443", 2020-11-16T21:51:26.251 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.251 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.251 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.251 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.251 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.252 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.252 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.252 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.252 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "standby_behaviour": { 2020-11-16T21:51:26.252 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "standby_behaviour", 2020-11-16T21:51:26.252 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.252 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.252 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.253 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "redirect", 2020-11-16T21:51:26.253 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.253 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.253 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:26.253 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:26.253 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "redirect" 2020-11-16T21:51:26.253 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:26.254 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.254 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.254 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.254 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.254 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.254 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "standby_error_status_code": { 2020-11-16T21:51:26.254 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2020-11-16T21:51:26.254 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:26.255 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.255 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.255 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "500", 2020-11-16T21:51:26.255 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "400", 2020-11-16T21:51:26.458 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "599", 2020-11-16T21:51:26.458 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.458 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.459 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.459 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.459 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.459 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.459 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "url_prefix": { 2020-11-16T21:51:26.459 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "url_prefix", 2020-11-16T21:51:26.459 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.460 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.460 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.460 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:26.460 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.460 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.460 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.460 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.460 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.461 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.461 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.461 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.461 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "username": { 2020-11-16T21:51:26.461 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "username", 2020-11-16T21:51:26.461 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.461 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.462 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.462 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:26.462 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.462 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.462 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.462 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.462 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.463 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.463 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.463 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:26.463 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:26.463 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.463 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:26.463 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "devicehealth", 2020-11-16T21:51:26.464 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:26.464 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:26.464 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:26.464 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enable_monitoring": { 2020-11-16T21:51:26.464 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "enable_monitoring", 2020-11-16T21:51:26.464 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.464 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.464 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.465 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:26.465 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.465 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.465 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.465 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2020-11-16T21:51:26.465 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.465 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.466 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.466 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.466 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:26.466 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:26.466 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.466 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.466 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.467 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:26.467 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.467 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.467 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:26.467 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:26.467 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:26.467 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:26.467 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:26.468 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:26.468 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:26.468 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:26.468 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.468 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.468 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.468 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.469 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.469 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:26.469 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:26.469 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.469 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.469 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.469 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:26.469 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.470 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.470 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.470 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.470 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.470 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.470 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.470 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.471 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:26.471 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:26.471 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.471 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.471 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.471 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:26.471 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.472 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.472 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:26.472 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:26.472 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:26.472 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:26.472 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:26.472 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:26.472 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:26.473 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:26.473 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.473 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.473 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.473 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.473 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.473 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:26.474 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:26.474 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.474 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.474 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.474 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:26.474 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.474 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.474 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.475 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.475 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.475 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.475 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.475 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.475 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "mark_out_threshold": { 2020-11-16T21:51:26.475 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2020-11-16T21:51:26.476 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:26.476 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.476 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.476 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "2419200", 2020-11-16T21:51:26.476 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.476 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.476 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.476 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2020-11-16T21:51:26.477 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.477 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.477 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.477 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.477 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pool_name": { 2020-11-16T21:51:26.477 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "pool_name", 2020-11-16T21:51:26.477 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.478 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.478 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.478 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2020-11-16T21:51:26.478 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.478 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.478 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.478 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2020-11-16T21:51:26.478 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.479 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.479 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.479 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.479 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "retention_period": { 2020-11-16T21:51:26.479 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "retention_period", 2020-11-16T21:51:26.479 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:26.479 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.480 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.480 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "15552000", 2020-11-16T21:51:26.480 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.480 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.480 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.480 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2020-11-16T21:51:26.480 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.480 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.481 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.481 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.481 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "scrape_frequency": { 2020-11-16T21:51:26.481 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "scrape_frequency", 2020-11-16T21:51:26.481 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:26.481 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.481 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.482 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "86400", 2020-11-16T21:51:26.482 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.482 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.482 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.482 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2020-11-16T21:51:26.482 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.482 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.483 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.483 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.483 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "self_heal": { 2020-11-16T21:51:26.483 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "self_heal", 2020-11-16T21:51:26.483 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.483 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.483 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.483 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:26.484 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.484 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.484 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.484 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2020-11-16T21:51:26.484 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.484 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.484 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.485 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.485 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "sleep_interval": { 2020-11-16T21:51:26.485 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-11-16T21:51:26.485 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:26.485 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.485 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.485 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "600", 2020-11-16T21:51:26.485 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.486 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.486 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.486 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2020-11-16T21:51:26.486 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.486 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.486 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.486 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.487 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warn_threshold": { 2020-11-16T21:51:26.487 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "warn_threshold", 2020-11-16T21:51:26.487 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:26.487 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.487 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.487 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "7257600", 2020-11-16T21:51:26.487 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.487 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.488 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.488 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2020-11-16T21:51:26.488 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.488 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.488 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.488 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:26.488 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:26.489 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.489 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:26.489 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "diskprediction_local", 2020-11-16T21:51:26.489 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:26.489 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:26.489 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:26.489 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:26.489 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:26.490 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.490 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.490 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.490 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:26.490 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.490 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.490 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:26.491 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:26.491 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:26.491 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:26.491 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:26.491 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:26.491 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:26.491 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:26.491 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.492 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.492 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.492 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.492 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.492 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:26.492 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:26.492 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.493 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.493 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.493 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:26.493 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.493 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.493 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.493 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.493 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.494 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.494 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.494 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.494 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:26.494 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:26.494 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.494 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.495 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.495 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:26.495 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.495 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.495 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:26.495 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:26.495 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:26.495 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:26.496 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:26.496 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:26.496 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:26.496 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:26.496 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.496 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.496 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.496 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.497 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.497 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:26.497 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:26.497 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.698 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.698 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.698 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:26.698 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.699 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.699 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.699 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.699 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.699 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.699 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.699 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.700 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "predict_interval": { 2020-11-16T21:51:26.700 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "predict_interval", 2020-11-16T21:51:26.700 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.700 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.700 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.700 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "86400", 2020-11-16T21:51:26.700 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.701 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.701 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.701 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.701 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.701 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.701 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.701 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.701 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "predictor_model": { 2020-11-16T21:51:26.702 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "predictor_model", 2020-11-16T21:51:26.702 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.702 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.702 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.702 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "prophetstor", 2020-11-16T21:51:26.702 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.703 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.703 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.703 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.703 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.703 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.703 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.703 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.703 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "sleep_interval": { 2020-11-16T21:51:26.704 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-11-16T21:51:26.704 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.704 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.704 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.704 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "600", 2020-11-16T21:51:26.704 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.704 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.705 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.705 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.705 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.705 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.705 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.705 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:26.705 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:26.705 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.706 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:26.706 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "influx", 2020-11-16T21:51:26.706 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": false, 2020-11-16T21:51:26.706 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2020-11-16T21:51:26.706 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:26.706 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "batch_size": { 2020-11-16T21:51:26.706 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "batch_size", 2020-11-16T21:51:26.707 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.707 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.707 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.707 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "5000", 2020-11-16T21:51:26.707 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.707 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.707 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.707 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.708 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.708 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.708 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.708 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.708 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "database": { 2020-11-16T21:51:26.708 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "database", 2020-11-16T21:51:26.708 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.709 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.709 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.709 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "ceph", 2020-11-16T21:51:26.709 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.709 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.709 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.709 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.709 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.710 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.710 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.710 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.710 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "hostname": { 2020-11-16T21:51:26.710 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "hostname", 2020-11-16T21:51:26.710 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.710 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.711 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.711 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:26.711 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.711 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.711 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.711 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.711 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.711 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.712 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.712 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.712 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "interval": { 2020-11-16T21:51:26.712 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "interval", 2020-11-16T21:51:26.712 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.712 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.712 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.713 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "30", 2020-11-16T21:51:26.713 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.713 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.713 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.713 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.713 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.713 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.713 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.714 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.714 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:26.714 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:26.714 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.714 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.714 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.714 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:26.715 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.715 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.715 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:26.715 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:26.715 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:26.715 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:26.715 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:26.715 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:26.716 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:26.716 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:26.716 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.716 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.716 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.716 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.716 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.717 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:26.717 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:26.717 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.717 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.717 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.717 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:26.717 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.717 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.718 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.718 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.718 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.718 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.718 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.718 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.718 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:26.719 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:26.719 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.719 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.719 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.719 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:26.719 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.719 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.719 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:26.720 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:26.720 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:26.720 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:26.720 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:26.720 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:26.720 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:26.720 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:26.721 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.721 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.721 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.721 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.721 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.721 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:26.721 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:26.721 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.722 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.722 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.722 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:26.722 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.722 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.722 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.722 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.723 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.723 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.723 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.723 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.723 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "password": { 2020-11-16T21:51:26.723 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "password", 2020-11-16T21:51:26.723 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.723 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.724 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.724 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:26.724 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.724 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.926 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.926 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.926 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.926 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.927 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.927 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.927 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "port": { 2020-11-16T21:51:26.927 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "port", 2020-11-16T21:51:26.927 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.927 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.927 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.928 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "8086", 2020-11-16T21:51:26.928 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.928 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.928 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.928 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.928 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.928 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.929 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.929 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.929 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ssl": { 2020-11-16T21:51:26.929 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ssl", 2020-11-16T21:51:26.929 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.929 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.929 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.929 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "false", 2020-11-16T21:51:26.930 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.930 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.930 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.930 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.930 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.930 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.930 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.931 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.931 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "threads": { 2020-11-16T21:51:26.931 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "threads", 2020-11-16T21:51:26.931 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.931 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.931 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.931 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "5", 2020-11-16T21:51:26.932 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.932 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.932 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.932 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.932 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.932 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.932 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.932 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.933 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "username": { 2020-11-16T21:51:26.933 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "username", 2020-11-16T21:51:26.933 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.933 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.933 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.933 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:26.933 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.934 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.934 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.934 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.934 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.934 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.934 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.934 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.934 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "verify_ssl": { 2020-11-16T21:51:26.935 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "verify_ssl", 2020-11-16T21:51:26.935 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.935 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.935 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.935 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "true", 2020-11-16T21:51:26.935 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.935 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.936 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.936 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.936 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.936 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.936 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.936 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:26.936 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:26.936 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.937 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:26.937 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "insights", 2020-11-16T21:51:26.937 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:26.937 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:26.937 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:26.937 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:26.937 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:26.938 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.938 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.938 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.938 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:26.938 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.938 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.938 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:26.938 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:26.939 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:26.939 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:26.939 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:26.939 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:26.939 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:26.939 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:26.939 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.940 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.940 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.940 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.940 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.940 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:26.940 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:26.940 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.940 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.941 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.941 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:26.941 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.941 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.941 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.941 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.941 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.941 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.942 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.942 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.942 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:26.942 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:26.942 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.942 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.942 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.943 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:26.943 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.943 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.943 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:26.943 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:26.943 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:26.943 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:26.943 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:26.944 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:26.944 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:26.944 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:26.944 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.944 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.944 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.944 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:26.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:26.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:26.946 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.946 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.946 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.946 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.946 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.946 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.946 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.946 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:26.947 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:26.947 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.947 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:26.947 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "iostat", 2020-11-16T21:51:26.947 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:26.947 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:26.947 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:26.948 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:26.948 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:26.948 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.948 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.948 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.948 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:26.948 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.948 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.949 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:26.949 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:26.949 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:26.949 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:26.949 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:26.949 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:26.949 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:26.950 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:26.950 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.950 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.950 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.950 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.950 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.950 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:26.950 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:26.951 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.951 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.951 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.951 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:26.951 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.951 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.951 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.952 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.952 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.952 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.952 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.952 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.952 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:26.952 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:26.952 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:26.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:26.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:26.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:26.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:26.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:26.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:26.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:26.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:26.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:26.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:26.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:26.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:26.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:26.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:26.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "k8sevents", 2020-11-16T21:51:26.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:26.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:26.958 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:26.958 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2020-11-16T21:51:26.958 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2020-11-16T21:51:26.958 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:26.958 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.958 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.958 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "7", 2020-11-16T21:51:26.959 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.959 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.959 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.959 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2020-11-16T21:51:26.959 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.959 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.959 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.959 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.960 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "config_check_secs": { 2020-11-16T21:51:26.960 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "config_check_secs", 2020-11-16T21:51:26.960 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:26.960 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.960 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:26.960 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "10", 2020-11-16T21:51:26.960 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "10", 2020-11-16T21:51:26.961 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.961 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.961 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2020-11-16T21:51:26.961 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.961 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.961 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.961 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.961 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:26.962 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:26.962 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.962 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.962 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.962 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:26.962 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.962 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.963 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:26.963 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:26.963 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:26.963 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:26.963 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:26.963 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:26.963 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:26.964 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:26.964 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.964 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.964 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.964 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.964 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.965 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:26.965 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:26.965 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.965 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.965 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.965 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:26.965 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.966 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.966 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.966 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.966 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.966 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.966 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.966 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.967 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:26.967 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:26.967 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.967 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.967 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.967 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:26.967 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.967 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.968 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:26.968 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:26.968 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:26.968 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:26.968 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:26.968 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:26.968 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:26.968 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:26.969 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.969 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.969 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.969 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.969 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.969 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:26.969 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:26.970 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.970 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.970 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.970 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:26.970 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.970 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.970 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.970 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.971 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.971 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.971 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.971 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:26.971 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:26.971 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.971 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:26.972 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "localpool", 2020-11-16T21:51:26.972 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:26.972 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:26.972 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:26.972 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "failure_domain": { 2020-11-16T21:51:26.972 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "failure_domain", 2020-11-16T21:51:26.972 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.972 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.973 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.973 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "host", 2020-11-16T21:51:26.973 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.973 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.973 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.973 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2020-11-16T21:51:26.973 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.974 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.974 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.974 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.974 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:26.974 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:26.974 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:26.974 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.974 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.975 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:26.975 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.975 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.975 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:26.975 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:26.975 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:26.975 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:26.976 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:26.976 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:26.976 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:26.976 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:26.976 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.976 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.976 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.976 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:26.977 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:26.977 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:26.977 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:26.977 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:26.977 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:26.977 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:26.977 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:26.977 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:26.978 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:26.978 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:26.978 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:26.978 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:26.978 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:26.978 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.182 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.182 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:27.183 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:27.183 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.183 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.183 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.183 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:27.183 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.183 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.184 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:27.184 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:27.184 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:27.184 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:27.184 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:27.184 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:27.184 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:27.185 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:27.185 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.185 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.185 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.185 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.185 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.185 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:27.185 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:27.186 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:27.186 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.186 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.186 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:27.186 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.186 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.186 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.187 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.187 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.187 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.187 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.187 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.187 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min_size": { 2020-11-16T21:51:27.187 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "min_size", 2020-11-16T21:51:27.188 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:27.188 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.188 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.188 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:27.188 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.188 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.188 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.189 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2020-11-16T21:51:27.189 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.189 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.189 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.189 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.189 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_rep": { 2020-11-16T21:51:27.189 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "num_rep", 2020-11-16T21:51:27.189 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:27.190 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.190 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.190 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "3", 2020-11-16T21:51:27.190 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.190 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.190 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.190 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2020-11-16T21:51:27.191 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.191 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.191 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.191 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.191 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pg_num": { 2020-11-16T21:51:27.191 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "pg_num", 2020-11-16T21:51:27.191 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:27.191 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.192 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.192 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "128", 2020-11-16T21:51:27.192 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.192 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.192 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.192 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2020-11-16T21:51:27.192 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.193 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.193 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.193 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.193 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "prefix": { 2020-11-16T21:51:27.193 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "prefix", 2020-11-16T21:51:27.193 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.193 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.193 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.194 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:27.194 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.194 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.194 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.194 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2020-11-16T21:51:27.194 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.194 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.195 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.195 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.195 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "subtree": { 2020-11-16T21:51:27.195 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "subtree", 2020-11-16T21:51:27.195 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.195 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.195 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.195 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "rack", 2020-11-16T21:51:27.196 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.196 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.196 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.196 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2020-11-16T21:51:27.196 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.196 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.196 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.197 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:27.197 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:27.197 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.197 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:27.197 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "mds_autoscaler", 2020-11-16T21:51:27.197 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:27.197 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:27.197 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:27.198 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:27.198 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:27.198 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.198 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.198 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.198 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:27.198 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.199 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.199 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:27.199 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:27.199 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:27.199 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:27.199 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:27.199 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:27.199 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:27.200 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:27.200 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.200 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.200 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.200 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.200 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.200 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:27.201 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:27.201 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:27.201 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.201 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.201 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:27.201 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.201 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.201 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.202 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.202 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.202 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.202 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.202 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.202 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:27.202 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:27.203 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.203 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.203 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.203 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:27.203 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.203 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.203 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:27.203 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:27.204 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:27.204 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:27.204 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:27.204 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:27.204 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:27.204 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:27.204 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.205 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.205 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.205 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.205 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.205 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:27.205 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:27.205 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:27.205 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.206 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.206 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:27.206 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.206 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.206 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.206 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.206 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.207 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.207 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.207 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:27.207 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:27.207 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.207 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:27.207 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "orchestrator", 2020-11-16T21:51:27.208 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:27.208 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:27.208 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:27.208 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:27.208 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:27.208 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.208 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.208 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.410 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:27.410 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.411 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.411 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:27.411 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:27.411 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:27.411 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:27.411 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:27.411 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:27.412 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:27.412 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:27.412 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.412 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.412 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.412 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.412 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.412 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:27.413 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:27.413 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:27.413 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.413 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.413 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:27.413 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.413 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.414 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.414 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.414 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.414 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.414 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.414 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.414 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:27.415 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:27.415 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.415 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.415 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.415 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:27.415 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.415 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.416 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:27.416 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:27.416 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:27.416 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:27.416 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:27.416 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:27.416 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:27.416 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:27.417 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.417 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.417 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.417 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.417 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.417 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:27.417 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:27.418 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:27.418 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.418 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.418 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:27.418 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.418 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.418 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.418 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.419 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.419 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.419 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.419 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.419 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "orchestrator": { 2020-11-16T21:51:27.419 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "orchestrator", 2020-11-16T21:51:27.419 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.420 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.420 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.420 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:27.420 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.420 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.420 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:27.420 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "cephadm", 2020-11-16T21:51:27.420 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rook", 2020-11-16T21:51:27.421 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "test_orchestrator" 2020-11-16T21:51:27.421 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:27.421 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2020-11-16T21:51:27.421 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.421 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.421 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.421 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:27.422 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:27.422 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.422 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:27.422 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "osd_support", 2020-11-16T21:51:27.422 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:27.422 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:27.422 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:27.423 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:27.423 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:27.423 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.423 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.423 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.423 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:27.423 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.423 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.424 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:27.424 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:27.424 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:27.424 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:27.424 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:27.424 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:27.424 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:27.425 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:27.425 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.425 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.425 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.425 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.425 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.425 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:27.425 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:27.426 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:27.426 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.426 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.426 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:27.426 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.426 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.426 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.427 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.427 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.427 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.427 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.427 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.427 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:27.427 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:27.427 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.428 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.428 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.428 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:27.428 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.428 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.428 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:27.428 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:27.429 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:27.429 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:27.429 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:27.429 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:27.429 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:27.429 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:27.429 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.430 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.430 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.430 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.430 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.430 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:27.430 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:27.430 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:27.430 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.431 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.431 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:27.431 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.431 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.431 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.431 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.431 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.432 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.432 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.432 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:27.432 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:27.432 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.432 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:27.432 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2020-11-16T21:51:27.432 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:27.433 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:27.433 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:27.433 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:27.433 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:27.433 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.433 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.433 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.434 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:27.434 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.434 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.434 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:27.434 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:27.434 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:27.434 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:27.434 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:27.435 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:27.435 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:27.435 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:27.435 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.435 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.435 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.435 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.436 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.436 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:27.436 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:27.436 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:27.436 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.436 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.436 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:27.436 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.638 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.638 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.638 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.639 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.639 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.639 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.639 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.639 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:27.639 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:27.639 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.640 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.640 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.640 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:27.640 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.640 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.640 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:27.640 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:27.640 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:27.641 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:27.641 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:27.641 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:27.641 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:27.641 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:27.641 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.641 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.642 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.642 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.642 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.642 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:27.642 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:27.642 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:27.642 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.643 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.643 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:27.643 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.643 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.643 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.643 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.643 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.643 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.644 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.644 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.644 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "sleep_interval": { 2020-11-16T21:51:27.644 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-11-16T21:51:27.644 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.644 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.644 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:27.645 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "60", 2020-11-16T21:51:27.645 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.645 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.645 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.645 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.645 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.645 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.645 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.646 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:27.646 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:27.646 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.646 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:27.646 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "progress", 2020-11-16T21:51:27.646 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:27.646 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:27.647 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:27.647 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:27.647 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:27.647 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.647 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.647 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.647 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:27.647 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.648 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.648 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:27.648 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:27.648 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:27.648 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:27.648 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:27.648 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:27.649 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:27.649 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:27.649 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.649 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.649 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.649 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.649 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.649 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:27.650 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:27.650 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:27.650 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.650 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.650 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:27.650 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.650 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.651 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.651 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.651 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.651 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.651 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.651 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.651 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:27.652 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:27.652 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.652 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.652 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.652 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:27.652 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.652 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.652 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:27.653 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:27.653 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:27.653 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:27.653 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:27.653 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:27.653 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:27.653 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:27.653 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.654 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.654 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.654 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.654 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.654 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:27.654 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:27.654 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:27.655 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.655 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.655 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:27.655 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.655 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.655 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.655 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.655 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.656 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.656 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.656 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.656 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max_completed_events": { 2020-11-16T21:51:27.656 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "max_completed_events", 2020-11-16T21:51:27.656 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:27.656 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.657 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.657 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "50", 2020-11-16T21:51:27.657 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.657 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.657 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.657 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2020-11-16T21:51:27.657 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.657 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.658 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.658 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.658 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "persist_interval": { 2020-11-16T21:51:27.658 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "persist_interval", 2020-11-16T21:51:27.658 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:27.658 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.658 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.659 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "5", 2020-11-16T21:51:27.659 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.659 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.659 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.659 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2020-11-16T21:51:27.659 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.659 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.659 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.660 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:27.660 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:27.660 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.660 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:27.660 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "prometheus", 2020-11-16T21:51:27.660 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:27.660 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:27.661 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:27.661 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:27.661 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:27.661 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.661 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.661 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.661 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:27.661 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.662 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.662 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:27.662 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:27.662 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:27.662 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:27.662 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:27.662 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:27.663 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:27.663 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:27.663 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.663 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.663 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.663 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.663 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.663 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:27.664 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:27.664 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:27.664 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.664 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.664 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:27.866 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.866 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.866 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.867 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.867 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.867 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.867 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.867 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.867 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:27.867 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:27.868 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.868 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.868 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.868 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:27.868 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.868 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.868 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:27.869 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:27.869 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:27.869 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:27.869 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:27.869 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:27.869 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:27.869 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:27.870 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.870 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.870 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.870 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.870 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.870 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:27.870 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:27.870 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:27.871 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.871 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.871 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:27.871 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.871 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.871 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.871 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.872 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.872 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.872 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.872 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.872 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rbd_stats_pools": { 2020-11-16T21:51:27.872 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2020-11-16T21:51:27.872 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.873 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.873 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:27.873 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:27.873 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.873 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.873 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.873 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.874 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.874 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.874 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.874 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.874 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2020-11-16T21:51:27.874 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2020-11-16T21:51:27.874 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:27.874 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.875 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:27.875 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "300", 2020-11-16T21:51:27.875 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.875 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.875 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.875 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.875 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.876 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.876 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.876 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.876 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "scrape_interval": { 2020-11-16T21:51:27.876 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "scrape_interval", 2020-11-16T21:51:27.876 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.876 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.877 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:27.877 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:27.877 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.877 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.877 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.877 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.877 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.877 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.878 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.878 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.878 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "server_addr": { 2020-11-16T21:51:27.878 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "server_addr", 2020-11-16T21:51:27.878 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.878 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.878 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:27.879 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:27.879 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.879 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.879 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.879 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.879 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.879 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.879 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.880 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.880 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "server_port": { 2020-11-16T21:51:27.880 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "server_port", 2020-11-16T21:51:27.880 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.880 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.880 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:27.880 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:27.881 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.881 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.881 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.881 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.881 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.881 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.881 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.881 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.882 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "stale_cache_strategy": { 2020-11-16T21:51:27.882 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "stale_cache_strategy", 2020-11-16T21:51:27.882 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.882 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.882 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:27.882 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:27.882 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.883 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.883 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.883 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.883 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.883 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.883 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.883 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:27.883 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:27.884 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.884 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:27.884 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rbd_support", 2020-11-16T21:51:27.884 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:27.884 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:27.884 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:27.884 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:27.885 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:27.885 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.885 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.885 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.885 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:27.885 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.885 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.885 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:27.886 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:27.886 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:27.886 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:27.886 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:27.886 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:27.886 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:27.886 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:27.887 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.887 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.887 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.887 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.887 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.887 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:27.887 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:27.887 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:27.888 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.888 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.888 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:27.888 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.888 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.888 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:27.888 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.889 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.889 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.889 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.889 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.889 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:27.889 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:27.889 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:27.889 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.890 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:27.890 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:27.890 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:27.890 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:27.890 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:27.890 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:27.890 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:27.891 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:27.891 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:27.891 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:27.891 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:27.891 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:27.891 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:27.891 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:27.891 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:27.892 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:27.892 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:27.892 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:27.892 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:27.892 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:27.892 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:27.892 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.094 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:28.094 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.094 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.094 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.095 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.095 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.095 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.095 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.095 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.095 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max_concurrent_snap_create": { 2020-11-16T21:51:28.095 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "max_concurrent_snap_create", 2020-11-16T21:51:28.096 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:28.096 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.096 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.096 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "10", 2020-11-16T21:51:28.096 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.096 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.096 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.097 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.097 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.097 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.097 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.097 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.097 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2020-11-16T21:51:28.097 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2020-11-16T21:51:28.097 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.098 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.098 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.098 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.098 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.098 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.098 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.098 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.099 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.099 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.099 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.099 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.099 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "trash_purge_schedule": { 2020-11-16T21:51:28.099 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2020-11-16T21:51:28.099 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.100 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.100 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.100 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.100 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.100 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.100 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.100 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.100 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.101 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.101 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.101 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:28.101 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:28.101 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.101 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:28.101 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "restful", 2020-11-16T21:51:28.102 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:28.102 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:28.102 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:28.102 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enable_auth": { 2020-11-16T21:51:28.102 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "enable_auth", 2020-11-16T21:51:28.102 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.102 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.103 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.103 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:28.103 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.103 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.103 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.103 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.103 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.103 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.104 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.104 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.104 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "key_file": { 2020-11-16T21:51:28.104 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "key_file", 2020-11-16T21:51:28.104 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.104 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.104 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.105 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.105 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.105 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.105 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.106 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.106 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.106 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.106 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.106 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.106 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:28.106 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:28.107 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.107 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.107 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.107 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.107 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.107 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.107 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:28.108 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:28.108 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:28.108 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:28.108 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:28.108 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:28.108 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:28.108 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:28.108 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.109 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.109 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.109 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.109 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.109 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:28.109 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:28.109 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.110 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.110 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.110 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:28.110 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.110 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.110 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.110 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.111 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.111 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.111 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.111 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.111 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:28.111 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:28.111 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.111 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.112 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.112 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:28.112 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.112 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.112 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:28.112 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:28.112 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:28.113 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:28.113 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:28.113 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:28.113 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:28.113 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:28.113 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.113 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.113 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.114 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.114 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.114 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:28.114 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:28.114 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.114 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.114 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.115 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:28.115 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.115 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.115 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.115 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.115 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.115 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.115 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.116 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.116 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "server_addr": { 2020-11-16T21:51:28.116 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "server_addr", 2020-11-16T21:51:28.116 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.116 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.116 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.116 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.117 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.117 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.117 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.117 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.117 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.117 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.117 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.118 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.118 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "server_port": { 2020-11-16T21:51:28.118 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "server_port", 2020-11-16T21:51:28.118 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.118 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.118 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.118 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.118 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.119 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.119 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.119 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.119 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.119 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.119 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.119 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:28.120 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:28.120 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.120 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:28.120 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rook", 2020-11-16T21:51:28.120 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:28.120 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:28.120 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:28.120 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:28.121 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:28.121 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.121 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.121 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.121 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.121 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.121 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.121 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:28.122 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:28.122 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:28.122 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:28.122 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:28.122 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:28.122 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:28.122 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:28.123 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.123 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.123 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.123 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.123 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.123 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:28.123 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:28.123 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.124 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.124 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.124 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:28.124 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.124 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.124 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.124 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.125 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.125 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.125 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.125 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.125 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:28.125 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:28.125 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.125 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.126 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.126 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:28.126 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.126 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.126 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:28.126 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:28.126 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:28.127 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:28.127 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:28.127 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:28.127 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:28.127 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:28.127 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.127 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.127 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.128 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.128 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.128 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:28.128 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:28.128 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.128 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.128 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.128 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:28.129 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.129 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.129 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.129 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.129 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.129 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.129 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.130 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:28.130 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:28.130 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.130 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:28.130 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "selftest", 2020-11-16T21:51:28.130 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:28.130 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:28.130 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:28.131 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:28.131 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:28.131 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.131 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.131 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.131 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.131 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.132 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.132 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:28.132 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:28.132 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:28.132 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:28.132 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:28.132 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:28.132 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:28.133 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:28.133 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.133 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.133 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.133 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.133 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.133 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:28.133 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:28.134 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.134 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.134 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.134 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:28.134 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.134 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.134 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.135 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.135 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.135 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.135 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.135 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.135 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:28.135 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:28.136 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.136 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.136 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.136 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:28.136 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.136 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.136 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:28.136 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:28.137 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:28.137 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:28.137 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:28.137 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:28.137 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:28.137 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:28.137 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.137 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.138 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.138 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.138 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.138 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:28.138 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:28.342 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.342 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.342 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.342 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:28.343 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.343 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.343 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.343 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.343 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.343 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.343 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.343 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.344 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "roption1": { 2020-11-16T21:51:28.344 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "roption1", 2020-11-16T21:51:28.344 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.344 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.344 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.344 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.344 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.345 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.345 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.345 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.345 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.345 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.345 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.345 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.346 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "roption2": { 2020-11-16T21:51:28.346 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "roption2", 2020-11-16T21:51:28.346 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.346 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.346 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.346 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "xyz", 2020-11-16T21:51:28.346 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.346 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.347 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.347 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.347 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.347 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.347 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.347 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.347 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rwoption1": { 2020-11-16T21:51:28.348 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rwoption1", 2020-11-16T21:51:28.348 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.348 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.348 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.348 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.348 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.348 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.348 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.349 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.349 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.349 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.349 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.349 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.349 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rwoption2": { 2020-11-16T21:51:28.349 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rwoption2", 2020-11-16T21:51:28.350 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:28.350 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.350 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.350 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.350 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.350 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.350 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.351 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.351 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.351 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.351 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.351 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.351 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rwoption3": { 2020-11-16T21:51:28.351 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rwoption3", 2020-11-16T21:51:28.351 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "float", 2020-11-16T21:51:28.352 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.352 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.352 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.352 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.352 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.352 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.352 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.352 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.353 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.353 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.353 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.353 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rwoption4": { 2020-11-16T21:51:28.353 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rwoption4", 2020-11-16T21:51:28.353 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.353 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.354 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.354 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.354 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.354 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.354 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.354 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.354 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.355 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.355 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.355 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.355 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rwoption5": { 2020-11-16T21:51:28.355 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rwoption5", 2020-11-16T21:51:28.355 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.355 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.355 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.356 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.356 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.356 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.356 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.356 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.356 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.356 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.356 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.357 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.357 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rwoption6": { 2020-11-16T21:51:28.357 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rwoption6", 2020-11-16T21:51:28.357 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.357 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.357 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.357 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:28.358 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.358 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.358 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.358 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.358 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.358 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.358 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.359 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.359 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "testkey": { 2020-11-16T21:51:28.359 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "testkey", 2020-11-16T21:51:28.359 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.359 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.359 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.359 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.359 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.360 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.360 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.360 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.360 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.360 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.360 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.360 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.361 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "testlkey": { 2020-11-16T21:51:28.361 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "testlkey", 2020-11-16T21:51:28.361 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.361 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.361 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.361 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.361 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.361 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.362 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.362 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.362 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.362 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.362 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.362 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.362 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "testnewline": { 2020-11-16T21:51:28.363 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "testnewline", 2020-11-16T21:51:28.363 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.363 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.363 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.363 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.363 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.363 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.363 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.364 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:28.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:28.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:28.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "snap_schedule", 2020-11-16T21:51:28.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:28.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:28.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:28.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:28.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:28.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:28.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:28.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:28.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:28.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:28.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:28.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:28.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:28.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:28.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:28.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:28.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:28.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:28.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:28.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:28.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:28.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:28.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:28.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:28.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:28.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:28.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:28.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:28.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:28.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:28.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:28.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:28.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:28.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "stats", 2020-11-16T21:51:28.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:28.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:28.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:28.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:28.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:28.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:28.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:28.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:28.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:28.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:28.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:28.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:28.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:28.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:28.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:28.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:28.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:28.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:28.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:28.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:28.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:28.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:28.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:28.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:28.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:28.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:28.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:28.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:28.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:28.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:28.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:28.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:28.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:28.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "status", 2020-11-16T21:51:28.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:28.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:28.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:28.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:28.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:28.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:28.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:28.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:28.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:28.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:28.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:28.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:28.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:28.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:28.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:28.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:28.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:28.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:28.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:28.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:28.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:28.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:28.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:28.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:28.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:28.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:28.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:28.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:28.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:28.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:28.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:28.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:28.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:28.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "telegraf", 2020-11-16T21:51:28.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:28.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:28.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:28.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "address": { 2020-11-16T21:51:28.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "address", 2020-11-16T21:51:28.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2020-11-16T21:51:28.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.600 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.600 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.600 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.600 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.600 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.600 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.600 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "interval": { 2020-11-16T21:51:28.601 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "interval", 2020-11-16T21:51:28.601 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:28.601 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.601 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.601 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "15", 2020-11-16T21:51:28.601 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.601 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.602 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.602 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.602 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.602 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.602 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.602 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.602 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:28.602 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:28.603 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.603 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.603 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.603 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:28.603 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.603 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.603 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:28.604 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:28.604 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:28.604 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:28.604 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:28.604 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:28.604 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:28.604 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:28.604 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.605 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.605 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.605 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.605 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.605 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:28.605 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:28.605 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.605 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.606 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.606 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:28.606 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.606 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.606 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.606 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.606 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.607 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.607 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.607 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.607 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:28.607 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:28.607 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.607 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.607 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.608 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:28.608 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.608 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.608 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:28.608 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:28.608 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:28.608 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:28.609 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:28.609 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:28.609 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:28.609 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:28.609 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.609 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.609 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.609 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.610 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.610 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:28.814 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:28.814 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.814 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.814 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:28.815 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:28.815 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.815 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.815 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.815 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.815 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.815 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.816 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.816 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:28.816 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:28.816 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.816 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:28.816 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "telemetry", 2020-11-16T21:51:28.816 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:28.817 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:28.817 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:28.817 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "channel_basic": { 2020-11-16T21:51:28.817 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "channel_basic", 2020-11-16T21:51:28.817 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.817 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.817 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.817 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:28.818 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.818 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.818 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.818 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2020-11-16T21:51:28.818 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.818 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.818 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.819 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.819 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "channel_crash": { 2020-11-16T21:51:28.819 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "channel_crash", 2020-11-16T21:51:28.819 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.819 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.819 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.819 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:28.820 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.820 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.820 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.820 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.820 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.820 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.820 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.820 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.821 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "channel_device": { 2020-11-16T21:51:28.821 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "channel_device", 2020-11-16T21:51:28.821 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.821 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.821 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.821 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:28.821 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.822 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.822 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.822 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.822 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.822 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.822 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.822 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.822 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "channel_ident": { 2020-11-16T21:51:28.823 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "channel_ident", 2020-11-16T21:51:28.823 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.823 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.823 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.823 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:28.823 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.823 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.824 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.824 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.824 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.824 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.824 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.824 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.824 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "contact": { 2020-11-16T21:51:28.824 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "contact", 2020-11-16T21:51:28.825 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.825 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.825 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.825 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:28.825 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.825 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.825 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.826 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.826 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.826 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.826 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.826 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.826 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "description": { 2020-11-16T21:51:28.826 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "description", 2020-11-16T21:51:28.826 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.827 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.827 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.827 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:28.827 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.827 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.827 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.827 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.828 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.828 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.828 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.828 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.828 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "device_url": { 2020-11-16T21:51:28.828 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "device_url", 2020-11-16T21:51:28.828 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:28.828 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.829 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.829 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2020-11-16T21:51:28.829 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.829 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.829 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.829 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.829 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.830 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.830 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.830 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.830 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enabled": { 2020-11-16T21:51:28.830 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "enabled", 2020-11-16T21:51:28.830 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:28.830 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.830 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.831 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:28.831 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.831 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.831 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.831 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.831 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.831 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.832 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.832 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.832 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "interval": { 2020-11-16T21:51:28.832 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "interval", 2020-11-16T21:51:28.832 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:28.832 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.832 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.833 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "24", 2020-11-16T21:51:28.833 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "8", 2020-11-16T21:51:28.833 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.833 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.833 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.833 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.833 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.833 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "last_opt_revision": { 2020-11-16T21:51:28.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "last_opt_revision", 2020-11-16T21:51:28.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:28.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:28.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:28.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "1", 2020-11-16T21:51:28.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:28.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:28.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:28.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:28.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:28.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:28.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:28.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:28.836 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "leaderboard": { 2020-11-16T21:51:29.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "leaderboard", 2020-11-16T21:51:29.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:29.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.038 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:29.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:29.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.039 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:29.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:29.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:29.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.040 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:29.041 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:29.041 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.041 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.041 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:29.041 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:29.041 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:29.041 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:29.041 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:29.042 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:29.042 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:29.042 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:29.042 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.042 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.042 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.042 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.043 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.043 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:29.043 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:29.043 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:29.043 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.043 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:29.043 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:29.044 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.044 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.044 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.044 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.044 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.044 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.044 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.044 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.045 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:29.045 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:29.045 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:29.045 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.045 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:29.045 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:29.045 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.046 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.046 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:29.046 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:29.046 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:29.046 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:29.046 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:29.046 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:29.046 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:29.047 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:29.047 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.047 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.047 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.047 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.047 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.047 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:29.048 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:29.048 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:29.048 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.048 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:29.048 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:29.048 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.048 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.049 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.049 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.049 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.049 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.049 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.049 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.049 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "organization": { 2020-11-16T21:51:29.049 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "organization", 2020-11-16T21:51:29.050 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:29.050 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.050 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:29.050 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:29.050 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.050 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.050 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.051 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.051 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.051 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.051 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.051 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.051 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "proxy": { 2020-11-16T21:51:29.051 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "proxy", 2020-11-16T21:51:29.051 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:29.052 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.052 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:29.052 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:29.052 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.052 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.052 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.052 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.052 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.053 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.053 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.053 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.053 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "url": { 2020-11-16T21:51:29.053 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "url", 2020-11-16T21:51:29.053 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:29.053 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.054 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:29.054 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2020-11-16T21:51:29.054 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.054 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.054 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.054 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.054 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:29.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:29.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:29.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "test_orchestrator", 2020-11-16T21:51:29.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:29.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:29.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:29.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:29.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:29.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:29.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:29.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:29.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:29.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:29.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:29.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:29.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:29.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:29.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:29.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:29.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:29.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:29.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:29.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:29.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:29.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.262 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.262 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.262 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.263 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.263 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:29.263 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:29.263 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:29.263 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.263 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:29.263 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:29.264 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.264 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.264 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:29.264 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:29.264 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:29.264 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:29.264 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:29.264 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:29.265 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:29.265 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:29.265 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.265 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.265 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.265 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.265 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.266 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:29.266 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:29.266 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:29.266 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.266 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:29.266 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:29.266 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.267 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.267 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.267 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.267 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.267 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.267 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.267 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:29.267 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:29.268 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.268 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:29.268 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "volumes", 2020-11-16T21:51:29.268 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:29.268 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:29.268 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:29.268 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:29.269 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:29.269 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:29.269 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.269 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:29.269 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:29.269 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.269 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.269 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:29.270 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:29.270 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:29.270 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:29.270 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:29.270 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:29.270 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:29.271 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:29.271 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.271 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.271 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.271 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.271 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.271 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:29.271 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:29.272 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:29.272 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.272 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:29.272 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:29.272 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.272 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.272 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.273 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.273 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.273 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.273 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.273 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.273 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:29.273 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:29.273 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:29.274 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.274 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:29.274 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:29.274 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.274 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.274 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:29.274 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:29.275 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:29.275 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:29.275 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:29.275 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:29.275 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:29.275 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:29.275 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.276 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.276 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.276 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.276 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.276 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:29.276 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:29.276 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:29.276 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.277 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:29.277 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:29.277 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.277 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.277 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.277 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.277 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.278 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.278 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.278 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.278 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max_concurrent_clones": { 2020-11-16T21:51:29.278 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "max_concurrent_clones", 2020-11-16T21:51:29.278 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:29.278 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.279 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:29.279 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "4", 2020-11-16T21:51:29.279 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.279 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.279 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.279 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Number of asynchronous cloner threads", 2020-11-16T21:51:29.279 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.279 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.280 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.280 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:29.280 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:29.280 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.280 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:29.280 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "zabbix", 2020-11-16T21:51:29.280 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:29.281 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:29.281 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:29.281 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "discovery_interval": { 2020-11-16T21:51:29.281 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "discovery_interval", 2020-11-16T21:51:29.281 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:29.281 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.281 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:29.281 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "100", 2020-11-16T21:51:29.282 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.282 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.282 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.282 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.282 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.282 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.282 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "identifier": { 2020-11-16T21:51:29.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "identifier", 2020-11-16T21:51:29.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:29.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:29.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:29.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "interval": { 2020-11-16T21:51:29.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "interval", 2020-11-16T21:51:29.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:29.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:29.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "60", 2020-11-16T21:51:29.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:29.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:29.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:29.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:29.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:29.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:29.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:29.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:29.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:29.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:29.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:29.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:29.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:29.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:29.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:29.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:29.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:29.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:29.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:29.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:29.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:29.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:29.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:29.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:29.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:29.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:29.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:29.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:29.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:29.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:29.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:29.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:29.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:29.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:29.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:29.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:29.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "zabbix_host": { 2020-11-16T21:51:29.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "zabbix_host", 2020-11-16T21:51:29.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:29.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:29.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:29.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "zabbix_port": { 2020-11-16T21:51:29.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "zabbix_port", 2020-11-16T21:51:29.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:29.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:29.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "10051", 2020-11-16T21:51:29.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "zabbix_sender": { 2020-11-16T21:51:29.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "zabbix_sender", 2020-11-16T21:51:29.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:29.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:29.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:29.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2020-11-16T21:51:29.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:29.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:29.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:29.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:29.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:29.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:29.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:29.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:29.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:29.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:29.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:29.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "services": {}, 2020-11-16T21:51:29.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "always_on_modules": { 2020-11-16T21:51:29.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "nautilus": [ 2020-11-16T21:51:29.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "balancer", 2020-11-16T21:51:29.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "crash", 2020-11-16T21:51:29.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "devicehealth", 2020-11-16T21:51:29.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "orchestrator_cli", 2020-11-16T21:51:29.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "progress", 2020-11-16T21:51:29.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rbd_support", 2020-11-16T21:51:29.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "status", 2020-11-16T21:51:29.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "volumes" 2020-11-16T21:51:29.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:29.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "octopus": [ 2020-11-16T21:51:29.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "balancer", 2020-11-16T21:51:29.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "crash", 2020-11-16T21:51:29.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "devicehealth", 2020-11-16T21:51:29.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "orchestrator", 2020-11-16T21:51:29.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pg_autoscaler", 2020-11-16T21:51:29.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "progress", 2020-11-16T21:51:29.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rbd_support", 2020-11-16T21:51:29.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "status", 2020-11-16T21:51:29.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "telemetry", 2020-11-16T21:51:29.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "volumes" 2020-11-16T21:51:29.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:29.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pacific": [ 2020-11-16T21:51:29.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "balancer", 2020-11-16T21:51:29.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "crash", 2020-11-16T21:51:29.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "devicehealth", 2020-11-16T21:51:29.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "orchestrator", 2020-11-16T21:51:29.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pg_autoscaler", 2020-11-16T21:51:29.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "progress", 2020-11-16T21:51:29.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rbd_support", 2020-11-16T21:51:29.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "status", 2020-11-16T21:51:29.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "telemetry", 2020-11-16T21:51:29.510 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "volumes" 2020-11-16T21:51:29.510 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:29.510 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "last_failure_osd_epoch": 0, 2020-11-16T21:51:29.510 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "active_clients": [ 2020-11-16T21:51:29.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:29.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "addrvec": [ 2020-11-16T21:51:29.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:29.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "v2", 2020-11-16T21:51:29.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "addr": "172.21.15.195:0", 2020-11-16T21:51:29.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "nonce": 4048385390 2020-11-16T21:51:29.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:29.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ] 2020-11-16T21:51:29.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:29.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:29.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "addrvec": [ 2020-11-16T21:51:29.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:29.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "v2", 2020-11-16T21:51:29.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "addr": "172.21.15.195:0", 2020-11-16T21:51:29.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "nonce": 3952937853 2020-11-16T21:51:29.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:29.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ] 2020-11-16T21:51:29.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:29.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ] 2020-11-16T21:51:29.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:29.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:29.515 INFO:teuthology.orchestra.run.smithi195.stderr:Waiting for the mgr to restart... 2020-11-16T21:51:29.515 INFO:teuthology.orchestra.run.smithi195.stderr:Waiting for mgr epoch 5... 2020-11-16T21:51:29.515 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b tell mgr mgr_status 2020-11-16T21:51:29.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:29.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "mgrmap_epoch": 7, 2020-11-16T21:51:29.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "initialized": true 2020-11-16T21:51:29.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:29.516 INFO:teuthology.orchestra.run.smithi195.stderr:mgr epoch 5 is available 2020-11-16T21:51:29.516 INFO:teuthology.orchestra.run.smithi195.stderr:Setting orchestrator backend to cephadm... 2020-11-16T21:51:29.516 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b orch set backend cephadm 2020-11-16T21:51:29.517 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:25 smithi195 bash[10218]: audit 2020-11-16T21:51:24.695798+0000 mon.a (mon.0) 37 : audit [DBG] from='client.? v1:172.21.15.195:0/3310926810' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2020-11-16T21:51:29.517 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: cluster 2020-11-16T21:51:27.690660+0000 mon.a (mon.0) 38 : cluster [INF] Active manager daemon y restarted 2020-11-16T21:51:29.517 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: cluster 2020-11-16T21:51:27.691661+0000 mon.a (mon.0) 39 : cluster [INF] Activating manager daemon y 2020-11-16T21:51:29.517 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: cluster 2020-11-16T21:51:27.695836+0000 mon.a (mon.0) 40 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2020-11-16T21:51:29.517 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: cluster 2020-11-16T21:51:27.747106+0000 mon.a (mon.0) 41 : cluster [DBG] mgrmap e6: y(active, starting, since 0.0556534s) 2020-11-16T21:51:29.517 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.752731+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2020-11-16T21:51:29.517 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.754170+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-11-16T21:51:29.518 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.754530+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-11-16T21:51:29.518 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.754821+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-11-16T21:51:29.518 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.755408+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-11-16T21:51:29.518 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.756645+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2020-11-16T21:51:29.518 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.757013+0000 mon.a (mon.0) 48 : audit [DBG] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2020-11-16T21:51:29.518 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.757346+0000 mon.a (mon.0) 49 : audit [DBG] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2020-11-16T21:51:29.519 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.757660+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2020-11-16T21:51:29.519 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: cluster 2020-11-16T21:51:27.761009+0000 mon.a (mon.0) 51 : cluster [INF] Manager daemon y is now available 2020-11-16T21:51:29.519 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.778679+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2020-11-16T21:51:29.519 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.781813+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2020-11-16T21:51:29.519 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.783754+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2020-11-16T21:51:29.519 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.786494+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2020-11-16T21:51:29.519 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.787479+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2020-11-16T21:51:29.519 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.790117+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd='[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2020-11-16T21:51:29.520 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.917451+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:51:29.520 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.922627+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:51:29.520 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.926223+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:51:29.520 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.928227+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:51:29.520 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.938140+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:51:29.520 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:28 smithi195 bash[10218]: audit 2020-11-16T21:51:27.940535+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2020-11-16T21:51:30.083 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:29 smithi195 bash[10218]: cluster 2020-11-16T21:51:28.748979+0000 mon.a (mon.0) 64 : cluster [DBG] mgrmap e7: y(active, since 1.05753s) 2020-11-16T21:51:30.083 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:29 smithi195 bash[10218]: audit 2020-11-16T21:51:28.751752+0000 mgr.y (mgr.14116) 1 : audit [DBG] from='client.14120 v1:172.21.15.195:0/2369964473' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2020-11-16T21:51:30.084 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:29 smithi195 bash[10218]: audit 2020-11-16T21:51:28.767950+0000 mgr.y (mgr.14116) 2 : audit [DBG] from='client.14120 v1:172.21.15.195:0/2369964473' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2020-11-16T21:51:31.374 INFO:teuthology.orchestra.run.smithi195.stderr:Generating ssh key... 2020-11-16T21:51:31.375 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b cephadm generate-key 2020-11-16T21:51:31.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:31 smithi195 bash[10218]: cluster 2020-11-16T21:51:30.383469+0000 mon.a (mon.0) 65 : cluster [DBG] mgrmap e8: y(active, since 2s) 2020-11-16T21:51:31.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:31 smithi195 bash[10218]: audit 2020-11-16T21:51:30.781412+0000 mgr.y (mgr.14116) 3 : audit [DBG] from='client.14126 v1:172.21.15.195:0/2456285695' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:51:31.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:31 smithi195 bash[10218]: audit 2020-11-16T21:51:30.785085+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]: dispatch 2020-11-16T21:51:31.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:31 smithi195 bash[10218]: audit 2020-11-16T21:51:30.791486+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd='[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]': finished 2020-11-16T21:51:31.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:31 smithi195 bash[10218]: audit 2020-11-16T21:51:30.798961+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:51:31.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:31 smithi195 bash[10218]: audit 2020-11-16T21:51:30.802945+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:51:33.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10218]: audit 2020-11-16T21:51:33.077709+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEA38YHq1TtOek8ikrjC+bPAa1DS5+MFebopPyveu1RzdvzUX/pPmy/\noVcjJKIcxw2wLfIjD2gC54KfQqGg+HMof4xHSE0NEMuqm3e1ppH7JtGzVi9iqoJv40E6kl\nWAe16VFHIzl/6Q+7Uw1IWGoL5hyoFfzNMj8zGNO2EKzaxAE8KBi3JyQkqEG9RHfBpUdiXp\nRusBV7Ch92Tty9Sl2yMdQUWd0l+xjy2jTnUYDv6EifwgHbpCskC+VQr9qtO9ZFZ1Z/HX3c\nnHi1YTiMNyXkJL+R22M3OW71EdErzYZAuTVVi1f3iv/8DOts3NbucYq1qWO/EQvDkuMpnQ\nQl/51l73ZANK4LbK0LxO6Rb7uGVKurNJRpBlU5+5xpVgtqX1Pr7DRGqrLhxiS2EIbqKOYU\nlkw76I3XhXPIe+yYpyW4bgvOJk9sYOVLXFyz42Hl0ixF9eJhHxQzEFL3y/ux0impQ2Xg+a\nq90JrMU2NEtZgySR1KDxylz4tApLh1tvcoiHMsf3AAAFoCMTqtUjE6rVAAAAB3NzaC1yc2\nEAAAGBAN/GB6tU7TnpPIpK4wvmzwGtQ0ufjBXm6KT8r3rtUc3b81F/6T5sv6FXIySiHMcN\nsC3yIw9oAueCn0KhoPhzKH+MR0hNDRDLqpt3taaR+ybRs1YvYqqCb+NBOpJVgHtelRRyM5\nf+kPu1MNSFhqC+YcqBX8zTI/MxjTthCs2sQBPCgYtyckJKhBvUR3waVHYl6UbrAVewofdk\n7cvUpdsjHUFFndJfsY8to051GA7+hIn8IB26QrJAvlUK/arTvWRWdWfx193Jx4tWE4jDcl\n5CS/kdtjNzlu9RHRK82GQLk1VYtX94r//AzrbNzW7nGKtaljvxELw5LjKZ0EJf+dZe92QD\nSuC2ytC8TukW+7hlSrqzSUaQZVOfucaVYLal9T6+w0Rqqy4cYkthCG6ijmFJZMO+iN14Vz\nyHvsmKcluG4LziZPbGDlS1xcs+Nh5dIsRfXiYR8UMxBS98v7sdIpqUNl4PmqvdCazFNjRL\nWYMkkdSg8cpc+LQKS4dbb3KIhzLH9wAAAAMBAAEAAAGBAKPk5rkV+qnvqeef8atF4VfZDv\nDUakWgWcR9Tgk6yC9+aTfH941BGRmSOKscEPe5jtAYCJXAGGB3yy2CM+PEdGT22T6bMHac\ntNgpVWIqiUhlTnRRQHKiFlDb9Yo4FWJGY+oVurQYPxgcHSeKpJAW4IjxOLlL64izQj27Va\n5N+qB+VWNM72KeMSQw1iqPHk1qdvD6LoGLXRVVVtVzagaWMVcdJfpvHB1Bz9om6PgScgCe\nKOedBDyKLt0ar6/uZUiYCQbsXcdv51ZGzj6U0lZNBHpIZLSTkpQhJv2Vq5HWU8F/m5zwzK\nD+LekztmHoxLOLiQ+dyXdc3cMmv2N2z6wKGFniRFsUCC5stVBedK7JDsVrbGrpIqaAjUEy\nF11syOapxsBOwcfiURpiwDlg52dzZiq9PgL0XXg77hOifbs+tzRfZtnmQC4wP4aLLG8qxO\n4wF1NFN3laN82+JVTDh9y4jcQrsyzSfngKuBhaTFXO1gM/Q1lrUO7YK5UNZd7k9BlEAQAA\nAMEAtM5/eqnEhR2qcWAVhedZTkoFfD94PbvHfFWWKS/ZaKADyqRtwTZS/U5QGFLQNQzef4\n97l45e5wN6nTHPF/mia4pF9npAO/l3IymcCURMSpxttveF9TmHO/fTaIRFhJ2es2PpQMkD\nSapIH4xpX0ut1q6JgAs/kHErgqNszP5VjOdHFTH+cegxn5qqkoK5Dq+PYvkEi7HLsKcba9\nRQlStErlEwkmo2IbiqqlgcAylDkrfD4dlgwA4+3ey8iIDHUUfwAAAAwQD0Kv14MmDjLqcI\nEErFm9gTeyBg2RzKnRe6CHCeMAgeeR4iAmSCZ34jR5K2hvKP1PHsMdTfw5hmws7bwhT9uR\nKEojrVEFyyQrwks2eu8gzMbaOHNX+7C9NgyAQI+jlb3puJzFYxssscoT3JM7WQr0UWEhjN\nTLRmd/n6n9OUZ6MSQN/IaKGuNnxUS+1kwliaOMNbrgZLHYQ/rw44O1WHnECigJNq6nH10v\nffx8izBe+j3SHqvAJPKBOyJLvMZTHzpSMAAADBAOqeCeg/xSxYYY0kYxmByYhh6HEF9X6K\nEBrw8XX5uNNxL3KO/ZIc0btH8DG5X0ztxECFaitxt8JCK6v1r2mTx6rXr3ZbfXdH463Baw\nGcjmiAF0rYb2lJNpoHmVpdBdoSbikYhKbi+NJQCJ5t/Ur/bVd3/xSuMZ3yjRaCFGEVEro2\nMkXY2RXa3KDflIf80Nuz4yKktsCvknkStjBnHBdnWWthVfiOAn7rKPr8ixhWYOY9ogDUno\ngpwdTo56MCH1NRHQAAACljZXBoLWJjZDUxMDhlLTI4NTUtMTFlYi1hMmIyLTAwMWE0YWFi\nODMwYw==\n-----END OPENSSH PRIVATE KEY-----\n"}]: dispatch 2020-11-16T21:51:33.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10218]: audit 2020-11-16T21:51:33.081566+0000 mon.a (mon.0) 71 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEA38YHq1TtOek8ikrjC+bPAa1DS5+MFebopPyveu1RzdvzUX/pPmy/\noVcjJKIcxw2wLfIjD2gC54KfQqGg+HMof4xHSE0NEMuqm3e1ppH7JtGzVi9iqoJv40E6kl\nWAe16VFHIzl/6Q+7Uw1IWGoL5hyoFfzNMj8zGNO2EKzaxAE8KBi3JyQkqEG9RHfBpUdiXp\nRusBV7Ch92Tty9Sl2yMdQUWd0l+xjy2jTnUYDv6EifwgHbpCskC+VQr9qtO9ZFZ1Z/HX3c\nnHi1YTiMNyXkJL+R22M3OW71EdErzYZAuTVVi1f3iv/8DOts3NbucYq1qWO/EQvDkuMpnQ\nQl/51l73ZANK4LbK0LxO6Rb7uGVKurNJRpBlU5+5xpVgtqX1Pr7DRGqrLhxiS2EIbqKOYU\nlkw76I3XhXPIe+yYpyW4bgvOJk9sYOVLXFyz42Hl0ixF9eJhHxQzEFL3y/ux0impQ2Xg+a\nq90JrMU2NEtZgySR1KDxylz4tApLh1tvcoiHMsf3AAAFoCMTqtUjE6rVAAAAB3NzaC1yc2\nEAAAGBAN/GB6tU7TnpPIpK4wvmzwGtQ0ufjBXm6KT8r3rtUc3b81F/6T5sv6FXIySiHMcN\nsC3yIw9oAueCn0KhoPhzKH+MR0hNDRDLqpt3taaR+ybRs1YvYqqCb+NBOpJVgHtelRRyM5\nf+kPu1MNSFhqC+YcqBX8zTI/MxjTthCs2sQBPCgYtyckJKhBvUR3waVHYl6UbrAVewofdk\n7cvUpdsjHUFFndJfsY8to051GA7+hIn8IB26QrJAvlUK/arTvWRWdWfx193Jx4tWE4jDcl\n5CS/kdtjNzlu9RHRK82GQLk1VYtX94r//AzrbNzW7nGKtaljvxELw5LjKZ0EJf+dZe92QD\nSuC2ytC8TukW+7hlSrqzSUaQZVOfucaVYLal9T6+w0Rqqy4cYkthCG6ijmFJZMO+iN14Vz\nyHvsmKcluG4LziZPbGDlS1xcs+Nh5dIsRfXiYR8UMxBS98v7sdIpqUNl4PmqvdCazFNjRL\nWYMkkdSg8cpc+LQKS4dbb3KIhzLH9wAAAAMBAAEAAAGBAKPk5rkV+qnvqeef8atF4VfZDv\nDUakWgWcR9Tgk6yC9+aTfH941BGRmSOKscEPe5jtAYCJXAGGB3yy2CM+PEdGT22T6bMHac\ntNgpVWIqiUhlTnRRQHKiFlDb9Yo4FWJGY+oVurQYPxgcHSeKpJAW4IjxOLlL64izQj27Va\n5N+qB+VWNM72KeMSQw1iqPHk1qdvD6LoGLXRVVVtVzagaWMVcdJfpvHB1Bz9om6PgScgCe\nKOedBDyKLt0ar6/uZUiYCQbsXcdv51ZGzj6U0lZNBHpIZLSTkpQhJv2Vq5HWU8F/m5zwzK\nD+LekztmHoxLOLiQ+dyXdc3cMmv2N2z6wKGFniRFsUCC5stVBedK7JDsVrbGrpIqaAjUEy\nF11syOapxsBOwcfiURpiwDlg52dzZiq9PgL0XXg77hOifbs+tzRfZtnmQC4wP4aLLG8qxO\n4wF1NFN3laN82+JVTDh9y4jcQrsyzSfngKuBhaTFXO1gM/Q1lrUO7YK5UNZd7k9BlEAQAA\nAMEAtM5/eqnEhR2qcWAVhedZTkoFfD94PbvHfFWWKS/ZaKADyqRtwTZS/U5QGFLQNQzef4\n97l45e5wN6nTHPF/mia4pF9npAO/l3IymcCURMSpxttveF9TmHO/fTaIRFhJ2es2PpQMkD\nSapIH4xpX0ut1q6JgAs/kHErgqNszP5VjOdHFTH+cegxn5qqkoK5Dq+PYvkEi7HLsKcba9\nRQlStErlEwkmo2IbiqqlgcAylDkrfD4dlgwA4+3ey8iIDHUUfwAAAAwQD0Kv14MmDjLqcI\nEErFm9gTeyBg2RzKnRe6CHCeMAgeeR4iAmSCZ34jR5K2hvKP1PHsMdTfw5hmws7bwhT9uR\nKEojrVEFyyQrwks2eu8gzMbaOHNX+7C9NgyAQI+jlb3puJzFYxssscoT3JM7WQr0UWEhjN\nTLRmd/n6n9OUZ6MSQN/IaKGuNnxUS+1kwliaOMNbrgZLHYQ/rw44O1WHnECigJNq6nH10v\nffx8izBe+j3SHqvAJPKBOyJLvMZTHzpSMAAADBAOqeCeg/xSxYYY0kYxmByYhh6HEF9X6K\nEBrw8XX5uNNxL3KO/ZIc0btH8DG5X0ztxECFaitxt8JCK6v1r2mTx6rXr3ZbfXdH463Baw\nGcjmiAF0rYb2lJNpoHmVpdBdoSbikYhKbi+NJQCJ5t/Ur/bVd3/xSuMZ3yjRaCFGEVEro2\nMkXY2RXa3KDflIf80Nuz4yKktsCvknkStjBnHBdnWWthVfiOAn7rKPr8ixhWYOY9ogDUno\ngpwdTo56MCH1NRHQAAACljZXBoLWJjZDUxMDhlLTI4NTUtMTFlYi1hMmIyLTAwMWE0YWFi\nODMwYw==\n-----END OPENSSH PRIVATE KEY-----\n"}]': finished 2020-11-16T21:51:33.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10218]: audit 2020-11-16T21:51:33.082266+0000 mon.a (mon.0) 72 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfxgerVO056TyKSuML5s8BrUNLn4wV5uik/K967VHN2/NRf+k+bL+hVyMkohzHDbAt8iMPaALngp9CoaD4cyh/jEdITQ0Qy6qbd7Wmkfsm0bNWL2Kqgm/jQTqSVYB7XpUUcjOX/pD7tTDUhYagvmHKgV/M0yPzMY07YQrNrEATwoGLcnJCSoQb1Ed8GlR2JelG6wFXsKH3ZO3L1KXbIx1BRZ3SX7GPLaNOdRgO/oSJ/CAdukKyQL5VCv2q071kVnVn8dfdyceLVhOIw3JeQkv5HbYzc5bvUR0SvNhkC5NVWLV/eK//wM62zc1u5xirWpY78RC8OS4ymdBCX/nWXvdkA0rgtsrQvE7pFvu4ZUq6s0lGkGVTn7nGlWC2pfU+vsNEaqsuHGJLYQhuoo5hSWTDvojdeFc8h77JinJbhuC84mT2xg5UtcXLPjYeXSLEX14mEfFDMQUvfL+7HSKalDZeD5qr3QmsxTY0S1mDJJHUoPHKXPi0CkuHW29yiIcyx/c= ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c\n"}]: dispatch 2020-11-16T21:51:33.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10218]: audit 2020-11-16T21:51:33.085643+0000 mon.a (mon.0) 73 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfxgerVO056TyKSuML5s8BrUNLn4wV5uik/K967VHN2/NRf+k+bL+hVyMkohzHDbAt8iMPaALngp9CoaD4cyh/jEdITQ0Qy6qbd7Wmkfsm0bNWL2Kqgm/jQTqSVYB7XpUUcjOX/pD7tTDUhYagvmHKgV/M0yPzMY07YQrNrEATwoGLcnJCSoQb1Ed8GlR2JelG6wFXsKH3ZO3L1KXbIx1BRZ3SX7GPLaNOdRgO/oSJ/CAdukKyQL5VCv2q071kVnVn8dfdyceLVhOIw3JeQkv5HbYzc5bvUR0SvNhkC5NVWLV/eK//wM62zc1u5xirWpY78RC8OS4ymdBCX/nWXvdkA0rgtsrQvE7pFvu4ZUq6s0lGkGVTn7nGlWC2pfU+vsNEaqsuHGJLYQhuoo5hSWTDvojdeFc8h77JinJbhuC84mT2xg5UtcXLPjYeXSLEX14mEfFDMQUvfL+7HSKalDZeD5qr3QmsxTY0S1mDJJHUoPHKXPi0CkuHW29yiIcyx/c= ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c\n"}]': finished 2020-11-16T21:51:33.348 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10493]: Generating public/private rsa key pair. 2020-11-16T21:51:33.348 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10493]: Your identification has been saved in /tmp/tmphgyh_w9k/key. 2020-11-16T21:51:33.348 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10493]: Your public key has been saved in /tmp/tmphgyh_w9k/key.pub. 2020-11-16T21:51:33.348 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10493]: The key fingerprint is: 2020-11-16T21:51:33.349 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10493]: SHA256:W9E3i01Dsjc/wF5HOZLL20JqDa7eL8+/f4tHqGQtP0g ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:51:33.349 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10493]: The key's randomart image is: 2020-11-16T21:51:33.349 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10493]: +---[RSA 3072]----+ 2020-11-16T21:51:33.349 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10493]: | . o o| 2020-11-16T21:51:33.349 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10493]: | ..* + | 2020-11-16T21:51:33.349 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10493]: | . +oX.o| 2020-11-16T21:51:33.349 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10493]: | o.Xo*.| 2020-11-16T21:51:33.349 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10493]: | S o B.*..| 2020-11-16T21:51:33.350 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10493]: | o E * o.| 2020-11-16T21:51:33.350 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10493]: | . * = o | 2020-11-16T21:51:33.350 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10493]: | ..+.o...| 2020-11-16T21:51:33.350 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10493]: | .. .+=++*| 2020-11-16T21:51:33.350 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:33 smithi195 bash[10493]: +----[SHA256]-----+ 2020-11-16T21:51:33.713 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b cephadm get-pub-key 2020-11-16T21:51:34.434 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:34 smithi195 bash[10218]: audit 2020-11-16T21:51:32.863094+0000 mgr.y (mgr.14116) 4 : audit [DBG] from='client.14128 v1:172.21.15.195:0/117578840' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:51:34.434 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:34 smithi195 bash[10218]: cephadm 2020-11-16T21:51:32.863514+0000 mgr.y (mgr.14116) 5 : cephadm [INF] Generating ssh key... 2020-11-16T21:51:35.078 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfxgerVO056TyKSuML5s8BrUNLn4wV5uik/K967VHN2/NRf+k+bL+hVyMkohzHDbAt8iMPaALngp9CoaD4cyh/jEdITQ0Qy6qbd7Wmkfsm0bNWL2Kqgm/jQTqSVYB7XpUUcjOX/pD7tTDUhYagvmHKgV/M0yPzMY07YQrNrEATwoGLcnJCSoQb1Ed8GlR2JelG6wFXsKH3ZO3L1KXbIx1BRZ3SX7GPLaNOdRgO/oSJ/CAdukKyQL5VCv2q071kVnVn8dfdyceLVhOIw3JeQkv5HbYzc5bvUR0SvNhkC5NVWLV/eK//wM62zc1u5xirWpY78RC8OS4ymdBCX/nWXvdkA0rgtsrQvE7pFvu4ZUq6s0lGkGVTn7nGlWC2pfU+vsNEaqsuHGJLYQhuoo5hSWTDvojdeFc8h77JinJbhuC84mT2xg5UtcXLPjYeXSLEX14mEfFDMQUvfL+7HSKalDZeD5qr3QmsxTY0S1mDJJHUoPHKXPi0CkuHW29yiIcyx/c= ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:51:35.621 INFO:teuthology.orchestra.run.smithi195.stderr:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2020-11-16T21:51:35.621 INFO:teuthology.orchestra.run.smithi195.stderr:Adding key to root@localhost's authorized_keys... 2020-11-16T21:51:35.622 INFO:teuthology.orchestra.run.smithi195.stderr:Adding host smithi195... 2020-11-16T21:51:35.622 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b orch host add smithi195 2020-11-16T21:51:36.346 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:35 smithi195 bash[10218]: audit 2020-11-16T21:51:35.092428+0000 mgr.y (mgr.14116) 6 : audit [DBG] from='client.14130 v1:172.21.15.195:0/2056281298' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:51:37.596 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:37 smithi195 bash[10493]: Warning: Permanently added 'smithi195,172.21.15.195' (ECDSA) to the list of known hosts. 2020-11-16T21:51:37.949 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout Added host 'smithi195' 2020-11-16T21:51:38.346 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:37 smithi195 bash[10218]: audit 2020-11-16T21:51:37.211511+0000 mgr.y (mgr.14116) 7 : audit [DBG] from='client.14132 v1:172.21.15.195:0/186511678' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:51:38.637 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b config set mgr mgr/dashboard/ssl_server_port 8443 2020-11-16T21:51:39.346 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:38 smithi195 bash[10218]: audit 2020-11-16T21:51:37.958977+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"smithi195\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2020-11-16T21:51:39.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:38 smithi195 bash[10218]: audit 2020-11-16T21:51:37.961086+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"smithi195\", \"labels\": [], \"status\": \"\"}}"}]': finished 2020-11-16T21:51:39.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:38 smithi195 bash[10218]: cephadm 2020-11-16T21:51:37.961668+0000 mgr.y (mgr.14116) 8 : cephadm [INF] Added host smithi195 2020-11-16T21:51:39.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:38 smithi195 bash[10218]: audit 2020-11-16T21:51:38.304171+0000 mon.a (mon.0) 76 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:51:39.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:38 smithi195 bash[10218]: audit 2020-11-16T21:51:38.306373+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:51:39.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:38 smithi195 bash[10218]: audit 2020-11-16T21:51:38.307446+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:51:40.172 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:39 smithi195 bash[10218]: audit 2020-11-16T21:51:38.947448+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:51:38.945303\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:51:38.946847\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:51:38.946958\", \"networks\": {}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:51:40.173 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:39 smithi195 bash[10218]: audit 2020-11-16T21:51:38.950075+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:51:38.945303\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:51:38.946847\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:51:38.946958\", \"networks\": {}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:51:40.173 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:39 smithi195 bash[10218]: audit 2020-11-16T21:51:38.950900+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14116 v1:172.21.15.195:0/3577874034' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:51:41.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:40 smithi195 bash[10218]: audit 2020-11-16T21:51:40.488924+0000 mon.a (mon.0) 82 : audit [INF] from='client.? v1:172.21.15.195:0/2264839424' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "mgr/dashboard/ssl_server_port", "value": "8443"}]: dispatch 2020-11-16T21:51:41.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:40 smithi195 bash[10218]: audit 2020-11-16T21:51:40.493833+0000 mon.a (mon.0) 83 : audit [INF] from='client.? v1:172.21.15.195:0/2264839424' entity='client.admin' cmd='[{"prefix": "config set", "who": "mgr", "name": "mgr/dashboard/ssl_server_port", "value": "8443"}]': finished 2020-11-16T21:51:41.399 INFO:teuthology.orchestra.run.smithi195.stderr:Enabling the dashboard module... 2020-11-16T21:51:41.400 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b mgr module enable dashboard 2020-11-16T21:51:43.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:42 smithi195 bash[10218]: audit 2020-11-16T21:51:42.845365+0000 mon.a (mon.0) 84 : audit [INF] from='client.? v1:172.21.15.195:0/854731489' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2020-11-16T21:51:43.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:42 smithi195 bash[10218]: audit 2020-11-16T21:51:42.849374+0000 mon.a (mon.0) 85 : audit [INF] from='client.14136 v1:172.21.15.195:0/854731489' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2020-11-16T21:51:43.348 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:42 smithi195 bash[10493]: ignoring --setuser ceph since I am not root 2020-11-16T21:51:43.348 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:42 smithi195 bash[10493]: ignoring --setgroup ceph since I am not root 2020-11-16T21:51:43.490 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b mgr dump 2020-11-16T21:51:44.245 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:43 smithi195 bash[10218]: audit 2020-11-16T21:51:42.905713+0000 mon.a (mon.0) 86 : audit [INF] from='client.14136 v1:172.21.15.195:0/854731489' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2020-11-16T21:51:44.246 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:43 smithi195 bash[10218]: cluster 2020-11-16T21:51:42.905772+0000 mon.a (mon.0) 87 : cluster [DBG] mgrmap e9: y(active, since 15s) 2020-11-16T21:51:44.950 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:44.951 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "epoch": 9, 2020-11-16T21:51:44.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "active_gid": 14116, 2020-11-16T21:51:44.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "active_name": "y", 2020-11-16T21:51:44.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "active_addrs": { 2020-11-16T21:51:44.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "addrvec": [ 2020-11-16T21:51:44.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:44.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "v1", 2020-11-16T21:51:44.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "addr": "172.21.15.195:6800", 2020-11-16T21:51:44.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "nonce": 3473350336 2020-11-16T21:51:44.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:44.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ] 2020-11-16T21:51:44.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:44.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "active_addr": "172.21.15.195:6800/3473350336", 2020-11-16T21:51:44.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "active_change": "2020-11-16T21:51:27.691432+0000", 2020-11-16T21:51:44.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "active_mgr_features": 4540138297136906239, 2020-11-16T21:51:44.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "available": true, 2020-11-16T21:51:44.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "standbys": [], 2020-11-16T21:51:44.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "modules": [ 2020-11-16T21:51:44.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "cephadm", 2020-11-16T21:51:44.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "dashboard", 2020-11-16T21:51:44.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "iostat", 2020-11-16T21:51:44.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "restful" 2020-11-16T21:51:44.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:44.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "available_modules": [ 2020-11-16T21:51:44.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:45.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "alerts", 2020-11-16T21:51:45.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:45.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:45.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:45.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "interval": { 2020-11-16T21:51:45.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "interval", 2020-11-16T21:51:45.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:45.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "60", 2020-11-16T21:51:45.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2020-11-16T21:51:45.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:45.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:45.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:45.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:45.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:45.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:45.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:45.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:45.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:45.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:45.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:45.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:45.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:45.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:45.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:45.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:45.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:45.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:45.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:45.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:45.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:45.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:45.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:45.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:45.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:45.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:45.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:45.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:45.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:45.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:45.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:45.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:45.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "smtp_destination": { 2020-11-16T21:51:45.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "smtp_destination", 2020-11-16T21:51:45.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:45.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2020-11-16T21:51:45.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "smtp_from_name": { 2020-11-16T21:51:45.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "smtp_from_name", 2020-11-16T21:51:45.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "Ceph", 2020-11-16T21:51:45.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Email From: name", 2020-11-16T21:51:45.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "smtp_host": { 2020-11-16T21:51:45.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "smtp_host", 2020-11-16T21:51:45.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.309 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.309 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:45.309 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.309 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.309 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.309 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "SMTP server", 2020-11-16T21:51:45.309 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.309 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.310 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.310 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.310 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "smtp_password": { 2020-11-16T21:51:45.310 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "smtp_password", 2020-11-16T21:51:45.310 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.310 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.310 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.311 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:45.311 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.311 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.311 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.311 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2020-11-16T21:51:45.311 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.311 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.311 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.312 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.312 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "smtp_port": { 2020-11-16T21:51:45.312 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "smtp_port", 2020-11-16T21:51:45.312 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:45.312 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.312 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.312 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "465", 2020-11-16T21:51:45.313 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.313 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.313 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.313 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "SMTP port", 2020-11-16T21:51:45.313 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.313 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.313 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.314 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.314 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "smtp_sender": { 2020-11-16T21:51:45.314 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "smtp_sender", 2020-11-16T21:51:45.314 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.314 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.314 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.314 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:45.314 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.315 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.315 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.315 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2020-11-16T21:51:45.315 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.315 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.315 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.315 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.316 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "smtp_ssl": { 2020-11-16T21:51:45.316 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "smtp_ssl", 2020-11-16T21:51:45.316 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.316 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.316 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.316 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:45.316 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.316 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.317 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.317 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2020-11-16T21:51:45.317 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.317 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.317 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.317 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.317 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "smtp_user": { 2020-11-16T21:51:45.318 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "smtp_user", 2020-11-16T21:51:45.318 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.318 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.318 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.318 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:45.318 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.318 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.318 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.319 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2020-11-16T21:51:45.319 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.319 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.319 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.319 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:45.319 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:45.319 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.320 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:45.320 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "balancer", 2020-11-16T21:51:45.320 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:45.320 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:45.320 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:45.320 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "active": { 2020-11-16T21:51:45.320 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "active", 2020-11-16T21:51:45.320 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.321 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.321 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.321 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:45.321 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.321 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.321 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.321 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2020-11-16T21:51:45.322 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.322 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.322 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.322 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.322 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "begin_time": { 2020-11-16T21:51:45.322 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "begin_time", 2020-11-16T21:51:45.322 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.322 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.323 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.323 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "0000", 2020-11-16T21:51:45.323 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.323 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.323 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.323 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2020-11-16T21:51:45.323 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2020-11-16T21:51:45.324 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.324 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.324 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.324 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "begin_weekday": { 2020-11-16T21:51:45.324 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "begin_weekday", 2020-11-16T21:51:45.324 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "uint", 2020-11-16T21:51:45.324 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.324 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.325 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "0", 2020-11-16T21:51:45.325 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "0", 2020-11-16T21:51:45.325 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "7", 2020-11-16T21:51:45.325 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.325 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2020-11-16T21:51:45.325 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2020-11-16T21:51:45.325 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.326 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.326 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.326 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2020-11-16T21:51:45.326 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2020-11-16T21:51:45.326 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "uint", 2020-11-16T21:51:45.326 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.326 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.327 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "25", 2020-11-16T21:51:45.327 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "1", 2020-11-16T21:51:45.327 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "250", 2020-11-16T21:51:45.327 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.327 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2020-11-16T21:51:45.327 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.327 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.328 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.328 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.328 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "crush_compat_metrics": { 2020-11-16T21:51:45.328 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2020-11-16T21:51:45.328 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.328 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.328 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.328 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2020-11-16T21:51:45.329 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.329 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.329 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.329 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2020-11-16T21:51:45.329 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2020-11-16T21:51:45.329 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.329 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.330 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.330 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "crush_compat_step": { 2020-11-16T21:51:45.330 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "crush_compat_step", 2020-11-16T21:51:45.330 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "float", 2020-11-16T21:51:45.330 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.330 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.330 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "0.5", 2020-11-16T21:51:45.331 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "0.001", 2020-11-16T21:51:45.331 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "0.999", 2020-11-16T21:51:45.331 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.331 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2020-11-16T21:51:45.331 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2020-11-16T21:51:45.331 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.331 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.332 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.332 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "end_time": { 2020-11-16T21:51:45.332 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "end_time", 2020-11-16T21:51:45.332 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.332 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.332 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.332 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "2400", 2020-11-16T21:51:45.333 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.333 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.333 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.333 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2020-11-16T21:51:45.333 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2020-11-16T21:51:45.333 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.333 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.334 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.334 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "end_weekday": { 2020-11-16T21:51:45.334 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "end_weekday", 2020-11-16T21:51:45.334 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "uint", 2020-11-16T21:51:45.334 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.334 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.334 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "7", 2020-11-16T21:51:45.334 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "0", 2020-11-16T21:51:45.335 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "7", 2020-11-16T21:51:45.335 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.335 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2020-11-16T21:51:45.335 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2020-11-16T21:51:45.335 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.335 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.335 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.336 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:45.336 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:45.336 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.336 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.336 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.336 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:45.336 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.336 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.337 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:45.337 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:45.337 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:45.337 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:45.337 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:45.337 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:45.337 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:45.338 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:45.338 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:45.338 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.338 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.338 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.338 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.338 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:45.338 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:45.339 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.339 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.339 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.339 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:45.339 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.339 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.339 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.340 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:45.340 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.340 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.340 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.340 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.340 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:45.340 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:45.340 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.341 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.341 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.341 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:45.341 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.341 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.341 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:45.341 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:45.342 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:45.342 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:45.342 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:45.342 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:45.342 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:45.342 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:45.342 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:45.342 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.343 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.343 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.343 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.343 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:45.343 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:45.343 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.343 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.344 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.344 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:45.344 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.344 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.344 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.344 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:45.344 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.344 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.345 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.345 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.345 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min_score": { 2020-11-16T21:51:45.345 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "min_score", 2020-11-16T21:51:45.345 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "float", 2020-11-16T21:51:45.345 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.345 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.345 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "0", 2020-11-16T21:51:45.346 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.346 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.346 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.346 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2020-11-16T21:51:45.346 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.346 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.346 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.347 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.347 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "mode": { 2020-11-16T21:51:45.347 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "mode", 2020-11-16T21:51:45.347 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.347 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.347 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.347 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "upmap", 2020-11-16T21:51:45.348 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.348 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.348 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:45.348 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "crush-compat", 2020-11-16T21:51:45.348 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "none", 2020-11-16T21:51:45.348 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "upmap" 2020-11-16T21:51:45.348 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:45.348 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Balancer mode", 2020-11-16T21:51:45.349 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.349 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.349 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.349 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.349 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pool_ids": { 2020-11-16T21:51:45.349 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "pool_ids", 2020-11-16T21:51:45.349 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.349 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.350 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.350 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:45.350 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.350 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.554 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.554 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2020-11-16T21:51:45.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "sleep_interval": { 2020-11-16T21:51:45.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-11-16T21:51:45.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:45.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "60", 2020-11-16T21:51:45.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2020-11-16T21:51:45.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "upmap_max_deviation": { 2020-11-16T21:51:45.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2020-11-16T21:51:45.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:45.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "5", 2020-11-16T21:51:45.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "1", 2020-11-16T21:51:45.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2020-11-16T21:51:45.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2020-11-16T21:51:45.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2020-11-16T21:51:45.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2020-11-16T21:51:45.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "uint", 2020-11-16T21:51:45.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "10", 2020-11-16T21:51:45.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2020-11-16T21:51:45.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:45.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:45.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:45.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "cephadm", 2020-11-16T21:51:45.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:45.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:45.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:45.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "allow_ptrace": { 2020-11-16T21:51:45.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "allow_ptrace", 2020-11-16T21:51:45.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:45.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2020-11-16T21:51:45.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2020-11-16T21:51:45.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "config_dashboard": { 2020-11-16T21:51:45.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "config_dashboard", 2020-11-16T21:51:45.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:45.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "manage configs like API endpoints in Dashboard.", 2020-11-16T21:51:45.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "container_image_alertmanager": { 2020-11-16T21:51:45.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "container_image_alertmanager", 2020-11-16T21:51:45.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "docker.io/prom/alertmanager:v0.20.0", 2020-11-16T21:51:45.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Prometheus container image", 2020-11-16T21:51:45.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "container_image_base": { 2020-11-16T21:51:45.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "container_image_base", 2020-11-16T21:51:45.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "docker.io/ceph/ceph", 2020-11-16T21:51:45.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2020-11-16T21:51:45.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "container_image_grafana": { 2020-11-16T21:51:45.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "container_image_grafana", 2020-11-16T21:51:45.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "docker.io/ceph/ceph-grafana:6.6.2", 2020-11-16T21:51:45.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Prometheus container image", 2020-11-16T21:51:45.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "container_image_node_exporter": { 2020-11-16T21:51:45.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "container_image_node_exporter", 2020-11-16T21:51:45.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "docker.io/prom/node-exporter:v0.18.1", 2020-11-16T21:51:45.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Prometheus container image", 2020-11-16T21:51:45.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "container_image_prometheus": { 2020-11-16T21:51:45.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "container_image_prometheus", 2020-11-16T21:51:45.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "docker.io/prom/prometheus:v2.18.1", 2020-11-16T21:51:45.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Prometheus container image", 2020-11-16T21:51:45.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "container_init": { 2020-11-16T21:51:45.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "container_init", 2020-11-16T21:51:45.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:45.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Run podman/docker with `--init`", 2020-11-16T21:51:45.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2020-11-16T21:51:45.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2020-11-16T21:51:45.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:45.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "600", 2020-11-16T21:51:45.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2020-11-16T21:51:45.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "device_cache_timeout": { 2020-11-16T21:51:45.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2020-11-16T21:51:45.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:45.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.794 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "1800", 2020-11-16T21:51:45.794 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.794 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.795 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.795 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2020-11-16T21:51:45.795 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.795 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.795 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.795 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.795 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "host_check_interval": { 2020-11-16T21:51:45.795 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "host_check_interval", 2020-11-16T21:51:45.796 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:45.796 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.796 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.796 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "600", 2020-11-16T21:51:45.796 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.796 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.796 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.797 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2020-11-16T21:51:45.797 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.797 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.797 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.797 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.797 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:45.797 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:45.798 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.798 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.798 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.798 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:45.798 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.798 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.798 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:45.798 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:45.799 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:45.799 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:45.799 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:45.799 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:45.799 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:45.799 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:45.799 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:45.800 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.800 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.800 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.800 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.800 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:45.800 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:45.800 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.801 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.801 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.801 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:45.801 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.801 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.801 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.801 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2020-11-16T21:51:45.802 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.802 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.802 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.802 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.802 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:45.802 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:45.802 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.802 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.803 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.803 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:45.803 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.803 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.803 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:45.803 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:45.803 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:45.804 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:45.804 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:45.804 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:45.804 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:45.804 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:45.804 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:45.804 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.804 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.805 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.805 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.805 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:45.805 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:45.805 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.805 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.805 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.806 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:45.806 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.806 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.806 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.806 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:45.806 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.806 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.807 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.807 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.807 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "manage_etc_ceph_ceph_conf": { 2020-11-16T21:51:45.807 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "manage_etc_ceph_ceph_conf", 2020-11-16T21:51:45.807 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.807 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.807 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.808 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:45.808 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.808 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.808 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.808 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2020-11-16T21:51:45.808 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.808 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.808 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.809 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.809 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "migration_current": { 2020-11-16T21:51:45.809 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "migration_current", 2020-11-16T21:51:45.809 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:45.809 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.809 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.809 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:45.810 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.810 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.810 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.810 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "internal - do not modify", 2020-11-16T21:51:45.810 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.814 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.814 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.814 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.814 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "mode": { 2020-11-16T21:51:45.815 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "mode", 2020-11-16T21:51:45.815 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.815 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.815 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.815 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "root", 2020-11-16T21:51:45.815 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.815 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.816 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:45.816 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "cephadm-package", 2020-11-16T21:51:45.816 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "root" 2020-11-16T21:51:45.816 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:45.816 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2020-11-16T21:51:45.816 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.816 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.816 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.817 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.817 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "prometheus_alerts_path": { 2020-11-16T21:51:45.817 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "prometheus_alerts_path", 2020-11-16T21:51:45.817 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.817 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.817 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.817 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2020-11-16T21:51:45.818 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.818 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.818 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.818 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "location of alerts to include in prometheus deployments", 2020-11-16T21:51:45.818 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.818 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.819 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.819 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.819 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "registry_password": { 2020-11-16T21:51:45.819 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "registry_password", 2020-11-16T21:51:45.819 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.819 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.819 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.819 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:45.820 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.820 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.820 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.820 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Custom repository password", 2020-11-16T21:51:45.820 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.820 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.820 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.821 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.821 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "registry_url": { 2020-11-16T21:51:45.821 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "registry_url", 2020-11-16T21:51:45.821 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.821 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.821 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.821 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:45.821 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.822 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.822 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.822 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Custom repository url", 2020-11-16T21:51:45.822 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.822 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.822 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.822 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.823 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "registry_username": { 2020-11-16T21:51:45.823 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "registry_username", 2020-11-16T21:51:45.823 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.823 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.823 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.823 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:45.823 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.824 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.824 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.824 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Custom repository username", 2020-11-16T21:51:45.824 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.824 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.824 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.824 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.825 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ssh_config_file": { 2020-11-16T21:51:45.825 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ssh_config_file", 2020-11-16T21:51:45.825 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.825 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.825 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.825 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:45.825 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.825 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.826 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.826 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2020-11-16T21:51:45.826 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.826 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.826 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.826 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.826 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "use_repo_digest": { 2020-11-16T21:51:45.827 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "use_repo_digest", 2020-11-16T21:51:45.827 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.827 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.827 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.827 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:45.827 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.827 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.828 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.828 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2020-11-16T21:51:45.828 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.828 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.828 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.828 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.828 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2020-11-16T21:51:45.829 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2020-11-16T21:51:45.829 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.829 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.829 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.829 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:45.829 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.829 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.829 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.830 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2020-11-16T21:51:45.830 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.830 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.830 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.830 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.830 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2020-11-16T21:51:45.830 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2020-11-16T21:51:45.831 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.831 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.831 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.831 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:45.831 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.831 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.831 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.832 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2020-11-16T21:51:45.832 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.832 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.832 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.832 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.832 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2020-11-16T21:51:45.832 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2020-11-16T21:51:45.832 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.833 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.833 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:45.833 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:45.833 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.833 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.833 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.833 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2020-11-16T21:51:45.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:45.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:45.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:45.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "crash", 2020-11-16T21:51:45.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:45.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:45.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:45.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:45.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:45.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.836 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.836 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:45.836 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.836 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.836 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:45.836 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:45.836 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:45.836 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:45.837 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:45.837 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:45.837 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:45.837 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:45.837 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:45.837 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.837 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.838 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.838 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.838 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:45.838 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:45.838 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.838 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.838 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.838 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:45.839 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.839 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.839 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.839 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:45.839 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.839 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.839 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.840 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.840 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:45.840 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:45.840 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.840 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.840 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.840 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:45.840 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.841 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.841 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:45.841 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:45.841 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:45.841 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:45.841 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:45.841 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:45.842 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:45.842 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:45.842 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:45.842 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.842 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.842 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.842 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.842 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:45.843 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:45.843 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:45.843 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.843 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.843 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:45.843 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.843 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.844 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.844 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:45.844 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.844 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.844 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.844 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.844 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "retain_interval": { 2020-11-16T21:51:45.844 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "retain_interval", 2020-11-16T21:51:45.845 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:45.845 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.845 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.845 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "31536000", 2020-11-16T21:51:45.845 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.845 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.845 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.846 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2020-11-16T21:51:45.846 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.846 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.846 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.846 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.846 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warn_recent_interval": { 2020-11-16T21:51:45.846 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2020-11-16T21:51:45.846 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:45.847 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.847 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:45.847 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "1209600", 2020-11-16T21:51:45.847 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:45.847 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:45.847 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:45.847 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2020-11-16T21:51:45.848 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:45.848 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:45.848 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:45.848 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:45.848 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:45.848 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:45.848 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:45.849 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "dashboard", 2020-11-16T21:51:45.849 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:45.849 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:45.849 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:45.849 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2020-11-16T21:51:45.849 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2020-11-16T21:51:45.849 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:45.849 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:45.850 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.054 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.054 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.054 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.055 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ALERTMANAGER_API_SSL_VERIFY": { 2020-11-16T21:51:46.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_SSL_VERIFY", 2020-11-16T21:51:46.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.056 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2020-11-16T21:51:46.057 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2020-11-16T21:51:46.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.058 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2020-11-16T21:51:46.059 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2020-11-16T21:51:46.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.060 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.061 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.061 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.061 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.061 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.061 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2020-11-16T21:51:46.061 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2020-11-16T21:51:46.061 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.062 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.062 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.062 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.062 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.062 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.062 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.062 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.062 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.063 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.063 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.063 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.063 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2020-11-16T21:51:46.063 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2020-11-16T21:51:46.063 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.063 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.064 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.064 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.064 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.064 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.064 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.064 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.064 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.064 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.065 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.065 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.065 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2020-11-16T21:51:46.065 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2020-11-16T21:51:46.065 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.065 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.065 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.066 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.066 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.066 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.066 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.066 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.066 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.066 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.067 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.067 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.067 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2020-11-16T21:51:46.067 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2020-11-16T21:51:46.067 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.067 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.067 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.067 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.068 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.068 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.068 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.068 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.068 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.068 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.068 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.069 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.069 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2020-11-16T21:51:46.069 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2020-11-16T21:51:46.069 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.069 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.069 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.069 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.069 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.070 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.070 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.070 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.070 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.070 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.070 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.070 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.071 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2020-11-16T21:51:46.071 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2020-11-16T21:51:46.071 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.071 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.071 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.071 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.071 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.072 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.072 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.072 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.072 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.072 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.072 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.072 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.072 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2020-11-16T21:51:46.073 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2020-11-16T21:51:46.073 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.073 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.073 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.073 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.073 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.073 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.074 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.074 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.074 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.074 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.074 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.074 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.074 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2020-11-16T21:51:46.074 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2020-11-16T21:51:46.075 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.075 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.075 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.075 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.075 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.075 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.075 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.076 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.076 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.076 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.076 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.076 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.076 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2020-11-16T21:51:46.077 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2020-11-16T21:51:46.077 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.077 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.077 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.077 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "admin", 2020-11-16T21:51:46.077 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.077 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.078 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.078 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.078 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.078 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.078 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.078 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.078 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2020-11-16T21:51:46.079 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2020-11-16T21:51:46.079 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.079 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.079 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.079 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.079 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.080 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.080 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.080 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.080 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.080 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.080 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.080 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.081 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2020-11-16T21:51:46.282 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2020-11-16T21:51:46.282 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.282 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.283 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2020-11-16T21:51:46.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2020-11-16T21:51:46.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.284 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "admin", 2020-11-16T21:51:46.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.285 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2020-11-16T21:51:46.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2020-11-16T21:51:46.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.286 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.287 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2020-11-16T21:51:46.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2020-11-16T21:51:46.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.288 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.289 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2020-11-16T21:51:46.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2020-11-16T21:51:46.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.290 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.291 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PROMETHEUS_API_SSL_VERIFY": { 2020-11-16T21:51:46.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_SSL_VERIFY", 2020-11-16T21:51:46.292 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.293 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.294 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2020-11-16T21:51:46.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2020-11-16T21:51:46.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.295 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.296 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2020-11-16T21:51:46.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2020-11-16T21:51:46.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.297 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.298 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2020-11-16T21:51:46.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2020-11-16T21:51:46.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.299 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.300 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2020-11-16T21:51:46.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2020-11-16T21:51:46.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.301 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2020-11-16T21:51:46.302 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2020-11-16T21:51:46.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.303 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2020-11-16T21:51:46.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2020-11-16T21:51:46.304 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.305 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2020-11-16T21:51:46.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2020-11-16T21:51:46.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.306 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.307 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2020-11-16T21:51:46.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2020-11-16T21:51:46.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.308 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.309 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.309 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.309 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.309 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.510 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.510 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.510 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2020-11-16T21:51:46.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2020-11-16T21:51:46.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2020-11-16T21:51:46.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2020-11-16T21:51:46.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2020-11-16T21:51:46.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:46.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "10", 2020-11-16T21:51:46.514 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.514 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.514 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.514 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.514 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.514 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.514 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.515 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.515 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2020-11-16T21:51:46.515 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2020-11-16T21:51:46.515 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:46.515 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.515 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.515 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "8", 2020-11-16T21:51:46.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.517 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.517 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2020-11-16T21:51:46.517 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2020-11-16T21:51:46.517 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:46.517 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.517 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.517 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "45", 2020-11-16T21:51:46.517 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.518 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.518 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.518 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.518 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.518 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.518 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.519 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.519 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2020-11-16T21:51:46.519 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2020-11-16T21:51:46.519 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.519 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.519 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.519 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.520 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.520 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.520 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.520 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.520 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.520 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.520 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.520 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.521 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2020-11-16T21:51:46.521 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2020-11-16T21:51:46.521 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.521 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.521 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.521 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "admin", 2020-11-16T21:51:46.521 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.522 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.522 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.522 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.522 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.522 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.522 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.522 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.523 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "RGW_API_HOST": { 2020-11-16T21:51:46.523 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2020-11-16T21:51:46.523 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.523 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.523 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.523 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.523 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.523 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.524 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.524 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.524 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.524 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.524 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.524 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.524 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "RGW_API_PORT": { 2020-11-16T21:51:46.524 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2020-11-16T21:51:46.525 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:46.525 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.525 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.525 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "80", 2020-11-16T21:51:46.525 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.525 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.525 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.526 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.526 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.526 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.526 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.526 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.526 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2020-11-16T21:51:46.526 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2020-11-16T21:51:46.527 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.527 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.527 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.527 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "http", 2020-11-16T21:51:46.527 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.527 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.527 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.527 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.528 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.528 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.528 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.528 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.528 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2020-11-16T21:51:46.528 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2020-11-16T21:51:46.528 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.529 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.529 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.529 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.529 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.529 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.529 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.529 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.529 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.530 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.530 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.530 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.530 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2020-11-16T21:51:46.530 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2020-11-16T21:51:46.530 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.530 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.531 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.531 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.531 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.531 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.531 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.531 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.531 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.531 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.532 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.532 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.532 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2020-11-16T21:51:46.532 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2020-11-16T21:51:46.532 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.532 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.532 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.533 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.533 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.533 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.533 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.533 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.533 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.533 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.533 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.534 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.534 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2020-11-16T21:51:46.534 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2020-11-16T21:51:46.534 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:46.534 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.534 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.534 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "0", 2020-11-16T21:51:46.535 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.535 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.535 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.535 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.535 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.535 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.535 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.536 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.536 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2020-11-16T21:51:46.536 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2020-11-16T21:51:46.536 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:46.536 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.536 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.536 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "10", 2020-11-16T21:51:46.536 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.537 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.537 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.537 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.537 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.537 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.537 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.537 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.538 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2020-11-16T21:51:46.538 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2020-11-16T21:51:46.538 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:46.538 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.538 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.538 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "5", 2020-11-16T21:51:46.538 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.538 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.539 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.539 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.539 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.539 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.539 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.539 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.539 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "crt_file": { 2020-11-16T21:51:46.540 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "crt_file", 2020-11-16T21:51:46.540 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.540 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.540 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.540 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.540 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.540 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.540 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.541 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.541 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.541 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.541 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.541 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.541 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug": { 2020-11-16T21:51:46.541 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "debug", 2020-11-16T21:51:46.542 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.542 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.542 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.542 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.542 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.542 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.542 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.543 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2020-11-16T21:51:46.543 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.543 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.543 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.543 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.543 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "jwt_token_ttl": { 2020-11-16T21:51:46.543 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2020-11-16T21:51:46.543 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:46.544 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.544 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.544 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "28800", 2020-11-16T21:51:46.544 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.544 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.544 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.544 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.544 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.545 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.545 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.545 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.545 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "key_file": { 2020-11-16T21:51:46.545 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "key_file", 2020-11-16T21:51:46.545 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.545 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.546 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.546 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.546 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.546 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.546 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.546 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.546 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.546 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.547 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.547 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.547 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:46.547 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:46.547 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.547 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.547 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.548 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.548 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.548 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.548 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.548 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.548 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.548 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.548 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.549 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.549 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.549 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.549 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.549 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.549 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.549 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.550 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.550 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:46.550 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:46.550 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.550 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.550 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.550 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.551 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.551 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.551 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.551 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.551 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.551 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.551 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.552 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.552 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:46.552 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:46.552 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.552 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.552 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.552 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:46.552 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.553 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.553 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.553 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.553 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.553 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.553 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.553 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.554 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.554 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.554 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.554 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.554 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.554 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.554 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:46.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:46.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "password": { 2020-11-16T21:51:46.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "password", 2020-11-16T21:51:46.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "server_addr": { 2020-11-16T21:51:46.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "server_addr", 2020-11-16T21:51:46.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "::", 2020-11-16T21:51:46.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "server_port": { 2020-11-16T21:51:46.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "server_port", 2020-11-16T21:51:46.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:46.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "8080", 2020-11-16T21:51:46.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ssl": { 2020-11-16T21:51:46.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ssl", 2020-11-16T21:51:46.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ssl_server_port": { 2020-11-16T21:51:46.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ssl_server_port", 2020-11-16T21:51:46.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:46.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "8443", 2020-11-16T21:51:46.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "standby_behaviour": { 2020-11-16T21:51:46.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "standby_behaviour", 2020-11-16T21:51:46.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "redirect", 2020-11-16T21:51:46.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "redirect" 2020-11-16T21:51:46.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "standby_error_status_code": { 2020-11-16T21:51:46.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2020-11-16T21:51:46.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:46.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "500", 2020-11-16T21:51:46.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "400", 2020-11-16T21:51:46.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "599", 2020-11-16T21:51:46.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "url_prefix": { 2020-11-16T21:51:46.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "url_prefix", 2020-11-16T21:51:46.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "username": { 2020-11-16T21:51:46.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "username", 2020-11-16T21:51:46.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:46.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "devicehealth", 2020-11-16T21:51:46.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:46.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:46.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:46.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enable_monitoring": { 2020-11-16T21:51:46.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "enable_monitoring", 2020-11-16T21:51:46.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2020-11-16T21:51:46.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:46.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:46.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:46.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:46.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:46.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:46.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:46.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:46.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:46.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "mark_out_threshold": { 2020-11-16T21:51:46.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2020-11-16T21:51:46.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:46.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "2419200", 2020-11-16T21:51:46.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2020-11-16T21:51:46.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pool_name": { 2020-11-16T21:51:46.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "pool_name", 2020-11-16T21:51:46.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2020-11-16T21:51:46.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2020-11-16T21:51:46.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "retention_period": { 2020-11-16T21:51:46.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "retention_period", 2020-11-16T21:51:46.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:46.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "15552000", 2020-11-16T21:51:46.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2020-11-16T21:51:46.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "scrape_frequency": { 2020-11-16T21:51:46.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "scrape_frequency", 2020-11-16T21:51:46.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:46.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "86400", 2020-11-16T21:51:46.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2020-11-16T21:51:46.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "self_heal": { 2020-11-16T21:51:46.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "self_heal", 2020-11-16T21:51:46.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:46.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2020-11-16T21:51:46.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "sleep_interval": { 2020-11-16T21:51:46.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-11-16T21:51:46.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:46.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "600", 2020-11-16T21:51:46.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2020-11-16T21:51:46.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warn_threshold": { 2020-11-16T21:51:46.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "warn_threshold", 2020-11-16T21:51:46.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:46.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "7257600", 2020-11-16T21:51:46.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2020-11-16T21:51:46.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.600 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.600 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.600 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:46.600 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "diskprediction_local", 2020-11-16T21:51:46.600 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:46.600 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:46.600 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:46.600 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:46.601 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:46.601 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.601 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.601 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.601 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.601 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.601 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.602 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.602 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.602 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.602 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.602 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.602 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.602 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.603 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.603 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.603 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.603 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.603 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.603 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.603 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:46.603 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:46.604 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.604 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.604 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.604 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.604 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.604 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.604 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.605 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.605 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.605 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.605 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.605 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.605 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:46.605 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:46.605 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.606 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.606 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.606 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:46.606 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.606 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.606 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.606 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.607 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.607 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.607 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.607 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.607 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.607 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.607 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.608 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.608 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.608 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.608 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.608 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:46.608 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:46.608 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.608 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.609 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.609 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.609 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.609 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.609 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.609 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.609 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.610 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.610 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.610 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.610 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "predict_interval": { 2020-11-16T21:51:46.610 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "predict_interval", 2020-11-16T21:51:46.610 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.610 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.611 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.611 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "86400", 2020-11-16T21:51:46.611 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.611 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.611 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.611 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.611 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.611 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.612 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.612 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.612 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "predictor_model": { 2020-11-16T21:51:46.612 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "predictor_model", 2020-11-16T21:51:46.612 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.612 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.612 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.613 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "prophetstor", 2020-11-16T21:51:46.613 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.613 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.613 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.613 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.613 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.613 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.613 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.614 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.614 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "sleep_interval": { 2020-11-16T21:51:46.614 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-11-16T21:51:46.614 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.614 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.614 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.614 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "600", 2020-11-16T21:51:46.615 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.615 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.615 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.615 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.615 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.615 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.615 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.616 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.616 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.616 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.616 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:46.616 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "influx", 2020-11-16T21:51:46.616 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": false, 2020-11-16T21:51:46.616 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2020-11-16T21:51:46.616 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:46.617 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "batch_size": { 2020-11-16T21:51:46.617 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "batch_size", 2020-11-16T21:51:46.617 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.617 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.617 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.617 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "5000", 2020-11-16T21:51:46.617 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.618 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.618 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.618 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.618 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.618 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.618 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.618 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.619 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "database": { 2020-11-16T21:51:46.619 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "database", 2020-11-16T21:51:46.619 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.619 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.619 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.619 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "ceph", 2020-11-16T21:51:46.619 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.619 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.620 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.620 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.620 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.620 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.620 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.620 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.620 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "hostname": { 2020-11-16T21:51:46.621 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "hostname", 2020-11-16T21:51:46.621 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.621 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.621 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.621 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:46.621 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.621 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.621 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.622 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.622 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.622 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.622 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.622 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.622 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "interval": { 2020-11-16T21:51:46.622 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "interval", 2020-11-16T21:51:46.623 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.623 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.623 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.623 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "30", 2020-11-16T21:51:46.623 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.623 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.623 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.623 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.624 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.624 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.624 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.624 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.624 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:46.624 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:46.624 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.624 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.625 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.625 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.625 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.625 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.625 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.625 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.625 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.626 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.626 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.626 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.626 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.626 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.626 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.626 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.627 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.627 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.627 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.627 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:46.627 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:46.627 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.627 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.627 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.628 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.628 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.628 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.628 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.628 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.628 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.628 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.629 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.629 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.629 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:46.629 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:46.629 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.629 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.629 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.629 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:46.630 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.630 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.630 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.630 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.630 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.630 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.630 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.631 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.631 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.631 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.631 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.631 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.631 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.631 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.631 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.632 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:46.632 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:46.632 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.632 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.834 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.835 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.836 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "password": { 2020-11-16T21:51:46.836 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "password", 2020-11-16T21:51:46.836 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.836 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.836 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.836 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:46.836 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.837 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.837 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.837 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.837 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.837 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.837 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.837 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.837 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "port": { 2020-11-16T21:51:46.838 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "port", 2020-11-16T21:51:46.838 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.838 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.838 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.838 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "8086", 2020-11-16T21:51:46.838 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.838 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.839 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.839 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.839 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.839 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.839 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.839 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.839 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ssl": { 2020-11-16T21:51:46.840 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ssl", 2020-11-16T21:51:46.840 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.840 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.840 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.840 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "false", 2020-11-16T21:51:46.840 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.840 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.841 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.841 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.841 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.841 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.841 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.841 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.841 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "threads": { 2020-11-16T21:51:46.841 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "threads", 2020-11-16T21:51:46.842 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.842 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.842 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.842 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "5", 2020-11-16T21:51:46.842 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.842 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.842 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.843 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.843 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.843 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.843 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.843 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.843 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "username": { 2020-11-16T21:51:46.843 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "username", 2020-11-16T21:51:46.843 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.844 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.844 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.844 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:46.844 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.844 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.844 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.844 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.845 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.845 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.845 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.845 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.845 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "verify_ssl": { 2020-11-16T21:51:46.845 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "verify_ssl", 2020-11-16T21:51:46.845 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.845 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.846 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.846 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "true", 2020-11-16T21:51:46.846 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.846 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.846 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.846 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.846 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.847 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.847 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.847 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.847 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.847 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.847 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:46.847 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "insights", 2020-11-16T21:51:46.847 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:46.848 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:46.848 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:46.848 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:46.848 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:46.848 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.848 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.848 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.849 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.849 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.849 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.849 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.849 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.849 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.849 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.850 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.850 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.850 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.850 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.850 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.850 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.850 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.850 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.851 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.851 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:46.851 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:46.851 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.851 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.851 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.851 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.852 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.852 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.852 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.852 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.852 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.852 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.852 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.852 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.853 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:46.853 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:46.853 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.853 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.853 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.853 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:46.853 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.854 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.854 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.854 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.854 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.854 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.854 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.854 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.855 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.855 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.855 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.855 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.855 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.855 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.855 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.856 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:46.856 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:46.856 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.856 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.856 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.856 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.856 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.856 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.857 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.857 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.857 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.857 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.857 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.857 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.857 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.858 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.858 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:46.858 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "iostat", 2020-11-16T21:51:46.858 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:46.858 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:46.858 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:46.858 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:46.858 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:46.859 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.859 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.859 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.859 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.859 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.859 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.859 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.860 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.860 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.860 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.860 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.860 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.860 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.860 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.860 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.861 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.861 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.861 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.861 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.861 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:46.861 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:46.861 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.862 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.862 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.862 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.862 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.862 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.862 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.862 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.862 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.863 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.863 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.863 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.863 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:46.863 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:46.863 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.863 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.864 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.864 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:46.864 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.864 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.864 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.864 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.864 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.864 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.865 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.865 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.865 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.865 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.865 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.865 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.865 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.865 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.866 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.866 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:46.866 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:46.866 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.866 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.866 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.866 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.867 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.867 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.867 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.867 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.867 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.867 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.867 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.868 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.868 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.868 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.868 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:46.868 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "k8sevents", 2020-11-16T21:51:46.868 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:46.868 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:46.868 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:46.869 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2020-11-16T21:51:46.869 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2020-11-16T21:51:46.869 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:46.869 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.869 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.869 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "7", 2020-11-16T21:51:46.869 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.870 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.870 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.870 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2020-11-16T21:51:46.870 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.870 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.870 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.870 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.870 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "config_check_secs": { 2020-11-16T21:51:46.871 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "config_check_secs", 2020-11-16T21:51:46.871 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:46.871 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.871 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.871 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "10", 2020-11-16T21:51:46.871 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "10", 2020-11-16T21:51:46.871 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.872 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.872 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2020-11-16T21:51:46.872 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.872 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.872 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.872 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.872 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:46.872 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:46.873 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.873 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.873 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.873 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.873 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.873 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.873 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.873 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.874 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.874 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.874 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.874 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.874 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.874 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.874 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.875 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.875 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.875 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.875 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.875 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:46.875 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:46.875 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.876 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.876 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.876 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.876 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.876 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.876 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.876 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.876 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.877 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.877 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.877 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.877 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:46.877 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:46.877 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.877 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.877 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.878 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:46.878 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.878 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.878 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.878 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.878 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.878 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.879 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.879 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.879 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.879 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.879 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.879 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.879 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.880 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.880 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.880 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:46.880 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:46.880 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.880 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.880 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.880 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.881 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.881 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.881 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.881 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.881 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.881 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.881 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.882 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.882 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.882 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.882 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:46.882 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "localpool", 2020-11-16T21:51:46.882 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:46.882 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:46.883 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:46.883 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "failure_domain": { 2020-11-16T21:51:46.883 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "failure_domain", 2020-11-16T21:51:46.883 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.883 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.883 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.883 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "host", 2020-11-16T21:51:46.883 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.884 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.884 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.884 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2020-11-16T21:51:46.884 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.884 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.884 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.884 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.885 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:46.885 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:46.885 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.885 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.885 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.885 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.885 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.885 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.886 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.886 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.886 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.886 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.886 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.886 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.886 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.887 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.887 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.887 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.887 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.887 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.887 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.887 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:46.887 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:46.888 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.888 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.888 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.888 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.888 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.888 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.888 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.889 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.889 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.889 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.889 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.889 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.889 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:46.889 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:46.889 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.890 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.890 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.890 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:46.890 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.890 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.890 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.890 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.891 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.891 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.891 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.891 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.891 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.891 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.891 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.892 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.892 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.892 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.892 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.892 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:46.892 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:46.892 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.892 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.893 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.893 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.893 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.893 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.893 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.893 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.893 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.894 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.894 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.894 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.894 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min_size": { 2020-11-16T21:51:46.894 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "min_size", 2020-11-16T21:51:46.894 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:46.894 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.895 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.895 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.895 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.895 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.895 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.895 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2020-11-16T21:51:46.895 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.895 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.896 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.896 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.896 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "num_rep": { 2020-11-16T21:51:46.896 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "num_rep", 2020-11-16T21:51:46.896 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:46.896 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.896 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.897 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "3", 2020-11-16T21:51:46.897 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.897 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.897 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.897 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2020-11-16T21:51:46.897 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.897 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.897 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.898 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.898 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pg_num": { 2020-11-16T21:51:46.898 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "pg_num", 2020-11-16T21:51:46.898 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:46.898 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.898 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.898 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "128", 2020-11-16T21:51:46.899 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.899 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.899 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.899 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2020-11-16T21:51:46.899 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.899 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.899 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.899 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.900 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "prefix": { 2020-11-16T21:51:46.900 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "prefix", 2020-11-16T21:51:46.900 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.900 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.900 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.900 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.900 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.901 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.901 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.901 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2020-11-16T21:51:46.901 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.901 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.901 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.901 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.901 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "subtree": { 2020-11-16T21:51:46.902 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "subtree", 2020-11-16T21:51:46.902 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.902 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.902 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.902 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "rack", 2020-11-16T21:51:46.902 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.902 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.903 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.903 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2020-11-16T21:51:46.903 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.903 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.903 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.903 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.903 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.903 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.904 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:46.904 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "mds_autoscaler", 2020-11-16T21:51:46.904 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:46.904 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:46.904 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:46.904 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:46.904 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:46.904 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.905 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.905 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.905 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.905 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.905 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.905 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.905 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.906 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.906 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.906 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.906 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.906 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.906 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.906 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.906 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.907 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.907 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.907 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.907 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:46.907 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:46.907 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.907 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.908 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.908 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.908 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.908 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.908 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.908 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.908 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.908 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.909 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.909 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.909 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:46.909 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:46.909 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.909 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.909 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.910 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:46.910 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.910 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.910 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.910 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.910 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.910 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.910 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.911 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.911 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.911 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.911 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.911 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.911 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.911 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.911 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.912 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:46.912 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:46.912 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.912 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.912 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.912 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.912 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.913 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.913 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.913 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.913 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.913 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.913 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.913 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.913 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.914 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.914 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:46.914 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "orchestrator", 2020-11-16T21:51:46.914 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:46.914 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:46.914 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:46.914 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:46.915 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:46.915 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.915 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.915 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.915 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.915 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.915 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.916 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.916 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.916 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.916 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.916 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.916 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.916 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.916 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.917 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.917 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.917 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.917 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.917 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.917 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:46.917 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:46.918 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.918 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.918 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.918 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.918 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.918 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.918 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.918 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.919 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.919 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.919 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.919 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.919 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:46.919 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:46.919 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.920 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.920 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.920 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:46.920 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.920 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.920 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.920 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.920 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.921 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.921 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.921 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.921 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.921 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.921 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.921 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.922 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.922 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.922 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.922 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:46.922 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:46.922 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.922 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.923 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.923 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.923 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.923 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.923 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.923 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.923 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.923 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.924 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.924 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.924 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "orchestrator": { 2020-11-16T21:51:46.924 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "orchestrator", 2020-11-16T21:51:46.924 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.924 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.924 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.925 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:46.925 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.925 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.925 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.925 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "cephadm", 2020-11-16T21:51:46.925 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rook", 2020-11-16T21:51:46.925 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "test_orchestrator" 2020-11-16T21:51:46.925 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.926 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2020-11-16T21:51:46.926 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.926 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.926 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.926 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.926 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.926 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.927 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:46.927 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "osd_support", 2020-11-16T21:51:46.927 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:46.927 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:46.927 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:46.927 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:46.927 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:46.927 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.928 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.928 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.928 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.928 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.928 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.928 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.928 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.928 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.929 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.929 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.929 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.929 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.929 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.929 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.929 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.930 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.930 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.930 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.930 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:46.930 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:46.930 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.930 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.930 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.931 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.931 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.931 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.931 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.931 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.931 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.931 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.932 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.932 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.932 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:46.932 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:46.932 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.932 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.932 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.932 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:46.933 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.933 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.933 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.933 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.933 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.933 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.933 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.934 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.934 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.934 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.934 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.934 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.934 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.934 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.935 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.935 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:46.935 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:46.935 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.935 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.935 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.935 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.935 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.936 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.936 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.936 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.936 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.936 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.936 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.936 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.936 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.937 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.937 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:46.937 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2020-11-16T21:51:46.937 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:46.937 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:46.937 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:46.937 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:46.938 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:46.938 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.938 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.938 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.938 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.938 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.938 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.938 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.939 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.939 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.939 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.939 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.939 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.939 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.939 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.940 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.940 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.940 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.940 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.940 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.940 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:46.940 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:46.940 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.941 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.941 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.941 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.941 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.941 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.941 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.941 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.941 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.942 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.942 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.942 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.942 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:46.942 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:46.942 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.942 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.943 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.943 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:46.943 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.943 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.943 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.943 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.943 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.943 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.944 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.944 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.944 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.944 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.944 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.944 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.944 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:46.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:46.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.946 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.946 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.946 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.946 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.946 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.946 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.946 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.947 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.947 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "sleep_interval": { 2020-11-16T21:51:46.947 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "sleep_interval", 2020-11-16T21:51:46.947 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.947 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.947 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:46.947 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "60", 2020-11-16T21:51:46.947 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.948 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.948 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.948 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.948 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.948 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.948 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.948 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.948 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.949 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.949 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:46.949 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "progress", 2020-11-16T21:51:46.949 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:46.949 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:46.949 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:46.949 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:46.950 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:46.950 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.950 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.950 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.950 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.950 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.950 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.950 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.951 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.951 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.951 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.951 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.951 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.951 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.951 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.952 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.952 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.952 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.952 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.952 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.952 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:46.952 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:46.952 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.953 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:46.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:46.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.954 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:46.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:46.955 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:46.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:46.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:46.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:46.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:46.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:46.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.956 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:46.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:46.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:46.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.957 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.958 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:46.958 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.958 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.958 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.958 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:46.958 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.958 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.958 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.959 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.959 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max_completed_events": { 2020-11-16T21:51:46.959 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "max_completed_events", 2020-11-16T21:51:46.959 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:46.959 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.959 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.959 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "50", 2020-11-16T21:51:46.960 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.960 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.960 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.960 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2020-11-16T21:51:46.960 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.960 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.960 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.960 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.961 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "persist_interval": { 2020-11-16T21:51:46.961 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "persist_interval", 2020-11-16T21:51:46.961 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:46.961 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.961 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.961 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "5", 2020-11-16T21:51:46.961 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.962 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.962 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:46.962 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2020-11-16T21:51:46.962 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:46.962 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:46.962 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:46.962 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.962 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:46.963 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:46.963 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:46.963 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "prometheus", 2020-11-16T21:51:46.963 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:46.963 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:46.963 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:46.963 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:46.964 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:46.964 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:46.964 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:46.964 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:46.964 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:46.964 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:46.964 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:46.964 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:46.965 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.166 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.166 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.166 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.166 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.167 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.167 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.167 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.167 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.167 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.167 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.167 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.168 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:47.168 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:47.168 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.168 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.168 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.168 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.168 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.169 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.169 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.169 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.169 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.169 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.169 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.169 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.169 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:47.170 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:47.170 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.170 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.170 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.170 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:47.170 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.170 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.171 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.171 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.171 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.171 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.171 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.171 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.171 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.171 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.172 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.172 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.172 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.172 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.172 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.172 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:47.172 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:47.173 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.173 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.173 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.173 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.173 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.173 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.173 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.173 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.174 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.174 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.174 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.174 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.174 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rbd_stats_pools": { 2020-11-16T21:51:47.174 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2020-11-16T21:51:47.174 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.175 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.175 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.175 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.175 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.175 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.175 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.175 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.176 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.176 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.176 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.176 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.176 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2020-11-16T21:51:47.176 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2020-11-16T21:51:47.176 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:47.176 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.177 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.177 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "300", 2020-11-16T21:51:47.177 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.177 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.177 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.177 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.177 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.177 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.178 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.178 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.178 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "scrape_interval": { 2020-11-16T21:51:47.178 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "scrape_interval", 2020-11-16T21:51:47.178 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.178 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.178 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.179 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.179 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.179 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.179 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.179 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.179 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.179 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.180 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.180 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.180 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "server_addr": { 2020-11-16T21:51:47.180 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "server_addr", 2020-11-16T21:51:47.180 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.180 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.180 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.180 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.181 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.181 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.181 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.181 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.181 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.181 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.181 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.181 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.182 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "server_port": { 2020-11-16T21:51:47.182 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "server_port", 2020-11-16T21:51:47.182 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.182 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.182 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.182 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.182 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.183 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.183 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.183 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.183 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.183 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.183 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.183 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.183 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "stale_cache_strategy": { 2020-11-16T21:51:47.184 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "stale_cache_strategy", 2020-11-16T21:51:47.184 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.184 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.184 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.184 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.184 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.184 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.185 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.185 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.185 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.185 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.185 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.185 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.185 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.185 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.186 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:47.186 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rbd_support", 2020-11-16T21:51:47.186 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:47.186 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:47.186 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:47.186 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:47.186 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:47.187 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.187 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.187 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.187 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.187 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.187 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.187 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.187 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.188 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.188 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.188 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.188 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.188 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.188 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.188 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.189 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.189 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.189 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.189 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.189 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:47.189 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:47.189 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.189 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.190 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.190 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.190 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.190 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.190 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.190 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.190 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.191 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.191 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.191 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.191 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:47.191 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:47.191 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.191 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.191 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.192 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:47.192 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.192 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.192 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.192 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.192 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.192 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.193 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.193 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.193 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.193 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.193 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.193 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.193 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.193 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.194 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.194 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:47.194 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:47.194 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.194 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.194 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.194 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.194 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.195 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.195 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.195 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.195 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.195 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.195 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.195 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.196 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max_concurrent_snap_create": { 2020-11-16T21:51:47.196 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "max_concurrent_snap_create", 2020-11-16T21:51:47.196 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:47.196 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.196 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.196 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "10", 2020-11-16T21:51:47.196 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.197 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.197 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.197 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.197 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.197 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.197 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.197 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.197 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2020-11-16T21:51:47.198 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2020-11-16T21:51:47.198 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.198 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.198 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.198 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.198 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.198 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.198 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.199 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.199 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.199 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.199 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.199 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.199 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "trash_purge_schedule": { 2020-11-16T21:51:47.199 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2020-11-16T21:51:47.200 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.200 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.200 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.200 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.200 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.200 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.200 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.200 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.201 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.201 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.201 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.201 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.201 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.201 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.201 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:47.201 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "restful", 2020-11-16T21:51:47.202 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:47.202 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:47.202 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:47.202 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enable_auth": { 2020-11-16T21:51:47.202 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "enable_auth", 2020-11-16T21:51:47.202 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.202 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.203 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.203 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:47.203 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.203 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.203 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.203 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.203 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.203 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.204 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.204 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.204 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "key_file": { 2020-11-16T21:51:47.204 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "key_file", 2020-11-16T21:51:47.204 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.204 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.204 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.205 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.205 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.205 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.205 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.205 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.205 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.205 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.205 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.206 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.206 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:47.206 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:47.206 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.206 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.206 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.206 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.206 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.207 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.207 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.207 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.207 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.207 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.207 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.207 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.208 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.208 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.208 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.208 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.208 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.208 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.208 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.208 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:47.209 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:47.209 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.209 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.209 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.209 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.209 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.209 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.209 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.210 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.210 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.210 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.210 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.210 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.210 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:47.210 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:47.211 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.211 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.211 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.211 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:47.211 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.211 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.211 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.211 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.212 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.212 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.212 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.212 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.212 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.212 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.212 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.213 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.213 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.213 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.213 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.213 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:47.213 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:47.213 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.213 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.214 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.214 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.214 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.214 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.214 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.214 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.214 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.215 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.215 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.215 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.215 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "server_addr": { 2020-11-16T21:51:47.215 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "server_addr", 2020-11-16T21:51:47.215 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.215 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.215 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.216 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.216 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.216 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.216 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.216 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.216 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.216 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.216 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.217 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.217 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "server_port": { 2020-11-16T21:51:47.217 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "server_port", 2020-11-16T21:51:47.217 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.217 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.217 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.217 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.218 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.218 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.218 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.218 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.218 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.218 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.218 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.218 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.219 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.219 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.219 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:47.219 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rook", 2020-11-16T21:51:47.219 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:47.219 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:47.219 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:47.220 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:47.220 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:47.220 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.220 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.220 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.220 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.220 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.220 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.221 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.221 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.221 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.221 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.221 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.221 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.221 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.221 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.222 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.222 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.222 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.426 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.426 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.426 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:47.427 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:47.427 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.427 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.427 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.427 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.427 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.427 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.428 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.428 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.428 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.428 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.428 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.428 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.428 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:47.429 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:47.429 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.429 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.429 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.429 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:47.429 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.429 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.429 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.430 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.430 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.430 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.430 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.430 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.430 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.430 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.431 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.431 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.431 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.431 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.431 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.431 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:47.431 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:47.432 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.432 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.432 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.432 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.432 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.432 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.432 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.433 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.433 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.433 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.433 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.433 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.433 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.433 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.433 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:47.434 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "selftest", 2020-11-16T21:51:47.434 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:47.434 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:47.434 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:47.434 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:47.434 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:47.434 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.435 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.435 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.435 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.435 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.435 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.435 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.435 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.436 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.436 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.436 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.436 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.436 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.436 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.436 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.436 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.437 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.437 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.437 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.437 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:47.437 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:47.437 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.437 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.438 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.438 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.438 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.438 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.438 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.438 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.438 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.439 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.439 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.439 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.439 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:47.439 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:47.439 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.439 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.440 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.440 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:47.440 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.440 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.440 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.440 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.440 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.440 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.441 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.441 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.441 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.441 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.441 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.441 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.441 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.442 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.442 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.442 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:47.442 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:47.442 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.442 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.442 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.443 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.443 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.443 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.443 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.443 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.443 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.443 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.443 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.444 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.444 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "roption1": { 2020-11-16T21:51:47.444 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "roption1", 2020-11-16T21:51:47.444 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.444 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.444 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.444 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.445 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.445 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.445 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.445 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.445 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.445 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.445 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.445 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.446 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "roption2": { 2020-11-16T21:51:47.446 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "roption2", 2020-11-16T21:51:47.446 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.446 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.446 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.446 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "xyz", 2020-11-16T21:51:47.446 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.447 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.447 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.447 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.447 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.447 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.447 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.447 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.447 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rwoption1": { 2020-11-16T21:51:47.448 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rwoption1", 2020-11-16T21:51:47.448 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.448 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.448 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.448 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.448 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.448 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.449 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.449 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.449 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.449 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.449 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.449 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.449 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rwoption2": { 2020-11-16T21:51:47.449 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rwoption2", 2020-11-16T21:51:47.450 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:47.450 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.450 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.450 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.450 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.450 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.451 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.451 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.451 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.451 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.451 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.451 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.451 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rwoption3": { 2020-11-16T21:51:47.451 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rwoption3", 2020-11-16T21:51:47.452 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "float", 2020-11-16T21:51:47.452 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.452 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.452 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.452 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.452 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.452 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.453 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.453 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.453 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.453 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.453 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.453 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rwoption4": { 2020-11-16T21:51:47.453 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rwoption4", 2020-11-16T21:51:47.454 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.454 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.454 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.454 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.454 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.454 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.454 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.454 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.455 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.455 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.455 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.455 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.455 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rwoption5": { 2020-11-16T21:51:47.455 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rwoption5", 2020-11-16T21:51:47.455 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.456 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.456 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.456 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.456 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.456 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.456 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.456 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.456 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.457 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.457 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.457 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.457 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rwoption6": { 2020-11-16T21:51:47.457 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "rwoption6", 2020-11-16T21:51:47.457 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.457 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.458 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.458 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:47.458 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.458 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.458 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.458 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.458 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.458 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.459 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.459 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.459 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "testkey": { 2020-11-16T21:51:47.459 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "testkey", 2020-11-16T21:51:47.459 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.459 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.459 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.460 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.460 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.460 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.460 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.460 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.460 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.460 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.460 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.461 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.461 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "testlkey": { 2020-11-16T21:51:47.461 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "testlkey", 2020-11-16T21:51:47.461 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.461 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.461 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.461 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.462 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.462 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.462 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.462 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.462 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.462 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.462 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.462 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.463 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "testnewline": { 2020-11-16T21:51:47.463 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "testnewline", 2020-11-16T21:51:47.463 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.463 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.463 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.463 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.463 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.464 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.464 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.464 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.464 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.464 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.464 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.464 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.464 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.465 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.465 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:47.465 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "snap_schedule", 2020-11-16T21:51:47.465 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:47.465 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:47.465 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:47.465 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:47.466 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:47.466 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.466 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.466 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.466 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.466 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.466 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.466 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.467 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.467 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.467 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.467 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.467 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.467 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.467 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.468 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.468 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.468 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.468 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.468 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.468 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:47.468 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:47.468 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.469 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.469 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.469 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.469 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.469 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.469 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.469 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.470 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.470 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.470 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.470 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.470 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:47.470 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:47.470 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.470 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.471 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.471 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:47.471 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.471 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.471 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.471 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.471 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.472 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.472 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.472 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.472 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.472 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.472 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.472 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.472 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.473 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.473 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.473 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:47.473 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:47.473 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.473 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.473 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.474 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.474 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.474 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.474 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.474 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.474 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.474 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.474 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.475 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.475 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.475 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.475 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:47.475 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "stats", 2020-11-16T21:51:47.475 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:47.475 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:47.476 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:47.476 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:47.476 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:47.476 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.476 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.476 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.476 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.476 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.477 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.477 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.477 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.477 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.477 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.477 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.477 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.478 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.478 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.478 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.478 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.478 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.478 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.478 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.478 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:47.479 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:47.479 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.479 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.479 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.479 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.479 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.479 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.480 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.480 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.480 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.480 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.480 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.480 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.480 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:47.480 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:47.481 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.481 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.481 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.481 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:47.481 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.481 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.481 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.482 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.482 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.482 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.482 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.482 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.482 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.482 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.482 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.483 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.483 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.483 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.483 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.483 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:47.483 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:47.483 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.484 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.484 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.484 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.484 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.484 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.484 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.484 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.485 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.485 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.485 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.485 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.485 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.485 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.486 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:47.486 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "status", 2020-11-16T21:51:47.486 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:47.486 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:47.486 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:47.486 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:47.486 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:47.486 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.487 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.487 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.487 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.487 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.487 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.487 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.487 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.488 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.488 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.488 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.488 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.488 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.488 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.488 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.488 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.489 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.489 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.489 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.489 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:47.489 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:47.489 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.489 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.490 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.490 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.490 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.490 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.490 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.490 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.490 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.491 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.491 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.491 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.491 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:47.491 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:47.491 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.491 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.491 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.492 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:47.492 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.492 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.492 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.492 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.492 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.492 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.493 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.493 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.493 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.493 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.493 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.493 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.493 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.493 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.494 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.494 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:47.494 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:47.494 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.494 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.494 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.495 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.495 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.495 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.495 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.495 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.495 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.495 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.495 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.496 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.496 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.496 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.496 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:47.496 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "telegraf", 2020-11-16T21:51:47.496 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:47.496 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:47.497 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:47.497 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "address": { 2020-11-16T21:51:47.497 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "address", 2020-11-16T21:51:47.497 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.497 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.497 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.497 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2020-11-16T21:51:47.497 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.498 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.498 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.498 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.498 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.498 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.499 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.499 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.499 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "interval": { 2020-11-16T21:51:47.499 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "interval", 2020-11-16T21:51:47.499 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:47.499 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.500 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.500 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "15", 2020-11-16T21:51:47.500 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.500 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.500 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.500 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.500 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.501 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.501 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.501 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.501 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:47.501 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:47.501 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.501 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.502 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.502 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.502 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.502 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.502 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.502 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.502 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.503 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.503 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.503 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.503 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.503 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.503 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.503 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.503 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.504 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.504 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.504 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:47.504 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:47.504 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.504 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.504 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.505 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.505 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.505 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.505 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.505 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.505 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.505 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.506 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.506 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.506 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:47.506 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:47.506 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.506 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.506 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.507 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:47.507 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.507 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.507 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.507 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.507 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.507 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.507 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.508 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.508 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.508 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.508 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.508 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.508 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.508 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.509 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.509 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:47.509 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:47.509 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.509 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.509 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.509 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.509 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.510 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.510 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.510 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.510 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.510 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.510 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.510 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:47.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "telemetry", 2020-11-16T21:51:47.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:47.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:47.511 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:47.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "channel_basic": { 2020-11-16T21:51:47.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "channel_basic", 2020-11-16T21:51:47.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:47.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.512 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2020-11-16T21:51:47.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.513 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "channel_crash": { 2020-11-16T21:51:47.514 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "channel_crash", 2020-11-16T21:51:47.514 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.514 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.514 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.514 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:47.514 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.514 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.515 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.515 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.515 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.515 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.515 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.515 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.515 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "channel_device": { 2020-11-16T21:51:47.515 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "channel_device", 2020-11-16T21:51:47.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "True", 2020-11-16T21:51:47.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.516 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.517 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.517 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.517 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.517 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.517 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "channel_ident": { 2020-11-16T21:51:47.517 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "channel_ident", 2020-11-16T21:51:47.517 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.518 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.518 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.518 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.518 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.518 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.518 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.518 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.519 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.519 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.519 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.519 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.519 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "contact": { 2020-11-16T21:51:47.519 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "contact", 2020-11-16T21:51:47.519 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.519 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.520 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.520 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:47.520 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.520 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.520 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.520 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.520 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.521 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.521 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.521 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.521 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "description": { 2020-11-16T21:51:47.521 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "description", 2020-11-16T21:51:47.521 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.521 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.521 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.522 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:47.522 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.522 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.522 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.522 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.522 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.522 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.523 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.523 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.523 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "device_url": { 2020-11-16T21:51:47.523 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "device_url", 2020-11-16T21:51:47.523 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.523 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.523 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.524 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2020-11-16T21:51:47.524 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.524 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.524 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.524 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.524 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.524 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.525 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.525 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.525 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enabled": { 2020-11-16T21:51:47.525 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "enabled", 2020-11-16T21:51:47.525 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.525 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.526 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.526 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.526 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.526 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.526 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.526 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.526 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.527 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.527 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.527 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.527 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "interval": { 2020-11-16T21:51:47.527 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "interval", 2020-11-16T21:51:47.527 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:47.527 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.528 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.528 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "24", 2020-11-16T21:51:47.528 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "8", 2020-11-16T21:51:47.528 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.528 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.528 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.528 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.529 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.529 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.529 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.529 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "last_opt_revision": { 2020-11-16T21:51:47.529 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "last_opt_revision", 2020-11-16T21:51:47.529 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:47.529 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.529 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.530 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "1", 2020-11-16T21:51:47.530 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.530 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.530 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.530 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.530 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.530 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.531 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.531 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.531 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "leaderboard": { 2020-11-16T21:51:47.531 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "leaderboard", 2020-11-16T21:51:47.531 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.531 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.531 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.531 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.532 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.532 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.532 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.532 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.532 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.532 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.532 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.533 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.533 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:47.533 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:47.533 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.533 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.533 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.533 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.533 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.534 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.534 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.534 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.534 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.534 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.534 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.534 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.535 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.535 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.535 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.535 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.535 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.535 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.535 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.535 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:47.536 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:47.536 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.536 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.536 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.536 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.536 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.536 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.537 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.537 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.537 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.537 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.537 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.537 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.537 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:47.537 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:47.538 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.538 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.538 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.538 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:47.538 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.538 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.538 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.539 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.539 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.539 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.539 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.539 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.539 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.539 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.539 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.540 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.540 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.540 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.540 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.540 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:47.540 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:47.540 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.541 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.541 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.541 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.541 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.541 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.541 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.541 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.541 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.542 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.542 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.542 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.542 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "organization": { 2020-11-16T21:51:47.542 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "organization", 2020-11-16T21:51:47.542 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.542 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.543 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.543 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:47.543 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.543 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.543 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.543 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.543 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.544 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.544 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.544 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.544 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "proxy": { 2020-11-16T21:51:47.544 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "proxy", 2020-11-16T21:51:47.544 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.544 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.544 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.545 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:47.545 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.545 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.545 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.545 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.545 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.545 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.545 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.546 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.546 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "url": { 2020-11-16T21:51:47.546 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "url", 2020-11-16T21:51:47.546 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.546 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.546 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.546 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2020-11-16T21:51:47.547 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.547 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.547 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.547 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.547 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.547 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.547 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.547 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.548 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.548 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.548 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:47.548 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "test_orchestrator", 2020-11-16T21:51:47.548 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:47.548 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:47.548 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:47.549 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:47.549 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:47.549 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.549 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.549 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.549 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.549 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.549 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.550 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.550 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.550 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.550 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.550 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.550 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.550 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.551 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.551 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.551 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.551 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.551 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.551 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.551 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:47.551 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:47.552 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.552 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.552 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.552 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.552 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.552 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.552 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.553 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.553 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.553 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.553 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.553 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.553 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:47.553 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:47.553 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.554 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.554 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.554 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:47.554 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.554 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.554 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.554 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.555 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:47.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:47.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.556 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.557 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:47.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "volumes", 2020-11-16T21:51:47.558 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:47.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:47.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:47.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:47.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:47.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.559 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.560 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.561 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:47.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:47.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.562 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.563 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:47.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:47.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:47.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.564 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.565 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:47.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:47.566 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.567 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max_concurrent_clones": { 2020-11-16T21:51:47.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "max_concurrent_clones", 2020-11-16T21:51:47.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:47.568 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "4", 2020-11-16T21:51:47.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "Number of asynchronous cloner threads", 2020-11-16T21:51:47.569 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:47.570 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "zabbix", 2020-11-16T21:51:47.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "can_run": true, 2020-11-16T21:51:47.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error_string": "", 2020-11-16T21:51:47.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "module_options": { 2020-11-16T21:51:47.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "discovery_interval": { 2020-11-16T21:51:47.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "discovery_interval", 2020-11-16T21:51:47.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.571 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "100", 2020-11-16T21:51:47.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.572 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "identifier": { 2020-11-16T21:51:47.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "identifier", 2020-11-16T21:51:47.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.573 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.574 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "interval": { 2020-11-16T21:51:47.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "interval", 2020-11-16T21:51:47.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "secs", 2020-11-16T21:51:47.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "60", 2020-11-16T21:51:47.575 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.576 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_level": { 2020-11-16T21:51:47.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_level", 2020-11-16T21:51:47.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "", 2020-11-16T21:51:47.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.577 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.578 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster": { 2020-11-16T21:51:47.579 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster", 2020-11-16T21:51:47.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.580 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_cluster_level": { 2020-11-16T21:51:47.581 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2020-11-16T21:51:47.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "info", 2020-11-16T21:51:47.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [ 2020-11-16T21:51:47.582 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "", 2020-11-16T21:51:47.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "critical", 2020-11-16T21:51:47.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "debug", 2020-11-16T21:51:47.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "error", 2020-11-16T21:51:47.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "info", 2020-11-16T21:51:47.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "warning" 2020-11-16T21:51:47.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.583 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "log_to_file": { 2020-11-16T21:51:47.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "log_to_file", 2020-11-16T21:51:47.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "bool", 2020-11-16T21:51:47.584 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 1, 2020-11-16T21:51:47.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "False", 2020-11-16T21:51:47.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.585 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "zabbix_host": { 2020-11-16T21:51:47.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "zabbix_host", 2020-11-16T21:51:47.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.586 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "None", 2020-11-16T21:51:47.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.587 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "zabbix_port": { 2020-11-16T21:51:47.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "zabbix_port", 2020-11-16T21:51:47.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "int", 2020-11-16T21:51:47.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.588 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "10051", 2020-11-16T21:51:47.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.589 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "zabbix_sender": { 2020-11-16T21:51:47.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "name": "zabbix_sender", 2020-11-16T21:51:47.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "str", 2020-11-16T21:51:47.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "level": "advanced", 2020-11-16T21:51:47.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "flags": 0, 2020-11-16T21:51:47.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2020-11-16T21:51:47.590 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "min": "", 2020-11-16T21:51:47.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "max": "", 2020-11-16T21:51:47.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "enum_allowed": [], 2020-11-16T21:51:47.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "desc": "", 2020-11-16T21:51:47.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "long_desc": "", 2020-11-16T21:51:47.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "tags": [], 2020-11-16T21:51:47.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "see_also": [] 2020-11-16T21:51:47.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.591 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "services": {}, 2020-11-16T21:51:47.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "always_on_modules": { 2020-11-16T21:51:47.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "nautilus": [ 2020-11-16T21:51:47.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "balancer", 2020-11-16T21:51:47.592 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "crash", 2020-11-16T21:51:47.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "devicehealth", 2020-11-16T21:51:47.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "orchestrator_cli", 2020-11-16T21:51:47.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "progress", 2020-11-16T21:51:47.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rbd_support", 2020-11-16T21:51:47.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "status", 2020-11-16T21:51:47.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "volumes" 2020-11-16T21:51:47.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.593 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "octopus": [ 2020-11-16T21:51:47.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "balancer", 2020-11-16T21:51:47.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "crash", 2020-11-16T21:51:47.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "devicehealth", 2020-11-16T21:51:47.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "orchestrator", 2020-11-16T21:51:47.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pg_autoscaler", 2020-11-16T21:51:47.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "progress", 2020-11-16T21:51:47.594 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rbd_support", 2020-11-16T21:51:47.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "status", 2020-11-16T21:51:47.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "telemetry", 2020-11-16T21:51:47.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "volumes" 2020-11-16T21:51:47.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pacific": [ 2020-11-16T21:51:47.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "balancer", 2020-11-16T21:51:47.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "crash", 2020-11-16T21:51:47.595 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "devicehealth", 2020-11-16T21:51:47.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "orchestrator", 2020-11-16T21:51:47.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "pg_autoscaler", 2020-11-16T21:51:47.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "progress", 2020-11-16T21:51:47.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "rbd_support", 2020-11-16T21:51:47.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "status", 2020-11-16T21:51:47.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "telemetry", 2020-11-16T21:51:47.596 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "volumes" 2020-11-16T21:51:47.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ], 2020-11-16T21:51:47.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "last_failure_osd_epoch": 2, 2020-11-16T21:51:47.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "active_clients": [ 2020-11-16T21:51:47.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:47.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "addrvec": [ 2020-11-16T21:51:47.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:47.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "v2", 2020-11-16T21:51:47.597 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "addr": "172.21.15.195:0", 2020-11-16T21:51:47.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "nonce": 2605686555 2020-11-16T21:51:47.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ] 2020-11-16T21:51:47.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout }, 2020-11-16T21:51:47.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:47.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "addrvec": [ 2020-11-16T21:51:47.598 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:47.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "type": "v2", 2020-11-16T21:51:47.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "addr": "172.21.15.195:0", 2020-11-16T21:51:47.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "nonce": 2944342344 2020-11-16T21:51:47.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ] 2020-11-16T21:51:47.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout ] 2020-11-16T21:51:47.599 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.600 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:47.601 INFO:teuthology.orchestra.run.smithi195.stderr:Waiting for the mgr to restart... 2020-11-16T21:51:47.601 INFO:teuthology.orchestra.run.smithi195.stderr:Waiting for mgr epoch 9... 2020-11-16T21:51:47.601 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b tell mgr mgr_status 2020-11-16T21:51:47.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:45 smithi195 bash[10218]: audit 2020-11-16T21:51:44.957792+0000 mon.a (mon.0) 88 : audit [DBG] from='client.? v1:172.21.15.195:0/2518088177' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2020-11-16T21:51:48.192 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10493]: Warning: Permanently added 'smithi195,172.21.15.195' (ECDSA) to the list of known hosts. 2020-11-16T21:51:48.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout { 2020-11-16T21:51:48.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "mgrmap_epoch": 11, 2020-11-16T21:51:48.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout "initialized": true 2020-11-16T21:51:48.945 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout } 2020-11-16T21:51:49.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: cluster 2020-11-16T21:51:47.874317+0000 mon.a (mon.0) 89 : cluster [INF] Active manager daemon y restarted 2020-11-16T21:51:49.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: cluster 2020-11-16T21:51:47.874960+0000 mon.a (mon.0) 90 : cluster [INF] Activating manager daemon y 2020-11-16T21:51:49.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: cluster 2020-11-16T21:51:47.878763+0000 mon.a (mon.0) 91 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2020-11-16T21:51:49.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: cluster 2020-11-16T21:51:47.930902+0000 mon.a (mon.0) 92 : cluster [DBG] mgrmap e10: y(active, starting, since 0.0561169s) 2020-11-16T21:51:49.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: audit 2020-11-16T21:51:47.937145+0000 mon.a (mon.0) 93 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2020-11-16T21:51:49.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: audit 2020-11-16T21:51:47.938474+0000 mon.a (mon.0) 94 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-11-16T21:51:49.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: audit 2020-11-16T21:51:47.938809+0000 mon.a (mon.0) 95 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-11-16T21:51:49.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: audit 2020-11-16T21:51:47.939119+0000 mon.a (mon.0) 96 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-11-16T21:51:49.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: audit 2020-11-16T21:51:47.939618+0000 mon.a (mon.0) 97 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-11-16T21:51:49.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: audit 2020-11-16T21:51:47.941029+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi195"}]: dispatch 2020-11-16T21:51:49.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: audit 2020-11-16T21:51:47.941452+0000 mon.a (mon.0) 99 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2020-11-16T21:51:49.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: audit 2020-11-16T21:51:47.941720+0000 mon.a (mon.0) 100 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2020-11-16T21:51:49.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: audit 2020-11-16T21:51:47.941976+0000 mon.a (mon.0) 101 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2020-11-16T21:51:49.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: audit 2020-11-16T21:51:47.942231+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2020-11-16T21:51:49.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: audit 2020-11-16T21:51:47.942492+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2020-11-16T21:51:49.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: audit 2020-11-16T21:51:47.942743+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2020-11-16T21:51:49.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: audit 2020-11-16T21:51:47.942999+0000 mon.a (mon.0) 105 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2020-11-16T21:51:49.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: audit 2020-11-16T21:51:47.943262+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2020-11-16T21:51:49.352 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: cluster 2020-11-16T21:51:47.945565+0000 mon.a (mon.0) 107 : cluster [INF] Manager daemon y is now available 2020-11-16T21:51:49.352 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: audit 2020-11-16T21:51:48.143044+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:51:49.352 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: audit 2020-11-16T21:51:48.146370+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2020-11-16T21:51:49.352 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:48 smithi195 bash[10218]: audit 2020-11-16T21:51:48.446747+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:51:49.800 INFO:teuthology.orchestra.run.smithi195.stderr:mgr epoch 9 is available 2020-11-16T21:51:49.801 INFO:teuthology.orchestra.run.smithi195.stderr:Generating a dashboard self-signed certificate... 2020-11-16T21:51:49.801 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b dashboard create-self-signed-cert 2020-11-16T21:51:50.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:49 smithi195 bash[10218]: cluster 2020-11-16T21:51:48.934142+0000 mon.a (mon.0) 111 : cluster [DBG] mgrmap e11: y(active, since 1.05936s) 2020-11-16T21:51:50.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:49 smithi195 bash[10218]: audit 2020-11-16T21:51:48.938588+0000 mgr.y (mgr.14138) 1 : audit [DBG] from='client.14142 v1:172.21.15.195:0/2176599455' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2020-11-16T21:51:50.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:49 smithi195 bash[10218]: audit 2020-11-16T21:51:48.957190+0000 mgr.y (mgr.14138) 2 : audit [DBG] from='client.14142 v1:172.21.15.195:0/2176599455' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2020-11-16T21:51:50.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:49 smithi195 bash[10218]: audit 2020-11-16T21:51:49.095848+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:51:49.094559\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:51:49.094788\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:51:49.095035\", \"networks\": {}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:51:50.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:49 smithi195 bash[10218]: audit 2020-11-16T21:51:49.099647+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:51:49.094559\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:51:49.094788\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:51:49.095035\", \"networks\": {}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:51:50.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:49 smithi195 bash[10218]: audit 2020-11-16T21:51:49.100892+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:51:51.598 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:51 smithi195 bash[10218]: cluster 2020-11-16T21:51:50.388279+0000 mon.a (mon.0) 115 : cluster [DBG] mgrmap e12: y(active, since 2s) 2020-11-16T21:51:51.703 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout Self-signed certificate created 2020-11-16T21:51:52.333 INFO:teuthology.orchestra.run.smithi195.stderr:Creating initial admin user... 2020-11-16T21:51:52.334 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b dashboard ac-user-create admin r60eh3xv96 administrator --force-password --pwd-update-required 2020-11-16T21:51:52.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:52 smithi195 bash[10218]: audit 2020-11-16T21:51:51.659736+0000 mgr.y (mgr.14138) 3 : audit [DBG] from='client.14148 v1:172.21.15.195:0/1583976479' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:51:52.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:52 smithi195 bash[10218]: audit 2020-11-16T21:51:51.709480+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIIC0DCCAbgCEQCe01EMfhVIdJs/BTq+j8vNMA0GCSqGSIb3DQEBDQUAMCYxCzAJ\nBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBoLWRhc2hib2FyZDAeFw0yMDExMTYyMTUx\nNTFaFw0zMDExMTQyMTUxNTFaMCYxCzAJBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBo\nLWRhc2hib2FyZDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAM2bkUZo\nSjxiBLeEO0lRKWYsOQnZB3l+qmNbBLSgtSlRoSR5bGmrQGmpHY5BMN+lMwC8oXaN\nTIr9Ta2s4WU0b92lorChd1zYrG4jhCB5NWf7k7dCh4MrLsVlBWBWqjwT5/OMbC/A\nxVrQHUVHlE3v7ow+kuv2fXYHGfclP3B6MqFwpbqVcEcx1qCyl5WCO4ZJ1jFFI12+\nRA5MylPlIFPSNDSiQOm0qIjdIqNvt6+o2zamB48qaM7x7graefB17MjiTwYsDrwO\ne8I6k8FDHp0/bdkfTlHWv59rJqpRAXo/XA4gwpA4cisWH3o/HWe2Kv/XOQuXTxF8\nmWfPBVNcnTY4JrsCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAD4nwXKNwU1DAOyUE\nJ3LsIpFLxUmbT5dIjXkF7WQn99sUAWsfm4pUnSxJt9Vebqp4wkHyqKN8bRPActQW\n77OfM2NnjRxHpKWvWjDjg55DYF4UnfToRpevZiJruJWw7m/RDOoPJuVs7TSrDKDL\nsQmO9EOQmMNRdP/LLwN39CTXmqYCGTgyuZ5Br24YNwuIuLCoGiP21fH3kDr4WJdC\nBK2KkJhFDBaQIp20xS7morJ3i9KYFVdspG+qf4T480fT7HFSAuge+XTRaU4Xj53W\nx5oyCEWRenX24Gywd905reMpagPj791KfBooeZDgIoZ+PqwGp2wDD68jEB3/Q7km\n2whHAg==\n-----END CERTIFICATE-----\n"}]: dispatch 2020-11-16T21:51:52.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:52 smithi195 bash[10218]: audit 2020-11-16T21:51:51.711630+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIIC0DCCAbgCEQCe01EMfhVIdJs/BTq+j8vNMA0GCSqGSIb3DQEBDQUAMCYxCzAJ\nBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBoLWRhc2hib2FyZDAeFw0yMDExMTYyMTUx\nNTFaFw0zMDExMTQyMTUxNTFaMCYxCzAJBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBo\nLWRhc2hib2FyZDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAM2bkUZo\nSjxiBLeEO0lRKWYsOQnZB3l+qmNbBLSgtSlRoSR5bGmrQGmpHY5BMN+lMwC8oXaN\nTIr9Ta2s4WU0b92lorChd1zYrG4jhCB5NWf7k7dCh4MrLsVlBWBWqjwT5/OMbC/A\nxVrQHUVHlE3v7ow+kuv2fXYHGfclP3B6MqFwpbqVcEcx1qCyl5WCO4ZJ1jFFI12+\nRA5MylPlIFPSNDSiQOm0qIjdIqNvt6+o2zamB48qaM7x7graefB17MjiTwYsDrwO\ne8I6k8FDHp0/bdkfTlHWv59rJqpRAXo/XA4gwpA4cisWH3o/HWe2Kv/XOQuXTxF8\nmWfPBVNcnTY4JrsCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAD4nwXKNwU1DAOyUE\nJ3LsIpFLxUmbT5dIjXkF7WQn99sUAWsfm4pUnSxJt9Vebqp4wkHyqKN8bRPActQW\n77OfM2NnjRxHpKWvWjDjg55DYF4UnfToRpevZiJruJWw7m/RDOoPJuVs7TSrDKDL\nsQmO9EOQmMNRdP/LLwN39CTXmqYCGTgyuZ5Br24YNwuIuLCoGiP21fH3kDr4WJdC\nBK2KkJhFDBaQIp20xS7morJ3i9KYFVdspG+qf4T480fT7HFSAuge+XTRaU4Xj53W\nx5oyCEWRenX24Gywd905reMpagPj791KfBooeZDgIoZ+PqwGp2wDD68jEB3/Q7km\n2whHAg==\n-----END CERTIFICATE-----\n"}]': finished 2020-11-16T21:51:52.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:52 smithi195 bash[10218]: audit 2020-11-16T21:51:51.712075+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDNm5FGaEo8YgS3\nhDtJUSlmLDkJ2Qd5fqpjWwS0oLUpUaEkeWxpq0BpqR2OQTDfpTMAvKF2jUyK/U2t\nrOFlNG/dpaKwoXdc2KxuI4QgeTVn+5O3QoeDKy7FZQVgVqo8E+fzjGwvwMVa0B1F\nR5RN7+6MPpLr9n12Bxn3JT9wejKhcKW6lXBHMdagspeVgjuGSdYxRSNdvkQOTMpT\n5SBT0jQ0okDptKiI3SKjb7evqNs2pgePKmjO8e4K2nnwdezI4k8GLA68DnvCOpPB\nQx6dP23ZH05R1r+fayaqUQF6P1wOIMKQOHIrFh96Px1ntir/1zkLl08RfJlnzwVT\nXJ02OCa7AgMBAAECggEAYdrTdnX2NuzTn+AAM3G8SVNsxiITq6A8SdMs1ybRcdvW\n3Lwpe9U0b9U8KtMeBqLiNkyQcBLpxhCuYqUwFPGy+AN3/aarX3YEAttGbAoj/9w9\nPnAcfLIVrX7Z4zL8DGHQ+Bnx93xAsWrxM2LQ05MIrpitZj5HEeBpXDXPDqIp7KkL\ntfVujdRE8xqBJ7DsGKW0EMn+yaNpCe0Mt6B22A742Ks9T9/Vf+bZWw35oW3rKpjB\nr8+hKoFBr/b1sfhvdgoDLXzN4cxYGliqkIsQE8+EDcAS3ihbGQjwt5oix7QoCjCn\nN6jRcaL0cOpaABEImMvi2AB+wZL0wK6EmnMqO2+44QKBgQD+mXUL3E8QpFguOnQU\nVKPyzaejfvlkyNrgoSr4Pfd9ScmDu9ntbRWgJKNngBSluvupJDFFnLLjt7em5wWf\ng9QBQ1Ws6iHQLlxuzPVsg2V3VfDNeio0vVvXEvJKLbmxn4IgqCW203mXTKxe+u3C\nWsjyq9RcgZXbPbGpK71I8u070QKBgQDOvR31aLQ/NRiX8JhglZNuk3TLNbWb3lmS\nh2xFlC1sF7MsZeCpboZCDx2xcPz5A6PEhc0H1NVRaHZF09WerQ6wDuNjUSnXbLH9\nHyId9OvIU6BaQ+3Uv08X6D1ZcpB8PuVFYYC2Hlgv/2yWgA/dsXhAxwidXiRDdyXk\nuDUgc8Q4ywKBgDeVgTxJqOlVN/s/v8AAipqj04maWxBp2X9ZMGxp+vJbfadJB9cS\nDbqcxR//koJsRC01PZyZDWUx4uKJZWzh9xMfhEDwDNnKhVubW6mJNknLdXsmxLgm\n7zoRZNxVB0mELYC7tSApI06o6qkB146rC1wPr5lSoUjwOy1X40dd4fVBAoGAYDXM\nkl+mul+YUWVLVG9njCcdTFBzctU4NCPHtF2wAcTJwlirA86GtolYVTJy1+Pku9lU\nwFdA6sDFgduCZ3S8CBz1n0uvQCy6bESn2O8ZJ0IbtsY0ETTytvqCSnUxXlDa273z\na02V1sh0nVl9iLtFbkfx72JXV/pD7Tv4pWCaqZ8CgYEAhnEY4REZc1a+9SEVQRx0\nt1inD2TpY/z7IipB44gkzbI6bMzCH3InwYcIHlUgdsF46Xdz/lRGFuX/iaBMNquS\nQo8qm/a6gej+voN0bunysJJwKv16qqmj6fYwQ2mfk8oTvBA/EoJ+pPjcmTpRljQO\nESP17ytcHa7dI1ztqgyiCtw=\n-----END PRIVATE KEY-----\n"}]: dispatch 2020-11-16T21:51:52.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:52 smithi195 bash[10218]: audit 2020-11-16T21:51:51.715389+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDNm5FGaEo8YgS3\nhDtJUSlmLDkJ2Qd5fqpjWwS0oLUpUaEkeWxpq0BpqR2OQTDfpTMAvKF2jUyK/U2t\nrOFlNG/dpaKwoXdc2KxuI4QgeTVn+5O3QoeDKy7FZQVgVqo8E+fzjGwvwMVa0B1F\nR5RN7+6MPpLr9n12Bxn3JT9wejKhcKW6lXBHMdagspeVgjuGSdYxRSNdvkQOTMpT\n5SBT0jQ0okDptKiI3SKjb7evqNs2pgePKmjO8e4K2nnwdezI4k8GLA68DnvCOpPB\nQx6dP23ZH05R1r+fayaqUQF6P1wOIMKQOHIrFh96Px1ntir/1zkLl08RfJlnzwVT\nXJ02OCa7AgMBAAECggEAYdrTdnX2NuzTn+AAM3G8SVNsxiITq6A8SdMs1ybRcdvW\n3Lwpe9U0b9U8KtMeBqLiNkyQcBLpxhCuYqUwFPGy+AN3/aarX3YEAttGbAoj/9w9\nPnAcfLIVrX7Z4zL8DGHQ+Bnx93xAsWrxM2LQ05MIrpitZj5HEeBpXDXPDqIp7KkL\ntfVujdRE8xqBJ7DsGKW0EMn+yaNpCe0Mt6B22A742Ks9T9/Vf+bZWw35oW3rKpjB\nr8+hKoFBr/b1sfhvdgoDLXzN4cxYGliqkIsQE8+EDcAS3ihbGQjwt5oix7QoCjCn\nN6jRcaL0cOpaABEImMvi2AB+wZL0wK6EmnMqO2+44QKBgQD+mXUL3E8QpFguOnQU\nVKPyzaejfvlkyNrgoSr4Pfd9ScmDu9ntbRWgJKNngBSluvupJDFFnLLjt7em5wWf\ng9QBQ1Ws6iHQLlxuzPVsg2V3VfDNeio0vVvXEvJKLbmxn4IgqCW203mXTKxe+u3C\nWsjyq9RcgZXbPbGpK71I8u070QKBgQDOvR31aLQ/NRiX8JhglZNuk3TLNbWb3lmS\nh2xFlC1sF7MsZeCpboZCDx2xcPz5A6PEhc0H1NVRaHZF09WerQ6wDuNjUSnXbLH9\nHyId9OvIU6BaQ+3Uv08X6D1ZcpB8PuVFYYC2Hlgv/2yWgA/dsXhAxwidXiRDdyXk\nuDUgc8Q4ywKBgDeVgTxJqOlVN/s/v8AAipqj04maWxBp2X9ZMGxp+vJbfadJB9cS\nDbqcxR//koJsRC01PZyZDWUx4uKJZWzh9xMfhEDwDNnKhVubW6mJNknLdXsmxLgm\n7zoRZNxVB0mELYC7tSApI06o6qkB146rC1wPr5lSoUjwOy1X40dd4fVBAoGAYDXM\nkl+mul+YUWVLVG9njCcdTFBzctU4NCPHtF2wAcTJwlirA86GtolYVTJy1+Pku9lU\nwFdA6sDFgduCZ3S8CBz1n0uvQCy6bESn2O8ZJ0IbtsY0ETTytvqCSnUxXlDa273z\na02V1sh0nVl9iLtFbkfx72JXV/pD7Tv4pWCaqZ8CgYEAhnEY4REZc1a+9SEVQRx0\nt1inD2TpY/z7IipB44gkzbI6bMzCH3InwYcIHlUgdsF46Xdz/lRGFuX/iaBMNquS\nQo8qm/a6gej+voN0bunysJJwKv16qqmj6fYwQ2mfk8oTvBA/EoJ+pPjcmTpRljQO\nESP17ytcHa7dI1ztqgyiCtw=\n-----END PRIVATE KEY-----\n"}]': finished 2020-11-16T21:51:55.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:54 smithi195 bash[10218]: cluster 2020-11-16T21:51:53.934228+0000 mon.a (mon.0) 120 : cluster [DBG] mgrmap e13: y(active, since 6s) 2020-11-16T21:51:57.084 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout {"username": "admin", "password": "$2b$12$i9kILCigrAB2vb9xL3fAsOTgD.U6heMQhwcVGbDsOChPVcqWJlKrG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1605563517, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2020-11-16T21:51:57.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:57 smithi195 bash[10218]: audit 2020-11-16T21:51:56.875688+0000 mgr.y (mgr.14138) 4 : audit [DBG] from='client.14150 v1:172.21.15.195:0/2614592767' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "password": "r60eh3xv96", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:51:57.722 INFO:teuthology.orchestra.run.smithi195.stderr:Fetching dashboard port number... 2020-11-16T21:51:57.723 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b -e NODE_NAME=smithi195 -v /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprims_38u:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpesymbnn_:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b config get mgr mgr/dashboard/ssl_server_port 2020-11-16T21:51:58.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:58 smithi195 bash[10218]: audit 2020-11-16T21:51:57.094918+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$i9kILCigrAB2vb9xL3fAsOTgD.U6heMQhwcVGbDsOChPVcqWJlKrG\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1605563517, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]: dispatch 2020-11-16T21:51:58.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:58 smithi195 bash[10218]: audit 2020-11-16T21:51:57.096508+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$i9kILCigrAB2vb9xL3fAsOTgD.U6heMQhwcVGbDsOChPVcqWJlKrG\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1605563517, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]': finished 2020-11-16T21:51:59.191 INFO:teuthology.orchestra.run.smithi195.stderr:/usr/bin/ceph:stdout 8443 2020-11-16T21:51:59.598 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:51:59 smithi195 bash[10218]: audit 2020-11-16T21:51:59.203076+0000 mon.a (mon.0) 123 : audit [DBG] from='client.? v1:172.21.15.195:0/677399356' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2020-11-16T21:51:59.789 INFO:teuthology.orchestra.run.smithi195.stderr:firewalld does not appear to be present 2020-11-16T21:51:59.789 INFO:teuthology.orchestra.run.smithi195.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2020-11-16T21:51:59.800 INFO:teuthology.orchestra.run.smithi195.stderr:Ceph Dashboard is now available at: 2020-11-16T21:51:59.800 INFO:teuthology.orchestra.run.smithi195.stderr: 2020-11-16T21:51:59.800 INFO:teuthology.orchestra.run.smithi195.stderr: URL: https://smithi195.front.sepia.ceph.com:8443/ 2020-11-16T21:51:59.801 INFO:teuthology.orchestra.run.smithi195.stderr: User: admin 2020-11-16T21:51:59.801 INFO:teuthology.orchestra.run.smithi195.stderr: Password: r60eh3xv96 2020-11-16T21:51:59.801 INFO:teuthology.orchestra.run.smithi195.stderr: 2020-11-16T21:51:59.801 INFO:teuthology.orchestra.run.smithi195.stderr:You can access the Ceph CLI with: 2020-11-16T21:51:59.801 INFO:teuthology.orchestra.run.smithi195.stderr: 2020-11-16T21:51:59.801 INFO:teuthology.orchestra.run.smithi195.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2020-11-16T21:51:59.801 INFO:teuthology.orchestra.run.smithi195.stderr: 2020-11-16T21:51:59.802 INFO:teuthology.orchestra.run.smithi195.stderr:Please consider enabling telemetry to help improve Ceph: 2020-11-16T21:51:59.802 INFO:teuthology.orchestra.run.smithi195.stderr: 2020-11-16T21:51:59.802 INFO:teuthology.orchestra.run.smithi195.stderr: ceph telemetry on 2020-11-16T21:51:59.802 INFO:teuthology.orchestra.run.smithi195.stderr: 2020-11-16T21:51:59.802 INFO:teuthology.orchestra.run.smithi195.stderr:For more information see: 2020-11-16T21:51:59.802 INFO:teuthology.orchestra.run.smithi195.stderr: 2020-11-16T21:51:59.802 INFO:teuthology.orchestra.run.smithi195.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2020-11-16T21:51:59.803 INFO:teuthology.orchestra.run.smithi195.stderr: 2020-11-16T21:51:59.803 INFO:teuthology.orchestra.run.smithi195.stderr:Bootstrap complete. 2020-11-16T21:51:59.803 INFO:teuthology.orchestra.run.smithi195.stderr:Releasing lock 139821507717160 on /run/cephadm/bcd5108e-2855-11eb-a2b2-001a4aab830c.lock 2020-11-16T21:51:59.803 INFO:teuthology.orchestra.run.smithi195.stderr:Lock 139821507717160 released on /run/cephadm/bcd5108e-2855-11eb-a2b2-001a4aab830c.lock 2020-11-16T21:51:59.823 INFO:tasks.cephadm:Fetching config... 2020-11-16T21:51:59.823 INFO:teuthology.orchestra.run.smithi195:> set -ex 2020-11-16T21:51:59.824 INFO:teuthology.orchestra.run.smithi195:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2020-11-16T21:51:59.829 INFO:teuthology.orchestra.run.smithi195.stderr:+ dd if=/etc/ceph/ceph.conf of=/dev/stdout 2020-11-16T21:51:59.830 INFO:teuthology.orchestra.run.smithi195.stdout:# minimal ceph.conf for bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:51:59.831 INFO:teuthology.orchestra.run.smithi195.stdout:[global] 2020-11-16T21:51:59.831 INFO:teuthology.orchestra.run.smithi195.stdout: fsid = bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:51:59.831 INFO:teuthology.orchestra.run.smithi195.stdout: mon_host = 172.21.15.195:6789/0 2020-11-16T21:51:59.831 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2020-11-16T21:51:59.831 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2020-11-16T21:51:59.831 INFO:teuthology.orchestra.run.smithi195.stderr:148 bytes copied, 0.000158546 s, 933 kB/s 2020-11-16T21:51:59.832 INFO:tasks.cephadm:Fetching client.admin keyring... 2020-11-16T21:51:59.832 INFO:teuthology.orchestra.run.smithi195:> set -ex 2020-11-16T21:51:59.832 INFO:teuthology.orchestra.run.smithi195:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2020-11-16T21:51:59.875 INFO:teuthology.orchestra.run.smithi195.stderr:+ dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2020-11-16T21:51:59.876 INFO:teuthology.orchestra.run.smithi195.stdout:[client.admin] 2020-11-16T21:51:59.877 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQA/9LJf3C35ORAAG+q0ODXnI2d4Vxy0W3H9Rg== 2020-11-16T21:51:59.877 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2020-11-16T21:51:59.877 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2020-11-16T21:51:59.877 INFO:teuthology.orchestra.run.smithi195.stderr:63 bytes copied, 0.000144035 s, 437 kB/s 2020-11-16T21:51:59.877 INFO:tasks.cephadm:Fetching mon keyring... 2020-11-16T21:51:59.878 INFO:teuthology.orchestra.run.smithi195:> set -ex 2020-11-16T21:51:59.878 INFO:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/keyring of=/dev/stdout 2020-11-16T21:51:59.921 INFO:teuthology.orchestra.run.smithi195.stderr:+ sudo dd if=/var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/keyring of=/dev/stdout 2020-11-16T21:51:59.926 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.] 2020-11-16T21:51:59.926 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQA+9LJfB582JRAA58iDrRp5W8mav4SURtGJ3A== 2020-11-16T21:51:59.926 INFO:teuthology.orchestra.run.smithi195.stdout: caps mon = "allow *" 2020-11-16T21:51:59.927 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2020-11-16T21:51:59.927 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2020-11-16T21:51:59.927 INFO:teuthology.orchestra.run.smithi195.stderr:77 bytes copied, 0.00017189 s, 448 kB/s 2020-11-16T21:51:59.927 INFO:tasks.cephadm:Fetching pub ssh key... 2020-11-16T21:51:59.928 INFO:teuthology.orchestra.run.smithi195:> set -ex 2020-11-16T21:51:59.928 INFO:teuthology.orchestra.run.smithi195:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2020-11-16T21:51:59.975 INFO:teuthology.orchestra.run.smithi195.stderr:+ dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2020-11-16T21:51:59.976 INFO:teuthology.orchestra.run.smithi195.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfxgerVO056TyKSuML5s8BrUNLn4wV5uik/K967VHN2/NRf+k+bL+hVyMkohzHDbAt8iMPaALngp9CoaD4cyh/jEdITQ0Qy6qbd7Wmkfsm0bNWL2Kqgm/jQTqSVYB7XpUUcjOX/pD7tTDUhYagvmHKgV/M0yPzMY07YQrNrEATwoGLcnJCSoQb1Ed8GlR2JelG6wFXsKH3ZO3L1KXbIx1BRZ3SX7GPLaNOdRgO/oSJ/CAdukKyQL5VCv2q071kVnVn8dfdyceLVhOIw3JeQkv5HbYzc5bvUR0SvNhkC5NVWLV/eK//wM62zc1u5xirWpY78RC8OS4ymdBCX/nWXvdkA0rgtsrQvE7pFvu4ZUq6s0lGkGVTn7nGlWC2pfU+vsNEaqsuHGJLYQhuoo5hSWTDvojdeFc8h77JinJbhuC84mT2xg5UtcXLPjYeXSLEX14mEfFDMQUvfL+7HSKalDZeD5qr3QmsxTY0S1mDJJHUoPHKXPi0CkuHW29yiIcyx/c= ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:51:59.977 INFO:teuthology.orchestra.run.smithi195.stderr:1+1 records in 2020-11-16T21:51:59.977 INFO:teuthology.orchestra.run.smithi195.stderr:1+1 records out 2020-11-16T21:51:59.977 INFO:teuthology.orchestra.run.smithi195.stderr:595 bytes copied, 0.00017262 s, 3.4 MB/s 2020-11-16T21:51:59.977 INFO:tasks.cephadm:Installing pub ssh key for root users... 2020-11-16T21:51:59.978 INFO:teuthology.orchestra.run.smithi016:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfxgerVO056TyKSuML5s8BrUNLn4wV5uik/K967VHN2/NRf+k+bL+hVyMkohzHDbAt8iMPaALngp9CoaD4cyh/jEdITQ0Qy6qbd7Wmkfsm0bNWL2Kqgm/jQTqSVYB7XpUUcjOX/pD7tTDUhYagvmHKgV/M0yPzMY07YQrNrEATwoGLcnJCSoQb1Ed8GlR2JelG6wFXsKH3ZO3L1KXbIx1BRZ3SX7GPLaNOdRgO/oSJ/CAdukKyQL5VCv2q071kVnVn8dfdyceLVhOIw3JeQkv5HbYzc5bvUR0SvNhkC5NVWLV/eK//wM62zc1u5xirWpY78RC8OS4ymdBCX/nWXvdkA0rgtsrQvE7pFvu4ZUq6s0lGkGVTn7nGlWC2pfU+vsNEaqsuHGJLYQhuoo5hSWTDvojdeFc8h77JinJbhuC84mT2xg5UtcXLPjYeXSLEX14mEfFDMQUvfL+7HSKalDZeD5qr3QmsxTY0S1mDJJHUoPHKXPi0CkuHW29yiIcyx/c= ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2020-11-16T21:52:00.001 INFO:teuthology.orchestra.run.smithi016.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfxgerVO056TyKSuML5s8BrUNLn4wV5uik/K967VHN2/NRf+k+bL+hVyMkohzHDbAt8iMPaALngp9CoaD4cyh/jEdITQ0Qy6qbd7Wmkfsm0bNWL2Kqgm/jQTqSVYB7XpUUcjOX/pD7tTDUhYagvmHKgV/M0yPzMY07YQrNrEATwoGLcnJCSoQb1Ed8GlR2JelG6wFXsKH3ZO3L1KXbIx1BRZ3SX7GPLaNOdRgO/oSJ/CAdukKyQL5VCv2q071kVnVn8dfdyceLVhOIw3JeQkv5HbYzc5bvUR0SvNhkC5NVWLV/eK//wM62zc1u5xirWpY78RC8OS4ymdBCX/nWXvdkA0rgtsrQvE7pFvu4ZUq6s0lGkGVTn7nGlWC2pfU+vsNEaqsuHGJLYQhuoo5hSWTDvojdeFc8h77JinJbhuC84mT2xg5UtcXLPjYeXSLEX14mEfFDMQUvfL+7HSKalDZeD5qr3QmsxTY0S1mDJJHUoPHKXPi0CkuHW29yiIcyx/c= ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:52:00.011 INFO:teuthology.orchestra.run.smithi057:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfxgerVO056TyKSuML5s8BrUNLn4wV5uik/K967VHN2/NRf+k+bL+hVyMkohzHDbAt8iMPaALngp9CoaD4cyh/jEdITQ0Qy6qbd7Wmkfsm0bNWL2Kqgm/jQTqSVYB7XpUUcjOX/pD7tTDUhYagvmHKgV/M0yPzMY07YQrNrEATwoGLcnJCSoQb1Ed8GlR2JelG6wFXsKH3ZO3L1KXbIx1BRZ3SX7GPLaNOdRgO/oSJ/CAdukKyQL5VCv2q071kVnVn8dfdyceLVhOIw3JeQkv5HbYzc5bvUR0SvNhkC5NVWLV/eK//wM62zc1u5xirWpY78RC8OS4ymdBCX/nWXvdkA0rgtsrQvE7pFvu4ZUq6s0lGkGVTn7nGlWC2pfU+vsNEaqsuHGJLYQhuoo5hSWTDvojdeFc8h77JinJbhuC84mT2xg5UtcXLPjYeXSLEX14mEfFDMQUvfL+7HSKalDZeD5qr3QmsxTY0S1mDJJHUoPHKXPi0CkuHW29yiIcyx/c= ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2020-11-16T21:52:00.031 INFO:teuthology.orchestra.run.smithi057.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfxgerVO056TyKSuML5s8BrUNLn4wV5uik/K967VHN2/NRf+k+bL+hVyMkohzHDbAt8iMPaALngp9CoaD4cyh/jEdITQ0Qy6qbd7Wmkfsm0bNWL2Kqgm/jQTqSVYB7XpUUcjOX/pD7tTDUhYagvmHKgV/M0yPzMY07YQrNrEATwoGLcnJCSoQb1Ed8GlR2JelG6wFXsKH3ZO3L1KXbIx1BRZ3SX7GPLaNOdRgO/oSJ/CAdukKyQL5VCv2q071kVnVn8dfdyceLVhOIw3JeQkv5HbYzc5bvUR0SvNhkC5NVWLV/eK//wM62zc1u5xirWpY78RC8OS4ymdBCX/nWXvdkA0rgtsrQvE7pFvu4ZUq6s0lGkGVTn7nGlWC2pfU+vsNEaqsuHGJLYQhuoo5hSWTDvojdeFc8h77JinJbhuC84mT2xg5UtcXLPjYeXSLEX14mEfFDMQUvfL+7HSKalDZeD5qr3QmsxTY0S1mDJJHUoPHKXPi0CkuHW29yiIcyx/c= ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:52:00.040 INFO:teuthology.orchestra.run.smithi195:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfxgerVO056TyKSuML5s8BrUNLn4wV5uik/K967VHN2/NRf+k+bL+hVyMkohzHDbAt8iMPaALngp9CoaD4cyh/jEdITQ0Qy6qbd7Wmkfsm0bNWL2Kqgm/jQTqSVYB7XpUUcjOX/pD7tTDUhYagvmHKgV/M0yPzMY07YQrNrEATwoGLcnJCSoQb1Ed8GlR2JelG6wFXsKH3ZO3L1KXbIx1BRZ3SX7GPLaNOdRgO/oSJ/CAdukKyQL5VCv2q071kVnVn8dfdyceLVhOIw3JeQkv5HbYzc5bvUR0SvNhkC5NVWLV/eK//wM62zc1u5xirWpY78RC8OS4ymdBCX/nWXvdkA0rgtsrQvE7pFvu4ZUq6s0lGkGVTn7nGlWC2pfU+vsNEaqsuHGJLYQhuoo5hSWTDvojdeFc8h77JinJbhuC84mT2xg5UtcXLPjYeXSLEX14mEfFDMQUvfL+7HSKalDZeD5qr3QmsxTY0S1mDJJHUoPHKXPi0CkuHW29yiIcyx/c= ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2020-11-16T21:52:00.062 INFO:teuthology.orchestra.run.smithi195.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfxgerVO056TyKSuML5s8BrUNLn4wV5uik/K967VHN2/NRf+k+bL+hVyMkohzHDbAt8iMPaALngp9CoaD4cyh/jEdITQ0Qy6qbd7Wmkfsm0bNWL2Kqgm/jQTqSVYB7XpUUcjOX/pD7tTDUhYagvmHKgV/M0yPzMY07YQrNrEATwoGLcnJCSoQb1Ed8GlR2JelG6wFXsKH3ZO3L1KXbIx1BRZ3SX7GPLaNOdRgO/oSJ/CAdukKyQL5VCv2q071kVnVn8dfdyceLVhOIw3JeQkv5HbYzc5bvUR0SvNhkC5NVWLV/eK//wM62zc1u5xirWpY78RC8OS4ymdBCX/nWXvdkA0rgtsrQvE7pFvu4ZUq6s0lGkGVTn7nGlWC2pfU+vsNEaqsuHGJLYQhuoo5hSWTDvojdeFc8h77JinJbhuC84mT2xg5UtcXLPjYeXSLEX14mEfFDMQUvfL+7HSKalDZeD5qr3QmsxTY0S1mDJJHUoPHKXPi0CkuHW29yiIcyx/c= ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:52:00.072 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2020-11-16T21:52:03.598 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:03 smithi195 bash[10218]: audit 2020-11-16T21:52:03.301511+0000 mon.a (mon.0) 124 : audit [INF] from='client.? v1:172.21.15.195:0/480467489' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/allow_ptrace", "value": "true"}]: dispatch 2020-11-16T21:52:03.598 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:03 smithi195 bash[10218]: audit 2020-11-16T21:52:03.305806+0000 mon.a (mon.0) 125 : audit [INF] from='client.? v1:172.21.15.195:0/480467489' entity='client.admin' cmd='[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/allow_ptrace", "value": "true"}]': finished 2020-11-16T21:52:04.079 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi016 2020-11-16T21:52:04.080 INFO:teuthology.orchestra.run.smithi016:> set -ex 2020-11-16T21:52:04.080 INFO:teuthology.orchestra.run.smithi016:> dd of=/etc/ceph/ceph.conf 2020-11-16T21:52:04.085 INFO:teuthology.orchestra.run.smithi016.stderr:+ dd of=/etc/ceph/ceph.conf 2020-11-16T21:52:04.086 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2020-11-16T21:52:04.087 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2020-11-16T21:52:04.087 INFO:teuthology.orchestra.run.smithi016.stderr:148 bytes copied, 8.134e-05 s, 1.8 MB/s 2020-11-16T21:52:04.087 INFO:teuthology.orchestra.run.smithi016:> set -ex 2020-11-16T21:52:04.087 INFO:teuthology.orchestra.run.smithi016:> dd of=/etc/ceph/ceph.client.admin.keyring 2020-11-16T21:52:04.132 INFO:teuthology.orchestra.run.smithi016.stderr:+ dd of=/etc/ceph/ceph.client.admin.keyring 2020-11-16T21:52:04.133 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2020-11-16T21:52:04.133 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2020-11-16T21:52:04.133 INFO:teuthology.orchestra.run.smithi016.stderr:63 bytes copied, 7.5757e-05 s, 832 kB/s 2020-11-16T21:52:04.134 INFO:tasks.cephadm:Adding host smithi016 to orchestrator... 2020-11-16T21:52:04.134 INFO:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch host add smithi016 2020-11-16T21:52:04.598 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:04 smithi195 bash[10218]: audit 2020-11-16T21:52:03.517012+0000 mon.a (mon.0) 126 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:52:04.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:04 smithi195 bash[10218]: audit 2020-11-16T21:52:03.809272+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:51:49.094559\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:51:49.094788\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:51:49.095035\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:52:04.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:04 smithi195 bash[10218]: audit 2020-11-16T21:52:03.811315+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:51:49.094559\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:51:49.094788\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:51:49.095035\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:52:04.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:04 smithi195 bash[10218]: audit 2020-11-16T21:52:03.812658+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:52:04.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:04 smithi195 bash[10218]: audit 2020-11-16T21:52:03.815186+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:52:04.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:04 smithi195 bash[10218]: cephadm 2020-11-16T21:52:03.815786+0000 mgr.y (mgr.14138) 5 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2020-11-16T21:52:04.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:04 smithi195 bash[10218]: audit 2020-11-16T21:52:03.816302+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-11-16T21:52:04.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:04 smithi195 bash[10218]: audit 2020-11-16T21:52:03.817493+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:52:04.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:04 smithi195 bash[10218]: cephadm 2020-11-16T21:52:03.818407+0000 mgr.y (mgr.14138) 6 : cephadm [INF] Reconfiguring daemon mon.a on smithi195 2020-11-16T21:52:04.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:04 smithi195 bash[10218]: audit 2020-11-16T21:52:03.819163+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-11-16T21:52:09.260 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:08 smithi195 bash[10218]: cluster 2020-11-16T21:52:07.939939+0000 mgr.y (mgr.14138) 7 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:09.261 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:08 smithi195 bash[10218]: audit 2020-11-16T21:52:08.036834+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:51:49.094788\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:03.815917\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:52:09.261 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:08 smithi195 bash[10218]: audit 2020-11-16T21:52:08.041032+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:51:49.094788\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:03.815917\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:52:09.261 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:08 smithi195 bash[10218]: audit 2020-11-16T21:52:08.042465+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2020-11-16T21:52:09.261 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:08 smithi195 bash[10218]: audit 2020-11-16T21:52:08.044046+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:52:09.261 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:08 smithi195 bash[10218]: audit 2020-11-16T21:52:08.046225+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-11-16T21:52:10.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:09 smithi195 bash[10218]: cephadm 2020-11-16T21:52:08.041867+0000 mgr.y (mgr.14138) 8 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2020-11-16T21:52:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:09 smithi195 bash[10218]: cephadm 2020-11-16T21:52:08.045378+0000 mgr.y (mgr.14138) 9 : cephadm [INF] Reconfiguring daemon mgr.y on smithi195 2020-11-16T21:52:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:09 smithi195 bash[10218]: audit 2020-11-16T21:52:09.812044+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:03.815917\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:08.041974\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:52:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:09 smithi195 bash[10218]: audit 2020-11-16T21:52:09.816365+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:03.815917\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:08.041974\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:52:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:09 smithi195 bash[10218]: audit 2020-11-16T21:52:09.818701+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:52:11.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:10 smithi195 bash[10218]: cluster 2020-11-16T21:52:09.940259+0000 mgr.y (mgr.14138) 10 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:11.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:10 smithi195 bash[10218]: audit 2020-11-16T21:52:10.456191+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:52:10.454857\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:52:10.455017\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:03.815917\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:08.041974\"}}, \"last_daemon_update\": \"2020-11-16T21:52:10.455219\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:52:11.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:10 smithi195 bash[10218]: audit 2020-11-16T21:52:10.460316+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:52:10.454857\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:52:10.455017\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:03.815917\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:08.041974\"}}, \"last_daemon_update\": \"2020-11-16T21:52:10.455219\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:52:11.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:10 smithi195 bash[10218]: audit 2020-11-16T21:52:10.461499+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:52:11.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:10 smithi195 bash[10218]: audit 2020-11-16T21:52:10.463458+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:52:13.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:12 smithi195 bash[10218]: cluster 2020-11-16T21:52:11.940686+0000 mgr.y (mgr.14138) 11 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:15.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:14 smithi195 bash[10218]: cluster 2020-11-16T21:52:13.941151+0000 mgr.y (mgr.14138) 12 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:17.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:16 smithi195 bash[10218]: cluster 2020-11-16T21:52:15.941596+0000 mgr.y (mgr.14138) 13 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:19.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:18 smithi195 bash[10218]: cluster 2020-11-16T21:52:17.941985+0000 mgr.y (mgr.14138) 14 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:20.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:20 smithi195 bash[10218]: cluster 2020-11-16T21:52:19.942372+0000 mgr.y (mgr.14138) 15 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:22.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:22 smithi195 bash[10218]: cluster 2020-11-16T21:52:21.942759+0000 mgr.y (mgr.14138) 16 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:24.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:24 smithi195 bash[10218]: cluster 2020-11-16T21:52:23.943162+0000 mgr.y (mgr.14138) 17 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:26.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:26 smithi195 bash[10218]: cluster 2020-11-16T21:52:25.943533+0000 mgr.y (mgr.14138) 18 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:28.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:28 smithi195 bash[10218]: cluster 2020-11-16T21:52:27.943936+0000 mgr.y (mgr.14138) 19 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:30.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:30 smithi195 bash[10218]: cluster 2020-11-16T21:52:29.944265+0000 mgr.y (mgr.14138) 20 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:31.848 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:52:31 smithi195 bash[10493]: Warning: Permanently added 'smithi016,172.21.15.16' (ECDSA) to the list of known hosts. 2020-11-16T21:52:32.124 INFO:teuthology.orchestra.run.smithi016.stdout:Added host 'smithi016' 2020-11-16T21:52:32.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:32 smithi195 bash[10218]: audit 2020-11-16T21:52:31.369184+0000 mgr.y (mgr.14138) 21 : audit [DBG] from='client.14156 v1:172.21.15.16:0/4031237656' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi016", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:52:32.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:32 smithi195 bash[10218]: cluster 2020-11-16T21:52:31.944764+0000 mgr.y (mgr.14138) 22 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:32.860 INFO:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch host ls --format=json 2020-11-16T21:52:33.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:33 smithi195 bash[10218]: audit 2020-11-16T21:52:32.130690+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"smithi195\", \"labels\": [], \"status\": \"\"}, \"smithi016\": {\"hostname\": \"smithi016\", \"addr\": \"smithi016\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2020-11-16T21:52:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:33 smithi195 bash[10218]: audit 2020-11-16T21:52:32.134796+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"smithi195\", \"labels\": [], \"status\": \"\"}, \"smithi016\": {\"hostname\": \"smithi016\", \"addr\": \"smithi016\", \"labels\": [], \"status\": \"\"}}"}]': finished 2020-11-16T21:52:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:33 smithi195 bash[10218]: cephadm 2020-11-16T21:52:32.135612+0000 mgr.y (mgr.14138) 23 : cephadm [INF] Added host smithi016 2020-11-16T21:52:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:33 smithi195 bash[10218]: audit 2020-11-16T21:52:32.139448+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:52:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:33 smithi195 bash[10218]: audit 2020-11-16T21:52:32.519526+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:52:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:33 smithi195 bash[10218]: audit 2020-11-16T21:52:32.523134+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:52:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:33 smithi195 bash[10218]: audit 2020-11-16T21:52:32.524192+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:52:33.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:33 smithi195 bash[10218]: audit 2020-11-16T21:52:32.807449+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:52:32.806919\", \"networks\": {}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:52:33.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:33 smithi195 bash[10218]: audit 2020-11-16T21:52:32.810665+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:52:32.806919\", \"networks\": {}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:52:33.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:33 smithi195 bash[10218]: audit 2020-11-16T21:52:32.812829+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:52:32.811689\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:52:32.811868\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:03.815917\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:08.041974\"}}, \"last_daemon_update\": \"2020-11-16T21:52:32.812026\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:52:33.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:33 smithi195 bash[10218]: audit 2020-11-16T21:52:32.813381+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:52:33.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:33 smithi195 bash[10218]: audit 2020-11-16T21:52:32.816673+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:52:32.811689\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:52:32.811868\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:03.815917\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:08.041974\"}}, \"last_daemon_update\": \"2020-11-16T21:52:32.812026\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:52:34.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:34 smithi195 bash[10218]: cluster 2020-11-16T21:52:33.945228+0000 mgr.y (mgr.14138) 24 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:36.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:36 smithi195 bash[10218]: cluster 2020-11-16T21:52:35.945657+0000 mgr.y (mgr.14138) 25 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:37.144 INFO:teuthology.orchestra.run.smithi016.stdout: 2020-11-16T21:52:37.144 INFO:teuthology.orchestra.run.smithi016.stdout:[{"addr": "smithi195", "hostname": "smithi195", "labels": [], "status": ""}, {"addr": "smithi016", "hostname": "smithi016", "labels": [], "status": ""}] 2020-11-16T21:52:37.837 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi057 2020-11-16T21:52:37.837 INFO:teuthology.orchestra.run.smithi057:> set -ex 2020-11-16T21:52:37.838 INFO:teuthology.orchestra.run.smithi057:> dd of=/etc/ceph/ceph.conf 2020-11-16T21:52:37.843 INFO:teuthology.orchestra.run.smithi057.stderr:+ dd of=/etc/ceph/ceph.conf 2020-11-16T21:52:37.844 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records in 2020-11-16T21:52:37.844 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records out 2020-11-16T21:52:37.844 INFO:teuthology.orchestra.run.smithi057.stderr:148 bytes copied, 7.6783e-05 s, 1.9 MB/s 2020-11-16T21:52:37.845 INFO:teuthology.orchestra.run.smithi057:> set -ex 2020-11-16T21:52:37.845 INFO:teuthology.orchestra.run.smithi057:> dd of=/etc/ceph/ceph.client.admin.keyring 2020-11-16T21:52:37.891 INFO:teuthology.orchestra.run.smithi057.stderr:+ dd of=/etc/ceph/ceph.client.admin.keyring 2020-11-16T21:52:37.893 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records in 2020-11-16T21:52:37.893 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records out 2020-11-16T21:52:37.893 INFO:teuthology.orchestra.run.smithi057.stderr:63 bytes copied, 7.714e-05 s, 817 kB/s 2020-11-16T21:52:37.893 INFO:tasks.cephadm:Adding host smithi057 to orchestrator... 2020-11-16T21:52:37.894 INFO:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch host add smithi057 2020-11-16T21:52:38.347 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:38 smithi195 bash[10218]: audit 2020-11-16T21:52:37.155853+0000 mgr.y (mgr.14138) 26 : audit [DBG] from='client.14158 v1:172.21.15.16:0/2698867947' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-11-16T21:52:38.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:38 smithi195 bash[10218]: cluster 2020-11-16T21:52:37.946085+0000 mgr.y (mgr.14138) 27 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:39.402 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:39 smithi195 bash[10218]: audit 2020-11-16T21:52:39.098045+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:52:39.847 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:52:39 smithi195 bash[10493]: debug 2020-11-16T21:52:39.409+0000 7f2650aa2700 -1 ceph_set_health_checks check CEPHADM_REFRESH_FAILED detail item 0 not a [unicode] string 2020-11-16T21:52:39.848 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:52:39 smithi195 bash[10493]: debug 2020-11-16T21:52:39.409+0000 7f2650aa2700 -1 ceph_set_health_checks check CEPHADM_REFRESH_FAILED detail item 0 not a [unicode] string 2020-11-16T21:52:40.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:40 smithi195 bash[10218]: audit 2020-11-16T21:52:39.405626+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:52:32.806919\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:52:40.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:40 smithi195 bash[10218]: audit 2020-11-16T21:52:39.409290+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:52:32.806919\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:52:40.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:40 smithi195 bash[10218]: audit 2020-11-16T21:52:39.410959+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:52:32.806919\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:52:40.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:40 smithi195 bash[10218]: audit 2020-11-16T21:52:39.414579+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:52:32.806919\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:52:40.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:40 smithi195 bash[10218]: cluster 2020-11-16T21:52:39.415749+0000 mgr.y (mgr.14138) 28 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:40.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:40 smithi195 bash[10218]: audit 2020-11-16T21:52:39.416646+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:52:40.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:40 smithi195 bash[10218]: audit 2020-11-16T21:52:39.420519+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:52:41.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:41 smithi195 bash[10218]: cluster 2020-11-16T21:52:40.411820+0000 mon.a (mon.0) 164 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2020-11-16T21:52:42.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:42 smithi195 bash[10218]: cluster 2020-11-16T21:52:41.416198+0000 mgr.y (mgr.14138) 29 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:44.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:44 smithi195 bash[10218]: cluster 2020-11-16T21:52:43.416613+0000 mgr.y (mgr.14138) 30 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:46.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:46 smithi195 bash[10218]: cluster 2020-11-16T21:52:45.417062+0000 mgr.y (mgr.14138) 31 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:48.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:48 smithi195 bash[10218]: cluster 2020-11-16T21:52:47.417451+0000 mgr.y (mgr.14138) 32 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:48.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:48 smithi195 bash[10218]: audit 2020-11-16T21:52:48.145660+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:52:48.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:48 smithi195 bash[10218]: audit 2020-11-16T21:52:48.148293+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2020-11-16T21:52:50.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:50 smithi195 bash[10218]: cluster 2020-11-16T21:52:49.417914+0000 mgr.y (mgr.14138) 33 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:52.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:52 smithi195 bash[10218]: cluster 2020-11-16T21:52:51.418332+0000 mgr.y (mgr.14138) 34 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:54.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:54 smithi195 bash[10218]: cluster 2020-11-16T21:52:53.418723+0000 mgr.y (mgr.14138) 35 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:56.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:56 smithi195 bash[10218]: cluster 2020-11-16T21:52:55.419172+0000 mgr.y (mgr.14138) 36 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:52:58.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:52:58 smithi195 bash[10218]: cluster 2020-11-16T21:52:57.419606+0000 mgr.y (mgr.14138) 37 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:00.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:00 smithi195 bash[10218]: cluster 2020-11-16T21:52:59.419950+0000 mgr.y (mgr.14138) 38 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:02.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:02 smithi195 bash[10218]: cluster 2020-11-16T21:53:01.420394+0000 mgr.y (mgr.14138) 39 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:04.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:04 smithi195 bash[10218]: cluster 2020-11-16T21:53:03.420829+0000 mgr.y (mgr.14138) 40 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:05.847 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:53:05 smithi195 bash[10493]: Warning: Permanently added 'smithi057,172.21.15.57' (ECDSA) to the list of known hosts. 2020-11-16T21:53:06.282 INFO:teuthology.orchestra.run.smithi057.stdout:Added host 'smithi057' 2020-11-16T21:53:06.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:06 smithi195 bash[10218]: cluster 2020-11-16T21:53:05.421286+0000 mgr.y (mgr.14138) 41 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:06.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:06 smithi195 bash[10218]: audit 2020-11-16T21:53:05.512845+0000 mgr.y (mgr.14138) 42 : audit [DBG] from='client.14160 v1:172.21.15.57:0/4107967254' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi057", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:53:06.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:06 smithi195 bash[10218]: audit 2020-11-16T21:53:06.288927+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"smithi195\", \"labels\": [], \"status\": \"\"}, \"smithi016\": {\"hostname\": \"smithi016\", \"addr\": \"smithi016\", \"labels\": [], \"status\": \"\"}, \"smithi057\": {\"hostname\": \"smithi057\", \"addr\": \"smithi057\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2020-11-16T21:53:06.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:06 smithi195 bash[10218]: audit 2020-11-16T21:53:06.293446+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi195\": {\"hostname\": \"smithi195\", \"addr\": \"smithi195\", \"labels\": [], \"status\": \"\"}, \"smithi016\": {\"hostname\": \"smithi016\", \"addr\": \"smithi016\", \"labels\": [], \"status\": \"\"}, \"smithi057\": {\"hostname\": \"smithi057\", \"addr\": \"smithi057\", \"labels\": [], \"status\": \"\"}}"}]': finished 2020-11-16T21:53:06.978 INFO:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch host ls --format=json 2020-11-16T21:53:07.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:07 smithi195 bash[10218]: cephadm 2020-11-16T21:53:06.294179+0000 mgr.y (mgr.14138) 43 : cephadm [INF] Added host smithi057 2020-11-16T21:53:07.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:07 smithi195 bash[10218]: audit 2020-11-16T21:53:06.677112+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:53:07.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:07 smithi195 bash[10218]: audit 2020-11-16T21:53:06.680772+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:53:07.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:07 smithi195 bash[10218]: audit 2020-11-16T21:53:06.682030+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:07.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:07 smithi195 bash[10218]: audit 2020-11-16T21:53:06.975205+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:53:06.974605\", \"networks\": {}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:53:07.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:07 smithi195 bash[10218]: audit 2020-11-16T21:53:06.979237+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {}, \"devices\": [], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:53:06.974605\", \"networks\": {}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:53:07.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:07 smithi195 bash[10218]: audit 2020-11-16T21:53:06.981055+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:53:08.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:08 smithi195 bash[10218]: cluster 2020-11-16T21:53:07.421792+0000 mgr.y (mgr.14138) 44 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:10.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:10 smithi195 bash[10218]: cluster 2020-11-16T21:53:09.422206+0000 mgr.y (mgr.14138) 45 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:11.010 INFO:teuthology.orchestra.run.smithi057.stdout: 2020-11-16T21:53:11.011 INFO:teuthology.orchestra.run.smithi057.stdout:[{"addr": "smithi195", "hostname": "smithi195", "labels": [], "status": ""}, {"addr": "smithi016", "hostname": "smithi016", "labels": [], "status": ""}, {"addr": "smithi057", "hostname": "smithi057", "labels": [], "status": ""}] 2020-11-16T21:53:11.782 INFO:tasks.cephadm:Setting crush tunables to default 2020-11-16T21:53:11.783 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd crush tunables default 2020-11-16T21:53:12.762 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:12 smithi195 bash[10218]: audit 2020-11-16T21:53:11.023369+0000 mgr.y (mgr.14138) 46 : audit [DBG] from='client.14162 v1:172.21.15.57:0/402784843' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-11-16T21:53:12.763 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:12 smithi195 bash[10218]: cluster 2020-11-16T21:53:11.422621+0000 mgr.y (mgr.14138) 47 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:13.347 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:53:13 smithi195 bash[10493]: debug 2020-11-16T21:53:13.113+0000 7f2650aa2700 -1 ceph_set_health_checks check CEPHADM_REFRESH_FAILED detail item 0 not a [unicode] string 2020-11-16T21:53:13.347 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:53:13 smithi195 bash[10493]: debug 2020-11-16T21:53:13.113+0000 7f2650aa2700 -1 ceph_set_health_checks check CEPHADM_REFRESH_FAILED detail item 0 not a [unicode] string 2020-11-16T21:53:13.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:13 smithi195 bash[10218]: audit 2020-11-16T21:53:12.797785+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:13.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:13 smithi195 bash[10218]: audit 2020-11-16T21:53:13.106471+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:53:06.974605\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:53:13.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:13 smithi195 bash[10218]: audit 2020-11-16T21:53:13.110800+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:53:06.974605\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:53:13.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:13 smithi195 bash[10218]: audit 2020-11-16T21:53:13.112722+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:53:06.974605\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:53:13.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:13 smithi195 bash[10218]: audit 2020-11-16T21:53:13.116754+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2020-11-16T21:53:06.974605\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:53:13.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:13 smithi195 bash[10218]: audit 2020-11-16T21:53:13.118976+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:53:13.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:13 smithi195 bash[10218]: audit 2020-11-16T21:53:13.121204+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:53:14.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:14 smithi195 bash[10218]: cluster 2020-11-16T21:53:13.423057+0000 mgr.y (mgr.14138) 48 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:15.478 INFO:teuthology.orchestra.run.smithi195.stderr:adjusted tunables profile to default 2020-11-16T21:53:15.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:15 smithi195 bash[10218]: audit 2020-11-16T21:53:14.778797+0000 mon.a (mon.0) 182 : audit [INF] from='client.? v1:172.21.15.195:0/2989255195' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2020-11-16T21:53:16.100 INFO:tasks.cephadm:Adding mon.b on smithi016 2020-11-16T21:53:16.100 INFO:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch daemon add mon 'smithi016:[v1:172.21.15.16:6789]=b' 2020-11-16T21:53:16.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:16 smithi195 bash[10218]: cluster 2020-11-16T21:53:15.423450+0000 mgr.y (mgr.14138) 49 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:16.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:16 smithi195 bash[10218]: audit 2020-11-16T21:53:15.488603+0000 mon.a (mon.0) 183 : audit [INF] from='client.? v1:172.21.15.195:0/2989255195' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2020-11-16T21:53:16.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:16 smithi195 bash[10218]: cluster 2020-11-16T21:53:15.488709+0000 mon.a (mon.0) 184 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2020-11-16T21:53:16.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:16 smithi195 bash[10218]: audit 2020-11-16T21:53:15.489364+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2020-11-16T21:53:17.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:17 smithi195 bash[10218]: audit 2020-11-16T21:53:16.496536+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2020-11-16T21:53:17.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:17 smithi195 bash[10218]: cluster 2020-11-16T21:53:16.496635+0000 mon.a (mon.0) 187 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2020-11-16T21:53:17.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:17 smithi195 bash[10218]: audit 2020-11-16T21:53:16.498148+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2020-11-16T21:53:18.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:18 smithi195 bash[10218]: cluster 2020-11-16T21:53:17.423912+0000 mgr.y (mgr.14138) 50 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:18.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:18 smithi195 bash[10218]: audit 2020-11-16T21:53:17.503611+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2020-11-16T21:53:18.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:18 smithi195 bash[10218]: cluster 2020-11-16T21:53:17.503747+0000 mon.a (mon.0) 190 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-11-16T21:53:19.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:19 smithi195 bash[10218]: audit 2020-11-16T21:53:19.277834+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-11-16T21:53:19.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:19 smithi195 bash[10218]: audit 2020-11-16T21:53:19.279314+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:19.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:19 smithi195 bash[10218]: audit 2020-11-16T21:53:19.281065+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2020-11-16T21:53:20.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:20 smithi195 bash[10218]: audit 2020-11-16T21:53:19.273646+0000 mgr.y (mgr.14138) 51 : audit [DBG] from='client.14166 v1:172.21.15.16:0/4192618689' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi016:[v1:172.21.15.16:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:53:20.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:20 smithi195 bash[10218]: cephadm 2020-11-16T21:53:19.280463+0000 mgr.y (mgr.14138) 52 : cephadm [INF] Deploying daemon mon.b on smithi016 2020-11-16T21:53:20.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:20 smithi195 bash[10218]: cluster 2020-11-16T21:53:19.424269+0000 mgr.y (mgr.14138) 53 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:22.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:22 smithi195 bash[10218]: cluster 2020-11-16T21:53:21.424710+0000 mgr.y (mgr.14138) 54 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:23.677 INFO:teuthology.orchestra.run.smithi016.stdout:Deployed mon.b on host 'smithi016' 2020-11-16T21:53:24.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:24 smithi195 bash[10218]: cluster 2020-11-16T21:53:23.425156+0000 mgr.y (mgr.14138) 55 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:24.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:24 smithi195 bash[10218]: audit 2020-11-16T21:53:23.684755+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:19.278928\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:53:24.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:24 smithi195 bash[10218]: audit 2020-11-16T21:53:23.685672+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:24.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:24 smithi195 bash[10218]: audit 2020-11-16T21:53:23.689306+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:19.278928\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:53:24.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:24 smithi195 bash[10218]: audit 2020-11-16T21:53:24.316051+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:24.314739\", \"created\": \"2020-11-16T21:53:23.654525\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:19.278928\"}}, \"last_daemon_update\": \"2020-11-16T21:53:24.315046\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:53:24.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:24 smithi195 bash[10218]: audit 2020-11-16T21:53:24.320640+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:24.314739\", \"created\": \"2020-11-16T21:53:23.654525\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:19.278928\"}}, \"last_daemon_update\": \"2020-11-16T21:53:24.315046\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:53:24.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:24 smithi195 bash[10218]: audit 2020-11-16T21:53:24.323072+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:53:24.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:24 smithi195 bash[10218]: audit 2020-11-16T21:53:24.327068+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:53:24.850 INFO:teuthology.orchestra.run.smithi016:mon.b> sudo journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mon.b.service 2020-11-16T21:53:24.854 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2020-11-16T21:53:24.855 INFO:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph mon dump -f json 2020-11-16T21:53:24.914 INFO:journalctl@ceph.mon.b.smithi016.stdout:-- Logs begin at Sun 2020-11-15 12:21:41 UTC. -- 2020-11-16T21:53:25.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.194+0000 7fca1ac95700 0 set uid:gid to 167:167 (ceph:ceph) 2020-11-16T21:53:25.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.194+0000 7fca1ac95700 0 ceph version 16.0.0-7219-g911cc357 (911cc35794d871071a8bebfb0919482263b1d18b) pacific (dev), process ceph-mon, pid 1 2020-11-16T21:53:25.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.194+0000 7fca1ac95700 0 pidfile_write: ignore empty --pid-file 2020-11-16T21:53:25.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.198+0000 7fca1ac95700 0 load: jerasure load: lrc load: isa 2020-11-16T21:53:25.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.198+0000 7fca1ac95700 4 rocksdb: RocksDB version: 6.8.1 2020-11-16T21:53:25.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.198+0000 7fca1ac95700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2020-11-16T21:53:25.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.198+0000 7fca1ac95700 4 rocksdb: Compile date Nov 16 2020 2020-11-16T21:53:25.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.198+0000 7fca1ac95700 4 rocksdb: DB SUMMARY 2020-11-16T21:53:25.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: CURRENT file: CURRENT 2020-11-16T21:53:25.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: IDENTITY file: IDENTITY 2020-11-16T21:53:25.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2020-11-16T21:53:25.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2020-11-16T21:53:25.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 476 ; 2020-11-16T21:53:25.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.error_if_exists: 0 2020-11-16T21:53:25.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.create_if_missing: 0 2020-11-16T21:53:25.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.paranoid_checks: 1 2020-11-16T21:53:25.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.env: 0x5652899d5100 2020-11-16T21:53:25.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.fs: Posix File System 2020-11-16T21:53:25.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.info_log: 0x56528b63ca00 2020-11-16T21:53:25.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_file_opening_threads: 16 2020-11-16T21:53:25.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.statistics: (nil) 2020-11-16T21:53:25.589 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.use_fsync: 0 2020-11-16T21:53:25.589 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_log_file_size: 0 2020-11-16T21:53:25.589 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2020-11-16T21:53:25.589 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.log_file_time_to_roll: 0 2020-11-16T21:53:25.589 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.keep_log_file_num: 1000 2020-11-16T21:53:25.589 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.recycle_log_file_num: 0 2020-11-16T21:53:25.591 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.allow_fallocate: 1 2020-11-16T21:53:25.591 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.allow_mmap_reads: 0 2020-11-16T21:53:25.591 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.allow_mmap_writes: 0 2020-11-16T21:53:25.592 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.use_direct_reads: 0 2020-11-16T21:53:25.592 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2020-11-16T21:53:25.592 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.create_missing_column_families: 0 2020-11-16T21:53:25.592 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.db_log_dir: 2020-11-16T21:53:25.592 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2020-11-16T21:53:25.592 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.table_cache_numshardbits: 6 2020-11-16T21:53:25.592 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_subcompactions: 1 2020-11-16T21:53:25.593 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_background_flushes: -1 2020-11-16T21:53:25.593 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.WAL_ttl_seconds: 0 2020-11-16T21:53:25.593 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.WAL_size_limit_MB: 0 2020-11-16T21:53:25.593 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2020-11-16T21:53:25.593 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2020-11-16T21:53:25.593 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.is_fd_close_on_exec: 1 2020-11-16T21:53:25.593 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.advise_random_on_open: 1 2020-11-16T21:53:25.593 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.db_write_buffer_size: 0 2020-11-16T21:53:25.594 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.write_buffer_manager: 0x56528b689950 2020-11-16T21:53:25.594 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2020-11-16T21:53:25.594 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2020-11-16T21:53:25.594 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2020-11-16T21:53:25.594 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.use_adaptive_mutex: 0 2020-11-16T21:53:25.594 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.rate_limiter: (nil) 2020-11-16T21:53:25.594 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2020-11-16T21:53:25.595 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.wal_recovery_mode: 2 2020-11-16T21:53:25.595 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.enable_thread_tracking: 0 2020-11-16T21:53:25.595 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.enable_pipelined_write: 0 2020-11-16T21:53:25.595 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.unordered_write: 0 2020-11-16T21:53:25.595 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2020-11-16T21:53:25.595 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2020-11-16T21:53:25.595 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2020-11-16T21:53:25.596 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2020-11-16T21:53:25.596 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.row_cache: None 2020-11-16T21:53:25.596 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.wal_filter: None 2020-11-16T21:53:25.596 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2020-11-16T21:53:25.596 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.allow_ingest_behind: 0 2020-11-16T21:53:25.596 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.preserve_deletes: 0 2020-11-16T21:53:25.596 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.two_write_queues: 0 2020-11-16T21:53:25.596 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.manual_wal_flush: 0 2020-11-16T21:53:25.597 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.atomic_flush: 0 2020-11-16T21:53:25.597 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2020-11-16T21:53:25.597 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.persist_stats_to_disk: 0 2020-11-16T21:53:25.597 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.write_dbid_to_manifest: 0 2020-11-16T21:53:25.597 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.log_readahead_size: 0 2020-11-16T21:53:25.597 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2020-11-16T21:53:25.597 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_background_jobs: 2 2020-11-16T21:53:25.598 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_background_compactions: -1 2020-11-16T21:53:25.598 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2020-11-16T21:53:25.598 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2020-11-16T21:53:25.598 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.delayed_write_rate : 16777216 2020-11-16T21:53:25.598 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_total_wal_size: 0 2020-11-16T21:53:25.598 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2020-11-16T21:53:25.598 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.stats_dump_period_sec: 600 2020-11-16T21:53:25.598 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.stats_persist_period_sec: 600 2020-11-16T21:53:25.599 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2020-11-16T21:53:25.599 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_open_files: -1 2020-11-16T21:53:25.599 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.bytes_per_sync: 0 2020-11-16T21:53:25.599 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.wal_bytes_per_sync: 0 2020-11-16T21:53:25.599 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.strict_bytes_per_sync: 0 2020-11-16T21:53:25.599 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compaction_readahead_size: 0 2020-11-16T21:53:25.599 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Compression algorithms supported: 2020-11-16T21:53:25.600 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2020-11-16T21:53:25.600 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: kZSTD supported: 0 2020-11-16T21:53:25.600 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: kXpressCompression supported: 0 2020-11-16T21:53:25.600 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: kLZ4HCCompression supported: 1 2020-11-16T21:53:25.600 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: kLZ4Compression supported: 1 2020-11-16T21:53:25.600 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: kBZip2Compression supported: 0 2020-11-16T21:53:25.600 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: kZlibCompression supported: 1 2020-11-16T21:53:25.601 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: kSnappyCompression supported: 1 2020-11-16T21:53:25.601 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Fast CRC32 supported: Supported on x86 2020-11-16T21:53:25.601 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2020-11-16T21:53:25.601 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2020-11-16T21:53:25.601 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2020-11-16T21:53:25.601 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.merge_operator: 2020-11-16T21:53:25.601 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compaction_filter: None 2020-11-16T21:53:25.601 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compaction_filter_factory: None 2020-11-16T21:53:25.602 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.memtable_factory: SkipListFactory 2020-11-16T21:53:25.602 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.table_factory: BlockBasedTable 2020-11-16T21:53:25.602 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56528b5e1bb8) 2020-11-16T21:53:25.602 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: cache_index_and_filter_blocks: 1 2020-11-16T21:53:25.602 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: cache_index_and_filter_blocks_with_high_priority: 1 2020-11-16T21:53:25.602 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: pin_l0_filter_and_index_blocks_in_cache: 0 2020-11-16T21:53:25.602 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: pin_top_level_index_and_filter: 1 2020-11-16T21:53:25.603 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: index_type: 0 2020-11-16T21:53:25.603 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: data_block_index_type: 0 2020-11-16T21:53:25.603 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: index_shortening: 1 2020-11-16T21:53:25.603 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: data_block_hash_table_util_ratio: 0.750000 2020-11-16T21:53:25.603 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: hash_index_allow_collision: 1 2020-11-16T21:53:25.603 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: checksum: 1 2020-11-16T21:53:25.603 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: no_block_cache: 0 2020-11-16T21:53:25.603 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: block_cache: 0x56528b618610 2020-11-16T21:53:25.604 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: block_cache_name: BinnedLRUCache 2020-11-16T21:53:25.604 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: block_cache_options: 2020-11-16T21:53:25.604 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: capacity : 536870912 2020-11-16T21:53:25.604 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: num_shard_bits : 4 2020-11-16T21:53:25.604 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: strict_capacity_limit : 0 2020-11-16T21:53:25.604 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: high_pri_pool_ratio: 0.000 2020-11-16T21:53:25.604 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: block_cache_compressed: (nil) 2020-11-16T21:53:25.604 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: persistent_cache: (nil) 2020-11-16T21:53:25.605 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: block_size: 4096 2020-11-16T21:53:25.605 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: block_size_deviation: 10 2020-11-16T21:53:25.605 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: block_restart_interval: 16 2020-11-16T21:53:25.605 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: index_block_restart_interval: 1 2020-11-16T21:53:25.605 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: metadata_block_size: 4096 2020-11-16T21:53:25.605 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: partition_filters: 0 2020-11-16T21:53:25.605 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: use_delta_encoding: 1 2020-11-16T21:53:25.606 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: filter_policy: rocksdb.BuiltinBloomFilter 2020-11-16T21:53:25.606 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: whole_key_filtering: 1 2020-11-16T21:53:25.606 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: verify_compression: 0 2020-11-16T21:53:25.606 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: read_amp_bytes_per_bit: 0 2020-11-16T21:53:25.606 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: format_version: 2 2020-11-16T21:53:25.606 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: enable_index_compression: 1 2020-11-16T21:53:25.606 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: block_align: 0 2020-11-16T21:53:25.606 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.write_buffer_size: 33554432 2020-11-16T21:53:25.607 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_write_buffer_number: 2 2020-11-16T21:53:25.607 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compression: NoCompression 2020-11-16T21:53:25.607 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.bottommost_compression: Disabled 2020-11-16T21:53:25.607 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.prefix_extractor: nullptr 2020-11-16T21:53:25.607 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2020-11-16T21:53:25.607 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.num_levels: 7 2020-11-16T21:53:25.607 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2020-11-16T21:53:25.608 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2020-11-16T21:53:25.608 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2020-11-16T21:53:25.608 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2020-11-16T21:53:25.608 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2020-11-16T21:53:25.608 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2020-11-16T21:53:25.608 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2020-11-16T21:53:25.608 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2020-11-16T21:53:25.609 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2020-11-16T21:53:25.609 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compression_opts.window_bits: -14 2020-11-16T21:53:25.609 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compression_opts.level: 32767 2020-11-16T21:53:25.609 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compression_opts.strategy: 0 2020-11-16T21:53:25.609 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2020-11-16T21:53:25.609 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2020-11-16T21:53:25.609 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compression_opts.enabled: false 2020-11-16T21:53:25.609 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2020-11-16T21:53:25.610 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2020-11-16T21:53:25.610 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2020-11-16T21:53:25.610 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.target_file_size_base: 67108864 2020-11-16T21:53:25.610 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.target_file_size_multiplier: 1 2020-11-16T21:53:25.610 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2020-11-16T21:53:25.610 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2020-11-16T21:53:25.610 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2020-11-16T21:53:25.611 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2020-11-16T21:53:25.611 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2020-11-16T21:53:25.611 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2020-11-16T21:53:25.611 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2020-11-16T21:53:25.611 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2020-11-16T21:53:25.611 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2020-11-16T21:53:25.611 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2020-11-16T21:53:25.611 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2020-11-16T21:53:25.612 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2020-11-16T21:53:25.612 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.arena_block_size: 4194304 2020-11-16T21:53:25.612 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2020-11-16T21:53:25.612 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2020-11-16T21:53:25.612 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2020-11-16T21:53:25.612 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.disable_auto_compactions: 0 2020-11-16T21:53:25.612 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2020-11-16T21:53:25.612 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2020-11-16T21:53:25.613 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2020-11-16T21:53:25.613 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2020-11-16T21:53:25.613 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2020-11-16T21:53:25.613 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2020-11-16T21:53:25.613 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2020-11-16T21:53:25.613 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2020-11-16T21:53:25.613 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2020-11-16T21:53:25.614 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2020-11-16T21:53:25.614 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.table_properties_collectors: 2020-11-16T21:53:25.614 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.inplace_update_support: 0 2020-11-16T21:53:25.614 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.inplace_update_num_locks: 10000 2020-11-16T21:53:25.614 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2020-11-16T21:53:25.614 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2020-11-16T21:53:25.614 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.memtable_huge_page_size: 0 2020-11-16T21:53:25.614 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.bloom_locality: 0 2020-11-16T21:53:25.615 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.max_successive_merges: 0 2020-11-16T21:53:25.615 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.optimize_filters_for_hits: 0 2020-11-16T21:53:25.615 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.paranoid_file_checks: 0 2020-11-16T21:53:25.615 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.force_consistency_checks: 0 2020-11-16T21:53:25.615 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.report_bg_io_stats: 0 2020-11-16T21:53:25.615 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.ttl: 2592000 2020-11-16T21:53:25.615 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: Options.periodic_compaction_seconds: 0 2020-11-16T21:53:25.616 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2020-11-16T21:53:25.616 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2020-11-16T21:53:25.616 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1605563605207753, "job": 1, "event": "recovery_started", "log_files": [3]} 2020-11-16T21:53:25.616 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2020-11-16T21:53:25.616 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.202+0000 7fca1ac95700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2020-11-16T21:53:25.616 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.206+0000 7fca1ac95700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1605563605209544, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1402, "table_properties": {"data_size": 488, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 366, "raw_average_value_size": 73, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1605563605, "oldest_key_time": 3, "file_creation_time": 0}} 2020-11-16T21:53:25.616 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.206+0000 7fca1ac95700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2020-11-16T21:53:25.616 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.206+0000 7fca1ac95700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1605563605210182, "job": 1, "event": "recovery_finished"} 2020-11-16T21:53:25.617 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.206+0000 7fca1ac95700 4 rocksdb: DB pointer 0x56528b669800 2020-11-16T21:53:25.617 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.206+0000 7fca01ad7700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2020-11-16T21:53:25.617 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.206+0000 7fca01ad7700 4 rocksdb: [db_impl/db_impl.cc:851] 2020-11-16T21:53:25.617 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: ** DB Stats ** 2020-11-16T21:53:25.617 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Uptime(secs): 0.0 total, 0.0 interval 2020-11-16T21:53:25.617 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2020-11-16T21:53:25.617 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2020-11-16T21:53:25.618 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2020-11-16T21:53:25.618 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2020-11-16T21:53:25.618 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2020-11-16T21:53:25.618 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2020-11-16T21:53:25.618 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: ** Compaction Stats [default] ** 2020-11-16T21:53:25.618 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-11-16T21:53:25.618 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-11-16T21:53:25.618 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: L0 1/0 1.37 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.8 0.00 0.00 1 0.002 0 0 2020-11-16T21:53:25.619 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Sum 1/0 1.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.8 0.00 0.00 1 0.002 0 0 2020-11-16T21:53:25.619 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.8 0.00 0.00 1 0.002 0 0 2020-11-16T21:53:25.619 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: ** Compaction Stats [default] ** 2020-11-16T21:53:25.619 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-11-16T21:53:25.619 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-11-16T21:53:25.619 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.8 0.00 0.00 1 0.002 0 0 2020-11-16T21:53:25.619 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Uptime(secs): 0.0 total, 0.0 interval 2020-11-16T21:53:25.620 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Flush(GB): cumulative 0.000, interval 0.000 2020-11-16T21:53:25.620 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: AddFile(GB): cumulative 0.000, interval 0.000 2020-11-16T21:53:25.620 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: AddFile(Total Files): cumulative 0, interval 0 2020-11-16T21:53:25.620 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: AddFile(L0 Files): cumulative 0, interval 0 2020-11-16T21:53:25.620 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: AddFile(Keys): cumulative 0, interval 0 2020-11-16T21:53:25.620 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Cumulative compaction: 0.00 GB write, 0.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-11-16T21:53:25.620 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Interval compaction: 0.00 GB write, 0.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-11-16T21:53:25.620 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-11-16T21:53:25.621 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: ** File Read Latency Histogram By Level [default] ** 2020-11-16T21:53:25.621 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: ** Compaction Stats [default] ** 2020-11-16T21:53:25.621 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-11-16T21:53:25.621 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-11-16T21:53:25.621 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: L0 1/0 1.37 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.8 0.00 0.00 1 0.002 0 0 2020-11-16T21:53:25.621 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Sum 1/0 1.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.8 0.00 0.00 1 0.002 0 0 2020-11-16T21:53:25.621 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-11-16T21:53:25.622 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: ** Compaction Stats [default] ** 2020-11-16T21:53:25.622 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-11-16T21:53:25.622 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-11-16T21:53:25.622 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.8 0.00 0.00 1 0.002 0 0 2020-11-16T21:53:25.622 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Uptime(secs): 0.0 total, 0.0 interval 2020-11-16T21:53:25.622 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Flush(GB): cumulative 0.000, interval 0.000 2020-11-16T21:53:25.622 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: AddFile(GB): cumulative 0.000, interval 0.000 2020-11-16T21:53:25.622 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: AddFile(Total Files): cumulative 0, interval 0 2020-11-16T21:53:25.623 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: AddFile(L0 Files): cumulative 0, interval 0 2020-11-16T21:53:25.623 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: AddFile(Keys): cumulative 0, interval 0 2020-11-16T21:53:25.623 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Cumulative compaction: 0.00 GB write, 0.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-11-16T21:53:25.623 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-11-16T21:53:25.623 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-11-16T21:53:25.623 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: ** File Read Latency Histogram By Level [default] ** 2020-11-16T21:53:25.623 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.206+0000 7fca1ac95700 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2020-11-16T21:53:25.624 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.206+0000 7fca1ac95700 0 using public_addrv v1:172.21.15.16:6789/0 2020-11-16T21:53:25.624 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.210+0000 7fca1ac95700 0 starting mon.b rank -1 at public addrs v1:172.21.15.16:6789/0 at bind addrs v1:172.21.15.16:6789/0 mon_data /var/lib/ceph/mon/ceph-b fsid bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:53:25.624 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.210+0000 7fca1ac95700 1 mon.b@-1(???) e0 preinit fsid bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:53:25.624 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.274+0000 7fca042dc700 0 mon.b@-1(synchronizing).mds e1 new map 2020-11-16T21:53:25.624 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.274+0000 7fca042dc700 0 mon.b@-1(synchronizing).mds e1 print_map 2020-11-16T21:53:25.624 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: e1 2020-11-16T21:53:25.624 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: enable_multiple, ever_enabled_multiple: 0,0 2020-11-16T21:53:25.624 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2020-11-16T21:53:25.625 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: legacy client fscid: -1 2020-11-16T21:53:25.625 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: 2020-11-16T21:53:25.625 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: No filesystems configured 2020-11-16T21:53:25.625 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.274+0000 7fca042dc700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2020-11-16T21:53:25.625 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.278+0000 7fca042dc700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2020-11-16T21:53:25.625 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.278+0000 7fca042dc700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2020-11-16T21:53:25.625 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.278+0000 7fca042dc700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2020-11-16T21:53:25.625 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.278+0000 7fca042dc700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2020-11-16T21:53:25.626 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.278+0000 7fca042dc700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2020-11-16T21:53:25.626 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.278+0000 7fca042dc700 1 mon.b@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2020-11-16T21:53:25.626 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.278+0000 7fca042dc700 1 mon.b@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2020-11-16T21:53:25.626 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.278+0000 7fca042dc700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2020-11-16T21:53:25.626 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.278+0000 7fca042dc700 0 mon.b@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2020-11-16T21:53:25.626 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.278+0000 7fca042dc700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2020-11-16T21:53:25.626 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: cluster 2020-11-16T21:53:23.425156+0000 mgr.y (mgr.14138) 55 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:25.627 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: audit 2020-11-16T21:53:23.684755+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:19.278928\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:53:25.830 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: audit 2020-11-16T21:53:23.685672+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:25.830 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: audit 2020-11-16T21:53:23.689306+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:19.278928\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:53:25.830 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: audit 2020-11-16T21:53:24.316051+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:24.314739\", \"created\": \"2020-11-16T21:53:23.654525\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:19.278928\"}}, \"last_daemon_update\": \"2020-11-16T21:53:24.315046\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:53:25.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: audit 2020-11-16T21:53:24.320640+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:24.314739\", \"created\": \"2020-11-16T21:53:23.654525\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:19.278928\"}}, \"last_daemon_update\": \"2020-11-16T21:53:24.315046\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:53:25.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: audit 2020-11-16T21:53:24.323072+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:53:25.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: audit 2020-11-16T21:53:24.327068+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:53:25.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.278+0000 7fca042dc700 1 mon.b@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2020-11-16T21:53:25.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.282+0000 7fca042dc700 10 mon.b@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2020-11-16T21:53:25.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.282+0000 7fca042dc700 20 expand_channel_meta expand map: {default=false} 2020-11-16T21:53:25.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.282+0000 7fca042dc700 20 expand_channel_meta from 'false' to 'false' 2020-11-16T21:53:25.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.282+0000 7fca042dc700 20 expand_channel_meta expanded map: {default=false} 2020-11-16T21:53:25.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.282+0000 7fca042dc700 20 expand_channel_meta expand map: {default=info} 2020-11-16T21:53:25.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.282+0000 7fca042dc700 20 expand_channel_meta from 'info' to 'info' 2020-11-16T21:53:25.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.282+0000 7fca042dc700 20 expand_channel_meta expanded map: {default=info} 2020-11-16T21:53:25.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.282+0000 7fca042dc700 20 expand_channel_meta expand map: {default=daemon} 2020-11-16T21:53:25.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.282+0000 7fca042dc700 20 expand_channel_meta from 'daemon' to 'daemon' 2020-11-16T21:53:25.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.282+0000 7fca042dc700 20 expand_channel_meta expanded map: {default=daemon} 2020-11-16T21:53:25.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.282+0000 7fca042dc700 20 expand_channel_meta expand map: {default=debug} 2020-11-16T21:53:25.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.282+0000 7fca042dc700 20 expand_channel_meta from 'debug' to 'debug' 2020-11-16T21:53:25.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:25 smithi016 bash[10302]: debug 2020-11-16T21:53:25.282+0000 7fca042dc700 20 expand_channel_meta expanded map: {default=debug} 2020-11-16T21:53:30.598 INFO:teuthology.orchestra.run.smithi016.stdout: 2020-11-16T21:53:30.598 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":2,"fsid":"bcd5108e-2855-11eb-a2b2-001a4aab830c","modified":"2020-11-16T21:53:25.291581Z","created":"2020-11-16T21:50:58.760728Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2020-11-16T21:53:30.600 INFO:teuthology.orchestra.run.smithi016.stderr:dumped monmap epoch 2 2020-11-16T21:53:30.678 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:30 smithi016 bash[10302]: audit 2020-11-16T21:53:25.292273+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-11-16T21:53:30.678 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:30 smithi016 bash[10302]: cluster 2020-11-16T21:53:25.297572+0000 mon.a (mon.0) 202 : cluster [INF] mon.a calling monitor election 2020-11-16T21:53:30.678 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:30 smithi016 bash[10302]: audit 2020-11-16T21:53:26.292724+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-11-16T21:53:30.678 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:30 smithi016 bash[10302]: cluster 2020-11-16T21:53:26.322767+0000 mgr.y (mgr.14138) 57 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:30.679 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:30 smithi016 bash[10302]: audit 2020-11-16T21:53:27.292876+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-11-16T21:53:30.679 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:30 smithi016 bash[10302]: cluster 2020-11-16T21:53:27.300963+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2020-11-16T21:53:30.679 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:30 smithi016 bash[10302]: audit 2020-11-16T21:53:28.294525+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-11-16T21:53:30.679 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:30 smithi016 bash[10302]: cluster 2020-11-16T21:53:28.323189+0000 mgr.y (mgr.14138) 58 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:30.679 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:30 smithi016 bash[10302]: audit 2020-11-16T21:53:29.293062+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-11-16T21:53:30.679 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:30 smithi016 bash[10302]: audit 2020-11-16T21:53:30.293267+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-11-16T21:53:30.679 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:30 smithi016 bash[10302]: cluster 2020-11-16T21:53:30.322583+0000 mon.a (mon.0) 208 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2020-11-16T21:53:30.680 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:30 smithi016 bash[10302]: cluster 2020-11-16T21:53:30.328797+0000 mon.a (mon.0) 209 : cluster [DBG] monmap e2: 2 mons at {a=v1:172.21.15.195:6789/0,b=v1:172.21.15.16:6789/0} 2020-11-16T21:53:30.680 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:30 smithi016 bash[10302]: cluster 2020-11-16T21:53:30.328930+0000 mon.a (mon.0) 210 : cluster [DBG] fsmap 2020-11-16T21:53:30.680 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:30 smithi016 bash[10302]: cluster 2020-11-16T21:53:30.328996+0000 mon.a (mon.0) 211 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-11-16T21:53:30.680 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:30 smithi016 bash[10302]: cluster 2020-11-16T21:53:30.329412+0000 mon.a (mon.0) 212 : cluster [DBG] mgrmap e13: y(active, since 102s) 2020-11-16T21:53:30.680 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:30 smithi016 bash[10302]: cluster 2020-11-16T21:53:30.336362+0000 mon.a (mon.0) 213 : cluster [WRN] Health detail: HEALTH_WARN failed to probe daemons or devices 2020-11-16T21:53:30.680 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:30 smithi016 bash[10302]: cluster 2020-11-16T21:53:30.336403+0000 mon.a (mon.0) 214 : cluster [WRN] [WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2020-11-16T21:53:30.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:30 smithi195 bash[10218]: audit 2020-11-16T21:53:25.292273+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-11-16T21:53:30.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:30 smithi195 bash[10218]: cluster 2020-11-16T21:53:25.297572+0000 mon.a (mon.0) 202 : cluster [INF] mon.a calling monitor election 2020-11-16T21:53:30.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:30 smithi195 bash[10218]: audit 2020-11-16T21:53:26.292724+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-11-16T21:53:30.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:30 smithi195 bash[10218]: cluster 2020-11-16T21:53:26.322767+0000 mgr.y (mgr.14138) 57 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:30.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:30 smithi195 bash[10218]: audit 2020-11-16T21:53:27.292876+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-11-16T21:53:30.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:30 smithi195 bash[10218]: cluster 2020-11-16T21:53:27.300963+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2020-11-16T21:53:30.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:30 smithi195 bash[10218]: audit 2020-11-16T21:53:28.294525+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-11-16T21:53:30.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:30 smithi195 bash[10218]: cluster 2020-11-16T21:53:28.323189+0000 mgr.y (mgr.14138) 58 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:30.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:30 smithi195 bash[10218]: audit 2020-11-16T21:53:29.293062+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-11-16T21:53:30.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:30 smithi195 bash[10218]: audit 2020-11-16T21:53:30.293267+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-11-16T21:53:30.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:30 smithi195 bash[10218]: cluster 2020-11-16T21:53:30.322583+0000 mon.a (mon.0) 208 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2020-11-16T21:53:30.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:30 smithi195 bash[10218]: cluster 2020-11-16T21:53:30.328797+0000 mon.a (mon.0) 209 : cluster [DBG] monmap e2: 2 mons at {a=v1:172.21.15.195:6789/0,b=v1:172.21.15.16:6789/0} 2020-11-16T21:53:30.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:30 smithi195 bash[10218]: cluster 2020-11-16T21:53:30.328930+0000 mon.a (mon.0) 210 : cluster [DBG] fsmap 2020-11-16T21:53:30.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:30 smithi195 bash[10218]: cluster 2020-11-16T21:53:30.328996+0000 mon.a (mon.0) 211 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-11-16T21:53:30.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:30 smithi195 bash[10218]: cluster 2020-11-16T21:53:30.329412+0000 mon.a (mon.0) 212 : cluster [DBG] mgrmap e13: y(active, since 102s) 2020-11-16T21:53:30.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:30 smithi195 bash[10218]: cluster 2020-11-16T21:53:30.336362+0000 mon.a (mon.0) 213 : cluster [WRN] Health detail: HEALTH_WARN failed to probe daemons or devices 2020-11-16T21:53:30.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:30 smithi195 bash[10218]: cluster 2020-11-16T21:53:30.336403+0000 mon.a (mon.0) 214 : cluster [WRN] [WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2020-11-16T21:53:31.256 INFO:tasks.cephadm:Adding mon.c on smithi057 2020-11-16T21:53:31.257 INFO:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch daemon add mon 'smithi057:[v1:172.21.15.57:6789]=c' 2020-11-16T21:53:31.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:31 smithi016 bash[10302]: cluster 2020-11-16T21:53:30.323578+0000 mgr.y (mgr.14138) 59 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:31.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:31 smithi016 bash[10302]: cluster 2020-11-16T21:53:30.381111+0000 mon.a (mon.0) 215 : cluster [INF] Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2020-11-16T21:53:31.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:31 smithi016 bash[10302]: cluster 2020-11-16T21:53:30.381181+0000 mon.a (mon.0) 216 : cluster [INF] Cluster is now healthy 2020-11-16T21:53:31.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:31 smithi016 bash[10302]: audit 2020-11-16T21:53:30.612355+0000 mon.a (mon.0) 217 : audit [DBG] from='client.? v1:172.21.15.16:0/2227243097' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2020-11-16T21:53:31.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:31 smithi016 bash[10302]: audit 2020-11-16T21:53:31.293516+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-11-16T21:53:31.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:31 smithi195 bash[10218]: cluster 2020-11-16T21:53:30.323578+0000 mgr.y (mgr.14138) 59 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:31.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:31 smithi195 bash[10218]: cluster 2020-11-16T21:53:30.381111+0000 mon.a (mon.0) 215 : cluster [INF] Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2020-11-16T21:53:31.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:31 smithi195 bash[10218]: cluster 2020-11-16T21:53:30.381181+0000 mon.a (mon.0) 216 : cluster [INF] Cluster is now healthy 2020-11-16T21:53:31.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:31 smithi195 bash[10218]: audit 2020-11-16T21:53:30.612355+0000 mon.a (mon.0) 217 : audit [DBG] from='client.? v1:172.21.15.16:0/2227243097' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2020-11-16T21:53:31.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:31 smithi195 bash[10218]: audit 2020-11-16T21:53:31.293516+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2020-11-16T21:53:33.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:33 smithi016 bash[10302]: cluster 2020-11-16T21:53:32.324088+0000 mgr.y (mgr.14138) 60 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:33.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:33 smithi195 bash[10218]: cluster 2020-11-16T21:53:32.324088+0000 mgr.y (mgr.14138) 60 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:34.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:34 smithi016 bash[10302]: audit 2020-11-16T21:53:34.314892+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-11-16T21:53:34.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:34 smithi016 bash[10302]: audit 2020-11-16T21:53:34.316703+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:34.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:34 smithi016 bash[10302]: audit 2020-11-16T21:53:34.318826+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2020-11-16T21:53:34.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:34 smithi195 bash[10218]: audit 2020-11-16T21:53:34.314892+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-11-16T21:53:34.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:34 smithi195 bash[10218]: audit 2020-11-16T21:53:34.316703+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:34.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:34 smithi195 bash[10218]: audit 2020-11-16T21:53:34.318826+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2020-11-16T21:53:35.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:35 smithi016 bash[10302]: audit 2020-11-16T21:53:34.312466+0000 mgr.y (mgr.14138) 61 : audit [DBG] from='client.14174 v1:172.21.15.57:0/3641837730' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi057:[v1:172.21.15.57:6789]=c", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:53:35.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:35 smithi016 bash[10302]: cephadm 2020-11-16T21:53:34.318128+0000 mgr.y (mgr.14138) 62 : cephadm [INF] Deploying daemon mon.c on smithi057 2020-11-16T21:53:35.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:35 smithi016 bash[10302]: cluster 2020-11-16T21:53:34.324589+0000 mgr.y (mgr.14138) 63 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:35.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:35 smithi195 bash[10218]: audit 2020-11-16T21:53:34.312466+0000 mgr.y (mgr.14138) 61 : audit [DBG] from='client.14174 v1:172.21.15.57:0/3641837730' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi057:[v1:172.21.15.57:6789]=c", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:53:35.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:35 smithi195 bash[10218]: cephadm 2020-11-16T21:53:34.318128+0000 mgr.y (mgr.14138) 62 : cephadm [INF] Deploying daemon mon.c on smithi057 2020-11-16T21:53:35.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:35 smithi195 bash[10218]: cluster 2020-11-16T21:53:34.324589+0000 mgr.y (mgr.14138) 63 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:37.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:37 smithi016 bash[10302]: cluster 2020-11-16T21:53:36.325118+0000 mgr.y (mgr.14138) 64 : cluster [DBG] pgmap v51: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:37.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:37 smithi195 bash[10218]: cluster 2020-11-16T21:53:36.325118+0000 mgr.y (mgr.14138) 64 : cluster [DBG] pgmap v51: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:38.578 INFO:teuthology.orchestra.run.smithi057.stdout:Deployed mon.c on host 'smithi057' 2020-11-16T21:53:39.731 INFO:teuthology.orchestra.run.smithi057:mon.c> sudo journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mon.c.service 2020-11-16T21:53:39.734 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2020-11-16T21:53:39.734 INFO:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph mon dump -f json 2020-11-16T21:53:39.810 INFO:journalctl@ceph.mon.c.smithi057.stdout:-- Logs begin at Sun 2020-11-15 12:21:41 UTC. -- 2020-11-16T21:53:39.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:39 smithi016 bash[10302]: cluster 2020-11-16T21:53:38.325567+0000 mgr.y (mgr.14138) 65 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:39.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:39 smithi016 bash[10302]: audit 2020-11-16T21:53:38.582024+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:34.316216\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:53:39.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:39 smithi016 bash[10302]: audit 2020-11-16T21:53:38.583032+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:39.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:39 smithi016 bash[10302]: audit 2020-11-16T21:53:38.587707+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:34.316216\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:53:39.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:39 smithi016 bash[10302]: audit 2020-11-16T21:53:39.256869+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:39.255650\", \"created\": \"2020-11-16T21:53:38.542344\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:34.316216\"}}, \"last_daemon_update\": \"2020-11-16T21:53:39.255905\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:53:39.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:39 smithi016 bash[10302]: audit 2020-11-16T21:53:39.262372+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:39.255650\", \"created\": \"2020-11-16T21:53:38.542344\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:34.316216\"}}, \"last_daemon_update\": \"2020-11-16T21:53:39.255905\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:53:39.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:39 smithi016 bash[10302]: audit 2020-11-16T21:53:39.264053+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:53:39.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:39 smithi016 bash[10302]: audit 2020-11-16T21:53:39.269223+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:53:39.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:39 smithi016 bash[10302]: audit 2020-11-16T21:53:39.270437+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-11-16T21:53:39.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:39 smithi016 bash[10302]: audit 2020-11-16T21:53:39.271934+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:39.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:39 smithi016 bash[10302]: audit 2020-11-16T21:53:39.273978+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-11-16T21:53:39.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:39 smithi195 bash[10218]: cluster 2020-11-16T21:53:38.325567+0000 mgr.y (mgr.14138) 65 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:39.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:39 smithi195 bash[10218]: audit 2020-11-16T21:53:38.582024+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:34.316216\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:53:39.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:39 smithi195 bash[10218]: audit 2020-11-16T21:53:38.583032+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:39.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:39 smithi195 bash[10218]: audit 2020-11-16T21:53:38.587707+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:34.316216\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:53:39.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:39 smithi195 bash[10218]: audit 2020-11-16T21:53:39.256869+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:39.255650\", \"created\": \"2020-11-16T21:53:38.542344\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:34.316216\"}}, \"last_daemon_update\": \"2020-11-16T21:53:39.255905\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:53:39.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:39 smithi195 bash[10218]: audit 2020-11-16T21:53:39.262372+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:39.255650\", \"created\": \"2020-11-16T21:53:38.542344\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:34.316216\"}}, \"last_daemon_update\": \"2020-11-16T21:53:39.255905\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:53:39.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:39 smithi195 bash[10218]: audit 2020-11-16T21:53:39.264053+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:53:39.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:39 smithi195 bash[10218]: audit 2020-11-16T21:53:39.269223+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:53:39.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:39 smithi195 bash[10218]: audit 2020-11-16T21:53:39.270437+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-11-16T21:53:39.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:39 smithi195 bash[10218]: audit 2020-11-16T21:53:39.271934+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:39.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:39 smithi195 bash[10218]: audit 2020-11-16T21:53:39.273978+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-11-16T21:53:40.449 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.082+0000 7fe43cd1c700 0 set uid:gid to 167:167 (ceph:ceph) 2020-11-16T21:53:40.449 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.082+0000 7fe43cd1c700 0 ceph version 16.0.0-7219-g911cc357 (911cc35794d871071a8bebfb0919482263b1d18b) pacific (dev), process ceph-mon, pid 1 2020-11-16T21:53:40.449 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.082+0000 7fe43cd1c700 0 pidfile_write: ignore empty --pid-file 2020-11-16T21:53:40.449 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 0 load: jerasure load: lrc load: isa 2020-11-16T21:53:40.450 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: RocksDB version: 6.8.1 2020-11-16T21:53:40.450 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2020-11-16T21:53:40.450 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Compile date Nov 16 2020 2020-11-16T21:53:40.450 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: DB SUMMARY 2020-11-16T21:53:40.450 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: CURRENT file: CURRENT 2020-11-16T21:53:40.450 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: IDENTITY file: IDENTITY 2020-11-16T21:53:40.451 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2020-11-16T21:53:40.451 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2020-11-16T21:53:40.451 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 566 ; 2020-11-16T21:53:40.451 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.error_if_exists: 0 2020-11-16T21:53:40.451 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.create_if_missing: 0 2020-11-16T21:53:40.451 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.paranoid_checks: 1 2020-11-16T21:53:40.451 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.env: 0x55c0610ea100 2020-11-16T21:53:40.452 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.fs: Posix File System 2020-11-16T21:53:40.452 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.info_log: 0x55c0630a8aa0 2020-11-16T21:53:40.452 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_file_opening_threads: 16 2020-11-16T21:53:40.452 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.statistics: (nil) 2020-11-16T21:53:40.452 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.use_fsync: 0 2020-11-16T21:53:40.452 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_log_file_size: 0 2020-11-16T21:53:40.452 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2020-11-16T21:53:40.453 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.log_file_time_to_roll: 0 2020-11-16T21:53:40.453 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.keep_log_file_num: 1000 2020-11-16T21:53:40.453 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.recycle_log_file_num: 0 2020-11-16T21:53:40.453 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.allow_fallocate: 1 2020-11-16T21:53:40.453 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.allow_mmap_reads: 0 2020-11-16T21:53:40.453 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.allow_mmap_writes: 0 2020-11-16T21:53:40.453 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.use_direct_reads: 0 2020-11-16T21:53:40.454 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2020-11-16T21:53:40.454 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.create_missing_column_families: 0 2020-11-16T21:53:40.454 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.db_log_dir: 2020-11-16T21:53:40.454 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2020-11-16T21:53:40.454 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.table_cache_numshardbits: 6 2020-11-16T21:53:40.454 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_subcompactions: 1 2020-11-16T21:53:40.454 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_background_flushes: -1 2020-11-16T21:53:40.455 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.WAL_ttl_seconds: 0 2020-11-16T21:53:40.455 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.WAL_size_limit_MB: 0 2020-11-16T21:53:40.455 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2020-11-16T21:53:40.455 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2020-11-16T21:53:40.455 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.is_fd_close_on_exec: 1 2020-11-16T21:53:40.455 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.advise_random_on_open: 1 2020-11-16T21:53:40.455 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.db_write_buffer_size: 0 2020-11-16T21:53:40.455 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.write_buffer_manager: 0x55c0630f59b0 2020-11-16T21:53:40.456 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2020-11-16T21:53:40.456 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2020-11-16T21:53:40.456 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2020-11-16T21:53:40.456 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.use_adaptive_mutex: 0 2020-11-16T21:53:40.456 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.rate_limiter: (nil) 2020-11-16T21:53:40.456 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2020-11-16T21:53:40.456 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.wal_recovery_mode: 2 2020-11-16T21:53:40.457 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.enable_thread_tracking: 0 2020-11-16T21:53:40.457 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.enable_pipelined_write: 0 2020-11-16T21:53:40.457 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.unordered_write: 0 2020-11-16T21:53:40.457 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2020-11-16T21:53:40.457 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2020-11-16T21:53:40.457 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2020-11-16T21:53:40.457 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2020-11-16T21:53:40.458 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.row_cache: None 2020-11-16T21:53:40.458 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.wal_filter: None 2020-11-16T21:53:40.458 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2020-11-16T21:53:40.458 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.allow_ingest_behind: 0 2020-11-16T21:53:40.458 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.preserve_deletes: 0 2020-11-16T21:53:40.458 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.two_write_queues: 0 2020-11-16T21:53:40.458 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.manual_wal_flush: 0 2020-11-16T21:53:40.459 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.atomic_flush: 0 2020-11-16T21:53:40.459 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2020-11-16T21:53:40.459 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.persist_stats_to_disk: 0 2020-11-16T21:53:40.459 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.write_dbid_to_manifest: 0 2020-11-16T21:53:40.459 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.log_readahead_size: 0 2020-11-16T21:53:40.460 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2020-11-16T21:53:40.460 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_background_jobs: 2 2020-11-16T21:53:40.460 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_background_compactions: -1 2020-11-16T21:53:40.460 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2020-11-16T21:53:40.460 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2020-11-16T21:53:40.460 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.delayed_write_rate : 16777216 2020-11-16T21:53:40.460 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_total_wal_size: 0 2020-11-16T21:53:40.460 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2020-11-16T21:53:40.461 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.stats_dump_period_sec: 600 2020-11-16T21:53:40.461 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.stats_persist_period_sec: 600 2020-11-16T21:53:40.462 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2020-11-16T21:53:40.463 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_open_files: -1 2020-11-16T21:53:40.463 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.bytes_per_sync: 0 2020-11-16T21:53:40.463 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.wal_bytes_per_sync: 0 2020-11-16T21:53:40.463 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.strict_bytes_per_sync: 0 2020-11-16T21:53:40.463 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compaction_readahead_size: 0 2020-11-16T21:53:40.463 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Compression algorithms supported: 2020-11-16T21:53:40.463 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2020-11-16T21:53:40.464 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: kZSTD supported: 0 2020-11-16T21:53:40.464 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: kXpressCompression supported: 0 2020-11-16T21:53:40.464 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: kLZ4HCCompression supported: 1 2020-11-16T21:53:40.464 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: kLZ4Compression supported: 1 2020-11-16T21:53:40.464 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: kBZip2Compression supported: 0 2020-11-16T21:53:40.464 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: kZlibCompression supported: 1 2020-11-16T21:53:40.464 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: kSnappyCompression supported: 1 2020-11-16T21:53:40.465 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Fast CRC32 supported: Supported on x86 2020-11-16T21:53:40.465 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2020-11-16T21:53:40.465 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2020-11-16T21:53:40.465 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2020-11-16T21:53:40.465 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.merge_operator: 2020-11-16T21:53:40.465 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compaction_filter: None 2020-11-16T21:53:40.465 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compaction_filter_factory: None 2020-11-16T21:53:40.466 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.memtable_factory: SkipListFactory 2020-11-16T21:53:40.466 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.table_factory: BlockBasedTable 2020-11-16T21:53:40.466 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c06304dbb8) 2020-11-16T21:53:40.466 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: cache_index_and_filter_blocks: 1 2020-11-16T21:53:40.466 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: cache_index_and_filter_blocks_with_high_priority: 1 2020-11-16T21:53:40.466 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: pin_l0_filter_and_index_blocks_in_cache: 0 2020-11-16T21:53:40.466 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: pin_top_level_index_and_filter: 1 2020-11-16T21:53:40.467 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: index_type: 0 2020-11-16T21:53:40.467 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: data_block_index_type: 0 2020-11-16T21:53:40.467 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: index_shortening: 1 2020-11-16T21:53:40.467 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: data_block_hash_table_util_ratio: 0.750000 2020-11-16T21:53:40.467 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: hash_index_allow_collision: 1 2020-11-16T21:53:40.467 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: checksum: 1 2020-11-16T21:53:40.467 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: no_block_cache: 0 2020-11-16T21:53:40.468 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: block_cache: 0x55c063084610 2020-11-16T21:53:40.468 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: block_cache_name: BinnedLRUCache 2020-11-16T21:53:40.468 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: block_cache_options: 2020-11-16T21:53:40.468 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: capacity : 536870912 2020-11-16T21:53:40.468 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: num_shard_bits : 4 2020-11-16T21:53:40.468 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: strict_capacity_limit : 0 2020-11-16T21:53:40.468 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: high_pri_pool_ratio: 0.000 2020-11-16T21:53:40.469 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: block_cache_compressed: (nil) 2020-11-16T21:53:40.469 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: persistent_cache: (nil) 2020-11-16T21:53:40.469 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: block_size: 4096 2020-11-16T21:53:40.469 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: block_size_deviation: 10 2020-11-16T21:53:40.469 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: block_restart_interval: 16 2020-11-16T21:53:40.469 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: index_block_restart_interval: 1 2020-11-16T21:53:40.469 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: metadata_block_size: 4096 2020-11-16T21:53:40.469 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: partition_filters: 0 2020-11-16T21:53:40.470 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: use_delta_encoding: 1 2020-11-16T21:53:40.470 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: filter_policy: rocksdb.BuiltinBloomFilter 2020-11-16T21:53:40.470 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: whole_key_filtering: 1 2020-11-16T21:53:40.470 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: verify_compression: 0 2020-11-16T21:53:40.470 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: read_amp_bytes_per_bit: 0 2020-11-16T21:53:40.470 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: format_version: 2 2020-11-16T21:53:40.471 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: enable_index_compression: 1 2020-11-16T21:53:40.471 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: block_align: 0 2020-11-16T21:53:40.471 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.write_buffer_size: 33554432 2020-11-16T21:53:40.471 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_write_buffer_number: 2 2020-11-16T21:53:40.471 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compression: NoCompression 2020-11-16T21:53:40.471 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.bottommost_compression: Disabled 2020-11-16T21:53:40.471 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.prefix_extractor: nullptr 2020-11-16T21:53:40.471 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2020-11-16T21:53:40.472 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.num_levels: 7 2020-11-16T21:53:40.472 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2020-11-16T21:53:40.472 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2020-11-16T21:53:40.472 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2020-11-16T21:53:40.472 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2020-11-16T21:53:40.472 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2020-11-16T21:53:40.472 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2020-11-16T21:53:40.473 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2020-11-16T21:53:40.473 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2020-11-16T21:53:40.473 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2020-11-16T21:53:40.473 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compression_opts.window_bits: -14 2020-11-16T21:53:40.473 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compression_opts.level: 32767 2020-11-16T21:53:40.473 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compression_opts.strategy: 0 2020-11-16T21:53:40.473 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2020-11-16T21:53:40.474 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2020-11-16T21:53:40.474 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compression_opts.enabled: false 2020-11-16T21:53:40.474 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2020-11-16T21:53:40.474 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2020-11-16T21:53:40.474 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2020-11-16T21:53:40.474 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.target_file_size_base: 67108864 2020-11-16T21:53:40.474 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.target_file_size_multiplier: 1 2020-11-16T21:53:40.475 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2020-11-16T21:53:40.475 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2020-11-16T21:53:40.475 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2020-11-16T21:53:40.475 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2020-11-16T21:53:40.475 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2020-11-16T21:53:40.475 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2020-11-16T21:53:40.475 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2020-11-16T21:53:40.476 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2020-11-16T21:53:40.476 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2020-11-16T21:53:40.476 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2020-11-16T21:53:40.476 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2020-11-16T21:53:40.476 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2020-11-16T21:53:40.476 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.arena_block_size: 4194304 2020-11-16T21:53:40.476 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2020-11-16T21:53:40.477 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2020-11-16T21:53:40.477 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2020-11-16T21:53:40.477 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.disable_auto_compactions: 0 2020-11-16T21:53:40.477 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2020-11-16T21:53:40.477 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2020-11-16T21:53:40.477 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2020-11-16T21:53:40.477 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2020-11-16T21:53:40.478 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2020-11-16T21:53:40.478 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2020-11-16T21:53:40.478 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2020-11-16T21:53:40.478 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2020-11-16T21:53:40.478 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2020-11-16T21:53:40.478 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2020-11-16T21:53:40.478 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.table_properties_collectors: 2020-11-16T21:53:40.479 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.inplace_update_support: 0 2020-11-16T21:53:40.479 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.inplace_update_num_locks: 10000 2020-11-16T21:53:40.479 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2020-11-16T21:53:40.479 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2020-11-16T21:53:40.479 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.memtable_huge_page_size: 0 2020-11-16T21:53:40.479 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.bloom_locality: 0 2020-11-16T21:53:40.479 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.max_successive_merges: 0 2020-11-16T21:53:40.479 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.optimize_filters_for_hits: 0 2020-11-16T21:53:40.480 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.paranoid_file_checks: 0 2020-11-16T21:53:40.480 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.force_consistency_checks: 0 2020-11-16T21:53:40.480 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.report_bg_io_stats: 0 2020-11-16T21:53:40.480 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.ttl: 2592000 2020-11-16T21:53:40.480 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: Options.periodic_compaction_seconds: 0 2020-11-16T21:53:40.480 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2020-11-16T21:53:40.481 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2020-11-16T21:53:40.481 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1605563620094029, "job": 1, "event": "recovery_started", "log_files": [3]} 2020-11-16T21:53:40.481 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.086+0000 7fe43cd1c700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2020-11-16T21:53:40.481 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.090+0000 7fe43cd1c700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2020-11-16T21:53:40.481 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.090+0000 7fe43cd1c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1605563620095256, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1492, "table_properties": {"data_size": 578, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 456, "raw_average_value_size": 91, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1605563620, "oldest_key_time": 3, "file_creation_time": 0}} 2020-11-16T21:53:40.481 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.090+0000 7fe43cd1c700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2020-11-16T21:53:40.481 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.090+0000 7fe43cd1c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1605563620096154, "job": 1, "event": "recovery_finished"} 2020-11-16T21:53:40.482 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.094+0000 7fe43cd1c700 4 rocksdb: DB pointer 0x55c0630d5800 2020-11-16T21:53:40.482 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.094+0000 7fe423b5e700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2020-11-16T21:53:40.482 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.094+0000 7fe423b5e700 4 rocksdb: [db_impl/db_impl.cc:851] 2020-11-16T21:53:40.482 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: ** DB Stats ** 2020-11-16T21:53:40.482 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Uptime(secs): 0.0 total, 0.0 interval 2020-11-16T21:53:40.482 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2020-11-16T21:53:40.482 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2020-11-16T21:53:40.483 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2020-11-16T21:53:40.483 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2020-11-16T21:53:40.483 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2020-11-16T21:53:40.483 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2020-11-16T21:53:40.483 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: ** Compaction Stats [default] ** 2020-11-16T21:53:40.483 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-11-16T21:53:40.483 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-11-16T21:53:40.484 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: L0 1/0 1.46 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.3 0.00 0.00 1 0.001 0 0 2020-11-16T21:53:40.484 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Sum 1/0 1.46 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.3 0.00 0.00 1 0.001 0 0 2020-11-16T21:53:40.484 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.3 0.00 0.00 1 0.001 0 0 2020-11-16T21:53:40.484 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: ** Compaction Stats [default] ** 2020-11-16T21:53:40.484 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-11-16T21:53:40.484 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-11-16T21:53:40.484 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.3 0.00 0.00 1 0.001 0 0 2020-11-16T21:53:40.485 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Uptime(secs): 0.0 total, 0.0 interval 2020-11-16T21:53:40.485 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Flush(GB): cumulative 0.000, interval 0.000 2020-11-16T21:53:40.485 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: AddFile(GB): cumulative 0.000, interval 0.000 2020-11-16T21:53:40.485 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: AddFile(Total Files): cumulative 0, interval 0 2020-11-16T21:53:40.485 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: AddFile(L0 Files): cumulative 0, interval 0 2020-11-16T21:53:40.485 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: AddFile(Keys): cumulative 0, interval 0 2020-11-16T21:53:40.485 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Cumulative compaction: 0.00 GB write, 0.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-11-16T21:53:40.485 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Interval compaction: 0.00 GB write, 0.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-11-16T21:53:40.486 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-11-16T21:53:40.486 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: ** File Read Latency Histogram By Level [default] ** 2020-11-16T21:53:40.486 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: ** Compaction Stats [default] ** 2020-11-16T21:53:40.486 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-11-16T21:53:40.486 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-11-16T21:53:40.486 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: L0 1/0 1.46 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.3 0.00 0.00 1 0.001 0 0 2020-11-16T21:53:40.486 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Sum 1/0 1.46 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.3 0.00 0.00 1 0.001 0 0 2020-11-16T21:53:40.487 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2020-11-16T21:53:40.487 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: ** Compaction Stats [default] ** 2020-11-16T21:53:40.487 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2020-11-16T21:53:40.487 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2020-11-16T21:53:40.487 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.3 0.00 0.00 1 0.001 0 0 2020-11-16T21:53:40.487 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Uptime(secs): 0.0 total, 0.0 interval 2020-11-16T21:53:40.488 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Flush(GB): cumulative 0.000, interval 0.000 2020-11-16T21:53:40.488 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: AddFile(GB): cumulative 0.000, interval 0.000 2020-11-16T21:53:40.488 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: AddFile(Total Files): cumulative 0, interval 0 2020-11-16T21:53:40.488 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: AddFile(L0 Files): cumulative 0, interval 0 2020-11-16T21:53:40.488 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: AddFile(Keys): cumulative 0, interval 0 2020-11-16T21:53:40.488 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Cumulative compaction: 0.00 GB write, 0.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-11-16T21:53:40.488 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2020-11-16T21:53:40.489 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2020-11-16T21:53:40.489 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: ** File Read Latency Histogram By Level [default] ** 2020-11-16T21:53:40.489 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.094+0000 7fe43cd1c700 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2020-11-16T21:53:40.489 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.094+0000 7fe43cd1c700 0 using public_addrv v1:172.21.15.57:6789/0 2020-11-16T21:53:40.489 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.098+0000 7fe43cd1c700 0 starting mon.c rank -1 at public addrs v1:172.21.15.57:6789/0 at bind addrs v1:172.21.15.57:6789/0 mon_data /var/lib/ceph/mon/ceph-c fsid bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:53:40.489 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.098+0000 7fe43cd1c700 1 mon.c@-1(???) e0 preinit fsid bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:53:40.489 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.158+0000 7fe426363700 0 mon.c@-1(synchronizing).mds e1 new map 2020-11-16T21:53:40.490 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.158+0000 7fe426363700 0 mon.c@-1(synchronizing).mds e1 print_map 2020-11-16T21:53:40.490 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: e1 2020-11-16T21:53:40.490 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: enable_multiple, ever_enabled_multiple: 0,0 2020-11-16T21:53:40.490 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2020-11-16T21:53:40.490 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: legacy client fscid: -1 2020-11-16T21:53:40.490 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: 2020-11-16T21:53:40.490 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: No filesystems configured 2020-11-16T21:53:40.491 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.158+0000 7fe426363700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2020-11-16T21:53:40.491 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.158+0000 7fe426363700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2020-11-16T21:53:40.491 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.158+0000 7fe426363700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2020-11-16T21:53:40.491 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.158+0000 7fe426363700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2020-11-16T21:53:40.491 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.158+0000 7fe426363700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2020-11-16T21:53:40.491 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.158+0000 7fe426363700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2020-11-16T21:53:40.491 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.158+0000 7fe426363700 1 mon.c@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2020-11-16T21:53:40.492 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.158+0000 7fe426363700 1 mon.c@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2020-11-16T21:53:40.492 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.158+0000 7fe426363700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2020-11-16T21:53:40.492 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.158+0000 7fe426363700 0 mon.c@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2020-11-16T21:53:40.492 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.158+0000 7fe426363700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2020-11-16T21:53:40.492 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: cluster 2020-11-16T21:53:38.325567+0000 mgr.y (mgr.14138) 65 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:40.492 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: audit 2020-11-16T21:53:38.582024+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:34.316216\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:53:40.492 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: audit 2020-11-16T21:53:38.583032+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:40.493 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: audit 2020-11-16T21:53:38.587707+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:34.316216\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:53:40.493 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: audit 2020-11-16T21:53:39.256869+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:39.255650\", \"created\": \"2020-11-16T21:53:38.542344\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:34.316216\"}}, \"last_daemon_update\": \"2020-11-16T21:53:39.255905\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:53:40.493 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: audit 2020-11-16T21:53:39.262372+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:39.255650\", \"created\": \"2020-11-16T21:53:38.542344\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:34.316216\"}}, \"last_daemon_update\": \"2020-11-16T21:53:39.255905\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:53:40.493 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: audit 2020-11-16T21:53:39.264053+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:53:40.493 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: audit 2020-11-16T21:53:39.269223+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:53:40.493 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: audit 2020-11-16T21:53:39.270437+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-11-16T21:53:40.494 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: audit 2020-11-16T21:53:39.271934+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:40.494 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: audit 2020-11-16T21:53:39.273978+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-11-16T21:53:40.494 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.162+0000 7fe426363700 1 mon.c@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2020-11-16T21:53:40.494 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.162+0000 7fe426363700 10 mon.c@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2020-11-16T21:53:40.494 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.162+0000 7fe426363700 20 expand_channel_meta expand map: {default=false} 2020-11-16T21:53:40.495 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.162+0000 7fe426363700 20 expand_channel_meta from 'false' to 'false' 2020-11-16T21:53:40.495 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.162+0000 7fe426363700 20 expand_channel_meta expanded map: {default=false} 2020-11-16T21:53:40.495 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.162+0000 7fe426363700 20 expand_channel_meta expand map: {default=info} 2020-11-16T21:53:40.495 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.162+0000 7fe426363700 20 expand_channel_meta from 'info' to 'info' 2020-11-16T21:53:40.495 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.162+0000 7fe426363700 20 expand_channel_meta expanded map: {default=info} 2020-11-16T21:53:40.495 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.162+0000 7fe426363700 20 expand_channel_meta expand map: {default=daemon} 2020-11-16T21:53:40.495 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.162+0000 7fe426363700 20 expand_channel_meta from 'daemon' to 'daemon' 2020-11-16T21:53:40.496 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.162+0000 7fe426363700 20 expand_channel_meta expanded map: {default=daemon} 2020-11-16T21:53:40.496 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.162+0000 7fe426363700 20 expand_channel_meta expand map: {default=debug} 2020-11-16T21:53:40.496 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.162+0000 7fe426363700 20 expand_channel_meta from 'debug' to 'debug' 2020-11-16T21:53:40.496 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:40 smithi057 bash[10301]: debug 2020-11-16T21:53:40.162+0000 7fe426363700 20 expand_channel_meta expanded map: {default=debug} 2020-11-16T21:53:45.521 INFO:teuthology.orchestra.run.smithi057.stdout: 2020-11-16T21:53:45.522 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":3,"fsid":"bcd5108e-2855-11eb-a2b2-001a4aab830c","modified":"2020-11-16T21:53:40.176460Z","created":"2020-11-16T21:50:58.760728Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2020-11-16T21:53:45.524 INFO:teuthology.orchestra.run.smithi057.stderr:dumped monmap epoch 3 2020-11-16T21:53:45.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: audit 2020-11-16T21:53:40.177983+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: cluster 2020-11-16T21:53:40.182844+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2020-11-16T21:53:45.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: cluster 2020-11-16T21:53:40.183120+0000 mon.a (mon.0) 233 : cluster [INF] mon.a calling monitor election 2020-11-16T21:53:45.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: cluster 2020-11-16T21:53:40.326017+0000 mgr.y (mgr.14138) 68 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:45.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: audit 2020-11-16T21:53:41.178397+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: audit 2020-11-16T21:53:41.233004+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:52:32.811868\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:08.041974\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:45.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: audit 2020-11-16T21:53:42.182205+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: cluster 2020-11-16T21:53:42.182754+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2020-11-16T21:53:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: cluster 2020-11-16T21:53:42.326471+0000 mgr.y (mgr.14138) 69 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: audit 2020-11-16T21:53:43.178659+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: audit 2020-11-16T21:53:44.178762+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: cluster 2020-11-16T21:53:44.326993+0000 mgr.y (mgr.14138) 70 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: audit 2020-11-16T21:53:45.178889+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: cluster 2020-11-16T21:53:45.224434+0000 mon.a (mon.0) 240 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2020-11-16T21:53:45.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: cluster 2020-11-16T21:53:45.239640+0000 mon.a (mon.0) 241 : cluster [DBG] monmap e3: 3 mons at {a=v1:172.21.15.195:6789/0,b=v1:172.21.15.16:6789/0,c=v1:172.21.15.57:6789/0} 2020-11-16T21:53:45.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: cluster 2020-11-16T21:53:45.239753+0000 mon.a (mon.0) 242 : cluster [DBG] fsmap 2020-11-16T21:53:45.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: cluster 2020-11-16T21:53:45.239806+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-11-16T21:53:45.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: cluster 2020-11-16T21:53:45.240160+0000 mon.a (mon.0) 244 : cluster [DBG] mgrmap e13: y(active, since 117s) 2020-11-16T21:53:45.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: audit 2020-11-16T21:53:45.242053+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:52:32.811868\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:08.041974\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:45.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: cluster 2020-11-16T21:53:45.254878+0000 mon.a (mon.0) 246 : cluster [INF] overall HEALTH_OK 2020-11-16T21:53:45.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: audit 2020-11-16T21:53:45.276226+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:52:32.811868\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:08.041974\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:53:45.589 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: audit 2020-11-16T21:53:45.277590+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2020-11-16T21:53:45.589 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: audit 2020-11-16T21:53:45.278926+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:45.589 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:45 smithi016 bash[10302]: audit 2020-11-16T21:53:45.280984+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-11-16T21:53:45.594 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: audit 2020-11-16T21:53:40.177983+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.594 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: cluster 2020-11-16T21:53:40.182844+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2020-11-16T21:53:45.595 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: cluster 2020-11-16T21:53:40.183120+0000 mon.a (mon.0) 233 : cluster [INF] mon.a calling monitor election 2020-11-16T21:53:45.595 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: cluster 2020-11-16T21:53:40.326017+0000 mgr.y (mgr.14138) 68 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:45.595 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: audit 2020-11-16T21:53:41.178397+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.595 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: audit 2020-11-16T21:53:41.233004+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:52:32.811868\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:08.041974\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:45.595 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: audit 2020-11-16T21:53:42.182205+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.596 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: cluster 2020-11-16T21:53:42.182754+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2020-11-16T21:53:45.596 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: cluster 2020-11-16T21:53:42.326471+0000 mgr.y (mgr.14138) 69 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:45.596 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: audit 2020-11-16T21:53:43.178659+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.596 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: audit 2020-11-16T21:53:44.178762+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.596 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: cluster 2020-11-16T21:53:44.326993+0000 mgr.y (mgr.14138) 70 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:45.597 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: audit 2020-11-16T21:53:45.178889+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.597 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: cluster 2020-11-16T21:53:45.224434+0000 mon.a (mon.0) 240 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2020-11-16T21:53:45.597 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: cluster 2020-11-16T21:53:45.239640+0000 mon.a (mon.0) 241 : cluster [DBG] monmap e3: 3 mons at {a=v1:172.21.15.195:6789/0,b=v1:172.21.15.16:6789/0,c=v1:172.21.15.57:6789/0} 2020-11-16T21:53:45.597 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: cluster 2020-11-16T21:53:45.239753+0000 mon.a (mon.0) 242 : cluster [DBG] fsmap 2020-11-16T21:53:45.597 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: cluster 2020-11-16T21:53:45.239806+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-11-16T21:53:45.597 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: cluster 2020-11-16T21:53:45.240160+0000 mon.a (mon.0) 244 : cluster [DBG] mgrmap e13: y(active, since 117s) 2020-11-16T21:53:45.598 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: audit 2020-11-16T21:53:45.242053+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:52:32.811868\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:08.041974\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:45.598 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: cluster 2020-11-16T21:53:45.254878+0000 mon.a (mon.0) 246 : cluster [INF] overall HEALTH_OK 2020-11-16T21:53:45.598 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: audit 2020-11-16T21:53:45.276226+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:52:32.811868\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:08.041974\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:53:45.598 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: audit 2020-11-16T21:53:45.277590+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2020-11-16T21:53:45.599 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: audit 2020-11-16T21:53:45.278926+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:45.599 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:45 smithi057 bash[10301]: audit 2020-11-16T21:53:45.280984+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-11-16T21:53:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: audit 2020-11-16T21:53:40.177983+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: cluster 2020-11-16T21:53:40.182844+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2020-11-16T21:53:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: cluster 2020-11-16T21:53:40.183120+0000 mon.a (mon.0) 233 : cluster [INF] mon.a calling monitor election 2020-11-16T21:53:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: cluster 2020-11-16T21:53:40.326017+0000 mgr.y (mgr.14138) 68 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: audit 2020-11-16T21:53:41.178397+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: audit 2020-11-16T21:53:41.233004+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:52:32.811868\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:08.041974\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:45.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: audit 2020-11-16T21:53:42.182205+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: cluster 2020-11-16T21:53:42.182754+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2020-11-16T21:53:45.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: cluster 2020-11-16T21:53:42.326471+0000 mgr.y (mgr.14138) 69 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:45.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: audit 2020-11-16T21:53:43.178659+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: audit 2020-11-16T21:53:44.178762+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: cluster 2020-11-16T21:53:44.326993+0000 mgr.y (mgr.14138) 70 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:45.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: audit 2020-11-16T21:53:45.178889+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:45.602 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: cluster 2020-11-16T21:53:45.224434+0000 mon.a (mon.0) 240 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2020-11-16T21:53:45.602 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: cluster 2020-11-16T21:53:45.239640+0000 mon.a (mon.0) 241 : cluster [DBG] monmap e3: 3 mons at {a=v1:172.21.15.195:6789/0,b=v1:172.21.15.16:6789/0,c=v1:172.21.15.57:6789/0} 2020-11-16T21:53:45.602 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: cluster 2020-11-16T21:53:45.239753+0000 mon.a (mon.0) 242 : cluster [DBG] fsmap 2020-11-16T21:53:45.602 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: cluster 2020-11-16T21:53:45.239806+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2020-11-16T21:53:45.602 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: cluster 2020-11-16T21:53:45.240160+0000 mon.a (mon.0) 244 : cluster [DBG] mgrmap e13: y(active, since 117s) 2020-11-16T21:53:45.602 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: audit 2020-11-16T21:53:45.242053+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:52:32.811868\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:08.041974\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:45.602 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: cluster 2020-11-16T21:53:45.254878+0000 mon.a (mon.0) 246 : cluster [INF] overall HEALTH_OK 2020-11-16T21:53:45.603 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: audit 2020-11-16T21:53:45.276226+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:52:32.811868\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:52:08.041974\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:53:45.806 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: audit 2020-11-16T21:53:45.277590+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2020-11-16T21:53:45.806 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: audit 2020-11-16T21:53:45.278926+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:45.806 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:45 smithi195 bash[10218]: audit 2020-11-16T21:53:45.280984+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-11-16T21:53:46.191 INFO:tasks.cephadm:Generating final ceph.conf file... 2020-11-16T21:53:46.192 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph config generate-minimal-conf 2020-11-16T21:53:46.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:46 smithi057 bash[10301]: cephadm 2020-11-16T21:53:45.277088+0000 mgr.y (mgr.14138) 71 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2020-11-16T21:53:46.449 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:46 smithi057 bash[10301]: cephadm 2020-11-16T21:53:45.280031+0000 mgr.y (mgr.14138) 72 : cephadm [INF] Reconfiguring daemon mgr.y on smithi195 2020-11-16T21:53:46.449 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:46 smithi057 bash[10301]: audit 2020-11-16T21:53:45.536342+0000 mon.a (mon.0) 251 : audit [DBG] from='client.? v1:172.21.15.57:0/3675109854' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2020-11-16T21:53:46.449 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:46 smithi057 bash[10301]: audit 2020-11-16T21:53:46.179238+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:46.579 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:46 smithi195 bash[10218]: cephadm 2020-11-16T21:53:45.277088+0000 mgr.y (mgr.14138) 71 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2020-11-16T21:53:46.580 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:46 smithi195 bash[10218]: cephadm 2020-11-16T21:53:45.280031+0000 mgr.y (mgr.14138) 72 : cephadm [INF] Reconfiguring daemon mgr.y on smithi195 2020-11-16T21:53:46.580 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:46 smithi195 bash[10218]: audit 2020-11-16T21:53:45.536342+0000 mon.a (mon.0) 251 : audit [DBG] from='client.? v1:172.21.15.57:0/3675109854' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2020-11-16T21:53:46.580 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:46 smithi195 bash[10218]: audit 2020-11-16T21:53:46.179238+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:46.584 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:46 smithi016 bash[10302]: cephadm 2020-11-16T21:53:45.277088+0000 mgr.y (mgr.14138) 71 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2020-11-16T21:53:46.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:46 smithi016 bash[10302]: cephadm 2020-11-16T21:53:45.280031+0000 mgr.y (mgr.14138) 72 : cephadm [INF] Reconfiguring daemon mgr.y on smithi195 2020-11-16T21:53:46.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:46 smithi016 bash[10302]: audit 2020-11-16T21:53:45.536342+0000 mon.a (mon.0) 251 : audit [DBG] from='client.? v1:172.21.15.57:0/3675109854' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2020-11-16T21:53:46.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:46 smithi016 bash[10302]: audit 2020-11-16T21:53:46.179238+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2020-11-16T21:53:47.584 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:47 smithi016 bash[10302]: cluster 2020-11-16T21:53:46.327451+0000 mgr.y (mgr.14138) 73 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:47.596 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:47 smithi195 bash[10218]: cluster 2020-11-16T21:53:46.327451+0000 mgr.y (mgr.14138) 73 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:47.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:47 smithi057 bash[10301]: cluster 2020-11-16T21:53:46.327451+0000 mgr.y (mgr.14138) 73 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:48.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:48 smithi016 bash[10302]: audit 2020-11-16T21:53:47.620149+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:48.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:48 smithi016 bash[10302]: audit 2020-11-16T21:53:47.625507+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:53:48.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:48 smithi016 bash[10302]: cephadm 2020-11-16T21:53:47.626199+0000 mgr.y (mgr.14138) 74 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2020-11-16T21:53:48.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:48 smithi016 bash[10302]: audit 2020-11-16T21:53:47.626627+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-11-16T21:53:48.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:48 smithi016 bash[10302]: audit 2020-11-16T21:53:47.627774+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:48.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:48 smithi016 bash[10302]: cephadm 2020-11-16T21:53:47.628923+0000 mgr.y (mgr.14138) 75 : cephadm [INF] Reconfiguring daemon mon.b on smithi016 2020-11-16T21:53:48.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:48 smithi016 bash[10302]: audit 2020-11-16T21:53:47.629666+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2020-11-16T21:53:48.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:48 smithi016 bash[10302]: audit 2020-11-16T21:53:48.147385+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:53:48.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:48 smithi016 bash[10302]: audit 2020-11-16T21:53:48.149979+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2020-11-16T21:53:48.596 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:48 smithi195 bash[10218]: audit 2020-11-16T21:53:47.620149+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:48.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:48 smithi195 bash[10218]: audit 2020-11-16T21:53:47.625507+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:53:48.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:48 smithi195 bash[10218]: cephadm 2020-11-16T21:53:47.626199+0000 mgr.y (mgr.14138) 74 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2020-11-16T21:53:48.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:48 smithi195 bash[10218]: audit 2020-11-16T21:53:47.626627+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-11-16T21:53:48.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:48 smithi195 bash[10218]: audit 2020-11-16T21:53:47.627774+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:48.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:48 smithi195 bash[10218]: cephadm 2020-11-16T21:53:47.628923+0000 mgr.y (mgr.14138) 75 : cephadm [INF] Reconfiguring daemon mon.b on smithi016 2020-11-16T21:53:48.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:48 smithi195 bash[10218]: audit 2020-11-16T21:53:47.629666+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2020-11-16T21:53:48.598 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:48 smithi195 bash[10218]: audit 2020-11-16T21:53:48.147385+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:53:48.598 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:48 smithi195 bash[10218]: audit 2020-11-16T21:53:48.149979+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2020-11-16T21:53:48.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:48 smithi057 bash[10301]: audit 2020-11-16T21:53:47.620149+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:48.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:48 smithi057 bash[10301]: audit 2020-11-16T21:53:47.625507+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:53:48.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:48 smithi057 bash[10301]: cephadm 2020-11-16T21:53:47.626199+0000 mgr.y (mgr.14138) 74 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2020-11-16T21:53:48.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:48 smithi057 bash[10301]: audit 2020-11-16T21:53:47.626627+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-11-16T21:53:48.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:48 smithi057 bash[10301]: audit 2020-11-16T21:53:47.627774+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:48.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:48 smithi057 bash[10301]: cephadm 2020-11-16T21:53:47.628923+0000 mgr.y (mgr.14138) 75 : cephadm [INF] Reconfiguring daemon mon.b on smithi016 2020-11-16T21:53:48.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:48 smithi057 bash[10301]: audit 2020-11-16T21:53:47.629666+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2020-11-16T21:53:48.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:48 smithi057 bash[10301]: audit 2020-11-16T21:53:48.147385+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:53:48.700 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:48 smithi057 bash[10301]: audit 2020-11-16T21:53:48.149979+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2020-11-16T21:53:49.584 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:49 smithi016 bash[10302]: cluster 2020-11-16T21:53:48.327827+0000 mgr.y (mgr.14138) 76 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:49.596 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:49 smithi195 bash[10218]: cluster 2020-11-16T21:53:48.327827+0000 mgr.y (mgr.14138) 76 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:49.638 INFO:teuthology.orchestra.run.smithi195.stdout:# minimal ceph.conf for bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:53:49.639 INFO:teuthology.orchestra.run.smithi195.stdout:[global] 2020-11-16T21:53:49.639 INFO:teuthology.orchestra.run.smithi195.stdout: fsid = bcd5108e-2855-11eb-a2b2-001a4aab830c 2020-11-16T21:53:49.639 INFO:teuthology.orchestra.run.smithi195.stdout: mon_host = 172.21.15.195:6789/0 172.21.15.16:6789/0 172.21.15.57:6789/0 2020-11-16T21:53:49.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:49 smithi057 bash[10301]: cluster 2020-11-16T21:53:48.327827+0000 mgr.y (mgr.14138) 76 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:50.234 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2020-11-16T21:53:50.235 INFO:teuthology.orchestra.run.smithi195:> set -ex 2020-11-16T21:53:50.235 INFO:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.conf 2020-11-16T21:53:50.240 INFO:teuthology.orchestra.run.smithi195.stderr:+ sudo dd of=/etc/ceph/ceph.conf 2020-11-16T21:53:50.249 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2020-11-16T21:53:50.249 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2020-11-16T21:53:50.249 INFO:teuthology.orchestra.run.smithi195.stderr:188 bytes copied, 0.000145751 s, 1.3 MB/s 2020-11-16T21:53:50.250 INFO:teuthology.orchestra.run.smithi195:> set -ex 2020-11-16T21:53:50.250 INFO:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2020-11-16T21:53:50.297 INFO:teuthology.orchestra.run.smithi195.stderr:+ sudo dd of=/etc/ceph/ceph.client.admin.keyring 2020-11-16T21:53:50.304 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2020-11-16T21:53:50.304 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2020-11-16T21:53:50.304 INFO:teuthology.orchestra.run.smithi195.stderr:63 bytes copied, 0.000111127 s, 567 kB/s 2020-11-16T21:53:50.305 INFO:teuthology.orchestra.run.smithi016:> set -ex 2020-11-16T21:53:50.306 INFO:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.conf 2020-11-16T21:53:50.311 INFO:teuthology.orchestra.run.smithi016.stderr:+ sudo dd of=/etc/ceph/ceph.conf 2020-11-16T21:53:50.320 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2020-11-16T21:53:50.321 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2020-11-16T21:53:50.321 INFO:teuthology.orchestra.run.smithi016.stderr:188 bytes copied, 0.000128414 s, 1.5 MB/s 2020-11-16T21:53:50.321 INFO:teuthology.orchestra.run.smithi016:> set -ex 2020-11-16T21:53:50.322 INFO:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2020-11-16T21:53:50.366 INFO:teuthology.orchestra.run.smithi016.stderr:+ sudo dd of=/etc/ceph/ceph.client.admin.keyring 2020-11-16T21:53:50.375 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2020-11-16T21:53:50.375 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2020-11-16T21:53:50.375 INFO:teuthology.orchestra.run.smithi016.stderr:63 bytes copied, 0.000125833 s, 501 kB/s 2020-11-16T21:53:50.376 INFO:teuthology.orchestra.run.smithi057:> set -ex 2020-11-16T21:53:50.377 INFO:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.conf 2020-11-16T21:53:50.381 INFO:teuthology.orchestra.run.smithi057.stderr:+ sudo dd of=/etc/ceph/ceph.conf 2020-11-16T21:53:50.391 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records in 2020-11-16T21:53:50.391 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records out 2020-11-16T21:53:50.391 INFO:teuthology.orchestra.run.smithi057.stderr:188 bytes copied, 0.00010642 s, 1.8 MB/s 2020-11-16T21:53:50.392 INFO:teuthology.orchestra.run.smithi057:> set -ex 2020-11-16T21:53:50.392 INFO:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2020-11-16T21:53:50.438 INFO:teuthology.orchestra.run.smithi057.stderr:+ sudo dd of=/etc/ceph/ceph.client.admin.keyring 2020-11-16T21:53:50.448 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records in 2020-11-16T21:53:50.448 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records out 2020-11-16T21:53:50.448 INFO:teuthology.orchestra.run.smithi057.stderr:63 bytes copied, 0.00011586 s, 544 kB/s 2020-11-16T21:53:50.449 INFO:tasks.cephadm:Adding mgr.x on smithi016 2020-11-16T21:53:50.449 INFO:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch apply mgr '2;smithi016=x' 2020-11-16T21:53:50.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:50 smithi016 bash[10302]: audit 2020-11-16T21:53:49.653726+0000 mon.a (mon.0) 260 : audit [DBG] from='client.? v1:172.21.15.195:0/2688536422' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:50.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:50 smithi016 bash[10302]: audit 2020-11-16T21:53:49.766645+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:53:50.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:50 smithi016 bash[10302]: audit 2020-11-16T21:53:49.771964+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:53:50.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:50 smithi016 bash[10302]: audit 2020-11-16T21:53:49.772859+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-11-16T21:53:50.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:50 smithi016 bash[10302]: audit 2020-11-16T21:53:49.779016+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:50.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:50 smithi016 bash[10302]: audit 2020-11-16T21:53:49.779555+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:50.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:50 smithi016 bash[10302]: cephadm 2020-11-16T21:53:49.781151+0000 mgr.y (mgr.14138) 78 : cephadm [INF] Reconfiguring daemon mon.c on smithi057 2020-11-16T21:53:50.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:50 smithi016 bash[10302]: audit 2020-11-16T21:53:49.781683+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2020-11-16T21:53:50.596 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:50 smithi195 bash[10218]: audit 2020-11-16T21:53:49.653726+0000 mon.a (mon.0) 260 : audit [DBG] from='client.? v1:172.21.15.195:0/2688536422' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:50.596 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:50 smithi195 bash[10218]: audit 2020-11-16T21:53:49.766645+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:53:50.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:50 smithi195 bash[10218]: audit 2020-11-16T21:53:49.771964+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:53:50.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:50 smithi195 bash[10218]: audit 2020-11-16T21:53:49.772859+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-11-16T21:53:50.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:50 smithi195 bash[10218]: audit 2020-11-16T21:53:49.779016+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:50.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:50 smithi195 bash[10218]: audit 2020-11-16T21:53:49.779555+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:50.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:50 smithi195 bash[10218]: cephadm 2020-11-16T21:53:49.781151+0000 mgr.y (mgr.14138) 78 : cephadm [INF] Reconfiguring daemon mon.c on smithi057 2020-11-16T21:53:50.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:50 smithi195 bash[10218]: audit 2020-11-16T21:53:49.781683+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2020-11-16T21:53:50.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:50 smithi057 bash[10301]: audit 2020-11-16T21:53:49.653726+0000 mon.a (mon.0) 260 : audit [DBG] from='client.? v1:172.21.15.195:0/2688536422' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:50.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:50 smithi057 bash[10301]: audit 2020-11-16T21:53:49.766645+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:53:50.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:50 smithi057 bash[10301]: audit 2020-11-16T21:53:49.771964+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:53:50.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:50 smithi057 bash[10301]: audit 2020-11-16T21:53:49.772859+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-11-16T21:53:50.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:50 smithi057 bash[10301]: audit 2020-11-16T21:53:49.779016+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:50.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:50 smithi057 bash[10301]: audit 2020-11-16T21:53:49.779555+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:50.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:50 smithi057 bash[10301]: cephadm 2020-11-16T21:53:49.781151+0000 mgr.y (mgr.14138) 78 : cephadm [INF] Reconfiguring daemon mon.c on smithi057 2020-11-16T21:53:50.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:50 smithi057 bash[10301]: audit 2020-11-16T21:53:49.781683+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2020-11-16T21:53:51.894 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:51 smithi057 bash[10301]: cluster 2020-11-16T21:53:50.328277+0000 mgr.y (mgr.14138) 79 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:52.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:51 smithi016 bash[10302]: cluster 2020-11-16T21:53:50.328277+0000 mgr.y (mgr.14138) 79 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:52.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:51 smithi195 bash[10218]: cluster 2020-11-16T21:53:50.328277+0000 mgr.y (mgr.14138) 79 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:53.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:52 smithi016 bash[10302]: audit 2020-11-16T21:53:52.704668+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:53:53.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:52 smithi016 bash[10302]: audit 2020-11-16T21:53:52.710137+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:53:53.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:52 smithi016 bash[10302]: audit 2020-11-16T21:53:52.712256+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:53.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:52 smithi016 bash[10302]: audit 2020-11-16T21:53:52.712871+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:53.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:52 smithi016 bash[10302]: audit 2020-11-16T21:53:52.713485+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:53.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:52 smithi195 bash[10218]: audit 2020-11-16T21:53:52.704668+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:53:53.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:52 smithi195 bash[10218]: audit 2020-11-16T21:53:52.710137+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:53:53.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:52 smithi195 bash[10218]: audit 2020-11-16T21:53:52.712256+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:53.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:52 smithi195 bash[10218]: audit 2020-11-16T21:53:52.712871+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:53.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:52 smithi195 bash[10218]: audit 2020-11-16T21:53:52.713485+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:53.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:52 smithi057 bash[10301]: audit 2020-11-16T21:53:52.704668+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:53:53.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:52 smithi057 bash[10301]: audit 2020-11-16T21:53:52.710137+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:53:53.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:52 smithi057 bash[10301]: audit 2020-11-16T21:53:52.712256+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:53.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:52 smithi057 bash[10301]: audit 2020-11-16T21:53:52.712871+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:53.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:52 smithi057 bash[10301]: audit 2020-11-16T21:53:52.713485+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:54.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:53 smithi016 bash[10302]: cluster 2020-11-16T21:53:52.328730+0000 mgr.y (mgr.14138) 80 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:54.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:53 smithi016 bash[10302]: audit 2020-11-16T21:53:53.344786+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.343607\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.343835\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:53:54.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:53 smithi016 bash[10302]: audit 2020-11-16T21:53:53.351399+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.343607\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.343835\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:53:54.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:53 smithi016 bash[10302]: audit 2020-11-16T21:53:53.351842+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347672\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347922\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.348261\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:54.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:53 smithi016 bash[10302]: audit 2020-11-16T21:53:53.352442+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.349615\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.349888\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:53:54.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:53 smithi016 bash[10302]: audit 2020-11-16T21:53:53.355718+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347672\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347922\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.348261\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:53:54.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:53 smithi016 bash[10302]: audit 2020-11-16T21:53:53.361951+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.349615\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.349888\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:53:54.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:53 smithi016 bash[10302]: audit 2020-11-16T21:53:53.363253+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:53:54.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:53 smithi016 bash[10302]: audit 2020-11-16T21:53:53.366068+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:53:54.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:53 smithi016 bash[10302]: audit 2020-11-16T21:53:53.367113+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-11-16T21:53:54.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:53 smithi016 bash[10302]: audit 2020-11-16T21:53:53.368286+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:54.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:53 smithi016 bash[10302]: audit 2020-11-16T21:53:53.370209+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-11-16T21:53:54.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:53 smithi195 bash[10218]: cluster 2020-11-16T21:53:52.328730+0000 mgr.y (mgr.14138) 80 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:54.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:53 smithi195 bash[10218]: audit 2020-11-16T21:53:53.344786+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.343607\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.343835\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:53:54.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:53 smithi195 bash[10218]: audit 2020-11-16T21:53:53.351399+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.343607\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.343835\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:53:54.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:53 smithi195 bash[10218]: audit 2020-11-16T21:53:53.351842+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347672\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347922\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.348261\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:54.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:53 smithi195 bash[10218]: audit 2020-11-16T21:53:53.352442+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.349615\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.349888\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:53:54.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:53 smithi195 bash[10218]: audit 2020-11-16T21:53:53.355718+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347672\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347922\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.348261\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:53:54.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:53 smithi195 bash[10218]: audit 2020-11-16T21:53:53.361951+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.349615\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.349888\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:53:54.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:53 smithi195 bash[10218]: audit 2020-11-16T21:53:53.363253+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:53:54.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:53 smithi195 bash[10218]: audit 2020-11-16T21:53:53.366068+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:53:54.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:53 smithi195 bash[10218]: audit 2020-11-16T21:53:53.367113+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-11-16T21:53:54.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:53 smithi195 bash[10218]: audit 2020-11-16T21:53:53.368286+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:54.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:53 smithi195 bash[10218]: audit 2020-11-16T21:53:53.370209+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-11-16T21:53:54.107 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:53 smithi057 bash[10301]: cluster 2020-11-16T21:53:52.328730+0000 mgr.y (mgr.14138) 80 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:54.107 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:53 smithi057 bash[10301]: audit 2020-11-16T21:53:53.344786+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.343607\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.343835\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:53:54.108 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:53 smithi057 bash[10301]: audit 2020-11-16T21:53:53.351399+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.343607\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.343835\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:53:54.108 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:53 smithi057 bash[10301]: audit 2020-11-16T21:53:53.351842+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347672\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347922\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.348261\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:54.108 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:53 smithi057 bash[10301]: audit 2020-11-16T21:53:53.352442+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.349615\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.349888\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:53:54.108 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:53 smithi057 bash[10301]: audit 2020-11-16T21:53:53.355718+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347672\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347922\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:39.269971\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.348261\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:53:54.109 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:53 smithi057 bash[10301]: audit 2020-11-16T21:53:53.361951+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.349615\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}}, \"last_daemon_update\": \"2020-11-16T21:53:53.349888\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:53:54.109 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:53 smithi057 bash[10301]: audit 2020-11-16T21:53:53.363253+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:53:54.109 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:53 smithi057 bash[10301]: audit 2020-11-16T21:53:53.366068+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:53:54.110 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:53 smithi057 bash[10301]: audit 2020-11-16T21:53:53.367113+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2020-11-16T21:53:54.110 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:53 smithi057 bash[10301]: audit 2020-11-16T21:53:53.368286+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:54.110 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:53 smithi057 bash[10301]: audit 2020-11-16T21:53:53.370209+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2020-11-16T21:53:54.503 INFO:teuthology.orchestra.run.smithi057.stdout:Scheduled mgr update... 2020-11-16T21:53:54.918 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:54 smithi195 bash[10218]: cephadm 2020-11-16T21:53:53.366665+0000 mgr.y (mgr.14138) 81 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2020-11-16T21:53:54.918 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:54 smithi195 bash[10218]: cephadm 2020-11-16T21:53:53.369489+0000 mgr.y (mgr.14138) 82 : cephadm [INF] Reconfiguring daemon mon.a on smithi195 2020-11-16T21:53:54.919 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:54 smithi195 bash[10218]: audit 2020-11-16T21:53:54.512500+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-11-16T21:53:54.511814\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [\"smithi016=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2020-11-16T21:53:54.919 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:54 smithi195 bash[10218]: audit 2020-11-16T21:53:54.518010+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-11-16T21:53:54.511814\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [\"smithi016=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2020-11-16T21:53:54.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:54 smithi057 bash[10301]: cephadm 2020-11-16T21:53:53.366665+0000 mgr.y (mgr.14138) 81 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2020-11-16T21:53:54.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:54 smithi057 bash[10301]: cephadm 2020-11-16T21:53:53.369489+0000 mgr.y (mgr.14138) 82 : cephadm [INF] Reconfiguring daemon mon.a on smithi195 2020-11-16T21:53:54.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:54 smithi057 bash[10301]: audit 2020-11-16T21:53:54.512500+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-11-16T21:53:54.511814\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [\"smithi016=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2020-11-16T21:53:54.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:54 smithi057 bash[10301]: audit 2020-11-16T21:53:54.518010+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-11-16T21:53:54.511814\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [\"smithi016=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2020-11-16T21:53:55.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:54 smithi016 bash[10302]: cephadm 2020-11-16T21:53:53.366665+0000 mgr.y (mgr.14138) 81 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2020-11-16T21:53:55.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:54 smithi016 bash[10302]: cephadm 2020-11-16T21:53:53.369489+0000 mgr.y (mgr.14138) 82 : cephadm [INF] Reconfiguring daemon mon.a on smithi195 2020-11-16T21:53:55.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:54 smithi016 bash[10302]: audit 2020-11-16T21:53:54.512500+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-11-16T21:53:54.511814\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [\"smithi016=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2020-11-16T21:53:55.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:54 smithi016 bash[10302]: audit 2020-11-16T21:53:54.518010+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2020-11-16T21:53:54.511814\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [\"smithi016=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2020-11-16T21:53:55.190 INFO:teuthology.orchestra.run.smithi016:mgr.x> sudo journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mgr.x.service 2020-11-16T21:53:55.192 INFO:tasks.cephadm:Deploying OSDs... 2020-11-16T21:53:55.193 INFO:teuthology.orchestra.run.smithi195:> set -ex 2020-11-16T21:53:55.193 INFO:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2020-11-16T21:53:55.198 INFO:teuthology.orchestra.run.smithi195.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-16T21:53:55.200 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/vg_nvme/lv_1 2020-11-16T21:53:55.200 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/vg_nvme/lv_2 2020-11-16T21:53:55.200 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/vg_nvme/lv_3 2020-11-16T21:53:55.200 INFO:teuthology.orchestra.run.smithi195.stdout:/dev/vg_nvme/lv_4 2020-11-16T21:53:55.200 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2020-11-16T21:53:55.200 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2020-11-16T21:53:55.201 INFO:teuthology.orchestra.run.smithi195.stderr:72 bytes copied, 0.000181244 s, 397 kB/s 2020-11-16T21:53:55.201 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-16T21:53:55.201 INFO:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-16T21:53:55.228 INFO:journalctl@ceph.mgr.x.smithi016.stdout:-- Logs begin at Sun 2020-11-15 12:21:41 UTC. -- 2020-11-16T21:53:55.247 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-16T21:53:55.247 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T21:53:55.247 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 343 Links: 1 2020-11-16T21:53:55.247 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T21:53:55.248 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2020-11-16 21:47:21.261055667 +0000 2020-11-16T21:53:55.248 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2020-11-16 21:47:21.169055669 +0000 2020-11-16T21:53:55.248 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2020-11-16 21:47:21.169055669 +0000 2020-11-16T21:53:55.248 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2020-11-16T21:53:55.256 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2020-11-16T21:53:55.256 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2020-11-16T21:53:55.256 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000209968 s, 2.4 MB/s 2020-11-16T21:53:55.260 INFO:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-16T21:53:55.307 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-16T21:53:55.307 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T21:53:55.307 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 349 Links: 1 2020-11-16T21:53:55.307 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T21:53:55.307 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2020-11-16 21:47:21.505055662 +0000 2020-11-16T21:53:55.308 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2020-11-16 21:47:21.385055664 +0000 2020-11-16T21:53:55.308 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2020-11-16 21:47:21.385055664 +0000 2020-11-16T21:53:55.308 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2020-11-16T21:53:55.315 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2020-11-16T21:53:55.315 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2020-11-16T21:53:55.315 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000189155 s, 2.7 MB/s 2020-11-16T21:53:55.319 INFO:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-16T21:53:55.367 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-16T21:53:55.367 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T21:53:55.367 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 355 Links: 1 2020-11-16T21:53:55.367 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T21:53:55.367 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2020-11-16 21:47:21.749055656 +0000 2020-11-16T21:53:55.368 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2020-11-16 21:47:21.645055659 +0000 2020-11-16T21:53:55.368 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2020-11-16 21:47:21.645055659 +0000 2020-11-16T21:53:55.368 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2020-11-16T21:53:55.376 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2020-11-16T21:53:55.376 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2020-11-16T21:53:55.376 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.00024856 s, 2.1 MB/s 2020-11-16T21:53:55.379 INFO:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-16T21:53:55.431 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-16T21:53:55.431 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T21:53:55.431 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 361 Links: 1 2020-11-16T21:53:55.431 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T21:53:55.432 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2020-11-16 21:47:21.973055651 +0000 2020-11-16T21:53:55.432 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2020-11-16 21:47:21.873055653 +0000 2020-11-16T21:53:55.432 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2020-11-16 21:47:21.873055653 +0000 2020-11-16T21:53:55.432 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2020-11-16T21:53:55.440 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2020-11-16T21:53:55.440 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2020-11-16T21:53:55.440 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000274077 s, 1.9 MB/s 2020-11-16T21:53:55.444 INFO:teuthology.orchestra.run.smithi016:> set -ex 2020-11-16T21:53:55.445 INFO:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2020-11-16T21:53:55.449 INFO:teuthology.orchestra.run.smithi016.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-16T21:53:55.451 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/vg_nvme/lv_1 2020-11-16T21:53:55.451 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/vg_nvme/lv_2 2020-11-16T21:53:55.451 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/vg_nvme/lv_3 2020-11-16T21:53:55.451 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/vg_nvme/lv_4 2020-11-16T21:53:55.451 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2020-11-16T21:53:55.452 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2020-11-16T21:53:55.452 INFO:teuthology.orchestra.run.smithi016.stderr:72 bytes copied, 0.00018025 s, 399 kB/s 2020-11-16T21:53:55.452 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-16T21:53:55.452 INFO:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-16T21:53:55.500 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-16T21:53:55.501 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T21:53:55.501 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 341 Links: 1 2020-11-16T21:53:55.501 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T21:53:55.501 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2020-11-16 21:47:10.817892487 +0000 2020-11-16T21:53:55.501 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2020-11-16 21:47:10.709892488 +0000 2020-11-16T21:53:55.501 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2020-11-16 21:47:10.709892488 +0000 2020-11-16T21:53:55.501 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2020-11-16T21:53:55.510 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2020-11-16T21:53:55.511 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2020-11-16T21:53:55.511 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000206252 s, 2.5 MB/s 2020-11-16T21:53:55.515 INFO:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-16T21:53:55.564 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-16T21:53:55.564 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T21:53:55.565 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 347 Links: 1 2020-11-16T21:53:55.565 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T21:53:55.565 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2020-11-16 21:47:11.053892484 +0000 2020-11-16T21:53:55.565 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2020-11-16 21:47:10.953892485 +0000 2020-11-16T21:53:55.565 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2020-11-16 21:47:10.953892485 +0000 2020-11-16T21:53:55.565 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2020-11-16T21:53:55.574 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2020-11-16T21:53:55.574 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2020-11-16T21:53:55.574 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000238361 s, 2.1 MB/s 2020-11-16T21:53:55.579 INFO:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-16T21:53:55.628 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-16T21:53:55.628 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T21:53:55.629 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 353 Links: 1 2020-11-16T21:53:55.629 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T21:53:55.629 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2020-11-16 21:47:11.285892482 +0000 2020-11-16T21:53:55.629 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2020-11-16 21:47:11.197892482 +0000 2020-11-16T21:53:55.629 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2020-11-16 21:47:11.197892482 +0000 2020-11-16T21:53:55.629 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2020-11-16T21:53:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2020-11-16T21:53:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2020-11-16T21:53:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000285213 s, 1.8 MB/s 2020-11-16T21:53:55.643 INFO:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-16T21:53:55.696 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-16T21:53:55.697 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T21:53:55.697 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 359 Links: 1 2020-11-16T21:53:55.697 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T21:53:55.697 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2020-11-16 21:47:11.517892479 +0000 2020-11-16T21:53:55.697 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2020-11-16 21:47:11.413892480 +0000 2020-11-16T21:53:55.697 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2020-11-16 21:47:11.413892480 +0000 2020-11-16T21:53:55.698 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2020-11-16T21:53:55.706 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2020-11-16T21:53:55.706 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2020-11-16T21:53:55.706 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000280137 s, 1.8 MB/s 2020-11-16T21:53:55.711 INFO:teuthology.orchestra.run.smithi057:> set -ex 2020-11-16T21:53:55.711 INFO:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2020-11-16T21:53:55.716 INFO:teuthology.orchestra.run.smithi057.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-16T21:53:55.717 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/vg_nvme/lv_1 2020-11-16T21:53:55.717 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/vg_nvme/lv_2 2020-11-16T21:53:55.717 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/vg_nvme/lv_3 2020-11-16T21:53:55.718 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/vg_nvme/lv_4 2020-11-16T21:53:55.718 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records in 2020-11-16T21:53:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records out 2020-11-16T21:53:55.719 INFO:teuthology.orchestra.run.smithi057.stderr:72 bytes copied, 0.000228391 s, 315 kB/s 2020-11-16T21:53:55.719 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-16T21:53:55.719 INFO:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-16T21:53:55.769 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-16T21:53:55.769 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T21:53:55.769 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 339 Links: 1 2020-11-16T21:53:55.769 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T21:53:55.770 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2020-11-16 21:47:08.880248908 +0000 2020-11-16T21:53:55.770 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2020-11-16 21:47:08.804248906 +0000 2020-11-16T21:53:55.770 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2020-11-16 21:47:08.804248906 +0000 2020-11-16T21:53:55.770 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2020-11-16T21:53:55.779 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2020-11-16T21:53:55.780 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2020-11-16T21:53:55.780 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000680482 s, 752 kB/s 2020-11-16T21:53:55.784 INFO:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-16T21:53:55.833 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-16T21:53:55.833 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T21:53:55.833 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 345 Links: 1 2020-11-16T21:53:55.833 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T21:53:55.833 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2020-11-16 21:47:09.108248912 +0000 2020-11-16T21:53:55.833 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2020-11-16 21:47:09.008248910 +0000 2020-11-16T21:53:55.834 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2020-11-16 21:47:09.008248910 +0000 2020-11-16T21:53:55.834 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2020-11-16T21:53:55.841 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2020-11-16T21:53:55.841 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2020-11-16T21:53:55.841 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000453541 s, 1.1 MB/s 2020-11-16T21:53:55.845 INFO:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-16T21:53:55.892 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-16T21:53:55.893 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T21:53:55.893 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 351 Links: 1 2020-11-16T21:53:55.893 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T21:53:55.893 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2020-11-16 21:47:09.364248918 +0000 2020-11-16T21:53:55.893 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2020-11-16 21:47:09.248248915 +0000 2020-11-16T21:53:55.893 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2020-11-16 21:47:09.248248915 +0000 2020-11-16T21:53:55.893 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2020-11-16T21:53:55.901 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2020-11-16T21:53:55.901 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2020-11-16T21:53:55.902 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000352399 s, 1.5 MB/s 2020-11-16T21:53:55.905 INFO:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-16T21:53:55.952 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-16T21:53:55.953 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-16T21:53:55.953 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 357 Links: 1 2020-11-16T21:53:55.953 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-16T21:53:55.953 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2020-11-16 21:47:09.616248923 +0000 2020-11-16T21:53:55.953 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2020-11-16 21:47:09.516248921 +0000 2020-11-16T21:53:55.953 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2020-11-16 21:47:09.516248921 +0000 2020-11-16T21:53:55.953 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2020-11-16T21:53:55.962 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2020-11-16T21:53:55.962 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2020-11-16T21:53:55.962 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000498734 s, 1.0 MB/s 2020-11-16T21:53:55.965 INFO:tasks.cephadm:Deploying osd.0 on smithi195 with /dev/vg_nvme/lv_4... 2020-11-16T21:53:55.966 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2020-11-16T21:53:56.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:55 smithi016 bash[10302]: cluster 2020-11-16T21:53:54.329170+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:56.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:55 smithi016 bash[10302]: audit 2020-11-16T21:53:54.510115+0000 mgr.y (mgr.14138) 84 : audit [DBG] from='client.34103 v1:172.21.15.57:0/1875513228' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi016=x", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:53:56.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:55 smithi016 bash[10302]: cephadm 2020-11-16T21:53:54.511789+0000 mgr.y (mgr.14138) 85 : cephadm [INF] Saving service mgr spec with placement smithi016=x;count:2 2020-11-16T21:53:56.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:55 smithi016 bash[10302]: audit 2020-11-16T21:53:55.474449+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347922\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:56.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:55 smithi016 bash[10302]: audit 2020-11-16T21:53:55.479785+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347922\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:53:56.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:55 smithi016 bash[10302]: audit 2020-11-16T21:53:55.481832+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:56.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:55 smithi195 bash[10218]: cluster 2020-11-16T21:53:54.329170+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:56.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:55 smithi195 bash[10218]: audit 2020-11-16T21:53:54.510115+0000 mgr.y (mgr.14138) 84 : audit [DBG] from='client.34103 v1:172.21.15.57:0/1875513228' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi016=x", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:53:56.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:55 smithi195 bash[10218]: cephadm 2020-11-16T21:53:54.511789+0000 mgr.y (mgr.14138) 85 : cephadm [INF] Saving service mgr spec with placement smithi016=x;count:2 2020-11-16T21:53:56.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:55 smithi195 bash[10218]: audit 2020-11-16T21:53:55.474449+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347922\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:56.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:55 smithi195 bash[10218]: audit 2020-11-16T21:53:55.479785+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347922\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:53:56.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:55 smithi195 bash[10218]: audit 2020-11-16T21:53:55.481832+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:56.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:55 smithi057 bash[10301]: cluster 2020-11-16T21:53:54.329170+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:56.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:55 smithi057 bash[10301]: audit 2020-11-16T21:53:54.510115+0000 mgr.y (mgr.14138) 84 : audit [DBG] from='client.34103 v1:172.21.15.57:0/1875513228' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi016=x", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:53:56.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:55 smithi057 bash[10301]: cephadm 2020-11-16T21:53:54.511789+0000 mgr.y (mgr.14138) 85 : cephadm [INF] Saving service mgr spec with placement smithi016=x;count:2 2020-11-16T21:53:56.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:55 smithi057 bash[10301]: audit 2020-11-16T21:53:55.474449+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347922\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:56.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:55 smithi057 bash[10301]: audit 2020-11-16T21:53:55.479785+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.347922\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:53:56.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:55 smithi057 bash[10301]: audit 2020-11-16T21:53:55.481832+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:53:57.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:56 smithi016 bash[10302]: audit 2020-11-16T21:53:56.128233+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:56.127371\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:56.127462\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:53:56.127560\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:57.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:56 smithi016 bash[10302]: audit 2020-11-16T21:53:56.131706+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:56.127371\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:56.127462\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:53:56.127560\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:53:57.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:56 smithi016 bash[10302]: audit 2020-11-16T21:53:56.132775+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:53:57.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:56 smithi016 bash[10302]: audit 2020-11-16T21:53:56.137536+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:53:57.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:56 smithi016 bash[10302]: audit 2020-11-16T21:53:56.138797+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2020-11-16T21:53:57.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:56 smithi016 bash[10302]: audit 2020-11-16T21:53:56.147474+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2020-11-16T21:53:57.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:56 smithi016 bash[10302]: audit 2020-11-16T21:53:56.148734+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2020-11-16T21:53:57.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:56 smithi016 bash[10302]: audit 2020-11-16T21:53:56.150177+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:57.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:56 smithi016 bash[10302]: audit 2020-11-16T21:53:56.151580+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2020-11-16T21:53:57.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:56 smithi195 bash[10218]: audit 2020-11-16T21:53:56.128233+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:56.127371\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:56.127462\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:53:56.127560\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:57.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:56 smithi195 bash[10218]: audit 2020-11-16T21:53:56.131706+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:56.127371\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:56.127462\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:53:56.127560\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:53:57.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:56 smithi195 bash[10218]: audit 2020-11-16T21:53:56.132775+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:53:57.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:56 smithi195 bash[10218]: audit 2020-11-16T21:53:56.137536+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:53:57.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:56 smithi195 bash[10218]: audit 2020-11-16T21:53:56.138797+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2020-11-16T21:53:57.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:56 smithi195 bash[10218]: audit 2020-11-16T21:53:56.147474+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2020-11-16T21:53:57.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:56 smithi195 bash[10218]: audit 2020-11-16T21:53:56.148734+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2020-11-16T21:53:57.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:56 smithi195 bash[10218]: audit 2020-11-16T21:53:56.150177+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:57.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:56 smithi195 bash[10218]: audit 2020-11-16T21:53:56.151580+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2020-11-16T21:53:57.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:56 smithi057 bash[10301]: audit 2020-11-16T21:53:56.128233+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:56.127371\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:56.127462\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:53:56.127560\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:53:57.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:56 smithi057 bash[10301]: audit 2020-11-16T21:53:56.131706+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:56.127371\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"smithi195\", \"container_id\": \"a44aae415b4b\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:56.127462\", \"created\": \"2020-11-16T21:51:10.588235\", \"started\": \"2020-11-16T21:51:10.674618\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:53:56.127560\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:53:57.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:56 smithi057 bash[10301]: audit 2020-11-16T21:53:56.132775+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:53:57.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:56 smithi057 bash[10301]: audit 2020-11-16T21:53:56.137536+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:53:57.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:56 smithi057 bash[10301]: audit 2020-11-16T21:53:56.138797+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2020-11-16T21:53:57.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:56 smithi057 bash[10301]: audit 2020-11-16T21:53:56.147474+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2020-11-16T21:53:57.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:56 smithi057 bash[10301]: audit 2020-11-16T21:53:56.148734+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2020-11-16T21:53:57.200 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:56 smithi057 bash[10301]: audit 2020-11-16T21:53:56.150177+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:53:57.200 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:56 smithi057 bash[10301]: audit 2020-11-16T21:53:56.151580+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2020-11-16T21:53:58.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:57 smithi016 bash[10302]: cephadm 2020-11-16T21:53:56.151036+0000 mgr.y (mgr.14138) 86 : cephadm [INF] Deploying daemon mgr.x on smithi016 2020-11-16T21:53:58.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:57 smithi016 bash[10302]: cluster 2020-11-16T21:53:56.329602+0000 mgr.y (mgr.14138) 87 : cluster [DBG] pgmap v61: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:58.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:57 smithi195 bash[10218]: cephadm 2020-11-16T21:53:56.151036+0000 mgr.y (mgr.14138) 86 : cephadm [INF] Deploying daemon mgr.x on smithi016 2020-11-16T21:53:58.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:57 smithi195 bash[10218]: cluster 2020-11-16T21:53:56.329602+0000 mgr.y (mgr.14138) 87 : cluster [DBG] pgmap v61: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:58.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:57 smithi057 bash[10301]: cephadm 2020-11-16T21:53:56.151036+0000 mgr.y (mgr.14138) 86 : cephadm [INF] Deploying daemon mgr.x on smithi016 2020-11-16T21:53:58.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:57 smithi057 bash[10301]: cluster 2020-11-16T21:53:56.329602+0000 mgr.y (mgr.14138) 87 : cluster [DBG] pgmap v61: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:53:58.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:58 smithi195 bash[10218]: audit 2020-11-16T21:53:58.715902+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.349615\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:53:58.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:58 smithi195 bash[10218]: audit 2020-11-16T21:53:58.721126+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.349615\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:53:58.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:58 smithi195 bash[10218]: audit 2020-11-16T21:53:58.722779+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-11-16T21:53:59.085 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Nov 16 21:53:58 smithi016 systemd[1]: Started Ceph mgr.x for bcd5108e-2855-11eb-a2b2-001a4aab830c. 2020-11-16T21:53:59.085 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Nov 16 21:53:58 smithi016 bash[10965]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-mgr.x 2020-11-16T21:53:59.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:58 smithi016 bash[10302]: audit 2020-11-16T21:53:58.715902+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.349615\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:53:59.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:58 smithi016 bash[10302]: audit 2020-11-16T21:53:58.721126+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.349615\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:53:59.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:58 smithi016 bash[10302]: audit 2020-11-16T21:53:58.722779+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-11-16T21:53:59.093 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:58 smithi057 bash[10301]: audit 2020-11-16T21:53:58.715902+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.349615\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:53:59.093 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:58 smithi057 bash[10301]: audit 2020-11-16T21:53:58.721126+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:53:53.349615\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:53:59.093 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:58 smithi057 bash[10301]: audit 2020-11-16T21:53:58.722779+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14138 v1:172.21.15.195:0/1168243305' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2020-11-16T21:53:59.254 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_4 2020-11-16T21:53:59.255 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2020-11-16T21:53:59.255 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2020-11-16T21:53:59.255 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2020-11-16T21:53:59.255 INFO:teuthology.orchestra.run.smithi195.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0148309 s, 707 MB/s 2020-11-16T21:53:59.255 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2020-11-16T21:53:59.342 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:53:58 smithi195 systemd[1]: Stopping Ceph mgr.y for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T21:53:59.342 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:53:59 smithi195 bash[10493]: debug 2020-11-16T21:53:59.085+0000 7f26792cf700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-11-16T21:53:59.342 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:53:59 smithi195 bash[10493]: debug 2020-11-16T21:53:59.085+0000 7f26792cf700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2020-11-16T21:54:00.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:59 smithi016 bash[10302]: cluster 2020-11-16T21:53:58.330159+0000 mgr.y (mgr.14138) 88 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:54:00.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:59 smithi016 bash[10302]: cephadm 2020-11-16T21:53:58.721874+0000 mgr.y (mgr.14138) 89 : cephadm [INF] It is presumed safe to stop ['mgr.y'] 2020-11-16T21:54:00.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:53:59 smithi016 bash[10302]: cephadm 2020-11-16T21:53:58.722190+0000 mgr.y (mgr.14138) 90 : cephadm [INF] Removing daemon mgr.y from smithi195 2020-11-16T21:54:00.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:59 smithi195 bash[10218]: cluster 2020-11-16T21:53:58.330159+0000 mgr.y (mgr.14138) 88 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:54:00.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:59 smithi195 bash[10218]: cephadm 2020-11-16T21:53:58.721874+0000 mgr.y (mgr.14138) 89 : cephadm [INF] It is presumed safe to stop ['mgr.y'] 2020-11-16T21:54:00.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:53:59 smithi195 bash[10218]: cephadm 2020-11-16T21:53:58.722190+0000 mgr.y (mgr.14138) 90 : cephadm [INF] Removing daemon mgr.y from smithi195 2020-11-16T21:54:00.096 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:53:59 smithi195 docker[14874]: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-mgr.y 2020-11-16T21:54:00.096 INFO:journalctl@ceph.mgr.y.smithi195.stdout:Nov 16 21:53:59 smithi195 systemd[1]: Stopped Ceph mgr.y for bcd5108e-2855-11eb-a2b2-001a4aab830c. 2020-11-16T21:54:00.109 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch daemon add osd smithi195:vg_nvme/lv_4 2020-11-16T21:54:00.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:59 smithi057 bash[10301]: cluster 2020-11-16T21:53:58.330159+0000 mgr.y (mgr.14138) 88 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:54:00.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:59 smithi057 bash[10301]: cephadm 2020-11-16T21:53:58.721874+0000 mgr.y (mgr.14138) 89 : cephadm [INF] It is presumed safe to stop ['mgr.y'] 2020-11-16T21:54:00.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:53:59 smithi057 bash[10301]: cephadm 2020-11-16T21:53:58.722190+0000 mgr.y (mgr.14138) 90 : cephadm [INF] Removing daemon mgr.y from smithi195 2020-11-16T21:54:05.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:05 smithi057 bash[10301]: cluster 2020-11-16T21:54:04.985841+0000 mon.a (mon.0) 300 : cluster [DBG] Standby manager daemon x started 2020-11-16T21:54:05.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:05 smithi057 bash[10301]: audit 2020-11-16T21:54:04.986298+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-11-16T21:54:05.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:05 smithi057 bash[10301]: audit 2020-11-16T21:54:04.988332+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-11-16T21:54:05.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:05 smithi016 bash[10302]: cluster 2020-11-16T21:54:04.985841+0000 mon.a (mon.0) 300 : cluster [DBG] Standby manager daemon x started 2020-11-16T21:54:05.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:05 smithi016 bash[10302]: audit 2020-11-16T21:54:04.986298+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-11-16T21:54:05.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:05 smithi016 bash[10302]: audit 2020-11-16T21:54:04.988332+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-11-16T21:54:05.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:05 smithi195 bash[10218]: cluster 2020-11-16T21:54:04.985841+0000 mon.a (mon.0) 300 : cluster [DBG] Standby manager daemon x started 2020-11-16T21:54:05.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:05 smithi195 bash[10218]: audit 2020-11-16T21:54:04.986298+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-11-16T21:54:05.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:05 smithi195 bash[10218]: audit 2020-11-16T21:54:04.988332+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-11-16T21:54:06.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:06 smithi057 bash[10301]: cluster 2020-11-16T21:54:05.425487+0000 mon.a (mon.0) 301 : cluster [DBG] mgrmap e14: y(active, since 2m), standbys: x 2020-11-16T21:54:06.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:06 smithi016 bash[10302]: cluster 2020-11-16T21:54:05.425487+0000 mon.a (mon.0) 301 : cluster [DBG] mgrmap e14: y(active, since 2m), standbys: x 2020-11-16T21:54:06.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:06 smithi195 bash[10218]: cluster 2020-11-16T21:54:05.425487+0000 mon.a (mon.0) 301 : cluster [DBG] mgrmap e14: y(active, since 2m), standbys: x 2020-11-16T21:54:29.715 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10965]: Warning: Permanently added 'smithi016,172.21.15.16' (ECDSA) to the list of known hosts. 2020-11-16T21:54:29.715 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10965]: Warning: Permanently added 'smithi057,172.21.15.57' (ECDSA) to the list of known hosts. 2020-11-16T21:54:29.715 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10965]: Warning: Permanently added 'smithi195,172.21.15.195' (ECDSA) to the list of known hosts. 2020-11-16T21:54:29.716 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: cluster 2020-11-16T21:54:29.415401+0000 mon.a (mon.0) 302 : cluster [INF] Manager daemon y is unresponsive, replacing it with standby daemon x 2020-11-16T21:54:29.716 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: cluster 2020-11-16T21:54:29.421172+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e7: 0 total, 0 up, 0 in 2020-11-16T21:54:29.716 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: cluster 2020-11-16T21:54:29.428192+0000 mon.a (mon.0) 304 : cluster [DBG] mgrmap e15: x(active, starting, since 0.012907s) 2020-11-16T21:54:29.716 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.434502+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2020-11-16T21:54:29.716 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.435924+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-11-16T21:54:29.716 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.436318+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-11-16T21:54:29.717 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.436693+0000 mon.b (mon.1) 8 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-11-16T21:54:29.717 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.437883+0000 mon.b (mon.1) 9 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-11-16T21:54:29.717 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.439808+0000 mon.b (mon.1) 10 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi016"}]: dispatch 2020-11-16T21:54:29.717 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.440301+0000 mon.b (mon.1) 11 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi057"}]: dispatch 2020-11-16T21:54:29.717 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.440795+0000 mon.b (mon.1) 12 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi195"}]: dispatch 2020-11-16T21:54:29.717 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.441315+0000 mon.b (mon.1) 13 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2020-11-16T21:54:29.718 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.441845+0000 mon.b (mon.1) 14 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2020-11-16T21:54:29.718 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.442344+0000 mon.b (mon.1) 15 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2020-11-16T21:54:29.718 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.442851+0000 mon.b (mon.1) 16 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2020-11-16T21:54:29.718 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.443345+0000 mon.b (mon.1) 17 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2020-11-16T21:54:29.718 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.443839+0000 mon.b (mon.1) 18 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2020-11-16T21:54:29.718 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.444338+0000 mon.b (mon.1) 19 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2020-11-16T21:54:29.718 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.444826+0000 mon.b (mon.1) 20 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-11-16T21:54:29.719 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.445365+0000 mon.b (mon.1) 21 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-11-16T21:54:29.719 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.445938+0000 mon.b (mon.1) 22 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2020-11-16T21:54:29.719 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.446471+0000 mon.b (mon.1) 23 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2020-11-16T21:54:29.719 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: audit 2020-11-16T21:54:29.447010+0000 mon.b (mon.1) 24 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2020-11-16T21:54:29.719 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:29 smithi016 bash[10302]: cluster 2020-11-16T21:54:29.457264+0000 mon.a (mon.0) 305 : cluster [INF] Manager daemon x is now available 2020-11-16T21:54:29.731 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: cluster 2020-11-16T21:54:29.415401+0000 mon.a (mon.0) 302 : cluster [INF] Manager daemon y is unresponsive, replacing it with standby daemon x 2020-11-16T21:54:29.731 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: cluster 2020-11-16T21:54:29.421172+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e7: 0 total, 0 up, 0 in 2020-11-16T21:54:29.731 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: cluster 2020-11-16T21:54:29.428192+0000 mon.a (mon.0) 304 : cluster [DBG] mgrmap e15: x(active, starting, since 0.012907s) 2020-11-16T21:54:29.731 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.434502+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2020-11-16T21:54:29.732 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.435924+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-11-16T21:54:29.732 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.436318+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-11-16T21:54:29.732 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.436693+0000 mon.b (mon.1) 8 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-11-16T21:54:29.732 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.437883+0000 mon.b (mon.1) 9 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-11-16T21:54:29.732 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.439808+0000 mon.b (mon.1) 10 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi016"}]: dispatch 2020-11-16T21:54:29.732 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.440301+0000 mon.b (mon.1) 11 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi057"}]: dispatch 2020-11-16T21:54:29.732 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.440795+0000 mon.b (mon.1) 12 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi195"}]: dispatch 2020-11-16T21:54:29.733 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.441315+0000 mon.b (mon.1) 13 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2020-11-16T21:54:29.733 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.441845+0000 mon.b (mon.1) 14 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2020-11-16T21:54:29.733 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.442344+0000 mon.b (mon.1) 15 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2020-11-16T21:54:29.733 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.442851+0000 mon.b (mon.1) 16 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2020-11-16T21:54:29.733 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.443345+0000 mon.b (mon.1) 17 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2020-11-16T21:54:29.733 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.443839+0000 mon.b (mon.1) 18 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2020-11-16T21:54:29.734 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.444338+0000 mon.b (mon.1) 19 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2020-11-16T21:54:29.734 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.444826+0000 mon.b (mon.1) 20 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-11-16T21:54:29.734 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.445365+0000 mon.b (mon.1) 21 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-11-16T21:54:29.734 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.445938+0000 mon.b (mon.1) 22 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2020-11-16T21:54:29.734 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.446471+0000 mon.b (mon.1) 23 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2020-11-16T21:54:29.734 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: audit 2020-11-16T21:54:29.447010+0000 mon.b (mon.1) 24 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2020-11-16T21:54:29.734 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:29 smithi057 bash[10301]: cluster 2020-11-16T21:54:29.457264+0000 mon.a (mon.0) 305 : cluster [INF] Manager daemon x is now available 2020-11-16T21:54:29.741 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: cluster 2020-11-16T21:54:29.415401+0000 mon.a (mon.0) 302 : cluster [INF] Manager daemon y is unresponsive, replacing it with standby daemon x 2020-11-16T21:54:29.741 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: cluster 2020-11-16T21:54:29.421172+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e7: 0 total, 0 up, 0 in 2020-11-16T21:54:29.742 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: cluster 2020-11-16T21:54:29.428192+0000 mon.a (mon.0) 304 : cluster [DBG] mgrmap e15: x(active, starting, since 0.012907s) 2020-11-16T21:54:29.742 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.434502+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2020-11-16T21:54:29.742 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.435924+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2020-11-16T21:54:29.742 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.436318+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2020-11-16T21:54:29.742 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.436693+0000 mon.b (mon.1) 8 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2020-11-16T21:54:29.742 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.437883+0000 mon.b (mon.1) 9 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2020-11-16T21:54:29.743 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.439808+0000 mon.b (mon.1) 10 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi016"}]: dispatch 2020-11-16T21:54:29.743 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.440301+0000 mon.b (mon.1) 11 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi057"}]: dispatch 2020-11-16T21:54:29.743 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.440795+0000 mon.b (mon.1) 12 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi195"}]: dispatch 2020-11-16T21:54:29.743 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.441315+0000 mon.b (mon.1) 13 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2020-11-16T21:54:29.743 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.441845+0000 mon.b (mon.1) 14 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2020-11-16T21:54:29.743 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.442344+0000 mon.b (mon.1) 15 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2020-11-16T21:54:29.744 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.442851+0000 mon.b (mon.1) 16 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2020-11-16T21:54:29.744 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.443345+0000 mon.b (mon.1) 17 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2020-11-16T21:54:29.744 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.443839+0000 mon.b (mon.1) 18 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2020-11-16T21:54:29.744 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.444338+0000 mon.b (mon.1) 19 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2020-11-16T21:54:29.744 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.444826+0000 mon.b (mon.1) 20 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2020-11-16T21:54:29.744 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.445365+0000 mon.b (mon.1) 21 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2020-11-16T21:54:29.744 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.445938+0000 mon.b (mon.1) 22 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2020-11-16T21:54:29.745 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.446471+0000 mon.b (mon.1) 23 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2020-11-16T21:54:29.745 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: audit 2020-11-16T21:54:29.447010+0000 mon.b (mon.1) 24 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2020-11-16T21:54:29.745 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:29 smithi195 bash[10218]: cluster 2020-11-16T21:54:29.457264+0000 mon.a (mon.0) 305 : cluster [INF] Manager daemon x is now available 2020-11-16T21:54:30.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:30 smithi016 bash[10302]: audit 2020-11-16T21:54:29.692483+0000 mon.b (mon.1) 25 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:54:30.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:30 smithi016 bash[10302]: audit 2020-11-16T21:54:29.694734+0000 mon.a (mon.0) 306 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:54:30.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:30 smithi016 bash[10302]: audit 2020-11-16T21:54:29.696936+0000 mon.b (mon.1) 26 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:54:30.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:30 smithi016 bash[10302]: audit 2020-11-16T21:54:29.698983+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:54:30.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:30 smithi016 bash[10302]: audit 2020-11-16T21:54:29.997045+0000 mon.b (mon.1) 27 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:54:30.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:30 smithi016 bash[10302]: audit 2020-11-16T21:54:30.026686+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:54:30.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:30 smithi016 bash[10302]: audit 2020-11-16T21:54:30.033416+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:54:30.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:30 smithi016 bash[10302]: cluster 2020-11-16T21:54:30.432656+0000 mon.a (mon.0) 308 : cluster [DBG] mgrmap e16: x(active, since 1.01738s) 2020-11-16T21:54:30.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:30 smithi016 bash[10302]: audit 2020-11-16T21:54:30.437563+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:54:30.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:30 smithi016 bash[10302]: audit 2020-11-16T21:54:30.443214+0000 mon.b (mon.1) 31 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:54:30.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:30 smithi016 bash[10302]: audit 2020-11-16T21:54:30.444346+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:54:30.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:30 smithi016 bash[10302]: audit 2020-11-16T21:54:30.445746+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:54:30.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:30 smithi195 bash[10218]: audit 2020-11-16T21:54:29.692483+0000 mon.b (mon.1) 25 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:54:30.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:30 smithi195 bash[10218]: audit 2020-11-16T21:54:29.694734+0000 mon.a (mon.0) 306 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:54:30.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:30 smithi195 bash[10218]: audit 2020-11-16T21:54:29.696936+0000 mon.b (mon.1) 26 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:54:30.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:30 smithi195 bash[10218]: audit 2020-11-16T21:54:29.698983+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:54:30.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:30 smithi195 bash[10218]: audit 2020-11-16T21:54:29.997045+0000 mon.b (mon.1) 27 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:54:30.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:30 smithi195 bash[10218]: audit 2020-11-16T21:54:30.026686+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:54:30.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:30 smithi195 bash[10218]: audit 2020-11-16T21:54:30.033416+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:54:30.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:30 smithi195 bash[10218]: cluster 2020-11-16T21:54:30.432656+0000 mon.a (mon.0) 308 : cluster [DBG] mgrmap e16: x(active, since 1.01738s) 2020-11-16T21:54:30.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:30 smithi195 bash[10218]: audit 2020-11-16T21:54:30.437563+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:54:30.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:30 smithi195 bash[10218]: audit 2020-11-16T21:54:30.443214+0000 mon.b (mon.1) 31 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:54:30.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:30 smithi195 bash[10218]: audit 2020-11-16T21:54:30.444346+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:54:30.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:30 smithi195 bash[10218]: audit 2020-11-16T21:54:30.445746+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:54:30.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:30 smithi057 bash[10301]: audit 2020-11-16T21:54:29.692483+0000 mon.b (mon.1) 25 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:54:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:30 smithi057 bash[10301]: audit 2020-11-16T21:54:29.694734+0000 mon.a (mon.0) 306 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:54:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:30 smithi057 bash[10301]: audit 2020-11-16T21:54:29.696936+0000 mon.b (mon.1) 26 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:54:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:30 smithi057 bash[10301]: audit 2020-11-16T21:54:29.698983+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:54:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:30 smithi057 bash[10301]: audit 2020-11-16T21:54:29.997045+0000 mon.b (mon.1) 27 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:54:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:30 smithi057 bash[10301]: audit 2020-11-16T21:54:30.026686+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:54:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:30 smithi057 bash[10301]: audit 2020-11-16T21:54:30.033416+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:54:30.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:30 smithi057 bash[10301]: cluster 2020-11-16T21:54:30.432656+0000 mon.a (mon.0) 308 : cluster [DBG] mgrmap e16: x(active, since 1.01738s) 2020-11-16T21:54:30.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:30 smithi057 bash[10301]: audit 2020-11-16T21:54:30.437563+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:54:30.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:30 smithi057 bash[10301]: audit 2020-11-16T21:54:30.443214+0000 mon.b (mon.1) 31 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:54:30.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:30 smithi057 bash[10301]: audit 2020-11-16T21:54:30.444346+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:54:30.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:30 smithi057 bash[10301]: audit 2020-11-16T21:54:30.445746+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:54:31.833 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: audit 2020-11-16T21:54:30.433148+0000 mgr.x (mgr.24115) 1 : audit [DBG] from='client.14202 v1:172.21.15.195:0/4124570355' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:54:31.834 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: cephadm 2020-11-16T21:54:30.440892+0000 mgr.x (mgr.24115) 2 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:54:31.834 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: cephadm 2020-11-16T21:54:30.441149+0000 mgr.x (mgr.24115) 3 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:54:31.834 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: cephadm 2020-11-16T21:54:30.442677+0000 mgr.x (mgr.24115) 4 : cephadm [INF] Applying None on host smithi195... 2020-11-16T21:54:31.834 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: audit 2020-11-16T21:54:30.635985+0000 mon.b (mon.1) 34 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.635224\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:54:31.835 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: audit 2020-11-16T21:54:30.638291+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.635224\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:54:31.835 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: audit 2020-11-16T21:54:30.642268+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.635224\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:54:31.835 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: audit 2020-11-16T21:54:30.644591+0000 mon.b (mon.1) 35 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.643765\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:31.835 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: audit 2020-11-16T21:54:30.646718+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.643765\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:31.835 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: audit 2020-11-16T21:54:30.650533+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.643765\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:54:31.836 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: audit 2020-11-16T21:54:30.657960+0000 mon.b (mon.1) 36 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.657139\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:54:31.836 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: audit 2020-11-16T21:54:30.659974+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.657139\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:54:31.836 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: audit 2020-11-16T21:54:30.664069+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.657139\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:54:31.836 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: audit 2020-11-16T21:54:30.664999+0000 mon.b (mon.1) 37 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:31.836 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: audit 2020-11-16T21:54:30.667039+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:31.836 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: audit 2020-11-16T21:54:30.670769+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:54:31.837 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: audit 2020-11-16T21:54:30.672834+0000 mon.b (mon.1) 38 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:31.837 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: audit 2020-11-16T21:54:30.674766+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:31.837 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:31 smithi195 bash[10218]: audit 2020-11-16T21:54:30.678744+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:54:31.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: audit 2020-11-16T21:54:30.433148+0000 mgr.x (mgr.24115) 1 : audit [DBG] from='client.14202 v1:172.21.15.195:0/4124570355' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:54:31.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: cephadm 2020-11-16T21:54:30.440892+0000 mgr.x (mgr.24115) 2 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:54:31.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: cephadm 2020-11-16T21:54:30.441149+0000 mgr.x (mgr.24115) 3 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:54:31.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: cephadm 2020-11-16T21:54:30.442677+0000 mgr.x (mgr.24115) 4 : cephadm [INF] Applying None on host smithi195... 2020-11-16T21:54:31.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: audit 2020-11-16T21:54:30.635985+0000 mon.b (mon.1) 34 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.635224\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:54:31.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: audit 2020-11-16T21:54:30.638291+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.635224\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:54:31.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: audit 2020-11-16T21:54:30.642268+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.635224\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:54:31.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: audit 2020-11-16T21:54:30.644591+0000 mon.b (mon.1) 35 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.643765\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:31.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: audit 2020-11-16T21:54:30.646718+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.643765\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:31.840 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: audit 2020-11-16T21:54:30.650533+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.643765\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:54:31.840 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: audit 2020-11-16T21:54:30.657960+0000 mon.b (mon.1) 36 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.657139\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:54:31.840 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: audit 2020-11-16T21:54:30.659974+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.657139\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:54:31.840 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: audit 2020-11-16T21:54:30.664069+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.657139\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:54:31.840 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: audit 2020-11-16T21:54:30.664999+0000 mon.b (mon.1) 37 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:31.841 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: audit 2020-11-16T21:54:30.667039+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:31.841 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: audit 2020-11-16T21:54:30.670769+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:54:31.841 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: audit 2020-11-16T21:54:30.672834+0000 mon.b (mon.1) 38 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:31.841 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: audit 2020-11-16T21:54:30.674766+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:31.841 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:31 smithi016 bash[10302]: audit 2020-11-16T21:54:30.678744+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:54:31.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: audit 2020-11-16T21:54:30.433148+0000 mgr.x (mgr.24115) 1 : audit [DBG] from='client.14202 v1:172.21.15.195:0/4124570355' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:54:31.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: cephadm 2020-11-16T21:54:30.440892+0000 mgr.x (mgr.24115) 2 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:54:31.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: cephadm 2020-11-16T21:54:30.441149+0000 mgr.x (mgr.24115) 3 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:54:31.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: cephadm 2020-11-16T21:54:30.442677+0000 mgr.x (mgr.24115) 4 : cephadm [INF] Applying None on host smithi195... 2020-11-16T21:54:31.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: audit 2020-11-16T21:54:30.635985+0000 mon.b (mon.1) 34 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.635224\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:54:31.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: audit 2020-11-16T21:54:30.638291+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.635224\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:54:31.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: audit 2020-11-16T21:54:30.642268+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.635224\", \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:54:31.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: audit 2020-11-16T21:54:30.644591+0000 mon.b (mon.1) 35 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.643765\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:31.950 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: audit 2020-11-16T21:54:30.646718+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.643765\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:31.950 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: audit 2020-11-16T21:54:30.650533+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.643765\", \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:54:31.950 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: audit 2020-11-16T21:54:30.657960+0000 mon.b (mon.1) 36 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.657139\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:54:31.951 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: audit 2020-11-16T21:54:30.659974+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.657139\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:54:31.951 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: audit 2020-11-16T21:54:30.664069+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}}, \"last_daemon_update\": \"2020-11-16T21:54:30.657139\", \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:54:31.951 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: audit 2020-11-16T21:54:30.664999+0000 mon.b (mon.1) 37 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:31.951 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: audit 2020-11-16T21:54:30.667039+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:31.952 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: audit 2020-11-16T21:54:30.670769+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:54:31.952 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: audit 2020-11-16T21:54:30.672834+0000 mon.b (mon.1) 38 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:31.952 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: audit 2020-11-16T21:54:30.674766+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:31.952 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:31 smithi057 bash[10301]: audit 2020-11-16T21:54:30.678744+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:54:32.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:32 smithi057 bash[10301]: cluster 2020-11-16T21:54:31.681239+0000 mon.a (mon.0) 319 : cluster [DBG] mgrmap e17: x(active, since 2s) 2020-11-16T21:54:33.038 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:32 smithi195 bash[10218]: cluster 2020-11-16T21:54:31.681239+0000 mon.a (mon.0) 319 : cluster [DBG] mgrmap e17: x(active, since 2s) 2020-11-16T21:54:33.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:32 smithi016 bash[10302]: cluster 2020-11-16T21:54:31.681239+0000 mon.a (mon.0) 319 : cluster [DBG] mgrmap e17: x(active, since 2s) 2020-11-16T21:54:34.334 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:34 smithi016 bash[10302]: audit 2020-11-16T21:54:33.984378+0000 mon.a (mon.0) 320 : audit [INF] from='client.? v1:172.21.15.195:0/3884077471' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e17765a8-0ee0-47d6-8c45-96b8e46dbd03"}]: dispatch 2020-11-16T21:54:34.334 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:34 smithi016 bash[10302]: audit 2020-11-16T21:54:33.989924+0000 mon.b (mon.1) 39 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:34.334 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:34 smithi016 bash[10302]: audit 2020-11-16T21:54:33.990784+0000 mon.a (mon.0) 321 : audit [INF] from='client.? v1:172.21.15.195:0/3884077471' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e17765a8-0ee0-47d6-8c45-96b8e46dbd03"}]': finished 2020-11-16T21:54:34.334 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:34 smithi016 bash[10302]: cluster 2020-11-16T21:54:33.990877+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2020-11-16T21:54:34.345 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:34 smithi195 bash[10218]: audit 2020-11-16T21:54:33.984378+0000 mon.a (mon.0) 320 : audit [INF] from='client.? v1:172.21.15.195:0/3884077471' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e17765a8-0ee0-47d6-8c45-96b8e46dbd03"}]: dispatch 2020-11-16T21:54:34.345 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:34 smithi195 bash[10218]: audit 2020-11-16T21:54:33.989924+0000 mon.b (mon.1) 39 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:34.346 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:34 smithi195 bash[10218]: audit 2020-11-16T21:54:33.990784+0000 mon.a (mon.0) 321 : audit [INF] from='client.? v1:172.21.15.195:0/3884077471' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e17765a8-0ee0-47d6-8c45-96b8e46dbd03"}]': finished 2020-11-16T21:54:34.346 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:34 smithi195 bash[10218]: cluster 2020-11-16T21:54:33.990877+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2020-11-16T21:54:34.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:34 smithi057 bash[10301]: audit 2020-11-16T21:54:33.984378+0000 mon.a (mon.0) 320 : audit [INF] from='client.? v1:172.21.15.195:0/3884077471' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e17765a8-0ee0-47d6-8c45-96b8e46dbd03"}]: dispatch 2020-11-16T21:54:34.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:34 smithi057 bash[10301]: audit 2020-11-16T21:54:33.989924+0000 mon.b (mon.1) 39 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:34.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:34 smithi057 bash[10301]: audit 2020-11-16T21:54:33.990784+0000 mon.a (mon.0) 321 : audit [INF] from='client.? v1:172.21.15.195:0/3884077471' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e17765a8-0ee0-47d6-8c45-96b8e46dbd03"}]': finished 2020-11-16T21:54:34.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:34 smithi057 bash[10301]: cluster 2020-11-16T21:54:33.990877+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2020-11-16T21:54:35.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:35 smithi057 bash[10301]: audit 2020-11-16T21:54:34.629866+0000 mon.a (mon.0) 323 : audit [DBG] from='client.? v1:172.21.15.195:0/3274740792' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:54:35.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:35 smithi016 bash[10302]: audit 2020-11-16T21:54:34.629866+0000 mon.a (mon.0) 323 : audit [DBG] from='client.? v1:172.21.15.195:0/3274740792' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:54:35.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:35 smithi195 bash[10218]: audit 2020-11-16T21:54:34.629866+0000 mon.a (mon.0) 323 : audit [DBG] from='client.? v1:172.21.15.195:0/3274740792' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:54:38.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:37 smithi016 bash[10302]: audit 2020-11-16T21:54:37.664463+0000 mon.b (mon.1) 40 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:54:38.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:37 smithi195 bash[10218]: audit 2020-11-16T21:54:37.664463+0000 mon.b (mon.1) 40 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:54:38.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:37 smithi057 bash[10301]: audit 2020-11-16T21:54:37.664463+0000 mon.b (mon.1) 40 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:54:41.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:41 smithi057 bash[10301]: audit 2020-11-16T21:54:41.115363+0000 mon.b (mon.1) 41 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2020-11-16T21:54:41.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:41 smithi057 bash[10301]: audit 2020-11-16T21:54:41.116944+0000 mon.b (mon.1) 42 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:54:41.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:41 smithi057 bash[10301]: audit 2020-11-16T21:54:41.118952+0000 mon.b (mon.1) 43 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2020-11-16T21:54:41.584 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:41 smithi016 bash[10302]: audit 2020-11-16T21:54:41.115363+0000 mon.b (mon.1) 41 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2020-11-16T21:54:41.584 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:41 smithi016 bash[10302]: audit 2020-11-16T21:54:41.116944+0000 mon.b (mon.1) 42 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:54:41.584 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:41 smithi016 bash[10302]: audit 2020-11-16T21:54:41.118952+0000 mon.b (mon.1) 43 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2020-11-16T21:54:41.598 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:41 smithi195 bash[10218]: audit 2020-11-16T21:54:41.115363+0000 mon.b (mon.1) 41 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2020-11-16T21:54:41.598 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:41 smithi195 bash[10218]: audit 2020-11-16T21:54:41.116944+0000 mon.b (mon.1) 42 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:54:41.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:41 smithi195 bash[10218]: audit 2020-11-16T21:54:41.118952+0000 mon.b (mon.1) 43 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2020-11-16T21:54:42.399 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:42 smithi195 bash[10218]: cephadm 2020-11-16T21:54:41.118279+0000 mgr.x (mgr.24115) 5 : cephadm [INF] Deploying daemon osd.0 on smithi195 2020-11-16T21:54:42.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:42 smithi057 bash[10301]: cephadm 2020-11-16T21:54:41.118279+0000 mgr.x (mgr.24115) 5 : cephadm [INF] Deploying daemon osd.0 on smithi195 2020-11-16T21:54:42.583 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:42 smithi016 bash[10302]: cephadm 2020-11-16T21:54:41.118279+0000 mgr.x (mgr.24115) 5 : cephadm [INF] Deploying daemon osd.0 on smithi195 2020-11-16T21:54:43.242 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 0 on host 'smithi195' 2020-11-16T21:54:43.584 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:43 smithi016 bash[10302]: audit 2020-11-16T21:54:43.247428+0000 mon.b (mon.1) 44 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:43.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:43 smithi016 bash[10302]: audit 2020-11-16T21:54:43.248579+0000 mon.b (mon.1) 45 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:54:43.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:43 smithi016 bash[10302]: audit 2020-11-16T21:54:43.249807+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:43.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:43 smithi016 bash[10302]: audit 2020-11-16T21:54:43.254817+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:54:43.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:43 smithi016 bash[10302]: audit 2020-11-16T21:54:43.274861+0000 mon.b (mon.1) 46 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2020-11-16T21:54:43.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:43 smithi016 bash[10302]: audit 2020-11-16T21:54:43.277003+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2020-11-16T21:54:43.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:43 smithi016 bash[10302]: audit 2020-11-16T21:54:43.277653+0000 mon.b (mon.1) 47 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2020-11-16T21:54:43.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:43 smithi016 bash[10302]: audit 2020-11-16T21:54:43.279695+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2020-11-16T21:54:43.595 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:43 smithi195 bash[10218]: audit 2020-11-16T21:54:43.247428+0000 mon.b (mon.1) 44 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:43.595 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:43 smithi195 bash[10218]: audit 2020-11-16T21:54:43.248579+0000 mon.b (mon.1) 45 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:54:43.596 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:43 smithi195 bash[10218]: audit 2020-11-16T21:54:43.249807+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:43.596 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:43 smithi195 bash[10218]: audit 2020-11-16T21:54:43.254817+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:54:43.596 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:43 smithi195 bash[10218]: audit 2020-11-16T21:54:43.274861+0000 mon.b (mon.1) 46 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2020-11-16T21:54:43.596 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:43 smithi195 bash[10218]: audit 2020-11-16T21:54:43.277003+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2020-11-16T21:54:43.596 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:43 smithi195 bash[10218]: audit 2020-11-16T21:54:43.277653+0000 mon.b (mon.1) 47 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2020-11-16T21:54:43.596 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:43 smithi195 bash[10218]: audit 2020-11-16T21:54:43.279695+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2020-11-16T21:54:43.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:43 smithi057 bash[10301]: audit 2020-11-16T21:54:43.247428+0000 mon.b (mon.1) 44 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:43.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:43 smithi057 bash[10301]: audit 2020-11-16T21:54:43.248579+0000 mon.b (mon.1) 45 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:54:43.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:43 smithi057 bash[10301]: audit 2020-11-16T21:54:43.249807+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:43.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:43 smithi057 bash[10301]: audit 2020-11-16T21:54:43.254817+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.643467\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_device_update\": \"2020-11-16T21:52:03.808035\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:54:43.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:43 smithi057 bash[10301]: audit 2020-11-16T21:54:43.274861+0000 mon.b (mon.1) 46 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2020-11-16T21:54:43.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:43 smithi057 bash[10301]: audit 2020-11-16T21:54:43.277003+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2020-11-16T21:54:43.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:43 smithi057 bash[10301]: audit 2020-11-16T21:54:43.277653+0000 mon.b (mon.1) 47 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2020-11-16T21:54:43.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:43 smithi057 bash[10301]: audit 2020-11-16T21:54:43.279695+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2020-11-16T21:54:44.514 INFO:teuthology.orchestra.run.smithi195:osd.0> sudo journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.0.service 2020-11-16T21:54:44.517 INFO:tasks.cephadm:Deploying osd.1 on smithi195 with /dev/vg_nvme/lv_3... 2020-11-16T21:54:44.517 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2020-11-16T21:54:44.567 INFO:journalctl@ceph.osd.0.smithi195.stdout:-- Logs begin at Sun 2020-11-15 12:21:41 UTC. -- 2020-11-16T21:54:44.576 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:44 smithi195 bash[10218]: audit 2020-11-16T21:54:43.926377+0000 mon.b (mon.1) 48 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:44.576 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:44 smithi195 bash[10218]: audit 2020-11-16T21:54:43.928804+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:44.577 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:44 smithi195 bash[10218]: audit 2020-11-16T21:54:43.934024+0000 mon.b (mon.1) 49 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:54:44.577 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:44 smithi195 bash[10218]: audit 2020-11-16T21:54:43.934031+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:54:44.577 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:44 smithi195 bash[10218]: audit 2020-11-16T21:54:44.256770+0000 mon.b (mon.1) 50 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:44.577 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:44 smithi195 bash[10218]: audit 2020-11-16T21:54:44.256812+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2020-11-16T21:54:44.577 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:44 smithi195 bash[10218]: cluster 2020-11-16T21:54:44.256872+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2020-11-16T21:54:44.584 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:44 smithi016 bash[10302]: audit 2020-11-16T21:54:43.926377+0000 mon.b (mon.1) 48 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:44.584 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:44 smithi016 bash[10302]: audit 2020-11-16T21:54:43.928804+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:44.584 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:44 smithi016 bash[10302]: audit 2020-11-16T21:54:43.934024+0000 mon.b (mon.1) 49 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:54:44.584 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:44 smithi016 bash[10302]: audit 2020-11-16T21:54:43.934031+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:54:44.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:44 smithi016 bash[10302]: audit 2020-11-16T21:54:44.256770+0000 mon.b (mon.1) 50 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:44.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:44 smithi016 bash[10302]: audit 2020-11-16T21:54:44.256812+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2020-11-16T21:54:44.585 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:44 smithi016 bash[10302]: cluster 2020-11-16T21:54:44.256872+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2020-11-16T21:54:44.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:44 smithi057 bash[10301]: audit 2020-11-16T21:54:43.926377+0000 mon.b (mon.1) 48 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:44.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:44 smithi057 bash[10301]: audit 2020-11-16T21:54:43.928804+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:44.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:44 smithi057 bash[10301]: audit 2020-11-16T21:54:43.934024+0000 mon.b (mon.1) 49 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:54:44.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:44 smithi057 bash[10301]: audit 2020-11-16T21:54:43.934031+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:54:44.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:44 smithi057 bash[10301]: audit 2020-11-16T21:54:44.256770+0000 mon.b (mon.1) 50 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:44.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:44 smithi057 bash[10301]: audit 2020-11-16T21:54:44.256812+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2020-11-16T21:54:44.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:44 smithi057 bash[10301]: cluster 2020-11-16T21:54:44.256872+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2020-11-16T21:54:45.848 INFO:journalctl@ceph.osd.0.smithi195.stdout:Nov 16 21:54:45 smithi195 bash[16359]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-11-16T21:54:45.849 INFO:journalctl@ceph.osd.0.smithi195.stdout:Nov 16 21:54:45 smithi195 bash[16359]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2020-11-16T21:54:45.849 INFO:journalctl@ceph.osd.0.smithi195.stdout:Nov 16 21:54:45 smithi195 bash[16359]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2020-11-16T21:54:45.849 INFO:journalctl@ceph.osd.0.smithi195.stdout:Nov 16 21:54:45 smithi195 bash[16359]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2020-11-16T21:54:45.849 INFO:journalctl@ceph.osd.0.smithi195.stdout:Nov 16 21:54:45 smithi195 bash[16359]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-11-16T21:54:45.849 INFO:journalctl@ceph.osd.0.smithi195.stdout:Nov 16 21:54:45 smithi195 bash[16359]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-11-16T21:54:45.850 INFO:journalctl@ceph.osd.0.smithi195.stdout:Nov 16 21:54:45 smithi195 bash[16359]: --> ceph-volume lvm activate successful for osd ID: 0 2020-11-16T21:54:46.845 INFO:journalctl@ceph.osd.0.smithi195.stdout:Nov 16 21:54:46 smithi195 bash[16359]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.0 2020-11-16T21:54:48.845 INFO:journalctl@ceph.osd.0.smithi195.stdout:Nov 16 21:54:48 smithi195 bash[16359]: debug 2020-11-16T21:54:48.777+0000 7fa95fb34f40 -1 Falling back to public interface 2020-11-16T21:54:49.405 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_3 2020-11-16T21:54:49.405 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2020-11-16T21:54:49.406 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2020-11-16T21:54:49.406 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2020-11-16T21:54:49.406 INFO:teuthology.orchestra.run.smithi195.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0174163 s, 602 MB/s 2020-11-16T21:54:49.406 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2020-11-16T21:54:49.845 INFO:journalctl@ceph.osd.0.smithi195.stdout:Nov 16 21:54:49 smithi195 bash[16359]: debug 2020-11-16T21:54:49.425+0000 7fa95fb34f40 -1 osd.0 0 log_to_monitors {default=true} 2020-11-16T21:54:50.128 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch daemon add osd smithi195:vg_nvme/lv_3 2020-11-16T21:54:50.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:50 smithi057 bash[10301]: audit 2020-11-16T21:54:49.436573+0000 mon.c (mon.2) 2 : audit [INF] from='osd.0 v1:172.21.15.195:6800/3519378370' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-11-16T21:54:50.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:50 smithi057 bash[10301]: cluster 2020-11-16T21:54:49.437788+0000 mgr.x (mgr.24115) 6 : cluster [DBG] pgmap v5: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:54:50.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:50 smithi057 bash[10301]: audit 2020-11-16T21:54:49.441442+0000 mon.a (mon.0) 332 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-11-16T21:54:50.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:50 smithi016 bash[10302]: audit 2020-11-16T21:54:49.436573+0000 mon.c (mon.2) 2 : audit [INF] from='osd.0 v1:172.21.15.195:6800/3519378370' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-11-16T21:54:50.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:50 smithi016 bash[10302]: cluster 2020-11-16T21:54:49.437788+0000 mgr.x (mgr.24115) 6 : cluster [DBG] pgmap v5: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:54:50.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:50 smithi016 bash[10302]: audit 2020-11-16T21:54:49.441442+0000 mon.a (mon.0) 332 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-11-16T21:54:50.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:50 smithi195 bash[10218]: audit 2020-11-16T21:54:49.436573+0000 mon.c (mon.2) 2 : audit [INF] from='osd.0 v1:172.21.15.195:6800/3519378370' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-11-16T21:54:50.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:50 smithi195 bash[10218]: cluster 2020-11-16T21:54:49.437788+0000 mgr.x (mgr.24115) 6 : cluster [DBG] pgmap v5: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:54:50.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:50 smithi195 bash[10218]: audit 2020-11-16T21:54:49.441442+0000 mon.a (mon.0) 332 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2020-11-16T21:54:51.512 INFO:journalctl@ceph.osd.0.smithi195.stdout:Nov 16 21:54:51 smithi195 bash[16359]: debug 2020-11-16T21:54:51.441+0000 7fa9560b0700 -1 osd.0 0 waiting for initial osdmap 2020-11-16T21:54:51.512 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:51 smithi195 bash[10218]: audit 2020-11-16T21:54:50.433150+0000 mon.b (mon.1) 51 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:51.512 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:51 smithi195 bash[10218]: audit 2020-11-16T21:54:50.434213+0000 mon.a (mon.0) 333 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2020-11-16T21:54:51.512 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:51 smithi195 bash[10218]: cluster 2020-11-16T21:54:50.434288+0000 mon.a (mon.0) 334 : cluster [DBG] osdmap e10: 1 total, 0 up, 0 in 2020-11-16T21:54:51.513 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:51 smithi195 bash[10218]: audit 2020-11-16T21:54:50.435038+0000 mon.c (mon.2) 3 : audit [INF] from='osd.0 v1:172.21.15.195:6800/3519378370' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2020-11-16T21:54:51.513 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:51 smithi195 bash[10218]: audit 2020-11-16T21:54:50.439994+0000 mon.a (mon.0) 335 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2020-11-16T21:54:51.513 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:51 smithi195 bash[10218]: audit 2020-11-16T21:54:50.746977+0000 mon.b (mon.1) 52 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:54:51.513 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:51 smithi195 bash[10218]: audit 2020-11-16T21:54:51.053341+0000 mon.b (mon.1) 53 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:51.513 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:51 smithi195 bash[10218]: audit 2020-11-16T21:54:51.055583+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:51.514 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:51 smithi195 bash[10218]: audit 2020-11-16T21:54:51.058727+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:54:51.514 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:51 smithi195 bash[10218]: audit 2020-11-16T21:54:51.061350+0000 mon.b (mon.1) 54 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:51.514 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:51 smithi195 bash[10218]: audit 2020-11-16T21:54:51.063419+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:51.514 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:51 smithi195 bash[10218]: audit 2020-11-16T21:54:51.068255+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:54:51.514 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:51 smithi195 bash[10218]: audit 2020-11-16T21:54:51.070930+0000 mon.b (mon.1) 55 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:51.514 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:51 smithi195 bash[10218]: audit 2020-11-16T21:54:51.072942+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:51.514 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:51 smithi195 bash[10218]: audit 2020-11-16T21:54:51.076193+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:54:51.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:51 smithi057 bash[10301]: audit 2020-11-16T21:54:50.433150+0000 mon.b (mon.1) 51 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:51.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:51 smithi057 bash[10301]: audit 2020-11-16T21:54:50.434213+0000 mon.a (mon.0) 333 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2020-11-16T21:54:51.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:51 smithi057 bash[10301]: cluster 2020-11-16T21:54:50.434288+0000 mon.a (mon.0) 334 : cluster [DBG] osdmap e10: 1 total, 0 up, 0 in 2020-11-16T21:54:51.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:51 smithi057 bash[10301]: audit 2020-11-16T21:54:50.435038+0000 mon.c (mon.2) 3 : audit [INF] from='osd.0 v1:172.21.15.195:6800/3519378370' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2020-11-16T21:54:51.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:51 smithi057 bash[10301]: audit 2020-11-16T21:54:50.439994+0000 mon.a (mon.0) 335 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2020-11-16T21:54:51.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:51 smithi057 bash[10301]: audit 2020-11-16T21:54:50.746977+0000 mon.b (mon.1) 52 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:54:55.822 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:51 smithi057 bash[10301]: audit 2020-11-16T21:54:51.053341+0000 mon.b (mon.1) 53 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:55.822 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:51 smithi057 bash[10301]: audit 2020-11-16T21:54:51.055583+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:55.823 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:51 smithi057 bash[10301]: audit 2020-11-16T21:54:51.058727+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:54:55.823 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:51 smithi057 bash[10301]: audit 2020-11-16T21:54:51.061350+0000 mon.b (mon.1) 54 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:55.823 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:51 smithi057 bash[10301]: audit 2020-11-16T21:54:51.063419+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:55.823 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:51 smithi057 bash[10301]: audit 2020-11-16T21:54:51.068255+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:54:55.823 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:51 smithi057 bash[10301]: audit 2020-11-16T21:54:51.070930+0000 mon.b (mon.1) 55 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:55.823 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:51 smithi057 bash[10301]: audit 2020-11-16T21:54:51.072942+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:55.823 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:51 smithi057 bash[10301]: audit 2020-11-16T21:54:51.076193+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:54:55.825 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:52 smithi195 bash[10218]: cluster 2020-11-16T21:54:50.400122+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:54:55.826 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:52 smithi195 bash[10218]: cluster 2020-11-16T21:54:50.400284+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:54:55.826 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:52 smithi195 bash[10218]: audit 2020-11-16T21:54:51.435190+0000 mon.b (mon.1) 56 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:55.826 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:52 smithi195 bash[10218]: audit 2020-11-16T21:54:51.436227+0000 mon.a (mon.0) 342 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2020-11-16T21:54:55.826 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:52 smithi195 bash[10218]: cluster 2020-11-16T21:54:51.436326+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e11: 1 total, 0 up, 0 in 2020-11-16T21:54:55.826 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:52 smithi195 bash[10218]: cluster 2020-11-16T21:54:51.438256+0000 mgr.x (mgr.24115) 7 : cluster [DBG] pgmap v8: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:54:55.826 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:52 smithi195 bash[10218]: audit 2020-11-16T21:54:51.444712+0000 mon.b (mon.1) 57 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:55.827 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:53 smithi195 bash[10218]: audit 2020-11-16T21:54:52.443818+0000 mon.b (mon.1) 58 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:55.827 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:53 smithi195 bash[10218]: audit 2020-11-16T21:54:52.452945+0000 mon.b (mon.1) 59 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:55.827 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:53 smithi195 bash[10218]: cluster 2020-11-16T21:54:52.453278+0000 mon.a (mon.0) 344 : cluster [INF] osd.0 v1:172.21.15.195:6800/3519378370 boot 2020-11-16T21:54:55.827 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:53 smithi195 bash[10218]: cluster 2020-11-16T21:54:52.453363+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2020-11-16T21:54:55.827 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:53 smithi195 bash[10218]: audit 2020-11-16T21:54:53.171031+0000 mon.b (mon.1) 60 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:54:55.827 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:53 smithi195 bash[10218]: audit 2020-11-16T21:54:53.174672+0000 mon.b (mon.1) 61 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:54:55.827 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:53 smithi195 bash[10218]: audit 2020-11-16T21:54:53.176122+0000 mon.b (mon.1) 62 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:54:55.828 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:53 smithi195 bash[10218]: audit 2020-11-16T21:54:53.177828+0000 mon.b (mon.1) 63 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:54:55.828 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:54 smithi195 bash[10218]: audit 2020-11-16T21:54:53.168917+0000 mgr.x (mgr.24115) 8 : audit [DBG] from='client.14238 v1:172.21.15.195:0/142831537' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:54:55.828 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:54 smithi195 bash[10218]: cephadm 2020-11-16T21:54:53.172376+0000 mgr.x (mgr.24115) 9 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:54:55.828 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:54 smithi195 bash[10218]: cephadm 2020-11-16T21:54:53.172605+0000 mgr.x (mgr.24115) 10 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:54:55.828 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:54 smithi195 bash[10218]: cephadm 2020-11-16T21:54:53.173810+0000 mgr.x (mgr.24115) 11 : cephadm [INF] Applying None on host smithi195... 2020-11-16T21:54:55.828 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:54 smithi195 bash[10218]: cluster 2020-11-16T21:54:53.438717+0000 mgr.x (mgr.24115) 12 : cluster [DBG] pgmap v10: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:54:55.828 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:54 smithi195 bash[10218]: cluster 2020-11-16T21:54:53.469929+0000 mon.a (mon.0) 346 : cluster [DBG] osdmap e13: 1 total, 1 up, 1 in 2020-11-16T21:54:55.829 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:55 smithi195 bash[10218]: cluster 2020-11-16T21:54:54.468296+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e14: 1 total, 1 up, 1 in 2020-11-16T21:54:55.829 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:51 smithi016 bash[10302]: audit 2020-11-16T21:54:50.433150+0000 mon.b (mon.1) 51 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:55.829 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:51 smithi016 bash[10302]: audit 2020-11-16T21:54:50.434213+0000 mon.a (mon.0) 333 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2020-11-16T21:54:55.829 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:51 smithi016 bash[10302]: cluster 2020-11-16T21:54:50.434288+0000 mon.a (mon.0) 334 : cluster [DBG] osdmap e10: 1 total, 0 up, 0 in 2020-11-16T21:54:55.829 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:51 smithi016 bash[10302]: audit 2020-11-16T21:54:50.435038+0000 mon.c (mon.2) 3 : audit [INF] from='osd.0 v1:172.21.15.195:6800/3519378370' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2020-11-16T21:54:55.830 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:51 smithi016 bash[10302]: audit 2020-11-16T21:54:50.439994+0000 mon.a (mon.0) 335 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2020-11-16T21:54:55.830 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:51 smithi016 bash[10302]: audit 2020-11-16T21:54:50.746977+0000 mon.b (mon.1) 52 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:54:55.830 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:51 smithi016 bash[10302]: audit 2020-11-16T21:54:51.053341+0000 mon.b (mon.1) 53 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:55.830 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:51 smithi016 bash[10302]: audit 2020-11-16T21:54:51.055583+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:54:55.830 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:51 smithi016 bash[10302]: audit 2020-11-16T21:54:51.058727+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}}, \"last_daemon_update\": \"2020-11-16T21:54:43.925249\", \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:54:55.830 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:51 smithi016 bash[10302]: audit 2020-11-16T21:54:51.061350+0000 mon.b (mon.1) 54 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:55.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:51 smithi016 bash[10302]: audit 2020-11-16T21:54:51.063419+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:55.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:51 smithi016 bash[10302]: audit 2020-11-16T21:54:51.068255+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:54:55.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:51 smithi016 bash[10302]: audit 2020-11-16T21:54:51.070930+0000 mon.b (mon.1) 55 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:55.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:51 smithi016 bash[10302]: audit 2020-11-16T21:54:51.072942+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:54:55.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:51 smithi016 bash[10302]: audit 2020-11-16T21:54:51.076193+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:54:55.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:52 smithi016 bash[10302]: cluster 2020-11-16T21:54:50.400122+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:54:55.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:52 smithi016 bash[10302]: cluster 2020-11-16T21:54:50.400284+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:54:55.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:52 smithi016 bash[10302]: audit 2020-11-16T21:54:51.435190+0000 mon.b (mon.1) 56 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:55.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:52 smithi016 bash[10302]: audit 2020-11-16T21:54:51.436227+0000 mon.a (mon.0) 342 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2020-11-16T21:54:55.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:52 smithi016 bash[10302]: cluster 2020-11-16T21:54:51.436326+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e11: 1 total, 0 up, 0 in 2020-11-16T21:54:55.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:52 smithi016 bash[10302]: cluster 2020-11-16T21:54:51.438256+0000 mgr.x (mgr.24115) 7 : cluster [DBG] pgmap v8: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:54:55.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:52 smithi016 bash[10302]: audit 2020-11-16T21:54:51.444712+0000 mon.b (mon.1) 57 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:55.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:53 smithi016 bash[10302]: audit 2020-11-16T21:54:52.443818+0000 mon.b (mon.1) 58 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:55.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:53 smithi016 bash[10302]: audit 2020-11-16T21:54:52.452945+0000 mon.b (mon.1) 59 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:55.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:53 smithi016 bash[10302]: cluster 2020-11-16T21:54:52.453278+0000 mon.a (mon.0) 344 : cluster [INF] osd.0 v1:172.21.15.195:6800/3519378370 boot 2020-11-16T21:54:55.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:53 smithi016 bash[10302]: cluster 2020-11-16T21:54:52.453363+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2020-11-16T21:54:55.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:53 smithi016 bash[10302]: audit 2020-11-16T21:54:53.171031+0000 mon.b (mon.1) 60 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:54:55.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:53 smithi016 bash[10302]: audit 2020-11-16T21:54:53.174672+0000 mon.b (mon.1) 61 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:54:55.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:53 smithi016 bash[10302]: audit 2020-11-16T21:54:53.176122+0000 mon.b (mon.1) 62 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:54:55.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:53 smithi016 bash[10302]: audit 2020-11-16T21:54:53.177828+0000 mon.b (mon.1) 63 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:54:55.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:54 smithi016 bash[10302]: audit 2020-11-16T21:54:53.168917+0000 mgr.x (mgr.24115) 8 : audit [DBG] from='client.14238 v1:172.21.15.195:0/142831537' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:54:55.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:54 smithi016 bash[10302]: cephadm 2020-11-16T21:54:53.172376+0000 mgr.x (mgr.24115) 9 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:54:55.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:54 smithi016 bash[10302]: cephadm 2020-11-16T21:54:53.172605+0000 mgr.x (mgr.24115) 10 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:54:55.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:54 smithi016 bash[10302]: cephadm 2020-11-16T21:54:53.173810+0000 mgr.x (mgr.24115) 11 : cephadm [INF] Applying None on host smithi195... 2020-11-16T21:54:55.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:54 smithi016 bash[10302]: cluster 2020-11-16T21:54:53.438717+0000 mgr.x (mgr.24115) 12 : cluster [DBG] pgmap v10: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:54:55.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:54 smithi016 bash[10302]: cluster 2020-11-16T21:54:53.469929+0000 mon.a (mon.0) 346 : cluster [DBG] osdmap e13: 1 total, 1 up, 1 in 2020-11-16T21:54:55.834 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:52 smithi057 bash[10301]: cluster 2020-11-16T21:54:50.400122+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:54:55.835 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:52 smithi057 bash[10301]: cluster 2020-11-16T21:54:50.400284+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:54:55.835 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:52 smithi057 bash[10301]: audit 2020-11-16T21:54:51.435190+0000 mon.b (mon.1) 56 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:55.835 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:52 smithi057 bash[10301]: audit 2020-11-16T21:54:51.436227+0000 mon.a (mon.0) 342 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2020-11-16T21:54:55.835 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:52 smithi057 bash[10301]: cluster 2020-11-16T21:54:51.436326+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e11: 1 total, 0 up, 0 in 2020-11-16T21:54:55.835 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:52 smithi057 bash[10301]: cluster 2020-11-16T21:54:51.438256+0000 mgr.x (mgr.24115) 7 : cluster [DBG] pgmap v8: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:54:55.835 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:52 smithi057 bash[10301]: audit 2020-11-16T21:54:51.444712+0000 mon.b (mon.1) 57 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:55.835 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:53 smithi057 bash[10301]: audit 2020-11-16T21:54:52.443818+0000 mon.b (mon.1) 58 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:55.836 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:53 smithi057 bash[10301]: audit 2020-11-16T21:54:52.452945+0000 mon.b (mon.1) 59 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2020-11-16T21:54:55.836 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:53 smithi057 bash[10301]: cluster 2020-11-16T21:54:52.453278+0000 mon.a (mon.0) 344 : cluster [INF] osd.0 v1:172.21.15.195:6800/3519378370 boot 2020-11-16T21:54:55.836 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:53 smithi057 bash[10301]: cluster 2020-11-16T21:54:52.453363+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2020-11-16T21:54:55.836 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:53 smithi057 bash[10301]: audit 2020-11-16T21:54:53.171031+0000 mon.b (mon.1) 60 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:54:55.836 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:53 smithi057 bash[10301]: audit 2020-11-16T21:54:53.174672+0000 mon.b (mon.1) 61 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:54:55.836 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:53 smithi057 bash[10301]: audit 2020-11-16T21:54:53.176122+0000 mon.b (mon.1) 62 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:54:55.836 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:53 smithi057 bash[10301]: audit 2020-11-16T21:54:53.177828+0000 mon.b (mon.1) 63 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:54:55.837 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:54 smithi057 bash[10301]: audit 2020-11-16T21:54:53.168917+0000 mgr.x (mgr.24115) 8 : audit [DBG] from='client.14238 v1:172.21.15.195:0/142831537' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:54:55.837 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:54 smithi057 bash[10301]: cephadm 2020-11-16T21:54:53.172376+0000 mgr.x (mgr.24115) 9 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:54:55.837 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:54 smithi057 bash[10301]: cephadm 2020-11-16T21:54:53.172605+0000 mgr.x (mgr.24115) 10 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:54:55.837 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:54 smithi057 bash[10301]: cephadm 2020-11-16T21:54:53.173810+0000 mgr.x (mgr.24115) 11 : cephadm [INF] Applying None on host smithi195... 2020-11-16T21:54:55.837 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:54 smithi057 bash[10301]: cluster 2020-11-16T21:54:53.438717+0000 mgr.x (mgr.24115) 12 : cluster [DBG] pgmap v10: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2020-11-16T21:54:55.837 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:54 smithi057 bash[10301]: cluster 2020-11-16T21:54:53.469929+0000 mon.a (mon.0) 346 : cluster [DBG] osdmap e13: 1 total, 1 up, 1 in 2020-11-16T21:54:55.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:55 smithi016 bash[10302]: cluster 2020-11-16T21:54:54.468296+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e14: 1 total, 1 up, 1 in 2020-11-16T21:54:55.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:55 smithi057 bash[10301]: cluster 2020-11-16T21:54:54.468296+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e14: 1 total, 1 up, 1 in 2020-11-16T21:54:56.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:56 smithi016 bash[10302]: cluster 2020-11-16T21:54:55.439302+0000 mgr.x (mgr.24115) 13 : cluster [DBG] pgmap v13: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:54:56.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:56 smithi016 bash[10302]: cluster 2020-11-16T21:54:55.471499+0000 mon.a (mon.0) 348 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2020-11-16T21:54:56.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:56 smithi195 bash[10218]: cluster 2020-11-16T21:54:55.439302+0000 mgr.x (mgr.24115) 13 : cluster [DBG] pgmap v13: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:54:56.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:56 smithi195 bash[10218]: cluster 2020-11-16T21:54:55.471499+0000 mon.a (mon.0) 348 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2020-11-16T21:54:56.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:56 smithi057 bash[10301]: cluster 2020-11-16T21:54:55.439302+0000 mgr.x (mgr.24115) 13 : cluster [DBG] pgmap v13: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:54:56.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:56 smithi057 bash[10301]: cluster 2020-11-16T21:54:55.471499+0000 mon.a (mon.0) 348 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2020-11-16T21:54:57.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:57 smithi016 bash[10302]: audit 2020-11-16T21:54:56.691557+0000 mon.a (mon.0) 349 : audit [INF] from='client.? v1:172.21.15.195:0/2129514284' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1"}]: dispatch 2020-11-16T21:54:57.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:57 smithi016 bash[10302]: audit 2020-11-16T21:54:56.697337+0000 mon.b (mon.1) 64 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-11-16T21:54:57.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:57 smithi016 bash[10302]: audit 2020-11-16T21:54:56.698421+0000 mon.a (mon.0) 350 : audit [INF] from='client.? v1:172.21.15.195:0/2129514284' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1"}]': finished 2020-11-16T21:54:57.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:57 smithi016 bash[10302]: cluster 2020-11-16T21:54:56.698482+0000 mon.a (mon.0) 351 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2020-11-16T21:54:57.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:57 smithi016 bash[10302]: audit 2020-11-16T21:54:57.372799+0000 mon.a (mon.0) 352 : audit [DBG] from='client.? v1:172.21.15.195:0/1191137594' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:54:57.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:57 smithi195 bash[10218]: audit 2020-11-16T21:54:56.691557+0000 mon.a (mon.0) 349 : audit [INF] from='client.? v1:172.21.15.195:0/2129514284' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1"}]: dispatch 2020-11-16T21:54:57.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:57 smithi195 bash[10218]: audit 2020-11-16T21:54:56.697337+0000 mon.b (mon.1) 64 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-11-16T21:54:57.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:57 smithi195 bash[10218]: audit 2020-11-16T21:54:56.698421+0000 mon.a (mon.0) 350 : audit [INF] from='client.? v1:172.21.15.195:0/2129514284' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1"}]': finished 2020-11-16T21:54:57.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:57 smithi195 bash[10218]: cluster 2020-11-16T21:54:56.698482+0000 mon.a (mon.0) 351 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2020-11-16T21:54:57.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:57 smithi195 bash[10218]: audit 2020-11-16T21:54:57.372799+0000 mon.a (mon.0) 352 : audit [DBG] from='client.? v1:172.21.15.195:0/1191137594' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:54:57.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:57 smithi057 bash[10301]: audit 2020-11-16T21:54:56.691557+0000 mon.a (mon.0) 349 : audit [INF] from='client.? v1:172.21.15.195:0/2129514284' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1"}]: dispatch 2020-11-16T21:54:57.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:57 smithi057 bash[10301]: audit 2020-11-16T21:54:56.697337+0000 mon.b (mon.1) 64 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-11-16T21:54:57.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:57 smithi057 bash[10301]: audit 2020-11-16T21:54:56.698421+0000 mon.a (mon.0) 350 : audit [INF] from='client.? v1:172.21.15.195:0/2129514284' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1"}]': finished 2020-11-16T21:54:57.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:57 smithi057 bash[10301]: cluster 2020-11-16T21:54:56.698482+0000 mon.a (mon.0) 351 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2020-11-16T21:54:57.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:57 smithi057 bash[10301]: audit 2020-11-16T21:54:57.372799+0000 mon.a (mon.0) 352 : audit [DBG] from='client.? v1:172.21.15.195:0/1191137594' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:54:58.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:54:58 smithi057 bash[10301]: cluster 2020-11-16T21:54:57.439834+0000 mgr.x (mgr.24115) 14 : cluster [DBG] pgmap v15: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:54:59.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:54:58 smithi016 bash[10302]: cluster 2020-11-16T21:54:57.439834+0000 mgr.x (mgr.24115) 14 : cluster [DBG] pgmap v15: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:54:59.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:54:58 smithi195 bash[10218]: cluster 2020-11-16T21:54:57.439834+0000 mgr.x (mgr.24115) 14 : cluster [DBG] pgmap v15: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:00.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:00 smithi057 bash[10301]: cluster 2020-11-16T21:54:59.440524+0000 mgr.x (mgr.24115) 15 : cluster [DBG] pgmap v16: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:00.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:00 smithi057 bash[10301]: audit 2020-11-16T21:55:00.398156+0000 mon.b (mon.1) 65 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:00.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:00 smithi016 bash[10302]: cluster 2020-11-16T21:54:59.440524+0000 mgr.x (mgr.24115) 15 : cluster [DBG] pgmap v16: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:00.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:00 smithi016 bash[10302]: audit 2020-11-16T21:55:00.398156+0000 mon.b (mon.1) 65 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:00.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:00 smithi195 bash[10218]: cluster 2020-11-16T21:54:59.440524+0000 mgr.x (mgr.24115) 15 : cluster [DBG] pgmap v16: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:00.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:00 smithi195 bash[10218]: audit 2020-11-16T21:55:00.398156+0000 mon.b (mon.1) 65 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:02.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:02 smithi016 bash[10302]: cluster 2020-11-16T21:55:01.441111+0000 mgr.x (mgr.24115) 16 : cluster [DBG] pgmap v17: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:02.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:02 smithi195 bash[10218]: cluster 2020-11-16T21:55:01.441111+0000 mgr.x (mgr.24115) 16 : cluster [DBG] pgmap v17: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:02.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:02 smithi057 bash[10301]: cluster 2020-11-16T21:55:01.441111+0000 mgr.x (mgr.24115) 16 : cluster [DBG] pgmap v17: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:04.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:04 smithi016 bash[10302]: cluster 2020-11-16T21:55:03.441688+0000 mgr.x (mgr.24115) 17 : cluster [DBG] pgmap v18: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:04.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:04 smithi016 bash[10302]: audit 2020-11-16T21:55:04.233964+0000 mon.b (mon.1) 66 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2020-11-16T21:55:04.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:04 smithi016 bash[10302]: audit 2020-11-16T21:55:04.235564+0000 mon.b (mon.1) 67 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:55:04.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:04 smithi016 bash[10302]: audit 2020-11-16T21:55:04.237443+0000 mon.b (mon.1) 68 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2020-11-16T21:55:04.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:04 smithi016 bash[10302]: cluster 2020-11-16T21:55:04.423039+0000 mon.a (mon.0) 353 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2020-11-16T21:55:04.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:04 smithi195 bash[10218]: cluster 2020-11-16T21:55:03.441688+0000 mgr.x (mgr.24115) 17 : cluster [DBG] pgmap v18: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:04.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:04 smithi195 bash[10218]: audit 2020-11-16T21:55:04.233964+0000 mon.b (mon.1) 66 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2020-11-16T21:55:04.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:04 smithi195 bash[10218]: audit 2020-11-16T21:55:04.235564+0000 mon.b (mon.1) 67 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:55:04.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:04 smithi195 bash[10218]: audit 2020-11-16T21:55:04.237443+0000 mon.b (mon.1) 68 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2020-11-16T21:55:04.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:04 smithi195 bash[10218]: cluster 2020-11-16T21:55:04.423039+0000 mon.a (mon.0) 353 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2020-11-16T21:55:04.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:04 smithi057 bash[10301]: cluster 2020-11-16T21:55:03.441688+0000 mgr.x (mgr.24115) 17 : cluster [DBG] pgmap v18: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:04.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:04 smithi057 bash[10301]: audit 2020-11-16T21:55:04.233964+0000 mon.b (mon.1) 66 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2020-11-16T21:55:04.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:04 smithi057 bash[10301]: audit 2020-11-16T21:55:04.235564+0000 mon.b (mon.1) 67 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:55:04.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:04 smithi057 bash[10301]: audit 2020-11-16T21:55:04.237443+0000 mon.b (mon.1) 68 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2020-11-16T21:55:04.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:04 smithi057 bash[10301]: cluster 2020-11-16T21:55:04.423039+0000 mon.a (mon.0) 353 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2020-11-16T21:55:05.673 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:05 smithi195 bash[10218]: cephadm 2020-11-16T21:55:04.236812+0000 mgr.x (mgr.24115) 18 : cephadm [INF] Deploying daemon osd.1 on smithi195 2020-11-16T21:55:05.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:05 smithi016 bash[10302]: cephadm 2020-11-16T21:55:04.236812+0000 mgr.x (mgr.24115) 18 : cephadm [INF] Deploying daemon osd.1 on smithi195 2020-11-16T21:55:05.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:05 smithi057 bash[10301]: cephadm 2020-11-16T21:55:04.236812+0000 mgr.x (mgr.24115) 18 : cephadm [INF] Deploying daemon osd.1 on smithi195 2020-11-16T21:55:06.508 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 1 on host 'smithi195' 2020-11-16T21:55:06.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:06 smithi016 bash[10302]: cluster 2020-11-16T21:55:05.442366+0000 mgr.x (mgr.24115) 19 : cluster [DBG] pgmap v19: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:06.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:06 smithi016 bash[10302]: audit 2020-11-16T21:55:06.514383+0000 mon.b (mon.1) 69 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:06.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:06 smithi016 bash[10302]: audit 2020-11-16T21:55:06.515357+0000 mon.b (mon.1) 70 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:55:06.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:06 smithi016 bash[10302]: audit 2020-11-16T21:55:06.516651+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:06.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:06 smithi016 bash[10302]: audit 2020-11-16T21:55:06.520055+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:06.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:06 smithi195 bash[10218]: cluster 2020-11-16T21:55:05.442366+0000 mgr.x (mgr.24115) 19 : cluster [DBG] pgmap v19: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:06.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:06 smithi195 bash[10218]: audit 2020-11-16T21:55:06.514383+0000 mon.b (mon.1) 69 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:06.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:06 smithi195 bash[10218]: audit 2020-11-16T21:55:06.515357+0000 mon.b (mon.1) 70 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:55:06.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:06 smithi195 bash[10218]: audit 2020-11-16T21:55:06.516651+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:06.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:06 smithi195 bash[10218]: audit 2020-11-16T21:55:06.520055+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:06.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:06 smithi057 bash[10301]: cluster 2020-11-16T21:55:05.442366+0000 mgr.x (mgr.24115) 19 : cluster [DBG] pgmap v19: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:06.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:06 smithi057 bash[10301]: audit 2020-11-16T21:55:06.514383+0000 mon.b (mon.1) 69 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:06.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:06 smithi057 bash[10301]: audit 2020-11-16T21:55:06.515357+0000 mon.b (mon.1) 70 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:55:06.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:06 smithi057 bash[10301]: audit 2020-11-16T21:55:06.516651+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:06.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:06 smithi057 bash[10301]: audit 2020-11-16T21:55:06.520055+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924782\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:43.924989\", \"created\": \"2020-11-16T21:54:43.217881\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_device_update\": \"2020-11-16T21:54:51.051886\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:07.579 INFO:teuthology.orchestra.run.smithi195:osd.1> sudo journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.1.service 2020-11-16T21:55:07.581 INFO:tasks.cephadm:Deploying osd.2 on smithi195 with /dev/vg_nvme/lv_2... 2020-11-16T21:55:07.582 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2020-11-16T21:55:07.651 INFO:journalctl@ceph.osd.1.smithi195.stdout:-- Logs begin at Sun 2020-11-15 12:21:41 UTC. -- 2020-11-16T21:55:07.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:07 smithi016 bash[10302]: audit 2020-11-16T21:55:07.245372+0000 mon.b (mon.1) 71 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:07.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:07 smithi016 bash[10302]: audit 2020-11-16T21:55:07.247875+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:07.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:07 smithi016 bash[10302]: audit 2020-11-16T21:55:07.251404+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:07.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:07 smithi016 bash[10302]: audit 2020-11-16T21:55:07.253174+0000 mon.b (mon.1) 72 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:07.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:07 smithi195 bash[10218]: audit 2020-11-16T21:55:07.245372+0000 mon.b (mon.1) 71 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:07.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:07 smithi195 bash[10218]: audit 2020-11-16T21:55:07.247875+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:07.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:07 smithi195 bash[10218]: audit 2020-11-16T21:55:07.251404+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:07.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:07 smithi195 bash[10218]: audit 2020-11-16T21:55:07.253174+0000 mon.b (mon.1) 72 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:07.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:07 smithi057 bash[10301]: audit 2020-11-16T21:55:07.245372+0000 mon.b (mon.1) 71 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:07.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:07 smithi057 bash[10301]: audit 2020-11-16T21:55:07.247875+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:07.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:07 smithi057 bash[10301]: audit 2020-11-16T21:55:07.251404+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:07.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:07 smithi057 bash[10301]: audit 2020-11-16T21:55:07.253174+0000 mon.b (mon.1) 72 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:08.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:08 smithi016 bash[10302]: cluster 2020-11-16T21:55:07.442976+0000 mgr.x (mgr.24115) 20 : cluster [DBG] pgmap v20: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:08.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:08 smithi195 bash[10218]: cluster 2020-11-16T21:55:07.442976+0000 mgr.x (mgr.24115) 20 : cluster [DBG] pgmap v20: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:08.844 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 21:55:08 smithi195 bash[18679]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-11-16T21:55:08.845 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 21:55:08 smithi195 bash[18679]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2020-11-16T21:55:08.845 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 21:55:08 smithi195 bash[18679]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2020-11-16T21:55:08.845 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 21:55:08 smithi195 bash[18679]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2020-11-16T21:55:08.845 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 21:55:08 smithi195 bash[18679]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2020-11-16T21:55:08.845 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 21:55:08 smithi195 bash[18679]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-11-16T21:55:08.845 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 21:55:08 smithi195 bash[18679]: --> ceph-volume lvm activate successful for osd ID: 1 2020-11-16T21:55:08.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:08 smithi057 bash[10301]: cluster 2020-11-16T21:55:07.442976+0000 mgr.x (mgr.24115) 20 : cluster [DBG] pgmap v20: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:09.845 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 21:55:09 smithi195 bash[18679]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.1 2020-11-16T21:55:10.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:10 smithi057 bash[10301]: cluster 2020-11-16T21:55:09.443563+0000 mgr.x (mgr.24115) 21 : cluster [DBG] pgmap v21: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:10.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:10 smithi016 bash[10302]: cluster 2020-11-16T21:55:09.443563+0000 mgr.x (mgr.24115) 21 : cluster [DBG] pgmap v21: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:10.865 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:10 smithi195 bash[10218]: cluster 2020-11-16T21:55:09.443563+0000 mgr.x (mgr.24115) 21 : cluster [DBG] pgmap v21: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:12.094 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 21:55:11 smithi195 bash[18679]: debug 2020-11-16T21:55:11.721+0000 7f9968e75700 10 -- 172.21.15.195:0/2934778376 dispatch_throttle_release 308 to dispatch throttler 502/104857600 2020-11-16T21:55:12.095 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 21:55:11 smithi195 bash[18679]: debug 2020-11-16T21:55:11.721+0000 7f9968e75700 20 -- 172.21.15.195:0/2934778376 done calling dispatch on 0x55a844f56c60 2020-11-16T21:55:12.095 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 21:55:11 smithi195 bash[18679]: debug 2020-11-16T21:55:11.721+0000 7f9968e75700 1 -- 172.21.15.195:0/2934778376 <== mon.0 v1:172.21.15.195:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (unknown 3702080980 0 0) 0x55a844f60340 con 0x55a844fdb400 2020-11-16T21:55:12.095 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 21:55:11 smithi195 bash[18679]: debug 2020-11-16T21:55:11.721+0000 7f9968e75700 10 -- 172.21.15.195:0/2934778376 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2020-11-16T21:55:12.095 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 21:55:11 smithi195 bash[18679]: debug 2020-11-16T21:55:11.721+0000 7f9968e75700 20 -- 172.21.15.195:0/2934778376 done calling dispatch on 0x55a844f60340 2020-11-16T21:55:12.580 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 21:55:12 smithi195 bash[18679]: debug 2020-11-16T21:55:12.265+0000 7f99708f5f40 -1 Falling back to public interface 2020-11-16T21:55:12.580 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:12 smithi195 bash[10218]: cluster 2020-11-16T21:55:11.444186+0000 mgr.x (mgr.24115) 22 : cluster [DBG] pgmap v22: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:12.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:12 smithi016 bash[10302]: cluster 2020-11-16T21:55:11.444186+0000 mgr.x (mgr.24115) 22 : cluster [DBG] pgmap v22: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:12.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:12 smithi057 bash[10301]: cluster 2020-11-16T21:55:11.444186+0000 mgr.x (mgr.24115) 22 : cluster [DBG] pgmap v22: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:12.979 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_2 2020-11-16T21:55:12.979 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2020-11-16T21:55:12.980 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2020-11-16T21:55:12.980 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2020-11-16T21:55:12.980 INFO:teuthology.orchestra.run.smithi195.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00988549 s, 1.1 GB/s 2020-11-16T21:55:12.980 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2020-11-16T21:55:13.344 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 21:55:12 smithi195 bash[18679]: debug 2020-11-16T21:55:12.877+0000 7f99708f5f40 -1 osd.1 0 log_to_monitors {default=true} 2020-11-16T21:55:13.649 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch daemon add osd smithi195:vg_nvme/lv_2 2020-11-16T21:55:13.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:13 smithi016 bash[10302]: audit 2020-11-16T21:55:12.888752+0000 mon.a (mon.0) 358 : audit [INF] from='osd.1 v1:172.21.15.195:6804/2842524876' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-11-16T21:55:13.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:13 smithi195 bash[10218]: audit 2020-11-16T21:55:12.888752+0000 mon.a (mon.0) 358 : audit [INF] from='osd.1 v1:172.21.15.195:6804/2842524876' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-11-16T21:55:13.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:13 smithi057 bash[10301]: audit 2020-11-16T21:55:12.888752+0000 mon.a (mon.0) 358 : audit [INF] from='osd.1 v1:172.21.15.195:6804/2842524876' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2020-11-16T21:55:14.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:14 smithi016 bash[10302]: cluster 2020-11-16T21:55:13.444881+0000 mgr.x (mgr.24115) 23 : cluster [DBG] pgmap v23: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:14.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:14 smithi016 bash[10302]: audit 2020-11-16T21:55:13.513696+0000 mon.a (mon.0) 359 : audit [INF] from='osd.1 v1:172.21.15.195:6804/2842524876' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2020-11-16T21:55:14.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:14 smithi016 bash[10302]: cluster 2020-11-16T21:55:13.513733+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e16: 2 total, 1 up, 1 in 2020-11-16T21:55:14.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:14 smithi016 bash[10302]: audit 2020-11-16T21:55:13.514491+0000 mon.a (mon.0) 361 : audit [INF] from='osd.1 v1:172.21.15.195:6804/2842524876' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2020-11-16T21:55:14.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:14 smithi016 bash[10302]: audit 2020-11-16T21:55:13.514684+0000 mon.b (mon.1) 73 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-11-16T21:55:14.844 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 21:55:14 smithi195 bash[18679]: debug 2020-11-16T21:55:14.517+0000 7f9968674700 -1 osd.1 0 waiting for initial osdmap 2020-11-16T21:55:14.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:14 smithi195 bash[10218]: cluster 2020-11-16T21:55:13.444881+0000 mgr.x (mgr.24115) 23 : cluster [DBG] pgmap v23: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:14.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:14 smithi195 bash[10218]: audit 2020-11-16T21:55:13.513696+0000 mon.a (mon.0) 359 : audit [INF] from='osd.1 v1:172.21.15.195:6804/2842524876' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2020-11-16T21:55:14.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:14 smithi195 bash[10218]: cluster 2020-11-16T21:55:13.513733+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e16: 2 total, 1 up, 1 in 2020-11-16T21:55:14.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:14 smithi195 bash[10218]: audit 2020-11-16T21:55:13.514491+0000 mon.a (mon.0) 361 : audit [INF] from='osd.1 v1:172.21.15.195:6804/2842524876' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2020-11-16T21:55:14.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:14 smithi195 bash[10218]: audit 2020-11-16T21:55:13.514684+0000 mon.b (mon.1) 73 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-11-16T21:55:14.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:14 smithi057 bash[10301]: cluster 2020-11-16T21:55:13.444881+0000 mgr.x (mgr.24115) 23 : cluster [DBG] pgmap v23: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:14.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:14 smithi057 bash[10301]: audit 2020-11-16T21:55:13.513696+0000 mon.a (mon.0) 359 : audit [INF] from='osd.1 v1:172.21.15.195:6804/2842524876' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2020-11-16T21:55:14.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:14 smithi057 bash[10301]: cluster 2020-11-16T21:55:13.513733+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e16: 2 total, 1 up, 1 in 2020-11-16T21:55:14.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:14 smithi057 bash[10301]: audit 2020-11-16T21:55:13.514491+0000 mon.a (mon.0) 361 : audit [INF] from='osd.1 v1:172.21.15.195:6804/2842524876' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2020-11-16T21:55:14.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:14 smithi057 bash[10301]: audit 2020-11-16T21:55:13.514684+0000 mon.b (mon.1) 73 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-11-16T21:55:15.595 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:15 smithi195 bash[10218]: audit 2020-11-16T21:55:14.517185+0000 mon.b (mon.1) 74 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-11-16T21:55:15.595 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:15 smithi195 bash[10218]: audit 2020-11-16T21:55:14.518390+0000 mon.a (mon.0) 362 : audit [INF] from='osd.1 v1:172.21.15.195:6804/2842524876' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2020-11-16T21:55:15.596 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:15 smithi195 bash[10218]: cluster 2020-11-16T21:55:14.518472+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e17: 2 total, 1 up, 1 in 2020-11-16T21:55:15.596 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:15 smithi195 bash[10218]: audit 2020-11-16T21:55:14.526916+0000 mon.b (mon.1) 75 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-11-16T21:55:15.596 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:15 smithi195 bash[10218]: audit 2020-11-16T21:55:14.925849+0000 mon.b (mon.1) 76 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:55:15.596 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:15 smithi195 bash[10218]: audit 2020-11-16T21:55:15.230645+0000 mon.b (mon.1) 77 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:15.596 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:15 smithi195 bash[10218]: audit 2020-11-16T21:55:15.233071+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:15.596 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:15 smithi195 bash[10218]: audit 2020-11-16T21:55:15.236745+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:15.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:15 smithi195 bash[10218]: audit 2020-11-16T21:55:15.238377+0000 mon.b (mon.1) 78 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:15.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:15 smithi195 bash[10218]: audit 2020-11-16T21:55:15.240370+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:15.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:15 smithi195 bash[10218]: audit 2020-11-16T21:55:15.244879+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:55:15.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:15 smithi195 bash[10218]: audit 2020-11-16T21:55:15.247318+0000 mon.b (mon.1) 79 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:15.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:15 smithi195 bash[10218]: audit 2020-11-16T21:55:15.249268+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:15.597 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:15 smithi195 bash[10218]: audit 2020-11-16T21:55:15.253024+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:55:15.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:15 smithi016 bash[10302]: audit 2020-11-16T21:55:14.517185+0000 mon.b (mon.1) 74 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-11-16T21:55:15.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:15 smithi016 bash[10302]: audit 2020-11-16T21:55:14.518390+0000 mon.a (mon.0) 362 : audit [INF] from='osd.1 v1:172.21.15.195:6804/2842524876' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2020-11-16T21:55:15.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:15 smithi016 bash[10302]: cluster 2020-11-16T21:55:14.518472+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e17: 2 total, 1 up, 1 in 2020-11-16T21:55:15.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:15 smithi016 bash[10302]: audit 2020-11-16T21:55:14.526916+0000 mon.b (mon.1) 75 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-11-16T21:55:15.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:15 smithi016 bash[10302]: audit 2020-11-16T21:55:14.925849+0000 mon.b (mon.1) 76 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:55:15.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:15 smithi016 bash[10302]: audit 2020-11-16T21:55:15.230645+0000 mon.b (mon.1) 77 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:15.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:15 smithi016 bash[10302]: audit 2020-11-16T21:55:15.233071+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:15.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:15 smithi016 bash[10302]: audit 2020-11-16T21:55:15.236745+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:15.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:15 smithi016 bash[10302]: audit 2020-11-16T21:55:15.238377+0000 mon.b (mon.1) 78 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:15.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:15 smithi016 bash[10302]: audit 2020-11-16T21:55:15.240370+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:15.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:15 smithi016 bash[10302]: audit 2020-11-16T21:55:15.244879+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:55:15.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:15 smithi016 bash[10302]: audit 2020-11-16T21:55:15.247318+0000 mon.b (mon.1) 79 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:15.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:15 smithi016 bash[10302]: audit 2020-11-16T21:55:15.249268+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:15.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:15 smithi016 bash[10302]: audit 2020-11-16T21:55:15.253024+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:55:15.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:15 smithi057 bash[10301]: audit 2020-11-16T21:55:14.517185+0000 mon.b (mon.1) 74 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-11-16T21:55:15.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:15 smithi057 bash[10301]: audit 2020-11-16T21:55:14.518390+0000 mon.a (mon.0) 362 : audit [INF] from='osd.1 v1:172.21.15.195:6804/2842524876' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2020-11-16T21:55:15.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:15 smithi057 bash[10301]: cluster 2020-11-16T21:55:14.518472+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e17: 2 total, 1 up, 1 in 2020-11-16T21:55:15.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:15 smithi057 bash[10301]: audit 2020-11-16T21:55:14.526916+0000 mon.b (mon.1) 75 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-11-16T21:55:15.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:15 smithi057 bash[10301]: audit 2020-11-16T21:55:14.925849+0000 mon.b (mon.1) 76 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:55:15.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:15 smithi057 bash[10301]: audit 2020-11-16T21:55:15.230645+0000 mon.b (mon.1) 77 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:15.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:15 smithi057 bash[10301]: audit 2020-11-16T21:55:15.233071+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:15.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:15 smithi057 bash[10301]: audit 2020-11-16T21:55:15.236745+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}}, \"last_daemon_update\": \"2020-11-16T21:55:07.244068\", \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:15.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:15 smithi057 bash[10301]: audit 2020-11-16T21:55:15.238377+0000 mon.b (mon.1) 78 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:15.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:15 smithi057 bash[10301]: audit 2020-11-16T21:55:15.240370+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:15.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:15 smithi057 bash[10301]: audit 2020-11-16T21:55:15.244879+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:55:15.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:15 smithi057 bash[10301]: audit 2020-11-16T21:55:15.247318+0000 mon.b (mon.1) 79 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:15.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:15 smithi057 bash[10301]: audit 2020-11-16T21:55:15.249268+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:15.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:15 smithi057 bash[10301]: audit 2020-11-16T21:55:15.253024+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:55:16.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:16 smithi016 bash[10302]: cluster 2020-11-16T21:55:13.926909+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:55:16.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:16 smithi016 bash[10302]: cluster 2020-11-16T21:55:13.927062+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:55:16.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:16 smithi016 bash[10302]: cluster 2020-11-16T21:55:15.445500+0000 mgr.x (mgr.24115) 24 : cluster [DBG] pgmap v26: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:16.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:16 smithi016 bash[10302]: audit 2020-11-16T21:55:15.526887+0000 mon.b (mon.1) 80 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-11-16T21:55:16.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:16 smithi016 bash[10302]: cluster 2020-11-16T21:55:15.527928+0000 mon.a (mon.0) 370 : cluster [INF] osd.1 v1:172.21.15.195:6804/2842524876 boot 2020-11-16T21:55:16.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:16 smithi016 bash[10302]: cluster 2020-11-16T21:55:15.528015+0000 mon.a (mon.0) 371 : cluster [DBG] osdmap e18: 2 total, 2 up, 2 in 2020-11-16T21:55:16.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:16 smithi195 bash[10218]: cluster 2020-11-16T21:55:13.926909+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:55:16.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:16 smithi195 bash[10218]: cluster 2020-11-16T21:55:13.927062+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:55:16.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:16 smithi195 bash[10218]: cluster 2020-11-16T21:55:15.445500+0000 mgr.x (mgr.24115) 24 : cluster [DBG] pgmap v26: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:16.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:16 smithi195 bash[10218]: audit 2020-11-16T21:55:15.526887+0000 mon.b (mon.1) 80 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-11-16T21:55:16.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:16 smithi195 bash[10218]: cluster 2020-11-16T21:55:15.527928+0000 mon.a (mon.0) 370 : cluster [INF] osd.1 v1:172.21.15.195:6804/2842524876 boot 2020-11-16T21:55:16.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:16 smithi195 bash[10218]: cluster 2020-11-16T21:55:15.528015+0000 mon.a (mon.0) 371 : cluster [DBG] osdmap e18: 2 total, 2 up, 2 in 2020-11-16T21:55:16.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:16 smithi057 bash[10301]: cluster 2020-11-16T21:55:13.926909+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:55:16.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:16 smithi057 bash[10301]: cluster 2020-11-16T21:55:13.927062+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:55:16.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:16 smithi057 bash[10301]: cluster 2020-11-16T21:55:15.445500+0000 mgr.x (mgr.24115) 24 : cluster [DBG] pgmap v26: 1 pgs: 1 undersized+peered; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2020-11-16T21:55:16.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:16 smithi057 bash[10301]: audit 2020-11-16T21:55:15.526887+0000 mon.b (mon.1) 80 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2020-11-16T21:55:16.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:16 smithi057 bash[10301]: cluster 2020-11-16T21:55:15.527928+0000 mon.a (mon.0) 370 : cluster [INF] osd.1 v1:172.21.15.195:6804/2842524876 boot 2020-11-16T21:55:16.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:16 smithi057 bash[10301]: cluster 2020-11-16T21:55:15.528015+0000 mon.a (mon.0) 371 : cluster [DBG] osdmap e18: 2 total, 2 up, 2 in 2020-11-16T21:55:17.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:17 smithi016 bash[10302]: cluster 2020-11-16T21:55:16.545437+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e19: 2 total, 2 up, 2 in 2020-11-16T21:55:17.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:17 smithi016 bash[10302]: audit 2020-11-16T21:55:17.091272+0000 mon.b (mon.1) 81 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:55:17.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:17 smithi016 bash[10302]: cephadm 2020-11-16T21:55:17.092941+0000 mgr.x (mgr.24115) 26 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:55:17.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:17 smithi016 bash[10302]: cephadm 2020-11-16T21:55:17.093225+0000 mgr.x (mgr.24115) 27 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:55:17.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:17 smithi016 bash[10302]: cephadm 2020-11-16T21:55:17.094427+0000 mgr.x (mgr.24115) 28 : cephadm [INF] Applying None on host smithi195... 2020-11-16T21:55:17.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:17 smithi016 bash[10302]: audit 2020-11-16T21:55:17.095250+0000 mon.b (mon.1) 82 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:55:17.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:17 smithi016 bash[10302]: audit 2020-11-16T21:55:17.096917+0000 mon.b (mon.1) 83 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:55:17.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:17 smithi016 bash[10302]: audit 2020-11-16T21:55:17.098883+0000 mon.b (mon.1) 84 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:17.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:17 smithi195 bash[10218]: cluster 2020-11-16T21:55:16.545437+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e19: 2 total, 2 up, 2 in 2020-11-16T21:55:17.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:17 smithi195 bash[10218]: audit 2020-11-16T21:55:17.091272+0000 mon.b (mon.1) 81 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:55:17.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:17 smithi195 bash[10218]: cephadm 2020-11-16T21:55:17.092941+0000 mgr.x (mgr.24115) 26 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:55:17.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:17 smithi195 bash[10218]: cephadm 2020-11-16T21:55:17.093225+0000 mgr.x (mgr.24115) 27 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:55:17.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:17 smithi195 bash[10218]: cephadm 2020-11-16T21:55:17.094427+0000 mgr.x (mgr.24115) 28 : cephadm [INF] Applying None on host smithi195... 2020-11-16T21:55:17.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:17 smithi195 bash[10218]: audit 2020-11-16T21:55:17.095250+0000 mon.b (mon.1) 82 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:55:17.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:17 smithi195 bash[10218]: audit 2020-11-16T21:55:17.096917+0000 mon.b (mon.1) 83 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:55:17.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:17 smithi195 bash[10218]: audit 2020-11-16T21:55:17.098883+0000 mon.b (mon.1) 84 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:17.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:17 smithi057 bash[10301]: cluster 2020-11-16T21:55:16.545437+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e19: 2 total, 2 up, 2 in 2020-11-16T21:55:17.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:17 smithi057 bash[10301]: audit 2020-11-16T21:55:17.091272+0000 mon.b (mon.1) 81 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:55:17.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:17 smithi057 bash[10301]: cephadm 2020-11-16T21:55:17.092941+0000 mgr.x (mgr.24115) 26 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:55:17.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:17 smithi057 bash[10301]: cephadm 2020-11-16T21:55:17.093225+0000 mgr.x (mgr.24115) 27 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:55:17.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:17 smithi057 bash[10301]: cephadm 2020-11-16T21:55:17.094427+0000 mgr.x (mgr.24115) 28 : cephadm [INF] Applying None on host smithi195... 2020-11-16T21:55:17.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:17 smithi057 bash[10301]: audit 2020-11-16T21:55:17.095250+0000 mon.b (mon.1) 82 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:55:17.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:17 smithi057 bash[10301]: audit 2020-11-16T21:55:17.096917+0000 mon.b (mon.1) 83 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:55:17.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:17 smithi057 bash[10301]: audit 2020-11-16T21:55:17.098883+0000 mon.b (mon.1) 84 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:18.621 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:18 smithi195 bash[10218]: cluster 2020-11-16T21:55:17.446073+0000 mgr.x (mgr.24115) 29 : cluster [DBG] pgmap v29: 1 pgs: 1 undersized+peered; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:18.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:18 smithi016 bash[10302]: cluster 2020-11-16T21:55:17.446073+0000 mgr.x (mgr.24115) 29 : cluster [DBG] pgmap v29: 1 pgs: 1 undersized+peered; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:18.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:18 smithi057 bash[10301]: cluster 2020-11-16T21:55:17.446073+0000 mgr.x (mgr.24115) 29 : cluster [DBG] pgmap v29: 1 pgs: 1 undersized+peered; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:20.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:20 smithi057 bash[10301]: cluster 2020-11-16T21:55:19.446643+0000 mgr.x (mgr.24115) 30 : cluster [DBG] pgmap v30: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:20.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:20 smithi016 bash[10302]: cluster 2020-11-16T21:55:19.446643+0000 mgr.x (mgr.24115) 30 : cluster [DBG] pgmap v30: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:20.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:20 smithi195 bash[10218]: cluster 2020-11-16T21:55:19.446643+0000 mgr.x (mgr.24115) 30 : cluster [DBG] pgmap v30: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:21.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:21 smithi057 bash[10301]: audit 2020-11-16T21:55:20.811418+0000 mon.a (mon.0) 373 : audit [INF] from='client.? v1:172.21.15.195:0/3079929519' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25dcebff-95d0-47a0-8efb-c3b66ee68eb5"}]: dispatch 2020-11-16T21:55:21.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:21 smithi057 bash[10301]: audit 2020-11-16T21:55:20.817170+0000 mon.b (mon.1) 85 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-11-16T21:55:21.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:21 smithi057 bash[10301]: audit 2020-11-16T21:55:20.818253+0000 mon.a (mon.0) 374 : audit [INF] from='client.? v1:172.21.15.195:0/3079929519' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25dcebff-95d0-47a0-8efb-c3b66ee68eb5"}]': finished 2020-11-16T21:55:21.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:21 smithi057 bash[10301]: cluster 2020-11-16T21:55:20.818335+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2020-11-16T21:55:21.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:21 smithi016 bash[10302]: audit 2020-11-16T21:55:20.811418+0000 mon.a (mon.0) 373 : audit [INF] from='client.? v1:172.21.15.195:0/3079929519' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25dcebff-95d0-47a0-8efb-c3b66ee68eb5"}]: dispatch 2020-11-16T21:55:21.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:21 smithi016 bash[10302]: audit 2020-11-16T21:55:20.817170+0000 mon.b (mon.1) 85 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-11-16T21:55:21.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:21 smithi016 bash[10302]: audit 2020-11-16T21:55:20.818253+0000 mon.a (mon.0) 374 : audit [INF] from='client.? v1:172.21.15.195:0/3079929519' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25dcebff-95d0-47a0-8efb-c3b66ee68eb5"}]': finished 2020-11-16T21:55:21.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:21 smithi016 bash[10302]: cluster 2020-11-16T21:55:20.818335+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2020-11-16T21:55:21.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:21 smithi195 bash[10218]: audit 2020-11-16T21:55:20.811418+0000 mon.a (mon.0) 373 : audit [INF] from='client.? v1:172.21.15.195:0/3079929519' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25dcebff-95d0-47a0-8efb-c3b66ee68eb5"}]: dispatch 2020-11-16T21:55:21.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:21 smithi195 bash[10218]: audit 2020-11-16T21:55:20.817170+0000 mon.b (mon.1) 85 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-11-16T21:55:21.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:21 smithi195 bash[10218]: audit 2020-11-16T21:55:20.818253+0000 mon.a (mon.0) 374 : audit [INF] from='client.? v1:172.21.15.195:0/3079929519' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25dcebff-95d0-47a0-8efb-c3b66ee68eb5"}]': finished 2020-11-16T21:55:21.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:21 smithi195 bash[10218]: cluster 2020-11-16T21:55:20.818335+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2020-11-16T21:55:22.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:22 smithi057 bash[10301]: cluster 2020-11-16T21:55:21.447176+0000 mgr.x (mgr.24115) 31 : cluster [DBG] pgmap v32: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:22.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:22 smithi057 bash[10301]: audit 2020-11-16T21:55:21.490072+0000 mon.a (mon.0) 376 : audit [DBG] from='client.? v1:172.21.15.195:0/410537664' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:55:22.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:22 smithi016 bash[10302]: cluster 2020-11-16T21:55:21.447176+0000 mgr.x (mgr.24115) 31 : cluster [DBG] pgmap v32: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:22.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:22 smithi016 bash[10302]: audit 2020-11-16T21:55:21.490072+0000 mon.a (mon.0) 376 : audit [DBG] from='client.? v1:172.21.15.195:0/410537664' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:55:22.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:22 smithi195 bash[10218]: cluster 2020-11-16T21:55:21.447176+0000 mgr.x (mgr.24115) 31 : cluster [DBG] pgmap v32: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:22.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:22 smithi195 bash[10218]: audit 2020-11-16T21:55:21.490072+0000 mon.a (mon.0) 376 : audit [DBG] from='client.? v1:172.21.15.195:0/410537664' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:55:23.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:23 smithi016 bash[10302]: cluster 2020-11-16T21:55:23.501036+0000 mon.a (mon.0) 377 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2020-11-16T21:55:23.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:23 smithi016 bash[10302]: cluster 2020-11-16T21:55:23.501118+0000 mon.a (mon.0) 378 : cluster [INF] Cluster is now healthy 2020-11-16T21:55:23.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:23 smithi195 bash[10218]: cluster 2020-11-16T21:55:23.501036+0000 mon.a (mon.0) 377 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2020-11-16T21:55:23.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:23 smithi195 bash[10218]: cluster 2020-11-16T21:55:23.501118+0000 mon.a (mon.0) 378 : cluster [INF] Cluster is now healthy 2020-11-16T21:55:23.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:23 smithi057 bash[10301]: cluster 2020-11-16T21:55:23.501036+0000 mon.a (mon.0) 377 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2020-11-16T21:55:23.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:23 smithi057 bash[10301]: cluster 2020-11-16T21:55:23.501118+0000 mon.a (mon.0) 378 : cluster [INF] Cluster is now healthy 2020-11-16T21:55:24.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:24 smithi016 bash[10302]: cluster 2020-11-16T21:55:23.447661+0000 mgr.x (mgr.24115) 32 : cluster [DBG] pgmap v33: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:24.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:24 smithi195 bash[10218]: cluster 2020-11-16T21:55:23.447661+0000 mgr.x (mgr.24115) 32 : cluster [DBG] pgmap v33: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:24.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:24 smithi057 bash[10301]: cluster 2020-11-16T21:55:23.447661+0000 mgr.x (mgr.24115) 32 : cluster [DBG] pgmap v33: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:25.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:25 smithi016 bash[10302]: audit 2020-11-16T21:55:24.553325+0000 mon.b (mon.1) 86 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:25.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:25 smithi195 bash[10218]: audit 2020-11-16T21:55:24.553325+0000 mon.b (mon.1) 86 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:25.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:25 smithi057 bash[10301]: audit 2020-11-16T21:55:24.553325+0000 mon.b (mon.1) 86 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:26.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:26 smithi016 bash[10302]: cluster 2020-11-16T21:55:25.448226+0000 mgr.x (mgr.24115) 33 : cluster [DBG] pgmap v34: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:26.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:26 smithi195 bash[10218]: cluster 2020-11-16T21:55:25.448226+0000 mgr.x (mgr.24115) 33 : cluster [DBG] pgmap v34: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:26.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:26 smithi057 bash[10301]: cluster 2020-11-16T21:55:25.448226+0000 mgr.x (mgr.24115) 33 : cluster [DBG] pgmap v34: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:28.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:28 smithi016 bash[10302]: cluster 2020-11-16T21:55:27.448793+0000 mgr.x (mgr.24115) 34 : cluster [DBG] pgmap v35: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:28.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:28 smithi016 bash[10302]: audit 2020-11-16T21:55:28.477104+0000 mon.b (mon.1) 87 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2020-11-16T21:55:28.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:28 smithi016 bash[10302]: audit 2020-11-16T21:55:28.478697+0000 mon.b (mon.1) 88 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:55:28.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:28 smithi016 bash[10302]: audit 2020-11-16T21:55:28.480653+0000 mon.b (mon.1) 89 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2020-11-16T21:55:28.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:28 smithi195 bash[10218]: cluster 2020-11-16T21:55:27.448793+0000 mgr.x (mgr.24115) 34 : cluster [DBG] pgmap v35: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:28.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:28 smithi195 bash[10218]: audit 2020-11-16T21:55:28.477104+0000 mon.b (mon.1) 87 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2020-11-16T21:55:28.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:28 smithi195 bash[10218]: audit 2020-11-16T21:55:28.478697+0000 mon.b (mon.1) 88 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:55:28.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:28 smithi195 bash[10218]: audit 2020-11-16T21:55:28.480653+0000 mon.b (mon.1) 89 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2020-11-16T21:55:28.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:28 smithi057 bash[10301]: cluster 2020-11-16T21:55:27.448793+0000 mgr.x (mgr.24115) 34 : cluster [DBG] pgmap v35: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:28.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:28 smithi057 bash[10301]: audit 2020-11-16T21:55:28.477104+0000 mon.b (mon.1) 87 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2020-11-16T21:55:28.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:28 smithi057 bash[10301]: audit 2020-11-16T21:55:28.478697+0000 mon.b (mon.1) 88 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:55:28.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:28 smithi057 bash[10301]: audit 2020-11-16T21:55:28.480653+0000 mon.b (mon.1) 89 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2020-11-16T21:55:29.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:29 smithi016 bash[10302]: cephadm 2020-11-16T21:55:28.479965+0000 mgr.x (mgr.24115) 35 : cephadm [INF] Deploying daemon osd.2 on smithi195 2020-11-16T21:55:29.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:29 smithi195 bash[10218]: cephadm 2020-11-16T21:55:28.479965+0000 mgr.x (mgr.24115) 35 : cephadm [INF] Deploying daemon osd.2 on smithi195 2020-11-16T21:55:29.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:29 smithi057 bash[10301]: cephadm 2020-11-16T21:55:28.479965+0000 mgr.x (mgr.24115) 35 : cephadm [INF] Deploying daemon osd.2 on smithi195 2020-11-16T21:55:30.665 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:30 smithi195 bash[10218]: cluster 2020-11-16T21:55:29.449367+0000 mgr.x (mgr.24115) 36 : cluster [DBG] pgmap v36: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:30.665 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:30 smithi195 bash[10218]: audit 2020-11-16T21:55:29.696156+0000 mon.b (mon.1) 90 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:55:30.665 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:30 smithi195 bash[10218]: audit 2020-11-16T21:55:29.698595+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:55:30.665 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:30 smithi195 bash[10218]: audit 2020-11-16T21:55:29.699655+0000 mon.b (mon.1) 91 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:55:30.666 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:30 smithi195 bash[10218]: audit 2020-11-16T21:55:29.701958+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:55:30.748 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 2 on host 'smithi195' 2020-11-16T21:55:30.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:30 smithi016 bash[10302]: cluster 2020-11-16T21:55:29.449367+0000 mgr.x (mgr.24115) 36 : cluster [DBG] pgmap v36: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:30.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:30 smithi016 bash[10302]: audit 2020-11-16T21:55:29.696156+0000 mon.b (mon.1) 90 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:55:30.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:30 smithi016 bash[10302]: audit 2020-11-16T21:55:29.698595+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:55:30.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:30 smithi016 bash[10302]: audit 2020-11-16T21:55:29.699655+0000 mon.b (mon.1) 91 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:55:30.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:30 smithi016 bash[10302]: audit 2020-11-16T21:55:29.701958+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:55:30.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:30 smithi057 bash[10301]: cluster 2020-11-16T21:55:29.449367+0000 mgr.x (mgr.24115) 36 : cluster [DBG] pgmap v36: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:30.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:30 smithi057 bash[10301]: audit 2020-11-16T21:55:29.696156+0000 mon.b (mon.1) 90 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:55:30.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:30 smithi057 bash[10301]: audit 2020-11-16T21:55:29.698595+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:55:30.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:30 smithi057 bash[10301]: audit 2020-11-16T21:55:29.699655+0000 mon.b (mon.1) 91 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:55:30.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:30 smithi057 bash[10301]: audit 2020-11-16T21:55:29.701958+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:55:31.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:31 smithi016 bash[10302]: audit 2020-11-16T21:55:30.751853+0000 mon.b (mon.1) 92 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:35.930 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:31 smithi016 bash[10302]: audit 2020-11-16T21:55:30.752657+0000 mon.b (mon.1) 93 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:55:35.930 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:31 smithi016 bash[10302]: audit 2020-11-16T21:55:30.754353+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:35.931 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:31 smithi016 bash[10302]: audit 2020-11-16T21:55:30.761134+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:35.933 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:31 smithi057 bash[10301]: audit 2020-11-16T21:55:30.751853+0000 mon.b (mon.1) 92 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:35.934 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:31 smithi057 bash[10301]: audit 2020-11-16T21:55:30.752657+0000 mon.b (mon.1) 93 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:55:35.934 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:31 smithi057 bash[10301]: audit 2020-11-16T21:55:30.754353+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:35.934 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:31 smithi057 bash[10301]: audit 2020-11-16T21:55:30.761134+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:35.966 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:31 smithi057 bash[10301]: audit 2020-11-16T21:55:31.526323+0000 mon.b (mon.1) 94 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:35.966 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:31 smithi057 bash[10301]: audit 2020-11-16T21:55:31.529111+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:35.966 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:31 smithi057 bash[10301]: audit 2020-11-16T21:55:31.534935+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:35.966 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:31 smithi057 bash[10301]: audit 2020-11-16T21:55:31.535030+0000 mon.b (mon.1) 95 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:35.967 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:32 smithi057 bash[10301]: cluster 2020-11-16T21:55:31.449948+0000 mgr.x (mgr.24115) 37 : cluster [DBG] pgmap v37: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:35.967 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:34 smithi057 bash[10301]: cluster 2020-11-16T21:55:33.450483+0000 mgr.x (mgr.24115) 38 : cluster [DBG] pgmap v38: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:35.967 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:31 smithi195 bash[10218]: audit 2020-11-16T21:55:30.751853+0000 mon.b (mon.1) 92 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:35.967 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:31 smithi195 bash[10218]: audit 2020-11-16T21:55:30.752657+0000 mon.b (mon.1) 93 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:55:35.967 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:31 smithi195 bash[10218]: audit 2020-11-16T21:55:30.754353+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:35.968 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:31 smithi195 bash[10218]: audit 2020-11-16T21:55:30.761134+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243414\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243613\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:07.243811\", \"created\": \"2020-11-16T21:55:06.485881\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_device_update\": \"2020-11-16T21:55:15.229505\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:35.968 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:31 smithi195 bash[10218]: audit 2020-11-16T21:55:31.526323+0000 mon.b (mon.1) 94 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:35.968 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:31 smithi195 bash[10218]: audit 2020-11-16T21:55:31.529111+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:35.968 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:31 smithi195 bash[10218]: audit 2020-11-16T21:55:31.534935+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:35.968 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:31 smithi195 bash[10218]: audit 2020-11-16T21:55:31.535030+0000 mon.b (mon.1) 95 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:35.969 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:32 smithi195 bash[10218]: cluster 2020-11-16T21:55:31.449948+0000 mgr.x (mgr.24115) 37 : cluster [DBG] pgmap v37: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:35.969 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:34 smithi195 bash[10218]: cluster 2020-11-16T21:55:33.450483+0000 mgr.x (mgr.24115) 38 : cluster [DBG] pgmap v38: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:35.969 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:31 smithi016 bash[10302]: audit 2020-11-16T21:55:31.526323+0000 mon.b (mon.1) 94 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:35.969 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:31 smithi016 bash[10302]: audit 2020-11-16T21:55:31.529111+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:35.970 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:31 smithi016 bash[10302]: audit 2020-11-16T21:55:31.534935+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:35.970 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:31 smithi016 bash[10302]: audit 2020-11-16T21:55:31.535030+0000 mon.b (mon.1) 95 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:35.970 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:32 smithi016 bash[10302]: cluster 2020-11-16T21:55:31.449948+0000 mgr.x (mgr.24115) 37 : cluster [DBG] pgmap v37: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:35.970 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:34 smithi016 bash[10302]: cluster 2020-11-16T21:55:33.450483+0000 mgr.x (mgr.24115) 38 : cluster [DBG] pgmap v38: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:35.971 INFO:teuthology.orchestra.run.smithi195:osd.2> sudo journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.2.service 2020-11-16T21:55:35.973 INFO:tasks.cephadm:Deploying osd.3 on smithi195 with /dev/vg_nvme/lv_1... 2020-11-16T21:55:35.973 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2020-11-16T21:55:36.003 INFO:journalctl@ceph.osd.2.smithi195.stdout:-- Logs begin at Sun 2020-11-15 12:21:41 UTC. -- 2020-11-16T21:55:37.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:36 smithi016 bash[10302]: cluster 2020-11-16T21:55:35.450997+0000 mgr.x (mgr.24115) 39 : cluster [DBG] pgmap v39: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:37.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:36 smithi016 bash[10302]: audit 2020-11-16T21:55:36.014488+0000 mon.a (mon.0) 385 : audit [INF] from='osd.2 v1:172.21.15.195:6808/2181977746' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-11-16T21:55:37.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:36 smithi195 bash[10218]: cluster 2020-11-16T21:55:35.450997+0000 mgr.x (mgr.24115) 39 : cluster [DBG] pgmap v39: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:37.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:36 smithi195 bash[10218]: audit 2020-11-16T21:55:36.014488+0000 mon.a (mon.0) 385 : audit [INF] from='osd.2 v1:172.21.15.195:6808/2181977746' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-11-16T21:55:37.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:36 smithi057 bash[10301]: cluster 2020-11-16T21:55:35.450997+0000 mgr.x (mgr.24115) 39 : cluster [DBG] pgmap v39: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:37.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:36 smithi057 bash[10301]: audit 2020-11-16T21:55:36.014488+0000 mon.a (mon.0) 385 : audit [INF] from='osd.2 v1:172.21.15.195:6808/2181977746' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2020-11-16T21:55:38.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:37 smithi016 bash[10302]: audit 2020-11-16T21:55:36.786671+0000 mon.b (mon.1) 96 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-11-16T21:55:38.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:37 smithi016 bash[10302]: audit 2020-11-16T21:55:36.787149+0000 mon.a (mon.0) 386 : audit [INF] from='osd.2 v1:172.21.15.195:6808/2181977746' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2020-11-16T21:55:38.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:37 smithi016 bash[10302]: cluster 2020-11-16T21:55:36.787229+0000 mon.a (mon.0) 387 : cluster [DBG] osdmap e21: 3 total, 2 up, 2 in 2020-11-16T21:55:38.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:37 smithi016 bash[10302]: audit 2020-11-16T21:55:36.788063+0000 mon.a (mon.0) 388 : audit [INF] from='osd.2 v1:172.21.15.195:6808/2181977746' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2020-11-16T21:55:38.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:37 smithi016 bash[10302]: audit 2020-11-16T21:55:37.276375+0000 mon.b (mon.1) 97 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:55:38.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:37 smithi016 bash[10302]: audit 2020-11-16T21:55:37.585019+0000 mon.b (mon.1) 98 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:38.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:37 smithi016 bash[10302]: audit 2020-11-16T21:55:37.587623+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:38.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:37 smithi016 bash[10302]: audit 2020-11-16T21:55:37.590922+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:38.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:37 smithi016 bash[10302]: audit 2020-11-16T21:55:37.593584+0000 mon.b (mon.1) 99 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:38.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:37 smithi016 bash[10302]: audit 2020-11-16T21:55:37.595837+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:38.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:37 smithi016 bash[10302]: audit 2020-11-16T21:55:37.601761+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:55:38.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:37 smithi016 bash[10302]: audit 2020-11-16T21:55:37.604516+0000 mon.b (mon.1) 100 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:38.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:37 smithi016 bash[10302]: audit 2020-11-16T21:55:37.606664+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:38.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:37 smithi016 bash[10302]: audit 2020-11-16T21:55:37.610454+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:55:38.094 INFO:journalctl@ceph.osd.2.smithi195.stdout:Nov 16 21:55:37 smithi195 bash[21024]: debug 2020-11-16T21:55:37.797+0000 7f3c35f9a700 -1 osd.2 0 waiting for initial osdmap 2020-11-16T21:55:38.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:37 smithi195 bash[10218]: audit 2020-11-16T21:55:36.786671+0000 mon.b (mon.1) 96 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-11-16T21:55:38.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:37 smithi195 bash[10218]: audit 2020-11-16T21:55:36.787149+0000 mon.a (mon.0) 386 : audit [INF] from='osd.2 v1:172.21.15.195:6808/2181977746' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2020-11-16T21:55:38.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:37 smithi195 bash[10218]: cluster 2020-11-16T21:55:36.787229+0000 mon.a (mon.0) 387 : cluster [DBG] osdmap e21: 3 total, 2 up, 2 in 2020-11-16T21:55:38.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:37 smithi195 bash[10218]: audit 2020-11-16T21:55:36.788063+0000 mon.a (mon.0) 388 : audit [INF] from='osd.2 v1:172.21.15.195:6808/2181977746' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2020-11-16T21:55:38.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:37 smithi195 bash[10218]: audit 2020-11-16T21:55:37.276375+0000 mon.b (mon.1) 97 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:55:38.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:37 smithi195 bash[10218]: audit 2020-11-16T21:55:37.585019+0000 mon.b (mon.1) 98 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:38.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:37 smithi195 bash[10218]: audit 2020-11-16T21:55:37.587623+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:38.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:37 smithi195 bash[10218]: audit 2020-11-16T21:55:37.590922+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:38.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:37 smithi195 bash[10218]: audit 2020-11-16T21:55:37.593584+0000 mon.b (mon.1) 99 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:38.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:37 smithi195 bash[10218]: audit 2020-11-16T21:55:37.595837+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:38.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:37 smithi195 bash[10218]: audit 2020-11-16T21:55:37.601761+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:55:38.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:37 smithi195 bash[10218]: audit 2020-11-16T21:55:37.604516+0000 mon.b (mon.1) 100 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:38.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:37 smithi195 bash[10218]: audit 2020-11-16T21:55:37.606664+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:38.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:37 smithi195 bash[10218]: audit 2020-11-16T21:55:37.610454+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:55:38.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:37 smithi057 bash[10301]: audit 2020-11-16T21:55:36.786671+0000 mon.b (mon.1) 96 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-11-16T21:55:38.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:37 smithi057 bash[10301]: audit 2020-11-16T21:55:36.787149+0000 mon.a (mon.0) 386 : audit [INF] from='osd.2 v1:172.21.15.195:6808/2181977746' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2020-11-16T21:55:38.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:37 smithi057 bash[10301]: cluster 2020-11-16T21:55:36.787229+0000 mon.a (mon.0) 387 : cluster [DBG] osdmap e21: 3 total, 2 up, 2 in 2020-11-16T21:55:38.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:37 smithi057 bash[10301]: audit 2020-11-16T21:55:36.788063+0000 mon.a (mon.0) 388 : audit [INF] from='osd.2 v1:172.21.15.195:6808/2181977746' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2020-11-16T21:55:38.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:37 smithi057 bash[10301]: audit 2020-11-16T21:55:37.276375+0000 mon.b (mon.1) 97 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:55:38.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:37 smithi057 bash[10301]: audit 2020-11-16T21:55:37.585019+0000 mon.b (mon.1) 98 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:38.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:37 smithi057 bash[10301]: audit 2020-11-16T21:55:37.587623+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:38.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:37 smithi057 bash[10301]: audit 2020-11-16T21:55:37.590922+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}}, \"last_daemon_update\": \"2020-11-16T21:55:31.524679\", \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:38.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:37 smithi057 bash[10301]: audit 2020-11-16T21:55:37.593584+0000 mon.b (mon.1) 99 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:38.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:37 smithi057 bash[10301]: audit 2020-11-16T21:55:37.595837+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:38.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:37 smithi057 bash[10301]: audit 2020-11-16T21:55:37.601761+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:55:38.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:37 smithi057 bash[10301]: audit 2020-11-16T21:55:37.604516+0000 mon.b (mon.1) 100 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:38.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:37 smithi057 bash[10301]: audit 2020-11-16T21:55:37.606664+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:55:38.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:37 smithi057 bash[10301]: audit 2020-11-16T21:55:37.610454+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:55:39.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:38 smithi016 bash[10302]: cluster 2020-11-16T21:55:37.451610+0000 mgr.x (mgr.24115) 40 : cluster [DBG] pgmap v41: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:39.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:38 smithi016 bash[10302]: audit 2020-11-16T21:55:37.797913+0000 mon.a (mon.0) 395 : audit [INF] from='osd.2 v1:172.21.15.195:6808/2181977746' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2020-11-16T21:55:39.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:38 smithi016 bash[10302]: cluster 2020-11-16T21:55:37.797965+0000 mon.a (mon.0) 396 : cluster [DBG] osdmap e22: 3 total, 2 up, 2 in 2020-11-16T21:55:39.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:38 smithi016 bash[10302]: audit 2020-11-16T21:55:37.799312+0000 mon.b (mon.1) 101 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-11-16T21:55:39.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:38 smithi016 bash[10302]: audit 2020-11-16T21:55:37.802540+0000 mon.b (mon.1) 102 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-11-16T21:55:39.087 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:38 smithi195 bash[10218]: cluster 2020-11-16T21:55:37.451610+0000 mgr.x (mgr.24115) 40 : cluster [DBG] pgmap v41: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:39.087 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:38 smithi195 bash[10218]: audit 2020-11-16T21:55:37.797913+0000 mon.a (mon.0) 395 : audit [INF] from='osd.2 v1:172.21.15.195:6808/2181977746' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2020-11-16T21:55:39.087 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:38 smithi195 bash[10218]: cluster 2020-11-16T21:55:37.797965+0000 mon.a (mon.0) 396 : cluster [DBG] osdmap e22: 3 total, 2 up, 2 in 2020-11-16T21:55:39.088 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:38 smithi195 bash[10218]: audit 2020-11-16T21:55:37.799312+0000 mon.b (mon.1) 101 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-11-16T21:55:39.088 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:38 smithi195 bash[10218]: audit 2020-11-16T21:55:37.802540+0000 mon.b (mon.1) 102 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-11-16T21:55:39.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:38 smithi057 bash[10301]: cluster 2020-11-16T21:55:37.451610+0000 mgr.x (mgr.24115) 40 : cluster [DBG] pgmap v41: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:39.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:38 smithi057 bash[10301]: audit 2020-11-16T21:55:37.797913+0000 mon.a (mon.0) 395 : audit [INF] from='osd.2 v1:172.21.15.195:6808/2181977746' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2020-11-16T21:55:39.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:38 smithi057 bash[10301]: cluster 2020-11-16T21:55:37.797965+0000 mon.a (mon.0) 396 : cluster [DBG] osdmap e22: 3 total, 2 up, 2 in 2020-11-16T21:55:39.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:38 smithi057 bash[10301]: audit 2020-11-16T21:55:37.799312+0000 mon.b (mon.1) 101 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-11-16T21:55:39.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:38 smithi057 bash[10301]: audit 2020-11-16T21:55:37.802540+0000 mon.b (mon.1) 102 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-11-16T21:55:39.637 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_1 2020-11-16T21:55:39.638 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2020-11-16T21:55:39.638 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2020-11-16T21:55:39.638 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2020-11-16T21:55:39.638 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.016445 s, 638 MB/s 2020-11-16T21:55:39.638 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2020-11-16T21:55:40.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:39 smithi016 bash[10302]: cluster 2020-11-16T21:55:37.003848+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:55:40.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:39 smithi016 bash[10302]: cluster 2020-11-16T21:55:37.004027+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:55:40.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:39 smithi016 bash[10302]: audit 2020-11-16T21:55:38.802498+0000 mon.b (mon.1) 103 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-11-16T21:55:40.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:39 smithi016 bash[10302]: cluster 2020-11-16T21:55:38.807540+0000 mon.a (mon.0) 397 : cluster [INF] osd.2 v1:172.21.15.195:6808/2181977746 boot 2020-11-16T21:55:40.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:39 smithi016 bash[10302]: cluster 2020-11-16T21:55:38.807595+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2020-11-16T21:55:40.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:39 smithi195 bash[10218]: cluster 2020-11-16T21:55:37.003848+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:55:40.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:39 smithi195 bash[10218]: cluster 2020-11-16T21:55:37.004027+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:55:40.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:39 smithi195 bash[10218]: audit 2020-11-16T21:55:38.802498+0000 mon.b (mon.1) 103 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-11-16T21:55:40.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:39 smithi195 bash[10218]: cluster 2020-11-16T21:55:38.807540+0000 mon.a (mon.0) 397 : cluster [INF] osd.2 v1:172.21.15.195:6808/2181977746 boot 2020-11-16T21:55:40.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:39 smithi195 bash[10218]: cluster 2020-11-16T21:55:38.807595+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2020-11-16T21:55:40.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:39 smithi057 bash[10301]: cluster 2020-11-16T21:55:37.003848+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:55:40.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:39 smithi057 bash[10301]: cluster 2020-11-16T21:55:37.004027+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:55:40.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:39 smithi057 bash[10301]: audit 2020-11-16T21:55:38.802498+0000 mon.b (mon.1) 103 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2020-11-16T21:55:40.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:39 smithi057 bash[10301]: cluster 2020-11-16T21:55:38.807540+0000 mon.a (mon.0) 397 : cluster [INF] osd.2 v1:172.21.15.195:6808/2181977746 boot 2020-11-16T21:55:40.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:39 smithi057 bash[10301]: cluster 2020-11-16T21:55:38.807595+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2020-11-16T21:55:40.285 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch daemon add osd smithi195:vg_nvme/lv_1 2020-11-16T21:55:41.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:40 smithi016 bash[10302]: cluster 2020-11-16T21:55:39.452159+0000 mgr.x (mgr.24115) 41 : cluster [DBG] pgmap v44: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:41.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:40 smithi016 bash[10302]: cluster 2020-11-16T21:55:39.809589+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e24: 3 total, 3 up, 3 in 2020-11-16T21:55:41.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:40 smithi195 bash[10218]: cluster 2020-11-16T21:55:39.452159+0000 mgr.x (mgr.24115) 41 : cluster [DBG] pgmap v44: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:41.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:40 smithi195 bash[10218]: cluster 2020-11-16T21:55:39.809589+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e24: 3 total, 3 up, 3 in 2020-11-16T21:55:41.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:40 smithi057 bash[10301]: cluster 2020-11-16T21:55:39.452159+0000 mgr.x (mgr.24115) 41 : cluster [DBG] pgmap v44: 1 pgs: 1 active+clean; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2020-11-16T21:55:41.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:40 smithi057 bash[10301]: cluster 2020-11-16T21:55:39.809589+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e24: 3 total, 3 up, 3 in 2020-11-16T21:55:43.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:42 smithi016 bash[10302]: cluster 2020-11-16T21:55:41.452727+0000 mgr.x (mgr.24115) 42 : cluster [DBG] pgmap v46: 1 pgs: 1 active+clean; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:43.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:42 smithi195 bash[10218]: cluster 2020-11-16T21:55:41.452727+0000 mgr.x (mgr.24115) 42 : cluster [DBG] pgmap v46: 1 pgs: 1 active+clean; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:43.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:42 smithi057 bash[10301]: cluster 2020-11-16T21:55:41.452727+0000 mgr.x (mgr.24115) 42 : cluster [DBG] pgmap v46: 1 pgs: 1 active+clean; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:44.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:43 smithi016 bash[10302]: audit 2020-11-16T21:55:43.260545+0000 mon.b (mon.1) 104 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:55:44.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:43 smithi016 bash[10302]: audit 2020-11-16T21:55:43.264185+0000 mon.b (mon.1) 105 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:55:44.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:43 smithi016 bash[10302]: audit 2020-11-16T21:55:43.265781+0000 mon.b (mon.1) 106 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:55:44.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:43 smithi016 bash[10302]: audit 2020-11-16T21:55:43.267631+0000 mon.b (mon.1) 107 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:44.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:43 smithi195 bash[10218]: audit 2020-11-16T21:55:43.260545+0000 mon.b (mon.1) 104 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:55:44.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:43 smithi195 bash[10218]: audit 2020-11-16T21:55:43.264185+0000 mon.b (mon.1) 105 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:55:44.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:43 smithi195 bash[10218]: audit 2020-11-16T21:55:43.265781+0000 mon.b (mon.1) 106 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:55:44.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:43 smithi195 bash[10218]: audit 2020-11-16T21:55:43.267631+0000 mon.b (mon.1) 107 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:44.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:43 smithi057 bash[10301]: audit 2020-11-16T21:55:43.260545+0000 mon.b (mon.1) 104 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:55:44.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:43 smithi057 bash[10301]: audit 2020-11-16T21:55:43.264185+0000 mon.b (mon.1) 105 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:55:44.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:43 smithi057 bash[10301]: audit 2020-11-16T21:55:43.265781+0000 mon.b (mon.1) 106 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:55:44.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:43 smithi057 bash[10301]: audit 2020-11-16T21:55:43.267631+0000 mon.b (mon.1) 107 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:45.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:44 smithi016 bash[10302]: audit 2020-11-16T21:55:43.258582+0000 mgr.x (mgr.24115) 43 : audit [DBG] from='client.24208 v1:172.21.15.195:0/31379056' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:55:45.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:44 smithi016 bash[10302]: cephadm 2020-11-16T21:55:43.262084+0000 mgr.x (mgr.24115) 44 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:55:45.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:44 smithi016 bash[10302]: cephadm 2020-11-16T21:55:43.262264+0000 mgr.x (mgr.24115) 45 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:55:45.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:44 smithi016 bash[10302]: cephadm 2020-11-16T21:55:43.263346+0000 mgr.x (mgr.24115) 46 : cephadm [INF] Applying None on host smithi195... 2020-11-16T21:55:45.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:44 smithi016 bash[10302]: cluster 2020-11-16T21:55:43.453310+0000 mgr.x (mgr.24115) 47 : cluster [DBG] pgmap v47: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:45.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:44 smithi195 bash[10218]: audit 2020-11-16T21:55:43.258582+0000 mgr.x (mgr.24115) 43 : audit [DBG] from='client.24208 v1:172.21.15.195:0/31379056' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:55:45.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:44 smithi195 bash[10218]: cephadm 2020-11-16T21:55:43.262084+0000 mgr.x (mgr.24115) 44 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:55:45.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:44 smithi195 bash[10218]: cephadm 2020-11-16T21:55:43.262264+0000 mgr.x (mgr.24115) 45 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:55:45.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:44 smithi195 bash[10218]: cephadm 2020-11-16T21:55:43.263346+0000 mgr.x (mgr.24115) 46 : cephadm [INF] Applying None on host smithi195... 2020-11-16T21:55:45.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:44 smithi195 bash[10218]: cluster 2020-11-16T21:55:43.453310+0000 mgr.x (mgr.24115) 47 : cluster [DBG] pgmap v47: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:45.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:44 smithi057 bash[10301]: audit 2020-11-16T21:55:43.258582+0000 mgr.x (mgr.24115) 43 : audit [DBG] from='client.24208 v1:172.21.15.195:0/31379056' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:55:45.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:44 smithi057 bash[10301]: cephadm 2020-11-16T21:55:43.262084+0000 mgr.x (mgr.24115) 44 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:55:45.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:44 smithi057 bash[10301]: cephadm 2020-11-16T21:55:43.262264+0000 mgr.x (mgr.24115) 45 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:55:45.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:44 smithi057 bash[10301]: cephadm 2020-11-16T21:55:43.263346+0000 mgr.x (mgr.24115) 46 : cephadm [INF] Applying None on host smithi195... 2020-11-16T21:55:45.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:44 smithi057 bash[10301]: cluster 2020-11-16T21:55:43.453310+0000 mgr.x (mgr.24115) 47 : cluster [DBG] pgmap v47: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:47.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:46 smithi016 bash[10302]: cluster 2020-11-16T21:55:45.453822+0000 mgr.x (mgr.24115) 48 : cluster [DBG] pgmap v48: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:47.093 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:46 smithi195 bash[10218]: cluster 2020-11-16T21:55:45.453822+0000 mgr.x (mgr.24115) 48 : cluster [DBG] pgmap v48: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:47.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:46 smithi057 bash[10301]: cluster 2020-11-16T21:55:45.453822+0000 mgr.x (mgr.24115) 48 : cluster [DBG] pgmap v48: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:48.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:47 smithi016 bash[10302]: audit 2020-11-16T21:55:47.005893+0000 mon.a (mon.0) 400 : audit [INF] from='client.? v1:172.21.15.195:0/4130415449' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8832539b-0ff5-4887-a8a1-005008fd830a"}]: dispatch 2020-11-16T21:55:48.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:47 smithi016 bash[10302]: audit 2020-11-16T21:55:47.010536+0000 mon.a (mon.0) 401 : audit [INF] from='client.? v1:172.21.15.195:0/4130415449' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8832539b-0ff5-4887-a8a1-005008fd830a"}]': finished 2020-11-16T21:55:48.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:47 smithi016 bash[10302]: cluster 2020-11-16T21:55:47.010566+0000 mon.a (mon.0) 402 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2020-11-16T21:55:48.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:47 smithi016 bash[10302]: audit 2020-11-16T21:55:47.011643+0000 mon.b (mon.1) 108 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:55:48.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:47 smithi016 bash[10302]: audit 2020-11-16T21:55:47.654511+0000 mon.a (mon.0) 403 : audit [DBG] from='client.? v1:172.21.15.195:0/84129881' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:55:48.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:47 smithi195 bash[10218]: audit 2020-11-16T21:55:47.005893+0000 mon.a (mon.0) 400 : audit [INF] from='client.? v1:172.21.15.195:0/4130415449' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8832539b-0ff5-4887-a8a1-005008fd830a"}]: dispatch 2020-11-16T21:55:48.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:47 smithi195 bash[10218]: audit 2020-11-16T21:55:47.010536+0000 mon.a (mon.0) 401 : audit [INF] from='client.? v1:172.21.15.195:0/4130415449' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8832539b-0ff5-4887-a8a1-005008fd830a"}]': finished 2020-11-16T21:55:48.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:47 smithi195 bash[10218]: cluster 2020-11-16T21:55:47.010566+0000 mon.a (mon.0) 402 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2020-11-16T21:55:48.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:47 smithi195 bash[10218]: audit 2020-11-16T21:55:47.011643+0000 mon.b (mon.1) 108 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:55:48.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:47 smithi195 bash[10218]: audit 2020-11-16T21:55:47.654511+0000 mon.a (mon.0) 403 : audit [DBG] from='client.? v1:172.21.15.195:0/84129881' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:55:48.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:47 smithi057 bash[10301]: audit 2020-11-16T21:55:47.005893+0000 mon.a (mon.0) 400 : audit [INF] from='client.? v1:172.21.15.195:0/4130415449' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8832539b-0ff5-4887-a8a1-005008fd830a"}]: dispatch 2020-11-16T21:55:48.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:47 smithi057 bash[10301]: audit 2020-11-16T21:55:47.010536+0000 mon.a (mon.0) 401 : audit [INF] from='client.? v1:172.21.15.195:0/4130415449' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8832539b-0ff5-4887-a8a1-005008fd830a"}]': finished 2020-11-16T21:55:48.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:47 smithi057 bash[10301]: cluster 2020-11-16T21:55:47.010566+0000 mon.a (mon.0) 402 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2020-11-16T21:55:48.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:47 smithi057 bash[10301]: audit 2020-11-16T21:55:47.011643+0000 mon.b (mon.1) 108 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:55:48.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:47 smithi057 bash[10301]: audit 2020-11-16T21:55:47.654511+0000 mon.a (mon.0) 403 : audit [DBG] from='client.? v1:172.21.15.195:0/84129881' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:55:49.332 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:49 smithi016 bash[10302]: cluster 2020-11-16T21:55:47.454356+0000 mgr.x (mgr.24115) 49 : cluster [DBG] pgmap v50: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:49.344 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:49 smithi195 bash[10218]: cluster 2020-11-16T21:55:47.454356+0000 mgr.x (mgr.24115) 49 : cluster [DBG] pgmap v50: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:49.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:49 smithi057 bash[10301]: cluster 2020-11-16T21:55:47.454356+0000 mgr.x (mgr.24115) 49 : cluster [DBG] pgmap v50: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:50.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:50 smithi057 bash[10301]: cluster 2020-11-16T21:55:49.454941+0000 mgr.x (mgr.24115) 50 : cluster [DBG] pgmap v51: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:50.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:50 smithi016 bash[10302]: cluster 2020-11-16T21:55:49.454941+0000 mgr.x (mgr.24115) 50 : cluster [DBG] pgmap v51: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:50.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:50 smithi195 bash[10218]: cluster 2020-11-16T21:55:49.454941+0000 mgr.x (mgr.24115) 50 : cluster [DBG] pgmap v51: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:51.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:51 smithi057 bash[10301]: audit 2020-11-16T21:55:50.663668+0000 mon.b (mon.1) 109 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:51.792 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:51 smithi195 bash[10218]: audit 2020-11-16T21:55:50.663668+0000 mon.b (mon.1) 109 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:51.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:51 smithi016 bash[10302]: audit 2020-11-16T21:55:50.663668+0000 mon.b (mon.1) 109 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:52.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:52 smithi057 bash[10301]: cluster 2020-11-16T21:55:51.455492+0000 mgr.x (mgr.24115) 51 : cluster [DBG] pgmap v52: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:52.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:52 smithi016 bash[10302]: cluster 2020-11-16T21:55:51.455492+0000 mgr.x (mgr.24115) 51 : cluster [DBG] pgmap v52: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:52.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:52 smithi195 bash[10218]: cluster 2020-11-16T21:55:51.455492+0000 mgr.x (mgr.24115) 51 : cluster [DBG] pgmap v52: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:54.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:54 smithi016 bash[10302]: cluster 2020-11-16T21:55:53.456056+0000 mgr.x (mgr.24115) 52 : cluster [DBG] pgmap v53: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:54.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:54 smithi195 bash[10218]: cluster 2020-11-16T21:55:53.456056+0000 mgr.x (mgr.24115) 52 : cluster [DBG] pgmap v53: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:54.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:54 smithi057 bash[10301]: cluster 2020-11-16T21:55:53.456056+0000 mgr.x (mgr.24115) 52 : cluster [DBG] pgmap v53: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:55.767 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:55 smithi195 bash[10218]: audit 2020-11-16T21:55:54.624138+0000 mon.b (mon.1) 110 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2020-11-16T21:55:55.767 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:55 smithi195 bash[10218]: audit 2020-11-16T21:55:54.625708+0000 mon.b (mon.1) 111 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:55:55.767 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:55 smithi195 bash[10218]: cephadm 2020-11-16T21:55:54.626971+0000 mgr.x (mgr.24115) 53 : cephadm [INF] Deploying daemon osd.3 on smithi195 2020-11-16T21:55:55.767 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:55 smithi195 bash[10218]: audit 2020-11-16T21:55:54.627609+0000 mon.b (mon.1) 112 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2020-11-16T21:55:55.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:55 smithi016 bash[10302]: audit 2020-11-16T21:55:54.624138+0000 mon.b (mon.1) 110 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2020-11-16T21:55:55.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:55 smithi016 bash[10302]: audit 2020-11-16T21:55:54.625708+0000 mon.b (mon.1) 111 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:55:55.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:55 smithi016 bash[10302]: cephadm 2020-11-16T21:55:54.626971+0000 mgr.x (mgr.24115) 53 : cephadm [INF] Deploying daemon osd.3 on smithi195 2020-11-16T21:55:55.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:55 smithi016 bash[10302]: audit 2020-11-16T21:55:54.627609+0000 mon.b (mon.1) 112 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2020-11-16T21:55:55.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:55 smithi057 bash[10301]: audit 2020-11-16T21:55:54.624138+0000 mon.b (mon.1) 110 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2020-11-16T21:55:55.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:55 smithi057 bash[10301]: audit 2020-11-16T21:55:54.625708+0000 mon.b (mon.1) 111 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:55:55.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:55 smithi057 bash[10301]: cephadm 2020-11-16T21:55:54.626971+0000 mgr.x (mgr.24115) 53 : cephadm [INF] Deploying daemon osd.3 on smithi195 2020-11-16T21:55:55.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:55 smithi057 bash[10301]: audit 2020-11-16T21:55:54.627609+0000 mon.b (mon.1) 112 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2020-11-16T21:55:56.721 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:56 smithi195 bash[10218]: cluster 2020-11-16T21:55:55.456591+0000 mgr.x (mgr.24115) 54 : cluster [DBG] pgmap v54: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:56.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:56 smithi016 bash[10302]: cluster 2020-11-16T21:55:55.456591+0000 mgr.x (mgr.24115) 54 : cluster [DBG] pgmap v54: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:56.943 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 3 on host 'smithi195' 2020-11-16T21:55:56.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:56 smithi057 bash[10301]: cluster 2020-11-16T21:55:55.456591+0000 mgr.x (mgr.24115) 54 : cluster [DBG] pgmap v54: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:57.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:57 smithi016 bash[10302]: audit 2020-11-16T21:55:56.947123+0000 mon.b (mon.1) 113 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:57.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:57 smithi016 bash[10302]: audit 2020-11-16T21:55:56.947913+0000 mon.b (mon.1) 114 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:55:57.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:57 smithi016 bash[10302]: audit 2020-11-16T21:55:56.949673+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:57.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:57 smithi016 bash[10302]: audit 2020-11-16T21:55:56.955015+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:57.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:57 smithi195 bash[10218]: audit 2020-11-16T21:55:56.947123+0000 mon.b (mon.1) 113 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:57.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:57 smithi195 bash[10218]: audit 2020-11-16T21:55:56.947913+0000 mon.b (mon.1) 114 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:55:57.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:57 smithi195 bash[10218]: audit 2020-11-16T21:55:56.949673+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:57.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:57 smithi195 bash[10218]: audit 2020-11-16T21:55:56.955015+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:57.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:57 smithi057 bash[10301]: audit 2020-11-16T21:55:56.947123+0000 mon.b (mon.1) 113 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:57.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:57 smithi057 bash[10301]: audit 2020-11-16T21:55:56.947913+0000 mon.b (mon.1) 114 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:55:57.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:57 smithi057 bash[10301]: audit 2020-11-16T21:55:56.949673+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:57.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:57 smithi057 bash[10301]: audit 2020-11-16T21:55:56.955015+0000 mon.a (mon.0) 405 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523760\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.523938\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524180\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:31.524395\", \"created\": \"2020-11-16T21:55:30.721880\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_device_update\": \"2020-11-16T21:55:37.583193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:58.085 INFO:teuthology.orchestra.run.smithi195:osd.3> sudo journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.3.service 2020-11-16T21:55:58.088 INFO:tasks.cephadm:Deploying osd.4 on smithi016 with /dev/vg_nvme/lv_4... 2020-11-16T21:55:58.088 INFO:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2020-11-16T21:55:58.107 INFO:journalctl@ceph.osd.3.smithi195.stdout:-- Logs begin at Sun 2020-11-15 12:21:41 UTC. -- 2020-11-16T21:55:58.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:58 smithi016 bash[10302]: cluster 2020-11-16T21:55:57.457150+0000 mgr.x (mgr.24115) 55 : cluster [DBG] pgmap v55: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:58.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:58 smithi016 bash[10302]: audit 2020-11-16T21:55:57.796153+0000 mon.b (mon.1) 115 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:58.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:58 smithi016 bash[10302]: audit 2020-11-16T21:55:57.798931+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:58.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:58 smithi016 bash[10302]: audit 2020-11-16T21:55:57.804931+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:58.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:55:58 smithi016 bash[10302]: audit 2020-11-16T21:55:57.804992+0000 mon.b (mon.1) 116 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:58.908 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:58 smithi195 bash[10218]: cluster 2020-11-16T21:55:57.457150+0000 mgr.x (mgr.24115) 55 : cluster [DBG] pgmap v55: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:58.908 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:58 smithi195 bash[10218]: audit 2020-11-16T21:55:57.796153+0000 mon.b (mon.1) 115 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:58.908 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:58 smithi195 bash[10218]: audit 2020-11-16T21:55:57.798931+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:58.909 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:58 smithi195 bash[10218]: audit 2020-11-16T21:55:57.804931+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:58.909 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:55:58 smithi195 bash[10218]: audit 2020-11-16T21:55:57.804992+0000 mon.b (mon.1) 116 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:58.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:58 smithi057 bash[10301]: cluster 2020-11-16T21:55:57.457150+0000 mgr.x (mgr.24115) 55 : cluster [DBG] pgmap v55: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:55:58.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:58 smithi057 bash[10301]: audit 2020-11-16T21:55:57.796153+0000 mon.b (mon.1) 115 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:58.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:58 smithi057 bash[10301]: audit 2020-11-16T21:55:57.798931+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:55:58.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:58 smithi057 bash[10301]: audit 2020-11-16T21:55:57.804931+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:55:58.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:55:58 smithi057 bash[10301]: audit 2020-11-16T21:55:57.804992+0000 mon.b (mon.1) 116 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:55:59.260 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 21:55:58 smithi195 bash[23354]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-11-16T21:55:59.261 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 21:55:58 smithi195 bash[23354]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2020-11-16T21:55:59.261 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 21:55:58 smithi195 bash[23354]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2020-11-16T21:55:59.261 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 21:55:58 smithi195 bash[23354]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2020-11-16T21:55:59.261 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 21:55:58 smithi195 bash[23354]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2020-11-16T21:55:59.261 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 21:55:58 smithi195 bash[23354]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-11-16T21:55:59.262 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 21:55:58 smithi195 bash[23354]: --> ceph-volume lvm activate successful for osd ID: 3 2020-11-16T21:56:00.093 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 21:55:59 smithi195 bash[23354]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.3 2020-11-16T21:56:00.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:00 smithi057 bash[10301]: cluster 2020-11-16T21:55:59.457670+0000 mgr.x (mgr.24115) 56 : cluster [DBG] pgmap v56: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:56:00.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:00 smithi016 bash[10302]: cluster 2020-11-16T21:55:59.457670+0000 mgr.x (mgr.24115) 56 : cluster [DBG] pgmap v56: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:56:00.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:00 smithi195 bash[10218]: cluster 2020-11-16T21:55:59.457670+0000 mgr.x (mgr.24115) 56 : cluster [DBG] pgmap v56: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:56:01.481 INFO:teuthology.orchestra.run.smithi016.stderr:--> Zapping: /dev/vg_nvme/lv_4 2020-11-16T21:56:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2020-11-16T21:56:01.482 INFO:teuthology.orchestra.run.smithi016.stderr: stderr: 10+0 records in 2020-11-16T21:56:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:10+0 records out 2020-11-16T21:56:01.482 INFO:teuthology.orchestra.run.smithi016.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0160945 s, 652 MB/s 2020-11-16T21:56:01.482 INFO:teuthology.orchestra.run.smithi016.stderr:--> Zapping successful for: 2020-11-16T21:56:01.565 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 21:56:01 smithi195 bash[23354]: debug 2020-11-16T21:56:01.485+0000 7fb4e1508700 10 -- 172.21.15.195:0/212520462 dispatch_throttle_release 308 to dispatch throttler 502/104857600 2020-11-16T21:56:01.566 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 21:56:01 smithi195 bash[23354]: debug 2020-11-16T21:56:01.485+0000 7fb4e1508700 20 -- 172.21.15.195:0/212520462 done calling dispatch on 0x55a8234b2c60 2020-11-16T21:56:01.566 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 21:56:01 smithi195 bash[23354]: debug 2020-11-16T21:56:01.485+0000 7fb4e1508700 1 -- 172.21.15.195:0/212520462 <== mon.0 v1:172.21.15.195:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (unknown 3314723177 0 0) 0x55a8234bcb60 con 0x55a823536c00 2020-11-16T21:56:01.566 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 21:56:01 smithi195 bash[23354]: debug 2020-11-16T21:56:01.485+0000 7fb4e1508700 10 -- 172.21.15.195:0/212520462 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2020-11-16T21:56:01.566 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 21:56:01 smithi195 bash[23354]: debug 2020-11-16T21:56:01.485+0000 7fb4e1508700 20 -- 172.21.15.195:0/212520462 done calling dispatch on 0x55a8234bcb60 2020-11-16T21:56:01.843 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 21:56:01 smithi195 bash[23354]: debug 2020-11-16T21:56:01.781+0000 7fb4e8f88f40 -1 Falling back to public interface 2020-11-16T21:56:02.136 INFO:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch daemon add osd smithi016:vg_nvme/lv_4 2020-11-16T21:56:02.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:02 smithi016 bash[10302]: cluster 2020-11-16T21:56:01.458221+0000 mgr.x (mgr.24115) 57 : cluster [DBG] pgmap v57: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:56:02.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:02 smithi016 bash[10302]: audit 2020-11-16T21:56:02.415697+0000 mon.a (mon.0) 408 : audit [INF] from='osd.3 v1:172.21.15.195:6812/825751928' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-11-16T21:56:02.843 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 21:56:02 smithi195 bash[23354]: debug 2020-11-16T21:56:02.405+0000 7fb4e8f88f40 -1 osd.3 0 log_to_monitors {default=true} 2020-11-16T21:56:02.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:02 smithi195 bash[10218]: cluster 2020-11-16T21:56:01.458221+0000 mgr.x (mgr.24115) 57 : cluster [DBG] pgmap v57: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:56:02.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:02 smithi195 bash[10218]: audit 2020-11-16T21:56:02.415697+0000 mon.a (mon.0) 408 : audit [INF] from='osd.3 v1:172.21.15.195:6812/825751928' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-11-16T21:56:02.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:02 smithi057 bash[10301]: cluster 2020-11-16T21:56:01.458221+0000 mgr.x (mgr.24115) 57 : cluster [DBG] pgmap v57: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:56:02.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:02 smithi057 bash[10301]: audit 2020-11-16T21:56:02.415697+0000 mon.a (mon.0) 408 : audit [INF] from='osd.3 v1:172.21.15.195:6812/825751928' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2020-11-16T21:56:03.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:03 smithi016 bash[10302]: audit 2020-11-16T21:56:02.519956+0000 mon.b (mon.1) 117 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:56:03.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:03 smithi016 bash[10302]: audit 2020-11-16T21:56:02.521001+0000 mon.a (mon.0) 409 : audit [INF] from='osd.3 v1:172.21.15.195:6812/825751928' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2020-11-16T21:56:03.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:03 smithi016 bash[10302]: cluster 2020-11-16T21:56:02.521121+0000 mon.a (mon.0) 410 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2020-11-16T21:56:03.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:03 smithi016 bash[10302]: audit 2020-11-16T21:56:02.522491+0000 mon.a (mon.0) 411 : audit [INF] from='osd.3 v1:172.21.15.195:6812/825751928' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2020-11-16T21:56:03.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:03 smithi016 bash[10302]: audit 2020-11-16T21:56:03.523576+0000 mon.a (mon.0) 412 : audit [INF] from='osd.3 v1:172.21.15.195:6812/825751928' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2020-11-16T21:56:03.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:03 smithi016 bash[10302]: cluster 2020-11-16T21:56:03.523683+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e27: 4 total, 3 up, 3 in 2020-11-16T21:56:03.843 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 21:56:03 smithi195 bash[23354]: debug 2020-11-16T21:56:03.525+0000 7fb4df504700 -1 osd.3 0 waiting for initial osdmap 2020-11-16T21:56:03.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:03 smithi195 bash[10218]: audit 2020-11-16T21:56:02.519956+0000 mon.b (mon.1) 117 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:56:03.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:03 smithi195 bash[10218]: audit 2020-11-16T21:56:02.521001+0000 mon.a (mon.0) 409 : audit [INF] from='osd.3 v1:172.21.15.195:6812/825751928' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2020-11-16T21:56:03.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:03 smithi195 bash[10218]: cluster 2020-11-16T21:56:02.521121+0000 mon.a (mon.0) 410 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2020-11-16T21:56:03.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:03 smithi195 bash[10218]: audit 2020-11-16T21:56:02.522491+0000 mon.a (mon.0) 411 : audit [INF] from='osd.3 v1:172.21.15.195:6812/825751928' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2020-11-16T21:56:03.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:03 smithi195 bash[10218]: audit 2020-11-16T21:56:03.523576+0000 mon.a (mon.0) 412 : audit [INF] from='osd.3 v1:172.21.15.195:6812/825751928' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2020-11-16T21:56:03.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:03 smithi195 bash[10218]: cluster 2020-11-16T21:56:03.523683+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e27: 4 total, 3 up, 3 in 2020-11-16T21:56:03.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:03 smithi057 bash[10301]: audit 2020-11-16T21:56:02.519956+0000 mon.b (mon.1) 117 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:56:03.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:03 smithi057 bash[10301]: audit 2020-11-16T21:56:02.521001+0000 mon.a (mon.0) 409 : audit [INF] from='osd.3 v1:172.21.15.195:6812/825751928' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2020-11-16T21:56:03.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:03 smithi057 bash[10301]: cluster 2020-11-16T21:56:02.521121+0000 mon.a (mon.0) 410 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2020-11-16T21:56:03.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:03 smithi057 bash[10301]: audit 2020-11-16T21:56:02.522491+0000 mon.a (mon.0) 411 : audit [INF] from='osd.3 v1:172.21.15.195:6812/825751928' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2020-11-16T21:56:03.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:03 smithi057 bash[10301]: audit 2020-11-16T21:56:03.523576+0000 mon.a (mon.0) 412 : audit [INF] from='osd.3 v1:172.21.15.195:6812/825751928' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2020-11-16T21:56:03.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:03 smithi057 bash[10301]: cluster 2020-11-16T21:56:03.523683+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e27: 4 total, 3 up, 3 in 2020-11-16T21:56:04.779 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:04 smithi016 bash[10302]: cluster 2020-11-16T21:56:03.458726+0000 mgr.x (mgr.24115) 58 : cluster [DBG] pgmap v59: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:56:04.780 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:04 smithi016 bash[10302]: audit 2020-11-16T21:56:03.522060+0000 mon.b (mon.1) 118 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:56:04.780 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:04 smithi016 bash[10302]: audit 2020-11-16T21:56:03.531413+0000 mon.b (mon.1) 119 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:56:04.780 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:04 smithi016 bash[10302]: audit 2020-11-16T21:56:03.576980+0000 mon.b (mon.1) 120 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:56:04.780 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:04 smithi016 bash[10302]: audit 2020-11-16T21:56:03.874336+0000 mon.b (mon.1) 121 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:56:04.780 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:04 smithi016 bash[10302]: audit 2020-11-16T21:56:03.877090+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:56:04.781 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:04 smithi016 bash[10302]: audit 2020-11-16T21:56:03.882279+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:56:04.781 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:04 smithi016 bash[10302]: audit 2020-11-16T21:56:03.883737+0000 mon.b (mon.1) 122 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:04.781 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:04 smithi016 bash[10302]: audit 2020-11-16T21:56:03.886157+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:04.781 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:04 smithi016 bash[10302]: audit 2020-11-16T21:56:03.889280+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:04.781 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:04 smithi016 bash[10302]: audit 2020-11-16T21:56:03.893475+0000 mon.b (mon.1) 123 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:04.782 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:04 smithi016 bash[10302]: audit 2020-11-16T21:56:03.895738+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:04.782 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:04 smithi016 bash[10302]: audit 2020-11-16T21:56:03.899754+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:04.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:04 smithi195 bash[10218]: cluster 2020-11-16T21:56:03.458726+0000 mgr.x (mgr.24115) 58 : cluster [DBG] pgmap v59: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:56:04.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:04 smithi195 bash[10218]: audit 2020-11-16T21:56:03.522060+0000 mon.b (mon.1) 118 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:56:04.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:04 smithi195 bash[10218]: audit 2020-11-16T21:56:03.531413+0000 mon.b (mon.1) 119 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:56:04.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:04 smithi195 bash[10218]: audit 2020-11-16T21:56:03.576980+0000 mon.b (mon.1) 120 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:56:04.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:04 smithi195 bash[10218]: audit 2020-11-16T21:56:03.874336+0000 mon.b (mon.1) 121 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:56:04.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:04 smithi195 bash[10218]: audit 2020-11-16T21:56:03.877090+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:56:04.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:04 smithi195 bash[10218]: audit 2020-11-16T21:56:03.882279+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:56:04.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:04 smithi195 bash[10218]: audit 2020-11-16T21:56:03.883737+0000 mon.b (mon.1) 122 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:04.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:04 smithi195 bash[10218]: audit 2020-11-16T21:56:03.886157+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:04.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:04 smithi195 bash[10218]: audit 2020-11-16T21:56:03.889280+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:04.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:04 smithi195 bash[10218]: audit 2020-11-16T21:56:03.893475+0000 mon.b (mon.1) 123 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:04.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:04 smithi195 bash[10218]: audit 2020-11-16T21:56:03.895738+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:04.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:04 smithi195 bash[10218]: audit 2020-11-16T21:56:03.899754+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:04.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:04 smithi057 bash[10301]: cluster 2020-11-16T21:56:03.458726+0000 mgr.x (mgr.24115) 58 : cluster [DBG] pgmap v59: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:56:04.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:04 smithi057 bash[10301]: audit 2020-11-16T21:56:03.522060+0000 mon.b (mon.1) 118 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:56:04.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:04 smithi057 bash[10301]: audit 2020-11-16T21:56:03.531413+0000 mon.b (mon.1) 119 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:56:04.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:04 smithi057 bash[10301]: audit 2020-11-16T21:56:03.576980+0000 mon.b (mon.1) 120 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:56:04.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:04 smithi057 bash[10301]: audit 2020-11-16T21:56:03.874336+0000 mon.b (mon.1) 121 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:56:04.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:04 smithi057 bash[10301]: audit 2020-11-16T21:56:03.877090+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]: dispatch 2020-11-16T21:56:04.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:04 smithi057 bash[10301]: audit 2020-11-16T21:56:03.882279+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T21:51:38.303550\"}"}]': finished 2020-11-16T21:56:04.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:04 smithi057 bash[10301]: audit 2020-11-16T21:56:03.883737+0000 mon.b (mon.1) 122 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:04.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:04 smithi057 bash[10301]: audit 2020-11-16T21:56:03.886157+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:04.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:04 smithi057 bash[10301]: audit 2020-11-16T21:56:03.889280+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:04.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:04 smithi057 bash[10301]: audit 2020-11-16T21:56:03.893475+0000 mon.b (mon.1) 123 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:04.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:04 smithi057 bash[10301]: audit 2020-11-16T21:56:03.895738+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:04.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:04 smithi057 bash[10301]: audit 2020-11-16T21:56:03.899754+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:05.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:05 smithi016 bash[10302]: cluster 2020-11-16T21:56:03.417889+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:56:05.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:05 smithi016 bash[10302]: cluster 2020-11-16T21:56:03.418065+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:56:05.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:05 smithi016 bash[10302]: audit 2020-11-16T21:56:04.529349+0000 mon.b (mon.1) 124 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:56:05.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:05 smithi016 bash[10302]: audit 2020-11-16T21:56:04.545502+0000 mon.b (mon.1) 125 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:56:05.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:05 smithi016 bash[10302]: cluster 2020-11-16T21:56:04.545794+0000 mon.a (mon.0) 420 : cluster [INF] osd.3 v1:172.21.15.195:6812/825751928 boot 2020-11-16T21:56:05.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:05 smithi016 bash[10302]: cluster 2020-11-16T21:56:04.545860+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2020-11-16T21:56:05.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:05 smithi016 bash[10302]: audit 2020-11-16T21:56:05.237379+0000 mon.b (mon.1) 126 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:56:05.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:05 smithi016 bash[10302]: audit 2020-11-16T21:56:05.240976+0000 mon.b (mon.1) 127 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:56:05.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:05 smithi016 bash[10302]: audit 2020-11-16T21:56:05.242426+0000 mon.b (mon.1) 128 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:56:05.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:05 smithi016 bash[10302]: audit 2020-11-16T21:56:05.243886+0000 mon.b (mon.1) 129 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:05.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:05 smithi195 bash[10218]: cluster 2020-11-16T21:56:03.417889+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:56:05.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:05 smithi195 bash[10218]: cluster 2020-11-16T21:56:03.418065+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:56:05.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:05 smithi195 bash[10218]: audit 2020-11-16T21:56:04.529349+0000 mon.b (mon.1) 124 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:56:05.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:05 smithi195 bash[10218]: audit 2020-11-16T21:56:04.545502+0000 mon.b (mon.1) 125 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:56:05.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:05 smithi195 bash[10218]: cluster 2020-11-16T21:56:04.545794+0000 mon.a (mon.0) 420 : cluster [INF] osd.3 v1:172.21.15.195:6812/825751928 boot 2020-11-16T21:56:05.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:05 smithi195 bash[10218]: cluster 2020-11-16T21:56:04.545860+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2020-11-16T21:56:05.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:05 smithi195 bash[10218]: audit 2020-11-16T21:56:05.237379+0000 mon.b (mon.1) 126 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:56:05.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:05 smithi195 bash[10218]: audit 2020-11-16T21:56:05.240976+0000 mon.b (mon.1) 127 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:56:05.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:05 smithi195 bash[10218]: audit 2020-11-16T21:56:05.242426+0000 mon.b (mon.1) 128 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:56:05.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:05 smithi195 bash[10218]: audit 2020-11-16T21:56:05.243886+0000 mon.b (mon.1) 129 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:05.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:05 smithi057 bash[10301]: cluster 2020-11-16T21:56:03.417889+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:56:05.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:05 smithi057 bash[10301]: cluster 2020-11-16T21:56:03.418065+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:56:05.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:05 smithi057 bash[10301]: audit 2020-11-16T21:56:04.529349+0000 mon.b (mon.1) 124 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:56:05.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:05 smithi057 bash[10301]: audit 2020-11-16T21:56:04.545502+0000 mon.b (mon.1) 125 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2020-11-16T21:56:05.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:05 smithi057 bash[10301]: cluster 2020-11-16T21:56:04.545794+0000 mon.a (mon.0) 420 : cluster [INF] osd.3 v1:172.21.15.195:6812/825751928 boot 2020-11-16T21:56:05.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:05 smithi057 bash[10301]: cluster 2020-11-16T21:56:04.545860+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2020-11-16T21:56:05.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:05 smithi057 bash[10301]: audit 2020-11-16T21:56:05.237379+0000 mon.b (mon.1) 126 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:56:05.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:05 smithi057 bash[10301]: audit 2020-11-16T21:56:05.240976+0000 mon.b (mon.1) 127 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:56:05.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:05 smithi057 bash[10301]: audit 2020-11-16T21:56:05.242426+0000 mon.b (mon.1) 128 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:56:05.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:05 smithi057 bash[10301]: audit 2020-11-16T21:56:05.243886+0000 mon.b (mon.1) 129 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:06.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:06 smithi016 bash[10302]: audit 2020-11-16T21:56:05.235451+0000 mgr.x (mgr.24115) 59 : audit [DBG] from='client.24235 v1:172.21.15.16:0/2418524035' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:56:06.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:06 smithi016 bash[10302]: cephadm 2020-11-16T21:56:05.238641+0000 mgr.x (mgr.24115) 60 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:56:06.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:06 smithi016 bash[10302]: cephadm 2020-11-16T21:56:05.238810+0000 mgr.x (mgr.24115) 61 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:56:06.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:06 smithi016 bash[10302]: cephadm 2020-11-16T21:56:05.240215+0000 mgr.x (mgr.24115) 62 : cephadm [INF] Applying None on host smithi016... 2020-11-16T21:56:06.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:06 smithi016 bash[10302]: cluster 2020-11-16T21:56:05.459251+0000 mgr.x (mgr.24115) 63 : cluster [DBG] pgmap v62: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:56:06.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:06 smithi016 bash[10302]: cluster 2020-11-16T21:56:05.559761+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e29: 4 total, 4 up, 4 in 2020-11-16T21:56:06.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:06 smithi195 bash[10218]: audit 2020-11-16T21:56:05.235451+0000 mgr.x (mgr.24115) 59 : audit [DBG] from='client.24235 v1:172.21.15.16:0/2418524035' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:56:06.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:06 smithi195 bash[10218]: cephadm 2020-11-16T21:56:05.238641+0000 mgr.x (mgr.24115) 60 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:56:06.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:06 smithi195 bash[10218]: cephadm 2020-11-16T21:56:05.238810+0000 mgr.x (mgr.24115) 61 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:56:06.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:06 smithi195 bash[10218]: cephadm 2020-11-16T21:56:05.240215+0000 mgr.x (mgr.24115) 62 : cephadm [INF] Applying None on host smithi016... 2020-11-16T21:56:06.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:06 smithi195 bash[10218]: cluster 2020-11-16T21:56:05.459251+0000 mgr.x (mgr.24115) 63 : cluster [DBG] pgmap v62: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:56:06.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:06 smithi195 bash[10218]: cluster 2020-11-16T21:56:05.559761+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e29: 4 total, 4 up, 4 in 2020-11-16T21:56:06.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:06 smithi057 bash[10301]: audit 2020-11-16T21:56:05.235451+0000 mgr.x (mgr.24115) 59 : audit [DBG] from='client.24235 v1:172.21.15.16:0/2418524035' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:56:06.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:06 smithi057 bash[10301]: cephadm 2020-11-16T21:56:05.238641+0000 mgr.x (mgr.24115) 60 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:56:06.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:06 smithi057 bash[10301]: cephadm 2020-11-16T21:56:05.238810+0000 mgr.x (mgr.24115) 61 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:56:06.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:06 smithi057 bash[10301]: cephadm 2020-11-16T21:56:05.240215+0000 mgr.x (mgr.24115) 62 : cephadm [INF] Applying None on host smithi016... 2020-11-16T21:56:06.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:06 smithi057 bash[10301]: cluster 2020-11-16T21:56:05.459251+0000 mgr.x (mgr.24115) 63 : cluster [DBG] pgmap v62: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2020-11-16T21:56:06.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:06 smithi057 bash[10301]: cluster 2020-11-16T21:56:05.559761+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e29: 4 total, 4 up, 4 in 2020-11-16T21:56:08.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:08 smithi016 bash[10302]: cluster 2020-11-16T21:56:07.459860+0000 mgr.x (mgr.24115) 64 : cluster [DBG] pgmap v64: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:08.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:08 smithi195 bash[10218]: cluster 2020-11-16T21:56:07.459860+0000 mgr.x (mgr.24115) 64 : cluster [DBG] pgmap v64: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:08.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:08 smithi057 bash[10301]: cluster 2020-11-16T21:56:07.459860+0000 mgr.x (mgr.24115) 64 : cluster [DBG] pgmap v64: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:09.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:09 smithi016 bash[10302]: audit 2020-11-16T21:56:09.074637+0000 mon.b (mon.1) 130 : audit [INF] from='client.? v1:172.21.15.16:0/3212487581' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bd595de-1740-4bdb-97b2-c346b366d299"}]: dispatch 2020-11-16T21:56:09.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:09 smithi016 bash[10302]: audit 2020-11-16T21:56:09.077289+0000 mon.a (mon.0) 423 : audit [INF] from='client.24241 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bd595de-1740-4bdb-97b2-c346b366d299"}]: dispatch 2020-11-16T21:56:09.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:09 smithi016 bash[10302]: audit 2020-11-16T21:56:09.083624+0000 mon.b (mon.1) 131 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:09.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:09 smithi016 bash[10302]: audit 2020-11-16T21:56:09.084781+0000 mon.a (mon.0) 424 : audit [INF] from='client.24241 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4bd595de-1740-4bdb-97b2-c346b366d299"}]': finished 2020-11-16T21:56:09.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:09 smithi016 bash[10302]: cluster 2020-11-16T21:56:09.084872+0000 mon.a (mon.0) 425 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2020-11-16T21:56:09.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:09 smithi195 bash[10218]: audit 2020-11-16T21:56:09.074637+0000 mon.b (mon.1) 130 : audit [INF] from='client.? v1:172.21.15.16:0/3212487581' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bd595de-1740-4bdb-97b2-c346b366d299"}]: dispatch 2020-11-16T21:56:09.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:09 smithi195 bash[10218]: audit 2020-11-16T21:56:09.077289+0000 mon.a (mon.0) 423 : audit [INF] from='client.24241 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bd595de-1740-4bdb-97b2-c346b366d299"}]: dispatch 2020-11-16T21:56:09.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:09 smithi195 bash[10218]: audit 2020-11-16T21:56:09.083624+0000 mon.b (mon.1) 131 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:09.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:09 smithi195 bash[10218]: audit 2020-11-16T21:56:09.084781+0000 mon.a (mon.0) 424 : audit [INF] from='client.24241 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4bd595de-1740-4bdb-97b2-c346b366d299"}]': finished 2020-11-16T21:56:09.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:09 smithi195 bash[10218]: cluster 2020-11-16T21:56:09.084872+0000 mon.a (mon.0) 425 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2020-11-16T21:56:09.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:09 smithi057 bash[10301]: audit 2020-11-16T21:56:09.074637+0000 mon.b (mon.1) 130 : audit [INF] from='client.? v1:172.21.15.16:0/3212487581' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bd595de-1740-4bdb-97b2-c346b366d299"}]: dispatch 2020-11-16T21:56:09.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:09 smithi057 bash[10301]: audit 2020-11-16T21:56:09.077289+0000 mon.a (mon.0) 423 : audit [INF] from='client.24241 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4bd595de-1740-4bdb-97b2-c346b366d299"}]: dispatch 2020-11-16T21:56:09.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:09 smithi057 bash[10301]: audit 2020-11-16T21:56:09.083624+0000 mon.b (mon.1) 131 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:09.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:09 smithi057 bash[10301]: audit 2020-11-16T21:56:09.084781+0000 mon.a (mon.0) 424 : audit [INF] from='client.24241 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4bd595de-1740-4bdb-97b2-c346b366d299"}]': finished 2020-11-16T21:56:09.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:09 smithi057 bash[10301]: cluster 2020-11-16T21:56:09.084872+0000 mon.a (mon.0) 425 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2020-11-16T21:56:10.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:10 smithi016 bash[10302]: cluster 2020-11-16T21:56:09.460489+0000 mgr.x (mgr.24115) 65 : cluster [DBG] pgmap v66: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:10.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:10 smithi016 bash[10302]: audit 2020-11-16T21:56:09.758925+0000 mon.b (mon.1) 132 : audit [DBG] from='client.? v1:172.21.15.16:0/3123706914' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:56:10.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:10 smithi195 bash[10218]: cluster 2020-11-16T21:56:09.460489+0000 mgr.x (mgr.24115) 65 : cluster [DBG] pgmap v66: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:10.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:10 smithi195 bash[10218]: audit 2020-11-16T21:56:09.758925+0000 mon.b (mon.1) 132 : audit [DBG] from='client.? v1:172.21.15.16:0/3123706914' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:56:10.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:10 smithi057 bash[10301]: cluster 2020-11-16T21:56:09.460489+0000 mgr.x (mgr.24115) 65 : cluster [DBG] pgmap v66: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:10.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:10 smithi057 bash[10301]: audit 2020-11-16T21:56:09.758925+0000 mon.b (mon.1) 132 : audit [DBG] from='client.? v1:172.21.15.16:0/3123706914' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:56:12.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:12 smithi016 bash[10302]: cluster 2020-11-16T21:56:11.461105+0000 mgr.x (mgr.24115) 66 : cluster [DBG] pgmap v67: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:12.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:12 smithi195 bash[10218]: cluster 2020-11-16T21:56:11.461105+0000 mgr.x (mgr.24115) 66 : cluster [DBG] pgmap v67: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:12.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:12 smithi057 bash[10301]: cluster 2020-11-16T21:56:11.461105+0000 mgr.x (mgr.24115) 66 : cluster [DBG] pgmap v67: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:13.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:13 smithi016 bash[10302]: audit 2020-11-16T21:56:12.797382+0000 mon.b (mon.1) 133 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:13.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:13 smithi195 bash[10218]: audit 2020-11-16T21:56:12.797382+0000 mon.b (mon.1) 133 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:13.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:13 smithi057 bash[10301]: audit 2020-11-16T21:56:12.797382+0000 mon.b (mon.1) 133 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:14.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:14 smithi016 bash[10302]: cluster 2020-11-16T21:56:13.461639+0000 mgr.x (mgr.24115) 67 : cluster [DBG] pgmap v68: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:14.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:14 smithi195 bash[10218]: cluster 2020-11-16T21:56:13.461639+0000 mgr.x (mgr.24115) 67 : cluster [DBG] pgmap v68: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:14.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:14 smithi057 bash[10301]: cluster 2020-11-16T21:56:13.461639+0000 mgr.x (mgr.24115) 67 : cluster [DBG] pgmap v68: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:16.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:16 smithi016 bash[10302]: cluster 2020-11-16T21:56:15.462198+0000 mgr.x (mgr.24115) 68 : cluster [DBG] pgmap v69: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:16.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:16 smithi195 bash[10218]: cluster 2020-11-16T21:56:15.462198+0000 mgr.x (mgr.24115) 68 : cluster [DBG] pgmap v69: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:16.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:16 smithi057 bash[10301]: cluster 2020-11-16T21:56:15.462198+0000 mgr.x (mgr.24115) 68 : cluster [DBG] pgmap v69: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:17.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:17 smithi195 bash[10218]: audit 2020-11-16T21:56:16.896415+0000 mon.b (mon.1) 134 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2020-11-16T21:56:17.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:17 smithi195 bash[10218]: audit 2020-11-16T21:56:16.897800+0000 mon.b (mon.1) 135 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:56:17.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:17 smithi195 bash[10218]: cephadm 2020-11-16T21:56:16.898957+0000 mgr.x (mgr.24115) 69 : cephadm [INF] Deploying daemon osd.4 on smithi016 2020-11-16T21:56:17.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:17 smithi195 bash[10218]: audit 2020-11-16T21:56:16.899531+0000 mon.b (mon.1) 136 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2020-11-16T21:56:17.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:17 smithi057 bash[10301]: audit 2020-11-16T21:56:16.896415+0000 mon.b (mon.1) 134 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2020-11-16T21:56:17.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:17 smithi057 bash[10301]: audit 2020-11-16T21:56:16.897800+0000 mon.b (mon.1) 135 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:56:17.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:17 smithi057 bash[10301]: cephadm 2020-11-16T21:56:16.898957+0000 mgr.x (mgr.24115) 69 : cephadm [INF] Deploying daemon osd.4 on smithi016 2020-11-16T21:56:17.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:17 smithi057 bash[10301]: audit 2020-11-16T21:56:16.899531+0000 mon.b (mon.1) 136 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2020-11-16T21:56:18.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:17 smithi016 bash[10302]: audit 2020-11-16T21:56:16.896415+0000 mon.b (mon.1) 134 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2020-11-16T21:56:18.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:17 smithi016 bash[10302]: audit 2020-11-16T21:56:16.897800+0000 mon.b (mon.1) 135 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:56:18.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:17 smithi016 bash[10302]: cephadm 2020-11-16T21:56:16.898957+0000 mgr.x (mgr.24115) 69 : cephadm [INF] Deploying daemon osd.4 on smithi016 2020-11-16T21:56:18.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:17 smithi016 bash[10302]: audit 2020-11-16T21:56:16.899531+0000 mon.b (mon.1) 136 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2020-11-16T21:56:18.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:18 smithi016 bash[10302]: cluster 2020-11-16T21:56:17.462862+0000 mgr.x (mgr.24115) 70 : cluster [DBG] pgmap v70: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:18.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:18 smithi195 bash[10218]: cluster 2020-11-16T21:56:17.462862+0000 mgr.x (mgr.24115) 70 : cluster [DBG] pgmap v70: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:18.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:18 smithi057 bash[10301]: cluster 2020-11-16T21:56:17.462862+0000 mgr.x (mgr.24115) 70 : cluster [DBG] pgmap v70: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:19.388 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 4 on host 'smithi016' 2020-11-16T21:56:19.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:19 smithi057 bash[10301]: audit 2020-11-16T21:56:19.395905+0000 mon.b (mon.1) 137 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:19.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:19 smithi057 bash[10301]: audit 2020-11-16T21:56:19.396439+0000 mon.b (mon.1) 138 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:56:19.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:19 smithi057 bash[10301]: audit 2020-11-16T21:56:19.398631+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:19.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:19 smithi057 bash[10301]: audit 2020-11-16T21:56:19.404288+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:20.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:19 smithi016 bash[10302]: audit 2020-11-16T21:56:19.395905+0000 mon.b (mon.1) 137 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:20.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:19 smithi016 bash[10302]: audit 2020-11-16T21:56:19.396439+0000 mon.b (mon.1) 138 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:56:20.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:19 smithi016 bash[10302]: audit 2020-11-16T21:56:19.398631+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:20.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:19 smithi016 bash[10302]: audit 2020-11-16T21:56:19.404288+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:20.093 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:19 smithi195 bash[10218]: audit 2020-11-16T21:56:19.395905+0000 mon.b (mon.1) 137 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:20.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:19 smithi195 bash[10218]: audit 2020-11-16T21:56:19.396439+0000 mon.b (mon.1) 138 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:56:20.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:19 smithi195 bash[10218]: audit 2020-11-16T21:56:19.398631+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:20.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:19 smithi195 bash[10218]: audit 2020-11-16T21:56:19.404288+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.656794\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:54:30.656937\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_device_update\": \"2020-11-16T21:52:39.404366\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:20.723 INFO:teuthology.orchestra.run.smithi016:osd.4> sudo journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.4.service 2020-11-16T21:56:20.725 INFO:tasks.cephadm:Deploying osd.5 on smithi016 with /dev/vg_nvme/lv_3... 2020-11-16T21:56:20.726 INFO:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2020-11-16T21:56:20.812 INFO:journalctl@ceph.osd.4.smithi016.stdout:-- Logs begin at Sun 2020-11-15 12:21:41 UTC. -- 2020-11-16T21:56:20.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:20 smithi057 bash[10301]: cluster 2020-11-16T21:56:19.463275+0000 mgr.x (mgr.24115) 71 : cluster [DBG] pgmap v71: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:20.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:20 smithi057 bash[10301]: audit 2020-11-16T21:56:20.311806+0000 mon.b (mon.1) 139 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:20.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:20 smithi057 bash[10301]: audit 2020-11-16T21:56:20.314494+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:20.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:20 smithi057 bash[10301]: audit 2020-11-16T21:56:20.319549+0000 mon.b (mon.1) 140 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:20.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:20 smithi057 bash[10301]: audit 2020-11-16T21:56:20.320267+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:21.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:20 smithi016 bash[10302]: cluster 2020-11-16T21:56:19.463275+0000 mgr.x (mgr.24115) 71 : cluster [DBG] pgmap v71: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:21.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:20 smithi016 bash[10302]: audit 2020-11-16T21:56:20.311806+0000 mon.b (mon.1) 139 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:21.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:20 smithi016 bash[10302]: audit 2020-11-16T21:56:20.314494+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:21.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:20 smithi016 bash[10302]: audit 2020-11-16T21:56:20.319549+0000 mon.b (mon.1) 140 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:21.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:20 smithi016 bash[10302]: audit 2020-11-16T21:56:20.320267+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:21.093 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:20 smithi195 bash[10218]: cluster 2020-11-16T21:56:19.463275+0000 mgr.x (mgr.24115) 71 : cluster [DBG] pgmap v71: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:21.093 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:20 smithi195 bash[10218]: audit 2020-11-16T21:56:20.311806+0000 mon.b (mon.1) 139 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:21.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:20 smithi195 bash[10218]: audit 2020-11-16T21:56:20.314494+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:21.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:20 smithi195 bash[10218]: audit 2020-11-16T21:56:20.319549+0000 mon.b (mon.1) 140 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:21.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:20 smithi195 bash[10218]: audit 2020-11-16T21:56:20.320267+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:22.332 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:22 smithi016 bash[12795]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-11-16T21:56:22.332 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:22 smithi016 bash[12795]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2020-11-16T21:56:22.333 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:22 smithi016 bash[12795]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2020-11-16T21:56:22.333 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:22 smithi016 bash[12795]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2020-11-16T21:56:22.333 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:22 smithi016 bash[12795]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-11-16T21:56:22.333 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:22 smithi016 bash[12795]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-11-16T21:56:22.333 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:22 smithi016 bash[12795]: --> ceph-volume lvm activate successful for osd ID: 4 2020-11-16T21:56:22.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:22 smithi016 bash[10302]: cluster 2020-11-16T21:56:21.463663+0000 mgr.x (mgr.24115) 72 : cluster [DBG] pgmap v72: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:22.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:22 smithi057 bash[10301]: cluster 2020-11-16T21:56:21.463663+0000 mgr.x (mgr.24115) 72 : cluster [DBG] pgmap v72: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:23.093 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:22 smithi195 bash[10218]: cluster 2020-11-16T21:56:21.463663+0000 mgr.x (mgr.24115) 72 : cluster [DBG] pgmap v72: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:23.582 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:23 smithi016 bash[12795]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.4 2020-11-16T21:56:24.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:24 smithi057 bash[10301]: cluster 2020-11-16T21:56:23.464223+0000 mgr.x (mgr.24115) 73 : cluster [DBG] pgmap v73: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:25.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:24 smithi016 bash[10302]: cluster 2020-11-16T21:56:23.464223+0000 mgr.x (mgr.24115) 73 : cluster [DBG] pgmap v73: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:25.093 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:24 smithi195 bash[10218]: cluster 2020-11-16T21:56:23.464223+0000 mgr.x (mgr.24115) 73 : cluster [DBG] pgmap v73: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:25.582 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.454+0000 7f730a89f700 20 -- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 legacy=0x562a78685800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2020-11-16T21:56:25.583 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.454+0000 7f730a89f700 20 -- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 legacy=0x562a78685800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=1 2020-11-16T21:56:25.583 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=OPENED pgs=82 cs=1 l=1).handle_message r=0 2020-11-16T21:56:25.583 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=OPENED pgs=82 cs=1 l=1).handle_message process tag 7 2020-11-16T21:56:25.583 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=OPENED pgs=82 cs=1 l=1).handle_message begin MSG 2020-11-16T21:56:25.583 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 -- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 legacy=0x562a78685800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=53 2020-11-16T21:56:25.584 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=OPENED pgs=82 cs=1 l=1).handle_message_header r=0 2020-11-16T21:56:25.584 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=OPENED pgs=82 cs=1 l=1).handle_message_header got MSG header 2020-11-16T21:56:25.584 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=OPENED pgs=82 cs=1 l=1).handle_message_header got envelope type=18 src mon.2 front=194 data=0 off 0 2020-11-16T21:56:25.584 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=THROTTLE_MESSAGE pgs=82 cs=1 l=1).throttle_message 2020-11-16T21:56:25.584 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=THROTTLE_BYTES pgs=82 cs=1 l=1).throttle_bytes 2020-11-16T21:56:25.584 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=THROTTLE_DISPATCH_QUEUE pgs=82 cs=1 l=1).throttle_dispatch_queue 2020-11-16T21:56:25.584 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=READ_MESSAGE_FRONT pgs=82 cs=1 l=1).read_message_front 2020-11-16T21:56:25.585 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 -- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 legacy=0x562a78685800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=194 2020-11-16T21:56:25.585 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=READ_MESSAGE_FRONT pgs=82 cs=1 l=1).handle_message_front r=0 2020-11-16T21:56:25.585 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=READ_MESSAGE_FRONT pgs=82 cs=1 l=1).handle_message_front got front 194 2020-11-16T21:56:25.585 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=READ_MESSAGE_FRONT pgs=82 cs=1 l=1).read_message_middle 2020-11-16T21:56:25.585 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=READ_MESSAGE_FRONT pgs=82 cs=1 l=1).read_message_data_prepare 2020-11-16T21:56:25.585 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=READ_MESSAGE_FRONT pgs=82 cs=1 l=1).read_message_data msg_left=0 2020-11-16T21:56:25.585 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=READ_MESSAGE_FRONT pgs=82 cs=1 l=1).read_message_footer 2020-11-16T21:56:25.585 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 -- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 legacy=0x562a78685800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=21 2020-11-16T21:56:25.586 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=READ_FOOTER_AND_DISPATCH pgs=82 cs=1 l=1).handle_message_footer r=0 2020-11-16T21:56:25.586 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 10 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=READ_FOOTER_AND_DISPATCH pgs=82 cs=1 l=1).handle_message_footer aborted = 0 2020-11-16T21:56:25.586 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=READ_FOOTER_AND_DISPATCH pgs=82 cs=1 l=1).handle_message_footer got 194 + 0 + 0 byte message 2020-11-16T21:56:25.586 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 10 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=READ_FOOTER_AND_DISPATCH pgs=82 cs=1 l=1).handle_message_footer no session security set 2020-11-16T21:56:25.586 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 5 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=READ_FOOTER_AND_DISPATCH pgs=82 cs=1 l=1). rx mon.2 seq 6 0x562a7861e680 auth_reply(proto 2 0 (0) Success) v1 2020-11-16T21:56:25.586 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 -- 172.21.15.16:0/3971328573 queue 0x562a7861e680 prio 196 2020-11-16T21:56:25.587 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 --1- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 0x562a78685800 :-1 s=OPENED pgs=82 cs=1 l=1).wait_message 2020-11-16T21:56:25.587 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a89f700 20 -- 172.21.15.16:0/3971328573 >> v1:172.21.15.57:6789/0 conn(0x562a78699000 legacy=0x562a78685800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=1 2020-11-16T21:56:25.587 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a09e700 1 -- 172.21.15.16:0/3971328573 <== mon.2 v1:172.21.15.57:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (unknown 907970157 0 0) 0x562a7861e680 con 0x562a78699000 2020-11-16T21:56:25.587 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a09e700 10 -- 172.21.15.16:0/3971328573 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2020-11-16T21:56:25.587 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:25 smithi016 bash[12795]: debug 2020-11-16T21:56:25.458+0000 7f730a09e700 20 -- 172.21.15.16:0/3971328573 done calling dispatch on 0x562a7861e680 2020-11-16T21:56:26.332 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:26 smithi016 bash[12795]: debug 2020-11-16T21:56:26.018+0000 7f7311b1ef40 -1 Falling back to public interface 2020-11-16T21:56:26.520 INFO:teuthology.orchestra.run.smithi016.stderr:--> Zapping: /dev/vg_nvme/lv_3 2020-11-16T21:56:26.520 INFO:teuthology.orchestra.run.smithi016.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2020-11-16T21:56:26.521 INFO:teuthology.orchestra.run.smithi016.stderr: stderr: 10+0 records in 2020-11-16T21:56:26.521 INFO:teuthology.orchestra.run.smithi016.stderr:10+0 records out 2020-11-16T21:56:26.521 INFO:teuthology.orchestra.run.smithi016.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0137666 s, 762 MB/s 2020-11-16T21:56:26.521 INFO:teuthology.orchestra.run.smithi016.stderr:--> Zapping successful for: 2020-11-16T21:56:26.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:26 smithi057 bash[10301]: cluster 2020-11-16T21:56:25.464624+0000 mgr.x (mgr.24115) 74 : cluster [DBG] pgmap v74: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:27.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:26 smithi016 bash[10302]: cluster 2020-11-16T21:56:25.464624+0000 mgr.x (mgr.24115) 74 : cluster [DBG] pgmap v74: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:27.082 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:26 smithi016 bash[12795]: debug 2020-11-16T21:56:26.662+0000 7f7311b1ef40 -1 osd.4 0 log_to_monitors {default=true} 2020-11-16T21:56:27.093 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:26 smithi195 bash[10218]: cluster 2020-11-16T21:56:25.464624+0000 mgr.x (mgr.24115) 74 : cluster [DBG] pgmap v74: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:27.358 INFO:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch daemon add osd smithi016:vg_nvme/lv_3 2020-11-16T21:56:27.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:27 smithi057 bash[10301]: audit 2020-11-16T21:56:26.676231+0000 mon.b (mon.1) 141 : audit [INF] from='osd.4 v1:172.21.15.16:6801/1979089250' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-11-16T21:56:27.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:27 smithi057 bash[10301]: audit 2020-11-16T21:56:26.678693+0000 mon.a (mon.0) 430 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-11-16T21:56:28.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:27 smithi016 bash[10302]: audit 2020-11-16T21:56:26.676231+0000 mon.b (mon.1) 141 : audit [INF] from='osd.4 v1:172.21.15.16:6801/1979089250' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-11-16T21:56:28.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:27 smithi016 bash[10302]: audit 2020-11-16T21:56:26.678693+0000 mon.a (mon.0) 430 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-11-16T21:56:28.093 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:27 smithi195 bash[10218]: audit 2020-11-16T21:56:26.676231+0000 mon.b (mon.1) 141 : audit [INF] from='osd.4 v1:172.21.15.16:6801/1979089250' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-11-16T21:56:28.093 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:27 smithi195 bash[10218]: audit 2020-11-16T21:56:26.678693+0000 mon.a (mon.0) 430 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2020-11-16T21:56:28.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:28 smithi016 bash[10302]: cluster 2020-11-16T21:56:27.465283+0000 mgr.x (mgr.24115) 75 : cluster [DBG] pgmap v75: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:28.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:28 smithi016 bash[10302]: audit 2020-11-16T21:56:27.647159+0000 mon.b (mon.1) 142 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:28.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:28 smithi016 bash[10302]: audit 2020-11-16T21:56:27.648253+0000 mon.a (mon.0) 431 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2020-11-16T21:56:28.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:28 smithi016 bash[10302]: cluster 2020-11-16T21:56:27.648359+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2020-11-16T21:56:28.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:28 smithi016 bash[10302]: audit 2020-11-16T21:56:28.021948+0000 mon.b (mon.1) 143 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:56:28.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:28 smithi016 bash[10302]: audit 2020-11-16T21:56:28.328059+0000 mon.b (mon.1) 144 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"last_device_update\": \"2020-11-16T21:56:28.326964\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:28.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:28 smithi016 bash[10302]: audit 2020-11-16T21:56:28.330737+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"last_device_update\": \"2020-11-16T21:56:28.326964\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:28.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:28 smithi016 bash[10302]: audit 2020-11-16T21:56:28.336650+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"last_device_update\": \"2020-11-16T21:56:28.326964\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:28.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:28 smithi016 bash[10302]: audit 2020-11-16T21:56:28.337283+0000 mon.b (mon.1) 145 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:28.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:28 smithi016 bash[10302]: audit 2020-11-16T21:56:28.339669+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:28.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:28 smithi016 bash[10302]: audit 2020-11-16T21:56:28.345505+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:28.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:28 smithi016 bash[10302]: audit 2020-11-16T21:56:28.347570+0000 mon.b (mon.1) 146 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:28.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:28 smithi016 bash[10302]: audit 2020-11-16T21:56:28.349987+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:28.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:28 smithi016 bash[10302]: audit 2020-11-16T21:56:28.360142+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:28.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:28 smithi016 bash[10302]: audit 2020-11-16T21:56:28.492110+0000 mon.b (mon.1) 147 : audit [INF] from='osd.4 v1:172.21.15.16:6801/1979089250' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:56:28.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:28 smithi016 bash[10302]: audit 2020-11-16T21:56:28.494879+0000 mon.a (mon.0) 439 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:56:28.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:28 smithi057 bash[10301]: cluster 2020-11-16T21:56:27.465283+0000 mgr.x (mgr.24115) 75 : cluster [DBG] pgmap v75: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:28.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:28 smithi057 bash[10301]: audit 2020-11-16T21:56:27.647159+0000 mon.b (mon.1) 142 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:28.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:28 smithi057 bash[10301]: audit 2020-11-16T21:56:27.648253+0000 mon.a (mon.0) 431 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2020-11-16T21:56:28.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:28 smithi057 bash[10301]: cluster 2020-11-16T21:56:27.648359+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2020-11-16T21:56:28.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:28 smithi057 bash[10301]: audit 2020-11-16T21:56:28.021948+0000 mon.b (mon.1) 143 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:56:28.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:28 smithi057 bash[10301]: audit 2020-11-16T21:56:28.328059+0000 mon.b (mon.1) 144 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"last_device_update\": \"2020-11-16T21:56:28.326964\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:28.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:28 smithi057 bash[10301]: audit 2020-11-16T21:56:28.330737+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"last_device_update\": \"2020-11-16T21:56:28.326964\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:28.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:28 smithi057 bash[10301]: audit 2020-11-16T21:56:28.336650+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"last_device_update\": \"2020-11-16T21:56:28.326964\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:28.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:28 smithi057 bash[10301]: audit 2020-11-16T21:56:28.337283+0000 mon.b (mon.1) 145 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:28.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:28 smithi057 bash[10301]: audit 2020-11-16T21:56:28.339669+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:28.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:28 smithi057 bash[10301]: audit 2020-11-16T21:56:28.345505+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:28.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:28 smithi057 bash[10301]: audit 2020-11-16T21:56:28.347570+0000 mon.b (mon.1) 146 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:28.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:28 smithi057 bash[10301]: audit 2020-11-16T21:56:28.349987+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:28.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:28 smithi057 bash[10301]: audit 2020-11-16T21:56:28.360142+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:28.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:28 smithi057 bash[10301]: audit 2020-11-16T21:56:28.492110+0000 mon.b (mon.1) 147 : audit [INF] from='osd.4 v1:172.21.15.16:6801/1979089250' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:56:28.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:28 smithi057 bash[10301]: audit 2020-11-16T21:56:28.494879+0000 mon.a (mon.0) 439 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:56:29.093 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:28 smithi195 bash[10218]: cluster 2020-11-16T21:56:27.465283+0000 mgr.x (mgr.24115) 75 : cluster [DBG] pgmap v75: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:29.093 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:28 smithi195 bash[10218]: audit 2020-11-16T21:56:27.647159+0000 mon.b (mon.1) 142 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:29.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:28 smithi195 bash[10218]: audit 2020-11-16T21:56:27.648253+0000 mon.a (mon.0) 431 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2020-11-16T21:56:29.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:28 smithi195 bash[10218]: cluster 2020-11-16T21:56:27.648359+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2020-11-16T21:56:29.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:28 smithi195 bash[10218]: audit 2020-11-16T21:56:28.021948+0000 mon.b (mon.1) 143 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:56:29.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:28 smithi195 bash[10218]: audit 2020-11-16T21:56:28.328059+0000 mon.b (mon.1) 144 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"last_device_update\": \"2020-11-16T21:56:28.326964\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:29.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:28 smithi195 bash[10218]: audit 2020-11-16T21:56:28.330737+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"last_device_update\": \"2020-11-16T21:56:28.326964\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:29.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:28 smithi195 bash[10218]: audit 2020-11-16T21:56:28.336650+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}}, \"last_daemon_update\": \"2020-11-16T21:56:20.310724\", \"last_device_update\": \"2020-11-16T21:56:28.326964\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:29.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:28 smithi195 bash[10218]: audit 2020-11-16T21:56:28.337283+0000 mon.b (mon.1) 145 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:29.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:28 smithi195 bash[10218]: audit 2020-11-16T21:56:28.339669+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:29.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:28 smithi195 bash[10218]: audit 2020-11-16T21:56:28.345505+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:29.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:28 smithi195 bash[10218]: audit 2020-11-16T21:56:28.347570+0000 mon.b (mon.1) 146 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:29.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:28 smithi195 bash[10218]: audit 2020-11-16T21:56:28.349987+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:29.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:28 smithi195 bash[10218]: audit 2020-11-16T21:56:28.360142+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:29.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:28 smithi195 bash[10218]: audit 2020-11-16T21:56:28.492110+0000 mon.b (mon.1) 147 : audit [INF] from='osd.4 v1:172.21.15.16:6801/1979089250' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:56:29.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:28 smithi195 bash[10218]: audit 2020-11-16T21:56:28.494879+0000 mon.a (mon.0) 439 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:56:29.832 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 21:56:29 smithi016 bash[12795]: debug 2020-11-16T21:56:29.366+0000 7f730989d700 -1 osd.4 0 waiting for initial osdmap 2020-11-16T21:56:30.582 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:30 smithi016 bash[10302]: cluster 2020-11-16T21:56:27.665571+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:56:30.582 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:30 smithi016 bash[10302]: cluster 2020-11-16T21:56:27.665742+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:56:30.583 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:30 smithi016 bash[10302]: audit 2020-11-16T21:56:29.363891+0000 mon.a (mon.0) 440 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2020-11-16T21:56:30.583 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:30 smithi016 bash[10302]: cluster 2020-11-16T21:56:29.364004+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e32: 5 total, 4 up, 4 in 2020-11-16T21:56:30.583 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:30 smithi016 bash[10302]: audit 2020-11-16T21:56:29.370553+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:30.583 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:30 smithi016 bash[10302]: audit 2020-11-16T21:56:29.371933+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:30.583 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:30 smithi016 bash[10302]: audit 2020-11-16T21:56:29.379440+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:30.583 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:30 smithi016 bash[10302]: audit 2020-11-16T21:56:29.384766+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:30.583 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:30 smithi016 bash[10302]: cluster 2020-11-16T21:56:29.465824+0000 mgr.x (mgr.24115) 76 : cluster [DBG] pgmap v78: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:30.584 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:30 smithi016 bash[10302]: audit 2020-11-16T21:56:29.701185+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:56:30.584 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:30 smithi016 bash[10302]: audit 2020-11-16T21:56:29.704995+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:56:30.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:30 smithi057 bash[10301]: cluster 2020-11-16T21:56:27.665571+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:56:30.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:30 smithi057 bash[10301]: cluster 2020-11-16T21:56:27.665742+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:56:30.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:30 smithi057 bash[10301]: audit 2020-11-16T21:56:29.363891+0000 mon.a (mon.0) 440 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2020-11-16T21:56:30.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:30 smithi057 bash[10301]: cluster 2020-11-16T21:56:29.364004+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e32: 5 total, 4 up, 4 in 2020-11-16T21:56:30.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:30 smithi057 bash[10301]: audit 2020-11-16T21:56:29.370553+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:30.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:30 smithi057 bash[10301]: audit 2020-11-16T21:56:29.371933+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:30.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:30 smithi057 bash[10301]: audit 2020-11-16T21:56:29.379440+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:30.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:30 smithi057 bash[10301]: audit 2020-11-16T21:56:29.384766+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:30.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:30 smithi057 bash[10301]: cluster 2020-11-16T21:56:29.465824+0000 mgr.x (mgr.24115) 76 : cluster [DBG] pgmap v78: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:30.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:30 smithi057 bash[10301]: audit 2020-11-16T21:56:29.701185+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:56:30.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:30 smithi057 bash[10301]: audit 2020-11-16T21:56:29.704995+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:56:30.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:30 smithi195 bash[10218]: cluster 2020-11-16T21:56:27.665571+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:56:30.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:30 smithi195 bash[10218]: cluster 2020-11-16T21:56:27.665742+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:56:30.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:30 smithi195 bash[10218]: audit 2020-11-16T21:56:29.363891+0000 mon.a (mon.0) 440 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2020-11-16T21:56:30.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:30 smithi195 bash[10218]: cluster 2020-11-16T21:56:29.364004+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e32: 5 total, 4 up, 4 in 2020-11-16T21:56:30.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:30 smithi195 bash[10218]: audit 2020-11-16T21:56:29.370553+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:30.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:30 smithi195 bash[10218]: audit 2020-11-16T21:56:29.371933+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:30.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:30 smithi195 bash[10218]: audit 2020-11-16T21:56:29.379440+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:30.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:30 smithi195 bash[10218]: audit 2020-11-16T21:56:29.384766+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:30.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:30 smithi195 bash[10218]: cluster 2020-11-16T21:56:29.465824+0000 mgr.x (mgr.24115) 76 : cluster [DBG] pgmap v78: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2020-11-16T21:56:30.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:30 smithi195 bash[10218]: audit 2020-11-16T21:56:29.701185+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:56:30.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:30 smithi195 bash[10218]: audit 2020-11-16T21:56:29.704995+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:56:31.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:31 smithi057 bash[10301]: audit 2020-11-16T21:56:30.371521+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:31.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:31 smithi057 bash[10301]: cluster 2020-11-16T21:56:30.388578+0000 mon.a (mon.0) 449 : cluster [INF] osd.4 v1:172.21.15.16:6801/1979089250 boot 2020-11-16T21:56:31.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:31 smithi057 bash[10301]: cluster 2020-11-16T21:56:30.388672+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2020-11-16T21:56:31.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:31 smithi057 bash[10301]: audit 2020-11-16T21:56:30.388892+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:31.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:31 smithi057 bash[10301]: audit 2020-11-16T21:56:30.772171+0000 mgr.x (mgr.24115) 77 : audit [DBG] from='client.24259 v1:172.21.15.16:0/830658633' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:56:31.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:31 smithi057 bash[10301]: cephadm 2020-11-16T21:56:30.775736+0000 mgr.x (mgr.24115) 78 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:56:31.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:31 smithi057 bash[10301]: cephadm 2020-11-16T21:56:30.775901+0000 mgr.x (mgr.24115) 79 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:56:31.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:31 smithi057 bash[10301]: audit 2020-11-16T21:56:30.775920+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:56:31.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:31 smithi057 bash[10301]: cephadm 2020-11-16T21:56:30.776889+0000 mgr.x (mgr.24115) 80 : cephadm [INF] Applying None on host smithi016... 2020-11-16T21:56:31.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:31 smithi057 bash[10301]: audit 2020-11-16T21:56:30.779611+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:56:31.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:31 smithi057 bash[10301]: audit 2020-11-16T21:56:30.781376+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:56:31.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:31 smithi057 bash[10301]: audit 2020-11-16T21:56:30.783024+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:31.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:31 smithi016 bash[10302]: audit 2020-11-16T21:56:30.371521+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:31.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:31 smithi016 bash[10302]: cluster 2020-11-16T21:56:30.388578+0000 mon.a (mon.0) 449 : cluster [INF] osd.4 v1:172.21.15.16:6801/1979089250 boot 2020-11-16T21:56:31.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:31 smithi016 bash[10302]: cluster 2020-11-16T21:56:30.388672+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2020-11-16T21:56:31.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:31 smithi016 bash[10302]: audit 2020-11-16T21:56:30.388892+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:31.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:31 smithi016 bash[10302]: audit 2020-11-16T21:56:30.772171+0000 mgr.x (mgr.24115) 77 : audit [DBG] from='client.24259 v1:172.21.15.16:0/830658633' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:56:31.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:31 smithi016 bash[10302]: cephadm 2020-11-16T21:56:30.775736+0000 mgr.x (mgr.24115) 78 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:56:31.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:31 smithi016 bash[10302]: cephadm 2020-11-16T21:56:30.775901+0000 mgr.x (mgr.24115) 79 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:56:31.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:31 smithi016 bash[10302]: audit 2020-11-16T21:56:30.775920+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:56:31.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:31 smithi016 bash[10302]: cephadm 2020-11-16T21:56:30.776889+0000 mgr.x (mgr.24115) 80 : cephadm [INF] Applying None on host smithi016... 2020-11-16T21:56:31.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:31 smithi016 bash[10302]: audit 2020-11-16T21:56:30.779611+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:56:31.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:31 smithi016 bash[10302]: audit 2020-11-16T21:56:30.781376+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:56:31.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:31 smithi016 bash[10302]: audit 2020-11-16T21:56:30.783024+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:31.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:31 smithi195 bash[10218]: audit 2020-11-16T21:56:30.371521+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:31.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:31 smithi195 bash[10218]: cluster 2020-11-16T21:56:30.388578+0000 mon.a (mon.0) 449 : cluster [INF] osd.4 v1:172.21.15.16:6801/1979089250 boot 2020-11-16T21:56:31.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:31 smithi195 bash[10218]: cluster 2020-11-16T21:56:30.388672+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2020-11-16T21:56:31.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:31 smithi195 bash[10218]: audit 2020-11-16T21:56:30.388892+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2020-11-16T21:56:31.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:31 smithi195 bash[10218]: audit 2020-11-16T21:56:30.772171+0000 mgr.x (mgr.24115) 77 : audit [DBG] from='client.24259 v1:172.21.15.16:0/830658633' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:56:31.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:31 smithi195 bash[10218]: cephadm 2020-11-16T21:56:30.775736+0000 mgr.x (mgr.24115) 78 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:56:31.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:31 smithi195 bash[10218]: cephadm 2020-11-16T21:56:30.775901+0000 mgr.x (mgr.24115) 79 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:56:31.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:31 smithi195 bash[10218]: audit 2020-11-16T21:56:30.775920+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:56:31.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:31 smithi195 bash[10218]: cephadm 2020-11-16T21:56:30.776889+0000 mgr.x (mgr.24115) 80 : cephadm [INF] Applying None on host smithi016... 2020-11-16T21:56:31.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:31 smithi195 bash[10218]: audit 2020-11-16T21:56:30.779611+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:56:31.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:31 smithi195 bash[10218]: audit 2020-11-16T21:56:30.781376+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:56:31.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:31 smithi195 bash[10218]: audit 2020-11-16T21:56:30.783024+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:32.582 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:32 smithi016 bash[10302]: cluster 2020-11-16T21:56:31.452281+0000 mon.a (mon.0) 456 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2020-11-16T21:56:32.582 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:32 smithi016 bash[10302]: cluster 2020-11-16T21:56:31.466257+0000 mgr.x (mgr.24115) 81 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:32.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:32 smithi057 bash[10301]: cluster 2020-11-16T21:56:31.452281+0000 mon.a (mon.0) 456 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2020-11-16T21:56:32.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:32 smithi057 bash[10301]: cluster 2020-11-16T21:56:31.466257+0000 mgr.x (mgr.24115) 81 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:32.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:32 smithi195 bash[10218]: cluster 2020-11-16T21:56:31.452281+0000 mon.a (mon.0) 456 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2020-11-16T21:56:32.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:32 smithi195 bash[10218]: cluster 2020-11-16T21:56:31.466257+0000 mgr.x (mgr.24115) 81 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:34.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:34 smithi016 bash[10302]: cluster 2020-11-16T21:56:33.466810+0000 mgr.x (mgr.24115) 82 : cluster [DBG] pgmap v82: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:34.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:34 smithi195 bash[10218]: cluster 2020-11-16T21:56:33.466810+0000 mgr.x (mgr.24115) 82 : cluster [DBG] pgmap v82: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:34.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:34 smithi057 bash[10301]: cluster 2020-11-16T21:56:33.466810+0000 mgr.x (mgr.24115) 82 : cluster [DBG] pgmap v82: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:35.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:35 smithi016 bash[10302]: audit 2020-11-16T21:56:34.678253+0000 mon.b (mon.1) 148 : audit [INF] from='client.? v1:172.21.15.16:0/1227083744' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b114510c-b7e9-48b0-8056-0a0fd4299259"}]: dispatch 2020-11-16T21:56:35.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:35 smithi016 bash[10302]: audit 2020-11-16T21:56:34.680644+0000 mon.a (mon.0) 457 : audit [INF] from='client.24265 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b114510c-b7e9-48b0-8056-0a0fd4299259"}]: dispatch 2020-11-16T21:56:35.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:35 smithi016 bash[10302]: audit 2020-11-16T21:56:34.688389+0000 mon.a (mon.0) 458 : audit [INF] from='client.24265 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b114510c-b7e9-48b0-8056-0a0fd4299259"}]': finished 2020-11-16T21:56:35.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:35 smithi016 bash[10302]: cluster 2020-11-16T21:56:34.688475+0000 mon.a (mon.0) 459 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2020-11-16T21:56:35.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:35 smithi016 bash[10302]: audit 2020-11-16T21:56:34.688785+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-11-16T21:56:35.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:35 smithi016 bash[10302]: audit 2020-11-16T21:56:35.354378+0000 mon.b (mon.1) 149 : audit [DBG] from='client.? v1:172.21.15.16:0/660978855' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:56:35.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:35 smithi195 bash[10218]: audit 2020-11-16T21:56:34.678253+0000 mon.b (mon.1) 148 : audit [INF] from='client.? v1:172.21.15.16:0/1227083744' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b114510c-b7e9-48b0-8056-0a0fd4299259"}]: dispatch 2020-11-16T21:56:35.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:35 smithi195 bash[10218]: audit 2020-11-16T21:56:34.680644+0000 mon.a (mon.0) 457 : audit [INF] from='client.24265 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b114510c-b7e9-48b0-8056-0a0fd4299259"}]: dispatch 2020-11-16T21:56:35.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:35 smithi195 bash[10218]: audit 2020-11-16T21:56:34.688389+0000 mon.a (mon.0) 458 : audit [INF] from='client.24265 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b114510c-b7e9-48b0-8056-0a0fd4299259"}]': finished 2020-11-16T21:56:35.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:35 smithi195 bash[10218]: cluster 2020-11-16T21:56:34.688475+0000 mon.a (mon.0) 459 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2020-11-16T21:56:35.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:35 smithi195 bash[10218]: audit 2020-11-16T21:56:34.688785+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-11-16T21:56:35.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:35 smithi195 bash[10218]: audit 2020-11-16T21:56:35.354378+0000 mon.b (mon.1) 149 : audit [DBG] from='client.? v1:172.21.15.16:0/660978855' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:56:35.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:35 smithi057 bash[10301]: audit 2020-11-16T21:56:34.678253+0000 mon.b (mon.1) 148 : audit [INF] from='client.? v1:172.21.15.16:0/1227083744' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b114510c-b7e9-48b0-8056-0a0fd4299259"}]: dispatch 2020-11-16T21:56:35.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:35 smithi057 bash[10301]: audit 2020-11-16T21:56:34.680644+0000 mon.a (mon.0) 457 : audit [INF] from='client.24265 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b114510c-b7e9-48b0-8056-0a0fd4299259"}]: dispatch 2020-11-16T21:56:35.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:35 smithi057 bash[10301]: audit 2020-11-16T21:56:34.688389+0000 mon.a (mon.0) 458 : audit [INF] from='client.24265 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b114510c-b7e9-48b0-8056-0a0fd4299259"}]': finished 2020-11-16T21:56:35.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:35 smithi057 bash[10301]: cluster 2020-11-16T21:56:34.688475+0000 mon.a (mon.0) 459 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2020-11-16T21:56:35.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:35 smithi057 bash[10301]: audit 2020-11-16T21:56:34.688785+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-11-16T21:56:35.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:35 smithi057 bash[10301]: audit 2020-11-16T21:56:35.354378+0000 mon.b (mon.1) 149 : audit [DBG] from='client.? v1:172.21.15.16:0/660978855' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:56:36.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:36 smithi057 bash[10301]: cluster 2020-11-16T21:56:35.467442+0000 mgr.x (mgr.24115) 83 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:37.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:36 smithi016 bash[10302]: cluster 2020-11-16T21:56:35.467442+0000 mgr.x (mgr.24115) 83 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:37.092 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:36 smithi195 bash[10218]: cluster 2020-11-16T21:56:35.467442+0000 mgr.x (mgr.24115) 83 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:38.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:38 smithi057 bash[10301]: cluster 2020-11-16T21:56:37.468087+0000 mgr.x (mgr.24115) 84 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:38.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:38 smithi057 bash[10301]: audit 2020-11-16T21:56:38.486184+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:39.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:38 smithi016 bash[10302]: cluster 2020-11-16T21:56:37.468087+0000 mgr.x (mgr.24115) 84 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:39.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:38 smithi016 bash[10302]: audit 2020-11-16T21:56:38.486184+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:39.092 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:38 smithi195 bash[10218]: cluster 2020-11-16T21:56:37.468087+0000 mgr.x (mgr.24115) 84 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:39.093 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:38 smithi195 bash[10218]: audit 2020-11-16T21:56:38.486184+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:40.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:40 smithi057 bash[10301]: cluster 2020-11-16T21:56:39.468597+0000 mgr.x (mgr.24115) 85 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:40.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:40 smithi016 bash[10302]: cluster 2020-11-16T21:56:39.468597+0000 mgr.x (mgr.24115) 85 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:40.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:40 smithi195 bash[10218]: cluster 2020-11-16T21:56:39.468597+0000 mgr.x (mgr.24115) 85 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:42.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:42 smithi016 bash[10302]: cluster 2020-11-16T21:56:41.469008+0000 mgr.x (mgr.24115) 86 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:42.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:42 smithi016 bash[10302]: audit 2020-11-16T21:56:42.422505+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2020-11-16T21:56:42.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:42 smithi016 bash[10302]: audit 2020-11-16T21:56:42.424531+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:56:42.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:42 smithi016 bash[10302]: audit 2020-11-16T21:56:42.426775+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2020-11-16T21:56:42.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:42 smithi195 bash[10218]: cluster 2020-11-16T21:56:41.469008+0000 mgr.x (mgr.24115) 86 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:42.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:42 smithi195 bash[10218]: audit 2020-11-16T21:56:42.422505+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2020-11-16T21:56:42.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:42 smithi195 bash[10218]: audit 2020-11-16T21:56:42.424531+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:56:42.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:42 smithi195 bash[10218]: audit 2020-11-16T21:56:42.426775+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2020-11-16T21:56:42.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:42 smithi057 bash[10301]: cluster 2020-11-16T21:56:41.469008+0000 mgr.x (mgr.24115) 86 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:42.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:42 smithi057 bash[10301]: audit 2020-11-16T21:56:42.422505+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2020-11-16T21:56:42.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:42 smithi057 bash[10301]: audit 2020-11-16T21:56:42.424531+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:56:42.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:42 smithi057 bash[10301]: audit 2020-11-16T21:56:42.426775+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2020-11-16T21:56:43.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:43 smithi016 bash[10302]: cephadm 2020-11-16T21:56:42.424158+0000 mgr.x (mgr.24115) 87 : cephadm [INF] Deploying daemon osd.5 on smithi016 2020-11-16T21:56:43.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:43 smithi195 bash[10218]: cephadm 2020-11-16T21:56:42.424158+0000 mgr.x (mgr.24115) 87 : cephadm [INF] Deploying daemon osd.5 on smithi016 2020-11-16T21:56:43.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:43 smithi057 bash[10301]: cephadm 2020-11-16T21:56:42.424158+0000 mgr.x (mgr.24115) 87 : cephadm [INF] Deploying daemon osd.5 on smithi016 2020-11-16T21:56:44.703 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:44 smithi016 bash[10302]: cluster 2020-11-16T21:56:43.469505+0000 mgr.x (mgr.24115) 88 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:44.781 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 5 on host 'smithi016' 2020-11-16T21:56:44.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:44 smithi195 bash[10218]: cluster 2020-11-16T21:56:43.469505+0000 mgr.x (mgr.24115) 88 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:44.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:44 smithi057 bash[10301]: cluster 2020-11-16T21:56:43.469505+0000 mgr.x (mgr.24115) 88 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:45.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:45 smithi016 bash[10302]: audit 2020-11-16T21:56:44.791162+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_device_update\": \"2020-11-16T21:56:28.326964\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:45.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:45 smithi016 bash[10302]: audit 2020-11-16T21:56:44.792117+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:56:45.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:45 smithi016 bash[10302]: audit 2020-11-16T21:56:44.796567+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_device_update\": \"2020-11-16T21:56:28.326964\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:45.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:45 smithi195 bash[10218]: audit 2020-11-16T21:56:44.791162+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_device_update\": \"2020-11-16T21:56:28.326964\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:45.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:45 smithi195 bash[10218]: audit 2020-11-16T21:56:44.792117+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:56:45.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:45 smithi195 bash[10218]: audit 2020-11-16T21:56:44.796567+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_device_update\": \"2020-11-16T21:56:28.326964\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:45.919 INFO:teuthology.orchestra.run.smithi016:osd.5> sudo journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.5.service 2020-11-16T21:56:45.922 INFO:tasks.cephadm:Deploying osd.6 on smithi016 with /dev/vg_nvme/lv_2... 2020-11-16T21:56:45.922 INFO:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2020-11-16T21:56:45.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:45 smithi057 bash[10301]: audit 2020-11-16T21:56:44.791162+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_device_update\": \"2020-11-16T21:56:28.326964\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:45.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:45 smithi057 bash[10301]: audit 2020-11-16T21:56:44.792117+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:56:45.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:45 smithi057 bash[10301]: audit 2020-11-16T21:56:44.796567+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310134\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:56:20.310307\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:20.310397\", \"created\": \"2020-11-16T21:56:19.366523\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_device_update\": \"2020-11-16T21:56:28.326964\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:45.960 INFO:journalctl@ceph.osd.5.smithi016.stdout:-- Logs begin at Sun 2020-11-15 12:21:41 UTC. -- 2020-11-16T21:56:46.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:46 smithi195 bash[10218]: cluster 2020-11-16T21:56:45.470110+0000 mgr.x (mgr.24115) 89 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:46.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:46 smithi195 bash[10218]: audit 2020-11-16T21:56:45.586035+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_daemon_update\": \"2020-11-16T21:56:45.582802\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:46.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:46 smithi195 bash[10218]: audit 2020-11-16T21:56:45.591886+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_daemon_update\": \"2020-11-16T21:56:45.582802\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:46.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:46 smithi195 bash[10218]: audit 2020-11-16T21:56:45.593315+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:46.884 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:46 smithi016 bash[10302]: cluster 2020-11-16T21:56:45.470110+0000 mgr.x (mgr.24115) 89 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:46.884 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:46 smithi016 bash[10302]: audit 2020-11-16T21:56:45.586035+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_daemon_update\": \"2020-11-16T21:56:45.582802\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:46.884 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:46 smithi016 bash[10302]: audit 2020-11-16T21:56:45.591886+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_daemon_update\": \"2020-11-16T21:56:45.582802\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:46.884 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:46 smithi016 bash[10302]: audit 2020-11-16T21:56:45.593315+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:46.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:46 smithi057 bash[10301]: cluster 2020-11-16T21:56:45.470110+0000 mgr.x (mgr.24115) 89 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:46.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:46 smithi057 bash[10301]: audit 2020-11-16T21:56:45.586035+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_daemon_update\": \"2020-11-16T21:56:45.582802\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:46.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:46 smithi057 bash[10301]: audit 2020-11-16T21:56:45.591886+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_daemon_update\": \"2020-11-16T21:56:45.582802\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:46.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:46 smithi057 bash[10301]: audit 2020-11-16T21:56:45.593315+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:47.582 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 21:56:47 smithi016 bash[15120]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-11-16T21:56:47.582 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 21:56:47 smithi016 bash[15120]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2020-11-16T21:56:47.582 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 21:56:47 smithi016 bash[15120]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2020-11-16T21:56:47.582 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 21:56:47 smithi016 bash[15120]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2020-11-16T21:56:47.583 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 21:56:47 smithi016 bash[15120]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2020-11-16T21:56:47.583 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 21:56:47 smithi016 bash[15120]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-11-16T21:56:47.583 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 21:56:47 smithi016 bash[15120]: --> ceph-volume lvm activate successful for osd ID: 5 2020-11-16T21:56:48.754 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:48 smithi016 bash[10302]: cluster 2020-11-16T21:56:47.470757+0000 mgr.x (mgr.24115) 90 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:48.755 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 21:56:48 smithi016 bash[15120]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.5 2020-11-16T21:56:48.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:48 smithi195 bash[10218]: cluster 2020-11-16T21:56:47.470757+0000 mgr.x (mgr.24115) 90 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:48.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:48 smithi057 bash[10301]: cluster 2020-11-16T21:56:47.470757+0000 mgr.x (mgr.24115) 90 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:50.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:50 smithi057 bash[10301]: cluster 2020-11-16T21:56:49.471294+0000 mgr.x (mgr.24115) 91 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:50.700 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:50 smithi016 bash[10302]: cluster 2020-11-16T21:56:49.471294+0000 mgr.x (mgr.24115) 91 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:50.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:50 smithi195 bash[10218]: cluster 2020-11-16T21:56:49.471294+0000 mgr.x (mgr.24115) 91 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:51.304 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 21:56:51 smithi016 bash[15120]: debug 2020-11-16T21:56:51.310+0000 7f8feb09df40 -1 Falling back to public interface 2020-11-16T21:56:51.713 INFO:teuthology.orchestra.run.smithi016.stderr:--> Zapping: /dev/vg_nvme/lv_2 2020-11-16T21:56:51.713 INFO:teuthology.orchestra.run.smithi016.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2020-11-16T21:56:51.713 INFO:teuthology.orchestra.run.smithi016.stderr: stderr: 10+0 records in 2020-11-16T21:56:51.713 INFO:teuthology.orchestra.run.smithi016.stderr:10+0 records out 2020-11-16T21:56:51.714 INFO:teuthology.orchestra.run.smithi016.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0139468 s, 752 MB/s 2020-11-16T21:56:51.714 INFO:teuthology.orchestra.run.smithi016.stderr:--> Zapping successful for: 2020-11-16T21:56:52.081 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 21:56:51 smithi016 bash[15120]: debug 2020-11-16T21:56:51.938+0000 7f8feb09df40 -1 osd.5 0 log_to_monitors {default=true} 2020-11-16T21:56:52.468 INFO:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch daemon add osd smithi016:vg_nvme/lv_2 2020-11-16T21:56:52.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:52 smithi016 bash[10302]: cluster 2020-11-16T21:56:51.471830+0000 mgr.x (mgr.24115) 92 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:52.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:52 smithi016 bash[10302]: audit 2020-11-16T21:56:51.950272+0000 mon.b (mon.1) 150 : audit [INF] from='osd.5 v1:172.21.15.16:6805/4180994375' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-11-16T21:56:52.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:52 smithi016 bash[10302]: audit 2020-11-16T21:56:51.952852+0000 mon.a (mon.0) 471 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-11-16T21:56:52.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:52 smithi195 bash[10218]: cluster 2020-11-16T21:56:51.471830+0000 mgr.x (mgr.24115) 92 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:52.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:52 smithi195 bash[10218]: audit 2020-11-16T21:56:51.950272+0000 mon.b (mon.1) 150 : audit [INF] from='osd.5 v1:172.21.15.16:6805/4180994375' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-11-16T21:56:52.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:52 smithi195 bash[10218]: audit 2020-11-16T21:56:51.952852+0000 mon.a (mon.0) 471 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-11-16T21:56:52.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:52 smithi057 bash[10301]: cluster 2020-11-16T21:56:51.471830+0000 mgr.x (mgr.24115) 92 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:52.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:52 smithi057 bash[10301]: audit 2020-11-16T21:56:51.950272+0000 mon.b (mon.1) 150 : audit [INF] from='osd.5 v1:172.21.15.16:6805/4180994375' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-11-16T21:56:52.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:52 smithi057 bash[10301]: audit 2020-11-16T21:56:51.952852+0000 mon.a (mon.0) 471 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2020-11-16T21:56:53.832 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 21:56:53 smithi016 bash[15120]: debug 2020-11-16T21:56:53.558+0000 7f8fe1619700 -1 osd.5 0 waiting for initial osdmap 2020-11-16T21:56:53.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:53 smithi016 bash[10302]: audit 2020-11-16T21:56:52.540848+0000 mon.a (mon.0) 472 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2020-11-16T21:56:53.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:53 smithi016 bash[10302]: cluster 2020-11-16T21:56:52.540960+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2020-11-16T21:56:53.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:53 smithi016 bash[10302]: audit 2020-11-16T21:56:52.541233+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-11-16T21:56:53.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:53 smithi016 bash[10302]: audit 2020-11-16T21:56:52.541239+0000 mon.b (mon.1) 151 : audit [INF] from='osd.5 v1:172.21.15.16:6805/4180994375' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:56:53.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:53 smithi016 bash[10302]: audit 2020-11-16T21:56:52.543904+0000 mon.a (mon.0) 475 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:56:53.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:53 smithi195 bash[10218]: audit 2020-11-16T21:56:52.540848+0000 mon.a (mon.0) 472 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2020-11-16T21:56:53.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:53 smithi195 bash[10218]: cluster 2020-11-16T21:56:52.540960+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2020-11-16T21:56:53.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:53 smithi195 bash[10218]: audit 2020-11-16T21:56:52.541233+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-11-16T21:56:53.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:53 smithi195 bash[10218]: audit 2020-11-16T21:56:52.541239+0000 mon.b (mon.1) 151 : audit [INF] from='osd.5 v1:172.21.15.16:6805/4180994375' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:56:53.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:53 smithi195 bash[10218]: audit 2020-11-16T21:56:52.543904+0000 mon.a (mon.0) 475 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:56:53.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:53 smithi057 bash[10301]: audit 2020-11-16T21:56:52.540848+0000 mon.a (mon.0) 472 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2020-11-16T21:56:53.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:53 smithi057 bash[10301]: cluster 2020-11-16T21:56:52.540960+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2020-11-16T21:56:53.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:53 smithi057 bash[10301]: audit 2020-11-16T21:56:52.541233+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-11-16T21:56:53.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:53 smithi057 bash[10301]: audit 2020-11-16T21:56:52.541239+0000 mon.b (mon.1) 151 : audit [INF] from='osd.5 v1:172.21.15.16:6805/4180994375' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:56:53.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:53 smithi057 bash[10301]: audit 2020-11-16T21:56:52.543904+0000 mon.a (mon.0) 475 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:56:54.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:54 smithi016 bash[10302]: cluster 2020-11-16T21:56:53.472405+0000 mgr.x (mgr.24115) 93 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:54.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:54 smithi016 bash[10302]: audit 2020-11-16T21:56:53.560259+0000 mon.a (mon.0) 476 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2020-11-16T21:56:54.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:54 smithi016 bash[10302]: cluster 2020-11-16T21:56:53.560404+0000 mon.a (mon.0) 477 : cluster [DBG] osdmap e37: 6 total, 5 up, 5 in 2020-11-16T21:56:54.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:54 smithi016 bash[10302]: audit 2020-11-16T21:56:53.561019+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-11-16T21:56:54.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:54 smithi016 bash[10302]: audit 2020-11-16T21:56:53.566891+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-11-16T21:56:54.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:54 smithi016 bash[10302]: audit 2020-11-16T21:56:53.643453+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:56:54.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:54 smithi016 bash[10302]: audit 2020-11-16T21:56:53.951664+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_daemon_update\": \"2020-11-16T21:56:45.582802\", \"last_device_update\": \"2020-11-16T21:56:53.948363\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:54.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:54 smithi016 bash[10302]: audit 2020-11-16T21:56:53.957777+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_daemon_update\": \"2020-11-16T21:56:45.582802\", \"last_device_update\": \"2020-11-16T21:56:53.948363\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:54.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:54 smithi016 bash[10302]: audit 2020-11-16T21:56:53.959066+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:54.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:54 smithi016 bash[10302]: audit 2020-11-16T21:56:53.964392+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:54.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:54 smithi016 bash[10302]: audit 2020-11-16T21:56:53.967051+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:54.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:54 smithi016 bash[10302]: audit 2020-11-16T21:56:53.971957+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:54.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:54 smithi195 bash[10218]: cluster 2020-11-16T21:56:53.472405+0000 mgr.x (mgr.24115) 93 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:54.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:54 smithi195 bash[10218]: audit 2020-11-16T21:56:53.560259+0000 mon.a (mon.0) 476 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2020-11-16T21:56:54.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:54 smithi195 bash[10218]: cluster 2020-11-16T21:56:53.560404+0000 mon.a (mon.0) 477 : cluster [DBG] osdmap e37: 6 total, 5 up, 5 in 2020-11-16T21:56:54.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:54 smithi195 bash[10218]: audit 2020-11-16T21:56:53.561019+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-11-16T21:56:54.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:54 smithi195 bash[10218]: audit 2020-11-16T21:56:53.566891+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-11-16T21:56:54.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:54 smithi195 bash[10218]: audit 2020-11-16T21:56:53.643453+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:56:54.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:54 smithi195 bash[10218]: audit 2020-11-16T21:56:53.951664+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_daemon_update\": \"2020-11-16T21:56:45.582802\", \"last_device_update\": \"2020-11-16T21:56:53.948363\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:54.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:54 smithi195 bash[10218]: audit 2020-11-16T21:56:53.957777+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_daemon_update\": \"2020-11-16T21:56:45.582802\", \"last_device_update\": \"2020-11-16T21:56:53.948363\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:54.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:54 smithi195 bash[10218]: audit 2020-11-16T21:56:53.959066+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:54.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:54 smithi195 bash[10218]: audit 2020-11-16T21:56:53.964392+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:54.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:54 smithi195 bash[10218]: audit 2020-11-16T21:56:53.967051+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:54.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:54 smithi195 bash[10218]: audit 2020-11-16T21:56:53.971957+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:54.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:54 smithi057 bash[10301]: cluster 2020-11-16T21:56:53.472405+0000 mgr.x (mgr.24115) 93 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:54.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:54 smithi057 bash[10301]: audit 2020-11-16T21:56:53.560259+0000 mon.a (mon.0) 476 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2020-11-16T21:56:54.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:54 smithi057 bash[10301]: cluster 2020-11-16T21:56:53.560404+0000 mon.a (mon.0) 477 : cluster [DBG] osdmap e37: 6 total, 5 up, 5 in 2020-11-16T21:56:54.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:54 smithi057 bash[10301]: audit 2020-11-16T21:56:53.561019+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-11-16T21:56:54.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:54 smithi057 bash[10301]: audit 2020-11-16T21:56:53.566891+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-11-16T21:56:54.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:54 smithi057 bash[10301]: audit 2020-11-16T21:56:53.643453+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:56:54.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:54 smithi057 bash[10301]: audit 2020-11-16T21:56:53.951664+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_daemon_update\": \"2020-11-16T21:56:45.582802\", \"last_device_update\": \"2020-11-16T21:56:53.948363\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:56:54.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:54 smithi057 bash[10301]: audit 2020-11-16T21:56:53.957777+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}}, \"last_daemon_update\": \"2020-11-16T21:56:45.582802\", \"last_device_update\": \"2020-11-16T21:56:53.948363\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:56:54.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:54 smithi057 bash[10301]: audit 2020-11-16T21:56:53.959066+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:54.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:54 smithi057 bash[10301]: audit 2020-11-16T21:56:53.964392+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:54.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:54 smithi057 bash[10301]: audit 2020-11-16T21:56:53.967051+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:56:54.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:54 smithi057 bash[10301]: audit 2020-11-16T21:56:53.971957+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:56:55.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:55 smithi016 bash[10302]: cluster 2020-11-16T21:56:52.959621+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:56:55.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:55 smithi016 bash[10302]: cluster 2020-11-16T21:56:52.959794+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:56:55.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:55 smithi016 bash[10302]: cluster 2020-11-16T21:56:54.569891+0000 mon.a (mon.0) 487 : cluster [INF] osd.5 v1:172.21.15.16:6805/4180994375 boot 2020-11-16T21:56:55.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:55 smithi016 bash[10302]: cluster 2020-11-16T21:56:54.570019+0000 mon.a (mon.0) 488 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2020-11-16T21:56:55.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:55 smithi016 bash[10302]: audit 2020-11-16T21:56:54.570233+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-11-16T21:56:55.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:55 smithi195 bash[10218]: cluster 2020-11-16T21:56:52.959621+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:56:55.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:55 smithi195 bash[10218]: cluster 2020-11-16T21:56:52.959794+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:56:55.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:55 smithi195 bash[10218]: cluster 2020-11-16T21:56:54.569891+0000 mon.a (mon.0) 487 : cluster [INF] osd.5 v1:172.21.15.16:6805/4180994375 boot 2020-11-16T21:56:55.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:55 smithi195 bash[10218]: cluster 2020-11-16T21:56:54.570019+0000 mon.a (mon.0) 488 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2020-11-16T21:56:55.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:55 smithi195 bash[10218]: audit 2020-11-16T21:56:54.570233+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-11-16T21:56:55.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:55 smithi057 bash[10301]: cluster 2020-11-16T21:56:52.959621+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:56:55.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:55 smithi057 bash[10301]: cluster 2020-11-16T21:56:52.959794+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:56:55.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:55 smithi057 bash[10301]: cluster 2020-11-16T21:56:54.569891+0000 mon.a (mon.0) 487 : cluster [INF] osd.5 v1:172.21.15.16:6805/4180994375 boot 2020-11-16T21:56:55.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:55 smithi057 bash[10301]: cluster 2020-11-16T21:56:54.570019+0000 mon.a (mon.0) 488 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2020-11-16T21:56:55.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:55 smithi057 bash[10301]: audit 2020-11-16T21:56:54.570233+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2020-11-16T21:56:56.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:56 smithi016 bash[10302]: cluster 2020-11-16T21:56:55.473003+0000 mgr.x (mgr.24115) 94 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:56.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:56 smithi016 bash[10302]: cluster 2020-11-16T21:56:55.580698+0000 mon.a (mon.0) 490 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2020-11-16T21:56:56.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:56 smithi016 bash[10302]: audit 2020-11-16T21:56:56.042967+0000 mgr.x (mgr.24115) 95 : audit [DBG] from='client.24286 v1:172.21.15.16:0/3665332866' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:56:56.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:56 smithi016 bash[10302]: cephadm 2020-11-16T21:56:56.045766+0000 mgr.x (mgr.24115) 96 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:56:56.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:56 smithi016 bash[10302]: cephadm 2020-11-16T21:56:56.045838+0000 mgr.x (mgr.24115) 97 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:56:56.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:56 smithi016 bash[10302]: audit 2020-11-16T21:56:56.046291+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:56:56.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:56 smithi016 bash[10302]: cephadm 2020-11-16T21:56:56.046547+0000 mgr.x (mgr.24115) 98 : cephadm [INF] Applying None on host smithi016... 2020-11-16T21:56:56.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:56 smithi016 bash[10302]: audit 2020-11-16T21:56:56.049281+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:56:56.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:56 smithi016 bash[10302]: audit 2020-11-16T21:56:56.051144+0000 mon.a (mon.0) 493 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:56:56.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:56 smithi016 bash[10302]: audit 2020-11-16T21:56:56.053020+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:56.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:56 smithi195 bash[10218]: cluster 2020-11-16T21:56:55.473003+0000 mgr.x (mgr.24115) 94 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:56.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:56 smithi195 bash[10218]: cluster 2020-11-16T21:56:55.580698+0000 mon.a (mon.0) 490 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2020-11-16T21:56:56.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:56 smithi195 bash[10218]: audit 2020-11-16T21:56:56.042967+0000 mgr.x (mgr.24115) 95 : audit [DBG] from='client.24286 v1:172.21.15.16:0/3665332866' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:56:56.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:56 smithi195 bash[10218]: cephadm 2020-11-16T21:56:56.045766+0000 mgr.x (mgr.24115) 96 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:56:56.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:56 smithi195 bash[10218]: cephadm 2020-11-16T21:56:56.045838+0000 mgr.x (mgr.24115) 97 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:56:56.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:56 smithi195 bash[10218]: audit 2020-11-16T21:56:56.046291+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:56:56.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:56 smithi195 bash[10218]: cephadm 2020-11-16T21:56:56.046547+0000 mgr.x (mgr.24115) 98 : cephadm [INF] Applying None on host smithi016... 2020-11-16T21:56:56.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:56 smithi195 bash[10218]: audit 2020-11-16T21:56:56.049281+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:56:56.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:56 smithi195 bash[10218]: audit 2020-11-16T21:56:56.051144+0000 mon.a (mon.0) 493 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:56:56.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:56 smithi195 bash[10218]: audit 2020-11-16T21:56:56.053020+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:56.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:56 smithi057 bash[10301]: cluster 2020-11-16T21:56:55.473003+0000 mgr.x (mgr.24115) 94 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2020-11-16T21:56:56.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:56 smithi057 bash[10301]: cluster 2020-11-16T21:56:55.580698+0000 mon.a (mon.0) 490 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2020-11-16T21:56:56.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:56 smithi057 bash[10301]: audit 2020-11-16T21:56:56.042967+0000 mgr.x (mgr.24115) 95 : audit [DBG] from='client.24286 v1:172.21.15.16:0/3665332866' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:56:56.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:56 smithi057 bash[10301]: cephadm 2020-11-16T21:56:56.045766+0000 mgr.x (mgr.24115) 96 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:56:56.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:56 smithi057 bash[10301]: cephadm 2020-11-16T21:56:56.045838+0000 mgr.x (mgr.24115) 97 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:56:56.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:56 smithi057 bash[10301]: audit 2020-11-16T21:56:56.046291+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:56:56.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:56 smithi057 bash[10301]: cephadm 2020-11-16T21:56:56.046547+0000 mgr.x (mgr.24115) 98 : cephadm [INF] Applying None on host smithi016... 2020-11-16T21:56:56.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:56 smithi057 bash[10301]: audit 2020-11-16T21:56:56.049281+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:56:56.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:56 smithi057 bash[10301]: audit 2020-11-16T21:56:56.051144+0000 mon.a (mon.0) 493 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:56:56.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:56 smithi057 bash[10301]: audit 2020-11-16T21:56:56.053020+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:56:58.821 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:56:58 smithi016 bash[10302]: cluster 2020-11-16T21:56:57.473609+0000 mgr.x (mgr.24115) 99 : cluster [DBG] pgmap v99: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:56:58.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:56:58 smithi195 bash[10218]: cluster 2020-11-16T21:56:57.473609+0000 mgr.x (mgr.24115) 99 : cluster [DBG] pgmap v99: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:56:58.944 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:56:58 smithi057 bash[10301]: cluster 2020-11-16T21:56:57.473609+0000 mgr.x (mgr.24115) 99 : cluster [DBG] pgmap v99: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:00.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:00 smithi057 bash[10301]: cluster 2020-11-16T21:56:59.474051+0000 mgr.x (mgr.24115) 100 : cluster [DBG] pgmap v100: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:00.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:00 smithi057 bash[10301]: audit 2020-11-16T21:56:59.741628+0000 mon.b (mon.1) 152 : audit [INF] from='client.? v1:172.21.15.16:0/2059764496' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6fae614-5672-4ca8-bd91-5625e1525a60"}]: dispatch 2020-11-16T21:57:00.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:00 smithi057 bash[10301]: audit 2020-11-16T21:56:59.744226+0000 mon.a (mon.0) 495 : audit [INF] from='client.24292 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6fae614-5672-4ca8-bd91-5625e1525a60"}]: dispatch 2020-11-16T21:57:00.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:00 smithi057 bash[10301]: audit 2020-11-16T21:56:59.752121+0000 mon.a (mon.0) 496 : audit [INF] from='client.24292 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6fae614-5672-4ca8-bd91-5625e1525a60"}]': finished 2020-11-16T21:57:00.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:00 smithi057 bash[10301]: cluster 2020-11-16T21:56:59.752222+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2020-11-16T21:57:00.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:00 smithi057 bash[10301]: audit 2020-11-16T21:56:59.752457+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-11-16T21:57:00.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:00 smithi057 bash[10301]: audit 2020-11-16T21:57:00.425900+0000 mon.b (mon.1) 153 : audit [DBG] from='client.? v1:172.21.15.16:0/3067200639' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:57:00.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:00 smithi016 bash[10302]: cluster 2020-11-16T21:56:59.474051+0000 mgr.x (mgr.24115) 100 : cluster [DBG] pgmap v100: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:00.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:00 smithi016 bash[10302]: audit 2020-11-16T21:56:59.741628+0000 mon.b (mon.1) 152 : audit [INF] from='client.? v1:172.21.15.16:0/2059764496' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6fae614-5672-4ca8-bd91-5625e1525a60"}]: dispatch 2020-11-16T21:57:00.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:00 smithi016 bash[10302]: audit 2020-11-16T21:56:59.744226+0000 mon.a (mon.0) 495 : audit [INF] from='client.24292 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6fae614-5672-4ca8-bd91-5625e1525a60"}]: dispatch 2020-11-16T21:57:00.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:00 smithi016 bash[10302]: audit 2020-11-16T21:56:59.752121+0000 mon.a (mon.0) 496 : audit [INF] from='client.24292 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6fae614-5672-4ca8-bd91-5625e1525a60"}]': finished 2020-11-16T21:57:00.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:00 smithi016 bash[10302]: cluster 2020-11-16T21:56:59.752222+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2020-11-16T21:57:00.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:00 smithi016 bash[10302]: audit 2020-11-16T21:56:59.752457+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-11-16T21:57:00.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:00 smithi016 bash[10302]: audit 2020-11-16T21:57:00.425900+0000 mon.b (mon.1) 153 : audit [DBG] from='client.? v1:172.21.15.16:0/3067200639' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:57:00.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:00 smithi195 bash[10218]: cluster 2020-11-16T21:56:59.474051+0000 mgr.x (mgr.24115) 100 : cluster [DBG] pgmap v100: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:00.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:00 smithi195 bash[10218]: audit 2020-11-16T21:56:59.741628+0000 mon.b (mon.1) 152 : audit [INF] from='client.? v1:172.21.15.16:0/2059764496' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6fae614-5672-4ca8-bd91-5625e1525a60"}]: dispatch 2020-11-16T21:57:00.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:00 smithi195 bash[10218]: audit 2020-11-16T21:56:59.744226+0000 mon.a (mon.0) 495 : audit [INF] from='client.24292 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6fae614-5672-4ca8-bd91-5625e1525a60"}]: dispatch 2020-11-16T21:57:00.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:00 smithi195 bash[10218]: audit 2020-11-16T21:56:59.752121+0000 mon.a (mon.0) 496 : audit [INF] from='client.24292 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6fae614-5672-4ca8-bd91-5625e1525a60"}]': finished 2020-11-16T21:57:00.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:00 smithi195 bash[10218]: cluster 2020-11-16T21:56:59.752222+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2020-11-16T21:57:00.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:00 smithi195 bash[10218]: audit 2020-11-16T21:56:59.752457+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-11-16T21:57:00.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:00 smithi195 bash[10218]: audit 2020-11-16T21:57:00.425900+0000 mon.b (mon.1) 153 : audit [DBG] from='client.? v1:172.21.15.16:0/3067200639' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:57:02.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:02 smithi016 bash[10302]: cluster 2020-11-16T21:57:01.474604+0000 mgr.x (mgr.24115) 101 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:02.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:02 smithi195 bash[10218]: cluster 2020-11-16T21:57:01.474604+0000 mgr.x (mgr.24115) 101 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:02.944 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:02 smithi057 bash[10301]: cluster 2020-11-16T21:57:01.474604+0000 mgr.x (mgr.24115) 101 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:03.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:03 smithi016 bash[10302]: audit 2020-11-16T21:57:03.488713+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:03.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:03 smithi195 bash[10218]: audit 2020-11-16T21:57:03.488713+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:03.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:03 smithi057 bash[10301]: audit 2020-11-16T21:57:03.488713+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:04.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:04 smithi016 bash[10302]: cluster 2020-11-16T21:57:03.475200+0000 mgr.x (mgr.24115) 102 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:04.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:04 smithi195 bash[10218]: cluster 2020-11-16T21:57:03.475200+0000 mgr.x (mgr.24115) 102 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:04.944 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:04 smithi057 bash[10301]: cluster 2020-11-16T21:57:03.475200+0000 mgr.x (mgr.24115) 102 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:06.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:06 smithi016 bash[10302]: cluster 2020-11-16T21:57:05.475590+0000 mgr.x (mgr.24115) 103 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:06.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:06 smithi195 bash[10218]: cluster 2020-11-16T21:57:05.475590+0000 mgr.x (mgr.24115) 103 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:06.944 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:06 smithi057 bash[10301]: cluster 2020-11-16T21:57:05.475590+0000 mgr.x (mgr.24115) 103 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:07.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:07 smithi016 bash[10302]: audit 2020-11-16T21:57:07.505710+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2020-11-16T21:57:07.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:07 smithi016 bash[10302]: audit 2020-11-16T21:57:07.507441+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:57:07.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:07 smithi016 bash[10302]: audit 2020-11-16T21:57:07.509311+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2020-11-16T21:57:07.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:07 smithi195 bash[10218]: audit 2020-11-16T21:57:07.505710+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2020-11-16T21:57:07.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:07 smithi195 bash[10218]: audit 2020-11-16T21:57:07.507441+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:57:07.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:07 smithi195 bash[10218]: audit 2020-11-16T21:57:07.509311+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2020-11-16T21:57:07.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:07 smithi057 bash[10301]: audit 2020-11-16T21:57:07.505710+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2020-11-16T21:57:07.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:07 smithi057 bash[10301]: audit 2020-11-16T21:57:07.507441+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:57:07.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:07 smithi057 bash[10301]: audit 2020-11-16T21:57:07.509311+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2020-11-16T21:57:08.805 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:08 smithi016 bash[10302]: cluster 2020-11-16T21:57:07.475971+0000 mgr.x (mgr.24115) 104 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:08.805 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:08 smithi016 bash[10302]: cephadm 2020-11-16T21:57:07.506803+0000 mgr.x (mgr.24115) 105 : cephadm [INF] Deploying daemon osd.6 on smithi016 2020-11-16T21:57:08.842 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:08 smithi195 bash[10218]: cluster 2020-11-16T21:57:07.475971+0000 mgr.x (mgr.24115) 104 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:08.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:08 smithi195 bash[10218]: cephadm 2020-11-16T21:57:07.506803+0000 mgr.x (mgr.24115) 105 : cephadm [INF] Deploying daemon osd.6 on smithi016 2020-11-16T21:57:08.944 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:08 smithi057 bash[10301]: cluster 2020-11-16T21:57:07.475971+0000 mgr.x (mgr.24115) 104 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:08.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:08 smithi057 bash[10301]: cephadm 2020-11-16T21:57:07.506803+0000 mgr.x (mgr.24115) 105 : cephadm [INF] Deploying daemon osd.6 on smithi016 2020-11-16T21:57:09.905 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 6 on host 'smithi016' 2020-11-16T21:57:10.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:10 smithi016 bash[10302]: cluster 2020-11-16T21:57:09.476347+0000 mgr.x (mgr.24115) 106 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:10.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:10 smithi016 bash[10302]: audit 2020-11-16T21:57:09.912670+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_device_update\": \"2020-11-16T21:56:53.948363\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:10.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:10 smithi016 bash[10302]: audit 2020-11-16T21:57:09.913665+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:57:10.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:10 smithi016 bash[10302]: audit 2020-11-16T21:57:09.918313+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_device_update\": \"2020-11-16T21:56:53.948363\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:10.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:10 smithi195 bash[10218]: cluster 2020-11-16T21:57:09.476347+0000 mgr.x (mgr.24115) 106 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:10.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:10 smithi195 bash[10218]: audit 2020-11-16T21:57:09.912670+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_device_update\": \"2020-11-16T21:56:53.948363\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:10.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:10 smithi195 bash[10218]: audit 2020-11-16T21:57:09.913665+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:57:10.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:10 smithi195 bash[10218]: audit 2020-11-16T21:57:09.918313+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_device_update\": \"2020-11-16T21:56:53.948363\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:10.944 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:10 smithi057 bash[10301]: cluster 2020-11-16T21:57:09.476347+0000 mgr.x (mgr.24115) 106 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:10.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:10 smithi057 bash[10301]: audit 2020-11-16T21:57:09.912670+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_device_update\": \"2020-11-16T21:56:53.948363\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:10.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:10 smithi057 bash[10301]: audit 2020-11-16T21:57:09.913665+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:57:10.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:10 smithi057 bash[10301]: audit 2020-11-16T21:57:09.918313+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.581920\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:56:45.582085\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582185\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:56:45.582492\", \"created\": \"2020-11-16T21:56:44.762523\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_device_update\": \"2020-11-16T21:56:53.948363\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:11.073 INFO:teuthology.orchestra.run.smithi016:osd.6> sudo journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.6.service 2020-11-16T21:57:11.074 INFO:tasks.cephadm:Deploying osd.7 on smithi016 with /dev/vg_nvme/lv_1... 2020-11-16T21:57:11.075 INFO:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2020-11-16T21:57:11.146 INFO:journalctl@ceph.osd.6.smithi016.stdout:-- Logs begin at Sun 2020-11-15 12:21:41 UTC. -- 2020-11-16T21:57:11.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:11 smithi016 bash[10302]: audit 2020-11-16T21:57:10.770272+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_daemon_update\": \"2020-11-16T21:57:10.767290\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:11.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:11 smithi016 bash[10302]: audit 2020-11-16T21:57:10.775676+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_daemon_update\": \"2020-11-16T21:57:10.767290\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:11.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:11 smithi016 bash[10302]: audit 2020-11-16T21:57:10.777138+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:11.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:11 smithi195 bash[10218]: audit 2020-11-16T21:57:10.770272+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_daemon_update\": \"2020-11-16T21:57:10.767290\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:11.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:11 smithi195 bash[10218]: audit 2020-11-16T21:57:10.775676+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_daemon_update\": \"2020-11-16T21:57:10.767290\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:11.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:11 smithi195 bash[10218]: audit 2020-11-16T21:57:10.777138+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:11.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:11 smithi057 bash[10301]: audit 2020-11-16T21:57:10.770272+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_daemon_update\": \"2020-11-16T21:57:10.767290\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:11.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:11 smithi057 bash[10301]: audit 2020-11-16T21:57:10.775676+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_daemon_update\": \"2020-11-16T21:57:10.767290\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:11.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:11 smithi057 bash[10301]: audit 2020-11-16T21:57:10.777138+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:12.581 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:12 smithi016 bash[10302]: cluster 2020-11-16T21:57:11.476839+0000 mgr.x (mgr.24115) 107 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:12.581 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 21:57:12 smithi016 bash[17468]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-11-16T21:57:12.582 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 21:57:12 smithi016 bash[17468]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2020-11-16T21:57:12.582 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 21:57:12 smithi016 bash[17468]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2020-11-16T21:57:12.582 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 21:57:12 smithi016 bash[17468]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2020-11-16T21:57:12.582 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 21:57:12 smithi016 bash[17468]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2020-11-16T21:57:12.582 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 21:57:12 smithi016 bash[17468]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-11-16T21:57:12.582 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 21:57:12 smithi016 bash[17468]: --> ceph-volume lvm activate successful for osd ID: 6 2020-11-16T21:57:12.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:12 smithi195 bash[10218]: cluster 2020-11-16T21:57:11.476839+0000 mgr.x (mgr.24115) 107 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:12.944 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:12 smithi057 bash[10301]: cluster 2020-11-16T21:57:11.476839+0000 mgr.x (mgr.24115) 107 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:13.831 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 21:57:13 smithi016 bash[17468]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.6 2020-11-16T21:57:14.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:14 smithi016 bash[10302]: cluster 2020-11-16T21:57:13.477313+0000 mgr.x (mgr.24115) 108 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:14.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:14 smithi195 bash[10218]: cluster 2020-11-16T21:57:13.477313+0000 mgr.x (mgr.24115) 108 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:14.944 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:14 smithi057 bash[10301]: cluster 2020-11-16T21:57:13.477313+0000 mgr.x (mgr.24115) 108 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:15.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:15 smithi195 bash[10218]: audit 2020-11-16T21:57:14.683296+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:57:15.844 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:15 smithi195 bash[10218]: audit 2020-11-16T21:57:14.688693+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-11-16T21:57:15.944 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:15 smithi057 bash[10301]: audit 2020-11-16T21:57:14.683296+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:57:15.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:15 smithi057 bash[10301]: audit 2020-11-16T21:57:14.688693+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-11-16T21:57:15.960 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:15 smithi016 bash[10302]: audit 2020-11-16T21:57:14.683296+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:57:15.960 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:15 smithi016 bash[10302]: audit 2020-11-16T21:57:14.688693+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-11-16T21:57:16.563 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 21:57:16 smithi016 bash[17468]: debug 2020-11-16T21:57:16.274+0000 7fd68d9ccf40 -1 Falling back to public interface 2020-11-16T21:57:16.944 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:16 smithi057 bash[10301]: cluster 2020-11-16T21:57:15.477665+0000 mgr.x (mgr.24115) 109 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:17.081 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:16 smithi016 bash[10302]: cluster 2020-11-16T21:57:15.477665+0000 mgr.x (mgr.24115) 109 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:17.155 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 21:57:16 smithi016 bash[17468]: debug 2020-11-16T21:57:16.930+0000 7fd68d9ccf40 -1 osd.6 0 log_to_monitors {default=true} 2020-11-16T21:57:17.156 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:16 smithi195 bash[10218]: cluster 2020-11-16T21:57:15.477665+0000 mgr.x (mgr.24115) 109 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:17.377 INFO:teuthology.orchestra.run.smithi016.stderr:--> Zapping: /dev/vg_nvme/lv_1 2020-11-16T21:57:17.378 INFO:teuthology.orchestra.run.smithi016.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2020-11-16T21:57:17.378 INFO:teuthology.orchestra.run.smithi016.stderr: stderr: 10+0 records in 2020-11-16T21:57:17.378 INFO:teuthology.orchestra.run.smithi016.stderr:10+0 records out 2020-11-16T21:57:17.378 INFO:teuthology.orchestra.run.smithi016.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0161444 s, 649 MB/s 2020-11-16T21:57:17.378 INFO:teuthology.orchestra.run.smithi016.stderr:--> Zapping successful for: 2020-11-16T21:57:17.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:17 smithi016 bash[10302]: audit 2020-11-16T21:57:16.938831+0000 mon.b (mon.1) 154 : audit [INF] from='osd.6 v1:172.21.15.16:6809/1747555876' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-11-16T21:57:17.831 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:17 smithi016 bash[10302]: audit 2020-11-16T21:57:16.939665+0000 mon.a (mon.0) 511 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-11-16T21:57:17.944 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:17 smithi057 bash[10301]: audit 2020-11-16T21:57:16.938831+0000 mon.b (mon.1) 154 : audit [INF] from='osd.6 v1:172.21.15.16:6809/1747555876' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-11-16T21:57:17.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:17 smithi057 bash[10301]: audit 2020-11-16T21:57:16.939665+0000 mon.a (mon.0) 511 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-11-16T21:57:18.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:17 smithi195 bash[10218]: audit 2020-11-16T21:57:16.938831+0000 mon.b (mon.1) 154 : audit [INF] from='osd.6 v1:172.21.15.16:6809/1747555876' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-11-16T21:57:18.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:17 smithi195 bash[10218]: audit 2020-11-16T21:57:16.939665+0000 mon.a (mon.0) 511 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2020-11-16T21:57:18.134 INFO:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch daemon add osd smithi016:vg_nvme/lv_1 2020-11-16T21:57:19.081 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 21:57:18 smithi016 bash[17468]: debug 2020-11-16T21:57:18.714+0000 7fd683f48700 -1 osd.6 0 waiting for initial osdmap 2020-11-16T21:57:19.081 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:18 smithi016 bash[10302]: audit 2020-11-16T21:57:17.707674+0000 mon.a (mon.0) 512 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2020-11-16T21:57:19.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:18 smithi016 bash[10302]: cluster 2020-11-16T21:57:17.707752+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2020-11-16T21:57:19.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:18 smithi016 bash[10302]: audit 2020-11-16T21:57:17.708555+0000 mon.b (mon.1) 155 : audit [INF] from='osd.6 v1:172.21.15.16:6809/1747555876' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:57:19.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:18 smithi016 bash[10302]: audit 2020-11-16T21:57:17.709284+0000 mon.a (mon.0) 514 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:57:19.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:18 smithi016 bash[10302]: audit 2020-11-16T21:57:17.711949+0000 mon.b (mon.1) 156 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-11-16T21:57:19.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:18 smithi195 bash[10218]: audit 2020-11-16T21:57:17.707674+0000 mon.a (mon.0) 512 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2020-11-16T21:57:19.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:18 smithi195 bash[10218]: cluster 2020-11-16T21:57:17.707752+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2020-11-16T21:57:19.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:18 smithi195 bash[10218]: audit 2020-11-16T21:57:17.708555+0000 mon.b (mon.1) 155 : audit [INF] from='osd.6 v1:172.21.15.16:6809/1747555876' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:57:19.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:18 smithi195 bash[10218]: audit 2020-11-16T21:57:17.709284+0000 mon.a (mon.0) 514 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:57:19.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:18 smithi195 bash[10218]: audit 2020-11-16T21:57:17.711949+0000 mon.b (mon.1) 156 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-11-16T21:57:19.194 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:18 smithi057 bash[10301]: audit 2020-11-16T21:57:17.707674+0000 mon.a (mon.0) 512 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2020-11-16T21:57:19.194 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:18 smithi057 bash[10301]: cluster 2020-11-16T21:57:17.707752+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2020-11-16T21:57:19.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:18 smithi057 bash[10301]: audit 2020-11-16T21:57:17.708555+0000 mon.b (mon.1) 155 : audit [INF] from='osd.6 v1:172.21.15.16:6809/1747555876' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:57:19.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:18 smithi057 bash[10301]: audit 2020-11-16T21:57:17.709284+0000 mon.a (mon.0) 514 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:57:19.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:18 smithi057 bash[10301]: audit 2020-11-16T21:57:17.711949+0000 mon.b (mon.1) 156 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-11-16T21:57:20.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:19 smithi016 bash[10302]: audit 2020-11-16T21:57:18.709873+0000 mon.a (mon.0) 515 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2020-11-16T21:57:20.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:19 smithi016 bash[10302]: cluster 2020-11-16T21:57:18.709961+0000 mon.a (mon.0) 516 : cluster [DBG] osdmap e42: 7 total, 6 up, 6 in 2020-11-16T21:57:20.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:19 smithi016 bash[10302]: audit 2020-11-16T21:57:18.709977+0000 mon.b (mon.1) 157 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-11-16T21:57:20.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:19 smithi016 bash[10302]: audit 2020-11-16T21:57:18.719383+0000 mon.b (mon.1) 158 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-11-16T21:57:20.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:19 smithi016 bash[10302]: audit 2020-11-16T21:57:18.870620+0000 mon.b (mon.1) 159 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:57:20.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:19 smithi016 bash[10302]: audit 2020-11-16T21:57:19.176583+0000 mon.b (mon.1) 160 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_daemon_update\": \"2020-11-16T21:57:10.767290\", \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:20.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:19 smithi016 bash[10302]: audit 2020-11-16T21:57:19.177318+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_daemon_update\": \"2020-11-16T21:57:10.767290\", \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:20.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:19 smithi016 bash[10302]: audit 2020-11-16T21:57:19.183336+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_daemon_update\": \"2020-11-16T21:57:10.767290\", \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:20.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:19 smithi016 bash[10302]: audit 2020-11-16T21:57:19.185047+0000 mon.b (mon.1) 161 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:20.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:19 smithi016 bash[10302]: audit 2020-11-16T21:57:19.185334+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:20.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:19 smithi016 bash[10302]: audit 2020-11-16T21:57:19.190570+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:57:20.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:19 smithi016 bash[10302]: audit 2020-11-16T21:57:19.195296+0000 mon.b (mon.1) 162 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:20.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:19 smithi016 bash[10302]: audit 2020-11-16T21:57:19.195775+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:20.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:19 smithi016 bash[10302]: audit 2020-11-16T21:57:19.200571+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:57:20.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:19 smithi195 bash[10218]: audit 2020-11-16T21:57:18.709873+0000 mon.a (mon.0) 515 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2020-11-16T21:57:20.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:19 smithi195 bash[10218]: cluster 2020-11-16T21:57:18.709961+0000 mon.a (mon.0) 516 : cluster [DBG] osdmap e42: 7 total, 6 up, 6 in 2020-11-16T21:57:20.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:19 smithi195 bash[10218]: audit 2020-11-16T21:57:18.709977+0000 mon.b (mon.1) 157 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-11-16T21:57:20.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:19 smithi195 bash[10218]: audit 2020-11-16T21:57:18.719383+0000 mon.b (mon.1) 158 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-11-16T21:57:20.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:19 smithi195 bash[10218]: audit 2020-11-16T21:57:18.870620+0000 mon.b (mon.1) 159 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:57:20.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:19 smithi195 bash[10218]: audit 2020-11-16T21:57:19.176583+0000 mon.b (mon.1) 160 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_daemon_update\": \"2020-11-16T21:57:10.767290\", \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:20.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:19 smithi195 bash[10218]: audit 2020-11-16T21:57:19.177318+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_daemon_update\": \"2020-11-16T21:57:10.767290\", \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:20.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:19 smithi195 bash[10218]: audit 2020-11-16T21:57:19.183336+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_daemon_update\": \"2020-11-16T21:57:10.767290\", \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:20.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:19 smithi195 bash[10218]: audit 2020-11-16T21:57:19.185047+0000 mon.b (mon.1) 161 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:20.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:19 smithi195 bash[10218]: audit 2020-11-16T21:57:19.185334+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:20.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:19 smithi195 bash[10218]: audit 2020-11-16T21:57:19.190570+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:57:20.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:19 smithi195 bash[10218]: audit 2020-11-16T21:57:19.195296+0000 mon.b (mon.1) 162 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:20.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:19 smithi195 bash[10218]: audit 2020-11-16T21:57:19.195775+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:20.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:19 smithi195 bash[10218]: audit 2020-11-16T21:57:19.200571+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:57:20.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:19 smithi057 bash[10301]: audit 2020-11-16T21:57:18.709873+0000 mon.a (mon.0) 515 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2020-11-16T21:57:20.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:19 smithi057 bash[10301]: cluster 2020-11-16T21:57:18.709961+0000 mon.a (mon.0) 516 : cluster [DBG] osdmap e42: 7 total, 6 up, 6 in 2020-11-16T21:57:20.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:19 smithi057 bash[10301]: audit 2020-11-16T21:57:18.709977+0000 mon.b (mon.1) 157 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-11-16T21:57:20.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:19 smithi057 bash[10301]: audit 2020-11-16T21:57:18.719383+0000 mon.b (mon.1) 158 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-11-16T21:57:20.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:19 smithi057 bash[10301]: audit 2020-11-16T21:57:18.870620+0000 mon.b (mon.1) 159 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:57:20.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:19 smithi057 bash[10301]: audit 2020-11-16T21:57:19.176583+0000 mon.b (mon.1) 160 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_daemon_update\": \"2020-11-16T21:57:10.767290\", \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:20.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:19 smithi057 bash[10301]: audit 2020-11-16T21:57:19.177318+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_daemon_update\": \"2020-11-16T21:57:10.767290\", \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:20.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:19 smithi057 bash[10301]: audit 2020-11-16T21:57:19.183336+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}}, \"last_daemon_update\": \"2020-11-16T21:57:10.767290\", \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:20.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:19 smithi057 bash[10301]: audit 2020-11-16T21:57:19.185047+0000 mon.b (mon.1) 161 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:20.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:19 smithi057 bash[10301]: audit 2020-11-16T21:57:19.185334+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:20.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:19 smithi057 bash[10301]: audit 2020-11-16T21:57:19.190570+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:57:20.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:19 smithi057 bash[10301]: audit 2020-11-16T21:57:19.195296+0000 mon.b (mon.1) 162 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:20.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:19 smithi057 bash[10301]: audit 2020-11-16T21:57:19.195775+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:20.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:19 smithi057 bash[10301]: audit 2020-11-16T21:57:19.200571+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:57:21.081 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:20 smithi016 bash[10302]: cluster 2020-11-16T21:57:17.918603+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:57:21.081 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:20 smithi016 bash[10302]: cluster 2020-11-16T21:57:17.918716+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:57:21.081 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:20 smithi016 bash[10302]: cluster 2020-11-16T21:57:19.478806+0000 mgr.x (mgr.24115) 111 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:21.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:20 smithi016 bash[10302]: cluster 2020-11-16T21:57:19.720333+0000 mon.a (mon.0) 523 : cluster [INF] osd.6 v1:172.21.15.16:6809/1747555876 boot 2020-11-16T21:57:21.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:20 smithi016 bash[10302]: cluster 2020-11-16T21:57:19.720426+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2020-11-16T21:57:21.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:20 smithi016 bash[10302]: audit 2020-11-16T21:57:19.721717+0000 mon.b (mon.1) 163 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-11-16T21:57:21.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:20 smithi195 bash[10218]: cluster 2020-11-16T21:57:17.918603+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:57:21.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:20 smithi195 bash[10218]: cluster 2020-11-16T21:57:17.918716+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:57:21.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:20 smithi195 bash[10218]: cluster 2020-11-16T21:57:19.478806+0000 mgr.x (mgr.24115) 111 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:21.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:20 smithi195 bash[10218]: cluster 2020-11-16T21:57:19.720333+0000 mon.a (mon.0) 523 : cluster [INF] osd.6 v1:172.21.15.16:6809/1747555876 boot 2020-11-16T21:57:21.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:20 smithi195 bash[10218]: cluster 2020-11-16T21:57:19.720426+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2020-11-16T21:57:21.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:20 smithi195 bash[10218]: audit 2020-11-16T21:57:19.721717+0000 mon.b (mon.1) 163 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-11-16T21:57:21.194 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:20 smithi057 bash[10301]: cluster 2020-11-16T21:57:17.918603+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:57:21.194 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:20 smithi057 bash[10301]: cluster 2020-11-16T21:57:17.918716+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:57:21.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:20 smithi057 bash[10301]: cluster 2020-11-16T21:57:19.478806+0000 mgr.x (mgr.24115) 111 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2020-11-16T21:57:21.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:20 smithi057 bash[10301]: cluster 2020-11-16T21:57:19.720333+0000 mon.a (mon.0) 523 : cluster [INF] osd.6 v1:172.21.15.16:6809/1747555876 boot 2020-11-16T21:57:21.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:20 smithi057 bash[10301]: cluster 2020-11-16T21:57:19.720426+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2020-11-16T21:57:21.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:20 smithi057 bash[10301]: audit 2020-11-16T21:57:19.721717+0000 mon.b (mon.1) 163 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2020-11-16T21:57:22.081 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:21 smithi016 bash[10302]: cluster 2020-11-16T21:57:20.738760+0000 mon.a (mon.0) 525 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2020-11-16T21:57:22.094 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:21 smithi195 bash[10218]: cluster 2020-11-16T21:57:20.738760+0000 mon.a (mon.0) 525 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2020-11-16T21:57:22.194 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:21 smithi057 bash[10301]: cluster 2020-11-16T21:57:20.738760+0000 mon.a (mon.0) 525 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2020-11-16T21:57:23.018 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:22 smithi016 bash[10302]: cluster 2020-11-16T21:57:21.479306+0000 mgr.x (mgr.24115) 112 : cluster [DBG] pgmap v116: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:23.018 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:22 smithi016 bash[10302]: audit 2020-11-16T21:57:21.867939+0000 mgr.x (mgr.24115) 113 : audit [DBG] from='client.24313 v1:172.21.15.16:0/4185166725' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:57:23.019 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:22 smithi016 bash[10302]: audit 2020-11-16T21:57:21.869243+0000 mon.b (mon.1) 164 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:57:23.019 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:22 smithi016 bash[10302]: cephadm 2020-11-16T21:57:21.870278+0000 mgr.x (mgr.24115) 114 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:57:23.019 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:22 smithi016 bash[10302]: cephadm 2020-11-16T21:57:21.870347+0000 mgr.x (mgr.24115) 115 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:57:23.019 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:22 smithi016 bash[10302]: cephadm 2020-11-16T21:57:21.871093+0000 mgr.x (mgr.24115) 116 : cephadm [INF] Applying None on host smithi016... 2020-11-16T21:57:23.019 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:22 smithi016 bash[10302]: audit 2020-11-16T21:57:21.871902+0000 mon.b (mon.1) 165 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:57:23.019 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:22 smithi016 bash[10302]: audit 2020-11-16T21:57:21.873283+0000 mon.b (mon.1) 166 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:57:23.020 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:22 smithi016 bash[10302]: audit 2020-11-16T21:57:21.874830+0000 mon.b (mon.1) 167 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:23.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:22 smithi195 bash[10218]: cluster 2020-11-16T21:57:21.479306+0000 mgr.x (mgr.24115) 112 : cluster [DBG] pgmap v116: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:23.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:22 smithi195 bash[10218]: audit 2020-11-16T21:57:21.867939+0000 mgr.x (mgr.24115) 113 : audit [DBG] from='client.24313 v1:172.21.15.16:0/4185166725' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:57:23.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:22 smithi195 bash[10218]: audit 2020-11-16T21:57:21.869243+0000 mon.b (mon.1) 164 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:57:23.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:22 smithi195 bash[10218]: cephadm 2020-11-16T21:57:21.870278+0000 mgr.x (mgr.24115) 114 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:57:23.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:22 smithi195 bash[10218]: cephadm 2020-11-16T21:57:21.870347+0000 mgr.x (mgr.24115) 115 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:57:23.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:22 smithi195 bash[10218]: cephadm 2020-11-16T21:57:21.871093+0000 mgr.x (mgr.24115) 116 : cephadm [INF] Applying None on host smithi016... 2020-11-16T21:57:23.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:22 smithi195 bash[10218]: audit 2020-11-16T21:57:21.871902+0000 mon.b (mon.1) 165 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:57:23.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:22 smithi195 bash[10218]: audit 2020-11-16T21:57:21.873283+0000 mon.b (mon.1) 166 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:57:23.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:22 smithi195 bash[10218]: audit 2020-11-16T21:57:21.874830+0000 mon.b (mon.1) 167 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:23.194 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:22 smithi057 bash[10301]: cluster 2020-11-16T21:57:21.479306+0000 mgr.x (mgr.24115) 112 : cluster [DBG] pgmap v116: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:23.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:22 smithi057 bash[10301]: audit 2020-11-16T21:57:21.867939+0000 mgr.x (mgr.24115) 113 : audit [DBG] from='client.24313 v1:172.21.15.16:0/4185166725' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi016:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:57:23.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:22 smithi057 bash[10301]: audit 2020-11-16T21:57:21.869243+0000 mon.b (mon.1) 164 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:57:23.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:22 smithi057 bash[10301]: cephadm 2020-11-16T21:57:21.870278+0000 mgr.x (mgr.24115) 114 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:57:23.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:22 smithi057 bash[10301]: cephadm 2020-11-16T21:57:21.870347+0000 mgr.x (mgr.24115) 115 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:57:23.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:22 smithi057 bash[10301]: cephadm 2020-11-16T21:57:21.871093+0000 mgr.x (mgr.24115) 116 : cephadm [INF] Applying None on host smithi016... 2020-11-16T21:57:23.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:22 smithi057 bash[10301]: audit 2020-11-16T21:57:21.871902+0000 mon.b (mon.1) 165 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:57:23.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:22 smithi057 bash[10301]: audit 2020-11-16T21:57:21.873283+0000 mon.b (mon.1) 166 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:57:23.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:22 smithi057 bash[10301]: audit 2020-11-16T21:57:21.874830+0000 mon.b (mon.1) 167 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:25.081 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:24 smithi016 bash[10302]: cluster 2020-11-16T21:57:23.479640+0000 mgr.x (mgr.24115) 117 : cluster [DBG] pgmap v117: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:25.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:24 smithi195 bash[10218]: cluster 2020-11-16T21:57:23.479640+0000 mgr.x (mgr.24115) 117 : cluster [DBG] pgmap v117: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:25.194 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:24 smithi057 bash[10301]: cluster 2020-11-16T21:57:23.479640+0000 mgr.x (mgr.24115) 117 : cluster [DBG] pgmap v117: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:26.081 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:25 smithi016 bash[10302]: audit 2020-11-16T21:57:25.699868+0000 mon.a (mon.0) 526 : audit [INF] from='client.24319 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2329bb51-31d3-4e24-89eb-dd4269482cb0"}]: dispatch 2020-11-16T21:57:26.081 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:25 smithi016 bash[10302]: audit 2020-11-16T21:57:25.700252+0000 mon.b (mon.1) 168 : audit [INF] from='client.? v1:172.21.15.16:0/3940850671' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2329bb51-31d3-4e24-89eb-dd4269482cb0"}]: dispatch 2020-11-16T21:57:26.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:25 smithi016 bash[10302]: audit 2020-11-16T21:57:25.707435+0000 mon.a (mon.0) 527 : audit [INF] from='client.24319 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2329bb51-31d3-4e24-89eb-dd4269482cb0"}]': finished 2020-11-16T21:57:26.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:25 smithi016 bash[10302]: cluster 2020-11-16T21:57:25.707532+0000 mon.a (mon.0) 528 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2020-11-16T21:57:26.082 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:25 smithi016 bash[10302]: audit 2020-11-16T21:57:25.709923+0000 mon.b (mon.1) 169 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-11-16T21:57:26.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:25 smithi195 bash[10218]: audit 2020-11-16T21:57:25.699868+0000 mon.a (mon.0) 526 : audit [INF] from='client.24319 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2329bb51-31d3-4e24-89eb-dd4269482cb0"}]: dispatch 2020-11-16T21:57:26.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:25 smithi195 bash[10218]: audit 2020-11-16T21:57:25.700252+0000 mon.b (mon.1) 168 : audit [INF] from='client.? v1:172.21.15.16:0/3940850671' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2329bb51-31d3-4e24-89eb-dd4269482cb0"}]: dispatch 2020-11-16T21:57:26.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:25 smithi195 bash[10218]: audit 2020-11-16T21:57:25.707435+0000 mon.a (mon.0) 527 : audit [INF] from='client.24319 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2329bb51-31d3-4e24-89eb-dd4269482cb0"}]': finished 2020-11-16T21:57:26.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:25 smithi195 bash[10218]: cluster 2020-11-16T21:57:25.707532+0000 mon.a (mon.0) 528 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2020-11-16T21:57:26.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:25 smithi195 bash[10218]: audit 2020-11-16T21:57:25.709923+0000 mon.b (mon.1) 169 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-11-16T21:57:26.194 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:25 smithi057 bash[10301]: audit 2020-11-16T21:57:25.699868+0000 mon.a (mon.0) 526 : audit [INF] from='client.24319 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2329bb51-31d3-4e24-89eb-dd4269482cb0"}]: dispatch 2020-11-16T21:57:26.194 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:25 smithi057 bash[10301]: audit 2020-11-16T21:57:25.700252+0000 mon.b (mon.1) 168 : audit [INF] from='client.? v1:172.21.15.16:0/3940850671' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2329bb51-31d3-4e24-89eb-dd4269482cb0"}]: dispatch 2020-11-16T21:57:26.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:25 smithi057 bash[10301]: audit 2020-11-16T21:57:25.707435+0000 mon.a (mon.0) 527 : audit [INF] from='client.24319 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2329bb51-31d3-4e24-89eb-dd4269482cb0"}]': finished 2020-11-16T21:57:26.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:25 smithi057 bash[10301]: cluster 2020-11-16T21:57:25.707532+0000 mon.a (mon.0) 528 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2020-11-16T21:57:26.195 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:25 smithi057 bash[10301]: audit 2020-11-16T21:57:25.709923+0000 mon.b (mon.1) 169 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-11-16T21:57:27.081 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:26 smithi016 bash[10302]: cluster 2020-11-16T21:57:25.480185+0000 mgr.x (mgr.24115) 118 : cluster [DBG] pgmap v118: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:27.081 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:26 smithi016 bash[10302]: audit 2020-11-16T21:57:26.429113+0000 mon.b (mon.1) 170 : audit [DBG] from='client.24325 v1:172.21.15.16:0/2542517046' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:57:27.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:26 smithi195 bash[10218]: cluster 2020-11-16T21:57:25.480185+0000 mgr.x (mgr.24115) 118 : cluster [DBG] pgmap v118: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:27.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:26 smithi195 bash[10218]: audit 2020-11-16T21:57:26.429113+0000 mon.b (mon.1) 170 : audit [DBG] from='client.24325 v1:172.21.15.16:0/2542517046' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:57:27.194 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:26 smithi057 bash[10301]: cluster 2020-11-16T21:57:25.480185+0000 mgr.x (mgr.24115) 118 : cluster [DBG] pgmap v118: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:27.194 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:26 smithi057 bash[10301]: audit 2020-11-16T21:57:26.429113+0000 mon.b (mon.1) 170 : audit [DBG] from='client.24325 v1:172.21.15.16:0/2542517046' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:57:29.081 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:28 smithi016 bash[10302]: cluster 2020-11-16T21:57:27.480857+0000 mgr.x (mgr.24115) 119 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:29.095 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:28 smithi195 bash[10218]: cluster 2020-11-16T21:57:27.480857+0000 mgr.x (mgr.24115) 119 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:29.194 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:28 smithi057 bash[10301]: cluster 2020-11-16T21:57:27.480857+0000 mgr.x (mgr.24115) 119 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:30.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:30 smithi016 bash[10302]: cluster 2020-11-16T21:57:29.481479+0000 mgr.x (mgr.24115) 120 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:30.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:30 smithi016 bash[10302]: audit 2020-11-16T21:57:29.516257+0000 mon.b (mon.1) 171 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:30.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:30 smithi016 bash[10302]: audit 2020-11-16T21:57:29.701017+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:57:30.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:30 smithi016 bash[10302]: audit 2020-11-16T21:57:29.701562+0000 mon.b (mon.1) 172 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:57:30.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:30 smithi016 bash[10302]: audit 2020-11-16T21:57:29.705137+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:57:30.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:30 smithi016 bash[10302]: audit 2020-11-16T21:57:29.705801+0000 mon.b (mon.1) 173 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:57:30.845 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:30 smithi195 bash[10218]: cluster 2020-11-16T21:57:29.481479+0000 mgr.x (mgr.24115) 120 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:30.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:30 smithi195 bash[10218]: audit 2020-11-16T21:57:29.516257+0000 mon.b (mon.1) 171 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:30.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:30 smithi195 bash[10218]: audit 2020-11-16T21:57:29.701017+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:57:30.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:30 smithi195 bash[10218]: audit 2020-11-16T21:57:29.701562+0000 mon.b (mon.1) 172 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:57:30.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:30 smithi195 bash[10218]: audit 2020-11-16T21:57:29.705137+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:57:30.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:30 smithi195 bash[10218]: audit 2020-11-16T21:57:29.705801+0000 mon.b (mon.1) 173 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:57:30.944 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:30 smithi057 bash[10301]: cluster 2020-11-16T21:57:29.481479+0000 mgr.x (mgr.24115) 120 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:30.944 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:30 smithi057 bash[10301]: audit 2020-11-16T21:57:29.516257+0000 mon.b (mon.1) 171 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:30.944 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:30 smithi057 bash[10301]: audit 2020-11-16T21:57:29.701017+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:57:30.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:30 smithi057 bash[10301]: audit 2020-11-16T21:57:29.701562+0000 mon.b (mon.1) 172 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:57:30.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:30 smithi057 bash[10301]: audit 2020-11-16T21:57:29.705137+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:57:30.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:30 smithi057 bash[10301]: audit 2020-11-16T21:57:29.705801+0000 mon.b (mon.1) 173 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:57:32.832 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:32 smithi016 bash[10302]: cluster 2020-11-16T21:57:31.482102+0000 mgr.x (mgr.24115) 121 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:32.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:32 smithi195 bash[10218]: cluster 2020-11-16T21:57:31.482102+0000 mgr.x (mgr.24115) 121 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:32.944 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:32 smithi057 bash[10301]: cluster 2020-11-16T21:57:31.482102+0000 mgr.x (mgr.24115) 121 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:34.793 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:34 smithi016 bash[10302]: cluster 2020-11-16T21:57:33.482811+0000 mgr.x (mgr.24115) 122 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:34.793 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:34 smithi016 bash[10302]: audit 2020-11-16T21:57:33.615613+0000 mon.b (mon.1) 174 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2020-11-16T21:57:34.793 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:34 smithi016 bash[10302]: audit 2020-11-16T21:57:33.617074+0000 mon.b (mon.1) 175 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:57:34.794 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:34 smithi016 bash[10302]: cephadm 2020-11-16T21:57:33.618221+0000 mgr.x (mgr.24115) 123 : cephadm [INF] Deploying daemon osd.7 on smithi016 2020-11-16T21:57:34.794 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:34 smithi016 bash[10302]: audit 2020-11-16T21:57:33.618785+0000 mon.b (mon.1) 176 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2020-11-16T21:57:34.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:34 smithi195 bash[10218]: cluster 2020-11-16T21:57:33.482811+0000 mgr.x (mgr.24115) 122 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:34.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:34 smithi195 bash[10218]: audit 2020-11-16T21:57:33.615613+0000 mon.b (mon.1) 174 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2020-11-16T21:57:34.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:34 smithi195 bash[10218]: audit 2020-11-16T21:57:33.617074+0000 mon.b (mon.1) 175 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:57:34.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:34 smithi195 bash[10218]: cephadm 2020-11-16T21:57:33.618221+0000 mgr.x (mgr.24115) 123 : cephadm [INF] Deploying daemon osd.7 on smithi016 2020-11-16T21:57:34.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:34 smithi195 bash[10218]: audit 2020-11-16T21:57:33.618785+0000 mon.b (mon.1) 176 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2020-11-16T21:57:34.944 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:34 smithi057 bash[10301]: cluster 2020-11-16T21:57:33.482811+0000 mgr.x (mgr.24115) 122 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:34.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:34 smithi057 bash[10301]: audit 2020-11-16T21:57:33.615613+0000 mon.b (mon.1) 174 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2020-11-16T21:57:34.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:34 smithi057 bash[10301]: audit 2020-11-16T21:57:33.617074+0000 mon.b (mon.1) 175 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:57:34.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:34 smithi057 bash[10301]: cephadm 2020-11-16T21:57:33.618221+0000 mgr.x (mgr.24115) 123 : cephadm [INF] Deploying daemon osd.7 on smithi016 2020-11-16T21:57:34.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:34 smithi057 bash[10301]: audit 2020-11-16T21:57:33.618785+0000 mon.b (mon.1) 176 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2020-11-16T21:57:35.892 INFO:teuthology.orchestra.run.smithi016.stdout:Created osd(s) 7 on host 'smithi016' 2020-11-16T21:57:36.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:36 smithi016 bash[10302]: cluster 2020-11-16T21:57:35.483334+0000 mgr.x (mgr.24115) 124 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:36.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:36 smithi016 bash[10302]: audit 2020-11-16T21:57:35.898473+0000 mon.b (mon.1) 177 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:36.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:36 smithi016 bash[10302]: audit 2020-11-16T21:57:35.898577+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:36.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:36 smithi016 bash[10302]: audit 2020-11-16T21:57:35.899267+0000 mon.b (mon.1) 178 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:57:36.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:36 smithi016 bash[10302]: audit 2020-11-16T21:57:35.904593+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:36.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:36 smithi195 bash[10218]: cluster 2020-11-16T21:57:35.483334+0000 mgr.x (mgr.24115) 124 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:36.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:36 smithi195 bash[10218]: audit 2020-11-16T21:57:35.898473+0000 mon.b (mon.1) 177 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:36.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:36 smithi195 bash[10218]: audit 2020-11-16T21:57:35.898577+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:36.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:36 smithi195 bash[10218]: audit 2020-11-16T21:57:35.899267+0000 mon.b (mon.1) 178 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:57:36.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:36 smithi195 bash[10218]: audit 2020-11-16T21:57:35.904593+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:36.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:36 smithi057 bash[10301]: cluster 2020-11-16T21:57:35.483334+0000 mgr.x (mgr.24115) 124 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:36.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:36 smithi057 bash[10301]: audit 2020-11-16T21:57:35.898473+0000 mon.b (mon.1) 177 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:36.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:36 smithi057 bash[10301]: audit 2020-11-16T21:57:35.898577+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:36.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:36 smithi057 bash[10301]: audit 2020-11-16T21:57:35.899267+0000 mon.b (mon.1) 178 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:57:36.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:36 smithi057 bash[10301]: audit 2020-11-16T21:57:35.904593+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766086\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:57:10.766245\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766342\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766674\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:10.766963\", \"created\": \"2020-11-16T21:57:09.870522\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_device_update\": \"2020-11-16T21:57:19.174919\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:37.047 INFO:teuthology.orchestra.run.smithi016:osd.7> sudo journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.7.service 2020-11-16T21:57:37.049 INFO:tasks.cephadm:Deploying osd.8 on smithi057 with /dev/vg_nvme/lv_4... 2020-11-16T21:57:37.049 INFO:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2020-11-16T21:57:37.077 INFO:journalctl@ceph.osd.7.smithi016.stdout:-- Logs begin at Sun 2020-11-15 12:21:41 UTC. -- 2020-11-16T21:57:37.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:37 smithi016 bash[10302]: audit 2020-11-16T21:57:36.803089+0000 mon.b (mon.1) 179 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:37.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:37 smithi016 bash[10302]: audit 2020-11-16T21:57:36.803452+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:37.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:37 smithi016 bash[10302]: audit 2020-11-16T21:57:36.809145+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:37.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:37 smithi016 bash[10302]: audit 2020-11-16T21:57:36.811499+0000 mon.b (mon.1) 180 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:37.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:37 smithi195 bash[10218]: audit 2020-11-16T21:57:36.803089+0000 mon.b (mon.1) 179 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:37.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:37 smithi195 bash[10218]: audit 2020-11-16T21:57:36.803452+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:37.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:37 smithi195 bash[10218]: audit 2020-11-16T21:57:36.809145+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:37.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:37 smithi195 bash[10218]: audit 2020-11-16T21:57:36.811499+0000 mon.b (mon.1) 180 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:37.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:37 smithi057 bash[10301]: audit 2020-11-16T21:57:36.803089+0000 mon.b (mon.1) 179 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:37.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:37 smithi057 bash[10301]: audit 2020-11-16T21:57:36.803452+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:37.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:37 smithi057 bash[10301]: audit 2020-11-16T21:57:36.809145+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:37.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:37 smithi057 bash[10301]: audit 2020-11-16T21:57:36.811499+0000 mon.b (mon.1) 180 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:38.333 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 21:57:38 smithi016 bash[19825]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-11-16T21:57:38.333 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 21:57:38 smithi016 bash[19825]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2020-11-16T21:57:38.333 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 21:57:38 smithi016 bash[19825]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2020-11-16T21:57:38.334 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 21:57:38 smithi016 bash[19825]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2020-11-16T21:57:38.334 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 21:57:38 smithi016 bash[19825]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2020-11-16T21:57:38.334 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 21:57:38 smithi016 bash[19825]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-11-16T21:57:38.334 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 21:57:38 smithi016 bash[19825]: --> ceph-volume lvm activate successful for osd ID: 7 2020-11-16T21:57:39.083 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 21:57:39 smithi016 bash[19825]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.7 2020-11-16T21:57:39.083 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:38 smithi016 bash[10302]: cluster 2020-11-16T21:57:37.483967+0000 mgr.x (mgr.24115) 125 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:39.096 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:38 smithi195 bash[10218]: cluster 2020-11-16T21:57:37.483967+0000 mgr.x (mgr.24115) 125 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:39.194 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:38 smithi057 bash[10301]: cluster 2020-11-16T21:57:37.483967+0000 mgr.x (mgr.24115) 125 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:40.718 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_4 2020-11-16T21:57:40.719 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2020-11-16T21:57:40.719 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2020-11-16T21:57:40.719 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2020-11-16T21:57:40.719 INFO:teuthology.orchestra.run.smithi057.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0133802 s, 784 MB/s 2020-11-16T21:57:40.719 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2020-11-16T21:57:40.798 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:40 smithi057 bash[10301]: cluster 2020-11-16T21:57:39.484556+0000 mgr.x (mgr.24115) 126 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:40.799 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:40 smithi057 bash[10301]: audit 2020-11-16T21:57:39.690723+0000 mon.b (mon.1) 181 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:57:40.799 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:40 smithi057 bash[10301]: audit 2020-11-16T21:57:39.690839+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:57:40.799 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:40 smithi057 bash[10301]: audit 2020-11-16T21:57:39.696268+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-11-16T21:57:40.833 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 21:57:40 smithi016 bash[19825]: debug 2020-11-16T21:57:40.584+0000 7f0e35c8b700 10 -- 172.21.15.16:0/356998340 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2020-11-16T21:57:40.833 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 21:57:40 smithi016 bash[19825]: debug 2020-11-16T21:57:40.584+0000 7f0e35c8b700 20 -- 172.21.15.16:0/356998340 done calling dispatch on 0x558c6df8c680 2020-11-16T21:57:40.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:40 smithi016 bash[10302]: cluster 2020-11-16T21:57:39.484556+0000 mgr.x (mgr.24115) 126 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:40.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:40 smithi016 bash[10302]: audit 2020-11-16T21:57:39.690723+0000 mon.b (mon.1) 181 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:57:40.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:40 smithi016 bash[10302]: audit 2020-11-16T21:57:39.690839+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:57:40.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:40 smithi016 bash[10302]: audit 2020-11-16T21:57:39.696268+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-11-16T21:57:40.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:40 smithi195 bash[10218]: cluster 2020-11-16T21:57:39.484556+0000 mgr.x (mgr.24115) 126 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:40.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:40 smithi195 bash[10218]: audit 2020-11-16T21:57:39.690723+0000 mon.b (mon.1) 181 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:57:40.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:40 smithi195 bash[10218]: audit 2020-11-16T21:57:39.690839+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:57:40.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:40 smithi195 bash[10218]: audit 2020-11-16T21:57:39.696268+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-11-16T21:57:41.398 INFO:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch daemon add osd smithi057:vg_nvme/lv_4 2020-11-16T21:57:41.583 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 21:57:41 smithi016 bash[19825]: debug 2020-11-16T21:57:41.120+0000 7f0e3d70bf40 -1 Falling back to public interface 2020-11-16T21:57:42.083 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 21:57:41 smithi016 bash[19825]: debug 2020-11-16T21:57:41.747+0000 7f0e3d70bf40 -1 osd.7 0 log_to_monitors {default=true} 2020-11-16T21:57:42.833 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:42 smithi016 bash[10302]: cluster 2020-11-16T21:57:41.485145+0000 mgr.x (mgr.24115) 127 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:42.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:42 smithi016 bash[10302]: audit 2020-11-16T21:57:41.758764+0000 mon.a (mon.0) 537 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-11-16T21:57:42.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:42 smithi016 bash[10302]: audit 2020-11-16T21:57:41.758852+0000 mon.b (mon.1) 182 : audit [INF] from='osd.7 v1:172.21.15.16:6813/4071463289' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-11-16T21:57:42.834 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:42 smithi057 bash[10301]: cluster 2020-11-16T21:57:41.485145+0000 mgr.x (mgr.24115) 127 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:42.835 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:42 smithi057 bash[10301]: audit 2020-11-16T21:57:41.758764+0000 mon.a (mon.0) 537 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-11-16T21:57:42.835 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:42 smithi057 bash[10301]: audit 2020-11-16T21:57:41.758852+0000 mon.b (mon.1) 182 : audit [INF] from='osd.7 v1:172.21.15.16:6813/4071463289' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-11-16T21:57:42.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:42 smithi195 bash[10218]: cluster 2020-11-16T21:57:41.485145+0000 mgr.x (mgr.24115) 127 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:42.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:42 smithi195 bash[10218]: audit 2020-11-16T21:57:41.758764+0000 mon.a (mon.0) 537 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-11-16T21:57:42.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:42 smithi195 bash[10218]: audit 2020-11-16T21:57:41.758852+0000 mon.b (mon.1) 182 : audit [INF] from='osd.7 v1:172.21.15.16:6813/4071463289' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2020-11-16T21:57:43.834 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 21:57:43 smithi016 bash[19825]: debug 2020-11-16T21:57:43.571+0000 7f0e3548a700 -1 osd.7 0 waiting for initial osdmap 2020-11-16T21:57:43.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:43 smithi016 bash[10302]: audit 2020-11-16T21:57:42.553734+0000 mon.a (mon.0) 538 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2020-11-16T21:57:43.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:43 smithi016 bash[10302]: cluster 2020-11-16T21:57:42.553824+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2020-11-16T21:57:43.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:43 smithi016 bash[10302]: audit 2020-11-16T21:57:42.555103+0000 mon.b (mon.1) 183 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-11-16T21:57:43.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:43 smithi016 bash[10302]: audit 2020-11-16T21:57:42.555777+0000 mon.a (mon.0) 540 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:57:43.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:43 smithi016 bash[10302]: audit 2020-11-16T21:57:42.555811+0000 mon.b (mon.1) 184 : audit [INF] from='osd.7 v1:172.21.15.16:6813/4071463289' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:57:43.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:43 smithi016 bash[10302]: audit 2020-11-16T21:57:43.193137+0000 mon.b (mon.1) 185 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:57:43.840 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:43 smithi016 bash[10302]: audit 2020-11-16T21:57:43.492217+0000 mon.b (mon.1) 186 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:43.840 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:43 smithi016 bash[10302]: audit 2020-11-16T21:57:43.492664+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:43.841 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:43 smithi016 bash[10302]: audit 2020-11-16T21:57:43.499051+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:43.841 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:43 smithi016 bash[10302]: audit 2020-11-16T21:57:43.501666+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:43.841 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:43 smithi016 bash[10302]: audit 2020-11-16T21:57:43.501718+0000 mon.b (mon.1) 187 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:43.841 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:43 smithi016 bash[10302]: audit 2020-11-16T21:57:43.515654+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:57:43.841 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:43 smithi016 bash[10302]: audit 2020-11-16T21:57:43.519357+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:43.841 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:43 smithi016 bash[10302]: audit 2020-11-16T21:57:43.519439+0000 mon.b (mon.1) 188 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:43.842 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:43 smithi016 bash[10302]: audit 2020-11-16T21:57:43.524425+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:57:43.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:43 smithi195 bash[10218]: audit 2020-11-16T21:57:42.553734+0000 mon.a (mon.0) 538 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2020-11-16T21:57:43.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:43 smithi195 bash[10218]: cluster 2020-11-16T21:57:42.553824+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2020-11-16T21:57:43.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:43 smithi195 bash[10218]: audit 2020-11-16T21:57:42.555103+0000 mon.b (mon.1) 183 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-11-16T21:57:43.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:43 smithi195 bash[10218]: audit 2020-11-16T21:57:42.555777+0000 mon.a (mon.0) 540 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:57:43.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:43 smithi195 bash[10218]: audit 2020-11-16T21:57:42.555811+0000 mon.b (mon.1) 184 : audit [INF] from='osd.7 v1:172.21.15.16:6813/4071463289' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:57:43.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:43 smithi195 bash[10218]: audit 2020-11-16T21:57:43.193137+0000 mon.b (mon.1) 185 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:57:43.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:43 smithi195 bash[10218]: audit 2020-11-16T21:57:43.492217+0000 mon.b (mon.1) 186 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:43.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:43 smithi195 bash[10218]: audit 2020-11-16T21:57:43.492664+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:43.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:43 smithi195 bash[10218]: audit 2020-11-16T21:57:43.499051+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:43.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:43 smithi195 bash[10218]: audit 2020-11-16T21:57:43.501666+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:43.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:43 smithi195 bash[10218]: audit 2020-11-16T21:57:43.501718+0000 mon.b (mon.1) 187 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:43.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:43 smithi195 bash[10218]: audit 2020-11-16T21:57:43.515654+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:57:43.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:43 smithi195 bash[10218]: audit 2020-11-16T21:57:43.519357+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:43.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:43 smithi195 bash[10218]: audit 2020-11-16T21:57:43.519439+0000 mon.b (mon.1) 188 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:43.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:43 smithi195 bash[10218]: audit 2020-11-16T21:57:43.524425+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:57:43.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:43 smithi057 bash[10301]: audit 2020-11-16T21:57:42.553734+0000 mon.a (mon.0) 538 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2020-11-16T21:57:43.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:43 smithi057 bash[10301]: cluster 2020-11-16T21:57:42.553824+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2020-11-16T21:57:43.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:43 smithi057 bash[10301]: audit 2020-11-16T21:57:42.555103+0000 mon.b (mon.1) 183 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-11-16T21:57:43.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:43 smithi057 bash[10301]: audit 2020-11-16T21:57:42.555777+0000 mon.a (mon.0) 540 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:57:43.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:43 smithi057 bash[10301]: audit 2020-11-16T21:57:42.555811+0000 mon.b (mon.1) 184 : audit [INF] from='osd.7 v1:172.21.15.16:6813/4071463289' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]: dispatch 2020-11-16T21:57:43.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:43 smithi057 bash[10301]: audit 2020-11-16T21:57:43.193137+0000 mon.b (mon.1) 185 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:57:43.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:43 smithi057 bash[10301]: audit 2020-11-16T21:57:43.492217+0000 mon.b (mon.1) 186 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:43.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:43 smithi057 bash[10301]: audit 2020-11-16T21:57:43.492664+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]: dispatch 2020-11-16T21:57:43.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:43 smithi057 bash[10301]: audit 2020-11-16T21:57:43.499051+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T21:52:32.518932\"}"}]': finished 2020-11-16T21:57:43.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:43 smithi057 bash[10301]: audit 2020-11-16T21:57:43.501666+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:43.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:43 smithi057 bash[10301]: audit 2020-11-16T21:57:43.501718+0000 mon.b (mon.1) 187 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:43.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:43 smithi057 bash[10301]: audit 2020-11-16T21:57:43.515654+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:57:43.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:43 smithi057 bash[10301]: audit 2020-11-16T21:57:43.519357+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:43.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:43 smithi057 bash[10301]: audit 2020-11-16T21:57:43.519439+0000 mon.b (mon.1) 188 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:57:43.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:43 smithi057 bash[10301]: audit 2020-11-16T21:57:43.524425+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:57:44.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:44 smithi057 bash[10301]: cluster 2020-11-16T21:57:43.485678+0000 mgr.x (mgr.24115) 128 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:44.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:44 smithi057 bash[10301]: audit 2020-11-16T21:57:43.554773+0000 mon.a (mon.0) 547 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2020-11-16T21:57:44.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:44 smithi057 bash[10301]: cluster 2020-11-16T21:57:43.554832+0000 mon.a (mon.0) 548 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2020-11-16T21:57:44.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:44 smithi057 bash[10301]: audit 2020-11-16T21:57:43.566578+0000 mon.b (mon.1) 189 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-11-16T21:57:44.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:44 smithi016 bash[10302]: cluster 2020-11-16T21:57:43.485678+0000 mgr.x (mgr.24115) 128 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:44.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:44 smithi016 bash[10302]: audit 2020-11-16T21:57:43.554773+0000 mon.a (mon.0) 547 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2020-11-16T21:57:44.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:44 smithi016 bash[10302]: cluster 2020-11-16T21:57:43.554832+0000 mon.a (mon.0) 548 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2020-11-16T21:57:44.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:44 smithi016 bash[10302]: audit 2020-11-16T21:57:43.566578+0000 mon.b (mon.1) 189 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-11-16T21:57:44.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:44 smithi195 bash[10218]: cluster 2020-11-16T21:57:43.485678+0000 mgr.x (mgr.24115) 128 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:44.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:44 smithi195 bash[10218]: audit 2020-11-16T21:57:43.554773+0000 mon.a (mon.0) 547 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi016", "root=default"]}]': finished 2020-11-16T21:57:44.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:44 smithi195 bash[10218]: cluster 2020-11-16T21:57:43.554832+0000 mon.a (mon.0) 548 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2020-11-16T21:57:44.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:44 smithi195 bash[10218]: audit 2020-11-16T21:57:43.566578+0000 mon.b (mon.1) 189 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-11-16T21:57:45.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:45 smithi016 bash[10302]: cluster 2020-11-16T21:57:42.763601+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:57:45.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:45 smithi016 bash[10302]: cluster 2020-11-16T21:57:42.763787+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:57:45.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:45 smithi016 bash[10302]: cluster 2020-11-16T21:57:44.574538+0000 mon.a (mon.0) 549 : cluster [INF] osd.7 v1:172.21.15.16:6813/4071463289 boot 2020-11-16T21:57:45.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:45 smithi016 bash[10302]: cluster 2020-11-16T21:57:44.574639+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2020-11-16T21:57:45.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:45 smithi016 bash[10302]: audit 2020-11-16T21:57:44.577533+0000 mon.b (mon.1) 190 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-11-16T21:57:45.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:45 smithi016 bash[10302]: audit 2020-11-16T21:57:44.903919+0000 mgr.x (mgr.24115) 129 : audit [DBG] from='client.34343 v1:172.21.15.57:0/1715505797' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:57:45.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:45 smithi016 bash[10302]: audit 2020-11-16T21:57:44.905863+0000 mon.b (mon.1) 191 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:57:45.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:45 smithi016 bash[10302]: cephadm 2020-11-16T21:57:44.907094+0000 mgr.x (mgr.24115) 130 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:57:45.835 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:45 smithi016 bash[10302]: cephadm 2020-11-16T21:57:44.907271+0000 mgr.x (mgr.24115) 131 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:57:45.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:45 smithi016 bash[10302]: cephadm 2020-11-16T21:57:44.908836+0000 mgr.x (mgr.24115) 132 : cephadm [INF] Applying None on host smithi057... 2020-11-16T21:57:45.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:45 smithi016 bash[10302]: audit 2020-11-16T21:57:44.909708+0000 mon.b (mon.1) 192 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:57:45.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:45 smithi016 bash[10302]: audit 2020-11-16T21:57:44.911113+0000 mon.b (mon.1) 193 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:57:45.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:45 smithi016 bash[10302]: audit 2020-11-16T21:57:44.912734+0000 mon.b (mon.1) 194 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:45.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:45 smithi195 bash[10218]: cluster 2020-11-16T21:57:42.763601+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:57:45.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:45 smithi195 bash[10218]: cluster 2020-11-16T21:57:42.763787+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:57:45.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:45 smithi195 bash[10218]: cluster 2020-11-16T21:57:44.574538+0000 mon.a (mon.0) 549 : cluster [INF] osd.7 v1:172.21.15.16:6813/4071463289 boot 2020-11-16T21:57:45.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:45 smithi195 bash[10218]: cluster 2020-11-16T21:57:44.574639+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2020-11-16T21:57:45.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:45 smithi195 bash[10218]: audit 2020-11-16T21:57:44.577533+0000 mon.b (mon.1) 190 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-11-16T21:57:45.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:45 smithi195 bash[10218]: audit 2020-11-16T21:57:44.903919+0000 mgr.x (mgr.24115) 129 : audit [DBG] from='client.34343 v1:172.21.15.57:0/1715505797' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:57:45.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:45 smithi195 bash[10218]: audit 2020-11-16T21:57:44.905863+0000 mon.b (mon.1) 191 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:57:45.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:45 smithi195 bash[10218]: cephadm 2020-11-16T21:57:44.907094+0000 mgr.x (mgr.24115) 130 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:57:45.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:45 smithi195 bash[10218]: cephadm 2020-11-16T21:57:44.907271+0000 mgr.x (mgr.24115) 131 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:57:45.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:45 smithi195 bash[10218]: cephadm 2020-11-16T21:57:44.908836+0000 mgr.x (mgr.24115) 132 : cephadm [INF] Applying None on host smithi057... 2020-11-16T21:57:45.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:45 smithi195 bash[10218]: audit 2020-11-16T21:57:44.909708+0000 mon.b (mon.1) 192 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:57:45.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:45 smithi195 bash[10218]: audit 2020-11-16T21:57:44.911113+0000 mon.b (mon.1) 193 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:57:45.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:45 smithi195 bash[10218]: audit 2020-11-16T21:57:44.912734+0000 mon.b (mon.1) 194 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:45.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:45 smithi057 bash[10301]: cluster 2020-11-16T21:57:42.763601+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:57:45.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:45 smithi057 bash[10301]: cluster 2020-11-16T21:57:42.763787+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:57:45.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:45 smithi057 bash[10301]: cluster 2020-11-16T21:57:44.574538+0000 mon.a (mon.0) 549 : cluster [INF] osd.7 v1:172.21.15.16:6813/4071463289 boot 2020-11-16T21:57:45.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:45 smithi057 bash[10301]: cluster 2020-11-16T21:57:44.574639+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2020-11-16T21:57:45.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:45 smithi057 bash[10301]: audit 2020-11-16T21:57:44.577533+0000 mon.b (mon.1) 190 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2020-11-16T21:57:45.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:45 smithi057 bash[10301]: audit 2020-11-16T21:57:44.903919+0000 mgr.x (mgr.24115) 129 : audit [DBG] from='client.34343 v1:172.21.15.57:0/1715505797' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:57:45.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:45 smithi057 bash[10301]: audit 2020-11-16T21:57:44.905863+0000 mon.b (mon.1) 191 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:57:45.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:45 smithi057 bash[10301]: cephadm 2020-11-16T21:57:44.907094+0000 mgr.x (mgr.24115) 130 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:57:45.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:45 smithi057 bash[10301]: cephadm 2020-11-16T21:57:44.907271+0000 mgr.x (mgr.24115) 131 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:57:45.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:45 smithi057 bash[10301]: cephadm 2020-11-16T21:57:44.908836+0000 mgr.x (mgr.24115) 132 : cephadm [INF] Applying None on host smithi057... 2020-11-16T21:57:45.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:45 smithi057 bash[10301]: audit 2020-11-16T21:57:44.909708+0000 mon.b (mon.1) 192 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:57:45.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:45 smithi057 bash[10301]: audit 2020-11-16T21:57:44.911113+0000 mon.b (mon.1) 193 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:57:45.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:45 smithi057 bash[10301]: audit 2020-11-16T21:57:44.912734+0000 mon.b (mon.1) 194 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:46.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:46 smithi016 bash[10302]: cluster 2020-11-16T21:57:45.486231+0000 mgr.x (mgr.24115) 133 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:46.834 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:46 smithi016 bash[10302]: cluster 2020-11-16T21:57:45.594055+0000 mon.a (mon.0) 551 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2020-11-16T21:57:46.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:46 smithi195 bash[10218]: cluster 2020-11-16T21:57:45.486231+0000 mgr.x (mgr.24115) 133 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:46.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:46 smithi195 bash[10218]: cluster 2020-11-16T21:57:45.594055+0000 mon.a (mon.0) 551 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2020-11-16T21:57:46.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:46 smithi057 bash[10301]: cluster 2020-11-16T21:57:45.486231+0000 mgr.x (mgr.24115) 133 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2020-11-16T21:57:46.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:46 smithi057 bash[10301]: cluster 2020-11-16T21:57:45.594055+0000 mon.a (mon.0) 551 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2020-11-16T21:57:48.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:48 smithi195 bash[10218]: cluster 2020-11-16T21:57:47.486824+0000 mgr.x (mgr.24115) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 peering; 0 B data, 41 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:48.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:48 smithi057 bash[10301]: cluster 2020-11-16T21:57:47.486824+0000 mgr.x (mgr.24115) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 peering; 0 B data, 41 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:49.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:48 smithi016 bash[10302]: cluster 2020-11-16T21:57:47.486824+0000 mgr.x (mgr.24115) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 peering; 0 B data, 41 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:49.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:49 smithi195 bash[10218]: audit 2020-11-16T21:57:48.971164+0000 mon.b (mon.1) 195 : audit [INF] from='client.? v1:172.21.15.57:0/1324923434' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4eaa536f-253e-460d-a65d-221dd0924d00"}]: dispatch 2020-11-16T21:57:49.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:49 smithi195 bash[10218]: audit 2020-11-16T21:57:48.971437+0000 mon.a (mon.0) 552 : audit [INF] from='client.24343 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4eaa536f-253e-460d-a65d-221dd0924d00"}]: dispatch 2020-11-16T21:57:49.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:49 smithi195 bash[10218]: audit 2020-11-16T21:57:48.979192+0000 mon.a (mon.0) 553 : audit [INF] from='client.24343 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4eaa536f-253e-460d-a65d-221dd0924d00"}]': finished 2020-11-16T21:57:49.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:49 smithi195 bash[10218]: cluster 2020-11-16T21:57:48.979300+0000 mon.a (mon.0) 554 : cluster [DBG] osdmap e50: 9 total, 8 up, 8 in 2020-11-16T21:57:49.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:49 smithi195 bash[10218]: audit 2020-11-16T21:57:48.980915+0000 mon.b (mon.1) 196 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2020-11-16T21:57:49.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:49 smithi057 bash[10301]: audit 2020-11-16T21:57:48.971164+0000 mon.b (mon.1) 195 : audit [INF] from='client.? v1:172.21.15.57:0/1324923434' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4eaa536f-253e-460d-a65d-221dd0924d00"}]: dispatch 2020-11-16T21:57:49.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:49 smithi057 bash[10301]: audit 2020-11-16T21:57:48.971437+0000 mon.a (mon.0) 552 : audit [INF] from='client.24343 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4eaa536f-253e-460d-a65d-221dd0924d00"}]: dispatch 2020-11-16T21:57:49.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:49 smithi057 bash[10301]: audit 2020-11-16T21:57:48.979192+0000 mon.a (mon.0) 553 : audit [INF] from='client.24343 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4eaa536f-253e-460d-a65d-221dd0924d00"}]': finished 2020-11-16T21:57:49.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:49 smithi057 bash[10301]: cluster 2020-11-16T21:57:48.979300+0000 mon.a (mon.0) 554 : cluster [DBG] osdmap e50: 9 total, 8 up, 8 in 2020-11-16T21:57:49.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:49 smithi057 bash[10301]: audit 2020-11-16T21:57:48.980915+0000 mon.b (mon.1) 196 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2020-11-16T21:57:50.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:49 smithi016 bash[10302]: audit 2020-11-16T21:57:48.971164+0000 mon.b (mon.1) 195 : audit [INF] from='client.? v1:172.21.15.57:0/1324923434' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4eaa536f-253e-460d-a65d-221dd0924d00"}]: dispatch 2020-11-16T21:57:50.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:49 smithi016 bash[10302]: audit 2020-11-16T21:57:48.971437+0000 mon.a (mon.0) 552 : audit [INF] from='client.24343 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4eaa536f-253e-460d-a65d-221dd0924d00"}]: dispatch 2020-11-16T21:57:50.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:49 smithi016 bash[10302]: audit 2020-11-16T21:57:48.979192+0000 mon.a (mon.0) 553 : audit [INF] from='client.24343 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4eaa536f-253e-460d-a65d-221dd0924d00"}]': finished 2020-11-16T21:57:50.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:49 smithi016 bash[10302]: cluster 2020-11-16T21:57:48.979300+0000 mon.a (mon.0) 554 : cluster [DBG] osdmap e50: 9 total, 8 up, 8 in 2020-11-16T21:57:50.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:49 smithi016 bash[10302]: audit 2020-11-16T21:57:48.980915+0000 mon.b (mon.1) 196 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2020-11-16T21:57:50.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:50 smithi195 bash[10218]: cluster 2020-11-16T21:57:49.487326+0000 mgr.x (mgr.24115) 135 : cluster [DBG] pgmap v136: 1 pgs: 1 peering; 0 B data, 41 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:50.848 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:50 smithi195 bash[10218]: audit 2020-11-16T21:57:49.612584+0000 mon.c (mon.2) 4 : audit [DBG] from='client.? v1:172.21.15.57:0/1882452860' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:57:50.945 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:50 smithi057 bash[10301]: cluster 2020-11-16T21:57:49.487326+0000 mgr.x (mgr.24115) 135 : cluster [DBG] pgmap v136: 1 pgs: 1 peering; 0 B data, 41 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:50.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:50 smithi057 bash[10301]: audit 2020-11-16T21:57:49.612584+0000 mon.c (mon.2) 4 : audit [DBG] from='client.? v1:172.21.15.57:0/1882452860' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:57:51.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:50 smithi016 bash[10302]: cluster 2020-11-16T21:57:49.487326+0000 mgr.x (mgr.24115) 135 : cluster [DBG] pgmap v136: 1 pgs: 1 peering; 0 B data, 41 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:51.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:50 smithi016 bash[10302]: audit 2020-11-16T21:57:49.612584+0000 mon.c (mon.2) 4 : audit [DBG] from='client.? v1:172.21.15.57:0/1882452860' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:57:52.847 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:52 smithi195 bash[10218]: cluster 2020-11-16T21:57:51.487949+0000 mgr.x (mgr.24115) 136 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 41 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:52.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:52 smithi057 bash[10301]: cluster 2020-11-16T21:57:51.487949+0000 mgr.x (mgr.24115) 136 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 41 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:53.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:52 smithi016 bash[10302]: cluster 2020-11-16T21:57:51.487949+0000 mgr.x (mgr.24115) 136 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 41 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:53.894 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:53 smithi057 bash[10301]: audit 2020-11-16T21:57:52.776795+0000 mon.b (mon.1) 197 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:54.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:53 smithi016 bash[10302]: audit 2020-11-16T21:57:52.776795+0000 mon.b (mon.1) 197 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:54.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:53 smithi195 bash[10218]: audit 2020-11-16T21:57:52.776795+0000 mon.b (mon.1) 197 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:57:54.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:54 smithi057 bash[10301]: cluster 2020-11-16T21:57:53.488543+0000 mgr.x (mgr.24115) 137 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:55.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:54 smithi016 bash[10302]: cluster 2020-11-16T21:57:53.488543+0000 mgr.x (mgr.24115) 137 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:55.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:54 smithi195 bash[10218]: cluster 2020-11-16T21:57:53.488543+0000 mgr.x (mgr.24115) 137 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:56.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:56 smithi057 bash[10301]: cluster 2020-11-16T21:57:55.489123+0000 mgr.x (mgr.24115) 138 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:57.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:56 smithi016 bash[10302]: cluster 2020-11-16T21:57:55.489123+0000 mgr.x (mgr.24115) 138 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:57.097 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:56 smithi195 bash[10218]: cluster 2020-11-16T21:57:55.489123+0000 mgr.x (mgr.24115) 138 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:57.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:57 smithi057 bash[10301]: audit 2020-11-16T21:57:56.798825+0000 mon.b (mon.1) 198 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2020-11-16T21:57:57.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:57 smithi057 bash[10301]: audit 2020-11-16T21:57:56.800449+0000 mon.b (mon.1) 199 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:57:57.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:57 smithi057 bash[10301]: cephadm 2020-11-16T21:57:56.801759+0000 mgr.x (mgr.24115) 139 : cephadm [INF] Deploying daemon osd.8 on smithi057 2020-11-16T21:57:57.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:57 smithi057 bash[10301]: audit 2020-11-16T21:57:56.802450+0000 mon.b (mon.1) 200 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.8", "key": "container_image"}]: dispatch 2020-11-16T21:57:58.084 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:57 smithi016 bash[10302]: audit 2020-11-16T21:57:56.798825+0000 mon.b (mon.1) 198 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2020-11-16T21:57:58.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:57 smithi016 bash[10302]: audit 2020-11-16T21:57:56.800449+0000 mon.b (mon.1) 199 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:57:58.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:57 smithi016 bash[10302]: cephadm 2020-11-16T21:57:56.801759+0000 mgr.x (mgr.24115) 139 : cephadm [INF] Deploying daemon osd.8 on smithi057 2020-11-16T21:57:58.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:57 smithi016 bash[10302]: audit 2020-11-16T21:57:56.802450+0000 mon.b (mon.1) 200 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.8", "key": "container_image"}]: dispatch 2020-11-16T21:57:58.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:57 smithi195 bash[10218]: audit 2020-11-16T21:57:56.798825+0000 mon.b (mon.1) 198 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2020-11-16T21:57:58.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:57 smithi195 bash[10218]: audit 2020-11-16T21:57:56.800449+0000 mon.b (mon.1) 199 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:57:58.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:57 smithi195 bash[10218]: cephadm 2020-11-16T21:57:56.801759+0000 mgr.x (mgr.24115) 139 : cephadm [INF] Deploying daemon osd.8 on smithi057 2020-11-16T21:57:58.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:57 smithi195 bash[10218]: audit 2020-11-16T21:57:56.802450+0000 mon.b (mon.1) 200 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.8", "key": "container_image"}]: dispatch 2020-11-16T21:57:58.895 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:58 smithi057 bash[10301]: cluster 2020-11-16T21:57:57.489881+0000 mgr.x (mgr.24115) 140 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:59.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:58 smithi016 bash[10302]: cluster 2020-11-16T21:57:57.489881+0000 mgr.x (mgr.24115) 140 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:59.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:58 smithi195 bash[10218]: cluster 2020-11-16T21:57:57.489881+0000 mgr.x (mgr.24115) 140 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:57:59.228 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 8 on host 'smithi057' 2020-11-16T21:57:59.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:59 smithi057 bash[10301]: audit 2020-11-16T21:57:59.230032+0000 mon.b (mon.1) 201 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:57:59.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:59 smithi057 bash[10301]: audit 2020-11-16T21:57:59.230709+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:57:59.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:59 smithi057 bash[10301]: audit 2020-11-16T21:57:59.230892+0000 mon.b (mon.1) 202 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:57:59.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:57:59 smithi057 bash[10301]: audit 2020-11-16T21:57:59.236504+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:00.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:59 smithi016 bash[10302]: audit 2020-11-16T21:57:59.230032+0000 mon.b (mon.1) 201 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:00.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:59 smithi016 bash[10302]: audit 2020-11-16T21:57:59.230709+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:00.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:59 smithi016 bash[10302]: audit 2020-11-16T21:57:59.230892+0000 mon.b (mon.1) 202 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:58:00.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:57:59 smithi016 bash[10302]: audit 2020-11-16T21:57:59.236504+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:00.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:59 smithi195 bash[10218]: audit 2020-11-16T21:57:59.230032+0000 mon.b (mon.1) 201 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:00.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:59 smithi195 bash[10218]: audit 2020-11-16T21:57:59.230709+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:00.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:59 smithi195 bash[10218]: audit 2020-11-16T21:57:59.230892+0000 mon.b (mon.1) 202 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:58:00.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:57:59 smithi195 bash[10218]: audit 2020-11-16T21:57:59.236504+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:54:30.635050\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_device_update\": \"2020-11-16T21:53:13.105193\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:00.421 INFO:teuthology.orchestra.run.smithi057:osd.8> sudo journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.8.service 2020-11-16T21:58:00.424 INFO:tasks.cephadm:Deploying osd.9 on smithi057 with /dev/vg_nvme/lv_3... 2020-11-16T21:58:00.425 INFO:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2020-11-16T21:58:00.504 INFO:journalctl@ceph.osd.8.smithi057.stdout:-- Logs begin at Sun 2020-11-15 12:21:41 UTC. -- 2020-11-16T21:58:00.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:00 smithi057 bash[10301]: cluster 2020-11-16T21:57:59.490491+0000 mgr.x (mgr.24115) 141 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:00.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:00 smithi057 bash[10301]: audit 2020-11-16T21:57:59.700080+0000 mon.b (mon.1) 203 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:58:00.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:00 smithi057 bash[10301]: audit 2020-11-16T21:57:59.700621+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:58:00.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:00 smithi057 bash[10301]: audit 2020-11-16T21:57:59.706055+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-11-16T21:58:00.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:00 smithi057 bash[10301]: audit 2020-11-16T21:57:59.985333+0000 mon.b (mon.1) 204 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:00.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:00 smithi057 bash[10301]: audit 2020-11-16T21:57:59.986061+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:00.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:00 smithi057 bash[10301]: audit 2020-11-16T21:57:59.991683+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:00.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:00 smithi057 bash[10301]: audit 2020-11-16T21:57:59.994458+0000 mon.b (mon.1) 205 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:01.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:00 smithi016 bash[10302]: cluster 2020-11-16T21:57:59.490491+0000 mgr.x (mgr.24115) 141 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:01.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:00 smithi016 bash[10302]: audit 2020-11-16T21:57:59.700080+0000 mon.b (mon.1) 203 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:58:01.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:00 smithi016 bash[10302]: audit 2020-11-16T21:57:59.700621+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:58:01.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:00 smithi016 bash[10302]: audit 2020-11-16T21:57:59.706055+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-11-16T21:58:01.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:00 smithi016 bash[10302]: audit 2020-11-16T21:57:59.985333+0000 mon.b (mon.1) 204 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:01.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:00 smithi016 bash[10302]: audit 2020-11-16T21:57:59.986061+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:01.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:00 smithi016 bash[10302]: audit 2020-11-16T21:57:59.991683+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:01.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:00 smithi016 bash[10302]: audit 2020-11-16T21:57:59.994458+0000 mon.b (mon.1) 205 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:01.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:00 smithi195 bash[10218]: cluster 2020-11-16T21:57:59.490491+0000 mgr.x (mgr.24115) 141 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:01.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:00 smithi195 bash[10218]: audit 2020-11-16T21:57:59.700080+0000 mon.b (mon.1) 203 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:58:01.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:00 smithi195 bash[10218]: audit 2020-11-16T21:57:59.700621+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:58:01.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:00 smithi195 bash[10218]: audit 2020-11-16T21:57:59.706055+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-11-16T21:58:01.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:00 smithi195 bash[10218]: audit 2020-11-16T21:57:59.985333+0000 mon.b (mon.1) 204 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:01.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:00 smithi195 bash[10218]: audit 2020-11-16T21:57:59.986061+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:01.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:00 smithi195 bash[10218]: audit 2020-11-16T21:57:59.991683+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:01.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:00 smithi195 bash[10218]: audit 2020-11-16T21:57:59.994458+0000 mon.b (mon.1) 205 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:01.967 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 21:58:01 smithi057 bash[12595]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2020-11-16T21:58:01.967 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 21:58:01 smithi057 bash[12595]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-8 --no-mon-config 2020-11-16T21:58:01.967 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 21:58:01 smithi057 bash[12595]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-8/block 2020-11-16T21:58:01.967 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 21:58:01 smithi057 bash[12595]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-8/block 2020-11-16T21:58:01.968 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 21:58:01 smithi057 bash[12595]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2020-11-16T21:58:01.968 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 21:58:01 smithi057 bash[12595]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2020-11-16T21:58:01.968 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 21:58:01 smithi057 bash[12595]: --> ceph-volume lvm activate successful for osd ID: 8 2020-11-16T21:58:02.814 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:02 smithi057 bash[10301]: cluster 2020-11-16T21:58:01.491092+0000 mgr.x (mgr.24115) 142 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:03.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:02 smithi016 bash[10302]: cluster 2020-11-16T21:58:01.491092+0000 mgr.x (mgr.24115) 142 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:03.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:02 smithi195 bash[10218]: cluster 2020-11-16T21:58:01.491092+0000 mgr.x (mgr.24115) 142 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:03.196 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 21:58:02 smithi057 bash[12595]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.8 2020-11-16T21:58:04.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:04 smithi057 bash[10301]: cluster 2020-11-16T21:58:03.491685+0000 mgr.x (mgr.24115) 143 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:05.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:04 smithi016 bash[10302]: cluster 2020-11-16T21:58:03.491685+0000 mgr.x (mgr.24115) 143 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:05.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:04 smithi195 bash[10218]: cluster 2020-11-16T21:58:03.491685+0000 mgr.x (mgr.24115) 143 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:05.446 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 21:58:05 smithi057 bash[12595]: debug 2020-11-16T21:58:05.243+0000 7f739aa0a700 10 -- 172.21.15.57:0/1162106643 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2020-11-16T21:58:05.446 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 21:58:05 smithi057 bash[12595]: debug 2020-11-16T21:58:05.243+0000 7f739aa0a700 20 -- 172.21.15.57:0/1162106643 done calling dispatch on 0x557299df2680 2020-11-16T21:58:06.031 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 21:58:05 smithi057 bash[12595]: debug 2020-11-16T21:58:05.783+0000 7f73a248af40 -1 Falling back to public interface 2020-11-16T21:58:06.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:06 smithi057 bash[10301]: cluster 2020-11-16T21:58:05.492303+0000 mgr.x (mgr.24115) 144 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:06.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:06 smithi057 bash[10301]: audit 2020-11-16T21:58:06.444787+0000 mon.c (mon.2) 5 : audit [INF] from='osd.8 v1:172.21.15.57:6800/2452828964' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2020-11-16T21:58:06.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:06 smithi057 bash[10301]: audit 2020-11-16T21:58:06.445605+0000 mon.a (mon.0) 561 : audit [INF] from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2020-11-16T21:58:06.697 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 21:58:06 smithi057 bash[12595]: debug 2020-11-16T21:58:06.435+0000 7f73a248af40 -1 osd.8 0 log_to_monitors {default=true} 2020-11-16T21:58:06.706 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_3 2020-11-16T21:58:06.706 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2020-11-16T21:58:06.706 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2020-11-16T21:58:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2020-11-16T21:58:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0125072 s, 838 MB/s 2020-11-16T21:58:06.707 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2020-11-16T21:58:07.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:06 smithi016 bash[10302]: cluster 2020-11-16T21:58:05.492303+0000 mgr.x (mgr.24115) 144 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:07.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:06 smithi016 bash[10302]: audit 2020-11-16T21:58:06.444787+0000 mon.c (mon.2) 5 : audit [INF] from='osd.8 v1:172.21.15.57:6800/2452828964' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2020-11-16T21:58:07.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:06 smithi016 bash[10302]: audit 2020-11-16T21:58:06.445605+0000 mon.a (mon.0) 561 : audit [INF] from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2020-11-16T21:58:07.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:06 smithi195 bash[10218]: cluster 2020-11-16T21:58:05.492303+0000 mgr.x (mgr.24115) 144 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:07.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:06 smithi195 bash[10218]: audit 2020-11-16T21:58:06.444787+0000 mon.c (mon.2) 5 : audit [INF] from='osd.8 v1:172.21.15.57:6800/2452828964' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2020-11-16T21:58:07.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:06 smithi195 bash[10218]: audit 2020-11-16T21:58:06.445605+0000 mon.a (mon.0) 561 : audit [INF] from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2020-11-16T21:58:07.641 INFO:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch daemon add osd smithi057:vg_nvme/lv_3 2020-11-16T21:58:07.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:07 smithi057 bash[10301]: audit 2020-11-16T21:58:06.676593+0000 mon.a (mon.0) 562 : audit [INF] from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2020-11-16T21:58:07.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:07 smithi057 bash[10301]: cluster 2020-11-16T21:58:06.676686+0000 mon.a (mon.0) 563 : cluster [DBG] osdmap e51: 9 total, 8 up, 8 in 2020-11-16T21:58:07.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:07 smithi057 bash[10301]: audit 2020-11-16T21:58:06.679552+0000 mon.b (mon.1) 206 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2020-11-16T21:58:07.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:07 smithi057 bash[10301]: audit 2020-11-16T21:58:06.682302+0000 mon.c (mon.2) 6 : audit [INF] from='osd.8 v1:172.21.15.57:6800/2452828964' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:58:07.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:07 smithi057 bash[10301]: audit 2020-11-16T21:58:06.689693+0000 mon.a (mon.0) 564 : audit [INF] from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:58:07.947 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 21:58:07 smithi057 bash[12595]: debug 2020-11-16T21:58:07.695+0000 7f7398a06700 -1 osd.8 0 waiting for initial osdmap 2020-11-16T21:58:08.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:07 smithi016 bash[10302]: audit 2020-11-16T21:58:06.676593+0000 mon.a (mon.0) 562 : audit [INF] from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2020-11-16T21:58:08.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:07 smithi016 bash[10302]: cluster 2020-11-16T21:58:06.676686+0000 mon.a (mon.0) 563 : cluster [DBG] osdmap e51: 9 total, 8 up, 8 in 2020-11-16T21:58:08.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:07 smithi016 bash[10302]: audit 2020-11-16T21:58:06.679552+0000 mon.b (mon.1) 206 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2020-11-16T21:58:08.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:07 smithi016 bash[10302]: audit 2020-11-16T21:58:06.682302+0000 mon.c (mon.2) 6 : audit [INF] from='osd.8 v1:172.21.15.57:6800/2452828964' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:58:08.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:07 smithi016 bash[10302]: audit 2020-11-16T21:58:06.689693+0000 mon.a (mon.0) 564 : audit [INF] from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:58:08.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:07 smithi195 bash[10218]: audit 2020-11-16T21:58:06.676593+0000 mon.a (mon.0) 562 : audit [INF] from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2020-11-16T21:58:08.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:07 smithi195 bash[10218]: cluster 2020-11-16T21:58:06.676686+0000 mon.a (mon.0) 563 : cluster [DBG] osdmap e51: 9 total, 8 up, 8 in 2020-11-16T21:58:08.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:07 smithi195 bash[10218]: audit 2020-11-16T21:58:06.679552+0000 mon.b (mon.1) 206 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2020-11-16T21:58:08.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:07 smithi195 bash[10218]: audit 2020-11-16T21:58:06.682302+0000 mon.c (mon.2) 6 : audit [INF] from='osd.8 v1:172.21.15.57:6800/2452828964' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:58:08.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:07 smithi195 bash[10218]: audit 2020-11-16T21:58:06.689693+0000 mon.a (mon.0) 564 : audit [INF] from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:58:08.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:08 smithi057 bash[10301]: cluster 2020-11-16T21:58:07.492932+0000 mgr.x (mgr.24115) 145 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:08.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:08 smithi057 bash[10301]: audit 2020-11-16T21:58:07.690025+0000 mon.a (mon.0) 565 : audit [INF] from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2020-11-16T21:58:08.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:08 smithi057 bash[10301]: cluster 2020-11-16T21:58:07.690128+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e52: 9 total, 8 up, 8 in 2020-11-16T21:58:08.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:08 smithi057 bash[10301]: audit 2020-11-16T21:58:07.692438+0000 mon.b (mon.1) 207 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2020-11-16T21:58:08.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:08 smithi057 bash[10301]: audit 2020-11-16T21:58:07.751244+0000 mon.b (mon.1) 208 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:58:08.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:08 smithi057 bash[10301]: audit 2020-11-16T21:58:08.055111+0000 mon.b (mon.1) 209 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:08.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:08 smithi057 bash[10301]: audit 2020-11-16T21:58:08.056113+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:08.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:08 smithi057 bash[10301]: audit 2020-11-16T21:58:08.061838+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:08.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:08 smithi057 bash[10301]: audit 2020-11-16T21:58:08.065002+0000 mon.b (mon.1) 210 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:08.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:08 smithi057 bash[10301]: audit 2020-11-16T21:58:08.065610+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:08.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:08 smithi057 bash[10301]: audit 2020-11-16T21:58:08.071041+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:58:08.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:08 smithi057 bash[10301]: audit 2020-11-16T21:58:08.077135+0000 mon.b (mon.1) 211 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:08.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:08 smithi057 bash[10301]: audit 2020-11-16T21:58:08.077712+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:08.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:08 smithi057 bash[10301]: audit 2020-11-16T21:58:08.082587+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:58:09.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:08 smithi016 bash[10302]: cluster 2020-11-16T21:58:07.492932+0000 mgr.x (mgr.24115) 145 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:09.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:08 smithi016 bash[10302]: audit 2020-11-16T21:58:07.690025+0000 mon.a (mon.0) 565 : audit [INF] from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2020-11-16T21:58:09.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:08 smithi016 bash[10302]: cluster 2020-11-16T21:58:07.690128+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e52: 9 total, 8 up, 8 in 2020-11-16T21:58:09.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:08 smithi016 bash[10302]: audit 2020-11-16T21:58:07.692438+0000 mon.b (mon.1) 207 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2020-11-16T21:58:09.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:08 smithi016 bash[10302]: audit 2020-11-16T21:58:07.751244+0000 mon.b (mon.1) 208 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:58:09.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:08 smithi016 bash[10302]: audit 2020-11-16T21:58:08.055111+0000 mon.b (mon.1) 209 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:09.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:08 smithi016 bash[10302]: audit 2020-11-16T21:58:08.056113+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:09.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:08 smithi016 bash[10302]: audit 2020-11-16T21:58:08.061838+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:09.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:08 smithi016 bash[10302]: audit 2020-11-16T21:58:08.065002+0000 mon.b (mon.1) 210 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:09.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:08 smithi016 bash[10302]: audit 2020-11-16T21:58:08.065610+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:09.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:08 smithi016 bash[10302]: audit 2020-11-16T21:58:08.071041+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:58:09.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:08 smithi016 bash[10302]: audit 2020-11-16T21:58:08.077135+0000 mon.b (mon.1) 211 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:09.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:08 smithi016 bash[10302]: audit 2020-11-16T21:58:08.077712+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:09.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:08 smithi016 bash[10302]: audit 2020-11-16T21:58:08.082587+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:58:09.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:08 smithi195 bash[10218]: cluster 2020-11-16T21:58:07.492932+0000 mgr.x (mgr.24115) 145 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:09.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:08 smithi195 bash[10218]: audit 2020-11-16T21:58:07.690025+0000 mon.a (mon.0) 565 : audit [INF] from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2020-11-16T21:58:09.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:08 smithi195 bash[10218]: cluster 2020-11-16T21:58:07.690128+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e52: 9 total, 8 up, 8 in 2020-11-16T21:58:09.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:08 smithi195 bash[10218]: audit 2020-11-16T21:58:07.692438+0000 mon.b (mon.1) 207 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2020-11-16T21:58:09.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:08 smithi195 bash[10218]: audit 2020-11-16T21:58:07.751244+0000 mon.b (mon.1) 208 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:58:09.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:08 smithi195 bash[10218]: audit 2020-11-16T21:58:08.055111+0000 mon.b (mon.1) 209 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:09.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:08 smithi195 bash[10218]: audit 2020-11-16T21:58:08.056113+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:09.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:08 smithi195 bash[10218]: audit 2020-11-16T21:58:08.061838+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}}, \"last_daemon_update\": \"2020-11-16T21:57:59.984150\", \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:09.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:08 smithi195 bash[10218]: audit 2020-11-16T21:58:08.065002+0000 mon.b (mon.1) 210 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:09.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:08 smithi195 bash[10218]: audit 2020-11-16T21:58:08.065610+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:09.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:08 smithi195 bash[10218]: audit 2020-11-16T21:58:08.071041+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:58:09.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:08 smithi195 bash[10218]: audit 2020-11-16T21:58:08.077135+0000 mon.b (mon.1) 211 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:09.101 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:08 smithi195 bash[10218]: audit 2020-11-16T21:58:08.077712+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:09.101 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:08 smithi195 bash[10218]: audit 2020-11-16T21:58:08.082587+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:58:09.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:09 smithi057 bash[10301]: cluster 2020-11-16T21:58:07.409682+0000 osd.8 (osd.8) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:58:09.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:09 smithi057 bash[10301]: cluster 2020-11-16T21:58:07.409880+0000 osd.8 (osd.8) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:58:09.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:09 smithi057 bash[10301]: audit 2020-11-16T21:58:08.704243+0000 mon.b (mon.1) 212 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2020-11-16T21:58:09.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:09 smithi057 bash[10301]: cluster 2020-11-16T21:58:08.720764+0000 mon.a (mon.0) 573 : cluster [INF] osd.8 v1:172.21.15.57:6800/2452828964 boot 2020-11-16T21:58:09.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:09 smithi057 bash[10301]: cluster 2020-11-16T21:58:08.720887+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e53: 9 total, 9 up, 9 in 2020-11-16T21:58:09.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:09 smithi057 bash[10301]: audit 2020-11-16T21:58:08.730617+0000 mon.b (mon.1) 213 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2020-11-16T21:58:10.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:09 smithi016 bash[10302]: cluster 2020-11-16T21:58:07.409682+0000 osd.8 (osd.8) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:58:10.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:09 smithi016 bash[10302]: cluster 2020-11-16T21:58:07.409880+0000 osd.8 (osd.8) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:58:10.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:09 smithi016 bash[10302]: audit 2020-11-16T21:58:08.704243+0000 mon.b (mon.1) 212 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2020-11-16T21:58:10.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:09 smithi016 bash[10302]: cluster 2020-11-16T21:58:08.720764+0000 mon.a (mon.0) 573 : cluster [INF] osd.8 v1:172.21.15.57:6800/2452828964 boot 2020-11-16T21:58:10.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:09 smithi016 bash[10302]: cluster 2020-11-16T21:58:08.720887+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e53: 9 total, 9 up, 9 in 2020-11-16T21:58:10.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:09 smithi016 bash[10302]: audit 2020-11-16T21:58:08.730617+0000 mon.b (mon.1) 213 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2020-11-16T21:58:10.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:09 smithi195 bash[10218]: cluster 2020-11-16T21:58:07.409682+0000 osd.8 (osd.8) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:58:10.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:09 smithi195 bash[10218]: cluster 2020-11-16T21:58:07.409880+0000 osd.8 (osd.8) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:58:10.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:09 smithi195 bash[10218]: audit 2020-11-16T21:58:08.704243+0000 mon.b (mon.1) 212 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2020-11-16T21:58:10.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:09 smithi195 bash[10218]: cluster 2020-11-16T21:58:08.720764+0000 mon.a (mon.0) 573 : cluster [INF] osd.8 v1:172.21.15.57:6800/2452828964 boot 2020-11-16T21:58:10.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:09 smithi195 bash[10218]: cluster 2020-11-16T21:58:08.720887+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e53: 9 total, 9 up, 9 in 2020-11-16T21:58:10.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:09 smithi195 bash[10218]: audit 2020-11-16T21:58:08.730617+0000 mon.b (mon.1) 213 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2020-11-16T21:58:10.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:10 smithi057 bash[10301]: cluster 2020-11-16T21:58:09.493572+0000 mgr.x (mgr.24115) 146 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:10.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:10 smithi057 bash[10301]: cluster 2020-11-16T21:58:09.723047+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e54: 9 total, 9 up, 9 in 2020-11-16T21:58:11.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:10 smithi016 bash[10302]: cluster 2020-11-16T21:58:09.493572+0000 mgr.x (mgr.24115) 146 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:11.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:10 smithi016 bash[10302]: cluster 2020-11-16T21:58:09.723047+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e54: 9 total, 9 up, 9 in 2020-11-16T21:58:11.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:10 smithi195 bash[10218]: cluster 2020-11-16T21:58:09.493572+0000 mgr.x (mgr.24115) 146 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2020-11-16T21:58:11.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:10 smithi195 bash[10218]: cluster 2020-11-16T21:58:09.723047+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e54: 9 total, 9 up, 9 in 2020-11-16T21:58:12.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:11 smithi016 bash[10302]: audit 2020-11-16T21:58:11.094099+0000 mgr.x (mgr.24115) 147 : audit [DBG] from='client.34367 v1:172.21.15.57:0/3610701692' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:58:12.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:11 smithi016 bash[10302]: audit 2020-11-16T21:58:11.096001+0000 mon.b (mon.1) 214 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:58:12.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:11 smithi016 bash[10302]: cephadm 2020-11-16T21:58:11.097481+0000 mgr.x (mgr.24115) 148 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:58:12.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:11 smithi016 bash[10302]: cephadm 2020-11-16T21:58:11.097660+0000 mgr.x (mgr.24115) 149 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:58:12.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:11 smithi016 bash[10302]: cephadm 2020-11-16T21:58:11.098759+0000 mgr.x (mgr.24115) 150 : cephadm [INF] Applying None on host smithi057... 2020-11-16T21:58:12.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:11 smithi016 bash[10302]: audit 2020-11-16T21:58:11.099594+0000 mon.b (mon.1) 215 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:58:12.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:11 smithi016 bash[10302]: audit 2020-11-16T21:58:11.101187+0000 mon.b (mon.1) 216 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:58:12.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:11 smithi016 bash[10302]: audit 2020-11-16T21:58:11.103003+0000 mon.b (mon.1) 217 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:12.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:11 smithi195 bash[10218]: audit 2020-11-16T21:58:11.094099+0000 mgr.x (mgr.24115) 147 : audit [DBG] from='client.34367 v1:172.21.15.57:0/3610701692' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:58:12.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:11 smithi195 bash[10218]: audit 2020-11-16T21:58:11.096001+0000 mon.b (mon.1) 214 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:58:12.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:11 smithi195 bash[10218]: cephadm 2020-11-16T21:58:11.097481+0000 mgr.x (mgr.24115) 148 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:58:12.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:11 smithi195 bash[10218]: cephadm 2020-11-16T21:58:11.097660+0000 mgr.x (mgr.24115) 149 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:58:12.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:11 smithi195 bash[10218]: cephadm 2020-11-16T21:58:11.098759+0000 mgr.x (mgr.24115) 150 : cephadm [INF] Applying None on host smithi057... 2020-11-16T21:58:12.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:11 smithi195 bash[10218]: audit 2020-11-16T21:58:11.099594+0000 mon.b (mon.1) 215 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:58:12.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:11 smithi195 bash[10218]: audit 2020-11-16T21:58:11.101187+0000 mon.b (mon.1) 216 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:58:12.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:11 smithi195 bash[10218]: audit 2020-11-16T21:58:11.103003+0000 mon.b (mon.1) 217 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:12.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:11 smithi057 bash[10301]: audit 2020-11-16T21:58:11.094099+0000 mgr.x (mgr.24115) 147 : audit [DBG] from='client.34367 v1:172.21.15.57:0/3610701692' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:58:12.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:11 smithi057 bash[10301]: audit 2020-11-16T21:58:11.096001+0000 mon.b (mon.1) 214 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:58:12.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:11 smithi057 bash[10301]: cephadm 2020-11-16T21:58:11.097481+0000 mgr.x (mgr.24115) 148 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:58:12.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:11 smithi057 bash[10301]: cephadm 2020-11-16T21:58:11.097660+0000 mgr.x (mgr.24115) 149 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:58:12.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:11 smithi057 bash[10301]: cephadm 2020-11-16T21:58:11.098759+0000 mgr.x (mgr.24115) 150 : cephadm [INF] Applying None on host smithi057... 2020-11-16T21:58:12.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:11 smithi057 bash[10301]: audit 2020-11-16T21:58:11.099594+0000 mon.b (mon.1) 215 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:58:12.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:11 smithi057 bash[10301]: audit 2020-11-16T21:58:11.101187+0000 mon.b (mon.1) 216 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:58:12.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:11 smithi057 bash[10301]: audit 2020-11-16T21:58:11.103003+0000 mon.b (mon.1) 217 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:13.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:12 smithi016 bash[10302]: cluster 2020-11-16T21:58:11.494204+0000 mgr.x (mgr.24115) 151 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:13.098 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:12 smithi195 bash[10218]: cluster 2020-11-16T21:58:11.494204+0000 mgr.x (mgr.24115) 151 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:13.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:12 smithi057 bash[10301]: cluster 2020-11-16T21:58:11.494204+0000 mgr.x (mgr.24115) 151 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:15.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:14 smithi016 bash[10302]: cluster 2020-11-16T21:58:13.494825+0000 mgr.x (mgr.24115) 152 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:15.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:14 smithi195 bash[10218]: cluster 2020-11-16T21:58:13.494825+0000 mgr.x (mgr.24115) 152 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:15.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:14 smithi057 bash[10301]: cluster 2020-11-16T21:58:13.494825+0000 mgr.x (mgr.24115) 152 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:16.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:15 smithi016 bash[10302]: audit 2020-11-16T21:58:15.272187+0000 mon.c (mon.2) 7 : audit [INF] from='client.? v1:172.21.15.57:0/3590794692' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fcb83bc5-7834-4510-8fe9-40074b8dc739"}]: dispatch 2020-11-16T21:58:16.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:15 smithi016 bash[10302]: audit 2020-11-16T21:58:15.272605+0000 mon.a (mon.0) 576 : audit [INF] from='client.34373 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fcb83bc5-7834-4510-8fe9-40074b8dc739"}]: dispatch 2020-11-16T21:58:16.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:15 smithi016 bash[10302]: audit 2020-11-16T21:58:15.280450+0000 mon.a (mon.0) 577 : audit [INF] from='client.34373 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fcb83bc5-7834-4510-8fe9-40074b8dc739"}]': finished 2020-11-16T21:58:16.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:15 smithi016 bash[10302]: cluster 2020-11-16T21:58:15.280561+0000 mon.a (mon.0) 578 : cluster [DBG] osdmap e55: 10 total, 9 up, 9 in 2020-11-16T21:58:16.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:15 smithi016 bash[10302]: audit 2020-11-16T21:58:15.282378+0000 mon.b (mon.1) 218 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2020-11-16T21:58:16.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:15 smithi195 bash[10218]: audit 2020-11-16T21:58:15.272187+0000 mon.c (mon.2) 7 : audit [INF] from='client.? v1:172.21.15.57:0/3590794692' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fcb83bc5-7834-4510-8fe9-40074b8dc739"}]: dispatch 2020-11-16T21:58:16.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:15 smithi195 bash[10218]: audit 2020-11-16T21:58:15.272605+0000 mon.a (mon.0) 576 : audit [INF] from='client.34373 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fcb83bc5-7834-4510-8fe9-40074b8dc739"}]: dispatch 2020-11-16T21:58:16.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:15 smithi195 bash[10218]: audit 2020-11-16T21:58:15.280450+0000 mon.a (mon.0) 577 : audit [INF] from='client.34373 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fcb83bc5-7834-4510-8fe9-40074b8dc739"}]': finished 2020-11-16T21:58:16.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:15 smithi195 bash[10218]: cluster 2020-11-16T21:58:15.280561+0000 mon.a (mon.0) 578 : cluster [DBG] osdmap e55: 10 total, 9 up, 9 in 2020-11-16T21:58:16.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:15 smithi195 bash[10218]: audit 2020-11-16T21:58:15.282378+0000 mon.b (mon.1) 218 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2020-11-16T21:58:16.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:15 smithi057 bash[10301]: audit 2020-11-16T21:58:15.272187+0000 mon.c (mon.2) 7 : audit [INF] from='client.? v1:172.21.15.57:0/3590794692' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fcb83bc5-7834-4510-8fe9-40074b8dc739"}]: dispatch 2020-11-16T21:58:16.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:15 smithi057 bash[10301]: audit 2020-11-16T21:58:15.272605+0000 mon.a (mon.0) 576 : audit [INF] from='client.34373 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fcb83bc5-7834-4510-8fe9-40074b8dc739"}]: dispatch 2020-11-16T21:58:16.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:15 smithi057 bash[10301]: audit 2020-11-16T21:58:15.280450+0000 mon.a (mon.0) 577 : audit [INF] from='client.34373 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fcb83bc5-7834-4510-8fe9-40074b8dc739"}]': finished 2020-11-16T21:58:16.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:15 smithi057 bash[10301]: cluster 2020-11-16T21:58:15.280561+0000 mon.a (mon.0) 578 : cluster [DBG] osdmap e55: 10 total, 9 up, 9 in 2020-11-16T21:58:16.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:15 smithi057 bash[10301]: audit 2020-11-16T21:58:15.282378+0000 mon.b (mon.1) 218 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2020-11-16T21:58:17.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:16 smithi016 bash[10302]: cluster 2020-11-16T21:58:15.495427+0000 mgr.x (mgr.24115) 153 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:17.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:16 smithi016 bash[10302]: audit 2020-11-16T21:58:15.960157+0000 mon.c (mon.2) 8 : audit [DBG] from='client.? v1:172.21.15.57:0/29414908' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:58:17.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:16 smithi195 bash[10218]: cluster 2020-11-16T21:58:15.495427+0000 mgr.x (mgr.24115) 153 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:17.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:16 smithi195 bash[10218]: audit 2020-11-16T21:58:15.960157+0000 mon.c (mon.2) 8 : audit [DBG] from='client.? v1:172.21.15.57:0/29414908' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:58:17.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:16 smithi057 bash[10301]: cluster 2020-11-16T21:58:15.495427+0000 mgr.x (mgr.24115) 153 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:17.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:16 smithi057 bash[10301]: audit 2020-11-16T21:58:15.960157+0000 mon.c (mon.2) 8 : audit [DBG] from='client.? v1:172.21.15.57:0/29414908' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:58:19.085 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:18 smithi016 bash[10302]: cluster 2020-11-16T21:58:17.496101+0000 mgr.x (mgr.24115) 154 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:19.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:18 smithi195 bash[10218]: cluster 2020-11-16T21:58:17.496101+0000 mgr.x (mgr.24115) 154 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:19.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:18 smithi057 bash[10301]: cluster 2020-11-16T21:58:17.496101+0000 mgr.x (mgr.24115) 154 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:20.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:19 smithi016 bash[10302]: audit 2020-11-16T21:58:19.100073+0000 mon.b (mon.1) 219 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:20.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:19 smithi195 bash[10218]: audit 2020-11-16T21:58:19.100073+0000 mon.b (mon.1) 219 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:20.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:19 smithi057 bash[10301]: audit 2020-11-16T21:58:19.100073+0000 mon.b (mon.1) 219 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:20.809 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:20 smithi057 bash[10301]: cluster 2020-11-16T21:58:19.496648+0000 mgr.x (mgr.24115) 155 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:21.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:20 smithi016 bash[10302]: cluster 2020-11-16T21:58:19.496648+0000 mgr.x (mgr.24115) 155 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:21.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:20 smithi195 bash[10218]: cluster 2020-11-16T21:58:19.496648+0000 mgr.x (mgr.24115) 155 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:23.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:22 smithi016 bash[10302]: cluster 2020-11-16T21:58:21.497324+0000 mgr.x (mgr.24115) 156 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:23.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:22 smithi195 bash[10218]: cluster 2020-11-16T21:58:21.497324+0000 mgr.x (mgr.24115) 156 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:23.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:22 smithi057 bash[10301]: cluster 2020-11-16T21:58:21.497324+0000 mgr.x (mgr.24115) 156 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:24.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:23 smithi016 bash[10302]: audit 2020-11-16T21:58:23.490477+0000 mon.b (mon.1) 220 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2020-11-16T21:58:24.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:23 smithi016 bash[10302]: audit 2020-11-16T21:58:23.491959+0000 mon.b (mon.1) 221 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:58:24.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:23 smithi016 bash[10302]: audit 2020-11-16T21:58:23.493803+0000 mon.b (mon.1) 222 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.9", "key": "container_image"}]: dispatch 2020-11-16T21:58:24.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:23 smithi195 bash[10218]: audit 2020-11-16T21:58:23.490477+0000 mon.b (mon.1) 220 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2020-11-16T21:58:24.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:23 smithi195 bash[10218]: audit 2020-11-16T21:58:23.491959+0000 mon.b (mon.1) 221 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:58:24.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:23 smithi195 bash[10218]: audit 2020-11-16T21:58:23.493803+0000 mon.b (mon.1) 222 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.9", "key": "container_image"}]: dispatch 2020-11-16T21:58:24.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:23 smithi057 bash[10301]: audit 2020-11-16T21:58:23.490477+0000 mon.b (mon.1) 220 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2020-11-16T21:58:24.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:23 smithi057 bash[10301]: audit 2020-11-16T21:58:23.491959+0000 mon.b (mon.1) 221 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:58:24.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:23 smithi057 bash[10301]: audit 2020-11-16T21:58:23.493803+0000 mon.b (mon.1) 222 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.9", "key": "container_image"}]: dispatch 2020-11-16T21:58:24.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:24 smithi057 bash[10301]: cephadm 2020-11-16T21:58:23.493209+0000 mgr.x (mgr.24115) 157 : cephadm [INF] Deploying daemon osd.9 on smithi057 2020-11-16T21:58:25.004 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:24 smithi057 bash[10301]: cluster 2020-11-16T21:58:23.497804+0000 mgr.x (mgr.24115) 158 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:25.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:24 smithi016 bash[10302]: cephadm 2020-11-16T21:58:23.493209+0000 mgr.x (mgr.24115) 157 : cephadm [INF] Deploying daemon osd.9 on smithi057 2020-11-16T21:58:25.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:24 smithi016 bash[10302]: cluster 2020-11-16T21:58:23.497804+0000 mgr.x (mgr.24115) 158 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:25.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:24 smithi195 bash[10218]: cephadm 2020-11-16T21:58:23.493209+0000 mgr.x (mgr.24115) 157 : cephadm [INF] Deploying daemon osd.9 on smithi057 2020-11-16T21:58:25.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:24 smithi195 bash[10218]: cluster 2020-11-16T21:58:23.497804+0000 mgr.x (mgr.24115) 158 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:25.912 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 9 on host 'smithi057' 2020-11-16T21:58:27.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:26 smithi016 bash[10302]: cluster 2020-11-16T21:58:25.498379+0000 mgr.x (mgr.24115) 159 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:27.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:26 smithi016 bash[10302]: audit 2020-11-16T21:58:25.912482+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:27.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:26 smithi016 bash[10302]: audit 2020-11-16T21:58:25.912686+0000 mon.b (mon.1) 223 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:27.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:26 smithi016 bash[10302]: audit 2020-11-16T21:58:25.913727+0000 mon.b (mon.1) 224 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:58:27.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:26 smithi016 bash[10302]: audit 2020-11-16T21:58:25.917602+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:27.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:26 smithi016 bash[10302]: audit 2020-11-16T21:58:26.647896+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:27.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:26 smithi016 bash[10302]: audit 2020-11-16T21:58:26.648059+0000 mon.b (mon.1) 225 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:27.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:26 smithi016 bash[10302]: audit 2020-11-16T21:58:26.653487+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:27.089 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:26 smithi016 bash[10302]: audit 2020-11-16T21:58:26.657411+0000 mon.b (mon.1) 226 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:27.101 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:26 smithi195 bash[10218]: cluster 2020-11-16T21:58:25.498379+0000 mgr.x (mgr.24115) 159 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:27.101 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:26 smithi195 bash[10218]: audit 2020-11-16T21:58:25.912482+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:27.101 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:26 smithi195 bash[10218]: audit 2020-11-16T21:58:25.912686+0000 mon.b (mon.1) 223 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:27.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:26 smithi195 bash[10218]: audit 2020-11-16T21:58:25.913727+0000 mon.b (mon.1) 224 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:58:27.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:26 smithi195 bash[10218]: audit 2020-11-16T21:58:25.917602+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:27.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:26 smithi195 bash[10218]: audit 2020-11-16T21:58:26.647896+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:27.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:26 smithi195 bash[10218]: audit 2020-11-16T21:58:26.648059+0000 mon.b (mon.1) 225 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:27.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:26 smithi195 bash[10218]: audit 2020-11-16T21:58:26.653487+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:27.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:26 smithi195 bash[10218]: audit 2020-11-16T21:58:26.657411+0000 mon.b (mon.1) 226 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:27.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:26 smithi057 bash[10301]: cluster 2020-11-16T21:58:25.498379+0000 mgr.x (mgr.24115) 159 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:27.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:26 smithi057 bash[10301]: audit 2020-11-16T21:58:25.912482+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:27.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:26 smithi057 bash[10301]: audit 2020-11-16T21:58:25.912686+0000 mon.b (mon.1) 223 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:27.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:26 smithi057 bash[10301]: audit 2020-11-16T21:58:25.913727+0000 mon.b (mon.1) 224 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:58:27.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:26 smithi057 bash[10301]: audit 2020-11-16T21:58:25.917602+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983318\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:59.983523\", \"created\": \"2020-11-16T21:57:59.192190\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_device_update\": \"2020-11-16T21:58:08.053406\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:27.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:26 smithi057 bash[10301]: audit 2020-11-16T21:58:26.647896+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:27.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:26 smithi057 bash[10301]: audit 2020-11-16T21:58:26.648059+0000 mon.b (mon.1) 225 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:27.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:26 smithi057 bash[10301]: audit 2020-11-16T21:58:26.653487+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:27.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:26 smithi057 bash[10301]: audit 2020-11-16T21:58:26.657411+0000 mon.b (mon.1) 226 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:27.486 INFO:teuthology.orchestra.run.smithi057:osd.9> sudo journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.9.service 2020-11-16T21:58:27.489 INFO:tasks.cephadm:Deploying osd.10 on smithi057 with /dev/vg_nvme/lv_2... 2020-11-16T21:58:27.489 INFO:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2020-11-16T21:58:27.548 INFO:journalctl@ceph.osd.9.smithi057.stdout:-- Logs begin at Sun 2020-11-15 12:21:41 UTC. -- 2020-11-16T21:58:29.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:28 smithi016 bash[10302]: cluster 2020-11-16T21:58:27.499093+0000 mgr.x (mgr.24115) 160 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:29.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:28 smithi195 bash[10218]: cluster 2020-11-16T21:58:27.499093+0000 mgr.x (mgr.24115) 160 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:29.202 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:28 smithi057 bash[10301]: cluster 2020-11-16T21:58:27.499093+0000 mgr.x (mgr.24115) 160 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:29.202 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 21:58:28 smithi057 bash[14912]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2020-11-16T21:58:29.202 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 21:58:28 smithi057 bash[14912]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-9 --no-mon-config 2020-11-16T21:58:29.202 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 21:58:28 smithi057 bash[14912]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9/block 2020-11-16T21:58:29.202 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 21:58:28 smithi057 bash[14912]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-9/block 2020-11-16T21:58:29.203 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 21:58:28 smithi057 bash[14912]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2020-11-16T21:58:29.203 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 21:58:28 smithi057 bash[14912]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2020-11-16T21:58:29.203 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 21:58:28 smithi057 bash[14912]: --> ceph-volume lvm activate successful for osd ID: 9 2020-11-16T21:58:30.446 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 21:58:30 smithi057 bash[14912]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.9 2020-11-16T21:58:30.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:30 smithi016 bash[10302]: cluster 2020-11-16T21:58:29.499770+0000 mgr.x (mgr.24115) 161 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:30.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:30 smithi016 bash[10302]: audit 2020-11-16T21:58:29.703950+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:58:30.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:30 smithi016 bash[10302]: audit 2020-11-16T21:58:29.704635+0000 mon.b (mon.1) 227 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:58:30.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:30 smithi016 bash[10302]: audit 2020-11-16T21:58:29.708521+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:58:30.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:30 smithi016 bash[10302]: audit 2020-11-16T21:58:29.709122+0000 mon.b (mon.1) 228 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:58:30.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:30 smithi016 bash[10302]: audit 2020-11-16T21:58:29.709634+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:58:30.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:30 smithi016 bash[10302]: audit 2020-11-16T21:58:29.709697+0000 mon.b (mon.1) 229 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:58:30.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:30 smithi016 bash[10302]: audit 2020-11-16T21:58:29.714074+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-11-16T21:58:30.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:30 smithi195 bash[10218]: cluster 2020-11-16T21:58:29.499770+0000 mgr.x (mgr.24115) 161 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:30.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:30 smithi195 bash[10218]: audit 2020-11-16T21:58:29.703950+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:58:30.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:30 smithi195 bash[10218]: audit 2020-11-16T21:58:29.704635+0000 mon.b (mon.1) 227 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:58:30.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:30 smithi195 bash[10218]: audit 2020-11-16T21:58:29.708521+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:58:30.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:30 smithi195 bash[10218]: audit 2020-11-16T21:58:29.709122+0000 mon.b (mon.1) 228 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:58:30.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:30 smithi195 bash[10218]: audit 2020-11-16T21:58:29.709634+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:58:30.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:30 smithi195 bash[10218]: audit 2020-11-16T21:58:29.709697+0000 mon.b (mon.1) 229 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:58:30.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:30 smithi195 bash[10218]: audit 2020-11-16T21:58:29.714074+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-11-16T21:58:30.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:30 smithi057 bash[10301]: cluster 2020-11-16T21:58:29.499770+0000 mgr.x (mgr.24115) 161 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:30.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:30 smithi057 bash[10301]: audit 2020-11-16T21:58:29.703950+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:58:30.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:30 smithi057 bash[10301]: audit 2020-11-16T21:58:29.704635+0000 mon.b (mon.1) 227 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:58:30.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:30 smithi057 bash[10301]: audit 2020-11-16T21:58:29.708521+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:58:30.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:30 smithi057 bash[10301]: audit 2020-11-16T21:58:29.709122+0000 mon.b (mon.1) 228 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:58:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:30 smithi057 bash[10301]: audit 2020-11-16T21:58:29.709634+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:58:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:30 smithi057 bash[10301]: audit 2020-11-16T21:58:29.709697+0000 mon.b (mon.1) 229 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:58:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:30 smithi057 bash[10301]: audit 2020-11-16T21:58:29.714074+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-11-16T21:58:32.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:32 smithi057 bash[10301]: cluster 2020-11-16T21:58:31.500452+0000 mgr.x (mgr.24115) 162 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:32.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:32 smithi016 bash[10302]: cluster 2020-11-16T21:58:31.500452+0000 mgr.x (mgr.24115) 162 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:32.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:32 smithi195 bash[10218]: cluster 2020-11-16T21:58:31.500452+0000 mgr.x (mgr.24115) 162 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:33.073 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_2 2020-11-16T21:58:33.074 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2020-11-16T21:58:33.074 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2020-11-16T21:58:33.074 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2020-11-16T21:58:33.074 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.019513 s, 537 MB/s 2020-11-16T21:58:33.074 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2020-11-16T21:58:33.164 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 21:58:32 smithi057 bash[14912]: debug 2020-11-16T21:58:32.738+0000 7faa96e0af40 -1 Falling back to public interface 2020-11-16T21:58:33.446 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 21:58:33 smithi057 bash[14912]: debug 2020-11-16T21:58:33.398+0000 7faa96e0af40 -1 osd.9 0 log_to_monitors {default=true} 2020-11-16T21:58:33.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:33 smithi016 bash[10302]: audit 2020-11-16T21:58:33.413262+0000 mon.a (mon.0) 587 : audit [INF] from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2020-11-16T21:58:33.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:33 smithi016 bash[10302]: audit 2020-11-16T21:58:33.414535+0000 mon.c (mon.2) 9 : audit [INF] from='osd.9 v1:172.21.15.57:6804/1543210377' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2020-11-16T21:58:33.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:33 smithi195 bash[10218]: audit 2020-11-16T21:58:33.413262+0000 mon.a (mon.0) 587 : audit [INF] from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2020-11-16T21:58:33.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:33 smithi195 bash[10218]: audit 2020-11-16T21:58:33.414535+0000 mon.c (mon.2) 9 : audit [INF] from='osd.9 v1:172.21.15.57:6804/1543210377' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2020-11-16T21:58:33.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:33 smithi057 bash[10301]: audit 2020-11-16T21:58:33.413262+0000 mon.a (mon.0) 587 : audit [INF] from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2020-11-16T21:58:33.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:33 smithi057 bash[10301]: audit 2020-11-16T21:58:33.414535+0000 mon.c (mon.2) 9 : audit [INF] from='osd.9 v1:172.21.15.57:6804/1543210377' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2020-11-16T21:58:33.961 INFO:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch daemon add osd smithi057:vg_nvme/lv_2 2020-11-16T21:58:34.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:34 smithi016 bash[10302]: cluster 2020-11-16T21:58:33.501038+0000 mgr.x (mgr.24115) 163 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:34.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:34 smithi016 bash[10302]: audit 2020-11-16T21:58:33.570366+0000 mon.a (mon.0) 588 : audit [INF] from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2020-11-16T21:58:34.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:34 smithi016 bash[10302]: cluster 2020-11-16T21:58:33.570445+0000 mon.a (mon.0) 589 : cluster [DBG] osdmap e56: 10 total, 9 up, 9 in 2020-11-16T21:58:34.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:34 smithi016 bash[10302]: audit 2020-11-16T21:58:33.572845+0000 mon.a (mon.0) 590 : audit [INF] from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:58:34.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:34 smithi016 bash[10302]: audit 2020-11-16T21:58:33.573628+0000 mon.b (mon.1) 230 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2020-11-16T21:58:34.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:34 smithi016 bash[10302]: audit 2020-11-16T21:58:33.573966+0000 mon.c (mon.2) 10 : audit [INF] from='osd.9 v1:172.21.15.57:6804/1543210377' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:58:34.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:34 smithi195 bash[10218]: cluster 2020-11-16T21:58:33.501038+0000 mgr.x (mgr.24115) 163 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:34.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:34 smithi195 bash[10218]: audit 2020-11-16T21:58:33.570366+0000 mon.a (mon.0) 588 : audit [INF] from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2020-11-16T21:58:34.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:34 smithi195 bash[10218]: cluster 2020-11-16T21:58:33.570445+0000 mon.a (mon.0) 589 : cluster [DBG] osdmap e56: 10 total, 9 up, 9 in 2020-11-16T21:58:34.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:34 smithi195 bash[10218]: audit 2020-11-16T21:58:33.572845+0000 mon.a (mon.0) 590 : audit [INF] from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:58:34.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:34 smithi195 bash[10218]: audit 2020-11-16T21:58:33.573628+0000 mon.b (mon.1) 230 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2020-11-16T21:58:34.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:34 smithi195 bash[10218]: audit 2020-11-16T21:58:33.573966+0000 mon.c (mon.2) 10 : audit [INF] from='osd.9 v1:172.21.15.57:6804/1543210377' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:58:34.946 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 21:58:34 smithi057 bash[14912]: debug 2020-11-16T21:58:34.582+0000 7faa8eb89700 -1 osd.9 0 waiting for initial osdmap 2020-11-16T21:58:34.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:34 smithi057 bash[10301]: cluster 2020-11-16T21:58:33.501038+0000 mgr.x (mgr.24115) 163 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 47 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:34.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:34 smithi057 bash[10301]: audit 2020-11-16T21:58:33.570366+0000 mon.a (mon.0) 588 : audit [INF] from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2020-11-16T21:58:34.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:34 smithi057 bash[10301]: cluster 2020-11-16T21:58:33.570445+0000 mon.a (mon.0) 589 : cluster [DBG] osdmap e56: 10 total, 9 up, 9 in 2020-11-16T21:58:34.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:34 smithi057 bash[10301]: audit 2020-11-16T21:58:33.572845+0000 mon.a (mon.0) 590 : audit [INF] from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:58:34.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:34 smithi057 bash[10301]: audit 2020-11-16T21:58:33.573628+0000 mon.b (mon.1) 230 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2020-11-16T21:58:34.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:34 smithi057 bash[10301]: audit 2020-11-16T21:58:33.573966+0000 mon.c (mon.2) 10 : audit [INF] from='osd.9 v1:172.21.15.57:6804/1543210377' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:58:35.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:35 smithi016 bash[10302]: audit 2020-11-16T21:58:34.573422+0000 mon.a (mon.0) 591 : audit [INF] from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2020-11-16T21:58:35.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:35 smithi016 bash[10302]: cluster 2020-11-16T21:58:34.573514+0000 mon.a (mon.0) 592 : cluster [DBG] osdmap e57: 10 total, 9 up, 9 in 2020-11-16T21:58:35.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:35 smithi016 bash[10302]: audit 2020-11-16T21:58:34.576352+0000 mon.b (mon.1) 231 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2020-11-16T21:58:35.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:35 smithi016 bash[10302]: audit 2020-11-16T21:58:34.586220+0000 mon.b (mon.1) 232 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2020-11-16T21:58:35.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:35 smithi016 bash[10302]: audit 2020-11-16T21:58:34.633614+0000 mon.b (mon.1) 233 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:58:35.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:35 smithi016 bash[10302]: audit 2020-11-16T21:58:34.941369+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:35.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:35 smithi016 bash[10302]: audit 2020-11-16T21:58:34.942131+0000 mon.b (mon.1) 234 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:35.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:35 smithi016 bash[10302]: audit 2020-11-16T21:58:34.947028+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:35.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:35 smithi016 bash[10302]: audit 2020-11-16T21:58:34.951050+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:35.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:35 smithi016 bash[10302]: audit 2020-11-16T21:58:34.952113+0000 mon.b (mon.1) 235 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:35.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:35 smithi016 bash[10302]: audit 2020-11-16T21:58:34.956070+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:58:35.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:35 smithi016 bash[10302]: audit 2020-11-16T21:58:34.963533+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:35.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:35 smithi016 bash[10302]: audit 2020-11-16T21:58:34.964577+0000 mon.b (mon.1) 236 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:35.840 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:35 smithi016 bash[10302]: audit 2020-11-16T21:58:34.968753+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:58:35.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:35 smithi195 bash[10218]: audit 2020-11-16T21:58:34.573422+0000 mon.a (mon.0) 591 : audit [INF] from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2020-11-16T21:58:35.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:35 smithi195 bash[10218]: cluster 2020-11-16T21:58:34.573514+0000 mon.a (mon.0) 592 : cluster [DBG] osdmap e57: 10 total, 9 up, 9 in 2020-11-16T21:58:35.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:35 smithi195 bash[10218]: audit 2020-11-16T21:58:34.576352+0000 mon.b (mon.1) 231 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2020-11-16T21:58:35.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:35 smithi195 bash[10218]: audit 2020-11-16T21:58:34.586220+0000 mon.b (mon.1) 232 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2020-11-16T21:58:35.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:35 smithi195 bash[10218]: audit 2020-11-16T21:58:34.633614+0000 mon.b (mon.1) 233 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:58:35.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:35 smithi195 bash[10218]: audit 2020-11-16T21:58:34.941369+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:35.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:35 smithi195 bash[10218]: audit 2020-11-16T21:58:34.942131+0000 mon.b (mon.1) 234 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:35.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:35 smithi195 bash[10218]: audit 2020-11-16T21:58:34.947028+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:35.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:35 smithi195 bash[10218]: audit 2020-11-16T21:58:34.951050+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:35.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:35 smithi195 bash[10218]: audit 2020-11-16T21:58:34.952113+0000 mon.b (mon.1) 235 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:35.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:35 smithi195 bash[10218]: audit 2020-11-16T21:58:34.956070+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:58:35.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:35 smithi195 bash[10218]: audit 2020-11-16T21:58:34.963533+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:35.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:35 smithi195 bash[10218]: audit 2020-11-16T21:58:34.964577+0000 mon.b (mon.1) 236 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:35.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:35 smithi195 bash[10218]: audit 2020-11-16T21:58:34.968753+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:58:35.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:35 smithi057 bash[10301]: audit 2020-11-16T21:58:34.573422+0000 mon.a (mon.0) 591 : audit [INF] from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2020-11-16T21:58:35.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:35 smithi057 bash[10301]: cluster 2020-11-16T21:58:34.573514+0000 mon.a (mon.0) 592 : cluster [DBG] osdmap e57: 10 total, 9 up, 9 in 2020-11-16T21:58:35.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:35 smithi057 bash[10301]: audit 2020-11-16T21:58:34.576352+0000 mon.b (mon.1) 231 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2020-11-16T21:58:35.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:35 smithi057 bash[10301]: audit 2020-11-16T21:58:34.586220+0000 mon.b (mon.1) 232 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2020-11-16T21:58:35.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:35 smithi057 bash[10301]: audit 2020-11-16T21:58:34.633614+0000 mon.b (mon.1) 233 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:58:35.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:35 smithi057 bash[10301]: audit 2020-11-16T21:58:34.941369+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:35.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:35 smithi057 bash[10301]: audit 2020-11-16T21:58:34.942131+0000 mon.b (mon.1) 234 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:35.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:35 smithi057 bash[10301]: audit 2020-11-16T21:58:34.947028+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}}, \"last_daemon_update\": \"2020-11-16T21:58:26.646866\", \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:35.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:35 smithi057 bash[10301]: audit 2020-11-16T21:58:34.951050+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:35.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:35 smithi057 bash[10301]: audit 2020-11-16T21:58:34.952113+0000 mon.b (mon.1) 235 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:35.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:35 smithi057 bash[10301]: audit 2020-11-16T21:58:34.956070+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:58:35.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:35 smithi057 bash[10301]: audit 2020-11-16T21:58:34.963533+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:35.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:35 smithi057 bash[10301]: audit 2020-11-16T21:58:34.964577+0000 mon.b (mon.1) 236 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:58:35.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:35 smithi057 bash[10301]: audit 2020-11-16T21:58:34.968753+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:58:36.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:36 smithi016 bash[10302]: cluster 2020-11-16T21:58:34.395836+0000 osd.9 (osd.9) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:58:36.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:36 smithi016 bash[10302]: cluster 2020-11-16T21:58:34.395971+0000 osd.9 (osd.9) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:58:36.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:36 smithi016 bash[10302]: cluster 2020-11-16T21:58:35.501693+0000 mgr.x (mgr.24115) 164 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 48 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:36.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:36 smithi016 bash[10302]: cluster 2020-11-16T21:58:35.584159+0000 mon.a (mon.0) 599 : cluster [INF] osd.9 v1:172.21.15.57:6804/1543210377 boot 2020-11-16T21:58:36.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:36 smithi016 bash[10302]: cluster 2020-11-16T21:58:35.584250+0000 mon.a (mon.0) 600 : cluster [DBG] osdmap e58: 10 total, 10 up, 10 in 2020-11-16T21:58:36.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:36 smithi016 bash[10302]: audit 2020-11-16T21:58:35.588693+0000 mon.b (mon.1) 237 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2020-11-16T21:58:36.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:36 smithi195 bash[10218]: cluster 2020-11-16T21:58:34.395836+0000 osd.9 (osd.9) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:58:36.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:36 smithi195 bash[10218]: cluster 2020-11-16T21:58:34.395971+0000 osd.9 (osd.9) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:58:36.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:36 smithi195 bash[10218]: cluster 2020-11-16T21:58:35.501693+0000 mgr.x (mgr.24115) 164 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 48 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:36.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:36 smithi195 bash[10218]: cluster 2020-11-16T21:58:35.584159+0000 mon.a (mon.0) 599 : cluster [INF] osd.9 v1:172.21.15.57:6804/1543210377 boot 2020-11-16T21:58:36.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:36 smithi195 bash[10218]: cluster 2020-11-16T21:58:35.584250+0000 mon.a (mon.0) 600 : cluster [DBG] osdmap e58: 10 total, 10 up, 10 in 2020-11-16T21:58:36.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:36 smithi195 bash[10218]: audit 2020-11-16T21:58:35.588693+0000 mon.b (mon.1) 237 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2020-11-16T21:58:36.910 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:36 smithi057 bash[10301]: cluster 2020-11-16T21:58:34.395836+0000 osd.9 (osd.9) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:58:36.911 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:36 smithi057 bash[10301]: cluster 2020-11-16T21:58:34.395971+0000 osd.9 (osd.9) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:58:36.911 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:36 smithi057 bash[10301]: cluster 2020-11-16T21:58:35.501693+0000 mgr.x (mgr.24115) 164 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 48 MiB used, 805 GiB / 805 GiB avail 2020-11-16T21:58:36.911 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:36 smithi057 bash[10301]: cluster 2020-11-16T21:58:35.584159+0000 mon.a (mon.0) 599 : cluster [INF] osd.9 v1:172.21.15.57:6804/1543210377 boot 2020-11-16T21:58:36.911 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:36 smithi057 bash[10301]: cluster 2020-11-16T21:58:35.584250+0000 mon.a (mon.0) 600 : cluster [DBG] osdmap e58: 10 total, 10 up, 10 in 2020-11-16T21:58:36.911 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:36 smithi057 bash[10301]: audit 2020-11-16T21:58:35.588693+0000 mon.b (mon.1) 237 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2020-11-16T21:58:38.336 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:37 smithi016 bash[10302]: cluster 2020-11-16T21:58:36.974012+0000 mon.a (mon.0) 601 : cluster [DBG] osdmap e59: 10 total, 10 up, 10 in 2020-11-16T21:58:38.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:37 smithi016 bash[10302]: audit 2020-11-16T21:58:37.424391+0000 mon.b (mon.1) 238 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:58:38.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:37 smithi016 bash[10302]: audit 2020-11-16T21:58:37.428008+0000 mon.b (mon.1) 239 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:58:38.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:37 smithi016 bash[10302]: audit 2020-11-16T21:58:37.429516+0000 mon.b (mon.1) 240 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:58:38.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:37 smithi016 bash[10302]: audit 2020-11-16T21:58:37.430660+0000 mon.b (mon.1) 241 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:38.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:37 smithi195 bash[10218]: cluster 2020-11-16T21:58:36.974012+0000 mon.a (mon.0) 601 : cluster [DBG] osdmap e59: 10 total, 10 up, 10 in 2020-11-16T21:58:38.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:37 smithi195 bash[10218]: audit 2020-11-16T21:58:37.424391+0000 mon.b (mon.1) 238 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:58:38.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:37 smithi195 bash[10218]: audit 2020-11-16T21:58:37.428008+0000 mon.b (mon.1) 239 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:58:38.352 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:37 smithi195 bash[10218]: audit 2020-11-16T21:58:37.429516+0000 mon.b (mon.1) 240 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:58:38.352 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:37 smithi195 bash[10218]: audit 2020-11-16T21:58:37.430660+0000 mon.b (mon.1) 241 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:38.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:37 smithi057 bash[10301]: cluster 2020-11-16T21:58:36.974012+0000 mon.a (mon.0) 601 : cluster [DBG] osdmap e59: 10 total, 10 up, 10 in 2020-11-16T21:58:38.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:37 smithi057 bash[10301]: audit 2020-11-16T21:58:37.424391+0000 mon.b (mon.1) 238 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:58:38.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:37 smithi057 bash[10301]: audit 2020-11-16T21:58:37.428008+0000 mon.b (mon.1) 239 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:58:38.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:37 smithi057 bash[10301]: audit 2020-11-16T21:58:37.429516+0000 mon.b (mon.1) 240 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:58:38.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:37 smithi057 bash[10301]: audit 2020-11-16T21:58:37.430660+0000 mon.b (mon.1) 241 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:39.063 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:38 smithi057 bash[10301]: audit 2020-11-16T21:58:37.422503+0000 mgr.x (mgr.24115) 165 : audit [DBG] from='client.34394 v1:172.21.15.57:0/918450160' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:58:39.063 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:38 smithi057 bash[10301]: cephadm 2020-11-16T21:58:37.425798+0000 mgr.x (mgr.24115) 166 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:58:39.063 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:38 smithi057 bash[10301]: cephadm 2020-11-16T21:58:37.425982+0000 mgr.x (mgr.24115) 167 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:58:39.064 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:38 smithi057 bash[10301]: cephadm 2020-11-16T21:58:37.427115+0000 mgr.x (mgr.24115) 168 : cephadm [INF] Applying None on host smithi057... 2020-11-16T21:58:39.064 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:38 smithi057 bash[10301]: cluster 2020-11-16T21:58:37.502225+0000 mgr.x (mgr.24115) 169 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:39.336 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:38 smithi016 bash[10302]: audit 2020-11-16T21:58:37.422503+0000 mgr.x (mgr.24115) 165 : audit [DBG] from='client.34394 v1:172.21.15.57:0/918450160' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:58:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:38 smithi016 bash[10302]: cephadm 2020-11-16T21:58:37.425798+0000 mgr.x (mgr.24115) 166 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:58:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:38 smithi016 bash[10302]: cephadm 2020-11-16T21:58:37.425982+0000 mgr.x (mgr.24115) 167 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:58:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:38 smithi016 bash[10302]: cephadm 2020-11-16T21:58:37.427115+0000 mgr.x (mgr.24115) 168 : cephadm [INF] Applying None on host smithi057... 2020-11-16T21:58:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:38 smithi016 bash[10302]: cluster 2020-11-16T21:58:37.502225+0000 mgr.x (mgr.24115) 169 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:39.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:38 smithi195 bash[10218]: audit 2020-11-16T21:58:37.422503+0000 mgr.x (mgr.24115) 165 : audit [DBG] from='client.34394 v1:172.21.15.57:0/918450160' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:58:39.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:38 smithi195 bash[10218]: cephadm 2020-11-16T21:58:37.425798+0000 mgr.x (mgr.24115) 166 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:58:39.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:38 smithi195 bash[10218]: cephadm 2020-11-16T21:58:37.425982+0000 mgr.x (mgr.24115) 167 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:58:39.352 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:38 smithi195 bash[10218]: cephadm 2020-11-16T21:58:37.427115+0000 mgr.x (mgr.24115) 168 : cephadm [INF] Applying None on host smithi057... 2020-11-16T21:58:39.352 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:38 smithi195 bash[10218]: cluster 2020-11-16T21:58:37.502225+0000 mgr.x (mgr.24115) 169 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:40.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:40 smithi016 bash[10302]: cluster 2020-11-16T21:58:39.502821+0000 mgr.x (mgr.24115) 170 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:40.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:40 smithi195 bash[10218]: cluster 2020-11-16T21:58:39.502821+0000 mgr.x (mgr.24115) 170 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:40.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:40 smithi057 bash[10301]: cluster 2020-11-16T21:58:39.502821+0000 mgr.x (mgr.24115) 170 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:41.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:41 smithi016 bash[10302]: audit 2020-11-16T21:58:41.466335+0000 mon.a (mon.0) 602 : audit [INF] from='client.34400 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f96ec9f0-97cf-4382-a66a-eddbe351df6f"}]: dispatch 2020-11-16T21:58:41.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:41 smithi016 bash[10302]: audit 2020-11-16T21:58:41.468045+0000 mon.c (mon.2) 11 : audit [INF] from='client.? v1:172.21.15.57:0/3372754678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f96ec9f0-97cf-4382-a66a-eddbe351df6f"}]: dispatch 2020-11-16T21:58:41.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:41 smithi016 bash[10302]: audit 2020-11-16T21:58:41.474288+0000 mon.a (mon.0) 603 : audit [INF] from='client.34400 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f96ec9f0-97cf-4382-a66a-eddbe351df6f"}]': finished 2020-11-16T21:58:41.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:41 smithi016 bash[10302]: cluster 2020-11-16T21:58:41.474378+0000 mon.a (mon.0) 604 : cluster [DBG] osdmap e60: 11 total, 10 up, 10 in 2020-11-16T21:58:41.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:41 smithi016 bash[10302]: audit 2020-11-16T21:58:41.477661+0000 mon.b (mon.1) 242 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2020-11-16T21:58:41.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:41 smithi195 bash[10218]: audit 2020-11-16T21:58:41.466335+0000 mon.a (mon.0) 602 : audit [INF] from='client.34400 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f96ec9f0-97cf-4382-a66a-eddbe351df6f"}]: dispatch 2020-11-16T21:58:41.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:41 smithi195 bash[10218]: audit 2020-11-16T21:58:41.468045+0000 mon.c (mon.2) 11 : audit [INF] from='client.? v1:172.21.15.57:0/3372754678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f96ec9f0-97cf-4382-a66a-eddbe351df6f"}]: dispatch 2020-11-16T21:58:41.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:41 smithi195 bash[10218]: audit 2020-11-16T21:58:41.474288+0000 mon.a (mon.0) 603 : audit [INF] from='client.34400 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f96ec9f0-97cf-4382-a66a-eddbe351df6f"}]': finished 2020-11-16T21:58:41.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:41 smithi195 bash[10218]: cluster 2020-11-16T21:58:41.474378+0000 mon.a (mon.0) 604 : cluster [DBG] osdmap e60: 11 total, 10 up, 10 in 2020-11-16T21:58:41.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:41 smithi195 bash[10218]: audit 2020-11-16T21:58:41.477661+0000 mon.b (mon.1) 242 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2020-11-16T21:58:41.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:41 smithi057 bash[10301]: audit 2020-11-16T21:58:41.466335+0000 mon.a (mon.0) 602 : audit [INF] from='client.34400 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f96ec9f0-97cf-4382-a66a-eddbe351df6f"}]: dispatch 2020-11-16T21:58:41.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:41 smithi057 bash[10301]: audit 2020-11-16T21:58:41.468045+0000 mon.c (mon.2) 11 : audit [INF] from='client.? v1:172.21.15.57:0/3372754678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f96ec9f0-97cf-4382-a66a-eddbe351df6f"}]: dispatch 2020-11-16T21:58:41.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:41 smithi057 bash[10301]: audit 2020-11-16T21:58:41.474288+0000 mon.a (mon.0) 603 : audit [INF] from='client.34400 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f96ec9f0-97cf-4382-a66a-eddbe351df6f"}]': finished 2020-11-16T21:58:41.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:41 smithi057 bash[10301]: cluster 2020-11-16T21:58:41.474378+0000 mon.a (mon.0) 604 : cluster [DBG] osdmap e60: 11 total, 10 up, 10 in 2020-11-16T21:58:41.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:41 smithi057 bash[10301]: audit 2020-11-16T21:58:41.477661+0000 mon.b (mon.1) 242 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2020-11-16T21:58:42.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:42 smithi016 bash[10302]: cluster 2020-11-16T21:58:41.503429+0000 mgr.x (mgr.24115) 171 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:42.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:42 smithi016 bash[10302]: audit 2020-11-16T21:58:42.153211+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? v1:172.21.15.57:0/185970766' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:58:42.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:42 smithi195 bash[10218]: cluster 2020-11-16T21:58:41.503429+0000 mgr.x (mgr.24115) 171 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:42.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:42 smithi195 bash[10218]: audit 2020-11-16T21:58:42.153211+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? v1:172.21.15.57:0/185970766' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:58:42.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:42 smithi057 bash[10301]: cluster 2020-11-16T21:58:41.503429+0000 mgr.x (mgr.24115) 171 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:42.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:42 smithi057 bash[10301]: audit 2020-11-16T21:58:42.153211+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? v1:172.21.15.57:0/185970766' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:58:44.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:44 smithi016 bash[10302]: cluster 2020-11-16T21:58:43.504052+0000 mgr.x (mgr.24115) 172 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:44.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:44 smithi195 bash[10218]: cluster 2020-11-16T21:58:43.504052+0000 mgr.x (mgr.24115) 172 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:44.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:44 smithi057 bash[10301]: cluster 2020-11-16T21:58:43.504052+0000 mgr.x (mgr.24115) 172 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:45.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:45 smithi016 bash[10302]: audit 2020-11-16T21:58:45.301375+0000 mon.b (mon.1) 243 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:45.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:45 smithi195 bash[10218]: audit 2020-11-16T21:58:45.301375+0000 mon.b (mon.1) 243 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:45.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:45 smithi057 bash[10301]: audit 2020-11-16T21:58:45.301375+0000 mon.b (mon.1) 243 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:46.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:46 smithi057 bash[10301]: cluster 2020-11-16T21:58:45.504751+0000 mgr.x (mgr.24115) 173 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:46.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:46 smithi016 bash[10302]: cluster 2020-11-16T21:58:45.504751+0000 mgr.x (mgr.24115) 173 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:46.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:46 smithi195 bash[10218]: cluster 2020-11-16T21:58:45.504751+0000 mgr.x (mgr.24115) 173 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:48.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:48 smithi016 bash[10302]: cluster 2020-11-16T21:58:47.505567+0000 mgr.x (mgr.24115) 174 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:48.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:48 smithi195 bash[10218]: cluster 2020-11-16T21:58:47.505567+0000 mgr.x (mgr.24115) 174 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:48.869 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:48 smithi057 bash[10301]: cluster 2020-11-16T21:58:47.505567+0000 mgr.x (mgr.24115) 174 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:50.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:50 smithi016 bash[10302]: audit 2020-11-16T21:58:49.494500+0000 mon.b (mon.1) 244 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2020-11-16T21:58:50.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:50 smithi016 bash[10302]: audit 2020-11-16T21:58:49.496165+0000 mon.b (mon.1) 245 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:58:50.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:50 smithi016 bash[10302]: cephadm 2020-11-16T21:58:49.497564+0000 mgr.x (mgr.24115) 175 : cephadm [INF] Deploying daemon osd.10 on smithi057 2020-11-16T21:58:50.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:50 smithi016 bash[10302]: audit 2020-11-16T21:58:49.498262+0000 mon.b (mon.1) 246 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.10", "key": "container_image"}]: dispatch 2020-11-16T21:58:50.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:50 smithi016 bash[10302]: cluster 2020-11-16T21:58:49.506153+0000 mgr.x (mgr.24115) 176 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:50.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:50 smithi195 bash[10218]: audit 2020-11-16T21:58:49.494500+0000 mon.b (mon.1) 244 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2020-11-16T21:58:50.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:50 smithi195 bash[10218]: audit 2020-11-16T21:58:49.496165+0000 mon.b (mon.1) 245 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:58:50.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:50 smithi195 bash[10218]: cephadm 2020-11-16T21:58:49.497564+0000 mgr.x (mgr.24115) 175 : cephadm [INF] Deploying daemon osd.10 on smithi057 2020-11-16T21:58:50.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:50 smithi195 bash[10218]: audit 2020-11-16T21:58:49.498262+0000 mon.b (mon.1) 246 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.10", "key": "container_image"}]: dispatch 2020-11-16T21:58:50.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:50 smithi195 bash[10218]: cluster 2020-11-16T21:58:49.506153+0000 mgr.x (mgr.24115) 176 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:50.865 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:50 smithi057 bash[10301]: audit 2020-11-16T21:58:49.494500+0000 mon.b (mon.1) 244 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2020-11-16T21:58:50.865 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:50 smithi057 bash[10301]: audit 2020-11-16T21:58:49.496165+0000 mon.b (mon.1) 245 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:58:50.865 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:50 smithi057 bash[10301]: cephadm 2020-11-16T21:58:49.497564+0000 mgr.x (mgr.24115) 175 : cephadm [INF] Deploying daemon osd.10 on smithi057 2020-11-16T21:58:50.865 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:50 smithi057 bash[10301]: audit 2020-11-16T21:58:49.498262+0000 mon.b (mon.1) 246 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.10", "key": "container_image"}]: dispatch 2020-11-16T21:58:50.866 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:50 smithi057 bash[10301]: cluster 2020-11-16T21:58:49.506153+0000 mgr.x (mgr.24115) 176 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:51.821 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 10 on host 'smithi057' 2020-11-16T21:58:52.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:52 smithi016 bash[10302]: cluster 2020-11-16T21:58:51.506853+0000 mgr.x (mgr.24115) 177 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:52.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:52 smithi016 bash[10302]: audit 2020-11-16T21:58:51.820675+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:52.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:52 smithi016 bash[10302]: audit 2020-11-16T21:58:51.822137+0000 mon.b (mon.1) 247 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:52.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:52 smithi016 bash[10302]: audit 2020-11-16T21:58:51.822810+0000 mon.b (mon.1) 248 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:58:52.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:52 smithi016 bash[10302]: audit 2020-11-16T21:58:51.825913+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:52.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:52 smithi195 bash[10218]: cluster 2020-11-16T21:58:51.506853+0000 mgr.x (mgr.24115) 177 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:52.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:52 smithi195 bash[10218]: audit 2020-11-16T21:58:51.820675+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:52.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:52 smithi195 bash[10218]: audit 2020-11-16T21:58:51.822137+0000 mon.b (mon.1) 247 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:52.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:52 smithi195 bash[10218]: audit 2020-11-16T21:58:51.822810+0000 mon.b (mon.1) 248 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:58:52.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:52 smithi195 bash[10218]: audit 2020-11-16T21:58:51.825913+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:52.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:52 smithi057 bash[10301]: cluster 2020-11-16T21:58:51.506853+0000 mgr.x (mgr.24115) 177 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:52.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:52 smithi057 bash[10301]: audit 2020-11-16T21:58:51.820675+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:52.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:52 smithi057 bash[10301]: audit 2020-11-16T21:58:51.822137+0000 mon.b (mon.1) 247 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:52.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:52 smithi057 bash[10301]: audit 2020-11-16T21:58:51.822810+0000 mon.b (mon.1) 248 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:58:52.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:52 smithi057 bash[10301]: audit 2020-11-16T21:58:51.825913+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645777\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.645949\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:26.646421\", \"created\": \"2020-11-16T21:58:25.883143\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_device_update\": \"2020-11-16T21:58:34.940334\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:53.266 INFO:teuthology.orchestra.run.smithi057:osd.10> sudo journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.10.service 2020-11-16T21:58:53.268 INFO:tasks.cephadm:Deploying osd.11 on smithi057 with /dev/vg_nvme/lv_1... 2020-11-16T21:58:53.268 INFO:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2020-11-16T21:58:53.317 INFO:journalctl@ceph.osd.10.smithi057.stdout:-- Logs begin at Sun 2020-11-15 12:21:41 UTC. -- 2020-11-16T21:58:53.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:53 smithi016 bash[10302]: audit 2020-11-16T21:58:52.615970+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:53.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:53 smithi016 bash[10302]: audit 2020-11-16T21:58:52.617604+0000 mon.b (mon.1) 249 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:53.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:53 smithi016 bash[10302]: audit 2020-11-16T21:58:52.621672+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:53.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:53 smithi016 bash[10302]: audit 2020-11-16T21:58:52.625657+0000 mon.b (mon.1) 250 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:53.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:53 smithi195 bash[10218]: audit 2020-11-16T21:58:52.615970+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:53.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:53 smithi195 bash[10218]: audit 2020-11-16T21:58:52.617604+0000 mon.b (mon.1) 249 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:53.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:53 smithi195 bash[10218]: audit 2020-11-16T21:58:52.621672+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:53.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:53 smithi195 bash[10218]: audit 2020-11-16T21:58:52.625657+0000 mon.b (mon.1) 250 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:53.895 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:53 smithi057 bash[10301]: audit 2020-11-16T21:58:52.615970+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:53.896 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:53 smithi057 bash[10301]: audit 2020-11-16T21:58:52.617604+0000 mon.b (mon.1) 249 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:58:53.896 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:53 smithi057 bash[10301]: audit 2020-11-16T21:58:52.621672+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:58:53.897 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:53 smithi057 bash[10301]: audit 2020-11-16T21:58:52.625657+0000 mon.b (mon.1) 250 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:58:54.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:54 smithi057 bash[10301]: cluster 2020-11-16T21:58:53.507428+0000 mgr.x (mgr.24115) 178 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:54.697 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 21:58:54 smithi057 bash[17237]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2020-11-16T21:58:54.697 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 21:58:54 smithi057 bash[17237]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-10 --no-mon-config 2020-11-16T21:58:54.698 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 21:58:54 smithi057 bash[17237]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-10/block 2020-11-16T21:58:54.698 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 21:58:54 smithi057 bash[17237]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-10/block 2020-11-16T21:58:54.698 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 21:58:54 smithi057 bash[17237]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2020-11-16T21:58:54.698 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 21:58:54 smithi057 bash[17237]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2020-11-16T21:58:54.698 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 21:58:54 smithi057 bash[17237]: --> ceph-volume lvm activate successful for osd ID: 10 2020-11-16T21:58:55.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:54 smithi016 bash[10302]: cluster 2020-11-16T21:58:53.507428+0000 mgr.x (mgr.24115) 178 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:55.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:54 smithi195 bash[10218]: cluster 2020-11-16T21:58:53.507428+0000 mgr.x (mgr.24115) 178 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:55.892 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 21:58:55 smithi057 bash[17237]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.10 2020-11-16T21:58:56.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:56 smithi057 bash[10301]: cluster 2020-11-16T21:58:55.508077+0000 mgr.x (mgr.24115) 179 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:57.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:56 smithi016 bash[10302]: cluster 2020-11-16T21:58:55.508077+0000 mgr.x (mgr.24115) 179 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:57.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:56 smithi195 bash[10218]: cluster 2020-11-16T21:58:55.508077+0000 mgr.x (mgr.24115) 179 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:57.697 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 21:58:57 smithi057 bash[17237]: debug 2020-11-16T21:58:57.506+0000 7f181552c700 10 -- 172.21.15.57:0/2448554261 dispatch_throttle_release 308 to dispatch throttler 502/104857600 2020-11-16T21:58:57.697 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 21:58:57 smithi057 bash[17237]: debug 2020-11-16T21:58:57.506+0000 7f181552c700 20 -- 172.21.15.57:0/2448554261 done calling dispatch on 0x5593bd4aec60 2020-11-16T21:58:57.697 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 21:58:57 smithi057 bash[17237]: debug 2020-11-16T21:58:57.506+0000 7f181552c700 1 -- 172.21.15.57:0/2448554261 <== mon.2 v1:172.21.15.57:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (unknown 907883521 0 0) 0x5593bd4b8340 con 0x5593bd532c00 2020-11-16T21:58:57.698 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 21:58:57 smithi057 bash[17237]: debug 2020-11-16T21:58:57.506+0000 7f181552c700 10 -- 172.21.15.57:0/2448554261 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2020-11-16T21:58:57.698 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 21:58:57 smithi057 bash[17237]: debug 2020-11-16T21:58:57.506+0000 7f181552c700 20 -- 172.21.15.57:0/2448554261 done calling dispatch on 0x5593bd4b8340 2020-11-16T21:58:58.397 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 21:58:58 smithi057 bash[17237]: debug 2020-11-16T21:58:58.054+0000 7f181cfacf40 -1 Falling back to public interface 2020-11-16T21:58:58.667 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:58 smithi057 bash[10301]: cluster 2020-11-16T21:58:57.508738+0000 mgr.x (mgr.24115) 180 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:58.947 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 21:58:58 smithi057 bash[17237]: debug 2020-11-16T21:58:58.678+0000 7f181cfacf40 -1 osd.10 0 log_to_monitors {default=true} 2020-11-16T21:58:59.058 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping: /dev/vg_nvme/lv_1 2020-11-16T21:58:59.058 INFO:teuthology.orchestra.run.smithi057.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2020-11-16T21:58:59.058 INFO:teuthology.orchestra.run.smithi057.stderr: stderr: 10+0 records in 2020-11-16T21:58:59.058 INFO:teuthology.orchestra.run.smithi057.stderr:10+0 records out 2020-11-16T21:58:59.058 INFO:teuthology.orchestra.run.smithi057.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.015567 s, 674 MB/s 2020-11-16T21:58:59.059 INFO:teuthology.orchestra.run.smithi057.stderr:--> Zapping successful for: 2020-11-16T21:58:59.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:58 smithi016 bash[10302]: cluster 2020-11-16T21:58:57.508738+0000 mgr.x (mgr.24115) 180 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:59.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:58 smithi195 bash[10218]: cluster 2020-11-16T21:58:57.508738+0000 mgr.x (mgr.24115) 180 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:58:59.915 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:59 smithi057 bash[10301]: audit 2020-11-16T21:58:59.341365+0000 mon.a (mon.0) 609 : audit [INF] from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2020-11-16T21:58:59.916 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:58:59 smithi057 bash[10301]: audit 2020-11-16T21:58:59.343402+0000 mon.c (mon.2) 13 : audit [INF] from='osd.10 v1:172.21.15.57:6808/12217522' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2020-11-16T21:58:59.917 INFO:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph orch daemon add osd smithi057:vg_nvme/lv_1 2020-11-16T21:59:00.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:59 smithi016 bash[10302]: audit 2020-11-16T21:58:59.341365+0000 mon.a (mon.0) 609 : audit [INF] from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2020-11-16T21:59:00.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:58:59 smithi016 bash[10302]: audit 2020-11-16T21:58:59.343402+0000 mon.c (mon.2) 13 : audit [INF] from='osd.10 v1:172.21.15.57:6808/12217522' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2020-11-16T21:59:00.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:59 smithi195 bash[10218]: audit 2020-11-16T21:58:59.341365+0000 mon.a (mon.0) 609 : audit [INF] from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2020-11-16T21:59:00.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:58:59 smithi195 bash[10218]: audit 2020-11-16T21:58:59.343402+0000 mon.c (mon.2) 13 : audit [INF] from='osd.10 v1:172.21.15.57:6808/12217522' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2020-11-16T21:59:00.947 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 21:59:00 smithi057 bash[17237]: debug 2020-11-16T21:59:00.657+0000 7f1813528700 -1 osd.10 0 waiting for initial osdmap 2020-11-16T21:59:00.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:00 smithi057 bash[10301]: cluster 2020-11-16T21:58:59.509304+0000 mgr.x (mgr.24115) 181 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:59:00.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:00 smithi057 bash[10301]: audit 2020-11-16T21:58:59.640086+0000 mon.a (mon.0) 610 : audit [INF] from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2020-11-16T21:59:00.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:00 smithi057 bash[10301]: cluster 2020-11-16T21:58:59.640198+0000 mon.a (mon.0) 611 : cluster [DBG] osdmap e61: 11 total, 10 up, 10 in 2020-11-16T21:59:00.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:00 smithi057 bash[10301]: audit 2020-11-16T21:58:59.644851+0000 mon.c (mon.2) 14 : audit [INF] from='osd.10 v1:172.21.15.57:6808/12217522' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:59:00.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:00 smithi057 bash[10301]: audit 2020-11-16T21:58:59.645497+0000 mon.b (mon.1) 251 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2020-11-16T21:59:00.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:00 smithi057 bash[10301]: audit 2020-11-16T21:58:59.648146+0000 mon.a (mon.0) 612 : audit [INF] from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:59:01.091 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:00 smithi016 bash[10302]: cluster 2020-11-16T21:58:59.509304+0000 mgr.x (mgr.24115) 181 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:59:01.092 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:00 smithi016 bash[10302]: audit 2020-11-16T21:58:59.640086+0000 mon.a (mon.0) 610 : audit [INF] from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2020-11-16T21:59:01.092 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:00 smithi016 bash[10302]: cluster 2020-11-16T21:58:59.640198+0000 mon.a (mon.0) 611 : cluster [DBG] osdmap e61: 11 total, 10 up, 10 in 2020-11-16T21:59:01.092 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:00 smithi016 bash[10302]: audit 2020-11-16T21:58:59.644851+0000 mon.c (mon.2) 14 : audit [INF] from='osd.10 v1:172.21.15.57:6808/12217522' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:59:01.092 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:00 smithi016 bash[10302]: audit 2020-11-16T21:58:59.645497+0000 mon.b (mon.1) 251 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2020-11-16T21:59:01.092 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:00 smithi016 bash[10302]: audit 2020-11-16T21:58:59.648146+0000 mon.a (mon.0) 612 : audit [INF] from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:59:01.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:00 smithi195 bash[10218]: cluster 2020-11-16T21:58:59.509304+0000 mgr.x (mgr.24115) 181 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 53 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:59:01.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:00 smithi195 bash[10218]: audit 2020-11-16T21:58:59.640086+0000 mon.a (mon.0) 610 : audit [INF] from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2020-11-16T21:59:01.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:00 smithi195 bash[10218]: cluster 2020-11-16T21:58:59.640198+0000 mon.a (mon.0) 611 : cluster [DBG] osdmap e61: 11 total, 10 up, 10 in 2020-11-16T21:59:01.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:00 smithi195 bash[10218]: audit 2020-11-16T21:58:59.644851+0000 mon.c (mon.2) 14 : audit [INF] from='osd.10 v1:172.21.15.57:6808/12217522' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:59:01.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:00 smithi195 bash[10218]: audit 2020-11-16T21:58:59.645497+0000 mon.b (mon.1) 251 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2020-11-16T21:59:01.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:00 smithi195 bash[10218]: audit 2020-11-16T21:58:59.648146+0000 mon.a (mon.0) 612 : audit [INF] from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:59:01.658 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:01 smithi057 bash[10301]: audit 2020-11-16T21:59:00.648207+0000 mon.b (mon.1) 252 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:59:01.658 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:01 smithi057 bash[10301]: audit 2020-11-16T21:59:00.650278+0000 mon.a (mon.0) 613 : audit [INF] from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2020-11-16T21:59:01.659 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:01 smithi057 bash[10301]: cluster 2020-11-16T21:59:00.650355+0000 mon.a (mon.0) 614 : cluster [DBG] osdmap e62: 11 total, 10 up, 10 in 2020-11-16T21:59:01.659 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:01 smithi057 bash[10301]: audit 2020-11-16T21:59:00.655280+0000 mon.b (mon.1) 253 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2020-11-16T21:59:01.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:01 smithi057 bash[10301]: audit 2020-11-16T21:59:00.965020+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:01.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:01 smithi057 bash[10301]: audit 2020-11-16T21:59:00.966656+0000 mon.b (mon.1) 254 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:01.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:01 smithi057 bash[10301]: audit 2020-11-16T21:59:00.970245+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:59:01.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:01 smithi057 bash[10301]: audit 2020-11-16T21:59:00.974294+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:01.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:01 smithi057 bash[10301]: audit 2020-11-16T21:59:00.976445+0000 mon.b (mon.1) 255 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:01.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:01 smithi057 bash[10301]: audit 2020-11-16T21:59:00.979213+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:59:01.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:01 smithi057 bash[10301]: audit 2020-11-16T21:59:00.986477+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:01.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:01 smithi057 bash[10301]: audit 2020-11-16T21:59:00.988522+0000 mon.b (mon.1) 256 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:01.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:01 smithi057 bash[10301]: audit 2020-11-16T21:59:00.991616+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:59:02.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:01 smithi016 bash[10302]: audit 2020-11-16T21:59:00.648207+0000 mon.b (mon.1) 252 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:59:02.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:01 smithi016 bash[10302]: audit 2020-11-16T21:59:00.650278+0000 mon.a (mon.0) 613 : audit [INF] from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2020-11-16T21:59:02.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:01 smithi016 bash[10302]: cluster 2020-11-16T21:59:00.650355+0000 mon.a (mon.0) 614 : cluster [DBG] osdmap e62: 11 total, 10 up, 10 in 2020-11-16T21:59:02.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:01 smithi016 bash[10302]: audit 2020-11-16T21:59:00.655280+0000 mon.b (mon.1) 253 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2020-11-16T21:59:02.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:01 smithi016 bash[10302]: audit 2020-11-16T21:59:00.965020+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:02.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:01 smithi016 bash[10302]: audit 2020-11-16T21:59:00.966656+0000 mon.b (mon.1) 254 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:02.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:01 smithi016 bash[10302]: audit 2020-11-16T21:59:00.970245+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:59:02.089 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:01 smithi016 bash[10302]: audit 2020-11-16T21:59:00.974294+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:02.089 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:01 smithi016 bash[10302]: audit 2020-11-16T21:59:00.976445+0000 mon.b (mon.1) 255 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:02.089 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:01 smithi016 bash[10302]: audit 2020-11-16T21:59:00.979213+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:59:02.089 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:01 smithi016 bash[10302]: audit 2020-11-16T21:59:00.986477+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:02.089 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:01 smithi016 bash[10302]: audit 2020-11-16T21:59:00.988522+0000 mon.b (mon.1) 256 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:02.089 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:01 smithi016 bash[10302]: audit 2020-11-16T21:59:00.991616+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:59:02.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:01 smithi195 bash[10218]: audit 2020-11-16T21:59:00.648207+0000 mon.b (mon.1) 252 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:59:02.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:01 smithi195 bash[10218]: audit 2020-11-16T21:59:00.650278+0000 mon.a (mon.0) 613 : audit [INF] from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2020-11-16T21:59:02.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:01 smithi195 bash[10218]: cluster 2020-11-16T21:59:00.650355+0000 mon.a (mon.0) 614 : cluster [DBG] osdmap e62: 11 total, 10 up, 10 in 2020-11-16T21:59:02.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:01 smithi195 bash[10218]: audit 2020-11-16T21:59:00.655280+0000 mon.b (mon.1) 253 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2020-11-16T21:59:02.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:01 smithi195 bash[10218]: audit 2020-11-16T21:59:00.965020+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:02.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:01 smithi195 bash[10218]: audit 2020-11-16T21:59:00.966656+0000 mon.b (mon.1) 254 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:02.104 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:01 smithi195 bash[10218]: audit 2020-11-16T21:59:00.970245+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}}, \"last_daemon_update\": \"2020-11-16T21:58:52.616136\", \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:59:02.104 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:01 smithi195 bash[10218]: audit 2020-11-16T21:59:00.974294+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:02.104 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:01 smithi195 bash[10218]: audit 2020-11-16T21:59:00.976445+0000 mon.b (mon.1) 255 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:02.104 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:01 smithi195 bash[10218]: audit 2020-11-16T21:59:00.979213+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:59:02.104 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:01 smithi195 bash[10218]: audit 2020-11-16T21:59:00.986477+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:02.104 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:01 smithi195 bash[10218]: audit 2020-11-16T21:59:00.988522+0000 mon.b (mon.1) 256 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:02.105 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:01 smithi195 bash[10218]: audit 2020-11-16T21:59:00.991616+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:59:02.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:02 smithi057 bash[10301]: cluster 2020-11-16T21:58:59.712199+0000 osd.10 (osd.10) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:59:02.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:02 smithi057 bash[10301]: cluster 2020-11-16T21:58:59.712298+0000 osd.10 (osd.10) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:59:02.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:02 smithi057 bash[10301]: cluster 2020-11-16T21:59:01.509896+0000 mgr.x (mgr.24115) 182 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 54 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:59:02.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:02 smithi057 bash[10301]: cluster 2020-11-16T21:59:01.660173+0000 mon.a (mon.0) 621 : cluster [INF] osd.10 v1:172.21.15.57:6808/12217522 boot 2020-11-16T21:59:02.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:02 smithi057 bash[10301]: cluster 2020-11-16T21:59:01.660271+0000 mon.a (mon.0) 622 : cluster [DBG] osdmap e63: 11 total, 11 up, 11 in 2020-11-16T21:59:02.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:02 smithi057 bash[10301]: audit 2020-11-16T21:59:01.665218+0000 mon.b (mon.1) 257 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2020-11-16T21:59:03.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:02 smithi016 bash[10302]: cluster 2020-11-16T21:58:59.712199+0000 osd.10 (osd.10) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:59:03.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:02 smithi016 bash[10302]: cluster 2020-11-16T21:58:59.712298+0000 osd.10 (osd.10) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:59:03.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:02 smithi016 bash[10302]: cluster 2020-11-16T21:59:01.509896+0000 mgr.x (mgr.24115) 182 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 54 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:59:03.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:02 smithi016 bash[10302]: cluster 2020-11-16T21:59:01.660173+0000 mon.a (mon.0) 621 : cluster [INF] osd.10 v1:172.21.15.57:6808/12217522 boot 2020-11-16T21:59:03.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:02 smithi016 bash[10302]: cluster 2020-11-16T21:59:01.660271+0000 mon.a (mon.0) 622 : cluster [DBG] osdmap e63: 11 total, 11 up, 11 in 2020-11-16T21:59:03.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:02 smithi016 bash[10302]: audit 2020-11-16T21:59:01.665218+0000 mon.b (mon.1) 257 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2020-11-16T21:59:03.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:02 smithi195 bash[10218]: cluster 2020-11-16T21:58:59.712199+0000 osd.10 (osd.10) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:59:03.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:02 smithi195 bash[10218]: cluster 2020-11-16T21:58:59.712298+0000 osd.10 (osd.10) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:59:03.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:02 smithi195 bash[10218]: cluster 2020-11-16T21:59:01.509896+0000 mgr.x (mgr.24115) 182 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 54 MiB used, 894 GiB / 894 GiB avail 2020-11-16T21:59:03.106 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:02 smithi195 bash[10218]: cluster 2020-11-16T21:59:01.660173+0000 mon.a (mon.0) 621 : cluster [INF] osd.10 v1:172.21.15.57:6808/12217522 boot 2020-11-16T21:59:03.107 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:02 smithi195 bash[10218]: cluster 2020-11-16T21:59:01.660271+0000 mon.a (mon.0) 622 : cluster [DBG] osdmap e63: 11 total, 11 up, 11 in 2020-11-16T21:59:03.107 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:02 smithi195 bash[10218]: audit 2020-11-16T21:59:01.665218+0000 mon.b (mon.1) 257 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2020-11-16T21:59:03.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:03 smithi057 bash[10301]: cluster 2020-11-16T21:59:02.671262+0000 mon.a (mon.0) 623 : cluster [DBG] osdmap e64: 11 total, 11 up, 11 in 2020-11-16T21:59:03.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:03 smithi057 bash[10301]: audit 2020-11-16T21:59:03.467184+0000 mon.b (mon.1) 258 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:59:03.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:03 smithi057 bash[10301]: audit 2020-11-16T21:59:03.470554+0000 mon.b (mon.1) 259 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:59:03.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:03 smithi057 bash[10301]: audit 2020-11-16T21:59:03.472002+0000 mon.b (mon.1) 260 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:59:03.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:03 smithi057 bash[10301]: audit 2020-11-16T21:59:03.473687+0000 mon.b (mon.1) 261 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:59:04.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:03 smithi016 bash[10302]: cluster 2020-11-16T21:59:02.671262+0000 mon.a (mon.0) 623 : cluster [DBG] osdmap e64: 11 total, 11 up, 11 in 2020-11-16T21:59:04.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:03 smithi016 bash[10302]: audit 2020-11-16T21:59:03.467184+0000 mon.b (mon.1) 258 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:59:04.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:03 smithi016 bash[10302]: audit 2020-11-16T21:59:03.470554+0000 mon.b (mon.1) 259 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:59:04.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:03 smithi016 bash[10302]: audit 2020-11-16T21:59:03.472002+0000 mon.b (mon.1) 260 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:59:04.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:03 smithi016 bash[10302]: audit 2020-11-16T21:59:03.473687+0000 mon.b (mon.1) 261 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:59:04.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:03 smithi195 bash[10218]: cluster 2020-11-16T21:59:02.671262+0000 mon.a (mon.0) 623 : cluster [DBG] osdmap e64: 11 total, 11 up, 11 in 2020-11-16T21:59:04.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:03 smithi195 bash[10218]: audit 2020-11-16T21:59:03.467184+0000 mon.b (mon.1) 258 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2020-11-16T21:59:04.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:03 smithi195 bash[10218]: audit 2020-11-16T21:59:03.470554+0000 mon.b (mon.1) 259 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2020-11-16T21:59:04.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:03 smithi195 bash[10218]: audit 2020-11-16T21:59:03.472002+0000 mon.b (mon.1) 260 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:59:04.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:03 smithi195 bash[10218]: audit 2020-11-16T21:59:03.473687+0000 mon.b (mon.1) 261 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:59:04.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:04 smithi057 bash[10301]: audit 2020-11-16T21:59:03.465263+0000 mgr.x (mgr.24115) 183 : audit [DBG] from='client.34421 v1:172.21.15.57:0/1797523103' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:59:04.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:04 smithi057 bash[10301]: cephadm 2020-11-16T21:59:03.468515+0000 mgr.x (mgr.24115) 184 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:59:04.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:04 smithi057 bash[10301]: cephadm 2020-11-16T21:59:03.468706+0000 mgr.x (mgr.24115) 185 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:59:04.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:04 smithi057 bash[10301]: cephadm 2020-11-16T21:59:03.469824+0000 mgr.x (mgr.24115) 186 : cephadm [INF] Applying None on host smithi057... 2020-11-16T21:59:04.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:04 smithi057 bash[10301]: cluster 2020-11-16T21:59:03.510505+0000 mgr.x (mgr.24115) 187 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 59 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:05.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:04 smithi016 bash[10302]: audit 2020-11-16T21:59:03.465263+0000 mgr.x (mgr.24115) 183 : audit [DBG] from='client.34421 v1:172.21.15.57:0/1797523103' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:59:05.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:04 smithi016 bash[10302]: cephadm 2020-11-16T21:59:03.468515+0000 mgr.x (mgr.24115) 184 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:59:05.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:04 smithi016 bash[10302]: cephadm 2020-11-16T21:59:03.468706+0000 mgr.x (mgr.24115) 185 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:59:05.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:04 smithi016 bash[10302]: cephadm 2020-11-16T21:59:03.469824+0000 mgr.x (mgr.24115) 186 : cephadm [INF] Applying None on host smithi057... 2020-11-16T21:59:05.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:04 smithi016 bash[10302]: cluster 2020-11-16T21:59:03.510505+0000 mgr.x (mgr.24115) 187 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 59 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:05.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:04 smithi195 bash[10218]: audit 2020-11-16T21:59:03.465263+0000 mgr.x (mgr.24115) 183 : audit [DBG] from='client.34421 v1:172.21.15.57:0/1797523103' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi057:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2020-11-16T21:59:05.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:04 smithi195 bash[10218]: cephadm 2020-11-16T21:59:03.468515+0000 mgr.x (mgr.24115) 184 : cephadm [INF] Found osd claims -> {} 2020-11-16T21:59:05.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:04 smithi195 bash[10218]: cephadm 2020-11-16T21:59:03.468706+0000 mgr.x (mgr.24115) 185 : cephadm [INF] Found osd claims for drivegroup None -> {} 2020-11-16T21:59:05.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:04 smithi195 bash[10218]: cephadm 2020-11-16T21:59:03.469824+0000 mgr.x (mgr.24115) 186 : cephadm [INF] Applying None on host smithi057... 2020-11-16T21:59:05.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:04 smithi195 bash[10218]: cluster 2020-11-16T21:59:03.510505+0000 mgr.x (mgr.24115) 187 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 59 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:06.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:06 smithi057 bash[10301]: cluster 2020-11-16T21:59:05.511173+0000 mgr.x (mgr.24115) 188 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 59 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:07.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:06 smithi016 bash[10302]: cluster 2020-11-16T21:59:05.511173+0000 mgr.x (mgr.24115) 188 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 59 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:07.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:06 smithi195 bash[10218]: cluster 2020-11-16T21:59:05.511173+0000 mgr.x (mgr.24115) 188 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 59 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:07.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:07 smithi057 bash[10301]: audit 2020-11-16T21:59:07.390000+0000 mon.a (mon.0) 624 : audit [INF] from='client.34427 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac30fc92-b414-4fe6-8ca4-f3f4bab38156"}]: dispatch 2020-11-16T21:59:07.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:07 smithi057 bash[10301]: audit 2020-11-16T21:59:07.392443+0000 mon.c (mon.2) 15 : audit [INF] from='client.? v1:172.21.15.57:0/335207943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac30fc92-b414-4fe6-8ca4-f3f4bab38156"}]: dispatch 2020-11-16T21:59:07.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:07 smithi057 bash[10301]: audit 2020-11-16T21:59:07.398001+0000 mon.a (mon.0) 625 : audit [INF] from='client.34427 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac30fc92-b414-4fe6-8ca4-f3f4bab38156"}]': finished 2020-11-16T21:59:07.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:07 smithi057 bash[10301]: cluster 2020-11-16T21:59:07.398090+0000 mon.a (mon.0) 626 : cluster [DBG] osdmap e65: 12 total, 11 up, 11 in 2020-11-16T21:59:07.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:07 smithi057 bash[10301]: audit 2020-11-16T21:59:07.402388+0000 mon.b (mon.1) 262 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2020-11-16T21:59:08.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:07 smithi016 bash[10302]: audit 2020-11-16T21:59:07.390000+0000 mon.a (mon.0) 624 : audit [INF] from='client.34427 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac30fc92-b414-4fe6-8ca4-f3f4bab38156"}]: dispatch 2020-11-16T21:59:08.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:07 smithi016 bash[10302]: audit 2020-11-16T21:59:07.392443+0000 mon.c (mon.2) 15 : audit [INF] from='client.? v1:172.21.15.57:0/335207943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac30fc92-b414-4fe6-8ca4-f3f4bab38156"}]: dispatch 2020-11-16T21:59:08.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:07 smithi016 bash[10302]: audit 2020-11-16T21:59:07.398001+0000 mon.a (mon.0) 625 : audit [INF] from='client.34427 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac30fc92-b414-4fe6-8ca4-f3f4bab38156"}]': finished 2020-11-16T21:59:08.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:07 smithi016 bash[10302]: cluster 2020-11-16T21:59:07.398090+0000 mon.a (mon.0) 626 : cluster [DBG] osdmap e65: 12 total, 11 up, 11 in 2020-11-16T21:59:08.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:07 smithi016 bash[10302]: audit 2020-11-16T21:59:07.402388+0000 mon.b (mon.1) 262 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2020-11-16T21:59:08.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:07 smithi195 bash[10218]: audit 2020-11-16T21:59:07.390000+0000 mon.a (mon.0) 624 : audit [INF] from='client.34427 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac30fc92-b414-4fe6-8ca4-f3f4bab38156"}]: dispatch 2020-11-16T21:59:08.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:07 smithi195 bash[10218]: audit 2020-11-16T21:59:07.392443+0000 mon.c (mon.2) 15 : audit [INF] from='client.? v1:172.21.15.57:0/335207943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac30fc92-b414-4fe6-8ca4-f3f4bab38156"}]: dispatch 2020-11-16T21:59:08.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:07 smithi195 bash[10218]: audit 2020-11-16T21:59:07.398001+0000 mon.a (mon.0) 625 : audit [INF] from='client.34427 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac30fc92-b414-4fe6-8ca4-f3f4bab38156"}]': finished 2020-11-16T21:59:08.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:07 smithi195 bash[10218]: cluster 2020-11-16T21:59:07.398090+0000 mon.a (mon.0) 626 : cluster [DBG] osdmap e65: 12 total, 11 up, 11 in 2020-11-16T21:59:08.103 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:07 smithi195 bash[10218]: audit 2020-11-16T21:59:07.402388+0000 mon.b (mon.1) 262 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2020-11-16T21:59:08.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:08 smithi057 bash[10301]: cluster 2020-11-16T21:59:07.511754+0000 mgr.x (mgr.24115) 189 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:08.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:08 smithi057 bash[10301]: audit 2020-11-16T21:59:08.105040+0000 mon.c (mon.2) 16 : audit [DBG] from='client.? v1:172.21.15.57:0/1484295109' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:59:09.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:08 smithi016 bash[10302]: cluster 2020-11-16T21:59:07.511754+0000 mgr.x (mgr.24115) 189 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:09.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:08 smithi016 bash[10302]: audit 2020-11-16T21:59:08.105040+0000 mon.c (mon.2) 16 : audit [DBG] from='client.? v1:172.21.15.57:0/1484295109' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:59:09.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:08 smithi195 bash[10218]: cluster 2020-11-16T21:59:07.511754+0000 mgr.x (mgr.24115) 189 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:09.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:08 smithi195 bash[10218]: audit 2020-11-16T21:59:08.105040+0000 mon.c (mon.2) 16 : audit [DBG] from='client.? v1:172.21.15.57:0/1484295109' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2020-11-16T21:59:10.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:10 smithi016 bash[10302]: cluster 2020-11-16T21:59:09.512390+0000 mgr.x (mgr.24115) 190 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:10.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:10 smithi195 bash[10218]: cluster 2020-11-16T21:59:09.512390+0000 mgr.x (mgr.24115) 190 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:10.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:10 smithi057 bash[10301]: cluster 2020-11-16T21:59:09.512390+0000 mgr.x (mgr.24115) 190 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:11.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:11 smithi016 bash[10302]: audit 2020-11-16T21:59:11.270740+0000 mon.b (mon.1) 263 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:59:11.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:11 smithi195 bash[10218]: audit 2020-11-16T21:59:11.270740+0000 mon.b (mon.1) 263 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:59:11.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:11 smithi057 bash[10301]: audit 2020-11-16T21:59:11.270740+0000 mon.b (mon.1) 263 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:59:12.773 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:12 smithi057 bash[10301]: cluster 2020-11-16T21:59:11.513016+0000 mgr.x (mgr.24115) 191 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:12.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:12 smithi016 bash[10302]: cluster 2020-11-16T21:59:11.513016+0000 mgr.x (mgr.24115) 191 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:12.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:12 smithi195 bash[10218]: cluster 2020-11-16T21:59:11.513016+0000 mgr.x (mgr.24115) 191 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:14.836 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:14 smithi016 bash[10302]: cluster 2020-11-16T21:59:13.513766+0000 mgr.x (mgr.24115) 192 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:14.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:14 smithi195 bash[10218]: cluster 2020-11-16T21:59:13.513766+0000 mgr.x (mgr.24115) 192 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:14.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:14 smithi057 bash[10301]: cluster 2020-11-16T21:59:13.513766+0000 mgr.x (mgr.24115) 192 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:16.822 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:16 smithi057 bash[10301]: cluster 2020-11-16T21:59:15.514401+0000 mgr.x (mgr.24115) 193 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:16.822 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:16 smithi057 bash[10301]: audit 2020-11-16T21:59:15.614188+0000 mon.b (mon.1) 264 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2020-11-16T21:59:16.822 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:16 smithi057 bash[10301]: audit 2020-11-16T21:59:15.615784+0000 mon.b (mon.1) 265 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:59:16.823 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:16 smithi057 bash[10301]: cephadm 2020-11-16T21:59:15.617067+0000 mgr.x (mgr.24115) 194 : cephadm [INF] Deploying daemon osd.11 on smithi057 2020-11-16T21:59:16.823 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:16 smithi057 bash[10301]: audit 2020-11-16T21:59:15.617771+0000 mon.b (mon.1) 266 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.11", "key": "container_image"}]: dispatch 2020-11-16T21:59:16.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:16 smithi016 bash[10302]: cluster 2020-11-16T21:59:15.514401+0000 mgr.x (mgr.24115) 193 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:16.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:16 smithi016 bash[10302]: audit 2020-11-16T21:59:15.614188+0000 mon.b (mon.1) 264 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2020-11-16T21:59:16.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:16 smithi016 bash[10302]: audit 2020-11-16T21:59:15.615784+0000 mon.b (mon.1) 265 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:59:16.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:16 smithi016 bash[10302]: cephadm 2020-11-16T21:59:15.617067+0000 mgr.x (mgr.24115) 194 : cephadm [INF] Deploying daemon osd.11 on smithi057 2020-11-16T21:59:16.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:16 smithi016 bash[10302]: audit 2020-11-16T21:59:15.617771+0000 mon.b (mon.1) 266 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.11", "key": "container_image"}]: dispatch 2020-11-16T21:59:16.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:16 smithi195 bash[10218]: cluster 2020-11-16T21:59:15.514401+0000 mgr.x (mgr.24115) 193 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:16.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:16 smithi195 bash[10218]: audit 2020-11-16T21:59:15.614188+0000 mon.b (mon.1) 264 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2020-11-16T21:59:16.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:16 smithi195 bash[10218]: audit 2020-11-16T21:59:15.615784+0000 mon.b (mon.1) 265 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2020-11-16T21:59:16.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:16 smithi195 bash[10218]: cephadm 2020-11-16T21:59:15.617067+0000 mgr.x (mgr.24115) 194 : cephadm [INF] Deploying daemon osd.11 on smithi057 2020-11-16T21:59:16.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:16 smithi195 bash[10218]: audit 2020-11-16T21:59:15.617771+0000 mon.b (mon.1) 266 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.11", "key": "container_image"}]: dispatch 2020-11-16T21:59:17.874 INFO:teuthology.orchestra.run.smithi057.stdout:Created osd(s) 11 on host 'smithi057' 2020-11-16T21:59:18.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:18 smithi016 bash[10302]: cluster 2020-11-16T21:59:17.515039+0000 mgr.x (mgr.24115) 195 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:18.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:18 smithi016 bash[10302]: audit 2020-11-16T21:59:17.873110+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:18.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:18 smithi016 bash[10302]: audit 2020-11-16T21:59:17.874872+0000 mon.b (mon.1) 267 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:18.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:18 smithi016 bash[10302]: audit 2020-11-16T21:59:17.875667+0000 mon.b (mon.1) 268 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:59:18.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:18 smithi016 bash[10302]: audit 2020-11-16T21:59:17.878338+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:59:18.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:18 smithi195 bash[10218]: cluster 2020-11-16T21:59:17.515039+0000 mgr.x (mgr.24115) 195 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:18.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:18 smithi195 bash[10218]: audit 2020-11-16T21:59:17.873110+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:18.854 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:18 smithi195 bash[10218]: audit 2020-11-16T21:59:17.874872+0000 mon.b (mon.1) 267 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:18.854 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:18 smithi195 bash[10218]: audit 2020-11-16T21:59:17.875667+0000 mon.b (mon.1) 268 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:59:18.854 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:18 smithi195 bash[10218]: audit 2020-11-16T21:59:17.878338+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:59:18.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:18 smithi057 bash[10301]: cluster 2020-11-16T21:59:17.515039+0000 mgr.x (mgr.24115) 195 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:18.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:18 smithi057 bash[10301]: audit 2020-11-16T21:59:17.873110+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:18.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:18 smithi057 bash[10301]: audit 2020-11-16T21:59:17.874872+0000 mon.b (mon.1) 267 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:18.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:18 smithi057 bash[10301]: audit 2020-11-16T21:59:17.875667+0000 mon.b (mon.1) 268 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:59:18.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:18 smithi057 bash[10301]: audit 2020-11-16T21:59:17.878338+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614273\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.614476\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615099\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:58:52.615582\", \"created\": \"2020-11-16T21:58:51.794258\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_device_update\": \"2020-11-16T21:59:00.964752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:59:19.023 INFO:teuthology.orchestra.run.smithi057:osd.11> sudo journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.11.service 2020-11-16T21:59:19.025 INFO:tasks.cephadm:Setting up client nodes... 2020-11-16T21:59:19.026 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2020-11-16T21:59:19.080 INFO:journalctl@ceph.osd.11.smithi057.stdout:-- Logs begin at Sun 2020-11-15 12:21:41 UTC. -- 2020-11-16T21:59:19.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:19 smithi016 bash[10302]: audit 2020-11-16T21:59:18.750114+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:19.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:19 smithi016 bash[10302]: audit 2020-11-16T21:59:18.752078+0000 mon.b (mon.1) 269 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:19.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:19 smithi016 bash[10302]: audit 2020-11-16T21:59:18.755493+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:59:19.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:19 smithi016 bash[10302]: audit 2020-11-16T21:59:18.761459+0000 mon.b (mon.1) 270 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:59:19.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:19 smithi195 bash[10218]: audit 2020-11-16T21:59:18.750114+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:19.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:19 smithi195 bash[10218]: audit 2020-11-16T21:59:18.752078+0000 mon.b (mon.1) 269 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:19.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:19 smithi195 bash[10218]: audit 2020-11-16T21:59:18.755493+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:59:19.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:19 smithi195 bash[10218]: audit 2020-11-16T21:59:18.761459+0000 mon.b (mon.1) 270 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:59:19.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:19 smithi057 bash[10301]: audit 2020-11-16T21:59:18.750114+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:19.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:19 smithi057 bash[10301]: audit 2020-11-16T21:59:18.752078+0000 mon.b (mon.1) 269 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:19.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:19 smithi057 bash[10301]: audit 2020-11-16T21:59:18.755493+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0x83 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"Not a SCSI compatible device\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:59:19.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:19 smithi057 bash[10301]: audit 2020-11-16T21:59:18.761459+0000 mon.b (mon.1) 270 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2020-11-16T21:59:20.410 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 21:59:20 smithi057 bash[19569]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2020-11-16T21:59:20.410 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 21:59:20 smithi057 bash[19569]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-11 --no-mon-config 2020-11-16T21:59:20.410 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 21:59:20 smithi057 bash[19569]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-11/block 2020-11-16T21:59:20.411 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 21:59:20 smithi057 bash[19569]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-11/block 2020-11-16T21:59:20.411 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 21:59:20 smithi057 bash[19569]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2020-11-16T21:59:20.411 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 21:59:20 smithi057 bash[19569]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2020-11-16T21:59:20.411 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 21:59:20 smithi057 bash[19569]: --> ceph-volume lvm activate successful for osd ID: 11 2020-11-16T21:59:20.624 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:20 smithi195 bash[10218]: cluster 2020-11-16T21:59:19.515644+0000 mgr.x (mgr.24115) 196 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:20.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:20 smithi016 bash[10302]: cluster 2020-11-16T21:59:19.515644+0000 mgr.x (mgr.24115) 196 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:20.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:20 smithi057 bash[10301]: cluster 2020-11-16T21:59:19.515644+0000 mgr.x (mgr.24115) 196 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:21.447 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 21:59:21 smithi057 bash[19569]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.11 2020-11-16T21:59:22.415 INFO:teuthology.orchestra.run.smithi195.stdout:[client.0] 2020-11-16T21:59:22.416 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQA69rJf4aHpGBAAZrdMdQ0WSpBIq4C8rPPsLg== 2020-11-16T21:59:22.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:22 smithi016 bash[10302]: cluster 2020-11-16T21:59:21.516403+0000 mgr.x (mgr.24115) 197 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:22.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:22 smithi016 bash[10302]: audit 2020-11-16T21:59:22.417661+0000 mon.a (mon.0) 631 : audit [INF] from='client.? v1:172.21.15.195:0/2615572811' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-11-16T21:59:22.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:22 smithi016 bash[10302]: audit 2020-11-16T21:59:22.424583+0000 mon.a (mon.0) 632 : audit [INF] from='client.? v1:172.21.15.195:0/2615572811' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-11-16T21:59:22.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:22 smithi195 bash[10218]: cluster 2020-11-16T21:59:21.516403+0000 mgr.x (mgr.24115) 197 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:22.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:22 smithi195 bash[10218]: audit 2020-11-16T21:59:22.417661+0000 mon.a (mon.0) 631 : audit [INF] from='client.? v1:172.21.15.195:0/2615572811' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-11-16T21:59:22.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:22 smithi195 bash[10218]: audit 2020-11-16T21:59:22.424583+0000 mon.a (mon.0) 632 : audit [INF] from='client.? v1:172.21.15.195:0/2615572811' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-11-16T21:59:22.878 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 21:59:22 smithi057 bash[19569]: debug 2020-11-16T21:59:22.773+0000 7f5e32182700 10 -- 172.21.15.57:0/1228056829 dispatch_throttle_release 308 to dispatch throttler 502/104857600 2020-11-16T21:59:22.879 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 21:59:22 smithi057 bash[19569]: debug 2020-11-16T21:59:22.773+0000 7f5e32182700 20 -- 172.21.15.57:0/1228056829 done calling dispatch on 0x562f1b9cec60 2020-11-16T21:59:22.879 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 21:59:22 smithi057 bash[19569]: debug 2020-11-16T21:59:22.773+0000 7f5e32182700 1 -- 172.21.15.57:0/1228056829 <== mon.2 v1:172.21.15.57:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (unknown 2068441544 0 0) 0x562f1b9d8340 con 0x562f1ba53400 2020-11-16T21:59:22.879 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 21:59:22 smithi057 bash[19569]: debug 2020-11-16T21:59:22.773+0000 7f5e32182700 10 -- 172.21.15.57:0/1228056829 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2020-11-16T21:59:22.879 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 21:59:22 smithi057 bash[19569]: debug 2020-11-16T21:59:22.773+0000 7f5e32182700 20 -- 172.21.15.57:0/1228056829 done calling dispatch on 0x562f1b9d8340 2020-11-16T21:59:22.879 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:22 smithi057 bash[10301]: cluster 2020-11-16T21:59:21.516403+0000 mgr.x (mgr.24115) 197 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:22.880 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:22 smithi057 bash[10301]: audit 2020-11-16T21:59:22.417661+0000 mon.a (mon.0) 631 : audit [INF] from='client.? v1:172.21.15.195:0/2615572811' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-11-16T21:59:22.880 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:22 smithi057 bash[10301]: audit 2020-11-16T21:59:22.424583+0000 mon.a (mon.0) 632 : audit [INF] from='client.? v1:172.21.15.195:0/2615572811' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-11-16T21:59:23.007 INFO:teuthology.orchestra.run.smithi195:> set -ex 2020-11-16T21:59:23.008 INFO:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2020-11-16T21:59:23.008 INFO:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-11-16T21:59:23.012 INFO:teuthology.orchestra.run.smithi195.stderr:+ sudo dd of=/etc/ceph/ceph.client.0.keyring 2020-11-16T21:59:23.022 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records in 2020-11-16T21:59:23.022 INFO:teuthology.orchestra.run.smithi195.stderr:0+1 records out 2020-11-16T21:59:23.022 INFO:teuthology.orchestra.run.smithi195.stderr:59 bytes copied, 7.3523e-05 s, 802 kB/s 2020-11-16T21:59:23.023 INFO:teuthology.orchestra.run.smithi195.stderr:+ sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-11-16T21:59:23.030 INFO:teuthology.orchestra.run.smithi016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2020-11-16T21:59:23.697 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 21:59:23 smithi057 bash[19569]: debug 2020-11-16T21:59:23.317+0000 7f5e39c02f40 -1 Falling back to public interface 2020-11-16T21:59:24.318 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 21:59:23 smithi057 bash[19569]: debug 2020-11-16T21:59:23.957+0000 7f5e39c02f40 -1 osd.11 0 log_to_monitors {default=true} 2020-11-16T21:59:24.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:24 smithi057 bash[10301]: cluster 2020-11-16T21:59:23.517070+0000 mgr.x (mgr.24115) 198 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:24.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:24 smithi057 bash[10301]: audit 2020-11-16T21:59:23.965816+0000 mon.a (mon.0) 633 : audit [INF] from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2020-11-16T21:59:24.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:24 smithi057 bash[10301]: audit 2020-11-16T21:59:23.968002+0000 mon.c (mon.2) 17 : audit [INF] from='osd.11 v1:172.21.15.57:6812/3378371863' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2020-11-16T21:59:24.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:24 smithi016 bash[10302]: cluster 2020-11-16T21:59:23.517070+0000 mgr.x (mgr.24115) 198 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:24.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:24 smithi016 bash[10302]: audit 2020-11-16T21:59:23.965816+0000 mon.a (mon.0) 633 : audit [INF] from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2020-11-16T21:59:24.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:24 smithi016 bash[10302]: audit 2020-11-16T21:59:23.968002+0000 mon.c (mon.2) 17 : audit [INF] from='osd.11 v1:172.21.15.57:6812/3378371863' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2020-11-16T21:59:24.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:24 smithi195 bash[10218]: cluster 2020-11-16T21:59:23.517070+0000 mgr.x (mgr.24115) 198 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:24.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:24 smithi195 bash[10218]: audit 2020-11-16T21:59:23.965816+0000 mon.a (mon.0) 633 : audit [INF] from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2020-11-16T21:59:24.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:24 smithi195 bash[10218]: audit 2020-11-16T21:59:23.968002+0000 mon.c (mon.2) 17 : audit [INF] from='osd.11 v1:172.21.15.57:6812/3378371863' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2020-11-16T21:59:25.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:25 smithi016 bash[10302]: audit 2020-11-16T21:59:24.554621+0000 mon.a (mon.0) 634 : audit [INF] from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2020-11-16T21:59:25.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:25 smithi016 bash[10302]: cluster 2020-11-16T21:59:24.554726+0000 mon.a (mon.0) 635 : cluster [DBG] osdmap e66: 12 total, 11 up, 11 in 2020-11-16T21:59:25.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:25 smithi016 bash[10302]: audit 2020-11-16T21:59:24.560071+0000 mon.b (mon.1) 271 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2020-11-16T21:59:25.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:25 smithi016 bash[10302]: audit 2020-11-16T21:59:24.561909+0000 mon.c (mon.2) 18 : audit [INF] from='osd.11 v1:172.21.15.57:6812/3378371863' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:59:25.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:25 smithi016 bash[10302]: audit 2020-11-16T21:59:24.565918+0000 mon.a (mon.0) 636 : audit [INF] from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:59:25.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:25 smithi016 bash[10302]: audit 2020-11-16T21:59:24.989966+0000 mon.b (mon.1) 272 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:59:25.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:25 smithi016 bash[10302]: audit 2020-11-16T21:59:25.296975+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:25.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:25 smithi016 bash[10302]: audit 2020-11-16T21:59:25.298545+0000 mon.b (mon.1) 273 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:25.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:25 smithi016 bash[10302]: audit 2020-11-16T21:59:25.302496+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:59:25.839 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:25 smithi016 bash[10302]: audit 2020-11-16T21:59:25.305808+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:25.884 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:25 smithi016 bash[10302]: audit 2020-11-16T21:59:25.307848+0000 mon.b (mon.1) 274 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:25.884 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:25 smithi016 bash[10302]: audit 2020-11-16T21:59:25.310611+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:59:25.884 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:25 smithi016 bash[10302]: audit 2020-11-16T21:59:25.316987+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:25.884 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:25 smithi016 bash[10302]: audit 2020-11-16T21:59:25.318994+0000 mon.b (mon.1) 275 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:25.884 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:25 smithi016 bash[10302]: audit 2020-11-16T21:59:25.321424+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:59:25.885 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:25 smithi195 bash[10218]: audit 2020-11-16T21:59:24.554621+0000 mon.a (mon.0) 634 : audit [INF] from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2020-11-16T21:59:25.885 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:25 smithi195 bash[10218]: cluster 2020-11-16T21:59:24.554726+0000 mon.a (mon.0) 635 : cluster [DBG] osdmap e66: 12 total, 11 up, 11 in 2020-11-16T21:59:25.886 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:25 smithi195 bash[10218]: audit 2020-11-16T21:59:24.560071+0000 mon.b (mon.1) 271 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2020-11-16T21:59:25.886 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:25 smithi195 bash[10218]: audit 2020-11-16T21:59:24.561909+0000 mon.c (mon.2) 18 : audit [INF] from='osd.11 v1:172.21.15.57:6812/3378371863' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:59:25.886 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:25 smithi195 bash[10218]: audit 2020-11-16T21:59:24.565918+0000 mon.a (mon.0) 636 : audit [INF] from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:59:25.886 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:25 smithi195 bash[10218]: audit 2020-11-16T21:59:24.989966+0000 mon.b (mon.1) 272 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:59:25.886 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:25 smithi195 bash[10218]: audit 2020-11-16T21:59:25.296975+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:25.886 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:25 smithi195 bash[10218]: audit 2020-11-16T21:59:25.298545+0000 mon.b (mon.1) 273 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:25.887 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:25 smithi195 bash[10218]: audit 2020-11-16T21:59:25.302496+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:59:25.887 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:25 smithi195 bash[10218]: audit 2020-11-16T21:59:25.305808+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:25.887 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:25 smithi195 bash[10218]: audit 2020-11-16T21:59:25.307848+0000 mon.b (mon.1) 274 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:25.887 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:25 smithi195 bash[10218]: audit 2020-11-16T21:59:25.310611+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:59:25.887 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:25 smithi195 bash[10218]: audit 2020-11-16T21:59:25.316987+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:25.887 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:25 smithi195 bash[10218]: audit 2020-11-16T21:59:25.318994+0000 mon.b (mon.1) 275 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:25.888 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:25 smithi195 bash[10218]: audit 2020-11-16T21:59:25.321424+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:59:25.947 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 21:59:25 smithi057 bash[19569]: debug 2020-11-16T21:59:25.581+0000 7f5e3017e700 -1 osd.11 0 waiting for initial osdmap 2020-11-16T21:59:25.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:25 smithi057 bash[10301]: audit 2020-11-16T21:59:24.554621+0000 mon.a (mon.0) 634 : audit [INF] from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2020-11-16T21:59:25.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:25 smithi057 bash[10301]: cluster 2020-11-16T21:59:24.554726+0000 mon.a (mon.0) 635 : cluster [DBG] osdmap e66: 12 total, 11 up, 11 in 2020-11-16T21:59:25.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:25 smithi057 bash[10301]: audit 2020-11-16T21:59:24.560071+0000 mon.b (mon.1) 271 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2020-11-16T21:59:25.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:25 smithi057 bash[10301]: audit 2020-11-16T21:59:24.561909+0000 mon.c (mon.2) 18 : audit [INF] from='osd.11 v1:172.21.15.57:6812/3378371863' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:59:25.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:25 smithi057 bash[10301]: audit 2020-11-16T21:59:24.565918+0000 mon.a (mon.0) 636 : audit [INF] from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]: dispatch 2020-11-16T21:59:25.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:25 smithi057 bash[10301]: audit 2020-11-16T21:59:24.989966+0000 mon.b (mon.1) 272 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T21:59:25.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:25 smithi057 bash[10301]: audit 2020-11-16T21:59:25.296975+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:25.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:25 smithi057 bash[10301]: audit 2020-11-16T21:59:25.298545+0000 mon.b (mon.1) 273 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]: dispatch 2020-11-16T21:59:25.950 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:25 smithi057 bash[10301]: audit 2020-11-16T21:59:25.302496+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T21:53:06.676451\"}"}]': finished 2020-11-16T21:59:25.950 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:25 smithi057 bash[10301]: audit 2020-11-16T21:59:25.305808+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:25.950 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:25 smithi057 bash[10301]: audit 2020-11-16T21:59:25.307848+0000 mon.b (mon.1) 274 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:25.950 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:25 smithi057 bash[10301]: audit 2020-11-16T21:59:25.310611+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:59:25.950 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:25 smithi057 bash[10301]: audit 2020-11-16T21:59:25.316987+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:25.950 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:25 smithi057 bash[10301]: audit 2020-11-16T21:59:25.318994+0000 mon.b (mon.1) 275 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T21:59:25.951 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:25 smithi057 bash[10301]: audit 2020-11-16T21:59:25.321424+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T21:59:26.415 INFO:teuthology.orchestra.run.smithi016.stdout:[client.1] 2020-11-16T21:59:26.415 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQA+9rJf6crdGBAA886OM4/5BYQZ1l410akWXA== 2020-11-16T21:59:26.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:26 smithi016 bash[10302]: cluster 2020-11-16T21:59:25.517687+0000 mgr.x (mgr.24115) 199 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:26.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:26 smithi016 bash[10302]: audit 2020-11-16T21:59:25.577449+0000 mon.a (mon.0) 643 : audit [INF] from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2020-11-16T21:59:26.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:26 smithi016 bash[10302]: cluster 2020-11-16T21:59:25.577562+0000 mon.a (mon.0) 644 : cluster [DBG] osdmap e67: 12 total, 11 up, 11 in 2020-11-16T21:59:26.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:26 smithi016 bash[10302]: audit 2020-11-16T21:59:25.580793+0000 mon.b (mon.1) 276 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2020-11-16T21:59:26.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:26 smithi016 bash[10302]: audit 2020-11-16T21:59:25.586891+0000 mon.b (mon.1) 277 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2020-11-16T21:59:26.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:26 smithi016 bash[10302]: audit 2020-11-16T21:59:26.416850+0000 mon.a (mon.0) 645 : audit [INF] from='client.24451 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-11-16T21:59:26.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:26 smithi016 bash[10302]: audit 2020-11-16T21:59:26.418656+0000 mon.b (mon.1) 278 : audit [INF] from='client.? v1:172.21.15.16:0/1654468286' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-11-16T21:59:26.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:26 smithi016 bash[10302]: audit 2020-11-16T21:59:26.423752+0000 mon.a (mon.0) 646 : audit [INF] from='client.24451 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-11-16T21:59:26.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:26 smithi195 bash[10218]: cluster 2020-11-16T21:59:25.517687+0000 mgr.x (mgr.24115) 199 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:26.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:26 smithi195 bash[10218]: audit 2020-11-16T21:59:25.577449+0000 mon.a (mon.0) 643 : audit [INF] from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2020-11-16T21:59:26.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:26 smithi195 bash[10218]: cluster 2020-11-16T21:59:25.577562+0000 mon.a (mon.0) 644 : cluster [DBG] osdmap e67: 12 total, 11 up, 11 in 2020-11-16T21:59:26.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:26 smithi195 bash[10218]: audit 2020-11-16T21:59:25.580793+0000 mon.b (mon.1) 276 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2020-11-16T21:59:26.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:26 smithi195 bash[10218]: audit 2020-11-16T21:59:25.586891+0000 mon.b (mon.1) 277 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2020-11-16T21:59:26.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:26 smithi195 bash[10218]: audit 2020-11-16T21:59:26.416850+0000 mon.a (mon.0) 645 : audit [INF] from='client.24451 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-11-16T21:59:26.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:26 smithi195 bash[10218]: audit 2020-11-16T21:59:26.418656+0000 mon.b (mon.1) 278 : audit [INF] from='client.? v1:172.21.15.16:0/1654468286' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-11-16T21:59:26.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:26 smithi195 bash[10218]: audit 2020-11-16T21:59:26.423752+0000 mon.a (mon.0) 646 : audit [INF] from='client.24451 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-11-16T21:59:26.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:26 smithi057 bash[10301]: cluster 2020-11-16T21:59:25.517687+0000 mgr.x (mgr.24115) 199 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:26.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:26 smithi057 bash[10301]: audit 2020-11-16T21:59:25.577449+0000 mon.a (mon.0) 643 : audit [INF] from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi057", "root=default"]}]': finished 2020-11-16T21:59:26.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:26 smithi057 bash[10301]: cluster 2020-11-16T21:59:25.577562+0000 mon.a (mon.0) 644 : cluster [DBG] osdmap e67: 12 total, 11 up, 11 in 2020-11-16T21:59:26.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:26 smithi057 bash[10301]: audit 2020-11-16T21:59:25.580793+0000 mon.b (mon.1) 276 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2020-11-16T21:59:26.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:26 smithi057 bash[10301]: audit 2020-11-16T21:59:25.586891+0000 mon.b (mon.1) 277 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2020-11-16T21:59:26.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:26 smithi057 bash[10301]: audit 2020-11-16T21:59:26.416850+0000 mon.a (mon.0) 645 : audit [INF] from='client.24451 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-11-16T21:59:26.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:26 smithi057 bash[10301]: audit 2020-11-16T21:59:26.418656+0000 mon.b (mon.1) 278 : audit [INF] from='client.? v1:172.21.15.16:0/1654468286' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-11-16T21:59:26.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:26 smithi057 bash[10301]: audit 2020-11-16T21:59:26.423752+0000 mon.a (mon.0) 646 : audit [INF] from='client.24451 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-11-16T21:59:27.101 INFO:teuthology.orchestra.run.smithi016:> set -ex 2020-11-16T21:59:27.102 INFO:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2020-11-16T21:59:27.102 INFO:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-11-16T21:59:27.107 INFO:teuthology.orchestra.run.smithi016.stderr:+ sudo dd of=/etc/ceph/ceph.client.1.keyring 2020-11-16T21:59:27.116 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2020-11-16T21:59:27.116 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2020-11-16T21:59:27.116 INFO:teuthology.orchestra.run.smithi016.stderr:59 bytes copied, 3.9834e-05 s, 1.5 MB/s 2020-11-16T21:59:27.117 INFO:teuthology.orchestra.run.smithi016.stderr:+ sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-11-16T21:59:27.126 INFO:teuthology.orchestra.run.smithi057:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph auth get-or-create client.2 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2020-11-16T21:59:27.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:27 smithi195 bash[10218]: cluster 2020-11-16T21:59:24.926377+0000 osd.11 (osd.11) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:59:27.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:27 smithi195 bash[10218]: cluster 2020-11-16T21:59:24.926542+0000 osd.11 (osd.11) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:59:27.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:27 smithi195 bash[10218]: audit 2020-11-16T21:59:26.587513+0000 mon.b (mon.1) 279 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2020-11-16T21:59:27.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:27 smithi195 bash[10218]: cluster 2020-11-16T21:59:26.589974+0000 mon.a (mon.0) 647 : cluster [INF] osd.11 v1:172.21.15.57:6812/3378371863 boot 2020-11-16T21:59:27.853 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:27 smithi195 bash[10218]: cluster 2020-11-16T21:59:26.590059+0000 mon.a (mon.0) 648 : cluster [DBG] osdmap e68: 12 total, 12 up, 12 in 2020-11-16T21:59:27.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:27 smithi057 bash[10301]: cluster 2020-11-16T21:59:24.926377+0000 osd.11 (osd.11) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:59:27.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:27 smithi057 bash[10301]: cluster 2020-11-16T21:59:24.926542+0000 osd.11 (osd.11) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:59:27.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:27 smithi057 bash[10301]: audit 2020-11-16T21:59:26.587513+0000 mon.b (mon.1) 279 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2020-11-16T21:59:27.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:27 smithi057 bash[10301]: cluster 2020-11-16T21:59:26.589974+0000 mon.a (mon.0) 647 : cluster [INF] osd.11 v1:172.21.15.57:6812/3378371863 boot 2020-11-16T21:59:27.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:27 smithi057 bash[10301]: cluster 2020-11-16T21:59:26.590059+0000 mon.a (mon.0) 648 : cluster [DBG] osdmap e68: 12 total, 12 up, 12 in 2020-11-16T21:59:28.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:27 smithi016 bash[10302]: cluster 2020-11-16T21:59:24.926377+0000 osd.11 (osd.11) 1 : cluster [DBG] purged_snaps scrub starts 2020-11-16T21:59:28.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:27 smithi016 bash[10302]: cluster 2020-11-16T21:59:24.926542+0000 osd.11 (osd.11) 2 : cluster [DBG] purged_snaps scrub ok 2020-11-16T21:59:28.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:27 smithi016 bash[10302]: audit 2020-11-16T21:59:26.587513+0000 mon.b (mon.1) 279 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2020-11-16T21:59:28.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:27 smithi016 bash[10302]: cluster 2020-11-16T21:59:26.589974+0000 mon.a (mon.0) 647 : cluster [INF] osd.11 v1:172.21.15.57:6812/3378371863 boot 2020-11-16T21:59:28.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:27 smithi016 bash[10302]: cluster 2020-11-16T21:59:26.590059+0000 mon.a (mon.0) 648 : cluster [DBG] osdmap e68: 12 total, 12 up, 12 in 2020-11-16T21:59:28.633 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:28 smithi057 bash[10301]: cluster 2020-11-16T21:59:27.518405+0000 mgr.x (mgr.24115) 200 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:28.633 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:28 smithi057 bash[10301]: cluster 2020-11-16T21:59:27.592149+0000 mon.a (mon.0) 649 : cluster [DBG] osdmap e69: 12 total, 12 up, 12 in 2020-11-16T21:59:28.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:28 smithi195 bash[10218]: cluster 2020-11-16T21:59:27.518405+0000 mgr.x (mgr.24115) 200 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:28.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:28 smithi195 bash[10218]: cluster 2020-11-16T21:59:27.592149+0000 mon.a (mon.0) 649 : cluster [DBG] osdmap e69: 12 total, 12 up, 12 in 2020-11-16T21:59:29.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:28 smithi016 bash[10302]: cluster 2020-11-16T21:59:27.518405+0000 mgr.x (mgr.24115) 200 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 60 MiB used, 983 GiB / 983 GiB avail 2020-11-16T21:59:29.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:28 smithi016 bash[10302]: cluster 2020-11-16T21:59:27.592149+0000 mon.a (mon.0) 649 : cluster [DBG] osdmap e69: 12 total, 12 up, 12 in 2020-11-16T21:59:30.616 INFO:teuthology.orchestra.run.smithi057.stdout:[client.2] 2020-11-16T21:59:30.616 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBC9rJfTTXRJBAAHVpjJs61OOO66RsyW/VRVQ== 2020-11-16T21:59:30.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:30 smithi016 bash[10302]: cluster 2020-11-16T21:59:29.519103+0000 mgr.x (mgr.24115) 201 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 65 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:30.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:30 smithi016 bash[10302]: audit 2020-11-16T21:59:29.706848+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:59:30.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:30 smithi016 bash[10302]: audit 2020-11-16T21:59:29.708524+0000 mon.b (mon.1) 280 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:59:30.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:30 smithi016 bash[10302]: audit 2020-11-16T21:59:29.713143+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:59:30.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:30 smithi016 bash[10302]: audit 2020-11-16T21:59:29.714909+0000 mon.b (mon.1) 281 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:59:30.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:30 smithi195 bash[10218]: cluster 2020-11-16T21:59:29.519103+0000 mgr.x (mgr.24115) 201 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 65 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:30.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:30 smithi195 bash[10218]: audit 2020-11-16T21:59:29.706848+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:59:30.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:30 smithi195 bash[10218]: audit 2020-11-16T21:59:29.708524+0000 mon.b (mon.1) 280 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:59:30.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:30 smithi195 bash[10218]: audit 2020-11-16T21:59:29.713143+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:59:30.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:30 smithi195 bash[10218]: audit 2020-11-16T21:59:29.714909+0000 mon.b (mon.1) 281 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:59:30.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:30 smithi057 bash[10301]: cluster 2020-11-16T21:59:29.519103+0000 mgr.x (mgr.24115) 201 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 65 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:30 smithi057 bash[10301]: audit 2020-11-16T21:59:29.706848+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:59:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:30 smithi057 bash[10301]: audit 2020-11-16T21:59:29.708524+0000 mon.b (mon.1) 280 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T21:59:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:30 smithi057 bash[10301]: audit 2020-11-16T21:59:29.713143+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:59:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:30 smithi057 bash[10301]: audit 2020-11-16T21:59:29.714909+0000 mon.b (mon.1) 281 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T21:59:31.275 INFO:teuthology.orchestra.run.smithi057:> set -ex 2020-11-16T21:59:31.276 INFO:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.client.2.keyring 2020-11-16T21:59:31.276 INFO:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2020-11-16T21:59:31.279 INFO:teuthology.orchestra.run.smithi057.stderr:+ sudo dd of=/etc/ceph/ceph.client.2.keyring 2020-11-16T21:59:31.289 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records in 2020-11-16T21:59:31.289 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records out 2020-11-16T21:59:31.290 INFO:teuthology.orchestra.run.smithi057.stderr:59 bytes copied, 7.1605e-05 s, 824 kB/s 2020-11-16T21:59:31.290 INFO:teuthology.orchestra.run.smithi057.stderr:+ sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2020-11-16T21:59:31.297 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd dump --format=json 2020-11-16T21:59:31.439 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T21:59:31.602 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:31 smithi195 bash[10218]: audit 2020-11-16T21:59:30.617380+0000 mon.a (mon.0) 652 : audit [INF] from='client.34460 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-11-16T21:59:31.602 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:31 smithi195 bash[10218]: audit 2020-11-16T21:59:30.619314+0000 mon.c (mon.2) 19 : audit [INF] from='client.? v1:172.21.15.57:0/1833538028' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-11-16T21:59:31.603 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:31 smithi195 bash[10218]: audit 2020-11-16T21:59:30.624977+0000 mon.a (mon.0) 653 : audit [INF] from='client.34460 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-11-16T21:59:31.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:31 smithi057 bash[10301]: audit 2020-11-16T21:59:30.617380+0000 mon.a (mon.0) 652 : audit [INF] from='client.34460 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-11-16T21:59:31.697 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:31 smithi057 bash[10301]: audit 2020-11-16T21:59:30.619314+0000 mon.c (mon.2) 19 : audit [INF] from='client.? v1:172.21.15.57:0/1833538028' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-11-16T21:59:31.698 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:31 smithi057 bash[10301]: audit 2020-11-16T21:59:30.624977+0000 mon.a (mon.0) 653 : audit [INF] from='client.34460 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-11-16T21:59:31.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:31 smithi016 bash[10302]: audit 2020-11-16T21:59:30.617380+0000 mon.a (mon.0) 652 : audit [INF] from='client.34460 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-11-16T21:59:31.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:31 smithi016 bash[10302]: audit 2020-11-16T21:59:30.619314+0000 mon.c (mon.2) 19 : audit [INF] from='client.? v1:172.21.15.57:0/1833538028' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2020-11-16T21:59:31.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:31 smithi016 bash[10302]: audit 2020-11-16T21:59:30.624977+0000 mon.a (mon.0) 653 : audit [INF] from='client.34460 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2020-11-16T21:59:32.740 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:32 smithi195 bash[10218]: cluster 2020-11-16T21:59:31.519782+0000 mgr.x (mgr.24115) 202 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:32.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:32 smithi016 bash[10302]: cluster 2020-11-16T21:59:31.519782+0000 mgr.x (mgr.24115) 202 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:32.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:32 smithi057 bash[10301]: cluster 2020-11-16T21:59:31.519782+0000 mgr.x (mgr.24115) 202 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:34.456 INFO:teuthology.orchestra.run.smithi195.stdout: 2020-11-16T21:59:34.457 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":69,"fsid":"bcd5108e-2855-11eb-a2b2-001a4aab830c","created":"2020-11-16T21:51:02.722809+0000","modified":"2020-11-16T21:59:27.585666+0000","last_up_change":"2020-11-16T21:59:26.574799+0000","last_in_change":"2020-11-16T21:59:26.574799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-16T21:53:15.914744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"e17765a8-0ee0-47d6-8c45-96b8e46dbd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6800","nonce":3519378370}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6801","nonce":3519378370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6803","nonce":3519378370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6802","nonce":3519378370}]},"public_addr":"172.21.15.195:6800/3519378370","cluster_addr":"172.21.15.195:6801/3519378370","heartbeat_back_addr":"172.21.15.195:6803/3519378370","heartbeat_front_addr":"172.21.15.195:6802/3519378370","state":["exists","up"]},{"osd":1,"uuid":"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6804","nonce":2842524876}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6805","nonce":2842524876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6807","nonce":2842524876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6806","nonce":2842524876}]},"public_addr":"172.21.15.195:6804/2842524876","cluster_addr":"172.21.15.195:6805/2842524876","heartbeat_back_addr":"172.21.15.195:6807/2842524876","heartbeat_front_addr":"172.21.15.195:6806/2842524876","state":["exists","up"]},{"osd":2,"uuid":"25dcebff-95d0-47a0-8efb-c3b66ee68eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6808","nonce":2181977746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6809","nonce":2181977746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6811","nonce":2181977746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6810","nonce":2181977746}]},"public_addr":"172.21.15.195:6808/2181977746","cluster_addr":"172.21.15.195:6809/2181977746","heartbeat_back_addr":"172.21.15.195:6811/2181977746","heartbeat_front_addr":"172.21.15.195:6810/2181977746","state":["exists","up"]},{"osd":3,"uuid":"8832539b-0ff5-4887-a8a1-005008fd830a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6812","nonce":825751928}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6813","nonce":825751928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6815","nonce":825751928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6814","nonce":825751928}]},"public_addr":"172.21.15.195:6812/825751928","cluster_addr":"172.21.15.195:6813/825751928","heartbeat_back_addr":"172.21.15.195:6815/825751928","heartbeat_front_addr":"172.21.15.195:6814/825751928","state":["exists","up"]},{"osd":4,"uuid":"4bd595de-1740-4bdb-97b2-c346b366d299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6801","nonce":1979089250}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6802","nonce":1979089250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6804","nonce":1979089250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6803","nonce":1979089250}]},"public_addr":"172.21.15.16:6801/1979089250","cluster_addr":"172.21.15.16:6802/1979089250","heartbeat_back_addr":"172.21.15.16:6804/1979089250","heartbeat_front_addr":"172.21.15.16:6803/1979089250","state":["exists","up"]},{"osd":5,"uuid":"b114510c-b7e9-48b0-8056-0a0fd4299259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6805","nonce":4180994375}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6806","nonce":4180994375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6808","nonce":4180994375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6807","nonce":4180994375}]},"public_addr":"172.21.15.16:6805/4180994375","cluster_addr":"172.21.15.16:6806/4180994375","heartbeat_back_addr":"172.21.15.16:6808/4180994375","heartbeat_front_addr":"172.21.15.16:6807/4180994375","state":["exists","up"]},{"osd":6,"uuid":"a6fae614-5672-4ca8-bd91-5625e1525a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6809","nonce":1747555876}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6810","nonce":1747555876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6812","nonce":1747555876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6811","nonce":1747555876}]},"public_addr":"172.21.15.16:6809/1747555876","cluster_addr":"172.21.15.16:6810/1747555876","heartbeat_back_addr":"172.21.15.16:6812/1747555876","heartbeat_front_addr":"172.21.15.16:6811/1747555876","state":["exists","up"]},{"osd":7,"uuid":"2329bb51-31d3-4e24-89eb-dd4269482cb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6813","nonce":4071463289}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6814","nonce":4071463289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6816","nonce":4071463289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6815","nonce":4071463289}]},"public_addr":"172.21.15.16:6813/4071463289","cluster_addr":"172.21.15.16:6814/4071463289","heartbeat_back_addr":"172.21.15.16:6816/4071463289","heartbeat_front_addr":"172.21.15.16:6815/4071463289","state":["exists","up"]},{"osd":8,"uuid":"4eaa536f-253e-460d-a65d-221dd0924d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":2452828964}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":2452828964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":2452828964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":2452828964}]},"public_addr":"172.21.15.57:6800/2452828964","cluster_addr":"172.21.15.57:6801/2452828964","heartbeat_back_addr":"172.21.15.57:6803/2452828964","heartbeat_front_addr":"172.21.15.57:6802/2452828964","state":["exists","up"]},{"osd":9,"uuid":"fcb83bc5-7834-4510-8fe9-40074b8dc739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":1543210377}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":1543210377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":1543210377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":1543210377}]},"public_addr":"172.21.15.57:6804/1543210377","cluster_addr":"172.21.15.57:6805/1543210377","heartbeat_back_addr":"172.21.15.57:6807/1543210377","heartbeat_front_addr":"172.21.15.57:6806/1543210377","state":["exists","up"]},{"osd":10,"uuid":"f96ec9f0-97cf-4382-a66a-eddbe351df6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":12217522}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":12217522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":12217522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":12217522}]},"public_addr":"172.21.15.57:6808/12217522","cluster_addr":"172.21.15.57:6809/12217522","heartbeat_back_addr":"172.21.15.57:6811/12217522","heartbeat_front_addr":"172.21.15.57:6810/12217522","state":["exists","up"]},{"osd":11,"uuid":"ac30fc92-b414-4fe6-8ca4-f3f4bab38156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":3378371863}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":3378371863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":3378371863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":3378371863}]},"public_addr":"172.21.15.57:6812/3378371863","cluster_addr":"172.21.15.57:6813/3378371863","heartbeat_back_addr":"172.21.15.57:6815/3378371863","heartbeat_front_addr":"172.21.15.57:6814/3378371863","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:54:50.400290+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:55:13.927068+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:55:37.004032+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:56:03.418071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:56:27.665747+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:56:52.959802+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:57:17.918719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:57:42.763793+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:58:07.409888+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:58:34.395975+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:58:59.712301+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:59:24.926548+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.195:6800/2315309247":"2020-11-17T21:54:29.414415+0000","172.21.15.195:0/3155915619":"2020-11-17T21:54:29.414415+0000","172.21.15.195:0/1371401498":"2020-11-17T21:54:29.414415+0000","172.21.15.195:6800/3473350336":"2020-11-17T21:51:47.874337+0000","172.21.15.195:0/2605686555":"2020-11-17T21:51:47.874337+0000","172.21.15.195:0/2944342344":"2020-11-17T21:51:47.874337+0000","172.21.15.195:0/3952937853":"2020-11-17T21:51:27.690720+0000","172.21.15.195:0/4048385390":"2020-11-17T21:51:27.690720+0000","172.21.15.195:6800/4059900539":"2020-11-17T21:51:27.690720+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-16T21:59:34.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:34 smithi016 bash[10302]: cluster 2020-11-16T21:59:33.520408+0000 mgr.x (mgr.24115) 203 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:34.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:34 smithi016 bash[10302]: audit 2020-11-16T21:59:34.463773+0000 mon.a (mon.0) 654 : audit [DBG] from='client.? v1:172.21.15.195:0/3813903356' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-11-16T21:59:34.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:34 smithi195 bash[10218]: cluster 2020-11-16T21:59:33.520408+0000 mgr.x (mgr.24115) 203 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:34.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:34 smithi195 bash[10218]: audit 2020-11-16T21:59:34.463773+0000 mon.a (mon.0) 654 : audit [DBG] from='client.? v1:172.21.15.195:0/3813903356' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-11-16T21:59:34.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:34 smithi057 bash[10301]: cluster 2020-11-16T21:59:33.520408+0000 mgr.x (mgr.24115) 203 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:34.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:34 smithi057 bash[10301]: audit 2020-11-16T21:59:34.463773+0000 mon.a (mon.0) 654 : audit [DBG] from='client.? v1:172.21.15.195:0/3813903356' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-11-16T21:59:35.090 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-16T21:53:15.914744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2020-11-16T21:59:35.091 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2020-11-16T21:59:35.229 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T21:59:35.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:35 smithi016 bash[10302]: audit 2020-11-16T21:59:34.719904+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}, {\"id\": \"586ab02d-3da8-4732-83da-2675e8b8e71f\", \"message\": \"Rebalancing after osd.11 marked in\", \"refs\": [[\"osd\", 11]], \"started_at\": 1605563966.5920315, \"finished_at\": 1605563972.7228115, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:59:35.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:35 smithi016 bash[10302]: audit 2020-11-16T21:59:34.721250+0000 mon.b (mon.1) 282 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}, {\"id\": \"586ab02d-3da8-4732-83da-2675e8b8e71f\", \"message\": \"Rebalancing after osd.11 marked in\", \"refs\": [[\"osd\", 11]], \"started_at\": 1605563966.5920315, \"finished_at\": 1605563972.7228115, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:59:35.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:35 smithi016 bash[10302]: audit 2020-11-16T21:59:34.725955+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}, {\"id\": \"586ab02d-3da8-4732-83da-2675e8b8e71f\", \"message\": \"Rebalancing after osd.11 marked in\", \"refs\": [[\"osd\", 11]], \"started_at\": 1605563966.5920315, \"finished_at\": 1605563972.7228115, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-11-16T21:59:35.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:35 smithi195 bash[10218]: audit 2020-11-16T21:59:34.719904+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}, {\"id\": \"586ab02d-3da8-4732-83da-2675e8b8e71f\", \"message\": \"Rebalancing after osd.11 marked in\", \"refs\": [[\"osd\", 11]], \"started_at\": 1605563966.5920315, \"finished_at\": 1605563972.7228115, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:59:35.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:35 smithi195 bash[10218]: audit 2020-11-16T21:59:34.721250+0000 mon.b (mon.1) 282 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}, {\"id\": \"586ab02d-3da8-4732-83da-2675e8b8e71f\", \"message\": \"Rebalancing after osd.11 marked in\", \"refs\": [[\"osd\", 11]], \"started_at\": 1605563966.5920315, \"finished_at\": 1605563972.7228115, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:59:35.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:35 smithi195 bash[10218]: audit 2020-11-16T21:59:34.725955+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}, {\"id\": \"586ab02d-3da8-4732-83da-2675e8b8e71f\", \"message\": \"Rebalancing after osd.11 marked in\", \"refs\": [[\"osd\", 11]], \"started_at\": 1605563966.5920315, \"finished_at\": 1605563972.7228115, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-11-16T21:59:35.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:35 smithi057 bash[10301]: audit 2020-11-16T21:59:34.719904+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}, {\"id\": \"586ab02d-3da8-4732-83da-2675e8b8e71f\", \"message\": \"Rebalancing after osd.11 marked in\", \"refs\": [[\"osd\", 11]], \"started_at\": 1605563966.5920315, \"finished_at\": 1605563972.7228115, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:59:35.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:35 smithi057 bash[10301]: audit 2020-11-16T21:59:34.721250+0000 mon.b (mon.1) 282 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}, {\"id\": \"586ab02d-3da8-4732-83da-2675e8b8e71f\", \"message\": \"Rebalancing after osd.11 marked in\", \"refs\": [[\"osd\", 11]], \"started_at\": 1605563966.5920315, \"finished_at\": 1605563972.7228115, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2020-11-16T21:59:35.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:35 smithi057 bash[10301]: audit 2020-11-16T21:59:34.725955+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"d3d3f4d8-888b-4ba7-a9fd-4c62360a47ed\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1605563814.5707788, \"finished_at\": 1605563829.933309, \"add_to_ceph_s:\": false}, {\"id\": \"d26b6296-9668-4386-91d5-e1bfdaddf159\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1605563839.7218053, \"finished_at\": 1605563855.912455, \"add_to_ceph_s:\": false}, {\"id\": \"522fc571-9180-41c8-aaef-582eba827e79\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1605563864.5764174, \"finished_at\": 1605563879.2540488, \"add_to_ceph_s:\": false}, {\"id\": \"35bbe179-5476-49ad-8a98-82e97f765fdb\", \"message\": \"Rebalancing after osd.8 marked in\", \"refs\": [[\"osd\", 8]], \"started_at\": 1605563888.7324736, \"finished_at\": 1605563905.9339666, \"add_to_ceph_s:\": false}, {\"id\": \"586ab02d-3da8-4732-83da-2675e8b8e71f\", \"message\": \"Rebalancing after osd.11 marked in\", \"refs\": [[\"osd\", 11]], \"started_at\": 1605563966.5920315, \"finished_at\": 1605563972.7228115, \"add_to_ceph_s:\": false}], \"version\": 2, \"compat_version\": 2}"}]': finished 2020-11-16T21:59:36.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:36 smithi195 bash[10218]: cluster 2020-11-16T21:59:35.521004+0000 mgr.x (mgr.24115) 204 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:37.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:36 smithi016 bash[10302]: cluster 2020-11-16T21:59:35.521004+0000 mgr.x (mgr.24115) 204 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:37.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:36 smithi057 bash[10301]: cluster 2020-11-16T21:59:35.521004+0000 mgr.x (mgr.24115) 204 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:38.237 INFO:teuthology.orchestra.run.smithi195.stdout:pg_num: 1 2020-11-16T21:59:38.864 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-11-16T21:59:38.865 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2020-11-16T21:59:38.865 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph mgr dump --format=json 2020-11-16T21:59:39.000 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T21:59:39.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:38 smithi016 bash[10302]: cluster 2020-11-16T21:59:37.521749+0000 mgr.x (mgr.24115) 205 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:39.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:38 smithi016 bash[10302]: audit 2020-11-16T21:59:38.246714+0000 mon.a (mon.0) 657 : audit [DBG] from='client.? v1:172.21.15.195:0/2278217191' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2020-11-16T21:59:39.101 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:38 smithi195 bash[10218]: cluster 2020-11-16T21:59:37.521749+0000 mgr.x (mgr.24115) 205 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:39.102 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:38 smithi195 bash[10218]: audit 2020-11-16T21:59:38.246714+0000 mon.a (mon.0) 657 : audit [DBG] from='client.? v1:172.21.15.195:0/2278217191' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2020-11-16T21:59:39.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:38 smithi057 bash[10301]: cluster 2020-11-16T21:59:37.521749+0000 mgr.x (mgr.24115) 205 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:39.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:38 smithi057 bash[10301]: audit 2020-11-16T21:59:38.246714+0000 mon.a (mon.0) 657 : audit [DBG] from='client.? v1:172.21.15.195:0/2278217191' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2020-11-16T21:59:40.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:40 smithi016 bash[10302]: cluster 2020-11-16T21:59:39.522384+0000 mgr.x (mgr.24115) 206 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:40.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:40 smithi195 bash[10218]: cluster 2020-11-16T21:59:39.522384+0000 mgr.x (mgr.24115) 206 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:40.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:40 smithi057 bash[10301]: cluster 2020-11-16T21:59:39.522384+0000 mgr.x (mgr.24115) 206 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:42.020 INFO:teuthology.orchestra.run.smithi195.stdout: 2020-11-16T21:59:42.618 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":17,"active_gid":24115,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6800","nonce":3867444374}]},"active_addr":"172.21.15.16:6800/3867444374","active_change":"2020-11-16T21:54:29.415257+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi016.front.sepia.ceph.com:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":7,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":1381504538}]},{"addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":771918388}]}]}} 2020-11-16T21:59:42.621 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2020-11-16T21:59:42.621 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2020-11-16T21:59:42.621 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd dump --format=json 2020-11-16T21:59:42.759 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T21:59:42.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:42 smithi016 bash[10302]: cluster 2020-11-16T21:59:41.523044+0000 mgr.x (mgr.24115) 207 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:42.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:42 smithi016 bash[10302]: audit 2020-11-16T21:59:42.025256+0000 mon.a (mon.0) 658 : audit [DBG] from='client.? v1:172.21.15.195:0/2813041148' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2020-11-16T21:59:42.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:42 smithi195 bash[10218]: cluster 2020-11-16T21:59:41.523044+0000 mgr.x (mgr.24115) 207 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:42.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:42 smithi195 bash[10218]: audit 2020-11-16T21:59:42.025256+0000 mon.a (mon.0) 658 : audit [DBG] from='client.? v1:172.21.15.195:0/2813041148' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2020-11-16T21:59:42.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:42 smithi057 bash[10301]: cluster 2020-11-16T21:59:41.523044+0000 mgr.x (mgr.24115) 207 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:42.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:42 smithi057 bash[10301]: audit 2020-11-16T21:59:42.025256+0000 mon.a (mon.0) 658 : audit [DBG] from='client.? v1:172.21.15.195:0/2813041148' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2020-11-16T21:59:44.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:44 smithi016 bash[10302]: cluster 2020-11-16T21:59:43.523661+0000 mgr.x (mgr.24115) 208 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:44.890 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:44 smithi195 bash[10218]: cluster 2020-11-16T21:59:43.523661+0000 mgr.x (mgr.24115) 208 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:44.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:44 smithi057 bash[10301]: cluster 2020-11-16T21:59:43.523661+0000 mgr.x (mgr.24115) 208 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:45.735 INFO:teuthology.orchestra.run.smithi195.stdout: 2020-11-16T21:59:45.735 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":69,"fsid":"bcd5108e-2855-11eb-a2b2-001a4aab830c","created":"2020-11-16T21:51:02.722809+0000","modified":"2020-11-16T21:59:27.585666+0000","last_up_change":"2020-11-16T21:59:26.574799+0000","last_in_change":"2020-11-16T21:59:26.574799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-16T21:53:15.914744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"e17765a8-0ee0-47d6-8c45-96b8e46dbd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6800","nonce":3519378370}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6801","nonce":3519378370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6803","nonce":3519378370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6802","nonce":3519378370}]},"public_addr":"172.21.15.195:6800/3519378370","cluster_addr":"172.21.15.195:6801/3519378370","heartbeat_back_addr":"172.21.15.195:6803/3519378370","heartbeat_front_addr":"172.21.15.195:6802/3519378370","state":["exists","up"]},{"osd":1,"uuid":"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6804","nonce":2842524876}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6805","nonce":2842524876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6807","nonce":2842524876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6806","nonce":2842524876}]},"public_addr":"172.21.15.195:6804/2842524876","cluster_addr":"172.21.15.195:6805/2842524876","heartbeat_back_addr":"172.21.15.195:6807/2842524876","heartbeat_front_addr":"172.21.15.195:6806/2842524876","state":["exists","up"]},{"osd":2,"uuid":"25dcebff-95d0-47a0-8efb-c3b66ee68eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6808","nonce":2181977746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6809","nonce":2181977746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6811","nonce":2181977746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6810","nonce":2181977746}]},"public_addr":"172.21.15.195:6808/2181977746","cluster_addr":"172.21.15.195:6809/2181977746","heartbeat_back_addr":"172.21.15.195:6811/2181977746","heartbeat_front_addr":"172.21.15.195:6810/2181977746","state":["exists","up"]},{"osd":3,"uuid":"8832539b-0ff5-4887-a8a1-005008fd830a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6812","nonce":825751928}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6813","nonce":825751928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6815","nonce":825751928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6814","nonce":825751928}]},"public_addr":"172.21.15.195:6812/825751928","cluster_addr":"172.21.15.195:6813/825751928","heartbeat_back_addr":"172.21.15.195:6815/825751928","heartbeat_front_addr":"172.21.15.195:6814/825751928","state":["exists","up"]},{"osd":4,"uuid":"4bd595de-1740-4bdb-97b2-c346b366d299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6801","nonce":1979089250}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6802","nonce":1979089250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6804","nonce":1979089250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6803","nonce":1979089250}]},"public_addr":"172.21.15.16:6801/1979089250","cluster_addr":"172.21.15.16:6802/1979089250","heartbeat_back_addr":"172.21.15.16:6804/1979089250","heartbeat_front_addr":"172.21.15.16:6803/1979089250","state":["exists","up"]},{"osd":5,"uuid":"b114510c-b7e9-48b0-8056-0a0fd4299259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6805","nonce":4180994375}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6806","nonce":4180994375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6808","nonce":4180994375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6807","nonce":4180994375}]},"public_addr":"172.21.15.16:6805/4180994375","cluster_addr":"172.21.15.16:6806/4180994375","heartbeat_back_addr":"172.21.15.16:6808/4180994375","heartbeat_front_addr":"172.21.15.16:6807/4180994375","state":["exists","up"]},{"osd":6,"uuid":"a6fae614-5672-4ca8-bd91-5625e1525a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6809","nonce":1747555876}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6810","nonce":1747555876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6812","nonce":1747555876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6811","nonce":1747555876}]},"public_addr":"172.21.15.16:6809/1747555876","cluster_addr":"172.21.15.16:6810/1747555876","heartbeat_back_addr":"172.21.15.16:6812/1747555876","heartbeat_front_addr":"172.21.15.16:6811/1747555876","state":["exists","up"]},{"osd":7,"uuid":"2329bb51-31d3-4e24-89eb-dd4269482cb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6813","nonce":4071463289}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6814","nonce":4071463289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6816","nonce":4071463289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6815","nonce":4071463289}]},"public_addr":"172.21.15.16:6813/4071463289","cluster_addr":"172.21.15.16:6814/4071463289","heartbeat_back_addr":"172.21.15.16:6816/4071463289","heartbeat_front_addr":"172.21.15.16:6815/4071463289","state":["exists","up"]},{"osd":8,"uuid":"4eaa536f-253e-460d-a65d-221dd0924d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":2452828964}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":2452828964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":2452828964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":2452828964}]},"public_addr":"172.21.15.57:6800/2452828964","cluster_addr":"172.21.15.57:6801/2452828964","heartbeat_back_addr":"172.21.15.57:6803/2452828964","heartbeat_front_addr":"172.21.15.57:6802/2452828964","state":["exists","up"]},{"osd":9,"uuid":"fcb83bc5-7834-4510-8fe9-40074b8dc739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":1543210377}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":1543210377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":1543210377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":1543210377}]},"public_addr":"172.21.15.57:6804/1543210377","cluster_addr":"172.21.15.57:6805/1543210377","heartbeat_back_addr":"172.21.15.57:6807/1543210377","heartbeat_front_addr":"172.21.15.57:6806/1543210377","state":["exists","up"]},{"osd":10,"uuid":"f96ec9f0-97cf-4382-a66a-eddbe351df6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":12217522}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":12217522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":12217522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":12217522}]},"public_addr":"172.21.15.57:6808/12217522","cluster_addr":"172.21.15.57:6809/12217522","heartbeat_back_addr":"172.21.15.57:6811/12217522","heartbeat_front_addr":"172.21.15.57:6810/12217522","state":["exists","up"]},{"osd":11,"uuid":"ac30fc92-b414-4fe6-8ca4-f3f4bab38156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":3378371863}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":3378371863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":3378371863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":3378371863}]},"public_addr":"172.21.15.57:6812/3378371863","cluster_addr":"172.21.15.57:6813/3378371863","heartbeat_back_addr":"172.21.15.57:6815/3378371863","heartbeat_front_addr":"172.21.15.57:6814/3378371863","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:54:50.400290+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:55:13.927068+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:55:37.004032+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:56:03.418071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:56:27.665747+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:56:52.959802+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:57:17.918719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:57:42.763793+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:58:07.409888+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:58:34.395975+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:58:59.712301+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:59:24.926548+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.195:6800/2315309247":"2020-11-17T21:54:29.414415+0000","172.21.15.195:0/3155915619":"2020-11-17T21:54:29.414415+0000","172.21.15.195:0/1371401498":"2020-11-17T21:54:29.414415+0000","172.21.15.195:6800/3473350336":"2020-11-17T21:51:47.874337+0000","172.21.15.195:0/2605686555":"2020-11-17T21:51:47.874337+0000","172.21.15.195:0/2944342344":"2020-11-17T21:51:47.874337+0000","172.21.15.195:0/3952937853":"2020-11-17T21:51:27.690720+0000","172.21.15.195:0/4048385390":"2020-11-17T21:51:27.690720+0000","172.21.15.195:6800/4059900539":"2020-11-17T21:51:27.690720+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-16T21:59:46.372 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2020-11-16T21:59:46.373 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd dump --format=json 2020-11-16T21:59:46.509 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T21:59:46.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:46 smithi016 bash[10302]: cluster 2020-11-16T21:59:45.524271+0000 mgr.x (mgr.24115) 209 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:46.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:46 smithi016 bash[10302]: audit 2020-11-16T21:59:45.742662+0000 mon.a (mon.0) 659 : audit [DBG] from='client.? v1:172.21.15.195:0/4128039337' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-11-16T21:59:46.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:46 smithi195 bash[10218]: cluster 2020-11-16T21:59:45.524271+0000 mgr.x (mgr.24115) 209 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:46.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:46 smithi195 bash[10218]: audit 2020-11-16T21:59:45.742662+0000 mon.a (mon.0) 659 : audit [DBG] from='client.? v1:172.21.15.195:0/4128039337' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-11-16T21:59:46.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:46 smithi057 bash[10301]: cluster 2020-11-16T21:59:45.524271+0000 mgr.x (mgr.24115) 209 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:46.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:46 smithi057 bash[10301]: audit 2020-11-16T21:59:45.742662+0000 mon.a (mon.0) 659 : audit [DBG] from='client.? v1:172.21.15.195:0/4128039337' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-11-16T21:59:48.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:48 smithi016 bash[10302]: cluster 2020-11-16T21:59:47.524953+0000 mgr.x (mgr.24115) 210 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:48.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:48 smithi195 bash[10218]: cluster 2020-11-16T21:59:47.524953+0000 mgr.x (mgr.24115) 210 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:48.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:48 smithi057 bash[10301]: cluster 2020-11-16T21:59:47.524953+0000 mgr.x (mgr.24115) 210 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:49.488 INFO:teuthology.orchestra.run.smithi195.stdout: 2020-11-16T21:59:49.488 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":69,"fsid":"bcd5108e-2855-11eb-a2b2-001a4aab830c","created":"2020-11-16T21:51:02.722809+0000","modified":"2020-11-16T21:59:27.585666+0000","last_up_change":"2020-11-16T21:59:26.574799+0000","last_in_change":"2020-11-16T21:59:26.574799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-16T21:53:15.914744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"e17765a8-0ee0-47d6-8c45-96b8e46dbd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6800","nonce":3519378370}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6801","nonce":3519378370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6803","nonce":3519378370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6802","nonce":3519378370}]},"public_addr":"172.21.15.195:6800/3519378370","cluster_addr":"172.21.15.195:6801/3519378370","heartbeat_back_addr":"172.21.15.195:6803/3519378370","heartbeat_front_addr":"172.21.15.195:6802/3519378370","state":["exists","up"]},{"osd":1,"uuid":"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6804","nonce":2842524876}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6805","nonce":2842524876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6807","nonce":2842524876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6806","nonce":2842524876}]},"public_addr":"172.21.15.195:6804/2842524876","cluster_addr":"172.21.15.195:6805/2842524876","heartbeat_back_addr":"172.21.15.195:6807/2842524876","heartbeat_front_addr":"172.21.15.195:6806/2842524876","state":["exists","up"]},{"osd":2,"uuid":"25dcebff-95d0-47a0-8efb-c3b66ee68eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6808","nonce":2181977746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6809","nonce":2181977746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6811","nonce":2181977746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6810","nonce":2181977746}]},"public_addr":"172.21.15.195:6808/2181977746","cluster_addr":"172.21.15.195:6809/2181977746","heartbeat_back_addr":"172.21.15.195:6811/2181977746","heartbeat_front_addr":"172.21.15.195:6810/2181977746","state":["exists","up"]},{"osd":3,"uuid":"8832539b-0ff5-4887-a8a1-005008fd830a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6812","nonce":825751928}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6813","nonce":825751928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6815","nonce":825751928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6814","nonce":825751928}]},"public_addr":"172.21.15.195:6812/825751928","cluster_addr":"172.21.15.195:6813/825751928","heartbeat_back_addr":"172.21.15.195:6815/825751928","heartbeat_front_addr":"172.21.15.195:6814/825751928","state":["exists","up"]},{"osd":4,"uuid":"4bd595de-1740-4bdb-97b2-c346b366d299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6801","nonce":1979089250}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6802","nonce":1979089250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6804","nonce":1979089250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6803","nonce":1979089250}]},"public_addr":"172.21.15.16:6801/1979089250","cluster_addr":"172.21.15.16:6802/1979089250","heartbeat_back_addr":"172.21.15.16:6804/1979089250","heartbeat_front_addr":"172.21.15.16:6803/1979089250","state":["exists","up"]},{"osd":5,"uuid":"b114510c-b7e9-48b0-8056-0a0fd4299259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6805","nonce":4180994375}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6806","nonce":4180994375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6808","nonce":4180994375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6807","nonce":4180994375}]},"public_addr":"172.21.15.16:6805/4180994375","cluster_addr":"172.21.15.16:6806/4180994375","heartbeat_back_addr":"172.21.15.16:6808/4180994375","heartbeat_front_addr":"172.21.15.16:6807/4180994375","state":["exists","up"]},{"osd":6,"uuid":"a6fae614-5672-4ca8-bd91-5625e1525a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6809","nonce":1747555876}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6810","nonce":1747555876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6812","nonce":1747555876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6811","nonce":1747555876}]},"public_addr":"172.21.15.16:6809/1747555876","cluster_addr":"172.21.15.16:6810/1747555876","heartbeat_back_addr":"172.21.15.16:6812/1747555876","heartbeat_front_addr":"172.21.15.16:6811/1747555876","state":["exists","up"]},{"osd":7,"uuid":"2329bb51-31d3-4e24-89eb-dd4269482cb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6813","nonce":4071463289}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6814","nonce":4071463289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6816","nonce":4071463289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6815","nonce":4071463289}]},"public_addr":"172.21.15.16:6813/4071463289","cluster_addr":"172.21.15.16:6814/4071463289","heartbeat_back_addr":"172.21.15.16:6816/4071463289","heartbeat_front_addr":"172.21.15.16:6815/4071463289","state":["exists","up"]},{"osd":8,"uuid":"4eaa536f-253e-460d-a65d-221dd0924d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":2452828964}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":2452828964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":2452828964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":2452828964}]},"public_addr":"172.21.15.57:6800/2452828964","cluster_addr":"172.21.15.57:6801/2452828964","heartbeat_back_addr":"172.21.15.57:6803/2452828964","heartbeat_front_addr":"172.21.15.57:6802/2452828964","state":["exists","up"]},{"osd":9,"uuid":"fcb83bc5-7834-4510-8fe9-40074b8dc739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":1543210377}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":1543210377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":1543210377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":1543210377}]},"public_addr":"172.21.15.57:6804/1543210377","cluster_addr":"172.21.15.57:6805/1543210377","heartbeat_back_addr":"172.21.15.57:6807/1543210377","heartbeat_front_addr":"172.21.15.57:6806/1543210377","state":["exists","up"]},{"osd":10,"uuid":"f96ec9f0-97cf-4382-a66a-eddbe351df6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":12217522}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":12217522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":12217522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":12217522}]},"public_addr":"172.21.15.57:6808/12217522","cluster_addr":"172.21.15.57:6809/12217522","heartbeat_back_addr":"172.21.15.57:6811/12217522","heartbeat_front_addr":"172.21.15.57:6810/12217522","state":["exists","up"]},{"osd":11,"uuid":"ac30fc92-b414-4fe6-8ca4-f3f4bab38156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":3378371863}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":3378371863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":3378371863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":3378371863}]},"public_addr":"172.21.15.57:6812/3378371863","cluster_addr":"172.21.15.57:6813/3378371863","heartbeat_back_addr":"172.21.15.57:6815/3378371863","heartbeat_front_addr":"172.21.15.57:6814/3378371863","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:54:50.400290+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:55:13.927068+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:55:37.004032+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:56:03.418071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:56:27.665747+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:56:52.959802+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:57:17.918719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:57:42.763793+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:58:07.409888+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:58:34.395975+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:58:59.712301+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:59:24.926548+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.195:6800/2315309247":"2020-11-17T21:54:29.414415+0000","172.21.15.195:0/3155915619":"2020-11-17T21:54:29.414415+0000","172.21.15.195:0/1371401498":"2020-11-17T21:54:29.414415+0000","172.21.15.195:6800/3473350336":"2020-11-17T21:51:47.874337+0000","172.21.15.195:0/2605686555":"2020-11-17T21:51:47.874337+0000","172.21.15.195:0/2944342344":"2020-11-17T21:51:47.874337+0000","172.21.15.195:0/3952937853":"2020-11-17T21:51:27.690720+0000","172.21.15.195:0/4048385390":"2020-11-17T21:51:27.690720+0000","172.21.15.195:6800/4059900539":"2020-11-17T21:51:27.690720+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-16T21:59:50.107 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2020-11-16T21:59:50.235 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T21:59:50.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:50 smithi016 bash[10302]: audit 2020-11-16T21:59:49.495974+0000 mon.a (mon.0) 660 : audit [DBG] from='client.? v1:172.21.15.195:0/3019446013' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-11-16T21:59:50.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:50 smithi016 bash[10302]: cluster 2020-11-16T21:59:49.525558+0000 mgr.x (mgr.24115) 211 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:50.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:50 smithi195 bash[10218]: audit 2020-11-16T21:59:49.495974+0000 mon.a (mon.0) 660 : audit [DBG] from='client.? v1:172.21.15.195:0/3019446013' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-11-16T21:59:50.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:50 smithi195 bash[10218]: cluster 2020-11-16T21:59:49.525558+0000 mgr.x (mgr.24115) 211 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:50.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:50 smithi057 bash[10301]: audit 2020-11-16T21:59:49.495974+0000 mon.a (mon.0) 660 : audit [DBG] from='client.? v1:172.21.15.195:0/3019446013' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-11-16T21:59:50.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:50 smithi057 bash[10301]: cluster 2020-11-16T21:59:49.525558+0000 mgr.x (mgr.24115) 211 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:52.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:52 smithi016 bash[10302]: cluster 2020-11-16T21:59:51.526214+0000 mgr.x (mgr.24115) 212 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:52.843 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:52 smithi195 bash[10218]: cluster 2020-11-16T21:59:51.526214+0000 mgr.x (mgr.24115) 212 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:52.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:52 smithi057 bash[10301]: cluster 2020-11-16T21:59:51.526214+0000 mgr.x (mgr.24115) 212 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:53.653 INFO:teuthology.orchestra.run.smithi195.stdout:51539607614 2020-11-16T21:59:53.654 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2020-11-16T21:59:53.788 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T21:59:54.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:54 smithi016 bash[10302]: cluster 2020-11-16T21:59:53.526946+0000 mgr.x (mgr.24115) 213 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:54.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:54 smithi195 bash[10218]: cluster 2020-11-16T21:59:53.526946+0000 mgr.x (mgr.24115) 213 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:54.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:54 smithi057 bash[10301]: cluster 2020-11-16T21:59:53.526946+0000 mgr.x (mgr.24115) 213 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:56.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:56 smithi195 bash[10218]: cluster 2020-11-16T21:59:55.527601+0000 mgr.x (mgr.24115) 214 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:56.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:56 smithi057 bash[10301]: cluster 2020-11-16T21:59:55.527601+0000 mgr.x (mgr.24115) 214 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:57.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:56 smithi016 bash[10302]: cluster 2020-11-16T21:59:55.527601+0000 mgr.x (mgr.24115) 214 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:57.172 INFO:teuthology.orchestra.run.smithi195.stdout:77309411386 2020-11-16T21:59:57.173 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2020-11-16T21:59:57.315 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T21:59:58.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 21:59:58 smithi195 bash[10218]: cluster 2020-11-16T21:59:57.528266+0000 mgr.x (mgr.24115) 215 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:58.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 21:59:58 smithi057 bash[10301]: cluster 2020-11-16T21:59:57.528266+0000 mgr.x (mgr.24115) 215 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T21:59:59.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 21:59:58 smithi016 bash[10302]: cluster 2020-11-16T21:59:57.528266+0000 mgr.x (mgr.24115) 215 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:00.664 INFO:teuthology.orchestra.run.smithi195.stdout:98784247862 2020-11-16T22:00:00.665 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2020-11-16T22:00:00.800 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:00:00.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:00 smithi016 bash[10302]: cluster 2020-11-16T21:59:59.528865+0000 mgr.x (mgr.24115) 216 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:00.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:00 smithi016 bash[10302]: cluster 2020-11-16T22:00:00.000164+0000 mon.a (mon.0) 661 : cluster [INF] overall HEALTH_OK 2020-11-16T22:00:00.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:00 smithi195 bash[10218]: cluster 2020-11-16T21:59:59.528865+0000 mgr.x (mgr.24115) 216 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:00.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:00 smithi195 bash[10218]: cluster 2020-11-16T22:00:00.000164+0000 mon.a (mon.0) 661 : cluster [INF] overall HEALTH_OK 2020-11-16T22:00:00.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:00 smithi057 bash[10301]: cluster 2020-11-16T21:59:59.528865+0000 mgr.x (mgr.24115) 216 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:00.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:00 smithi057 bash[10301]: cluster 2020-11-16T22:00:00.000164+0000 mon.a (mon.0) 661 : cluster [INF] overall HEALTH_OK 2020-11-16T22:00:02.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:02 smithi016 bash[10302]: cluster 2020-11-16T22:00:01.529512+0000 mgr.x (mgr.24115) 217 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:02.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:02 smithi195 bash[10218]: cluster 2020-11-16T22:00:01.529512+0000 mgr.x (mgr.24115) 217 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:02.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:02 smithi057 bash[10301]: cluster 2020-11-16T22:00:01.529512+0000 mgr.x (mgr.24115) 217 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:04.213 INFO:teuthology.orchestra.run.smithi195.stdout:120259084339 2020-11-16T22:00:04.214 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2020-11-16T22:00:04.351 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:00:04.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:04 smithi016 bash[10302]: cluster 2020-11-16T22:00:03.530179+0000 mgr.x (mgr.24115) 218 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:04.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:04 smithi195 bash[10218]: cluster 2020-11-16T22:00:03.530179+0000 mgr.x (mgr.24115) 218 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:04.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:04 smithi057 bash[10301]: cluster 2020-11-16T22:00:03.530179+0000 mgr.x (mgr.24115) 218 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:06.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:06 smithi016 bash[10302]: cluster 2020-11-16T22:00:05.530756+0000 mgr.x (mgr.24115) 219 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:06.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:06 smithi195 bash[10218]: cluster 2020-11-16T22:00:05.530756+0000 mgr.x (mgr.24115) 219 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:06.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:06 smithi057 bash[10301]: cluster 2020-11-16T22:00:05.530756+0000 mgr.x (mgr.24115) 219 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:07.850 INFO:teuthology.orchestra.run.smithi195.stdout:141733920814 2020-11-16T22:00:07.851 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2020-11-16T22:00:07.985 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:00:08.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:08 smithi195 bash[10218]: cluster 2020-11-16T22:00:07.531393+0000 mgr.x (mgr.24115) 220 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:08.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:08 smithi057 bash[10301]: cluster 2020-11-16T22:00:07.531393+0000 mgr.x (mgr.24115) 220 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:09.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:08 smithi016 bash[10302]: cluster 2020-11-16T22:00:07.531393+0000 mgr.x (mgr.24115) 220 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:10.780 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:10 smithi195 bash[10218]: cluster 2020-11-16T22:00:09.532040+0000 mgr.x (mgr.24115) 221 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:10.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:10 smithi016 bash[10302]: cluster 2020-11-16T22:00:09.532040+0000 mgr.x (mgr.24115) 221 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:10.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:10 smithi057 bash[10301]: cluster 2020-11-16T22:00:09.532040+0000 mgr.x (mgr.24115) 221 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:11.319 INFO:teuthology.orchestra.run.smithi195.stdout:163208757289 2020-11-16T22:00:11.320 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2020-11-16T22:00:11.459 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:00:12.589 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:12 smithi195 bash[10218]: cluster 2020-11-16T22:00:11.532739+0000 mgr.x (mgr.24115) 222 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:12.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:12 smithi016 bash[10302]: cluster 2020-11-16T22:00:11.532739+0000 mgr.x (mgr.24115) 222 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:12.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:12 smithi057 bash[10301]: cluster 2020-11-16T22:00:11.532739+0000 mgr.x (mgr.24115) 222 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:14.785 INFO:teuthology.orchestra.run.smithi195.stdout:184683593766 2020-11-16T22:00:14.786 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2020-11-16T22:00:14.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:14 smithi016 bash[10302]: cluster 2020-11-16T22:00:13.533408+0000 mgr.x (mgr.24115) 223 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:14.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:14 smithi195 bash[10218]: cluster 2020-11-16T22:00:13.533408+0000 mgr.x (mgr.24115) 223 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:14.928 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:00:14.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:14 smithi057 bash[10301]: cluster 2020-11-16T22:00:13.533408+0000 mgr.x (mgr.24115) 223 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:16.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:16 smithi195 bash[10218]: cluster 2020-11-16T22:00:15.534010+0000 mgr.x (mgr.24115) 224 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:16.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:16 smithi057 bash[10301]: cluster 2020-11-16T22:00:15.534010+0000 mgr.x (mgr.24115) 224 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:17.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:16 smithi016 bash[10302]: cluster 2020-11-16T22:00:15.534010+0000 mgr.x (mgr.24115) 224 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:18.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:18 smithi195 bash[10218]: cluster 2020-11-16T22:00:17.534575+0000 mgr.x (mgr.24115) 225 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:18.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:18 smithi057 bash[10301]: cluster 2020-11-16T22:00:17.534575+0000 mgr.x (mgr.24115) 225 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:19.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:18 smithi016 bash[10302]: cluster 2020-11-16T22:00:17.534575+0000 mgr.x (mgr.24115) 225 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:19.269 INFO:teuthology.orchestra.run.smithi195.stdout:206158430240 2020-11-16T22:00:19.269 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph tell osd.8 flush_pg_stats 2020-11-16T22:00:19.408 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:00:20.577 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:20 smithi195 bash[10218]: cluster 2020-11-16T22:00:19.535241+0000 mgr.x (mgr.24115) 226 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:20.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:20 smithi016 bash[10302]: cluster 2020-11-16T22:00:19.535241+0000 mgr.x (mgr.24115) 226 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:20.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:20 smithi057 bash[10301]: cluster 2020-11-16T22:00:19.535241+0000 mgr.x (mgr.24115) 226 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:22.822 INFO:teuthology.orchestra.run.smithi195.stdout:227633266716 2020-11-16T22:00:22.823 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph tell osd.9 flush_pg_stats 2020-11-16T22:00:22.834 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:22 smithi195 bash[10218]: cluster 2020-11-16T22:00:21.535903+0000 mgr.x (mgr.24115) 227 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:22.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:22 smithi016 bash[10302]: cluster 2020-11-16T22:00:21.535903+0000 mgr.x (mgr.24115) 227 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:22.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:22 smithi057 bash[10301]: cluster 2020-11-16T22:00:21.535903+0000 mgr.x (mgr.24115) 227 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:22.958 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:00:24.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:24 smithi195 bash[10218]: cluster 2020-11-16T22:00:23.536549+0000 mgr.x (mgr.24115) 228 : cluster [DBG] pgmap v232: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:24.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:24 smithi057 bash[10301]: cluster 2020-11-16T22:00:23.536549+0000 mgr.x (mgr.24115) 228 : cluster [DBG] pgmap v232: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:25.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:24 smithi016 bash[10302]: cluster 2020-11-16T22:00:23.536549+0000 mgr.x (mgr.24115) 228 : cluster [DBG] pgmap v232: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:26.491 INFO:teuthology.orchestra.run.smithi195.stdout:249108103192 2020-11-16T22:00:26.492 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph tell osd.10 flush_pg_stats 2020-11-16T22:00:26.676 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:00:26.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:26 smithi195 bash[10218]: cluster 2020-11-16T22:00:25.537216+0000 mgr.x (mgr.24115) 229 : cluster [DBG] pgmap v233: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:26.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:26 smithi057 bash[10301]: cluster 2020-11-16T22:00:25.537216+0000 mgr.x (mgr.24115) 229 : cluster [DBG] pgmap v233: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:27.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:26 smithi016 bash[10302]: cluster 2020-11-16T22:00:25.537216+0000 mgr.x (mgr.24115) 229 : cluster [DBG] pgmap v233: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:28.871 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:28 smithi195 bash[10218]: cluster 2020-11-16T22:00:27.537855+0000 mgr.x (mgr.24115) 230 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:28.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:28 smithi057 bash[10301]: cluster 2020-11-16T22:00:27.537855+0000 mgr.x (mgr.24115) 230 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:29.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:28 smithi016 bash[10302]: cluster 2020-11-16T22:00:27.537855+0000 mgr.x (mgr.24115) 230 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:30.176 INFO:teuthology.orchestra.run.smithi195.stdout:270582939667 2020-11-16T22:00:30.177 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph tell osd.11 flush_pg_stats 2020-11-16T22:00:30.315 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:00:30.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:30 smithi016 bash[10302]: cluster 2020-11-16T22:00:29.538382+0000 mgr.x (mgr.24115) 231 : cluster [DBG] pgmap v235: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:30.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:30 smithi016 bash[10302]: audit 2020-11-16T22:00:29.712354+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:00:30.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:30 smithi016 bash[10302]: audit 2020-11-16T22:00:29.712520+0000 mon.b (mon.1) 283 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:00:30.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:30 smithi016 bash[10302]: audit 2020-11-16T22:00:29.719240+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:00:30.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:30 smithi016 bash[10302]: audit 2020-11-16T22:00:29.719717+0000 mon.b (mon.1) 284 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:00:30.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:30 smithi195 bash[10218]: cluster 2020-11-16T22:00:29.538382+0000 mgr.x (mgr.24115) 231 : cluster [DBG] pgmap v235: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:30.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:30 smithi195 bash[10218]: audit 2020-11-16T22:00:29.712354+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:00:30.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:30 smithi195 bash[10218]: audit 2020-11-16T22:00:29.712520+0000 mon.b (mon.1) 283 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:00:30.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:30 smithi195 bash[10218]: audit 2020-11-16T22:00:29.719240+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:00:30.852 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:30 smithi195 bash[10218]: audit 2020-11-16T22:00:29.719717+0000 mon.b (mon.1) 284 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:00:30.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:30 smithi057 bash[10301]: cluster 2020-11-16T22:00:29.538382+0000 mgr.x (mgr.24115) 231 : cluster [DBG] pgmap v235: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:30 smithi057 bash[10301]: audit 2020-11-16T22:00:29.712354+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:00:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:30 smithi057 bash[10301]: audit 2020-11-16T22:00:29.712520+0000 mon.b (mon.1) 283 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:00:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:30 smithi057 bash[10301]: audit 2020-11-16T22:00:29.719240+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:00:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:30 smithi057 bash[10301]: audit 2020-11-16T22:00:29.719717+0000 mon.b (mon.1) 284 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:00:32.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:32 smithi016 bash[10302]: cluster 2020-11-16T22:00:31.539064+0000 mgr.x (mgr.24115) 232 : cluster [DBG] pgmap v236: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:32.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:32 smithi195 bash[10218]: cluster 2020-11-16T22:00:31.539064+0000 mgr.x (mgr.24115) 232 : cluster [DBG] pgmap v236: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:32.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:32 smithi057 bash[10301]: cluster 2020-11-16T22:00:31.539064+0000 mgr.x (mgr.24115) 232 : cluster [DBG] pgmap v236: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:33.765 INFO:teuthology.orchestra.run.smithi195.stdout:292057776143 2020-11-16T22:00:33.765 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd last-stat-seq osd.0 2020-11-16T22:00:33.905 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:00:34.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:34 smithi195 bash[10218]: cluster 2020-11-16T22:00:33.539694+0000 mgr.x (mgr.24115) 233 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:34.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:34 smithi057 bash[10301]: cluster 2020-11-16T22:00:33.539694+0000 mgr.x (mgr.24115) 233 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:35.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:34 smithi016 bash[10302]: cluster 2020-11-16T22:00:33.539694+0000 mgr.x (mgr.24115) 233 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:36.765 INFO:teuthology.orchestra.run.smithi195.stdout:51539607623 2020-11-16T22:00:36.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:36 smithi195 bash[10218]: cluster 2020-11-16T22:00:35.540317+0000 mgr.x (mgr.24115) 234 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:36.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:36 smithi057 bash[10301]: cluster 2020-11-16T22:00:35.540317+0000 mgr.x (mgr.24115) 234 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:37.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:36 smithi016 bash[10302]: cluster 2020-11-16T22:00:35.540317+0000 mgr.x (mgr.24115) 234 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:37.400 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607614 got 51539607623 for osd.0 2020-11-16T22:00:37.401 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd last-stat-seq osd.1 2020-11-16T22:00:37.540 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:00:37.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:37 smithi195 bash[10218]: audit 2020-11-16T22:00:36.775992+0000 mon.a (mon.0) 664 : audit [DBG] from='client.? v1:172.21.15.195:0/633393880' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2020-11-16T22:00:37.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:37 smithi057 bash[10301]: audit 2020-11-16T22:00:36.775992+0000 mon.a (mon.0) 664 : audit [DBG] from='client.? v1:172.21.15.195:0/633393880' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2020-11-16T22:00:38.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:37 smithi016 bash[10302]: audit 2020-11-16T22:00:36.775992+0000 mon.a (mon.0) 664 : audit [DBG] from='client.? v1:172.21.15.195:0/633393880' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2020-11-16T22:00:38.724 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:38 smithi195 bash[10218]: cluster 2020-11-16T22:00:37.540939+0000 mgr.x (mgr.24115) 235 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:38.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:38 smithi057 bash[10301]: cluster 2020-11-16T22:00:37.540939+0000 mgr.x (mgr.24115) 235 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:39.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:38 smithi016 bash[10302]: cluster 2020-11-16T22:00:37.540939+0000 mgr.x (mgr.24115) 235 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:40.362 INFO:teuthology.orchestra.run.smithi195.stdout:77309411395 2020-11-16T22:00:40.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:40 smithi016 bash[10302]: cluster 2020-11-16T22:00:39.541539+0000 mgr.x (mgr.24115) 236 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:40.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:40 smithi016 bash[10302]: audit 2020-11-16T22:00:40.373573+0000 mon.a (mon.0) 665 : audit [DBG] from='client.? v1:172.21.15.195:0/2308386621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2020-11-16T22:00:40.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:40 smithi195 bash[10218]: cluster 2020-11-16T22:00:39.541539+0000 mgr.x (mgr.24115) 236 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:40.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:40 smithi195 bash[10218]: audit 2020-11-16T22:00:40.373573+0000 mon.a (mon.0) 665 : audit [DBG] from='client.? v1:172.21.15.195:0/2308386621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2020-11-16T22:00:40.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:40 smithi057 bash[10301]: cluster 2020-11-16T22:00:39.541539+0000 mgr.x (mgr.24115) 236 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:40.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:40 smithi057 bash[10301]: audit 2020-11-16T22:00:40.373573+0000 mon.a (mon.0) 665 : audit [DBG] from='client.? v1:172.21.15.195:0/2308386621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2020-11-16T22:00:40.950 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411386 got 77309411395 for osd.1 2020-11-16T22:00:40.951 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd last-stat-seq osd.2 2020-11-16T22:00:41.085 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:00:42.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:42 smithi195 bash[10218]: cluster 2020-11-16T22:00:41.542189+0000 mgr.x (mgr.24115) 237 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:42.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:42 smithi057 bash[10301]: cluster 2020-11-16T22:00:41.542189+0000 mgr.x (mgr.24115) 237 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:43.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:42 smithi016 bash[10302]: cluster 2020-11-16T22:00:41.542189+0000 mgr.x (mgr.24115) 237 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:43.977 INFO:teuthology.orchestra.run.smithi195.stdout:98784247870 2020-11-16T22:00:44.575 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247862 got 98784247870 for osd.2 2020-11-16T22:00:44.576 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd last-stat-seq osd.3 2020-11-16T22:00:44.714 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:00:44.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:44 smithi195 bash[10218]: cluster 2020-11-16T22:00:43.542859+0000 mgr.x (mgr.24115) 238 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:44.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:44 smithi195 bash[10218]: audit 2020-11-16T22:00:43.988474+0000 mon.a (mon.0) 666 : audit [DBG] from='client.? v1:172.21.15.195:0/2337053761' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2020-11-16T22:00:44.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:44 smithi057 bash[10301]: cluster 2020-11-16T22:00:43.542859+0000 mgr.x (mgr.24115) 238 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:44.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:44 smithi057 bash[10301]: audit 2020-11-16T22:00:43.988474+0000 mon.a (mon.0) 666 : audit [DBG] from='client.? v1:172.21.15.195:0/2337053761' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2020-11-16T22:00:45.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:44 smithi016 bash[10302]: cluster 2020-11-16T22:00:43.542859+0000 mgr.x (mgr.24115) 238 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:45.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:44 smithi016 bash[10302]: audit 2020-11-16T22:00:43.988474+0000 mon.a (mon.0) 666 : audit [DBG] from='client.? v1:172.21.15.195:0/2337053761' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2020-11-16T22:00:46.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:46 smithi195 bash[10218]: cluster 2020-11-16T22:00:45.543471+0000 mgr.x (mgr.24115) 239 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:46.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:46 smithi057 bash[10301]: cluster 2020-11-16T22:00:45.543471+0000 mgr.x (mgr.24115) 239 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:47.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:46 smithi016 bash[10302]: cluster 2020-11-16T22:00:45.543471+0000 mgr.x (mgr.24115) 239 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:47.695 INFO:teuthology.orchestra.run.smithi195.stdout:120259084348 2020-11-16T22:00:48.333 INFO:tasks.cephadm.ceph_manager.ceph:need seq 120259084339 got 120259084348 for osd.3 2020-11-16T22:00:48.334 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd last-stat-seq osd.4 2020-11-16T22:00:48.469 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:00:48.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:48 smithi057 bash[10301]: cluster 2020-11-16T22:00:47.544126+0000 mgr.x (mgr.24115) 240 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:48.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:48 smithi057 bash[10301]: audit 2020-11-16T22:00:47.706260+0000 mon.a (mon.0) 667 : audit [DBG] from='client.? v1:172.21.15.195:0/3821657896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2020-11-16T22:00:49.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:48 smithi016 bash[10302]: cluster 2020-11-16T22:00:47.544126+0000 mgr.x (mgr.24115) 240 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:49.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:48 smithi016 bash[10302]: audit 2020-11-16T22:00:47.706260+0000 mon.a (mon.0) 667 : audit [DBG] from='client.? v1:172.21.15.195:0/3821657896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2020-11-16T22:00:49.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:48 smithi195 bash[10218]: cluster 2020-11-16T22:00:47.544126+0000 mgr.x (mgr.24115) 240 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:49.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:48 smithi195 bash[10218]: audit 2020-11-16T22:00:47.706260+0000 mon.a (mon.0) 667 : audit [DBG] from='client.? v1:172.21.15.195:0/3821657896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2020-11-16T22:00:50.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:50 smithi016 bash[10302]: cluster 2020-11-16T22:00:49.544884+0000 mgr.x (mgr.24115) 241 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:50.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:50 smithi195 bash[10218]: cluster 2020-11-16T22:00:49.544884+0000 mgr.x (mgr.24115) 241 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:50.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:50 smithi057 bash[10301]: cluster 2020-11-16T22:00:49.544884+0000 mgr.x (mgr.24115) 241 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:51.386 INFO:teuthology.orchestra.run.smithi195.stdout:141733920822 2020-11-16T22:00:51.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:51 smithi016 bash[10302]: audit 2020-11-16T22:00:51.397609+0000 mon.a (mon.0) 668 : audit [DBG] from='client.? v1:172.21.15.195:0/2383437384' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2020-11-16T22:00:51.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:51 smithi195 bash[10218]: audit 2020-11-16T22:00:51.397609+0000 mon.a (mon.0) 668 : audit [DBG] from='client.? v1:172.21.15.195:0/2383437384' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2020-11-16T22:00:51.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:51 smithi057 bash[10301]: audit 2020-11-16T22:00:51.397609+0000 mon.a (mon.0) 668 : audit [DBG] from='client.? v1:172.21.15.195:0/2383437384' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2020-11-16T22:00:52.038 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920814 got 141733920822 for osd.4 2020-11-16T22:00:52.039 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd last-stat-seq osd.5 2020-11-16T22:00:52.171 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:00:52.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:52 smithi016 bash[10302]: cluster 2020-11-16T22:00:51.545507+0000 mgr.x (mgr.24115) 242 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:52.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:52 smithi195 bash[10218]: cluster 2020-11-16T22:00:51.545507+0000 mgr.x (mgr.24115) 242 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:52.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:52 smithi057 bash[10301]: cluster 2020-11-16T22:00:51.545507+0000 mgr.x (mgr.24115) 242 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:54.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:54 smithi195 bash[10218]: cluster 2020-11-16T22:00:53.546079+0000 mgr.x (mgr.24115) 243 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:54.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:54 smithi057 bash[10301]: cluster 2020-11-16T22:00:53.546079+0000 mgr.x (mgr.24115) 243 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:55.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:54 smithi016 bash[10302]: cluster 2020-11-16T22:00:53.546079+0000 mgr.x (mgr.24115) 243 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:55.150 INFO:teuthology.orchestra.run.smithi195.stdout:163208757297 2020-11-16T22:00:55.795 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757289 got 163208757297 for osd.5 2020-11-16T22:00:55.796 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd last-stat-seq osd.6 2020-11-16T22:00:55.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:55 smithi195 bash[10218]: audit 2020-11-16T22:00:55.162099+0000 mon.a (mon.0) 669 : audit [DBG] from='client.? v1:172.21.15.195:0/143503317' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2020-11-16T22:00:55.934 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:00:55.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:55 smithi057 bash[10301]: audit 2020-11-16T22:00:55.162099+0000 mon.a (mon.0) 669 : audit [DBG] from='client.? v1:172.21.15.195:0/143503317' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2020-11-16T22:00:56.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:55 smithi016 bash[10302]: audit 2020-11-16T22:00:55.162099+0000 mon.a (mon.0) 669 : audit [DBG] from='client.? v1:172.21.15.195:0/143503317' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2020-11-16T22:00:56.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:56 smithi057 bash[10301]: cluster 2020-11-16T22:00:55.546692+0000 mgr.x (mgr.24115) 244 : cluster [DBG] pgmap v248: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:57.019 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:56 smithi195 bash[10218]: cluster 2020-11-16T22:00:55.546692+0000 mgr.x (mgr.24115) 244 : cluster [DBG] pgmap v248: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:57.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:56 smithi016 bash[10302]: cluster 2020-11-16T22:00:55.546692+0000 mgr.x (mgr.24115) 244 : cluster [DBG] pgmap v248: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:58.762 INFO:teuthology.orchestra.run.smithi195.stdout:184683593775 2020-11-16T22:00:58.861 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:58 smithi195 bash[10218]: cluster 2020-11-16T22:00:57.547319+0000 mgr.x (mgr.24115) 245 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:58.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:58 smithi057 bash[10301]: cluster 2020-11-16T22:00:57.547319+0000 mgr.x (mgr.24115) 245 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:59.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:58 smithi016 bash[10302]: cluster 2020-11-16T22:00:57.547319+0000 mgr.x (mgr.24115) 245 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:00:59.373 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593766 got 184683593775 for osd.6 2020-11-16T22:00:59.374 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd last-stat-seq osd.7 2020-11-16T22:00:59.514 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:00:59.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:00:59 smithi195 bash[10218]: audit 2020-11-16T22:00:58.773388+0000 mon.a (mon.0) 670 : audit [DBG] from='client.? v1:172.21.15.195:0/1403460987' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2020-11-16T22:00:59.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:00:59 smithi057 bash[10301]: audit 2020-11-16T22:00:58.773388+0000 mon.a (mon.0) 670 : audit [DBG] from='client.? v1:172.21.15.195:0/1403460987' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2020-11-16T22:01:00.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:00:59 smithi016 bash[10302]: audit 2020-11-16T22:00:58.773388+0000 mon.a (mon.0) 670 : audit [DBG] from='client.? v1:172.21.15.195:0/1403460987' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2020-11-16T22:01:00.761 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:00 smithi195 bash[10218]: cluster 2020-11-16T22:00:59.547939+0000 mgr.x (mgr.24115) 246 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:00.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:00 smithi057 bash[10301]: cluster 2020-11-16T22:00:59.547939+0000 mgr.x (mgr.24115) 246 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:01.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:00 smithi016 bash[10302]: cluster 2020-11-16T22:00:59.547939+0000 mgr.x (mgr.24115) 246 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:02.523 INFO:teuthology.orchestra.run.smithi195.stdout:206158430249 2020-11-16T22:01:02.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:02 smithi057 bash[10301]: cluster 2020-11-16T22:01:01.548591+0000 mgr.x (mgr.24115) 247 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:02.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:02 smithi057 bash[10301]: audit 2020-11-16T22:01:02.534471+0000 mon.a (mon.0) 671 : audit [DBG] from='client.? v1:172.21.15.195:0/2921514680' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2020-11-16T22:01:03.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:02 smithi016 bash[10302]: cluster 2020-11-16T22:01:01.548591+0000 mgr.x (mgr.24115) 247 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:03.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:02 smithi016 bash[10302]: audit 2020-11-16T22:01:02.534471+0000 mon.a (mon.0) 671 : audit [DBG] from='client.? v1:172.21.15.195:0/2921514680' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2020-11-16T22:01:03.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:02 smithi195 bash[10218]: cluster 2020-11-16T22:01:01.548591+0000 mgr.x (mgr.24115) 247 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:03.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:02 smithi195 bash[10218]: audit 2020-11-16T22:01:02.534471+0000 mon.a (mon.0) 671 : audit [DBG] from='client.? v1:172.21.15.195:0/2921514680' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2020-11-16T22:01:03.223 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430240 got 206158430249 for osd.7 2020-11-16T22:01:03.224 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd last-stat-seq osd.8 2020-11-16T22:01:03.363 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:01:04.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:04 smithi195 bash[10218]: cluster 2020-11-16T22:01:03.549265+0000 mgr.x (mgr.24115) 248 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:04.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:04 smithi057 bash[10301]: cluster 2020-11-16T22:01:03.549265+0000 mgr.x (mgr.24115) 248 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:05.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:04 smithi016 bash[10302]: cluster 2020-11-16T22:01:03.549265+0000 mgr.x (mgr.24115) 248 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:06.292 INFO:teuthology.orchestra.run.smithi195.stdout:227633266725 2020-11-16T22:01:06.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:06 smithi195 bash[10218]: cluster 2020-11-16T22:01:05.549888+0000 mgr.x (mgr.24115) 249 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:06.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:06 smithi195 bash[10218]: audit 2020-11-16T22:01:06.304120+0000 mon.a (mon.0) 672 : audit [DBG] from='client.? v1:172.21.15.195:0/3943400136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2020-11-16T22:01:06.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:06 smithi057 bash[10301]: cluster 2020-11-16T22:01:05.549888+0000 mgr.x (mgr.24115) 249 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:06.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:06 smithi057 bash[10301]: audit 2020-11-16T22:01:06.304120+0000 mon.a (mon.0) 672 : audit [DBG] from='client.? v1:172.21.15.195:0/3943400136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2020-11-16T22:01:06.959 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266716 got 227633266725 for osd.8 2020-11-16T22:01:06.959 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd last-stat-seq osd.9 2020-11-16T22:01:07.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:06 smithi016 bash[10302]: cluster 2020-11-16T22:01:05.549888+0000 mgr.x (mgr.24115) 249 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:07.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:06 smithi016 bash[10302]: audit 2020-11-16T22:01:06.304120+0000 mon.a (mon.0) 672 : audit [DBG] from='client.? v1:172.21.15.195:0/3943400136' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2020-11-16T22:01:07.101 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:01:08.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:08 smithi057 bash[10301]: cluster 2020-11-16T22:01:07.550530+0000 mgr.x (mgr.24115) 250 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:09.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:08 smithi016 bash[10302]: cluster 2020-11-16T22:01:07.550530+0000 mgr.x (mgr.24115) 250 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:09.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:08 smithi195 bash[10218]: cluster 2020-11-16T22:01:07.550530+0000 mgr.x (mgr.24115) 250 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:10.116 INFO:teuthology.orchestra.run.smithi195.stdout:249108103201 2020-11-16T22:01:10.756 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103192 got 249108103201 for osd.9 2020-11-16T22:01:10.757 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd last-stat-seq osd.10 2020-11-16T22:01:10.769 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:10 smithi195 bash[10218]: cluster 2020-11-16T22:01:09.551163+0000 mgr.x (mgr.24115) 251 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:10.769 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:10 smithi195 bash[10218]: audit 2020-11-16T22:01:10.125509+0000 mon.a (mon.0) 673 : audit [DBG] from='client.? v1:172.21.15.195:0/3558882295' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2020-11-16T22:01:10.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:10 smithi016 bash[10302]: cluster 2020-11-16T22:01:09.551163+0000 mgr.x (mgr.24115) 251 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:10.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:10 smithi016 bash[10302]: audit 2020-11-16T22:01:10.125509+0000 mon.a (mon.0) 673 : audit [DBG] from='client.? v1:172.21.15.195:0/3558882295' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2020-11-16T22:01:10.894 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:01:10.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:10 smithi057 bash[10301]: cluster 2020-11-16T22:01:09.551163+0000 mgr.x (mgr.24115) 251 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:10.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:10 smithi057 bash[10301]: audit 2020-11-16T22:01:10.125509+0000 mon.a (mon.0) 673 : audit [DBG] from='client.? v1:172.21.15.195:0/3558882295' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2020-11-16T22:01:12.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:12 smithi195 bash[10218]: cluster 2020-11-16T22:01:11.551827+0000 mgr.x (mgr.24115) 252 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:12.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:12 smithi057 bash[10301]: cluster 2020-11-16T22:01:11.551827+0000 mgr.x (mgr.24115) 252 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:13.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:12 smithi016 bash[10302]: cluster 2020-11-16T22:01:11.551827+0000 mgr.x (mgr.24115) 252 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:13.821 INFO:teuthology.orchestra.run.smithi195.stdout:270582939676 2020-11-16T22:01:13.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:13 smithi195 bash[10218]: audit 2020-11-16T22:01:12.628540+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:01:13.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:13 smithi195 bash[10218]: audit 2020-11-16T22:01:12.633912+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:01:13.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:13 smithi057 bash[10301]: audit 2020-11-16T22:01:12.628540+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:01:13.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:13 smithi057 bash[10301]: audit 2020-11-16T22:01:12.633912+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:01:14.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:13 smithi016 bash[10302]: audit 2020-11-16T22:01:12.628540+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:01:14.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:13 smithi016 bash[10302]: audit 2020-11-16T22:01:12.633912+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:01:14.489 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939667 got 270582939676 for osd.10 2020-11-16T22:01:14.490 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd last-stat-seq osd.11 2020-11-16T22:01:14.673 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:01:14.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:14 smithi195 bash[10218]: cluster 2020-11-16T22:01:13.552441+0000 mgr.x (mgr.24115) 253 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:14.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:14 smithi195 bash[10218]: audit 2020-11-16T22:01:13.833175+0000 mon.a (mon.0) 676 : audit [DBG] from='client.? v1:172.21.15.195:0/1090027997' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2020-11-16T22:01:14.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:14 smithi057 bash[10301]: cluster 2020-11-16T22:01:13.552441+0000 mgr.x (mgr.24115) 253 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:14.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:14 smithi057 bash[10301]: audit 2020-11-16T22:01:13.833175+0000 mon.a (mon.0) 676 : audit [DBG] from='client.? v1:172.21.15.195:0/1090027997' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2020-11-16T22:01:15.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:14 smithi016 bash[10302]: cluster 2020-11-16T22:01:13.552441+0000 mgr.x (mgr.24115) 253 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:15.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:14 smithi016 bash[10302]: audit 2020-11-16T22:01:13.833175+0000 mon.a (mon.0) 676 : audit [DBG] from='client.? v1:172.21.15.195:0/1090027997' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2020-11-16T22:01:16.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:16 smithi057 bash[10301]: cluster 2020-11-16T22:01:15.553105+0000 mgr.x (mgr.24115) 254 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:17.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:16 smithi016 bash[10302]: cluster 2020-11-16T22:01:15.553105+0000 mgr.x (mgr.24115) 254 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:17.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:16 smithi195 bash[10218]: cluster 2020-11-16T22:01:15.553105+0000 mgr.x (mgr.24115) 254 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:17.643 INFO:teuthology.orchestra.run.smithi195.stdout:292057776151 2020-11-16T22:01:18.330 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776143 got 292057776151 for osd.11 2020-11-16T22:01:18.331 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2020-11-16T22:01:18.331 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph pg dump --format=json 2020-11-16T22:01:18.471 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:01:18.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:18 smithi057 bash[10301]: cluster 2020-11-16T22:01:17.553777+0000 mgr.x (mgr.24115) 255 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:18.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:18 smithi057 bash[10301]: audit 2020-11-16T22:01:17.655253+0000 mon.c (mon.2) 20 : audit [DBG] from='client.? v1:172.21.15.195:0/917960995' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2020-11-16T22:01:19.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:18 smithi016 bash[10302]: cluster 2020-11-16T22:01:17.553777+0000 mgr.x (mgr.24115) 255 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:19.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:18 smithi016 bash[10302]: audit 2020-11-16T22:01:17.655253+0000 mon.c (mon.2) 20 : audit [DBG] from='client.? v1:172.21.15.195:0/917960995' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2020-11-16T22:01:19.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:18 smithi195 bash[10218]: cluster 2020-11-16T22:01:17.553777+0000 mgr.x (mgr.24115) 255 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:19.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:18 smithi195 bash[10218]: audit 2020-11-16T22:01:17.655253+0000 mon.c (mon.2) 20 : audit [DBG] from='client.? v1:172.21.15.195:0/917960995' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2020-11-16T22:01:20.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:20 smithi016 bash[10302]: cluster 2020-11-16T22:01:19.554418+0000 mgr.x (mgr.24115) 256 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:20.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:20 smithi195 bash[10218]: cluster 2020-11-16T22:01:19.554418+0000 mgr.x (mgr.24115) 256 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:20.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:20 smithi057 bash[10301]: cluster 2020-11-16T22:01:19.554418+0000 mgr.x (mgr.24115) 256 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:21.377 INFO:teuthology.orchestra.run.smithi195.stdout: 2020-11-16T22:01:21.380 INFO:teuthology.orchestra.run.smithi195.stderr:dumped all 2020-11-16T22:01:22.059 INFO:teuthology.orchestra.run.smithi195.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2020-11-16T22:01:19.554103+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":12,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":1124941824,"kb_used":67328,"kb_used_data":7776,"kb_used_omap":0,"kb_used_meta":59456,"kb_avail":1124874496,"statfs":{"total":1151940427776,"available":1151871483904,"internally_reserved":0,"allocated":7962624,"data_stored":3246216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":60882944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"45","reported_epoch":"69","state":"active+clean","last_fresh":"2020-11-16T21:59:27.603441+0000","last_change":"2020-11-16T21:59:27.603441+0000","last_active":"2020-11-16T21:59:27.603441+0000","last_peered":"2020-11-16T21:59:27.603441+0000","last_clean":"2020-11-16T21:59:27.603441+0000","last_became_active":"2020-11-16T21:59:27.603020+0000","last_became_peered":"2020-11-16T21:59:27.603020+0000","last_unstale":"2020-11-16T21:59:27.603441+0000","last_undegraded":"2020-11-16T21:59:27.603441+0000","last_fullsized":"2020-11-16T21:59:27.603441+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":5,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T21:53:16.485896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T21:53:16.485896+0000","last_clean_scrub_stamp":"2020-11-16T21:53:16.485896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776152,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5392,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93739760,"statfs":{"total":95995035648,"available":95989514240,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"min":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"max":{"1min":3.669,"5min":3.669,"15min":3.669},"last":2.0019999999999998},{"interface":"front","average":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"min":{"1min":1.857,"5min":1.857,"15min":1.857},"max":{"1min":4.3300000000000001,"5min":4.3300000000000001,"15min":4.3300000000000001},"last":3.125}]},{"osd":1,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":12.460000000000001,"5min":12.460000000000001,"15min":12.460000000000001},"min":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"max":{"1min":188.61600000000001,"5min":188.61600000000001,"15min":188.61600000000001},"last":2.5},{"interface":"front","average":{"1min":31.518000000000001,"5min":31.518000000000001,"15min":31.518000000000001},"min":{"1min":1.26,"5min":1.26,"15min":1.26},"max":{"1min":614.48199999999997,"5min":614.48199999999997,"15min":614.48199999999997},"last":2.9049999999999998}]},{"osd":2,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":4.0209999999999999,"5min":4.0209999999999999,"15min":4.0209999999999999},"last":2.407},{"interface":"front","average":{"1min":2.218,"5min":2.218,"15min":2.218},"min":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"max":{"1min":2.7610000000000001,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":2.6469999999999998}]},{"osd":3,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"min":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"max":{"1min":3.48,"5min":3.48,"15min":3.48},"last":2.8029999999999999},{"interface":"front","average":{"1min":2.948,"5min":2.948,"15min":2.948},"min":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"max":{"1min":7.2039999999999997,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":2.7469999999999999}]},{"osd":4,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":45.206000000000003,"5min":45.206000000000003,"15min":45.206000000000003},"min":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"max":{"1min":885.75099999999998,"5min":885.75099999999998,"15min":885.75099999999998},"last":3.1059999999999999},{"interface":"front","average":{"1min":3.2850000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"min":{"1min":2.165,"5min":2.165,"15min":2.165},"max":{"1min":4.556,"5min":4.556,"15min":4.556},"last":4.4790000000000001}]},{"osd":5,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":3.1629999999999998,"5min":3.1629999999999998,"15min":3.1629999999999998},"min":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"max":{"1min":5.2359999999999998,"5min":5.2359999999999998,"15min":5.2359999999999998},"last":3.0230000000000001},{"interface":"front","average":{"1min":35.173999999999999,"5min":35.173999999999999,"15min":35.173999999999999},"min":{"1min":2.77,"5min":2.77,"15min":2.77},"max":{"1min":503.91399999999999,"5min":503.91399999999999,"15min":503.91399999999999},"last":3.984}]},{"osd":6,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":3.6379999999999999,"5min":3.6379999999999999,"15min":3.6379999999999999},"min":{"1min":2.4409999999999998,"5min":2.4409999999999998,"15min":2.4409999999999998},"max":{"1min":6.8150000000000004,"5min":6.8150000000000004,"15min":6.8150000000000004},"last":2.5739999999999998},{"interface":"front","average":{"1min":32.220999999999997,"5min":32.220999999999997,"15min":32.220999999999997},"min":{"1min":2.9460000000000002,"5min":2.9460000000000002,"15min":2.9460000000000002},"max":{"1min":606.91999999999996,"5min":606.91999999999996,"15min":606.91999999999996},"last":3.7770000000000001}]},{"osd":7,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":3.867,"5min":3.867,"15min":3.867},"min":{"1min":2.7370000000000001,"5min":2.7370000000000001,"15min":2.7370000000000001},"max":{"1min":6.7460000000000004,"5min":6.7460000000000004,"15min":6.7460000000000004},"last":4.3719999999999999},{"interface":"front","average":{"1min":3.581,"5min":3.581,"15min":3.581},"min":{"1min":2.835,"5min":2.835,"15min":2.835},"max":{"1min":5.4109999999999996,"5min":5.4109999999999996,"15min":5.4109999999999996},"last":3.8999999999999999}]},{"osd":8,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":3.9260000000000002,"5min":3.9260000000000002,"15min":3.9260000000000002},"min":{"1min":3.153,"5min":3.153,"15min":3.153},"max":{"1min":7.3280000000000003,"5min":7.3280000000000003,"15min":7.3280000000000003},"last":3.1579999999999999},{"interface":"front","average":{"1min":32.668999999999997,"5min":32.668999999999997,"15min":32.668999999999997},"min":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"max":{"1min":405.51999999999998,"5min":405.51999999999998,"15min":405.51999999999998},"last":4.4359999999999999}]},{"osd":10,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"min":{"1min":3.2509999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"max":{"1min":7.3789999999999996,"5min":7.3789999999999996,"15min":7.3789999999999996},"last":3.214},{"interface":"front","average":{"1min":4.1159999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"min":{"1min":3.2570000000000001,"5min":3.2570000000000001,"15min":3.2570000000000001},"max":{"1min":6.9909999999999997,"5min":6.9909999999999997,"15min":6.9909999999999997},"last":4.5270000000000001}]}]},{"osd":10,"up_from":63,"seq":270582939677,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5456,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93739696,"statfs":{"total":95995035648,"available":95989448704,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4289999999999998}]},{"osd":1,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":2.7519999999999998,"5min":2.609,"15min":2.585},"min":{"1min":1.605,"5min":1.48,"15min":1.48},"max":{"1min":4.4249999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":2.5670000000000002},{"interface":"front","average":{"1min":2.7109999999999999,"5min":2.5369999999999999,"15min":2.508},"min":{"1min":1.7769999999999999,"5min":1.405,"15min":1.405},"max":{"1min":4.5330000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":2.5139999999999998}]},{"osd":2,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":2.5659999999999998,"5min":2.5990000000000002,"15min":2.605},"min":{"1min":1.7729999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"max":{"1min":3.835,"5min":8.3300000000000001,"15min":8.3300000000000001},"last":3.1230000000000002},{"interface":"front","average":{"1min":2.8159999999999998,"5min":2.754,"15min":2.7440000000000002},"min":{"1min":1.768,"5min":1.6299999999999999,"15min":1.6299999999999999},"max":{"1min":4.7949999999999999,"5min":4.7949999999999999,"15min":4.7949999999999999},"last":2.4340000000000002}]},{"osd":3,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":3.0009999999999999,"5min":3.1619999999999999,"15min":3.1890000000000001},"min":{"1min":1.774,"5min":1.774,"15min":1.774},"max":{"1min":5.1070000000000002,"5min":8.657,"15min":8.657},"last":2.6720000000000002},{"interface":"front","average":{"1min":2.5750000000000002,"5min":2.863,"15min":2.911},"min":{"1min":1.639,"5min":1.4470000000000001,"15min":1.4470000000000001},"max":{"1min":4.2190000000000003,"5min":8.4049999999999994,"15min":8.4049999999999994},"last":2.9390000000000001}]},{"osd":4,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":44.606999999999999,"5min":11.515000000000001,"15min":5.9989999999999997},"min":{"1min":1.875,"5min":1.599,"15min":1.599},"max":{"1min":671.28300000000002,"5min":671.28300000000002,"15min":671.28300000000002},"last":3.8199999999999998},{"interface":"front","average":{"1min":3.331,"5min":3.298,"15min":3.2919999999999998},"min":{"1min":2.1680000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"max":{"1min":4.8860000000000001,"5min":4.8860000000000001,"15min":4.8860000000000001},"last":2.6219999999999999}]},{"osd":5,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":3.8050000000000002,"5min":3.722,"15min":3.7080000000000002},"min":{"1min":2.8769999999999998,"5min":2.6739999999999999,"15min":2.6739999999999999},"max":{"1min":5.3710000000000004,"5min":8.7850000000000001,"15min":8.7850000000000001},"last":2.7749999999999999},{"interface":"front","average":{"1min":3.4079999999999999,"5min":3.3889999999999998,"15min":3.3860000000000001},"min":{"1min":2.048,"5min":1.9950000000000001,"15min":1.9950000000000001},"max":{"1min":4.7409999999999997,"5min":4.7409999999999997,"15min":4.7409999999999997},"last":2.734}]},{"osd":6,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":3.2010000000000001,"5min":3.5710000000000002,"15min":3.633},"min":{"1min":2.4049999999999998,"5min":1.7370000000000001,"15min":1.7370000000000001},"max":{"1min":4.0369999999999999,"5min":8.4459999999999997,"15min":8.4459999999999997},"last":3.012},{"interface":"front","average":{"1min":3.8439999999999999,"5min":3.8700000000000001,"15min":3.8740000000000001},"min":{"1min":2.9470000000000001,"5min":2.819,"15min":2.819},"max":{"1min":5.2530000000000001,"5min":8.8810000000000002,"15min":8.8810000000000002},"last":3.3260000000000001}]},{"osd":7,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":52.546999999999997,"5min":13.499000000000001,"15min":6.9909999999999997},"min":{"1min":2.7629999999999999,"5min":2.46,"15min":2.46},"max":{"1min":787.95799999999997,"5min":787.95799999999997,"15min":787.95799999999997},"last":3.0609999999999999},{"interface":"front","average":{"1min":4.0670000000000002,"5min":3.8959999999999999,"15min":3.8679999999999999},"min":{"1min":3.0329999999999999,"5min":2.7909999999999999,"15min":2.7909999999999999},"max":{"1min":5.5490000000000004,"5min":8.9879999999999995,"15min":8.9879999999999995},"last":3.4260000000000002}]},{"osd":8,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":3.9889999999999999,"5min":4.0270000000000001,"15min":4.0330000000000004},"min":{"1min":2.6309999999999998,"5min":2.1890000000000001,"15min":2.1890000000000001},"max":{"1min":5.4589999999999996,"5min":13.583,"15min":13.583},"last":2.8159999999999998},{"interface":"front","average":{"1min":3.6280000000000001,"5min":41.179000000000002,"15min":47.436999999999998},"min":{"1min":2.4590000000000001,"5min":1.7749999999999999,"15min":1.7749999999999999},"max":{"1min":4.2679999999999998,"5min":940.79499999999996,"15min":940.79499999999996},"last":3.226}]},{"osd":9,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":3.931,"5min":4.125,"15min":4.157},"min":{"1min":3.0219999999999998,"5min":2.3239999999999998,"15min":2.3239999999999998},"max":{"1min":5.2720000000000002,"5min":13.654999999999999,"15min":13.654999999999999},"last":3.6970000000000001},{"interface":"front","average":{"1min":4.2789999999999999,"5min":4.4630000000000001,"15min":4.4930000000000003},"min":{"1min":3.2829999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"max":{"1min":6.1950000000000003,"5min":18.227,"15min":18.227},"last":3.4910000000000001}]},{"osd":11,"last update":"Mon Nov 16 22:00:27 2020","interfaces":[{"interface":"back","average":{"1min":3.9350000000000001,"5min":3.9350000000000001,"15min":3.9350000000000001},"min":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"max":{"1min":4.7309999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":3.766},{"interface":"front","average":{"1min":3.8479999999999999,"5min":3.8479999999999999,"15min":3.8479999999999999},"min":{"1min":1.849,"5min":1.849,"15min":1.849},"max":{"1min":4.9139999999999997,"5min":4.9139999999999997,"15min":4.9139999999999997},"last":3.5910000000000002}]}]},{"osd":9,"up_from":58,"seq":249108103203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5456,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93739696,"statfs":{"total":95995035648,"available":95989448704,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":2.5179999999999998,"5min":2.444,"15min":2.4319999999999999},"min":{"1min":1.472,"5min":1.472,"15min":1.472},"max":{"1min":3.6160000000000001,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":2.1419999999999999},{"interface":"front","average":{"1min":2.5489999999999999,"5min":29.178999999999998,"15min":33.616999999999997},"min":{"1min":1.5389999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"max":{"1min":3.9700000000000002,"5min":635.69200000000001,"15min":635.69200000000001},"last":3.8210000000000002}]},{"osd":1,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":2.109,"5min":2.173,"15min":2.1829999999999998},"min":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"max":{"1min":2.8740000000000001,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":2.0760000000000001},{"interface":"front","average":{"1min":2.6339999999999999,"5min":2.4700000000000002,"15min":2.4430000000000001},"min":{"1min":1.73,"5min":1.466,"15min":1.466},"max":{"1min":3.7269999999999999,"5min":3.7269999999999999,"15min":3.7269999999999999},"last":2.012}]},{"osd":2,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":2.4910000000000001,"5min":2.4769999999999999,"15min":2.4750000000000001},"min":{"1min":1.6060000000000001,"5min":1.48,"15min":1.48},"max":{"1min":3.3999999999999999,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":2.2320000000000002},{"interface":"front","average":{"1min":2.444,"5min":2.6930000000000001,"15min":2.7349999999999999},"min":{"1min":1.099,"5min":1.099,"15min":1.099},"max":{"1min":4.1879999999999997,"5min":4.1879999999999997,"15min":4.1879999999999997},"last":3.706}]},{"osd":3,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":2.9750000000000001,"5min":3.1509999999999998,"15min":3.1800000000000002},"min":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"max":{"1min":3.8399999999999999,"5min":9.8550000000000004,"15min":9.8550000000000004},"last":3.9209999999999998},{"interface":"front","average":{"1min":2.4620000000000002,"5min":2.5449999999999999,"15min":2.5590000000000002},"min":{"1min":1.752,"5min":1.752,"15min":1.752},"max":{"1min":3.4399999999999999,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":1.847}]},{"osd":4,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":3.056,"5min":3.2719999999999998,"15min":3.3079999999999998},"min":{"1min":2.302,"5min":1.8029999999999999,"15min":1.8029999999999999},"max":{"1min":3.948,"5min":9.5790000000000006,"15min":9.5790000000000006},"last":2.7890000000000001},{"interface":"front","average":{"1min":3.149,"5min":3.677,"15min":3.7650000000000001},"min":{"1min":2.286,"5min":2.242,"15min":2.242},"max":{"1min":4.0919999999999996,"5min":10.073,"15min":10.073},"last":4.0170000000000003}]},{"osd":5,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":3.6819999999999999,"5min":3.5630000000000002,"15min":3.5430000000000001},"min":{"1min":3.0190000000000001,"5min":2.1720000000000002,"15min":2.1720000000000002},"max":{"1min":4.3949999999999996,"5min":9.9359999999999999,"15min":9.9359999999999999},"last":4.1100000000000003},{"interface":"front","average":{"1min":37.817,"5min":49.792000000000002,"15min":51.787999999999997},"min":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"max":{"1min":527.98699999999997,"5min":949.928,"15min":949.928},"last":3.028}]},{"osd":6,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":3.1989999999999998,"5min":3.3079999999999998,"15min":3.3260000000000001},"min":{"1min":2.7549999999999999,"5min":2.2360000000000002,"15min":2.2360000000000002},"max":{"1min":3.8780000000000001,"5min":9.1400000000000006,"15min":9.1400000000000006},"last":3.0760000000000001},{"interface":"front","average":{"1min":3.4969999999999999,"5min":3.6579999999999999,"15min":3.6850000000000001},"min":{"1min":2.911,"5min":2.0619999999999998,"15min":2.0619999999999998},"max":{"1min":3.903,"5min":9.6460000000000008,"15min":9.6460000000000008},"last":2.911}]},{"osd":7,"last update":"Mon Nov 16 22:00:47 2020","interfaces":[{"interface":"back","average":{"1min":3.8100000000000001,"5min":3.9870000000000001,"15min":4.0170000000000003},"min":{"1min":3.2759999999999998,"5min":2.6960000000000002,"15min":2.6960000000000002},"max":{"1min":4.4550000000000001,"5min":10.324999999999999,"15min":10.324999999999999},"last":4.3179999999999996},{"interface":"front","average":{"1min":3.4809999999999999,"5min":3.645,"15min":3.6720000000000002},"min":{"1min":2.9980000000000002,"5min":2.5,"15min":2.5},"max":{"1min":4.0220000000000002,"5min":9.2940000000000005,"15min":9.2940000000000005},"last":3.165}]},{"osd":8,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":3.665,"5min":3.7690000000000001,"15min":3.786},"min":{"1min":3.214,"5min":1.903,"15min":1.903},"max":{"1min":4.2249999999999996,"5min":9.7720000000000002,"15min":9.7720000000000002},"last":4.2210000000000001},{"interface":"front","average":{"1min":45.927,"5min":12.368,"15min":6.7750000000000004},"min":{"1min":2.8260000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"max":{"1min":596.23000000000002,"5min":596.23000000000002,"15min":596.23000000000002},"last":2.843}]},{"osd":10,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":3.9620000000000002,"5min":3.9969999999999999,"15min":4.0030000000000001},"min":{"1min":2.7370000000000001,"5min":2.7370000000000001,"15min":2.7370000000000001},"max":{"1min":5.0010000000000003,"5min":5.0010000000000003,"15min":5.0010000000000003},"last":4.7270000000000003},{"interface":"front","average":{"1min":3.4700000000000002,"5min":3.3700000000000001,"15min":3.3530000000000002},"min":{"1min":2.8999999999999999,"5min":2.0910000000000002,"15min":2.0910000000000002},"max":{"1min":3.9889999999999999,"5min":3.9889999999999999,"15min":3.9889999999999999},"last":3.2080000000000002}]}]},{"osd":8,"up_from":53,"seq":227633266727,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5520,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739632,"statfs":{"total":95995035648,"available":95989383168,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":2.4510000000000001,"5min":2.6539999999999999,"15min":2.7160000000000002},"min":{"1min":1.617,"5min":1.1180000000000001,"15min":1.1180000000000001},"max":{"1min":3.375,"5min":15.356999999999999,"15min":15.356999999999999},"last":2.9630000000000001},{"interface":"front","average":{"1min":2.1859999999999999,"5min":3.8559999999999999,"15min":4.5720000000000001},"min":{"1min":1.5700000000000001,"5min":1.113,"15min":1.113},"max":{"1min":2.8820000000000001,"5min":46.750999999999998,"15min":46.750999999999998},"last":2.4660000000000002}]},{"osd":1,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":2.6739999999999999,"5min":2.6909999999999998,"15min":2.6629999999999998},"min":{"1min":1.5700000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"max":{"1min":3.9940000000000002,"5min":9.6679999999999993,"15min":9.6679999999999993},"last":3.2509999999999999},{"interface":"front","average":{"1min":2.5950000000000002,"5min":2.8490000000000002,"15min":2.9950000000000001},"min":{"1min":1.837,"5min":1.1559999999999999,"15min":1.1559999999999999},"max":{"1min":3.98,"5min":16.106999999999999,"15min":16.106999999999999},"last":2.7949999999999999}]},{"osd":2,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":37.756,"5min":11.473000000000001,"15min":5.452},"min":{"1min":1.673,"5min":1.2430000000000001,"15min":1.2430000000000001},"max":{"1min":748.44399999999996,"5min":748.44399999999996,"15min":748.44399999999996},"last":2.3239999999999998},{"interface":"front","average":{"1min":24.227,"5min":7.0469999999999997,"15min":4.1159999999999997},"min":{"1min":1.6970000000000001,"5min":1.401,"15min":1.401},"max":{"1min":449.21899999999999,"5min":449.21899999999999,"15min":449.21899999999999},"last":3.0960000000000001}]},{"osd":3,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":2.8919999999999999,"5min":2.6589999999999998,"15min":2.488},"min":{"1min":1.73,"5min":1.659,"15min":1.659},"max":{"1min":4.335,"5min":5.4139999999999997,"15min":5.4139999999999997},"last":2.8959999999999999},{"interface":"front","average":{"1min":3.0059999999999998,"5min":24.744,"15min":34.409999999999997},"min":{"1min":1.9930000000000001,"5min":1.3129999999999999,"15min":1.3129999999999999},"max":{"1min":4.1379999999999999,"5min":611.22699999999998,"15min":611.22699999999998},"last":3.1669999999999998}]},{"osd":4,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":3.028,"5min":3.3759999999999999,"15min":3.5030000000000001},"min":{"1min":1.8600000000000001,"5min":1.353,"15min":1.353},"max":{"1min":4.4009999999999998,"5min":16.491,"15min":16.491},"last":3.3130000000000002},{"interface":"front","average":{"1min":2.895,"5min":2.9180000000000001,"15min":2.903},"min":{"1min":2.238,"5min":1.8240000000000001,"15min":1.8240000000000001},"max":{"1min":3.9380000000000002,"5min":6.2569999999999997,"15min":6.2569999999999997},"last":2.5680000000000001}]},{"osd":5,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":3.5750000000000002,"5min":3.4159999999999999,"15min":3.3260000000000001},"min":{"1min":2.8439999999999999,"5min":1.901,"15min":1.901},"max":{"1min":4.5579999999999998,"5min":9.7530000000000001,"15min":9.7530000000000001},"last":4.1459999999999999},{"interface":"front","average":{"1min":4.0430000000000001,"5min":3.879,"15min":3.8519999999999999},"min":{"1min":3.339,"5min":1.8420000000000001,"15min":1.8420000000000001},"max":{"1min":4.8300000000000001,"5min":16.280999999999999,"15min":16.280999999999999},"last":4.2130000000000001}]},{"osd":6,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":3.3639999999999999,"5min":3.081,"15min":3},"min":{"1min":2.4660000000000002,"5min":1.462,"15min":1.462},"max":{"1min":4.2569999999999997,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":3.5099999999999998},{"interface":"front","average":{"1min":3.8119999999999998,"5min":5.4880000000000004,"15min":3.927},"min":{"1min":2.544,"5min":2.3300000000000001,"15min":2.3300000000000001},"max":{"1min":4.7320000000000002,"5min":269.29700000000003,"15min":269.29700000000003},"last":3.448}]},{"osd":7,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":3.464,"5min":3.7410000000000001,"15min":3.8149999999999999},"min":{"1min":2.2120000000000002,"5min":1.736,"15min":1.736},"max":{"1min":4.5179999999999998,"5min":15.984,"15min":15.984},"last":3.6669999999999998},{"interface":"front","average":{"1min":3.9750000000000001,"5min":3.4409999999999998,"15min":3.258},"min":{"1min":3.02,"5min":1.629,"15min":1.629},"max":{"1min":4.7830000000000004,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":3.5760000000000001}]},{"osd":9,"last update":"Mon Nov 16 22:00:42 2020","interfaces":[{"interface":"back","average":{"1min":3.5990000000000002,"5min":27.832999999999998,"15min":31.872},"min":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"max":{"1min":5.0129999999999999,"5min":610.89700000000005,"15min":610.89700000000005},"last":4.2859999999999996},{"interface":"front","average":{"1min":4.0049999999999999,"5min":3.5449999999999999,"15min":3.468},"min":{"1min":2.827,"5min":1.754,"15min":1.754},"max":{"1min":4.8719999999999999,"5min":6.5890000000000004,"15min":6.5890000000000004},"last":4.4199999999999999}]},{"osd":10,"last update":"Mon Nov 16 22:01:05 2020","interfaces":[{"interface":"back","average":{"1min":11.851000000000001,"5min":5.1399999999999997,"15min":4.0220000000000002},"min":{"1min":2.7570000000000001,"5min":1.349,"15min":1.349},"max":{"1min":155.61600000000001,"5min":155.61600000000001,"15min":155.61600000000001},"last":3.927},{"interface":"front","average":{"1min":3.915,"5min":3.7549999999999999,"15min":3.7280000000000002},"min":{"1min":2.8700000000000001,"5min":1.986,"15min":1.986},"max":{"1min":5.0880000000000001,"5min":5.4770000000000003,"15min":5.4770000000000003},"last":4.3579999999999997}]}]},{"osd":7,"up_from":48,"seq":206158430252,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5584,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739568,"statfs":{"total":95995035648,"available":95989317632,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 21:58:44 2020","interfaces":[{"interface":"back","average":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"min":{"1min":1.385,"5min":1.385,"15min":1.385},"max":{"1min":4.5209999999999999,"5min":4.5209999999999999,"15min":4.5209999999999999},"last":1.165},{"interface":"front","average":{"1min":43.802999999999997,"5min":43.802999999999997,"15min":43.802999999999997},"min":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"max":{"1min":819.04200000000003,"5min":819.04200000000003,"15min":819.04200000000003},"last":1.8200000000000001}]},{"osd":1,"last update":"Mon Nov 16 22:00:52 2020","interfaces":[{"interface":"back","average":{"1min":2.8690000000000002,"5min":18.948,"15min":26.088000000000001},"min":{"1min":1.639,"5min":1.5389999999999999,"15min":1.5389999999999999},"max":{"1min":5.4000000000000004,"5min":503.44499999999999,"15min":503.44499999999999},"last":2.8180000000000001},{"interface":"front","average":{"1min":2.2040000000000002,"5min":16.925999999999998,"15min":23.408999999999999},"min":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"max":{"1min":3.3759999999999999,"5min":503.37900000000002,"15min":503.37900000000002},"last":2.169}]},{"osd":2,"last update":"Mon Nov 16 22:00:52 2020","interfaces":[{"interface":"back","average":{"1min":2.6320000000000001,"5min":2.8330000000000002,"15min":2.8359999999999999},"min":{"1min":1.387,"5min":1.387,"15min":1.387},"max":{"1min":3.2360000000000002,"5min":4.2300000000000004,"15min":4.2300000000000004},"last":2.9140000000000001},{"interface":"front","average":{"1min":2.7999999999999998,"5min":3.0470000000000002,"15min":3.097},"min":{"1min":1.554,"5min":1.554,"15min":1.554},"max":{"1min":3.7040000000000002,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":520.64300000000003}]},{"osd":3,"last update":"Mon Nov 16 22:00:52 2020","interfaces":[{"interface":"back","average":{"1min":2.3319999999999999,"5min":2.4489999999999998,"15min":2.4569999999999999},"min":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"max":{"1min":2.851,"5min":4.181,"15min":4.181},"last":2.6640000000000001},{"interface":"front","average":{"1min":3.2999999999999998,"5min":25.026,"15min":34.689},"min":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"max":{"1min":5.2859999999999996,"5min":764.17999999999995,"15min":764.17999999999995},"last":3.0339999999999998}]},{"osd":4,"last update":"Mon Nov 16 22:00:52 2020","interfaces":[{"interface":"back","average":{"1min":2.7959999999999998,"5min":2.9590000000000001,"15min":3.0009999999999999},"min":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"max":{"1min":3.5030000000000001,"5min":3.8730000000000002,"15min":3.8730000000000002},"last":2.2509999999999999},{"interface":"front","average":{"1min":15.151,"5min":5.3449999999999998,"15min":3.71},"min":{"1min":2.323,"5min":1.821,"15min":1.821},"max":{"1min":221.72399999999999,"5min":221.72399999999999,"15min":221.72399999999999},"last":2.7530000000000001}]},{"osd":5,"last update":"Mon Nov 16 22:00:52 2020","interfaces":[{"interface":"back","average":{"1min":3.569,"5min":15.640000000000001,"15min":21.012},"min":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"max":{"1min":5.5049999999999999,"5min":429.83199999999999,"15min":429.83199999999999},"last":3.1480000000000001},{"interface":"front","average":{"1min":2.8330000000000002,"5min":3.3690000000000002,"15min":3.524},"min":{"1min":1.913,"5min":1.9019999999999999,"15min":1.9019999999999999},"max":{"1min":3.6269999999999998,"5min":6.7039999999999997,"15min":6.7039999999999997},"last":2.964}]},{"osd":6,"last update":"Mon Nov 16 22:00:52 2020","interfaces":[{"interface":"back","average":{"1min":26.117999999999999,"5min":13.148999999999999,"15min":6.8769999999999998},"min":{"1min":2.081,"5min":2.077,"15min":2.077},"max":{"1min":418.173,"5min":505.31599999999997,"15min":505.31599999999997},"last":2.2909999999999999},{"interface":"front","average":{"1min":3.4329999999999998,"5min":11.943,"15min":6.1799999999999997},"min":{"1min":2.4889999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"max":{"1min":4.5010000000000003,"5min":505.37400000000002,"15min":505.37400000000002},"last":3.6709999999999998}]},{"osd":8,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":3.2589999999999999,"5min":9.8529999999999998,"15min":7.8760000000000003},"min":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"max":{"1min":4.0419999999999998,"5min":419.17399999999998,"15min":419.17399999999998},"last":2.8719999999999999},{"interface":"front","average":{"1min":3.6890000000000001,"5min":3.5920000000000001,"15min":3.5350000000000001},"min":{"1min":2.548,"5min":2.4039999999999999,"15min":2.4039999999999999},"max":{"1min":4.8760000000000003,"5min":5.4429999999999996,"15min":5.4429999999999996},"last":3.7610000000000001}]},{"osd":9,"last update":"Mon Nov 16 22:00:38 2020","interfaces":[{"interface":"back","average":{"1min":3.4359999999999999,"5min":3.6619999999999999,"15min":3.7000000000000002},"min":{"1min":2.3319999999999999,"5min":2.016,"15min":2.016},"max":{"1min":4.6369999999999996,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":3.8130000000000002},{"interface":"front","average":{"1min":3.8599999999999999,"5min":24.129000000000001,"15min":27.507000000000001},"min":{"1min":3.0920000000000001,"5min":2.8879999999999999,"15min":2.8879999999999999},"max":{"1min":5.3579999999999997,"5min":533.94899999999996,"15min":533.94899999999996},"last":3.5710000000000002}]},{"osd":10,"last update":"Mon Nov 16 22:01:07 2020","interfaces":[{"interface":"back","average":{"1min":3.96,"5min":22.111000000000001,"15min":25.135999999999999},"min":{"1min":3.327,"5min":2.7989999999999999,"15min":2.7989999999999999},"max":{"1min":4.7640000000000002,"5min":505.94200000000001,"15min":505.94200000000001},"last":3.8639999999999999},{"interface":"front","average":{"1min":4.0099999999999998,"5min":54.026000000000003,"15min":62.362000000000002},"min":{"1min":3.028,"5min":2.847,"15min":2.847},"max":{"1min":5.718,"5min":506.30099999999999,"15min":506.30099999999999},"last":3.629}]},{"osd":11,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":3.8639999999999999,"5min":3.8639999999999999,"15min":3.8639999999999999},"min":{"1min":3.0649999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"max":{"1min":4.3810000000000002,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":3.105},{"interface":"front","average":{"1min":4.1399999999999997,"5min":4.1399999999999997,"15min":4.1399999999999997},"min":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"max":{"1min":4.859,"5min":4.859,"15min":4.859},"last":3.9159999999999999}]}]},{"osd":6,"up_from":43,"seq":184683593779,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5584,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739568,"statfs":{"total":95995035648,"available":95989317632,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:00:23 2020","interfaces":[{"interface":"back","average":{"1min":8.1739999999999995,"5min":8.8450000000000006,"15min":4.7770000000000001},"min":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"max":{"1min":104.563,"5min":504.16300000000001,"15min":504.16300000000001},"last":2.7930000000000001},{"interface":"front","average":{"1min":3.1000000000000001,"5min":8.0939999999999994,"15min":4.7460000000000004},"min":{"1min":1.7,"5min":1.7,"15min":1.7},"max":{"1min":4.1470000000000002,"5min":503.84300000000002,"15min":503.84300000000002},"last":2.7090000000000001}]},{"osd":1,"last update":"Mon Nov 16 22:00:23 2020","interfaces":[{"interface":"back","average":{"1min":2.6509999999999998,"5min":17.861000000000001,"15min":24.611000000000001},"min":{"1min":1.4970000000000001,"5min":1.389,"15min":1.389},"max":{"1min":4.4390000000000001,"5min":567.11500000000001,"15min":567.11500000000001},"last":3.1659999999999999},{"interface":"front","average":{"1min":2.6499999999999999,"5min":6.7270000000000003,"15min":3.992},"min":{"1min":1.8009999999999999,"5min":1.677,"15min":1.677},"max":{"1min":4.0810000000000004,"5min":432.185,"15min":432.185},"last":2.6059999999999999}]},{"osd":2,"last update":"Mon Nov 16 22:00:23 2020","interfaces":[{"interface":"back","average":{"1min":35.496000000000002,"5min":9.2420000000000009,"15min":4.798},"min":{"1min":1.9279999999999999,"5min":1.381,"15min":1.381},"max":{"1min":590.68799999999999,"5min":590.68799999999999,"15min":590.68799999999999},"last":2.4470000000000001},{"interface":"front","average":{"1min":2.883,"5min":2.5819999999999999,"15min":2.4689999999999999},"min":{"1min":1.8680000000000001,"5min":1.776,"15min":1.776},"max":{"1min":3.8610000000000002,"5min":4.0629999999999997,"15min":4.0629999999999997},"last":3.016}]},{"osd":3,"last update":"Mon Nov 16 22:00:23 2020","interfaces":[{"interface":"back","average":{"1min":2.9790000000000001,"5min":3.8039999999999998,"15min":2.9910000000000001},"min":{"1min":2.222,"5min":1.7430000000000001,"15min":1.7430000000000001},"max":{"1min":3.6789999999999998,"5min":115.22799999999999,"15min":115.22799999999999},"last":3.105},{"interface":"front","average":{"1min":3.1589999999999998,"5min":25.460000000000001,"15min":35.381999999999998},"min":{"1min":1.877,"5min":1.877,"15min":1.877},"max":{"1min":4.4729999999999999,"5min":826.58799999999997,"15min":826.58799999999997},"last":2.8799999999999999}]},{"osd":4,"last update":"Mon Nov 16 22:00:23 2020","interfaces":[{"interface":"back","average":{"1min":3.2879999999999998,"5min":2.9399999999999999,"15min":2.7999999999999998},"min":{"1min":2.4340000000000002,"5min":1.99,"15min":1.99},"max":{"1min":4.7889999999999997,"5min":4.7889999999999997,"15min":4.7889999999999997},"last":2.5470000000000002},{"interface":"front","average":{"1min":3.1800000000000002,"5min":4.4729999999999999,"15min":3.3340000000000001},"min":{"1min":2.4380000000000002,"5min":1.8180000000000001,"15min":1.8180000000000001},"max":{"1min":4.319,"5min":167.81399999999999,"15min":167.81399999999999},"last":2.931}]},{"osd":5,"last update":"Mon Nov 16 22:00:23 2020","interfaces":[{"interface":"back","average":{"1min":3.488,"5min":34.786999999999999,"15min":48.716999999999999},"min":{"1min":2.8439999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"max":{"1min":4.1680000000000001,"5min":962.26099999999997,"15min":962.26099999999997},"last":3.657},{"interface":"front","average":{"1min":7.5149999999999997,"5min":3.883,"15min":3.2189999999999999},"min":{"1min":2.5379999999999998,"5min":2.0600000000000001,"15min":2.0600000000000001},"max":{"1min":78.284000000000006,"5min":78.284000000000006,"15min":78.284000000000006},"last":3.706}]},{"osd":7,"last update":"Mon Nov 16 22:00:49 2020","interfaces":[{"interface":"back","average":{"1min":3.5049999999999999,"5min":3.254,"15min":3.1840000000000002},"min":{"1min":2.6349999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"max":{"1min":4.6219999999999999,"5min":4.6219999999999999,"15min":4.6219999999999999},"last":3.222},{"interface":"front","average":{"1min":3.8210000000000002,"5min":11.281000000000001,"15min":5.9329999999999998},"min":{"1min":2.6349999999999998,"5min":2.4470000000000001,"15min":2.4470000000000001},"max":{"1min":5.5369999999999999,"5min":825.97500000000002,"15min":825.97500000000002},"last":3.5259999999999998}]},{"osd":8,"last update":"Mon Nov 16 22:01:12 2020","interfaces":[{"interface":"back","average":{"1min":29.062000000000001,"5min":8.798,"15min":5.4000000000000004},"min":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"max":{"1min":505.20600000000002,"5min":505.20600000000002,"15min":505.20600000000002},"last":3.7639999999999998},{"interface":"front","average":{"1min":29.044,"5min":8.6120000000000001,"15min":5.1399999999999997},"min":{"1min":3.1120000000000001,"5min":2.742,"15min":2.742},"max":{"1min":506.22000000000003,"5min":506.22000000000003,"15min":506.22000000000003},"last":3.8109999999999999}]},{"osd":9,"last update":"Mon Nov 16 22:00:40 2020","interfaces":[{"interface":"back","average":{"1min":4.0010000000000003,"5min":3.8620000000000001,"15min":3.839},"min":{"1min":2.9529999999999998,"5min":2.5430000000000001,"15min":2.5430000000000001},"max":{"1min":5.0670000000000002,"5min":5.2699999999999996,"15min":5.2699999999999996},"last":3.879},{"interface":"front","average":{"1min":4.2910000000000004,"5min":4.0330000000000004,"15min":3.9900000000000002},"min":{"1min":3.1299999999999999,"5min":3.1299999999999999,"15min":3.1299999999999999},"max":{"1min":5.3289999999999997,"5min":5.3289999999999997,"15min":5.3289999999999997},"last":3.6200000000000001}]},{"osd":10,"last update":"Mon Nov 16 22:01:02 2020","interfaces":[{"interface":"back","average":{"1min":4.2830000000000004,"5min":4.2430000000000003,"15min":4.2370000000000001},"min":{"1min":3.206,"5min":3.206,"15min":3.206},"max":{"1min":5.0999999999999996,"5min":5.2409999999999997,"15min":5.2409999999999997},"last":3.9780000000000002},{"interface":"front","average":{"1min":3.9569999999999999,"5min":7.343,"15min":7.907},"min":{"1min":3.3530000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"max":{"1min":4.9450000000000003,"5min":83.480999999999995,"15min":83.480999999999995},"last":3.9340000000000002}]}]},{"osd":1,"up_from":18,"seq":77309411403,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5776,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739376,"statfs":{"total":95995035648,"available":95989121024,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:00:31 2020","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":9.3559999999999999,"15min":3.9169999999999998},"min":{"1min":1.581,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":3.5590000000000002,"5min":827.64999999999998,"15min":827.64999999999998},"last":2.1850000000000001},{"interface":"front","average":{"1min":2.3799999999999999,"5min":1.9430000000000001,"15min":1.407},"min":{"1min":1.2829999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":3.7789999999999999}]},{"osd":2,"last update":"Mon Nov 16 22:00:52 2020","interfaces":[{"interface":"back","average":{"1min":2.1850000000000001,"5min":17.800999999999998,"15min":42.652999999999999},"min":{"1min":1.387,"5min":1.028,"15min":1.028},"max":{"1min":3.8769999999999998,"5min":911.07100000000003,"15min":911.07100000000003},"last":1.9810000000000001},{"interface":"front","average":{"1min":2.3969999999999998,"5min":9.6880000000000006,"15min":4.4660000000000002},"min":{"1min":1.2969999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":5.867,"5min":786.87599999999998,"15min":786.87599999999998},"last":2.2650000000000001}]},{"osd":3,"last update":"Mon Nov 16 22:00:16 2020","interfaces":[{"interface":"back","average":{"1min":2.2400000000000002,"5min":2.0630000000000002,"15min":1.875},"min":{"1min":1.288,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":4.0919999999999996,"5min":4.8860000000000001,"15min":4.8860000000000001},"last":2.5390000000000001},{"interface":"front","average":{"1min":2.431,"5min":2.23,"15min":2.0760000000000001},"min":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":2.1059999999999999}]},{"osd":4,"last update":"Mon Nov 16 22:00:35 2020","interfaces":[{"interface":"back","average":{"1min":2.7040000000000002,"5min":2.597,"15min":2.4929999999999999},"min":{"1min":1.256,"5min":1.256,"15min":1.256},"max":{"1min":4.109,"5min":4.109,"15min":4.109},"last":2.448},{"interface":"front","average":{"1min":2.9849999999999999,"5min":2.6619999999999999,"15min":2.504},"min":{"1min":1.907,"5min":1.599,"15min":1.599},"max":{"1min":4.4669999999999996,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":3.2829999999999999}]},{"osd":5,"last update":"Mon Nov 16 22:01:10 2020","interfaces":[{"interface":"back","average":{"1min":2.7160000000000002,"5min":3.0459999999999998,"15min":2.8620000000000001},"min":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"max":{"1min":4.1890000000000001,"5min":35.645000000000003,"15min":35.645000000000003},"last":3.339},{"interface":"front","average":{"1min":2.9990000000000001,"5min":2.843,"15min":2.6230000000000002},"min":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"max":{"1min":4.2999999999999998,"5min":5.6200000000000001,"15min":5.6200000000000001},"last":3.4319999999999999}]},{"osd":6,"last update":"Mon Nov 16 22:00:22 2020","interfaces":[{"interface":"back","average":{"1min":3.3399999999999999,"5min":3.1269999999999998,"15min":2.9500000000000002},"min":{"1min":1.958,"5min":1.958,"15min":1.958},"max":{"1min":5.5179999999999998,"5min":5.5179999999999998,"15min":5.5179999999999998},"last":2.399},{"interface":"front","average":{"1min":3.294,"5min":3.085,"15min":3.0070000000000001},"min":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"max":{"1min":4.508,"5min":4.508,"15min":4.508},"last":2.613}]},{"osd":7,"last update":"Mon Nov 16 22:00:52 2020","interfaces":[{"interface":"back","average":{"1min":75.956999999999994,"5min":23.355,"15min":10.205},"min":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"max":{"1min":947.86900000000003,"5min":947.86900000000003,"15min":947.86900000000003},"last":2.4790000000000001},{"interface":"front","average":{"1min":53.244,"5min":13.291,"15min":6.6050000000000004},"min":{"1min":2.266,"5min":2.0790000000000002,"15min":2.0790000000000002},"max":{"1min":506.30900000000003,"5min":506.30900000000003,"15min":506.30900000000003},"last":3.8279999999999998}]},{"osd":8,"last update":"Mon Nov 16 22:01:10 2020","interfaces":[{"interface":"back","average":{"1min":3.4750000000000001,"5min":3.4500000000000002,"15min":3.4350000000000001},"min":{"1min":2.5299999999999998,"5min":2.363,"15min":2.363},"max":{"1min":4.4500000000000002,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":3.681},{"interface":"front","average":{"1min":29.277000000000001,"5min":16.106999999999999,"15min":7.8730000000000002},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":414.72000000000003,"5min":878.62900000000002,"15min":878.62900000000002},"last":3.8940000000000001}]},{"osd":9,"last update":"Mon Nov 16 22:00:39 2020","interfaces":[{"interface":"back","average":{"1min":3.7919999999999998,"5min":23.648,"15min":26.957000000000001},"min":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"max":{"1min":6.2770000000000001,"5min":572.471,"15min":572.471},"last":3.625},{"interface":"front","average":{"1min":3.8170000000000002,"5min":3.6819999999999999,"15min":3.6600000000000001},"min":{"1min":2.54,"5min":2.1709999999999998,"15min":2.1709999999999998},"max":{"1min":4.7370000000000001,"5min":5.0620000000000003,"15min":5.0620000000000003},"last":3.948}]},{"osd":10,"last update":"Mon Nov 16 22:01:10 2020","interfaces":[{"interface":"back","average":{"1min":4.0549999999999997,"5min":3.8929999999999998,"15min":3.8660000000000001},"min":{"1min":2.7309999999999999,"5min":2.7290000000000001,"15min":2.7290000000000001},"max":{"1min":6.141,"5min":6.141,"15min":6.141},"last":3.7290000000000001},{"interface":"front","average":{"1min":3.847,"5min":8.6620000000000008,"15min":9.4640000000000004},"min":{"1min":1.893,"5min":1.893,"15min":1.893},"max":{"1min":4.8719999999999999,"5min":153.101,"15min":153.101},"last":4.0069999999999997}]}]},{"osd":0,"up_from":12,"seq":51539607632,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5840,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739312,"statfs":{"total":95995035648,"available":95989055488,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":45.753,"5min":10.757999999999999,"15min":4.5960000000000001},"min":{"1min":1.3799999999999999,"5min":0.87,"15min":0.87},"max":{"1min":876.30399999999997,"5min":876.30399999999997,"15min":876.30399999999997},"last":1.6839999999999999},{"interface":"front","average":{"1min":3.2000000000000002,"5min":2.4060000000000001,"15min":1.804},"min":{"1min":1.7649999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":5.6139999999999999,"5min":5.6139999999999999,"15min":5.6139999999999999},"last":1.722}]},{"osd":2,"last update":"Mon Nov 16 21:58:46 2020","interfaces":[{"interface":"back","average":{"1min":1.8540000000000001,"5min":1.6439999999999999,"15min":1.5600000000000001},"min":{"1min":1.506,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.1589999999999998,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":2.7029999999999998},{"interface":"front","average":{"1min":2.226,"5min":21.937999999999999,"15min":30.780000000000001},"min":{"1min":1.7110000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":3.0169999999999999,"5min":674.01900000000001,"15min":674.01900000000001},"last":2.0339999999999998}]},{"osd":3,"last update":"Mon Nov 16 22:01:09 2020","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":8.9420000000000002,"15min":4.1980000000000004},"min":{"1min":1.01,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.456,"5min":600.50300000000004,"15min":600.50300000000004},"last":1.1759999999999999},{"interface":"front","average":{"1min":2.028,"5min":9.1470000000000002,"15min":4.3550000000000004},"min":{"1min":1.462,"5min":1.319,"15min":1.319},"max":{"1min":2.827,"5min":709.81700000000001,"15min":709.81700000000001},"last":1.579}]},{"osd":4,"last update":"Mon Nov 16 22:00:35 2020","interfaces":[{"interface":"back","average":{"1min":2.327,"5min":6.335,"15min":10.115},"min":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"max":{"1min":3.3849999999999998,"5min":206.61000000000001,"15min":206.61000000000001},"last":2.4359999999999999},{"interface":"front","average":{"1min":3.6850000000000001,"5min":3.0880000000000001,"15min":2.722},"min":{"1min":2.677,"5min":1.9350000000000001,"15min":1.9350000000000001},"max":{"1min":5.1740000000000004,"5min":5.1740000000000004,"15min":5.1740000000000004},"last":3.7930000000000001}]},{"osd":5,"last update":"Mon Nov 16 22:01:03 2020","interfaces":[{"interface":"back","average":{"1min":3.254,"5min":3.4159999999999999,"15min":3.5609999999999999},"min":{"1min":2.1480000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"max":{"1min":5.1159999999999997,"5min":25.355,"15min":25.355},"last":3.605},{"interface":"front","average":{"1min":2.3740000000000001,"5min":2.6080000000000001,"15min":2.5990000000000002},"min":{"1min":1.722,"5min":1.722,"15min":1.722},"max":{"1min":3.0009999999999999,"5min":4.9359999999999999,"15min":4.9359999999999999},"last":2.472}]},{"osd":6,"last update":"Mon Nov 16 22:00:28 2020","interfaces":[{"interface":"back","average":{"1min":3.532,"5min":7.6529999999999996,"15min":4.593},"min":{"1min":2.093,"5min":1.5649999999999999,"15min":1.5649999999999999},"max":{"1min":5.2949999999999999,"5min":334.87200000000001,"15min":334.87200000000001},"last":3.6640000000000001},{"interface":"front","average":{"1min":2.7749999999999999,"5min":22.861999999999998,"15min":31.716000000000001},"min":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"max":{"1min":4.0730000000000004,"5min":670.24099999999999,"15min":670.24099999999999},"last":2.5720000000000001}]},{"osd":7,"last update":"Mon Nov 16 22:00:51 2020","interfaces":[{"interface":"back","average":{"1min":2.6040000000000001,"5min":2.9140000000000001,"15min":2.964},"min":{"1min":1.784,"5min":1.784,"15min":1.784},"max":{"1min":3.258,"5min":4.5549999999999997,"15min":4.5549999999999997},"last":2.391},{"interface":"front","average":{"1min":41.268000000000001,"5min":11.311999999999999,"15min":6.274},"min":{"1min":3.0390000000000001,"5min":2.625,"15min":2.625},"max":{"1min":639.31399999999996,"5min":639.31399999999996,"15min":639.31399999999996},"last":3.7120000000000002}]},{"osd":8,"last update":"Mon Nov 16 22:01:16 2020","interfaces":[{"interface":"back","average":{"1min":2.6779999999999999,"5min":3.0710000000000002,"15min":3.2189999999999999},"min":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"max":{"1min":3.7120000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":2.5459999999999998},{"interface":"front","average":{"1min":3.8559999999999999,"5min":14.224,"15min":18.747},"min":{"1min":2.746,"5min":2.746,"15min":2.746},"max":{"1min":5.3730000000000002,"5min":293.52100000000002,"15min":293.52100000000002},"last":3.7519999999999998}]},{"osd":9,"last update":"Mon Nov 16 22:00:39 2020","interfaces":[{"interface":"back","average":{"1min":4.335,"5min":4.2439999999999998,"15min":4.2290000000000001},"min":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"max":{"1min":5.5010000000000003,"5min":5.7359999999999998,"15min":5.7359999999999998},"last":3.887},{"interface":"front","average":{"1min":29.266999999999999,"5min":8.4550000000000001,"15min":4.9859999999999998},"min":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"max":{"1min":472.029,"5min":472.029,"15min":472.029},"last":2.9830000000000001}]},{"osd":10,"last update":"Mon Nov 16 22:01:09 2020","interfaces":[{"interface":"back","average":{"1min":63.841000000000001,"5min":15.441000000000001,"15min":7.375},"min":{"1min":2.444,"5min":2.444,"15min":2.444},"max":{"1min":588.774,"5min":588.774,"15min":588.774},"last":2.3450000000000002},{"interface":"front","average":{"1min":5.2489999999999997,"5min":4.5960000000000001,"15min":4.4870000000000001},"min":{"1min":2.923,"5min":2.923,"15min":2.923},"max":{"1min":22.879999999999999,"5min":22.879999999999999,"15min":22.879999999999999},"last":3.8380000000000001}]},{"osd":11,"last update":"Mon Nov 16 22:00:28 2020","interfaces":[{"interface":"back","average":{"1min":4.5030000000000001,"5min":4.5030000000000001,"15min":4.5030000000000001},"min":{"1min":2.931,"5min":2.931,"15min":2.931},"max":{"1min":5.9809999999999999,"5min":5.9809999999999999,"15min":5.9809999999999999},"last":3.9260000000000002},{"interface":"front","average":{"1min":3.4449999999999998,"5min":3.4449999999999998,"15min":3.4449999999999998},"min":{"1min":2.597,"5min":2.597,"15min":2.597},"max":{"1min":4.3959999999999999,"5min":4.3959999999999999,"15min":4.3959999999999999},"last":2.6469999999999998}]}]},{"osd":2,"up_from":23,"seq":98784247878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5712,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739440,"statfs":{"total":95995035648,"available":95989186560,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:00:53 2020","interfaces":[{"interface":"back","average":{"1min":17.986000000000001,"5min":6.2430000000000003,"15min":6.8090000000000002},"min":{"1min":1.177,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":333.88799999999998,"5min":333.88799999999998,"15min":333.88799999999998},"last":2.3919999999999999},{"interface":"front","average":{"1min":2.294,"5min":13.273999999999999,"15min":18.861000000000001},"min":{"1min":1.276,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":3.6509999999999998,"5min":737.34500000000003,"15min":737.34500000000003},"last":2.5369999999999999}]},{"osd":1,"last update":"Mon Nov 16 22:00:53 2020","interfaces":[{"interface":"back","average":{"1min":2.6429999999999998,"5min":2.282,"15min":1.714},"min":{"1min":1.319,"5min":0.749,"15min":0.749},"max":{"1min":4.069,"5min":4.069,"15min":4.069},"last":2.3130000000000002},{"interface":"front","average":{"1min":2.8679999999999999,"5min":2.5750000000000002,"15min":1.9339999999999999},"min":{"1min":1.2989999999999999,"5min":1.022,"15min":1.022},"max":{"1min":4.2889999999999997,"5min":4.8940000000000001,"15min":4.8940000000000001},"last":2.629}]},{"osd":3,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":2.5379999999999998,"5min":2.532,"15min":2.2429999999999999},"min":{"1min":1.696,"5min":1.6000000000000001,"15min":1.6000000000000001},"max":{"1min":4.0499999999999998,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":2.766},{"interface":"front","average":{"1min":2.0150000000000001,"5min":1.859,"15min":1.7170000000000001},"min":{"1min":1.294,"5min":1.155,"15min":1.155},"max":{"1min":3.4889999999999999,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":3.4889999999999999}]},{"osd":4,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":2.3889999999999998,"5min":2.431,"15min":2.1629999999999998},"min":{"1min":1.536,"5min":1.4750000000000001,"15min":1.4750000000000001},"max":{"1min":3.746,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":4.6529999999999996},{"interface":"front","average":{"1min":2.5910000000000002,"5min":2.734,"15min":2.597},"min":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"max":{"1min":4.4900000000000002,"5min":4.54,"15min":4.54},"last":4.7450000000000001}]},{"osd":5,"last update":"Mon Nov 16 22:01:08 2020","interfaces":[{"interface":"back","average":{"1min":3.1299999999999999,"5min":10.664999999999999,"15min":18.257000000000001},"min":{"1min":1.964,"5min":1.7310000000000001,"15min":1.7310000000000001},"max":{"1min":4.9640000000000004,"5min":413.923,"15min":413.923},"last":4.827},{"interface":"front","average":{"1min":3.4329999999999998,"5min":3.202,"15min":2.9620000000000002},"min":{"1min":2.097,"5min":1.6739999999999999,"15min":1.6739999999999999},"max":{"1min":5.4649999999999999,"5min":5.4649999999999999,"15min":5.4649999999999999},"last":4.2640000000000002}]},{"osd":6,"last update":"Mon Nov 16 22:00:25 2020","interfaces":[{"interface":"back","average":{"1min":35.783999999999999,"5min":10.06,"15min":5.7080000000000002},"min":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"max":{"1min":505.08300000000003,"5min":505.08300000000003,"15min":505.08300000000003},"last":4.4329999999999998},{"interface":"front","average":{"1min":72.450000000000003,"5min":16.584,"15min":7.2809999999999997},"min":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"max":{"1min":691.75800000000004,"5min":691.75800000000004,"15min":691.75800000000004},"last":4.3559999999999999}]},{"osd":7,"last update":"Mon Nov 16 22:00:53 2020","interfaces":[{"interface":"back","average":{"1min":3.2890000000000001,"5min":3.2320000000000002,"15min":3.2480000000000002},"min":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"max":{"1min":5.0309999999999997,"5min":5.0309999999999997,"15min":5.0309999999999997},"last":4.4850000000000003},{"interface":"front","average":{"1min":3.802,"5min":7.8499999999999996,"15min":9.6370000000000005},"min":{"1min":2.27,"5min":2.1850000000000001,"15min":2.1850000000000001},"max":{"1min":5.1920000000000002,"5min":104.51300000000001,"15min":104.51300000000001},"last":4.7839999999999998}]},{"osd":8,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":3.944,"5min":3.754,"15min":3.665},"min":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"max":{"1min":6.0289999999999999,"5min":6.0289999999999999,"15min":6.0289999999999999},"last":4.609},{"interface":"front","average":{"1min":10.391999999999999,"5min":5.048,"15min":4.2119999999999997},"min":{"1min":1.946,"5min":1.946,"15min":1.946},"max":{"1min":146.42099999999999,"5min":146.42099999999999,"15min":146.42099999999999},"last":4.3049999999999997}]},{"osd":9,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":3.7120000000000002,"5min":4.1280000000000001,"15min":4.1970000000000001},"min":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"max":{"1min":5.0300000000000002,"5min":5.6980000000000004,"15min":5.6980000000000004},"last":4.6970000000000001},{"interface":"front","average":{"1min":2.5710000000000002,"5min":2.7629999999999999,"15min":2.7949999999999999},"min":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"max":{"1min":3.254,"5min":3.5070000000000001,"15min":3.5070000000000001},"last":4.532}]},{"osd":10,"last update":"Mon Nov 16 22:01:08 2020","interfaces":[{"interface":"back","average":{"1min":3.6059999999999999,"5min":3.6080000000000001,"15min":3.6080000000000001},"min":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"max":{"1min":5.3289999999999997,"5min":5.3289999999999997,"15min":5.3289999999999997},"last":4.9160000000000004},{"interface":"front","average":{"1min":4.093,"5min":4.218,"15min":4.2389999999999999},"min":{"1min":2.5819999999999999,"5min":2.286,"15min":2.286},"max":{"1min":5.6970000000000001,"5min":5.8040000000000003,"15min":5.8040000000000003},"last":4.8760000000000003}]}]},{"osd":3,"up_from":28,"seq":120259084354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5712,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739440,"statfs":{"total":95995035648,"available":95989186560,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 21:59:06 2020","interfaces":[{"interface":"back","average":{"1min":2.2469999999999999,"5min":1.7609999999999999,"15min":1.639},"min":{"1min":1.367,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":3.1549999999999998,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":3.0249999999999999},{"interface":"front","average":{"1min":12.419,"5min":3.9289999999999998,"15min":2.4940000000000002},"min":{"1min":1.502,"5min":1.266,"15min":1.266},"max":{"1min":208.25899999999999,"5min":208.25899999999999,"15min":208.25899999999999},"last":1.9450000000000001}]},{"osd":1,"last update":"Mon Nov 16 22:01:13 2020","interfaces":[{"interface":"back","average":{"1min":1.6659999999999999,"5min":1.8560000000000001,"15min":1.7629999999999999},"min":{"1min":1.0249999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":2.1070000000000002,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":2.1070000000000002},{"interface":"front","average":{"1min":7.5289999999999999,"5min":3.1339999999999999,"15min":2.2490000000000001},"min":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"max":{"1min":112.852,"5min":112.852,"15min":112.852},"last":1.7330000000000001}]},{"osd":2,"last update":"Mon Nov 16 22:01:13 2020","interfaces":[{"interface":"back","average":{"1min":2.004,"5min":7.5430000000000001,"15min":3.7549999999999999},"min":{"1min":1.244,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":4.1429999999999998,"5min":456.19600000000003,"15min":456.19600000000003},"last":1.6140000000000001},{"interface":"front","average":{"1min":2,"5min":2.2309999999999999,"15min":2.0310000000000001},"min":{"1min":1.069,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":3.9020000000000001,"5min":4.8419999999999996,"15min":4.8419999999999996},"last":2.02}]},{"osd":4,"last update":"Mon Nov 16 22:00:32 2020","interfaces":[{"interface":"back","average":{"1min":2.0139999999999998,"5min":2.2890000000000001,"15min":2.2200000000000002},"min":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"max":{"1min":3.1200000000000001,"5min":4.2960000000000003,"15min":4.2960000000000003},"last":1.9610000000000001},{"interface":"front","average":{"1min":2.5800000000000001,"5min":16.73,"15min":30.853999999999999},"min":{"1min":1.484,"5min":1.484,"15min":1.484},"max":{"1min":4.5620000000000003,"5min":678.92100000000005,"15min":678.92100000000005},"last":2.609}]},{"osd":5,"last update":"Mon Nov 16 22:01:02 2020","interfaces":[{"interface":"back","average":{"1min":2.3999999999999999,"5min":2.6739999999999999,"15min":2.5920000000000001},"min":{"1min":1.413,"5min":1.413,"15min":1.413},"max":{"1min":4.0229999999999997,"5min":4.1680000000000001,"15min":4.1680000000000001},"last":3.492},{"interface":"front","average":{"1min":2.593,"5min":24.279,"15min":45.645000000000003},"min":{"1min":1.746,"5min":1.746,"15min":1.746},"max":{"1min":4.165,"5min":862.47799999999995,"15min":862.47799999999995},"last":3.5720000000000001}]},{"osd":6,"last update":"Mon Nov 16 22:00:23 2020","interfaces":[{"interface":"back","average":{"1min":44.633000000000003,"5min":11.417,"15min":5.7869999999999999},"min":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"max":{"1min":917.947,"5min":917.947,"15min":917.947},"last":3.661},{"interface":"front","average":{"1min":3.1280000000000001,"5min":2.9990000000000001,"15min":2.9180000000000001},"min":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"max":{"1min":4.6779999999999999,"5min":5.0259999999999998,"15min":5.0259999999999998},"last":2.6720000000000002}]},{"osd":7,"last update":"Mon Nov 16 22:00:51 2020","interfaces":[{"interface":"back","average":{"1min":2.6829999999999998,"5min":3.2309999999999999,"15min":3.2730000000000001},"min":{"1min":1.8620000000000001,"5min":1.728,"15min":1.728},"max":{"1min":4.234,"5min":5.0700000000000003,"15min":5.0700000000000003},"last":2.7930000000000001},{"interface":"front","average":{"1min":2.9980000000000002,"5min":3.2229999999999999,"15min":3.1429999999999998},"min":{"1min":1.883,"5min":1.883,"15min":1.883},"max":{"1min":4.0339999999999998,"5min":5.2060000000000004,"15min":5.2060000000000004},"last":2.8290000000000002}]},{"osd":8,"last update":"Mon Nov 16 22:00:16 2020","interfaces":[{"interface":"back","average":{"1min":43.881999999999998,"5min":11.662000000000001,"15min":6.2919999999999998},"min":{"1min":1.863,"5min":1.863,"15min":1.863},"max":{"1min":852.04899999999998,"5min":852.04899999999998,"15min":852.04899999999998},"last":2.7200000000000002},{"interface":"front","average":{"1min":15.573,"5min":5.6260000000000003,"15min":3.968},"min":{"1min":1.516,"5min":1.516,"15min":1.516},"max":{"1min":274.65199999999999,"5min":274.65199999999999,"15min":274.65199999999999},"last":2.3380000000000001}]},{"osd":9,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":2.9820000000000002,"5min":3.532,"15min":3.6240000000000001},"min":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"max":{"1min":4.6230000000000002,"5min":4.7839999999999998,"15min":4.7839999999999998},"last":3.0910000000000002},{"interface":"front","average":{"1min":3.4809999999999999,"5min":3.9049999999999998,"15min":3.976},"min":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"max":{"1min":4.8019999999999996,"5min":5.319,"15min":5.319},"last":4.9580000000000002}]},{"osd":10,"last update":"Mon Nov 16 22:01:05 2020","interfaces":[{"interface":"back","average":{"1min":3.8439999999999999,"5min":3.9319999999999999,"15min":3.9460000000000002},"min":{"1min":2.464,"5min":2.2909999999999999,"15min":2.2909999999999999},"max":{"1min":6.1059999999999999,"5min":6.1059999999999999,"15min":6.1059999999999999},"last":3.2839999999999998},{"interface":"front","average":{"1min":3.3450000000000002,"5min":3.3170000000000002,"15min":3.3119999999999998},"min":{"1min":2.597,"5min":2.3620000000000001,"15min":2.3620000000000001},"max":{"1min":6.1550000000000002,"5min":6.1550000000000002,"15min":6.1550000000000002},"last":3.4260000000000002}]},{"osd":11,"last update":"Mon Nov 16 22:00:27 2020","interfaces":[{"interface":"back","average":{"1min":3.7829999999999999,"5min":3.7829999999999999,"15min":3.7829999999999999},"min":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"max":{"1min":4.9249999999999998,"5min":4.9249999999999998,"15min":4.9249999999999998},"last":3.218},{"interface":"front","average":{"1min":2.9260000000000002,"5min":2.9260000000000002,"15min":2.9260000000000002},"min":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"max":{"1min":3.5489999999999999,"5min":3.5489999999999999,"15min":3.5489999999999999},"last":499.03300000000002}]}]},{"osd":4,"up_from":33,"seq":141733920829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5712,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739440,"statfs":{"total":95995035648,"available":95989186560,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:00:40 2020","interfaces":[{"interface":"back","average":{"1min":2.645,"5min":6.8570000000000002,"15min":3.5710000000000002},"min":{"1min":1.766,"5min":1.204,"15min":1.204},"max":{"1min":3.5569999999999999,"5min":414.75,"15min":414.75},"last":2.1659999999999999},{"interface":"front","average":{"1min":2.8980000000000001,"5min":5.3049999999999997,"15min":2.9809999999999999},"min":{"1min":2.0030000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":4.1269999999999998,"5min":265.625,"15min":265.625},"last":2.4580000000000002}]},{"osd":1,"last update":"Mon Nov 16 22:00:40 2020","interfaces":[{"interface":"back","average":{"1min":2.8279999999999998,"5min":2.3399999999999999,"15min":1.9019999999999999},"min":{"1min":1.3899999999999999,"5min":1.278,"15min":1.278},"max":{"1min":3.6760000000000002,"5min":4.6500000000000004,"15min":4.6500000000000004},"last":3.2850000000000001},{"interface":"front","average":{"1min":3.2559999999999998,"5min":12.266,"15min":5.5819999999999999},"min":{"1min":2.5299999999999998,"5min":1.3799999999999999,"15min":1.3799999999999999},"max":{"1min":4.6349999999999998,"5min":862.78999999999996,"15min":862.78999999999996},"last":3.1619999999999999}]},{"osd":2,"last update":"Mon Nov 16 22:00:40 2020","interfaces":[{"interface":"back","average":{"1min":2.6059999999999999,"5min":2.4460000000000002,"15min":2.2789999999999999},"min":{"1min":1.8680000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"max":{"1min":3.254,"5min":4.4500000000000002,"15min":4.4500000000000002},"last":2.2309999999999999},{"interface":"front","average":{"1min":2.976,"5min":2.512,"15min":2.198},"min":{"1min":2.1099999999999999,"5min":1.284,"15min":1.284},"max":{"1min":3.9540000000000002,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":2.2970000000000002}]},{"osd":3,"last update":"Mon Nov 16 22:00:40 2020","interfaces":[{"interface":"back","average":{"1min":3.4159999999999999,"5min":2.7530000000000001,"15min":2.4369999999999998},"min":{"1min":2.6589999999999998,"5min":1.2150000000000001,"15min":1.2150000000000001},"max":{"1min":4.8920000000000003,"5min":6.5140000000000002,"15min":6.5140000000000002},"last":3.601},{"interface":"front","average":{"1min":3.109,"5min":13.48,"15min":6.1159999999999997},"min":{"1min":2.2669999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"max":{"1min":4.0839999999999996,"5min":972.75199999999995,"15min":972.75199999999995},"last":3.2170000000000001}]},{"osd":5,"last update":"Mon Nov 16 22:01:01 2020","interfaces":[{"interface":"back","average":{"1min":3.2189999999999999,"5min":8.2159999999999993,"15min":13.331},"min":{"1min":2.2970000000000002,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":4.2430000000000003,"5min":274.38400000000001,"15min":274.38400000000001},"last":2.5249999999999999},{"interface":"front","average":{"1min":3.5659999999999998,"5min":2.8700000000000001,"15min":2.3959999999999999},"min":{"1min":2.6030000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":4.7919999999999998,"5min":5.9189999999999996,"15min":5.9189999999999996},"last":3.4609999999999999}]},{"osd":6,"last update":"Mon Nov 16 22:00:24 2020","interfaces":[{"interface":"back","average":{"1min":3.125,"5min":12.909000000000001,"15min":6.2430000000000003},"min":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"max":{"1min":3.9119999999999999,"5min":844.12900000000002,"15min":844.12900000000002},"last":2.395},{"interface":"front","average":{"1min":3.5720000000000001,"5min":3.1269999999999998,"15min":2.9929999999999999},"min":{"1min":2.3410000000000002,"5min":1.8700000000000001,"15min":1.8700000000000001},"max":{"1min":4.4169999999999998,"5min":6.6529999999999996,"15min":6.6529999999999996},"last":3.5179999999999998}]},{"osd":7,"last update":"Mon Nov 16 22:00:54 2020","interfaces":[{"interface":"back","average":{"1min":3.734,"5min":3.4980000000000002,"15min":3.371},"min":{"1min":2.9670000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"max":{"1min":4.907,"5min":7.8079999999999998,"15min":7.8079999999999998},"last":3.7000000000000002},{"interface":"front","average":{"1min":3.9769999999999999,"5min":3.7149999999999999,"15min":3.5409999999999999},"min":{"1min":2.7280000000000002,"5min":2.5139999999999998,"15min":2.5139999999999998},"max":{"1min":5.3659999999999997,"5min":5.4660000000000002,"15min":5.4660000000000002},"last":4.3109999999999999}]},{"osd":8,"last update":"Mon Nov 16 22:01:13 2020","interfaces":[{"interface":"back","average":{"1min":3.754,"5min":3.7080000000000002,"15min":3.589},"min":{"1min":2.8370000000000002,"5min":2.4470000000000001,"15min":2.4470000000000001},"max":{"1min":5.1589999999999998,"5min":8.3960000000000008,"15min":8.3960000000000008},"last":3.4129999999999998},{"interface":"front","average":{"1min":4.3250000000000002,"5min":4.141,"15min":4.0330000000000004},"min":{"1min":3.3679999999999999,"5min":3.29,"15min":3.29},"max":{"1min":5.7990000000000004,"5min":5.8090000000000002,"15min":5.8090000000000002},"last":4.3849999999999998}]},{"osd":9,"last update":"Mon Nov 16 22:00:40 2020","interfaces":[{"interface":"back","average":{"1min":49.145000000000003,"5min":13.374000000000001,"15min":7.4119999999999999},"min":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"max":{"1min":990.01099999999997,"5min":990.01099999999997,"15min":990.01099999999997},"last":4.4329999999999998},{"interface":"front","average":{"1min":3.6110000000000002,"5min":3.6349999999999998,"15min":3.6389999999999998},"min":{"1min":2.8570000000000002,"5min":2.4239999999999999,"15min":2.4239999999999999},"max":{"1min":4.8259999999999996,"5min":7.6849999999999996,"15min":7.6849999999999996},"last":3.3740000000000001}]},{"osd":10,"last update":"Mon Nov 16 22:01:11 2020","interfaces":[{"interface":"back","average":{"1min":4.1799999999999997,"5min":4.2880000000000003,"15min":4.306},"min":{"1min":3.3889999999999998,"5min":3.3889999999999998,"15min":3.3889999999999998},"max":{"1min":5.2400000000000002,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":3.6469999999999998},{"interface":"front","average":{"1min":29.556999999999999,"5min":9.5570000000000004,"15min":6.2229999999999999},"min":{"1min":3.5910000000000002,"5min":3.5910000000000002,"15min":3.5910000000000002},"max":{"1min":479.274,"5min":479.274,"15min":479.274},"last":4.4859999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757302,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5584,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739568,"statfs":{"total":95995035648,"available":95989317632,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:01:07 2020","interfaces":[{"interface":"back","average":{"1min":2.968,"5min":2.5,"15min":2.242},"min":{"1min":1.7210000000000001,"5min":1.089,"15min":1.089},"max":{"1min":3.633,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":2.9910000000000001},{"interface":"front","average":{"1min":2.617,"5min":17.756,"15min":18.838999999999999},"min":{"1min":1.5549999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"max":{"1min":3.6219999999999999,"5min":795.57799999999997,"15min":795.57799999999997},"last":2.915}]},{"osd":1,"last update":"Mon Nov 16 22:01:07 2020","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.4409999999999998,"15min":2.1709999999999998},"min":{"1min":1.7849999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"max":{"1min":3.4609999999999999,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":2.7109999999999999},{"interface":"front","average":{"1min":2.8849999999999998,"5min":2.5630000000000002,"15min":2.3029999999999999},"min":{"1min":1.681,"5min":1.2789999999999999,"15min":1.2789999999999999},"max":{"1min":3.6659999999999999,"5min":4.2039999999999997,"15min":4.2039999999999997},"last":2.8180000000000001}]},{"osd":2,"last update":"Mon Nov 16 22:01:07 2020","interfaces":[{"interface":"back","average":{"1min":2.774,"5min":24.614999999999998,"15min":9.5399999999999991},"min":{"1min":1.77,"5min":1.097,"15min":1.097},"max":{"1min":3.5699999999999998,"5min":975.82500000000005,"15min":975.82500000000005},"last":2.7589999999999999},{"interface":"front","average":{"1min":2.8279999999999998,"5min":3.7829999999999999,"15min":4.7069999999999999},"min":{"1min":1.7190000000000001,"5min":1.389,"15min":1.389},"max":{"1min":3.7050000000000001,"5min":69.685000000000002,"15min":69.685000000000002},"last":2.6400000000000001}]},{"osd":3,"last update":"Mon Nov 16 22:01:07 2020","interfaces":[{"interface":"back","average":{"1min":3.1589999999999998,"5min":2.9119999999999999,"15min":2.637},"min":{"1min":2.496,"5min":1.5409999999999999,"15min":1.5409999999999999},"max":{"1min":4.1289999999999996,"5min":4.1289999999999996,"15min":4.1289999999999996},"last":3.036},{"interface":"front","average":{"1min":3.2970000000000002,"5min":3.0110000000000001,"15min":2.7450000000000001},"min":{"1min":2.4500000000000002,"5min":1.726,"15min":1.726},"max":{"1min":3.8370000000000002,"5min":4.3879999999999999,"15min":4.3879999999999999},"last":3.1659999999999999}]},{"osd":4,"last update":"Mon Nov 16 22:01:07 2020","interfaces":[{"interface":"back","average":{"1min":2.9390000000000001,"5min":2.581,"15min":2.2530000000000001},"min":{"1min":1.492,"5min":1.472,"15min":1.472},"max":{"1min":4.1669999999999998,"5min":4.1669999999999998,"15min":4.1669999999999998},"last":3.0870000000000002},{"interface":"front","average":{"1min":3.1909999999999998,"5min":2.8109999999999999,"15min":2.4510000000000001},"min":{"1min":2.6280000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":4.1459999999999999,"5min":4.306,"15min":4.306},"last":2.8769999999999998}]},{"osd":6,"last update":"Mon Nov 16 22:00:28 2020","interfaces":[{"interface":"back","average":{"1min":3.1850000000000001,"5min":22.498000000000001,"15min":31.117999999999999},"min":{"1min":2.1499999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"max":{"1min":4.6630000000000003,"5min":722.72699999999998,"15min":722.72699999999998},"last":3.278},{"interface":"front","average":{"1min":3.5510000000000002,"5min":3.032,"15min":2.8079999999999998},"min":{"1min":2.9569999999999999,"5min":1.224,"15min":1.224},"max":{"1min":4.5170000000000003,"5min":4.5170000000000003,"15min":4.5170000000000003},"last":3.2229999999999999}]},{"osd":7,"last update":"Mon Nov 16 22:00:57 2020","interfaces":[{"interface":"back","average":{"1min":3.589,"5min":3.5390000000000001,"15min":3.5569999999999999},"min":{"1min":2.8410000000000002,"5min":2.1970000000000001,"15min":2.1970000000000001},"max":{"1min":5.8099999999999996,"5min":5.9960000000000004,"15min":5.9960000000000004},"last":3.7599999999999998},{"interface":"front","average":{"1min":3.681,"5min":3.4620000000000002,"15min":3.3940000000000001},"min":{"1min":2.4950000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"max":{"1min":4.5270000000000001,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":3.5430000000000001}]},{"osd":8,"last update":"Mon Nov 16 22:00:15 2020","interfaces":[{"interface":"back","average":{"1min":3.7919999999999998,"5min":3.7210000000000001,"15min":3.7090000000000001},"min":{"1min":2.383,"5min":2.383,"15min":2.383},"max":{"1min":5.0830000000000002,"5min":6.0730000000000004,"15min":6.0730000000000004},"last":3.4399999999999999},{"interface":"front","average":{"1min":3.8079999999999998,"5min":3.7410000000000001,"15min":3.73},"min":{"1min":2.7240000000000002,"5min":2.7240000000000002,"15min":2.7240000000000002},"max":{"1min":4.7370000000000001,"5min":4.7370000000000001,"15min":4.7370000000000001},"last":327.36700000000002}]},{"osd":9,"last update":"Mon Nov 16 22:00:40 2020","interfaces":[{"interface":"back","average":{"1min":27.015000000000001,"5min":8.4830000000000005,"15min":5.3949999999999996},"min":{"1min":2.52,"5min":2.5059999999999998,"15min":2.5059999999999998},"max":{"1min":505.19299999999998,"5min":505.19299999999998,"15min":505.19299999999998},"last":3.3580000000000001},{"interface":"front","average":{"1min":28.611999999999998,"5min":8.7880000000000003,"15min":5.484},"min":{"1min":2.8650000000000002,"5min":2.8650000000000002,"15min":2.8650000000000002},"max":{"1min":548.05499999999995,"5min":548.05499999999995,"15min":548.05499999999995},"last":3.488}]},{"osd":10,"last update":"Mon Nov 16 22:01:07 2020","interfaces":[{"interface":"back","average":{"1min":4.1319999999999997,"5min":3.9889999999999999,"15min":3.9649999999999999},"min":{"1min":3.2189999999999999,"5min":2.75,"15min":2.75},"max":{"1min":5.9080000000000004,"5min":5.9080000000000004,"15min":5.9080000000000004},"last":3.879},{"interface":"front","average":{"1min":4.181,"5min":4.1929999999999996,"15min":4.1950000000000003},"min":{"1min":3.0539999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"max":{"1min":4.8129999999999997,"5min":5.1769999999999996,"15min":5.1769999999999996},"last":3.8300000000000001}]}]}]}} 2020-11-16T22:01:22.064 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph pg dump --format=json 2020-11-16T22:01:22.201 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:01:22.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:22 smithi057 bash[10301]: audit 2020-11-16T22:01:21.376504+0000 mgr.x (mgr.24115) 257 : audit [DBG] from='client.14709 v1:172.21.15.195:0/302932813' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-11-16T22:01:22.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:22 smithi057 bash[10301]: cluster 2020-11-16T22:01:21.555068+0000 mgr.x (mgr.24115) 258 : cluster [DBG] pgmap v261: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:23.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:22 smithi016 bash[10302]: audit 2020-11-16T22:01:21.376504+0000 mgr.x (mgr.24115) 257 : audit [DBG] from='client.14709 v1:172.21.15.195:0/302932813' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-11-16T22:01:23.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:22 smithi016 bash[10302]: cluster 2020-11-16T22:01:21.555068+0000 mgr.x (mgr.24115) 258 : cluster [DBG] pgmap v261: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:23.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:22 smithi195 bash[10218]: audit 2020-11-16T22:01:21.376504+0000 mgr.x (mgr.24115) 257 : audit [DBG] from='client.14709 v1:172.21.15.195:0/302932813' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-11-16T22:01:23.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:22 smithi195 bash[10218]: cluster 2020-11-16T22:01:21.555068+0000 mgr.x (mgr.24115) 258 : cluster [DBG] pgmap v261: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:24.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:24 smithi057 bash[10301]: cluster 2020-11-16T22:01:23.555658+0000 mgr.x (mgr.24115) 259 : cluster [DBG] pgmap v262: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:25.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:24 smithi016 bash[10302]: cluster 2020-11-16T22:01:23.555658+0000 mgr.x (mgr.24115) 259 : cluster [DBG] pgmap v262: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:25.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:24 smithi195 bash[10218]: cluster 2020-11-16T22:01:23.555658+0000 mgr.x (mgr.24115) 259 : cluster [DBG] pgmap v262: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:25.176 INFO:teuthology.orchestra.run.smithi195.stdout: 2020-11-16T22:01:25.177 INFO:teuthology.orchestra.run.smithi195.stderr:dumped all 2020-11-16T22:01:25.846 INFO:teuthology.orchestra.run.smithi195.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2020-11-16T22:01:23.555338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":12,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":1124941824,"kb_used":67328,"kb_used_data":7776,"kb_used_omap":0,"kb_used_meta":59456,"kb_avail":1124874496,"statfs":{"total":1151940427776,"available":1151871483904,"internally_reserved":0,"allocated":7962624,"data_stored":3246216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":60882944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"45","reported_epoch":"69","state":"active+clean","last_fresh":"2020-11-16T21:59:27.603441+0000","last_change":"2020-11-16T21:59:27.603441+0000","last_active":"2020-11-16T21:59:27.603441+0000","last_peered":"2020-11-16T21:59:27.603441+0000","last_clean":"2020-11-16T21:59:27.603441+0000","last_became_active":"2020-11-16T21:59:27.603020+0000","last_became_peered":"2020-11-16T21:59:27.603020+0000","last_unstale":"2020-11-16T21:59:27.603441+0000","last_undegraded":"2020-11-16T21:59:27.603441+0000","last_fullsized":"2020-11-16T21:59:27.603441+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":5,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T21:53:16.485896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T21:53:16.485896+0000","last_clean_scrub_stamp":"2020-11-16T21:53:16.485896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776153,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5392,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93739760,"statfs":{"total":95995035648,"available":95989514240,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"min":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"max":{"1min":3.669,"5min":3.669,"15min":3.669},"last":1.897},{"interface":"front","average":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"min":{"1min":1.857,"5min":1.857,"15min":1.857},"max":{"1min":4.3300000000000001,"5min":4.3300000000000001,"15min":4.3300000000000001},"last":1.7949999999999999}]},{"osd":1,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":12.460000000000001,"5min":12.460000000000001,"15min":12.460000000000001},"min":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"max":{"1min":188.61600000000001,"5min":188.61600000000001,"15min":188.61600000000001},"last":2.1640000000000001},{"interface":"front","average":{"1min":31.518000000000001,"5min":31.518000000000001,"15min":31.518000000000001},"min":{"1min":1.26,"5min":1.26,"15min":1.26},"max":{"1min":614.48199999999997,"5min":614.48199999999997,"15min":614.48199999999997},"last":3.6829999999999998}]},{"osd":2,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":4.0209999999999999,"5min":4.0209999999999999,"15min":4.0209999999999999},"last":3.8679999999999999},{"interface":"front","average":{"1min":2.218,"5min":2.218,"15min":2.218},"min":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"max":{"1min":2.7610000000000001,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":2.052}]},{"osd":3,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":2.6240000000000001,"5min":2.6240000000000001,"15min":2.6240000000000001},"min":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"max":{"1min":3.48,"5min":3.48,"15min":3.48},"last":1.9890000000000001},{"interface":"front","average":{"1min":2.948,"5min":2.948,"15min":2.948},"min":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"max":{"1min":7.2039999999999997,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":3.7650000000000001}]},{"osd":4,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":45.206000000000003,"5min":45.206000000000003,"15min":45.206000000000003},"min":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"max":{"1min":885.75099999999998,"5min":885.75099999999998,"15min":885.75099999999998},"last":3.823},{"interface":"front","average":{"1min":3.2850000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"min":{"1min":2.165,"5min":2.165,"15min":2.165},"max":{"1min":4.556,"5min":4.556,"15min":4.556},"last":3.968}]},{"osd":5,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":3.1629999999999998,"5min":3.1629999999999998,"15min":3.1629999999999998},"min":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"max":{"1min":5.2359999999999998,"5min":5.2359999999999998,"15min":5.2359999999999998},"last":3.2360000000000002},{"interface":"front","average":{"1min":35.173999999999999,"5min":35.173999999999999,"15min":35.173999999999999},"min":{"1min":2.77,"5min":2.77,"15min":2.77},"max":{"1min":503.91399999999999,"5min":503.91399999999999,"15min":503.91399999999999},"last":4.0140000000000002}]},{"osd":6,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":3.6379999999999999,"5min":3.6379999999999999,"15min":3.6379999999999999},"min":{"1min":2.4409999999999998,"5min":2.4409999999999998,"15min":2.4409999999999998},"max":{"1min":6.8150000000000004,"5min":6.8150000000000004,"15min":6.8150000000000004},"last":4.0599999999999996},{"interface":"front","average":{"1min":32.220999999999997,"5min":32.220999999999997,"15min":32.220999999999997},"min":{"1min":2.9460000000000002,"5min":2.9460000000000002,"15min":2.9460000000000002},"max":{"1min":606.91999999999996,"5min":606.91999999999996,"15min":606.91999999999996},"last":3.1789999999999998}]},{"osd":7,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":3.867,"5min":3.867,"15min":3.867},"min":{"1min":2.7370000000000001,"5min":2.7370000000000001,"15min":2.7370000000000001},"max":{"1min":6.7460000000000004,"5min":6.7460000000000004,"15min":6.7460000000000004},"last":4.1769999999999996},{"interface":"front","average":{"1min":3.581,"5min":3.581,"15min":3.581},"min":{"1min":2.835,"5min":2.835,"15min":2.835},"max":{"1min":5.4109999999999996,"5min":5.4109999999999996,"15min":5.4109999999999996},"last":3.2799999999999998}]},{"osd":8,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":3.9260000000000002,"5min":3.9260000000000002,"15min":3.9260000000000002},"min":{"1min":3.153,"5min":3.153,"15min":3.153},"max":{"1min":7.3280000000000003,"5min":7.3280000000000003,"15min":7.3280000000000003},"last":3.9289999999999998},{"interface":"front","average":{"1min":32.668999999999997,"5min":32.668999999999997,"15min":32.668999999999997},"min":{"1min":2.9300000000000002,"5min":2.9300000000000002,"15min":2.9300000000000002},"max":{"1min":405.51999999999998,"5min":405.51999999999998,"15min":405.51999999999998},"last":4.2359999999999998}]},{"osd":10,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":4.0679999999999996,"5min":4.0679999999999996,"15min":4.0679999999999996},"min":{"1min":3.2509999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"max":{"1min":7.3789999999999996,"5min":7.3789999999999996,"15min":7.3789999999999996},"last":4.1280000000000001},{"interface":"front","average":{"1min":4.1159999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"min":{"1min":3.2570000000000001,"5min":3.2570000000000001,"15min":3.2570000000000001},"max":{"1min":6.9909999999999997,"5min":6.9909999999999997,"15min":6.9909999999999997},"last":4.2830000000000004}]}]},{"osd":10,"up_from":63,"seq":270582939678,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5456,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93739696,"statfs":{"total":95995035648,"available":95989448704,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4289999999999998}]},{"osd":1,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":2.7519999999999998,"5min":2.609,"15min":2.585},"min":{"1min":1.605,"5min":1.48,"15min":1.48},"max":{"1min":4.4249999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":2.2890000000000001},{"interface":"front","average":{"1min":2.7109999999999999,"5min":2.5369999999999999,"15min":2.508},"min":{"1min":1.7769999999999999,"5min":1.405,"15min":1.405},"max":{"1min":4.5330000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":2.8420000000000001}]},{"osd":2,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":2.5659999999999998,"5min":2.5990000000000002,"15min":2.605},"min":{"1min":1.7729999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"max":{"1min":3.835,"5min":8.3300000000000001,"15min":8.3300000000000001},"last":1.919},{"interface":"front","average":{"1min":2.8159999999999998,"5min":2.754,"15min":2.7440000000000002},"min":{"1min":1.768,"5min":1.6299999999999999,"15min":1.6299999999999999},"max":{"1min":4.7949999999999999,"5min":4.7949999999999999,"15min":4.7949999999999999},"last":2.3889999999999998}]},{"osd":3,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":3.0009999999999999,"5min":3.1619999999999999,"15min":3.1890000000000001},"min":{"1min":1.774,"5min":1.774,"15min":1.774},"max":{"1min":5.1070000000000002,"5min":8.657,"15min":8.657},"last":2.339},{"interface":"front","average":{"1min":2.5750000000000002,"5min":2.863,"15min":2.911},"min":{"1min":1.639,"5min":1.4470000000000001,"15min":1.4470000000000001},"max":{"1min":4.2190000000000003,"5min":8.4049999999999994,"15min":8.4049999999999994},"last":1.819}]},{"osd":4,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":44.606999999999999,"5min":11.515000000000001,"15min":5.9989999999999997},"min":{"1min":1.875,"5min":1.599,"15min":1.599},"max":{"1min":671.28300000000002,"5min":671.28300000000002,"15min":671.28300000000002},"last":2.609},{"interface":"front","average":{"1min":3.331,"5min":3.298,"15min":3.2919999999999998},"min":{"1min":2.1680000000000001,"5min":1.8959999999999999,"15min":1.8959999999999999},"max":{"1min":4.8860000000000001,"5min":4.8860000000000001,"15min":4.8860000000000001},"last":2.6720000000000002}]},{"osd":5,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":3.8050000000000002,"5min":3.722,"15min":3.7080000000000002},"min":{"1min":2.8769999999999998,"5min":2.6739999999999999,"15min":2.6739999999999999},"max":{"1min":5.3710000000000004,"5min":8.7850000000000001,"15min":8.7850000000000001},"last":2.4329999999999998},{"interface":"front","average":{"1min":3.4079999999999999,"5min":3.3889999999999998,"15min":3.3860000000000001},"min":{"1min":2.048,"5min":1.9950000000000001,"15min":1.9950000000000001},"max":{"1min":4.7409999999999997,"5min":4.7409999999999997,"15min":4.7409999999999997},"last":2.79}]},{"osd":6,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":3.2010000000000001,"5min":3.5710000000000002,"15min":3.633},"min":{"1min":2.4049999999999998,"5min":1.7370000000000001,"15min":1.7370000000000001},"max":{"1min":4.0369999999999999,"5min":8.4459999999999997,"15min":8.4459999999999997},"last":3.125},{"interface":"front","average":{"1min":3.8439999999999999,"5min":3.8700000000000001,"15min":3.8740000000000001},"min":{"1min":2.9470000000000001,"5min":2.819,"15min":2.819},"max":{"1min":5.2530000000000001,"5min":8.8810000000000002,"15min":8.8810000000000002},"last":3.181}]},{"osd":7,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":52.546999999999997,"5min":13.499000000000001,"15min":6.9909999999999997},"min":{"1min":2.7629999999999999,"5min":2.46,"15min":2.46},"max":{"1min":787.95799999999997,"5min":787.95799999999997,"15min":787.95799999999997},"last":3.0089999999999999},{"interface":"front","average":{"1min":4.0670000000000002,"5min":3.8959999999999999,"15min":3.8679999999999999},"min":{"1min":3.0329999999999999,"5min":2.7909999999999999,"15min":2.7909999999999999},"max":{"1min":5.5490000000000004,"5min":8.9879999999999995,"15min":8.9879999999999995},"last":3.0569999999999999}]},{"osd":8,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":3.9889999999999999,"5min":4.0270000000000001,"15min":4.0330000000000004},"min":{"1min":2.6309999999999998,"5min":2.1890000000000001,"15min":2.1890000000000001},"max":{"1min":5.4589999999999996,"5min":13.583,"15min":13.583},"last":3.4969999999999999},{"interface":"front","average":{"1min":3.6280000000000001,"5min":41.179000000000002,"15min":47.436999999999998},"min":{"1min":2.4590000000000001,"5min":1.7749999999999999,"15min":1.7749999999999999},"max":{"1min":4.2679999999999998,"5min":940.79499999999996,"15min":940.79499999999996},"last":3.343}]},{"osd":9,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":3.931,"5min":4.125,"15min":4.157},"min":{"1min":3.0219999999999998,"5min":2.3239999999999998,"15min":2.3239999999999998},"max":{"1min":5.2720000000000002,"5min":13.654999999999999,"15min":13.654999999999999},"last":3.387},{"interface":"front","average":{"1min":4.2789999999999999,"5min":4.4630000000000001,"15min":4.4930000000000003},"min":{"1min":3.2829999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"max":{"1min":6.1950000000000003,"5min":18.227,"15min":18.227},"last":3.3050000000000002}]},{"osd":11,"last update":"Mon Nov 16 22:00:27 2020","interfaces":[{"interface":"back","average":{"1min":3.9350000000000001,"5min":3.9350000000000001,"15min":3.9350000000000001},"min":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"max":{"1min":4.7309999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":3.448},{"interface":"front","average":{"1min":3.8479999999999999,"5min":3.8479999999999999,"15min":3.8479999999999999},"min":{"1min":1.849,"5min":1.849,"15min":1.849},"max":{"1min":4.9139999999999997,"5min":4.9139999999999997,"15min":4.9139999999999997},"last":3.2610000000000001}]}]},{"osd":9,"up_from":58,"seq":249108103204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5456,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93739696,"statfs":{"total":95995035648,"available":95989448704,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":2.5179999999999998,"5min":2.444,"15min":2.4319999999999999},"min":{"1min":1.472,"5min":1.472,"15min":1.472},"max":{"1min":3.6160000000000001,"5min":3.6160000000000001,"15min":3.6160000000000001},"last":1.673},{"interface":"front","average":{"1min":2.5489999999999999,"5min":29.178999999999998,"15min":33.616999999999997},"min":{"1min":1.5389999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"max":{"1min":3.9700000000000002,"5min":635.69200000000001,"15min":635.69200000000001},"last":2.1320000000000001}]},{"osd":1,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":2.109,"5min":2.173,"15min":2.1829999999999998},"min":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"max":{"1min":2.8740000000000001,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":1.7889999999999999},{"interface":"front","average":{"1min":2.6339999999999999,"5min":2.4700000000000002,"15min":2.4430000000000001},"min":{"1min":1.73,"5min":1.466,"15min":1.466},"max":{"1min":3.7269999999999999,"5min":3.7269999999999999,"15min":3.7269999999999999},"last":3.7709999999999999}]},{"osd":2,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":2.4910000000000001,"5min":2.4769999999999999,"15min":2.4750000000000001},"min":{"1min":1.6060000000000001,"5min":1.48,"15min":1.48},"max":{"1min":3.3999999999999999,"5min":3.7930000000000001,"15min":3.7930000000000001},"last":3.492},{"interface":"front","average":{"1min":2.444,"5min":2.6930000000000001,"15min":2.7349999999999999},"min":{"1min":1.099,"5min":1.099,"15min":1.099},"max":{"1min":4.1879999999999997,"5min":4.1879999999999997,"15min":4.1879999999999997},"last":2.2909999999999999}]},{"osd":3,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":2.9750000000000001,"5min":3.1509999999999998,"15min":3.1800000000000002},"min":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"max":{"1min":3.8399999999999999,"5min":9.8550000000000004,"15min":9.8550000000000004},"last":2.2320000000000002},{"interface":"front","average":{"1min":2.4620000000000002,"5min":2.5449999999999999,"15min":2.5590000000000002},"min":{"1min":1.752,"5min":1.752,"15min":1.752},"max":{"1min":3.4399999999999999,"5min":3.5270000000000001,"15min":3.5270000000000001},"last":1.917}]},{"osd":4,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":3.056,"5min":3.2719999999999998,"15min":3.3079999999999998},"min":{"1min":2.302,"5min":1.8029999999999999,"15min":1.8029999999999999},"max":{"1min":3.948,"5min":9.5790000000000006,"15min":9.5790000000000006},"last":3.3580000000000001},{"interface":"front","average":{"1min":3.149,"5min":3.677,"15min":3.7650000000000001},"min":{"1min":2.286,"5min":2.242,"15min":2.242},"max":{"1min":4.0919999999999996,"5min":10.073,"15min":10.073},"last":2.3889999999999998}]},{"osd":5,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":3.6819999999999999,"5min":3.5630000000000002,"15min":3.5430000000000001},"min":{"1min":3.0190000000000001,"5min":2.1720000000000002,"15min":2.1720000000000002},"max":{"1min":4.3949999999999996,"5min":9.9359999999999999,"15min":9.9359999999999999},"last":3.6760000000000002},{"interface":"front","average":{"1min":37.817,"5min":49.792000000000002,"15min":51.787999999999997},"min":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"max":{"1min":527.98699999999997,"5min":949.928,"15min":949.928},"last":3.5819999999999999}]},{"osd":6,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":3.1989999999999998,"5min":3.3079999999999998,"15min":3.3260000000000001},"min":{"1min":2.7549999999999999,"5min":2.2360000000000002,"15min":2.2360000000000002},"max":{"1min":3.8780000000000001,"5min":9.1400000000000006,"15min":9.1400000000000006},"last":3.835},{"interface":"front","average":{"1min":3.4969999999999999,"5min":3.6579999999999999,"15min":3.6850000000000001},"min":{"1min":2.911,"5min":2.0619999999999998,"15min":2.0619999999999998},"max":{"1min":3.903,"5min":9.6460000000000008,"15min":9.6460000000000008},"last":3.9510000000000001}]},{"osd":7,"last update":"Mon Nov 16 22:00:47 2020","interfaces":[{"interface":"back","average":{"1min":3.8100000000000001,"5min":3.9870000000000001,"15min":4.0170000000000003},"min":{"1min":3.2759999999999998,"5min":2.6960000000000002,"15min":2.6960000000000002},"max":{"1min":4.4550000000000001,"5min":10.324999999999999,"15min":10.324999999999999},"last":3.911},{"interface":"front","average":{"1min":3.4809999999999999,"5min":3.645,"15min":3.6720000000000002},"min":{"1min":2.9980000000000002,"5min":2.5,"15min":2.5},"max":{"1min":4.0220000000000002,"5min":9.2940000000000005,"15min":9.2940000000000005},"last":4.008}]},{"osd":8,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":3.665,"5min":3.7690000000000001,"15min":3.786},"min":{"1min":3.214,"5min":1.903,"15min":1.903},"max":{"1min":4.2249999999999996,"5min":9.7720000000000002,"15min":9.7720000000000002},"last":4.0919999999999996},{"interface":"front","average":{"1min":45.927,"5min":12.368,"15min":6.7750000000000004},"min":{"1min":2.8260000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"max":{"1min":596.23000000000002,"5min":596.23000000000002,"15min":596.23000000000002},"last":4.1539999999999999}]},{"osd":10,"last update":"Mon Nov 16 22:01:04 2020","interfaces":[{"interface":"back","average":{"1min":3.9620000000000002,"5min":3.9969999999999999,"15min":4.0030000000000001},"min":{"1min":2.7370000000000001,"5min":2.7370000000000001,"15min":2.7370000000000001},"max":{"1min":5.0010000000000003,"5min":5.0010000000000003,"15min":5.0010000000000003},"last":4.3449999999999998},{"interface":"front","average":{"1min":3.4700000000000002,"5min":3.3700000000000001,"15min":3.3530000000000002},"min":{"1min":2.8999999999999999,"5min":2.0910000000000002,"15min":2.0910000000000002},"max":{"1min":3.9889999999999999,"5min":3.9889999999999999,"15min":3.9889999999999999},"last":4.2039999999999997}]}]},{"osd":8,"up_from":53,"seq":227633266728,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5520,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739632,"statfs":{"total":95995035648,"available":95989383168,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":2.4510000000000001,"5min":2.6539999999999999,"15min":2.7160000000000002},"min":{"1min":1.617,"5min":1.1180000000000001,"15min":1.1180000000000001},"max":{"1min":3.375,"5min":15.356999999999999,"15min":15.356999999999999},"last":2.8109999999999999},{"interface":"front","average":{"1min":2.1859999999999999,"5min":3.8559999999999999,"15min":4.5720000000000001},"min":{"1min":1.5700000000000001,"5min":1.113,"15min":1.113},"max":{"1min":2.8820000000000001,"5min":46.750999999999998,"15min":46.750999999999998},"last":2.3780000000000001}]},{"osd":1,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":2.6739999999999999,"5min":2.6909999999999998,"15min":2.6629999999999998},"min":{"1min":1.5700000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"max":{"1min":3.9940000000000002,"5min":9.6679999999999993,"15min":9.6679999999999993},"last":2.4929999999999999},{"interface":"front","average":{"1min":2.5950000000000002,"5min":2.8490000000000002,"15min":2.9950000000000001},"min":{"1min":1.837,"5min":1.1559999999999999,"15min":1.1559999999999999},"max":{"1min":3.98,"5min":16.106999999999999,"15min":16.106999999999999},"last":2.6019999999999999}]},{"osd":2,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":37.756,"5min":11.473000000000001,"15min":5.452},"min":{"1min":1.673,"5min":1.2430000000000001,"15min":1.2430000000000001},"max":{"1min":748.44399999999996,"5min":748.44399999999996,"15min":748.44399999999996},"last":2.544},{"interface":"front","average":{"1min":24.227,"5min":7.0469999999999997,"15min":4.1159999999999997},"min":{"1min":1.6970000000000001,"5min":1.401,"15min":1.401},"max":{"1min":449.21899999999999,"5min":449.21899999999999,"15min":449.21899999999999},"last":2.694}]},{"osd":3,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":2.8919999999999999,"5min":2.6589999999999998,"15min":2.488},"min":{"1min":1.73,"5min":1.659,"15min":1.659},"max":{"1min":4.335,"5min":5.4139999999999997,"15min":5.4139999999999997},"last":2.9060000000000001},{"interface":"front","average":{"1min":3.0059999999999998,"5min":24.744,"15min":34.409999999999997},"min":{"1min":1.9930000000000001,"5min":1.3129999999999999,"15min":1.3129999999999999},"max":{"1min":4.1379999999999999,"5min":611.22699999999998,"15min":611.22699999999998},"last":3.0569999999999999}]},{"osd":4,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":3.028,"5min":3.3759999999999999,"15min":3.5030000000000001},"min":{"1min":1.8600000000000001,"5min":1.353,"15min":1.353},"max":{"1min":4.4009999999999998,"5min":16.491,"15min":16.491},"last":2.9449999999999998},{"interface":"front","average":{"1min":2.895,"5min":2.9180000000000001,"15min":2.903},"min":{"1min":2.238,"5min":1.8240000000000001,"15min":1.8240000000000001},"max":{"1min":3.9380000000000002,"5min":6.2569999999999997,"15min":6.2569999999999997},"last":2.7490000000000001}]},{"osd":5,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":3.5750000000000002,"5min":3.4159999999999999,"15min":3.3260000000000001},"min":{"1min":2.8439999999999999,"5min":1.901,"15min":1.901},"max":{"1min":4.5579999999999998,"5min":9.7530000000000001,"15min":9.7530000000000001},"last":3.7770000000000001},{"interface":"front","average":{"1min":4.0430000000000001,"5min":3.879,"15min":3.8519999999999999},"min":{"1min":3.339,"5min":1.8420000000000001,"15min":1.8420000000000001},"max":{"1min":4.8300000000000001,"5min":16.280999999999999,"15min":16.280999999999999},"last":4.109}]},{"osd":6,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":3.3639999999999999,"5min":3.081,"15min":3},"min":{"1min":2.4660000000000002,"5min":1.462,"15min":1.462},"max":{"1min":4.2569999999999997,"5min":6.4930000000000003,"15min":6.4930000000000003},"last":3.8380000000000001},{"interface":"front","average":{"1min":3.8119999999999998,"5min":5.4880000000000004,"15min":3.927},"min":{"1min":2.544,"5min":2.3300000000000001,"15min":2.3300000000000001},"max":{"1min":4.7320000000000002,"5min":269.29700000000003,"15min":269.29700000000003},"last":3.9180000000000001}]},{"osd":7,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":3.464,"5min":3.7410000000000001,"15min":3.8149999999999999},"min":{"1min":2.2120000000000002,"5min":1.736,"15min":1.736},"max":{"1min":4.5179999999999998,"5min":15.984,"15min":15.984},"last":4.0579999999999998},{"interface":"front","average":{"1min":3.9750000000000001,"5min":3.4409999999999998,"15min":3.258},"min":{"1min":3.02,"5min":1.629,"15min":1.629},"max":{"1min":4.7830000000000004,"5min":6.7060000000000004,"15min":6.7060000000000004},"last":4.202}]},{"osd":9,"last update":"Mon Nov 16 22:00:42 2020","interfaces":[{"interface":"back","average":{"1min":3.5990000000000002,"5min":27.832999999999998,"15min":31.872},"min":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"max":{"1min":5.0129999999999999,"5min":610.89700000000005,"15min":610.89700000000005},"last":4.0049999999999999},{"interface":"front","average":{"1min":4.0049999999999999,"5min":3.5449999999999999,"15min":3.468},"min":{"1min":2.827,"5min":1.754,"15min":1.754},"max":{"1min":4.8719999999999999,"5min":6.5890000000000004,"15min":6.5890000000000004},"last":4.266}]},{"osd":10,"last update":"Mon Nov 16 22:01:05 2020","interfaces":[{"interface":"back","average":{"1min":11.851000000000001,"5min":5.1399999999999997,"15min":4.0220000000000002},"min":{"1min":2.7570000000000001,"5min":1.349,"15min":1.349},"max":{"1min":155.61600000000001,"5min":155.61600000000001,"15min":155.61600000000001},"last":4.1529999999999996},{"interface":"front","average":{"1min":3.915,"5min":3.7549999999999999,"15min":3.7280000000000002},"min":{"1min":2.8700000000000001,"5min":1.986,"15min":1.986},"max":{"1min":5.0880000000000001,"5min":5.4770000000000003,"15min":5.4770000000000003},"last":4.3220000000000001}]}]},{"osd":7,"up_from":48,"seq":206158430253,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5584,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739568,"statfs":{"total":95995035648,"available":95989317632,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 21:58:44 2020","interfaces":[{"interface":"back","average":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"min":{"1min":1.385,"5min":1.385,"15min":1.385},"max":{"1min":4.5209999999999999,"5min":4.5209999999999999,"15min":4.5209999999999999},"last":1.165},{"interface":"front","average":{"1min":43.802999999999997,"5min":43.802999999999997,"15min":43.802999999999997},"min":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"max":{"1min":819.04200000000003,"5min":819.04200000000003,"15min":819.04200000000003},"last":1.8200000000000001}]},{"osd":1,"last update":"Mon Nov 16 22:00:52 2020","interfaces":[{"interface":"back","average":{"1min":2.8690000000000002,"5min":18.948,"15min":26.088000000000001},"min":{"1min":1.639,"5min":1.5389999999999999,"15min":1.5389999999999999},"max":{"1min":5.4000000000000004,"5min":503.44499999999999,"15min":503.44499999999999},"last":2.4140000000000001},{"interface":"front","average":{"1min":2.2040000000000002,"5min":16.925999999999998,"15min":23.408999999999999},"min":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"max":{"1min":3.3759999999999999,"5min":503.37900000000002,"15min":503.37900000000002},"last":2.6190000000000002}]},{"osd":2,"last update":"Mon Nov 16 22:00:52 2020","interfaces":[{"interface":"back","average":{"1min":2.6320000000000001,"5min":2.8330000000000002,"15min":2.8359999999999999},"min":{"1min":1.387,"5min":1.387,"15min":1.387},"max":{"1min":3.2360000000000002,"5min":4.2300000000000004,"15min":4.2300000000000004},"last":2.3490000000000002},{"interface":"front","average":{"1min":2.7999999999999998,"5min":3.0470000000000002,"15min":3.097},"min":{"1min":1.554,"5min":1.554,"15min":1.554},"max":{"1min":3.7040000000000002,"5min":4.3369999999999997,"15min":4.3369999999999997},"last":2.4710000000000001}]},{"osd":3,"last update":"Mon Nov 16 22:00:52 2020","interfaces":[{"interface":"back","average":{"1min":2.3319999999999999,"5min":2.4489999999999998,"15min":2.4569999999999999},"min":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"max":{"1min":2.851,"5min":4.181,"15min":4.181},"last":2.9510000000000001},{"interface":"front","average":{"1min":3.2999999999999998,"5min":25.026,"15min":34.689},"min":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"max":{"1min":5.2859999999999996,"5min":764.17999999999995,"15min":764.17999999999995},"last":2.7149999999999999}]},{"osd":4,"last update":"Mon Nov 16 22:00:52 2020","interfaces":[{"interface":"back","average":{"1min":2.7959999999999998,"5min":2.9590000000000001,"15min":3.0009999999999999},"min":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"max":{"1min":3.5030000000000001,"5min":3.8730000000000002,"15min":3.8730000000000002},"last":3.153},{"interface":"front","average":{"1min":15.151,"5min":5.3449999999999998,"15min":3.71},"min":{"1min":2.323,"5min":1.821,"15min":1.821},"max":{"1min":221.72399999999999,"5min":221.72399999999999,"15min":221.72399999999999},"last":613.36599999999999}]},{"osd":5,"last update":"Mon Nov 16 22:00:52 2020","interfaces":[{"interface":"back","average":{"1min":3.569,"5min":15.640000000000001,"15min":21.012},"min":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"max":{"1min":5.5049999999999999,"5min":429.83199999999999,"15min":429.83199999999999},"last":2.9100000000000001},{"interface":"front","average":{"1min":2.8330000000000002,"5min":3.3690000000000002,"15min":3.524},"min":{"1min":1.913,"5min":1.9019999999999999,"15min":1.9019999999999999},"max":{"1min":3.6269999999999998,"5min":6.7039999999999997,"15min":6.7039999999999997},"last":2.798}]},{"osd":6,"last update":"Mon Nov 16 22:00:52 2020","interfaces":[{"interface":"back","average":{"1min":26.117999999999999,"5min":13.148999999999999,"15min":6.8769999999999998},"min":{"1min":2.081,"5min":2.077,"15min":2.077},"max":{"1min":418.173,"5min":505.31599999999997,"15min":505.31599999999997},"last":3.0139999999999998},{"interface":"front","average":{"1min":3.4329999999999998,"5min":11.943,"15min":6.1799999999999997},"min":{"1min":2.4889999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"max":{"1min":4.5010000000000003,"5min":505.37400000000002,"15min":505.37400000000002},"last":3.6549999999999998}]},{"osd":8,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":3.2589999999999999,"5min":9.8529999999999998,"15min":7.8760000000000003},"min":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"max":{"1min":4.0419999999999998,"5min":419.17399999999998,"15min":419.17399999999998},"last":3.5870000000000002},{"interface":"front","average":{"1min":3.6890000000000001,"5min":3.5920000000000001,"15min":3.5350000000000001},"min":{"1min":2.548,"5min":2.4039999999999999,"15min":2.4039999999999999},"max":{"1min":4.8760000000000003,"5min":5.4429999999999996,"15min":5.4429999999999996},"last":3.1150000000000002}]},{"osd":9,"last update":"Mon Nov 16 22:00:38 2020","interfaces":[{"interface":"back","average":{"1min":3.4359999999999999,"5min":3.6619999999999999,"15min":3.7000000000000002},"min":{"1min":2.3319999999999999,"5min":2.016,"15min":2.016},"max":{"1min":4.6369999999999996,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":3.056},{"interface":"front","average":{"1min":3.8599999999999999,"5min":24.129000000000001,"15min":27.507000000000001},"min":{"1min":3.0920000000000001,"5min":2.8879999999999999,"15min":2.8879999999999999},"max":{"1min":5.3579999999999997,"5min":533.94899999999996,"15min":533.94899999999996},"last":3.2589999999999999}]},{"osd":10,"last update":"Mon Nov 16 22:01:07 2020","interfaces":[{"interface":"back","average":{"1min":3.96,"5min":22.111000000000001,"15min":25.135999999999999},"min":{"1min":3.327,"5min":2.7989999999999999,"15min":2.7989999999999999},"max":{"1min":4.7640000000000002,"5min":505.94200000000001,"15min":505.94200000000001},"last":3.7519999999999998},{"interface":"front","average":{"1min":4.0099999999999998,"5min":54.026000000000003,"15min":62.362000000000002},"min":{"1min":3.028,"5min":2.847,"15min":2.847},"max":{"1min":5.718,"5min":506.30099999999999,"15min":506.30099999999999},"last":3.5190000000000001}]},{"osd":11,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":3.8639999999999999,"5min":3.8639999999999999,"15min":3.8639999999999999},"min":{"1min":3.0649999999999999,"5min":3.0649999999999999,"15min":3.0649999999999999},"max":{"1min":4.3810000000000002,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":3.7090000000000001},{"interface":"front","average":{"1min":4.1399999999999997,"5min":4.1399999999999997,"15min":4.1399999999999997},"min":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"max":{"1min":4.859,"5min":4.859,"15min":4.859},"last":3.819}]}]},{"osd":6,"up_from":43,"seq":184683593780,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5584,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739568,"statfs":{"total":95995035648,"available":95989317632,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:00:23 2020","interfaces":[{"interface":"back","average":{"1min":8.1739999999999995,"5min":8.8450000000000006,"15min":4.7770000000000001},"min":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"max":{"1min":104.563,"5min":504.16300000000001,"15min":504.16300000000001},"last":2.7930000000000001},{"interface":"front","average":{"1min":3.1000000000000001,"5min":8.0939999999999994,"15min":4.7460000000000004},"min":{"1min":1.7,"5min":1.7,"15min":1.7},"max":{"1min":4.1470000000000002,"5min":503.84300000000002,"15min":503.84300000000002},"last":2.7090000000000001}]},{"osd":1,"last update":"Mon Nov 16 22:00:23 2020","interfaces":[{"interface":"back","average":{"1min":2.6509999999999998,"5min":17.861000000000001,"15min":24.611000000000001},"min":{"1min":1.4970000000000001,"5min":1.389,"15min":1.389},"max":{"1min":4.4390000000000001,"5min":567.11500000000001,"15min":567.11500000000001},"last":3.1659999999999999},{"interface":"front","average":{"1min":2.6499999999999999,"5min":6.7270000000000003,"15min":3.992},"min":{"1min":1.8009999999999999,"5min":1.677,"15min":1.677},"max":{"1min":4.0810000000000004,"5min":432.185,"15min":432.185},"last":2.6059999999999999}]},{"osd":2,"last update":"Mon Nov 16 22:00:23 2020","interfaces":[{"interface":"back","average":{"1min":35.496000000000002,"5min":9.2420000000000009,"15min":4.798},"min":{"1min":1.9279999999999999,"5min":1.381,"15min":1.381},"max":{"1min":590.68799999999999,"5min":590.68799999999999,"15min":590.68799999999999},"last":2.4470000000000001},{"interface":"front","average":{"1min":2.883,"5min":2.5819999999999999,"15min":2.4689999999999999},"min":{"1min":1.8680000000000001,"5min":1.776,"15min":1.776},"max":{"1min":3.8610000000000002,"5min":4.0629999999999997,"15min":4.0629999999999997},"last":3.016}]},{"osd":3,"last update":"Mon Nov 16 22:00:23 2020","interfaces":[{"interface":"back","average":{"1min":2.9790000000000001,"5min":3.8039999999999998,"15min":2.9910000000000001},"min":{"1min":2.222,"5min":1.7430000000000001,"15min":1.7430000000000001},"max":{"1min":3.6789999999999998,"5min":115.22799999999999,"15min":115.22799999999999},"last":3.105},{"interface":"front","average":{"1min":3.1589999999999998,"5min":25.460000000000001,"15min":35.381999999999998},"min":{"1min":1.877,"5min":1.877,"15min":1.877},"max":{"1min":4.4729999999999999,"5min":826.58799999999997,"15min":826.58799999999997},"last":2.8799999999999999}]},{"osd":4,"last update":"Mon Nov 16 22:00:23 2020","interfaces":[{"interface":"back","average":{"1min":3.2879999999999998,"5min":2.9399999999999999,"15min":2.7999999999999998},"min":{"1min":2.4340000000000002,"5min":1.99,"15min":1.99},"max":{"1min":4.7889999999999997,"5min":4.7889999999999997,"15min":4.7889999999999997},"last":2.5470000000000002},{"interface":"front","average":{"1min":3.1800000000000002,"5min":4.4729999999999999,"15min":3.3340000000000001},"min":{"1min":2.4380000000000002,"5min":1.8180000000000001,"15min":1.8180000000000001},"max":{"1min":4.319,"5min":167.81399999999999,"15min":167.81399999999999},"last":2.931}]},{"osd":5,"last update":"Mon Nov 16 22:00:23 2020","interfaces":[{"interface":"back","average":{"1min":3.488,"5min":34.786999999999999,"15min":48.716999999999999},"min":{"1min":2.8439999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"max":{"1min":4.1680000000000001,"5min":962.26099999999997,"15min":962.26099999999997},"last":3.657},{"interface":"front","average":{"1min":7.5149999999999997,"5min":3.883,"15min":3.2189999999999999},"min":{"1min":2.5379999999999998,"5min":2.0600000000000001,"15min":2.0600000000000001},"max":{"1min":78.284000000000006,"5min":78.284000000000006,"15min":78.284000000000006},"last":3.706}]},{"osd":7,"last update":"Mon Nov 16 22:00:49 2020","interfaces":[{"interface":"back","average":{"1min":3.5049999999999999,"5min":3.254,"15min":3.1840000000000002},"min":{"1min":2.6349999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"max":{"1min":4.6219999999999999,"5min":4.6219999999999999,"15min":4.6219999999999999},"last":3.222},{"interface":"front","average":{"1min":3.8210000000000002,"5min":11.281000000000001,"15min":5.9329999999999998},"min":{"1min":2.6349999999999998,"5min":2.4470000000000001,"15min":2.4470000000000001},"max":{"1min":5.5369999999999999,"5min":825.97500000000002,"15min":825.97500000000002},"last":3.5259999999999998}]},{"osd":8,"last update":"Mon Nov 16 22:01:12 2020","interfaces":[{"interface":"back","average":{"1min":29.062000000000001,"5min":8.798,"15min":5.4000000000000004},"min":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"max":{"1min":505.20600000000002,"5min":505.20600000000002,"15min":505.20600000000002},"last":3.7639999999999998},{"interface":"front","average":{"1min":29.044,"5min":8.6120000000000001,"15min":5.1399999999999997},"min":{"1min":3.1120000000000001,"5min":2.742,"15min":2.742},"max":{"1min":506.22000000000003,"5min":506.22000000000003,"15min":506.22000000000003},"last":3.8109999999999999}]},{"osd":9,"last update":"Mon Nov 16 22:00:40 2020","interfaces":[{"interface":"back","average":{"1min":4.0010000000000003,"5min":3.8620000000000001,"15min":3.839},"min":{"1min":2.9529999999999998,"5min":2.5430000000000001,"15min":2.5430000000000001},"max":{"1min":5.0670000000000002,"5min":5.2699999999999996,"15min":5.2699999999999996},"last":3.879},{"interface":"front","average":{"1min":4.2910000000000004,"5min":4.0330000000000004,"15min":3.9900000000000002},"min":{"1min":3.1299999999999999,"5min":3.1299999999999999,"15min":3.1299999999999999},"max":{"1min":5.3289999999999997,"5min":5.3289999999999997,"15min":5.3289999999999997},"last":3.6200000000000001}]},{"osd":10,"last update":"Mon Nov 16 22:01:02 2020","interfaces":[{"interface":"back","average":{"1min":4.2830000000000004,"5min":4.2430000000000003,"15min":4.2370000000000001},"min":{"1min":3.206,"5min":3.206,"15min":3.206},"max":{"1min":5.0999999999999996,"5min":5.2409999999999997,"15min":5.2409999999999997},"last":3.9780000000000002},{"interface":"front","average":{"1min":3.9569999999999999,"5min":7.343,"15min":7.907},"min":{"1min":3.3530000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"max":{"1min":4.9450000000000003,"5min":83.480999999999995,"15min":83.480999999999995},"last":3.9340000000000002}]}]},{"osd":1,"up_from":18,"seq":77309411404,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5776,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739376,"statfs":{"total":95995035648,"available":95989121024,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:00:31 2020","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":9.3559999999999999,"15min":3.9169999999999998},"min":{"1min":1.581,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":3.5590000000000002,"5min":827.64999999999998,"15min":827.64999999999998},"last":2.6190000000000002},{"interface":"front","average":{"1min":2.3799999999999999,"5min":1.9430000000000001,"15min":1.407},"min":{"1min":1.2829999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":2.7709999999999999}]},{"osd":2,"last update":"Mon Nov 16 22:00:52 2020","interfaces":[{"interface":"back","average":{"1min":2.1850000000000001,"5min":17.800999999999998,"15min":42.652999999999999},"min":{"1min":1.387,"5min":1.028,"15min":1.028},"max":{"1min":3.8769999999999998,"5min":911.07100000000003,"15min":911.07100000000003},"last":1.2729999999999999},{"interface":"front","average":{"1min":2.3969999999999998,"5min":9.6880000000000006,"15min":4.4660000000000002},"min":{"1min":1.2969999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":5.867,"5min":786.87599999999998,"15min":786.87599999999998},"last":2.4849999999999999}]},{"osd":3,"last update":"Mon Nov 16 22:01:21 2020","interfaces":[{"interface":"back","average":{"1min":2.2650000000000001,"5min":2.1589999999999998,"15min":1.907},"min":{"1min":1.355,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":4.3630000000000004,"5min":4.8860000000000001,"15min":4.8860000000000001},"last":1.6719999999999999},{"interface":"front","average":{"1min":2.2629999999999999,"5min":2.282,"15min":2.093},"min":{"1min":1.2609999999999999,"5min":1.2090000000000001,"15min":1.2090000000000001},"max":{"1min":4.2160000000000002,"5min":4.2160000000000002,"15min":4.2160000000000002},"last":1.982}]},{"osd":4,"last update":"Mon Nov 16 22:00:35 2020","interfaces":[{"interface":"back","average":{"1min":2.7040000000000002,"5min":2.597,"15min":2.4929999999999999},"min":{"1min":1.256,"5min":1.256,"15min":1.256},"max":{"1min":4.109,"5min":4.109,"15min":4.109},"last":2.9860000000000002},{"interface":"front","average":{"1min":2.9849999999999999,"5min":2.6619999999999999,"15min":2.504},"min":{"1min":1.907,"5min":1.599,"15min":1.599},"max":{"1min":4.4669999999999996,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":3.0419999999999998}]},{"osd":5,"last update":"Mon Nov 16 22:01:10 2020","interfaces":[{"interface":"back","average":{"1min":2.7160000000000002,"5min":3.0459999999999998,"15min":2.8620000000000001},"min":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"max":{"1min":4.1890000000000001,"5min":35.645000000000003,"15min":35.645000000000003},"last":2.1030000000000002},{"interface":"front","average":{"1min":2.9990000000000001,"5min":2.843,"15min":2.6230000000000002},"min":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"max":{"1min":4.2999999999999998,"5min":5.6200000000000001,"15min":5.6200000000000001},"last":2.8279999999999998}]},{"osd":6,"last update":"Mon Nov 16 22:00:22 2020","interfaces":[{"interface":"back","average":{"1min":3.3399999999999999,"5min":3.1269999999999998,"15min":2.9500000000000002},"min":{"1min":1.958,"5min":1.958,"15min":1.958},"max":{"1min":5.5179999999999998,"5min":5.5179999999999998,"15min":5.5179999999999998},"last":3.7839999999999998},{"interface":"front","average":{"1min":3.294,"5min":3.085,"15min":3.0070000000000001},"min":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"max":{"1min":4.508,"5min":4.508,"15min":4.508},"last":2.706}]},{"osd":7,"last update":"Mon Nov 16 22:00:52 2020","interfaces":[{"interface":"back","average":{"1min":75.956999999999994,"5min":23.355,"15min":10.205},"min":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"max":{"1min":947.86900000000003,"5min":947.86900000000003,"15min":947.86900000000003},"last":3.7280000000000002},{"interface":"front","average":{"1min":53.244,"5min":13.291,"15min":6.6050000000000004},"min":{"1min":2.266,"5min":2.0790000000000002,"15min":2.0790000000000002},"max":{"1min":506.30900000000003,"5min":506.30900000000003,"15min":506.30900000000003},"last":2.915}]},{"osd":8,"last update":"Mon Nov 16 22:01:10 2020","interfaces":[{"interface":"back","average":{"1min":3.4750000000000001,"5min":3.4500000000000002,"15min":3.4350000000000001},"min":{"1min":2.5299999999999998,"5min":2.363,"15min":2.363},"max":{"1min":4.4500000000000002,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":3.8959999999999999},{"interface":"front","average":{"1min":29.277000000000001,"5min":16.106999999999999,"15min":7.8730000000000002},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":414.72000000000003,"5min":878.62900000000002,"15min":878.62900000000002},"last":4.0010000000000003}]},{"osd":9,"last update":"Mon Nov 16 22:00:39 2020","interfaces":[{"interface":"back","average":{"1min":3.7919999999999998,"5min":23.648,"15min":26.957000000000001},"min":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"max":{"1min":6.2770000000000001,"5min":572.471,"15min":572.471},"last":3.6749999999999998},{"interface":"front","average":{"1min":3.8170000000000002,"5min":3.6819999999999999,"15min":3.6600000000000001},"min":{"1min":2.54,"5min":2.1709999999999998,"15min":2.1709999999999998},"max":{"1min":4.7370000000000001,"5min":5.0620000000000003,"15min":5.0620000000000003},"last":4.0999999999999996}]},{"osd":10,"last update":"Mon Nov 16 22:01:10 2020","interfaces":[{"interface":"back","average":{"1min":4.0549999999999997,"5min":3.8929999999999998,"15min":3.8660000000000001},"min":{"1min":2.7309999999999999,"5min":2.7290000000000001,"15min":2.7290000000000001},"max":{"1min":6.141,"5min":6.141,"15min":6.141},"last":3.8439999999999999},{"interface":"front","average":{"1min":3.847,"5min":8.6620000000000008,"15min":9.4640000000000004},"min":{"1min":1.893,"5min":1.893,"15min":1.893},"max":{"1min":4.8719999999999999,"5min":153.101,"15min":153.101},"last":4.1920000000000002}]}]},{"osd":0,"up_from":12,"seq":51539607633,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5840,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739312,"statfs":{"total":95995035648,"available":95989055488,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 16 22:00:30 2020","interfaces":[{"interface":"back","average":{"1min":45.753,"5min":10.757999999999999,"15min":4.5960000000000001},"min":{"1min":1.3799999999999999,"5min":0.87,"15min":0.87},"max":{"1min":876.30399999999997,"5min":876.30399999999997,"15min":876.30399999999997},"last":2.2730000000000001},{"interface":"front","average":{"1min":3.2000000000000002,"5min":2.4060000000000001,"15min":1.804},"min":{"1min":1.7649999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":5.6139999999999999,"5min":5.6139999999999999,"15min":5.6139999999999999},"last":2.339}]},{"osd":2,"last update":"Mon Nov 16 21:58:46 2020","interfaces":[{"interface":"back","average":{"1min":1.8540000000000001,"5min":1.6439999999999999,"15min":1.5600000000000001},"min":{"1min":1.506,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.1589999999999998,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":2.7029999999999998},{"interface":"front","average":{"1min":2.226,"5min":21.937999999999999,"15min":30.780000000000001},"min":{"1min":1.7110000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":3.0169999999999999,"5min":674.01900000000001,"15min":674.01900000000001},"last":2.0339999999999998}]},{"osd":3,"last update":"Mon Nov 16 22:01:09 2020","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":8.9420000000000002,"15min":4.1980000000000004},"min":{"1min":1.01,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.456,"5min":600.50300000000004,"15min":600.50300000000004},"last":1.6859999999999999},{"interface":"front","average":{"1min":2.028,"5min":9.1470000000000002,"15min":4.3550000000000004},"min":{"1min":1.462,"5min":1.319,"15min":1.319},"max":{"1min":2.827,"5min":709.81700000000001,"15min":709.81700000000001},"last":2.1120000000000001}]},{"osd":4,"last update":"Mon Nov 16 22:00:35 2020","interfaces":[{"interface":"back","average":{"1min":2.327,"5min":6.335,"15min":10.115},"min":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"max":{"1min":3.3849999999999998,"5min":206.61000000000001,"15min":206.61000000000001},"last":2.6829999999999998},{"interface":"front","average":{"1min":3.6850000000000001,"5min":3.0880000000000001,"15min":2.722},"min":{"1min":2.677,"5min":1.9350000000000001,"15min":1.9350000000000001},"max":{"1min":5.1740000000000004,"5min":5.1740000000000004,"15min":5.1740000000000004},"last":3.6800000000000002}]},{"osd":5,"last update":"Mon Nov 16 22:01:03 2020","interfaces":[{"interface":"back","average":{"1min":3.254,"5min":3.4159999999999999,"15min":3.5609999999999999},"min":{"1min":2.1480000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"max":{"1min":5.1159999999999997,"5min":25.355,"15min":25.355},"last":2.2069999999999999},{"interface":"front","average":{"1min":2.3740000000000001,"5min":2.6080000000000001,"15min":2.5990000000000002},"min":{"1min":1.722,"5min":1.722,"15min":1.722},"max":{"1min":3.0009999999999999,"5min":4.9359999999999999,"15min":4.9359999999999999},"last":2.4510000000000001}]},{"osd":6,"last update":"Mon Nov 16 22:00:28 2020","interfaces":[{"interface":"back","average":{"1min":3.532,"5min":7.6529999999999996,"15min":4.593},"min":{"1min":2.093,"5min":1.5649999999999999,"15min":1.5649999999999999},"max":{"1min":5.2949999999999999,"5min":334.87200000000001,"15min":334.87200000000001},"last":2.5209999999999999},{"interface":"front","average":{"1min":2.7749999999999999,"5min":22.861999999999998,"15min":31.716000000000001},"min":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"max":{"1min":4.0730000000000004,"5min":670.24099999999999,"15min":670.24099999999999},"last":2.6190000000000002}]},{"osd":7,"last update":"Mon Nov 16 22:00:51 2020","interfaces":[{"interface":"back","average":{"1min":2.6040000000000001,"5min":2.9140000000000001,"15min":2.964},"min":{"1min":1.784,"5min":1.784,"15min":1.784},"max":{"1min":3.258,"5min":4.5549999999999997,"15min":4.5549999999999997},"last":2.4119999999999999},{"interface":"front","average":{"1min":41.268000000000001,"5min":11.311999999999999,"15min":6.274},"min":{"1min":3.0390000000000001,"5min":2.625,"15min":2.625},"max":{"1min":639.31399999999996,"5min":639.31399999999996,"15min":639.31399999999996},"last":3.5630000000000002}]},{"osd":8,"last update":"Mon Nov 16 22:01:16 2020","interfaces":[{"interface":"back","average":{"1min":2.6779999999999999,"5min":3.0710000000000002,"15min":3.2189999999999999},"min":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"max":{"1min":3.7120000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":2.5760000000000001},{"interface":"front","average":{"1min":3.8559999999999999,"5min":14.224,"15min":18.747},"min":{"1min":2.746,"5min":2.746,"15min":2.746},"max":{"1min":5.3730000000000002,"5min":293.52100000000002,"15min":293.52100000000002},"last":3.6299999999999999}]},{"osd":9,"last update":"Mon Nov 16 22:00:39 2020","interfaces":[{"interface":"back","average":{"1min":4.335,"5min":4.2439999999999998,"15min":4.2290000000000001},"min":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"max":{"1min":5.5010000000000003,"5min":5.7359999999999998,"15min":5.7359999999999998},"last":3.73},{"interface":"front","average":{"1min":29.266999999999999,"5min":8.4550000000000001,"15min":4.9859999999999998},"min":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"max":{"1min":472.029,"5min":472.029,"15min":472.029},"last":3.0369999999999999}]},{"osd":10,"last update":"Mon Nov 16 22:01:09 2020","interfaces":[{"interface":"back","average":{"1min":63.841000000000001,"5min":15.441000000000001,"15min":7.375},"min":{"1min":2.444,"5min":2.444,"15min":2.444},"max":{"1min":588.774,"5min":588.774,"15min":588.774},"last":2.9420000000000002},{"interface":"front","average":{"1min":5.2489999999999997,"5min":4.5960000000000001,"15min":4.4870000000000001},"min":{"1min":2.923,"5min":2.923,"15min":2.923},"max":{"1min":22.879999999999999,"5min":22.879999999999999,"15min":22.879999999999999},"last":3.786}]},{"osd":11,"last update":"Mon Nov 16 22:00:28 2020","interfaces":[{"interface":"back","average":{"1min":4.5030000000000001,"5min":4.5030000000000001,"15min":4.5030000000000001},"min":{"1min":2.931,"5min":2.931,"15min":2.931},"max":{"1min":5.9809999999999999,"5min":5.9809999999999999,"15min":5.9809999999999999},"last":3.8380000000000001},{"interface":"front","average":{"1min":3.4449999999999998,"5min":3.4449999999999998,"15min":3.4449999999999998},"min":{"1min":2.597,"5min":2.597,"15min":2.597},"max":{"1min":4.3959999999999999,"5min":4.3959999999999999,"15min":4.3959999999999999},"last":3.0880000000000001}]}]},{"osd":2,"up_from":23,"seq":98784247879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5712,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739440,"statfs":{"total":95995035648,"available":95989186560,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:00:53 2020","interfaces":[{"interface":"back","average":{"1min":17.986000000000001,"5min":6.2430000000000003,"15min":6.8090000000000002},"min":{"1min":1.177,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":333.88799999999998,"5min":333.88799999999998,"15min":333.88799999999998},"last":3.9529999999999998},{"interface":"front","average":{"1min":2.294,"5min":13.273999999999999,"15min":18.861000000000001},"min":{"1min":1.276,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":3.6509999999999998,"5min":737.34500000000003,"15min":737.34500000000003},"last":3.1989999999999998}]},{"osd":1,"last update":"Mon Nov 16 22:00:53 2020","interfaces":[{"interface":"back","average":{"1min":2.6429999999999998,"5min":2.282,"15min":1.714},"min":{"1min":1.319,"5min":0.749,"15min":0.749},"max":{"1min":4.069,"5min":4.069,"15min":4.069},"last":3.0619999999999998},{"interface":"front","average":{"1min":2.8679999999999999,"5min":2.5750000000000002,"15min":1.9339999999999999},"min":{"1min":1.2989999999999999,"5min":1.022,"15min":1.022},"max":{"1min":4.2889999999999997,"5min":4.8940000000000001,"15min":4.8940000000000001},"last":2.153}]},{"osd":3,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":2.5379999999999998,"5min":2.532,"15min":2.2429999999999999},"min":{"1min":1.696,"5min":1.6000000000000001,"15min":1.6000000000000001},"max":{"1min":4.0499999999999998,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":3.1429999999999998},{"interface":"front","average":{"1min":2.0150000000000001,"5min":1.859,"15min":1.7170000000000001},"min":{"1min":1.294,"5min":1.155,"15min":1.155},"max":{"1min":3.4889999999999999,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":1.6259999999999999}]},{"osd":4,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":2.3889999999999998,"5min":2.431,"15min":2.1629999999999998},"min":{"1min":1.536,"5min":1.4750000000000001,"15min":1.4750000000000001},"max":{"1min":3.746,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":4.5940000000000003},{"interface":"front","average":{"1min":2.5910000000000002,"5min":2.734,"15min":2.597},"min":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"max":{"1min":4.4900000000000002,"5min":4.54,"15min":4.54},"last":2.2959999999999998}]},{"osd":5,"last update":"Mon Nov 16 22:01:08 2020","interfaces":[{"interface":"back","average":{"1min":3.1299999999999999,"5min":10.664999999999999,"15min":18.257000000000001},"min":{"1min":1.964,"5min":1.7310000000000001,"15min":1.7310000000000001},"max":{"1min":4.9640000000000004,"5min":413.923,"15min":413.923},"last":4.0620000000000003},{"interface":"front","average":{"1min":3.4329999999999998,"5min":3.202,"15min":2.9620000000000002},"min":{"1min":2.097,"5min":1.6739999999999999,"15min":1.6739999999999999},"max":{"1min":5.4649999999999999,"5min":5.4649999999999999,"15min":5.4649999999999999},"last":3.2869999999999999}]},{"osd":6,"last update":"Mon Nov 16 22:00:25 2020","interfaces":[{"interface":"back","average":{"1min":35.783999999999999,"5min":10.06,"15min":5.7080000000000002},"min":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"max":{"1min":505.08300000000003,"5min":505.08300000000003,"15min":505.08300000000003},"last":4.3609999999999998},{"interface":"front","average":{"1min":72.450000000000003,"5min":16.584,"15min":7.2809999999999997},"min":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"max":{"1min":691.75800000000004,"5min":691.75800000000004,"15min":691.75800000000004},"last":2.6400000000000001}]},{"osd":7,"last update":"Mon Nov 16 22:00:53 2020","interfaces":[{"interface":"back","average":{"1min":3.2890000000000001,"5min":3.2320000000000002,"15min":3.2480000000000002},"min":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"max":{"1min":5.0309999999999997,"5min":5.0309999999999997,"15min":5.0309999999999997},"last":4.1680000000000001},{"interface":"front","average":{"1min":3.802,"5min":7.8499999999999996,"15min":9.6370000000000005},"min":{"1min":2.27,"5min":2.1850000000000001,"15min":2.1850000000000001},"max":{"1min":5.1920000000000002,"5min":104.51300000000001,"15min":104.51300000000001},"last":3.2410000000000001}]},{"osd":8,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":3.944,"5min":3.754,"15min":3.665},"min":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"max":{"1min":6.0289999999999999,"5min":6.0289999999999999,"15min":6.0289999999999999},"last":4.2539999999999996},{"interface":"front","average":{"1min":10.391999999999999,"5min":5.048,"15min":4.2119999999999997},"min":{"1min":1.946,"5min":1.946,"15min":1.946},"max":{"1min":146.42099999999999,"5min":146.42099999999999,"15min":146.42099999999999},"last":4.4429999999999996}]},{"osd":9,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":3.7120000000000002,"5min":4.1280000000000001,"15min":4.1970000000000001},"min":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"max":{"1min":5.0300000000000002,"5min":5.6980000000000004,"15min":5.6980000000000004},"last":4.532},{"interface":"front","average":{"1min":2.5710000000000002,"5min":2.7629999999999999,"15min":2.7949999999999999},"min":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"max":{"1min":3.254,"5min":3.5070000000000001,"15min":3.5070000000000001},"last":2.5819999999999999}]},{"osd":10,"last update":"Mon Nov 16 22:01:08 2020","interfaces":[{"interface":"back","average":{"1min":3.6059999999999999,"5min":3.6080000000000001,"15min":3.6080000000000001},"min":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"max":{"1min":5.3289999999999997,"5min":5.3289999999999997,"15min":5.3289999999999997},"last":4.3040000000000003},{"interface":"front","average":{"1min":4.093,"5min":4.218,"15min":4.2389999999999999},"min":{"1min":2.5819999999999999,"5min":2.286,"15min":2.286},"max":{"1min":5.6970000000000001,"5min":5.8040000000000003,"15min":5.8040000000000003},"last":4.6580000000000004}]}]},{"osd":3,"up_from":28,"seq":120259084355,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5712,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739440,"statfs":{"total":95995035648,"available":95989186560,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 21:59:06 2020","interfaces":[{"interface":"back","average":{"1min":2.2469999999999999,"5min":1.7609999999999999,"15min":1.639},"min":{"1min":1.367,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":3.1549999999999998,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":3.0249999999999999},{"interface":"front","average":{"1min":12.419,"5min":3.9289999999999998,"15min":2.4940000000000002},"min":{"1min":1.502,"5min":1.266,"15min":1.266},"max":{"1min":208.25899999999999,"5min":208.25899999999999,"15min":208.25899999999999},"last":1.9450000000000001}]},{"osd":1,"last update":"Mon Nov 16 22:01:13 2020","interfaces":[{"interface":"back","average":{"1min":1.6659999999999999,"5min":1.8560000000000001,"15min":1.7629999999999999},"min":{"1min":1.0249999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":2.1070000000000002,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.98799999999999999},{"interface":"front","average":{"1min":7.5289999999999999,"5min":3.1339999999999999,"15min":2.2490000000000001},"min":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"max":{"1min":112.852,"5min":112.852,"15min":112.852},"last":1.26}]},{"osd":2,"last update":"Mon Nov 16 22:01:13 2020","interfaces":[{"interface":"back","average":{"1min":2.004,"5min":7.5430000000000001,"15min":3.7549999999999999},"min":{"1min":1.244,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":4.1429999999999998,"5min":456.19600000000003,"15min":456.19600000000003},"last":1.5780000000000001},{"interface":"front","average":{"1min":2,"5min":2.2309999999999999,"15min":2.0310000000000001},"min":{"1min":1.069,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":3.9020000000000001,"5min":4.8419999999999996,"15min":4.8419999999999996},"last":0.84299999999999997}]},{"osd":4,"last update":"Mon Nov 16 22:00:32 2020","interfaces":[{"interface":"back","average":{"1min":2.0139999999999998,"5min":2.2890000000000001,"15min":2.2200000000000002},"min":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"max":{"1min":3.1200000000000001,"5min":4.2960000000000003,"15min":4.2960000000000003},"last":1.3049999999999999},{"interface":"front","average":{"1min":2.5800000000000001,"5min":16.73,"15min":30.853999999999999},"min":{"1min":1.484,"5min":1.484,"15min":1.484},"max":{"1min":4.5620000000000003,"5min":678.92100000000005,"15min":678.92100000000005},"last":2.9689999999999999}]},{"osd":5,"last update":"Mon Nov 16 22:01:02 2020","interfaces":[{"interface":"back","average":{"1min":2.3999999999999999,"5min":2.6739999999999999,"15min":2.5920000000000001},"min":{"1min":1.413,"5min":1.413,"15min":1.413},"max":{"1min":4.0229999999999997,"5min":4.1680000000000001,"15min":4.1680000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":2.593,"5min":24.279,"15min":45.645000000000003},"min":{"1min":1.746,"5min":1.746,"15min":1.746},"max":{"1min":4.165,"5min":862.47799999999995,"15min":862.47799999999995},"last":1.6539999999999999}]},{"osd":6,"last update":"Mon Nov 16 22:00:23 2020","interfaces":[{"interface":"back","average":{"1min":44.633000000000003,"5min":11.417,"15min":5.7869999999999999},"min":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"max":{"1min":917.947,"5min":917.947,"15min":917.947},"last":1.889},{"interface":"front","average":{"1min":3.1280000000000001,"5min":2.9990000000000001,"15min":2.9180000000000001},"min":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"max":{"1min":4.6779999999999999,"5min":5.0259999999999998,"15min":5.0259999999999998},"last":1.6919999999999999}]},{"osd":7,"last update":"Mon Nov 16 22:00:51 2020","interfaces":[{"interface":"back","average":{"1min":2.6829999999999998,"5min":3.2309999999999999,"15min":3.2730000000000001},"min":{"1min":1.8620000000000001,"5min":1.728,"15min":1.728},"max":{"1min":4.234,"5min":5.0700000000000003,"15min":5.0700000000000003},"last":2.907},{"interface":"front","average":{"1min":2.9980000000000002,"5min":3.2229999999999999,"15min":3.1429999999999998},"min":{"1min":1.883,"5min":1.883,"15min":1.883},"max":{"1min":4.0339999999999998,"5min":5.2060000000000004,"15min":5.2060000000000004},"last":2.8559999999999999}]},{"osd":8,"last update":"Mon Nov 16 22:01:19 2020","interfaces":[{"interface":"back","average":{"1min":3.4020000000000001,"5min":11.621,"15min":6.2779999999999996},"min":{"1min":2.1680000000000001,"5min":1.863,"15min":1.863},"max":{"1min":5.0700000000000003,"5min":852.04899999999998,"15min":852.04899999999998},"last":3.2149999999999999},{"interface":"front","average":{"1min":2.8340000000000001,"5min":5.5650000000000004,"15min":3.948},"min":{"1min":2.0379999999999998,"5min":1.516,"15min":1.516},"max":{"1min":4.7800000000000002,"5min":274.65199999999999,"15min":274.65199999999999},"last":1.7609999999999999}]},{"osd":9,"last update":"Mon Nov 16 22:00:41 2020","interfaces":[{"interface":"back","average":{"1min":2.9820000000000002,"5min":3.532,"15min":3.6240000000000001},"min":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"max":{"1min":4.6230000000000002,"5min":4.7839999999999998,"15min":4.7839999999999998},"last":3.073},{"interface":"front","average":{"1min":3.4809999999999999,"5min":3.9049999999999998,"15min":3.976},"min":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"max":{"1min":4.8019999999999996,"5min":5.319,"15min":5.319},"last":1.7310000000000001}]},{"osd":10,"last update":"Mon Nov 16 22:01:05 2020","interfaces":[{"interface":"back","average":{"1min":3.8439999999999999,"5min":3.9319999999999999,"15min":3.9460000000000002},"min":{"1min":2.464,"5min":2.2909999999999999,"15min":2.2909999999999999},"max":{"1min":6.1059999999999999,"5min":6.1059999999999999,"15min":6.1059999999999999},"last":3.1589999999999998},{"interface":"front","average":{"1min":3.3450000000000002,"5min":3.3170000000000002,"15min":3.3119999999999998},"min":{"1min":2.597,"5min":2.3620000000000001,"15min":2.3620000000000001},"max":{"1min":6.1550000000000002,"5min":6.1550000000000002,"15min":6.1550000000000002},"last":1.8009999999999999}]},{"osd":11,"last update":"Mon Nov 16 22:00:27 2020","interfaces":[{"interface":"back","average":{"1min":3.7829999999999999,"5min":3.7829999999999999,"15min":3.7829999999999999},"min":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"max":{"1min":4.9249999999999998,"5min":4.9249999999999998,"15min":4.9249999999999998},"last":3.02},{"interface":"front","average":{"1min":2.9260000000000002,"5min":2.9260000000000002,"15min":2.9260000000000002},"min":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"max":{"1min":3.5489999999999999,"5min":3.5489999999999999,"15min":3.5489999999999999},"last":1.831}]}]},{"osd":4,"up_from":33,"seq":141733920830,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5712,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739440,"statfs":{"total":95995035648,"available":95989186560,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:00:40 2020","interfaces":[{"interface":"back","average":{"1min":2.645,"5min":6.8570000000000002,"15min":3.5710000000000002},"min":{"1min":1.766,"5min":1.204,"15min":1.204},"max":{"1min":3.5569999999999999,"5min":414.75,"15min":414.75},"last":1.5629999999999999},{"interface":"front","average":{"1min":2.8980000000000001,"5min":5.3049999999999997,"15min":2.9809999999999999},"min":{"1min":2.0030000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":4.1269999999999998,"5min":265.625,"15min":265.625},"last":816.50199999999995}]},{"osd":1,"last update":"Mon Nov 16 22:00:40 2020","interfaces":[{"interface":"back","average":{"1min":2.8279999999999998,"5min":2.3399999999999999,"15min":1.9019999999999999},"min":{"1min":1.3899999999999999,"5min":1.278,"15min":1.278},"max":{"1min":3.6760000000000002,"5min":4.6500000000000004,"15min":4.6500000000000004},"last":2.2850000000000001},{"interface":"front","average":{"1min":3.2559999999999998,"5min":12.266,"15min":5.5819999999999999},"min":{"1min":2.5299999999999998,"5min":1.3799999999999999,"15min":1.3799999999999999},"max":{"1min":4.6349999999999998,"5min":862.78999999999996,"15min":862.78999999999996},"last":2.3999999999999999}]},{"osd":2,"last update":"Mon Nov 16 22:00:40 2020","interfaces":[{"interface":"back","average":{"1min":2.6059999999999999,"5min":2.4460000000000002,"15min":2.2789999999999999},"min":{"1min":1.8680000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"max":{"1min":3.254,"5min":4.4500000000000002,"15min":4.4500000000000002},"last":1.6639999999999999},{"interface":"front","average":{"1min":2.976,"5min":2.512,"15min":2.198},"min":{"1min":2.1099999999999999,"5min":1.284,"15min":1.284},"max":{"1min":3.9540000000000002,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":3.2669999999999999}]},{"osd":3,"last update":"Mon Nov 16 22:00:40 2020","interfaces":[{"interface":"back","average":{"1min":3.4159999999999999,"5min":2.7530000000000001,"15min":2.4369999999999998},"min":{"1min":2.6589999999999998,"5min":1.2150000000000001,"15min":1.2150000000000001},"max":{"1min":4.8920000000000003,"5min":6.5140000000000002,"15min":6.5140000000000002},"last":3.4399999999999999},{"interface":"front","average":{"1min":3.109,"5min":13.48,"15min":6.1159999999999997},"min":{"1min":2.2669999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"max":{"1min":4.0839999999999996,"5min":972.75199999999995,"15min":972.75199999999995},"last":2.2069999999999999}]},{"osd":5,"last update":"Mon Nov 16 22:01:01 2020","interfaces":[{"interface":"back","average":{"1min":3.2189999999999999,"5min":8.2159999999999993,"15min":13.331},"min":{"1min":2.2970000000000002,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":4.2430000000000003,"5min":274.38400000000001,"15min":274.38400000000001},"last":3.3399999999999999},{"interface":"front","average":{"1min":3.5659999999999998,"5min":2.8700000000000001,"15min":2.3959999999999999},"min":{"1min":2.6030000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":4.7919999999999998,"5min":5.9189999999999996,"15min":5.9189999999999996},"last":2.4609999999999999}]},{"osd":6,"last update":"Mon Nov 16 22:00:24 2020","interfaces":[{"interface":"back","average":{"1min":3.125,"5min":12.909000000000001,"15min":6.2430000000000003},"min":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"max":{"1min":3.9119999999999999,"5min":844.12900000000002,"15min":844.12900000000002},"last":2.9140000000000001},{"interface":"front","average":{"1min":3.5720000000000001,"5min":3.1269999999999998,"15min":2.9929999999999999},"min":{"1min":2.3410000000000002,"5min":1.8700000000000001,"15min":1.8700000000000001},"max":{"1min":4.4169999999999998,"5min":6.6529999999999996,"15min":6.6529999999999996},"last":3.532}]},{"osd":7,"last update":"Mon Nov 16 22:00:54 2020","interfaces":[{"interface":"back","average":{"1min":3.734,"5min":3.4980000000000002,"15min":3.371},"min":{"1min":2.9670000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"max":{"1min":4.907,"5min":7.8079999999999998,"15min":7.8079999999999998},"last":3.3929999999999998},{"interface":"front","average":{"1min":3.9769999999999999,"5min":3.7149999999999999,"15min":3.5409999999999999},"min":{"1min":2.7280000000000002,"5min":2.5139999999999998,"15min":2.5139999999999998},"max":{"1min":5.3659999999999997,"5min":5.4660000000000002,"15min":5.4660000000000002},"last":3.669}]},{"osd":8,"last update":"Mon Nov 16 22:01:13 2020","interfaces":[{"interface":"back","average":{"1min":3.754,"5min":3.7080000000000002,"15min":3.589},"min":{"1min":2.8370000000000002,"5min":2.4470000000000001,"15min":2.4470000000000001},"max":{"1min":5.1589999999999998,"5min":8.3960000000000008,"15min":8.3960000000000008},"last":4.3920000000000003},{"interface":"front","average":{"1min":4.3250000000000002,"5min":4.141,"15min":4.0330000000000004},"min":{"1min":3.3679999999999999,"5min":3.29,"15min":3.29},"max":{"1min":5.7990000000000004,"5min":5.8090000000000002,"15min":5.8090000000000002},"last":3.6099999999999999}]},{"osd":9,"last update":"Mon Nov 16 22:00:40 2020","interfaces":[{"interface":"back","average":{"1min":49.145000000000003,"5min":13.374000000000001,"15min":7.4119999999999999},"min":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"max":{"1min":990.01099999999997,"5min":990.01099999999997,"15min":990.01099999999997},"last":3.7229999999999999},{"interface":"front","average":{"1min":3.6110000000000002,"5min":3.6349999999999998,"15min":3.6389999999999998},"min":{"1min":2.8570000000000002,"5min":2.4239999999999999,"15min":2.4239999999999999},"max":{"1min":4.8259999999999996,"5min":7.6849999999999996,"15min":7.6849999999999996},"last":3.0230000000000001}]},{"osd":10,"last update":"Mon Nov 16 22:01:11 2020","interfaces":[{"interface":"back","average":{"1min":4.1799999999999997,"5min":4.2880000000000003,"15min":4.306},"min":{"1min":3.3889999999999998,"5min":3.3889999999999998,"15min":3.3889999999999998},"max":{"1min":5.2400000000000002,"5min":8.0359999999999996,"15min":8.0359999999999996},"last":4.71},{"interface":"front","average":{"1min":29.556999999999999,"5min":9.5570000000000004,"15min":6.2229999999999999},"min":{"1min":3.5910000000000002,"5min":3.5910000000000002,"15min":3.5910000000000002},"max":{"1min":479.274,"5min":479.274,"15min":479.274},"last":3.9830000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757303,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5584,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739568,"statfs":{"total":95995035648,"available":95989317632,"internally_reserved":0,"allocated":663552,"data_stored":270518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:01:07 2020","interfaces":[{"interface":"back","average":{"1min":2.968,"5min":2.5,"15min":2.242},"min":{"1min":1.7210000000000001,"5min":1.089,"15min":1.089},"max":{"1min":3.633,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":2.8029999999999999},{"interface":"front","average":{"1min":2.617,"5min":17.756,"15min":18.838999999999999},"min":{"1min":1.5549999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"max":{"1min":3.6219999999999999,"5min":795.57799999999997,"15min":795.57799999999997},"last":4.0069999999999997}]},{"osd":1,"last update":"Mon Nov 16 22:01:07 2020","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.4409999999999998,"15min":2.1709999999999998},"min":{"1min":1.7849999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"max":{"1min":3.4609999999999999,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":2.7120000000000002},{"interface":"front","average":{"1min":2.8849999999999998,"5min":2.5630000000000002,"15min":2.3029999999999999},"min":{"1min":1.681,"5min":1.2789999999999999,"15min":1.2789999999999999},"max":{"1min":3.6659999999999999,"5min":4.2039999999999997,"15min":4.2039999999999997},"last":2.8559999999999999}]},{"osd":2,"last update":"Mon Nov 16 22:01:07 2020","interfaces":[{"interface":"back","average":{"1min":2.774,"5min":24.614999999999998,"15min":9.5399999999999991},"min":{"1min":1.77,"5min":1.097,"15min":1.097},"max":{"1min":3.5699999999999998,"5min":975.82500000000005,"15min":975.82500000000005},"last":3.141},{"interface":"front","average":{"1min":2.8279999999999998,"5min":3.7829999999999999,"15min":4.7069999999999999},"min":{"1min":1.7190000000000001,"5min":1.389,"15min":1.389},"max":{"1min":3.7050000000000001,"5min":69.685000000000002,"15min":69.685000000000002},"last":3.028}]},{"osd":3,"last update":"Mon Nov 16 22:01:07 2020","interfaces":[{"interface":"back","average":{"1min":3.1589999999999998,"5min":2.9119999999999999,"15min":2.637},"min":{"1min":2.496,"5min":1.5409999999999999,"15min":1.5409999999999999},"max":{"1min":4.1289999999999996,"5min":4.1289999999999996,"15min":4.1289999999999996},"last":3.194},{"interface":"front","average":{"1min":3.2970000000000002,"5min":3.0110000000000001,"15min":2.7450000000000001},"min":{"1min":2.4500000000000002,"5min":1.726,"15min":1.726},"max":{"1min":3.8370000000000002,"5min":4.3879999999999999,"15min":4.3879999999999999},"last":2.9359999999999999}]},{"osd":4,"last update":"Mon Nov 16 22:01:07 2020","interfaces":[{"interface":"back","average":{"1min":2.9390000000000001,"5min":2.581,"15min":2.2530000000000001},"min":{"1min":1.492,"5min":1.472,"15min":1.472},"max":{"1min":4.1669999999999998,"5min":4.1669999999999998,"15min":4.1669999999999998},"last":4.1150000000000002},{"interface":"front","average":{"1min":3.1909999999999998,"5min":2.8109999999999999,"15min":2.4510000000000001},"min":{"1min":2.6280000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":4.1459999999999999,"5min":4.306,"15min":4.306},"last":3.2759999999999998}]},{"osd":6,"last update":"Mon Nov 16 22:00:28 2020","interfaces":[{"interface":"back","average":{"1min":3.1850000000000001,"5min":22.498000000000001,"15min":31.117999999999999},"min":{"1min":2.1499999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"max":{"1min":4.6630000000000003,"5min":722.72699999999998,"15min":722.72699999999998},"last":4.2359999999999998},{"interface":"front","average":{"1min":3.5510000000000002,"5min":3.032,"15min":2.8079999999999998},"min":{"1min":2.9569999999999999,"5min":1.224,"15min":1.224},"max":{"1min":4.5170000000000003,"5min":4.5170000000000003,"15min":4.5170000000000003},"last":3.399}]},{"osd":7,"last update":"Mon Nov 16 22:00:57 2020","interfaces":[{"interface":"back","average":{"1min":3.589,"5min":3.5390000000000001,"15min":3.5569999999999999},"min":{"1min":2.8410000000000002,"5min":2.1970000000000001,"15min":2.1970000000000001},"max":{"1min":5.8099999999999996,"5min":5.9960000000000004,"15min":5.9960000000000004},"last":3.601},{"interface":"front","average":{"1min":3.681,"5min":3.4620000000000002,"15min":3.3940000000000001},"min":{"1min":2.4950000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"max":{"1min":4.5270000000000001,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":4.3289999999999997}]},{"osd":8,"last update":"Mon Nov 16 22:01:18 2020","interfaces":[{"interface":"back","average":{"1min":3.7570000000000001,"5min":3.7320000000000002,"15min":3.7130000000000001},"min":{"1min":2,"5min":2,"15min":2},"max":{"1min":4.6779999999999999,"5min":6.0730000000000004,"15min":6.0730000000000004},"last":5.3109999999999999},{"interface":"front","average":{"1min":20.192,"5min":7.0350000000000001,"15min":4.8280000000000003},"min":{"1min":2.9830000000000001,"5min":2.7240000000000002,"15min":2.7240000000000002},"max":{"1min":327.36700000000002,"5min":327.36700000000002,"15min":327.36700000000002},"last":3.6680000000000001}]},{"osd":9,"last update":"Mon Nov 16 22:00:40 2020","interfaces":[{"interface":"back","average":{"1min":27.015000000000001,"5min":8.4830000000000005,"15min":5.3949999999999996},"min":{"1min":2.52,"5min":2.5059999999999998,"15min":2.5059999999999998},"max":{"1min":505.19299999999998,"5min":505.19299999999998,"15min":505.19299999999998},"last":5.5069999999999997},{"interface":"front","average":{"1min":28.611999999999998,"5min":8.7880000000000003,"15min":5.484},"min":{"1min":2.8650000000000002,"5min":2.8650000000000002,"15min":2.8650000000000002},"max":{"1min":548.05499999999995,"5min":548.05499999999995,"15min":548.05499999999995},"last":3.7349999999999999}]},{"osd":10,"last update":"Mon Nov 16 22:01:07 2020","interfaces":[{"interface":"back","average":{"1min":4.1319999999999997,"5min":3.9889999999999999,"15min":3.9649999999999999},"min":{"1min":3.2189999999999999,"5min":2.75,"15min":2.75},"max":{"1min":5.9080000000000004,"5min":5.9080000000000004,"15min":5.9080000000000004},"last":3.8140000000000001},{"interface":"front","average":{"1min":4.181,"5min":4.1929999999999996,"15min":4.1950000000000003},"min":{"1min":3.0539999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"max":{"1min":4.8129999999999997,"5min":5.1769999999999996,"15min":5.1769999999999996},"last":5.4169999999999998}]}]}]}} 2020-11-16T22:01:25.850 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2020-11-16T22:01:25.850 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-11-16T22:01:25.850 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2020-11-16T22:01:25.851 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph health --format=json 2020-11-16T22:01:25.862 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:25 smithi195 bash[10218]: audit 2020-11-16T22:01:25.172697+0000 mgr.x (mgr.24115) 260 : audit [DBG] from='client.14715 v1:172.21.15.195:0/2168711700' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-11-16T22:01:25.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:25 smithi057 bash[10301]: audit 2020-11-16T22:01:25.172697+0000 mgr.x (mgr.24115) 260 : audit [DBG] from='client.14715 v1:172.21.15.195:0/2168711700' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-11-16T22:01:25.990 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:01:26.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:25 smithi016 bash[10302]: audit 2020-11-16T22:01:25.172697+0000 mgr.x (mgr.24115) 260 : audit [DBG] from='client.14715 v1:172.21.15.195:0/2168711700' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-11-16T22:01:26.882 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:26 smithi195 bash[10218]: cluster 2020-11-16T22:01:25.556307+0000 mgr.x (mgr.24115) 261 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:26.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:26 smithi057 bash[10301]: cluster 2020-11-16T22:01:25.556307+0000 mgr.x (mgr.24115) 261 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:27.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:26 smithi016 bash[10302]: cluster 2020-11-16T22:01:25.556307+0000 mgr.x (mgr.24115) 261 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:28.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:28 smithi195 bash[10218]: cluster 2020-11-16T22:01:27.556994+0000 mgr.x (mgr.24115) 262 : cluster [DBG] pgmap v264: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:28.939 INFO:teuthology.orchestra.run.smithi195.stdout: 2020-11-16T22:01:28.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:28 smithi057 bash[10301]: cluster 2020-11-16T22:01:27.556994+0000 mgr.x (mgr.24115) 262 : cluster [DBG] pgmap v264: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:29.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:28 smithi016 bash[10302]: cluster 2020-11-16T22:01:27.556994+0000 mgr.x (mgr.24115) 262 : cluster [DBG] pgmap v264: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:29.567 INFO:teuthology.orchestra.run.smithi195.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-11-16T22:01:29.568 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2020-11-16T22:01:29.569 INFO:tasks.cephadm:Setup complete, yielding 2020-11-16T22:01:29.569 INFO:teuthology.run_tasks:Running task exec... 2020-11-16T22:01:29.580 INFO:teuthology.task.exec:Executing custom commands... 2020-11-16T22:01:29.581 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi195.front.sepia.ceph.com 2020-11-16T22:01:29.581 INFO:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'while ! ceph balancer status ; do sleep 1 ; done' 2020-11-16T22:01:29.849 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:29 smithi195 bash[10218]: audit 2020-11-16T22:01:28.951651+0000 mon.a (mon.0) 677 : audit [DBG] from='client.? v1:172.21.15.195:0/3865919568' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2020-11-16T22:01:29.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:29 smithi057 bash[10301]: audit 2020-11-16T22:01:28.951651+0000 mon.a (mon.0) 677 : audit [DBG] from='client.? v1:172.21.15.195:0/3865919568' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2020-11-16T22:01:30.045 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2020-11-16T22:01:30.045 INFO:teuthology.orchestra.run.smithi195.stdout: "active": true, 2020-11-16T22:01:30.045 INFO:teuthology.orchestra.run.smithi195.stdout: "last_optimize_duration": "0:00:00.000928", 2020-11-16T22:01:30.045 INFO:teuthology.orchestra.run.smithi195.stdout: "last_optimize_started": "Mon Nov 16 22:01:29 2020", 2020-11-16T22:01:30.045 INFO:teuthology.orchestra.run.smithi195.stdout: "mode": "upmap", 2020-11-16T22:01:30.046 INFO:teuthology.orchestra.run.smithi195.stdout: "optimize_result": "Unable to find further optimization, or pool(s) pg_num is decreasing, or distribution is already perfect", 2020-11-16T22:01:30.046 INFO:teuthology.orchestra.run.smithi195.stdout: "plans": [] 2020-11-16T22:01:30.046 INFO:teuthology.orchestra.run.smithi195.stdout:} 2020-11-16T22:01:30.079 INFO:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer mode crush-compat' 2020-11-16T22:01:30.086 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:29 smithi016 bash[10302]: audit 2020-11-16T22:01:28.951651+0000 mon.a (mon.0) 677 : audit [DBG] from='client.? v1:172.21.15.195:0/3865919568' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2020-11-16T22:01:30.714 INFO:teuthology.orchestra.run.smithi195:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer on' 2020-11-16T22:01:30.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:30 smithi057 bash[10301]: cluster 2020-11-16T22:01:29.557659+0000 mgr.x (mgr.24115) 263 : cluster [DBG] pgmap v265: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:30 smithi057 bash[10301]: audit 2020-11-16T22:01:29.717067+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:01:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:30 smithi057 bash[10301]: audit 2020-11-16T22:01:29.724810+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:01:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:30 smithi057 bash[10301]: audit 2020-11-16T22:01:30.054407+0000 mgr.x (mgr.24115) 264 : audit [DBG] from='client.14727 v1:172.21.15.195:0/2231513945' entity='client.admin' cmd=[{"prefix": "balancer status", "target": ["mgr", ""]}]: dispatch 2020-11-16T22:01:30.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:30 smithi057 bash[10301]: audit 2020-11-16T22:01:30.446189+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd crush weight-set create-compat", "format": "json"}]: dispatch 2020-11-16T22:01:31.082 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:30 smithi195 bash[10218]: cluster 2020-11-16T22:01:29.557659+0000 mgr.x (mgr.24115) 263 : cluster [DBG] pgmap v265: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:31.082 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:30 smithi195 bash[10218]: audit 2020-11-16T22:01:29.717067+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:01:31.082 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:30 smithi195 bash[10218]: audit 2020-11-16T22:01:29.724810+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:01:31.082 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:30 smithi195 bash[10218]: audit 2020-11-16T22:01:30.054407+0000 mgr.x (mgr.24115) 264 : audit [DBG] from='client.14727 v1:172.21.15.195:0/2231513945' entity='client.admin' cmd=[{"prefix": "balancer status", "target": ["mgr", ""]}]: dispatch 2020-11-16T22:01:31.083 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:30 smithi195 bash[10218]: audit 2020-11-16T22:01:30.446189+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd crush weight-set create-compat", "format": "json"}]: dispatch 2020-11-16T22:01:31.083 INFO:teuthology.run_tasks:Running task rados... 2020-11-16T22:01:31.095 INFO:tasks.rados:Beginning rados... 2020-11-16T22:01:31.095 DEBUG:teuthology.run_tasks:Unwinding manager rados 2020-11-16T22:01:31.106 INFO:tasks.rados:joining rados 2020-11-16T22:01:31.106 INFO:tasks.rados:clients are ['client.0', 'client.1', 'client.2'] 2020-11-16T22:01:31.106 INFO:tasks.rados:starting run 0 out of 1 2020-11-16T22:01:31.107 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_0 2020-11-16T22:01:31.107 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd pool create unique_pool_0 16 2020-11-16T22:01:31.108 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:30 smithi016 bash[10302]: cluster 2020-11-16T22:01:29.557659+0000 mgr.x (mgr.24115) 263 : cluster [DBG] pgmap v265: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:31.108 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:30 smithi016 bash[10302]: audit 2020-11-16T22:01:29.717067+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:01:31.108 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:30 smithi016 bash[10302]: audit 2020-11-16T22:01:29.724810+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:01:31.108 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:30 smithi016 bash[10302]: audit 2020-11-16T22:01:30.054407+0000 mgr.x (mgr.24115) 264 : audit [DBG] from='client.14727 v1:172.21.15.195:0/2231513945' entity='client.admin' cmd=[{"prefix": "balancer status", "target": ["mgr", ""]}]: dispatch 2020-11-16T22:01:31.108 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:30 smithi016 bash[10302]: audit 2020-11-16T22:01:30.446189+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd crush weight-set create-compat", "format": "json"}]: dispatch 2020-11-16T22:01:31.247 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:01:31.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:31 smithi057 bash[10301]: audit 2020-11-16T22:01:30.443025+0000 mgr.x (mgr.24115) 265 : audit [DBG] from='client.14733 v1:172.21.15.195:0/43747948' entity='client.admin' cmd=[{"prefix": "balancer mode", "mode": "crush-compat", "target": ["mgr", ""]}]: dispatch 2020-11-16T22:01:31.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:31 smithi057 bash[10301]: audit 2020-11-16T22:01:30.643147+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix": "osd crush weight-set create-compat", "format": "json"}]': finished 2020-11-16T22:01:31.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:31 smithi057 bash[10301]: cluster 2020-11-16T22:01:30.643235+0000 mon.a (mon.0) 682 : cluster [DBG] osdmap e70: 12 total, 12 up, 12 in 2020-11-16T22:01:31.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:31 smithi057 bash[10301]: audit 2020-11-16T22:01:30.644964+0000 mon.a (mon.0) 683 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd crush dump", "format": "json"}]: dispatch 2020-11-16T22:01:31.948 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:31 smithi057 bash[10301]: audit 2020-11-16T22:01:30.649177+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config set","value":"crush-compat","who":"mgr","name":"mgr/balancer/mode"}]: dispatch 2020-11-16T22:01:31.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:31 smithi057 bash[10301]: audit 2020-11-16T22:01:30.665022+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config set","value":"crush-compat","who":"mgr","name":"mgr/balancer/mode"}]': finished 2020-11-16T22:01:31.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:31 smithi057 bash[10301]: audit 2020-11-16T22:01:30.679915+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:01:31.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:31 smithi057 bash[10301]: audit 2020-11-16T22:01:30.684565+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:01:31.949 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:31 smithi057 bash[10301]: audit 2020-11-16T22:01:31.078384+0000 mgr.x (mgr.24115) 266 : audit [DBG] from='client.14739 v1:172.21.15.195:0/3807908946' entity='client.admin' cmd=[{"prefix": "balancer on", "target": ["mgr", ""]}]: dispatch 2020-11-16T22:01:32.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:31 smithi016 bash[10302]: audit 2020-11-16T22:01:30.443025+0000 mgr.x (mgr.24115) 265 : audit [DBG] from='client.14733 v1:172.21.15.195:0/43747948' entity='client.admin' cmd=[{"prefix": "balancer mode", "mode": "crush-compat", "target": ["mgr", ""]}]: dispatch 2020-11-16T22:01:32.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:31 smithi016 bash[10302]: audit 2020-11-16T22:01:30.643147+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix": "osd crush weight-set create-compat", "format": "json"}]': finished 2020-11-16T22:01:32.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:31 smithi016 bash[10302]: cluster 2020-11-16T22:01:30.643235+0000 mon.a (mon.0) 682 : cluster [DBG] osdmap e70: 12 total, 12 up, 12 in 2020-11-16T22:01:32.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:31 smithi016 bash[10302]: audit 2020-11-16T22:01:30.644964+0000 mon.a (mon.0) 683 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd crush dump", "format": "json"}]: dispatch 2020-11-16T22:01:32.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:31 smithi016 bash[10302]: audit 2020-11-16T22:01:30.649177+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config set","value":"crush-compat","who":"mgr","name":"mgr/balancer/mode"}]: dispatch 2020-11-16T22:01:32.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:31 smithi016 bash[10302]: audit 2020-11-16T22:01:30.665022+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config set","value":"crush-compat","who":"mgr","name":"mgr/balancer/mode"}]': finished 2020-11-16T22:01:32.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:31 smithi016 bash[10302]: audit 2020-11-16T22:01:30.679915+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:01:32.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:31 smithi016 bash[10302]: audit 2020-11-16T22:01:30.684565+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:01:32.088 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:31 smithi016 bash[10302]: audit 2020-11-16T22:01:31.078384+0000 mgr.x (mgr.24115) 266 : audit [DBG] from='client.14739 v1:172.21.15.195:0/3807908946' entity='client.admin' cmd=[{"prefix": "balancer on", "target": ["mgr", ""]}]: dispatch 2020-11-16T22:01:32.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:31 smithi195 bash[10218]: audit 2020-11-16T22:01:30.443025+0000 mgr.x (mgr.24115) 265 : audit [DBG] from='client.14733 v1:172.21.15.195:0/43747948' entity='client.admin' cmd=[{"prefix": "balancer mode", "mode": "crush-compat", "target": ["mgr", ""]}]: dispatch 2020-11-16T22:01:32.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:31 smithi195 bash[10218]: audit 2020-11-16T22:01:30.643147+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix": "osd crush weight-set create-compat", "format": "json"}]': finished 2020-11-16T22:01:32.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:31 smithi195 bash[10218]: cluster 2020-11-16T22:01:30.643235+0000 mon.a (mon.0) 682 : cluster [DBG] osdmap e70: 12 total, 12 up, 12 in 2020-11-16T22:01:32.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:31 smithi195 bash[10218]: audit 2020-11-16T22:01:30.644964+0000 mon.a (mon.0) 683 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "osd crush dump", "format": "json"}]: dispatch 2020-11-16T22:01:32.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:31 smithi195 bash[10218]: audit 2020-11-16T22:01:30.649177+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config set","value":"crush-compat","who":"mgr","name":"mgr/balancer/mode"}]: dispatch 2020-11-16T22:01:32.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:31 smithi195 bash[10218]: audit 2020-11-16T22:01:30.665022+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config set","value":"crush-compat","who":"mgr","name":"mgr/balancer/mode"}]': finished 2020-11-16T22:01:32.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:31 smithi195 bash[10218]: audit 2020-11-16T22:01:30.679915+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:01:32.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:31 smithi195 bash[10218]: audit 2020-11-16T22:01:30.684565+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:01:32.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:31 smithi195 bash[10218]: audit 2020-11-16T22:01:31.078384+0000 mgr.x (mgr.24115) 266 : audit [DBG] from='client.14739 v1:172.21.15.195:0/3807908946' entity='client.admin' cmd=[{"prefix": "balancer on", "target": ["mgr", ""]}]: dispatch 2020-11-16T22:01:32.947 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:32 smithi057 bash[10301]: cluster 2020-11-16T22:01:31.558300+0000 mgr.x (mgr.24115) 267 : cluster [DBG] pgmap v267: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:33.087 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:32 smithi016 bash[10302]: cluster 2020-11-16T22:01:31.558300+0000 mgr.x (mgr.24115) 267 : cluster [DBG] pgmap v267: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:33.099 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:32 smithi195 bash[10218]: cluster 2020-11-16T22:01:31.558300+0000 mgr.x (mgr.24115) 267 : cluster [DBG] pgmap v267: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:34.897 INFO:teuthology.orchestra.run.smithi195.stderr:pool 'unique_pool_0' created 2020-11-16T22:01:35.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:34 smithi057 bash[10301]: cluster 2020-11-16T22:01:33.558927+0000 mgr.x (mgr.24115) 268 : cluster [DBG] pgmap v268: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:35.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:34 smithi016 bash[10302]: cluster 2020-11-16T22:01:33.558927+0000 mgr.x (mgr.24115) 268 : cluster [DBG] pgmap v268: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:35.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:34 smithi195 bash[10218]: cluster 2020-11-16T22:01:33.558927+0000 mgr.x (mgr.24115) 268 : cluster [DBG] pgmap v268: 1 pgs: 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:35.556 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2020-11-16T22:01:35.694 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:01:36.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:35 smithi057 bash[10301]: audit 2020-11-16T22:01:34.410872+0000 mon.a (mon.0) 688 : audit [INF] from='client.? v1:172.21.15.195:0/3455879214' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2020-11-16T22:01:36.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:35 smithi057 bash[10301]: audit 2020-11-16T22:01:34.901865+0000 mon.a (mon.0) 689 : audit [INF] from='client.? v1:172.21.15.195:0/3455879214' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2020-11-16T22:01:36.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:35 smithi057 bash[10301]: cluster 2020-11-16T22:01:34.901935+0000 mon.a (mon.0) 690 : cluster [DBG] osdmap e71: 12 total, 12 up, 12 in 2020-11-16T22:01:36.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:35 smithi016 bash[10302]: audit 2020-11-16T22:01:34.410872+0000 mon.a (mon.0) 688 : audit [INF] from='client.? v1:172.21.15.195:0/3455879214' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2020-11-16T22:01:36.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:35 smithi016 bash[10302]: audit 2020-11-16T22:01:34.901865+0000 mon.a (mon.0) 689 : audit [INF] from='client.? v1:172.21.15.195:0/3455879214' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2020-11-16T22:01:36.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:35 smithi016 bash[10302]: cluster 2020-11-16T22:01:34.901935+0000 mon.a (mon.0) 690 : cluster [DBG] osdmap e71: 12 total, 12 up, 12 in 2020-11-16T22:01:36.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:35 smithi195 bash[10218]: audit 2020-11-16T22:01:34.410872+0000 mon.a (mon.0) 688 : audit [INF] from='client.? v1:172.21.15.195:0/3455879214' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]: dispatch 2020-11-16T22:01:36.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:35 smithi195 bash[10218]: audit 2020-11-16T22:01:34.901865+0000 mon.a (mon.0) 689 : audit [INF] from='client.? v1:172.21.15.195:0/3455879214' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]': finished 2020-11-16T22:01:36.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:35 smithi195 bash[10218]: cluster 2020-11-16T22:01:34.901935+0000 mon.a (mon.0) 690 : cluster [DBG] osdmap e71: 12 total, 12 up, 12 in 2020-11-16T22:01:37.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:36 smithi057 bash[10301]: cluster 2020-11-16T22:01:35.559563+0000 mgr.x (mgr.24115) 269 : cluster [DBG] pgmap v270: 17 pgs: 16 unknown, 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:37.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:36 smithi057 bash[10301]: cluster 2020-11-16T22:01:35.909282+0000 mon.a (mon.0) 691 : cluster [DBG] osdmap e72: 12 total, 12 up, 12 in 2020-11-16T22:01:37.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:36 smithi016 bash[10302]: cluster 2020-11-16T22:01:35.559563+0000 mgr.x (mgr.24115) 269 : cluster [DBG] pgmap v270: 17 pgs: 16 unknown, 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:37.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:36 smithi016 bash[10302]: cluster 2020-11-16T22:01:35.909282+0000 mon.a (mon.0) 691 : cluster [DBG] osdmap e72: 12 total, 12 up, 12 in 2020-11-16T22:01:37.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:36 smithi195 bash[10218]: cluster 2020-11-16T22:01:35.559563+0000 mgr.x (mgr.24115) 269 : cluster [DBG] pgmap v270: 17 pgs: 16 unknown, 1 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:37.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:36 smithi195 bash[10218]: cluster 2020-11-16T22:01:35.909282+0000 mon.a (mon.0) 691 : cluster [DBG] osdmap e72: 12 total, 12 up, 12 in 2020-11-16T22:01:38.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:37 smithi057 bash[10301]: cluster 2020-11-16T22:01:36.918287+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e73: 12 total, 12 up, 12 in 2020-11-16T22:01:38.239 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:37 smithi195 bash[10218]: cluster 2020-11-16T22:01:36.918287+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e73: 12 total, 12 up, 12 in 2020-11-16T22:01:38.340 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:37 smithi016 bash[10302]: cluster 2020-11-16T22:01:36.918287+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e73: 12 total, 12 up, 12 in 2020-11-16T22:01:38.923 INFO:teuthology.orchestra.run.smithi195.stderr:enabled application 'rados' on pool 'unique_pool_0' 2020-11-16T22:01:39.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:38 smithi057 bash[10301]: cluster 2020-11-16T22:01:37.560234+0000 mgr.x (mgr.24115) 270 : cluster [DBG] pgmap v273: 17 pgs: 5 creating+peering, 7 unknown, 5 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:39.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:38 smithi057 bash[10301]: audit 2020-11-16T22:01:38.715823+0000 mon.a (mon.0) 693 : audit [INF] from='client.? v1:172.21.15.195:0/1356651353' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2020-11-16T22:01:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:38 smithi016 bash[10302]: cluster 2020-11-16T22:01:37.560234+0000 mgr.x (mgr.24115) 270 : cluster [DBG] pgmap v273: 17 pgs: 5 creating+peering, 7 unknown, 5 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:38 smithi016 bash[10302]: audit 2020-11-16T22:01:38.715823+0000 mon.a (mon.0) 693 : audit [INF] from='client.? v1:172.21.15.195:0/1356651353' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2020-11-16T22:01:39.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:38 smithi195 bash[10218]: cluster 2020-11-16T22:01:37.560234+0000 mgr.x (mgr.24115) 270 : cluster [DBG] pgmap v273: 17 pgs: 5 creating+peering, 7 unknown, 5 active+clean; 0 B data, 66 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:39.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:38 smithi195 bash[10218]: audit 2020-11-16T22:01:38.715823+0000 mon.a (mon.0) 693 : audit [INF] from='client.? v1:172.21.15.195:0/1356651353' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2020-11-16T22:01:40.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:39 smithi057 bash[10301]: audit 2020-11-16T22:01:38.930129+0000 mon.a (mon.0) 694 : audit [INF] from='client.? v1:172.21.15.195:0/1356651353' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2020-11-16T22:01:40.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:39 smithi057 bash[10301]: cluster 2020-11-16T22:01:38.930212+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e74: 12 total, 12 up, 12 in 2020-11-16T22:01:40.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:39 smithi016 bash[10302]: audit 2020-11-16T22:01:38.930129+0000 mon.a (mon.0) 694 : audit [INF] from='client.? v1:172.21.15.195:0/1356651353' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2020-11-16T22:01:40.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:39 smithi016 bash[10302]: cluster 2020-11-16T22:01:38.930212+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e74: 12 total, 12 up, 12 in 2020-11-16T22:01:40.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:39 smithi195 bash[10218]: audit 2020-11-16T22:01:38.930129+0000 mon.a (mon.0) 694 : audit [INF] from='client.? v1:172.21.15.195:0/1356651353' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2020-11-16T22:01:40.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:39 smithi195 bash[10218]: cluster 2020-11-16T22:01:38.930212+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e74: 12 total, 12 up, 12 in 2020-11-16T22:01:40.575 INFO:teuthology.orchestra.run.smithi057:> CEPH_CLIENT_ID=2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op copy_from 50 --op write_excl 50 --pool unique_pool_0 2020-11-16T22:01:40.595 INFO:tasks.rados.rados.2.smithi057.stdout:adding op weight read -> 100 2020-11-16T22:01:40.595 INFO:tasks.rados.rados.2.smithi057.stdout:adding op weight write -> 50 2020-11-16T22:01:40.596 INFO:tasks.rados.rados.2.smithi057.stdout:adding op weight delete -> 50 2020-11-16T22:01:40.596 INFO:tasks.rados.rados.2.smithi057.stdout:adding op weight snap_create -> 50 2020-11-16T22:01:40.596 INFO:tasks.rados.rados.2.smithi057.stdout:adding op weight snap_remove -> 50 2020-11-16T22:01:40.596 INFO:tasks.rados.rados.2.smithi057.stdout:adding op weight rollback -> 50 2020-11-16T22:01:40.596 INFO:tasks.rados.rados.2.smithi057.stdout:adding op weight copy_from -> 50 2020-11-16T22:01:40.596 INFO:tasks.rados.rados.2.smithi057.stdout:adding op weight write_excl -> 50 2020-11-16T22:01:40.596 INFO:tasks.rados.rados.2.smithi057.stdout:ceph version 14.2.13-54-g53ad2a5cf1 (53ad2a5cf1726c1ab9c1d4a532e0ac3f9867beae) nautilus (stable) 2020-11-16T22:01:40.597 INFO:tasks.rados.rados.2.smithi057.stdout:Configuration: 2020-11-16T22:01:40.597 INFO:tasks.rados.rados.2.smithi057.stdout: Number of operations: 4000 2020-11-16T22:01:40.597 INFO:tasks.rados.rados.2.smithi057.stdout: Number of objects: 50 2020-11-16T22:01:40.597 INFO:tasks.rados.rados.2.smithi057.stdout: Max in flight operations: 16 2020-11-16T22:01:40.597 INFO:tasks.rados.rados.2.smithi057.stdout: Object size (in bytes): 4000000 2020-11-16T22:01:40.597 INFO:tasks.rados.rados.2.smithi057.stdout: Write stride min: 400000 2020-11-16T22:01:40.597 INFO:tasks.rados.rados.2.smithi057.stdout: Write stride max: 800000 2020-11-16T22:01:40.937 INFO:tasks.rados.rados.2.smithi057.stdout:1: write initial oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:40.937 INFO:tasks.rados.rados.2.smithi057.stdout:1: seq_num 0 ranges {416807=475249,1542129=474678} 2020-11-16T22:01:40.948 INFO:tasks.rados.rados.2.smithi057.stdout:1: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 416807 to 892056 tid 1 2020-11-16T22:01:40.957 INFO:tasks.rados.rados.2.smithi057.stdout:1: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1542129 to 2016807 tid 2 2020-11-16T22:01:40.957 INFO:tasks.rados.rados.2.smithi057.stdout:2: write initial oid 2 2020-11-16T22:01:40.957 INFO:tasks.rados.rados.2.smithi057.stdout:2: seq_num 1 ranges {416807=475249,1542129=474678} 2020-11-16T22:01:40.962 INFO:tasks.rados.rados.2.smithi057.stdout:2: writing smithi05720651-2 from 416807 to 892056 tid 1 2020-11-16T22:01:40.969 INFO:tasks.rados.rados.2.smithi057.stdout:2: writing smithi05720651-2 from 1542129 to 2016807 tid 2 2020-11-16T22:01:40.969 INFO:tasks.rados.rados.2.smithi057.stdout:3: write initial oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:40.969 INFO:tasks.rados.rados.2.smithi057.stdout:3: seq_num 2 ranges {433614=550498,1600611=433003} 2020-11-16T22:01:40.975 INFO:tasks.rados.rados.2.smithi057.stdout:3: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 433614 to 984112 tid 1 2020-11-16T22:01:40.981 INFO:tasks.rados.rados.2.smithi057.stdout:3: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1600611 to 2033614 tid 2 2020-11-16T22:01:40.981 INFO:tasks.rados.rados.2.smithi057.stdout:4: write initial oid 4 2020-11-16T22:01:40.981 INFO:tasks.rados.rados.2.smithi057.stdout:4: seq_num 3 ranges {450421=625747,1659093=391328} 2020-11-16T22:01:40.987 INFO:tasks.rados.rados.2.smithi057.stdout:4: writing smithi05720651-4 from 450421 to 1076168 tid 1 2020-11-16T22:01:40.993 INFO:tasks.rados.rados.2.smithi057.stdout:4: writing smithi05720651-4 from 1659093 to 2050421 tid 2 2020-11-16T22:01:40.993 INFO:tasks.rados.rados.2.smithi057.stdout:5: write initial oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:40.993 INFO:tasks.rados.rados.2.smithi057.stdout:5: seq_num 4 ranges {467228=700996,1717575=349653} 2020-11-16T22:01:41.000 INFO:tasks.rados.rados.2.smithi057.stdout:5: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 467228 to 1168224 tid 1 2020-11-16T22:01:41.005 INFO:tasks.rados.rados.2.smithi057.stdout:5: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1717575 to 2067228 tid 2 2020-11-16T22:01:41.006 INFO:tasks.rados.rados.2.smithi057.stdout:6: write initial oid 6 2020-11-16T22:01:41.006 INFO:tasks.rados.rados.2.smithi057.stdout:6: seq_num 5 ranges {484035=776245,2059704=24331} 2020-11-16T22:01:41.013 INFO:tasks.rados.rados.2.smithi057.stdout:6: writing smithi05720651-6 from 484035 to 1260280 tid 1 2020-11-16T22:01:41.018 INFO:tasks.rados.rados.2.smithi057.stdout:6: writing smithi05720651-6 from 2059704 to 2084035 tid 2 2020-11-16T22:01:41.018 INFO:tasks.rados.rados.2.smithi057.stdout:7: write initial oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.018 INFO:tasks.rados.rados.2.smithi057.stdout:7: seq_num 6 ranges {500842=451494,1718186=382656} 2020-11-16T22:01:41.023 INFO:tasks.rados.rados.2.smithi057.stdout:7: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 500842 to 952336 tid 1 2020-11-16T22:01:41.030 INFO:tasks.rados.rados.2.smithi057.stdout:7: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1718186 to 2100842 tid 2 2020-11-16T22:01:41.030 INFO:tasks.rados.rados.2.smithi057.stdout:8: write initial oid 8 2020-11-16T22:01:41.030 INFO:tasks.rados.rados.2.smithi057.stdout:1: finishing write tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.030 INFO:tasks.rados.rados.2.smithi057.stdout:8: seq_num 7 ranges {517649=526743,1776668=340981} 2020-11-16T22:01:41.036 INFO:tasks.rados.rados.2.smithi057.stdout:8: writing smithi05720651-8 from 517649 to 1044392 tid 1 2020-11-16T22:01:41.042 INFO:tasks.rados.rados.2.smithi057.stdout:8: writing smithi05720651-8 from 1776668 to 2117649 tid 2 2020-11-16T22:01:41.042 INFO:tasks.rados.rados.2.smithi057.stdout:9: write initial oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.042 INFO:tasks.rados.rados.2.smithi057.stdout:9: seq_num 8 ranges {534456=718345,1951503=182953} 2020-11-16T22:01:41.049 INFO:tasks.rados.rados.2.smithi057.stdout:9: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 534456 to 1252801 tid 1 2020-11-16T22:01:41.054 INFO:tasks.rados.rados.2.smithi057.stdout:9: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1951503 to 2134456 tid 2 2020-11-16T22:01:41.054 INFO:tasks.rados.rados.2.smithi057.stdout:10: write initial oid 10 2020-11-16T22:01:41.054 INFO:tasks.rados.rados.2.smithi057.stdout:10: seq_num 9 ranges {551263=793594,1893632=257631} 2020-11-16T22:01:41.062 INFO:tasks.rados.rados.2.smithi057.stdout:10: writing smithi05720651-10 from 551263 to 1344857 tid 1 2020-11-16T22:01:41.066 INFO:tasks.rados.rados.2.smithi057.stdout:10: writing smithi05720651-10 from 1893632 to 2151263 tid 2 2020-11-16T22:01:41.067 INFO:tasks.rados.rados.2.smithi057.stdout:11: write initial oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.067 INFO:tasks.rados.rados.2.smithi057.stdout:11: seq_num 10 ranges {568070=468843,1552114=615956} 2020-11-16T22:01:41.072 INFO:tasks.rados.rados.2.smithi057.stdout:11: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 568070 to 1036913 tid 1 2020-11-16T22:01:41.079 INFO:tasks.rados.rados.2.smithi057.stdout:11: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1552114 to 2168070 tid 2 2020-11-16T22:01:41.079 INFO:tasks.rados.rados.2.smithi057.stdout:12: write initial oid 12 2020-11-16T22:01:41.079 INFO:tasks.rados.rados.2.smithi057.stdout:12: seq_num 11 ranges {584877=544092,1610596=562003} 2020-11-16T22:01:41.086 INFO:tasks.rados.rados.2.smithi057.stdout:12: writing smithi05720651-12 from 584877 to 1128969 tid 1 2020-11-16T22:01:41.092 INFO:tasks.rados.rados.2.smithi057.stdout:12: writing smithi05720651-12 from 1610596 to 2172599 tid 2 2020-11-16T22:01:41.092 INFO:tasks.rados.rados.2.smithi057.stdout:13: write initial oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.092 INFO:tasks.rados.rados.2.smithi057.stdout:13: seq_num 12 ranges {601684=619341,1669078=532606} 2020-11-16T22:01:41.099 INFO:tasks.rados.rados.2.smithi057.stdout:13: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 601684 to 1221025 tid 1 2020-11-16T22:01:41.105 INFO:tasks.rados.rados.2.smithi057.stdout:13: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1669078 to 2201684 tid 2 2020-11-16T22:01:41.105 INFO:tasks.rados.rados.2.smithi057.stdout:14: write initial oid 14 2020-11-16T22:01:41.105 INFO:tasks.rados.rados.2.smithi057.stdout:14: seq_num 13 ranges {618491=694590,2011207=207284} 2020-11-16T22:01:41.112 INFO:tasks.rados.rados.2.smithi057.stdout:14: writing smithi05720651-14 from 618491 to 1313081 tid 1 2020-11-16T22:01:41.117 INFO:tasks.rados.rados.2.smithi057.stdout:14: writing smithi05720651-14 from 2011207 to 2218491 tid 2 2020-11-16T22:01:41.117 INFO:tasks.rados.rados.2.smithi057.stdout:15: write initial oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.118 INFO:tasks.rados.rados.2.smithi057.stdout:15: seq_num 14 ranges {635298=769839,2069689=165609} 2020-11-16T22:01:41.126 INFO:tasks.rados.rados.2.smithi057.stdout:15: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 635298 to 1405137 tid 1 2020-11-16T22:01:41.130 INFO:tasks.rados.rados.2.smithi057.stdout:15: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2069689 to 2235298 tid 2 2020-11-16T22:01:41.131 INFO:tasks.rados.rados.2.smithi057.stdout:16: write initial oid 16 2020-11-16T22:01:41.131 INFO:tasks.rados.rados.2.smithi057.stdout:16: seq_num 15 ranges {652105=445088,1728171=452988} 2020-11-16T22:01:41.136 INFO:tasks.rados.rados.2.smithi057.stdout:16: writing smithi05720651-16 from 652105 to 1097193 tid 1 2020-11-16T22:01:41.143 INFO:tasks.rados.rados.2.smithi057.stdout:16: writing smithi05720651-16 from 1728171 to 2181159 tid 2 2020-11-16T22:01:41.143 INFO:tasks.rados.rados.2.smithi057.stdout: waiting on 16 2020-11-16T22:01:41.143 INFO:tasks.rados.rados.2.smithi057.stdout:1: finishing write tid 2 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.144 INFO:tasks.rados.rados.2.smithi057.stdout:1: finishing write tid 4 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.144 INFO:tasks.rados.rados.2.smithi057.stdout:1: finishing write tid 5 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.144 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3 (ObjNum 0 snap 0 seq_num 0) dirty exists 2020-11-16T22:01:41.144 INFO:tasks.rados.rados.2.smithi057.stdout:1: left oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 0 snap 0 seq_num 0) 2020-11-16T22:01:41.144 INFO:tasks.rados.rados.2.smithi057.stdout:3: finishing write tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.144 INFO:tasks.rados.rados.2.smithi057.stdout:3: finishing write tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.145 INFO:tasks.rados.rados.2.smithi057.stdout:3: finishing write tid 4 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.145 INFO:tasks.rados.rados.2.smithi057.stdout:3: finishing write tid 5 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.145 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3 (ObjNum 2 snap 0 seq_num 2) dirty exists 2020-11-16T22:01:41.145 INFO:tasks.rados.rados.2.smithi057.stdout:3: left oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 2 snap 0 seq_num 2) 2020-11-16T22:01:41.145 INFO:tasks.rados.rados.2.smithi057.stdout:4: finishing write tid 1 to smithi05720651-4 2020-11-16T22:01:41.145 INFO:tasks.rados.rados.2.smithi057.stdout:4: finishing write tid 2 to smithi05720651-4 2020-11-16T22:01:41.145 INFO:tasks.rados.rados.2.smithi057.stdout:4: finishing write tid 4 to smithi05720651-4 2020-11-16T22:01:41.146 INFO:tasks.rados.rados.2.smithi057.stdout:4: finishing write tid 5 to smithi05720651-4 2020-11-16T22:01:41.146 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 3 (ObjNum 3 snap 0 seq_num 3) dirty exists 2020-11-16T22:01:41.146 INFO:tasks.rados.rados.2.smithi057.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2020-11-16T22:01:41.146 INFO:tasks.rados.rados.2.smithi057.stdout:1: done (15 left) 2020-11-16T22:01:41.146 INFO:tasks.rados.rados.2.smithi057.stdout:3: done (14 left) 2020-11-16T22:01:41.146 INFO:tasks.rados.rados.2.smithi057.stdout:4: done (13 left) 2020-11-16T22:01:41.146 INFO:tasks.rados.rados.2.smithi057.stdout:17: write initial oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.147 INFO:tasks.rados.rados.2.smithi057.stdout:17: seq_num 16 ranges {668912=636690,1903006=365906} 2020-11-16T22:01:41.150 INFO:tasks.rados.rados.2.smithi057.stdout:17: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 668912 to 1305602 tid 1 2020-11-16T22:01:41.156 INFO:tasks.rados.rados.2.smithi057.stdout:17: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1903006 to 2268912 tid 2 2020-11-16T22:01:41.156 INFO:tasks.rados.rados.2.smithi057.stdout:18: write initial oid 18 2020-11-16T22:01:41.156 INFO:tasks.rados.rados.2.smithi057.stdout:18: seq_num 17 ranges {685719=711939,1845135=440584} 2020-11-16T22:01:41.164 INFO:tasks.rados.rados.2.smithi057.stdout:18: writing smithi05720651-18 from 685719 to 1397658 tid 1 2020-11-16T22:01:41.169 INFO:tasks.rados.rados.2.smithi057.stdout:18: writing smithi05720651-18 from 1845135 to 2285719 tid 2 2020-11-16T22:01:41.169 INFO:tasks.rados.rados.2.smithi057.stdout:19: write initial oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.169 INFO:tasks.rados.rados.2.smithi057.stdout:19: seq_num 18 ranges {702526=787188,1903617=398909} 2020-11-16T22:01:41.177 INFO:tasks.rados.rados.2.smithi057.stdout:19: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 702526 to 1489714 tid 1 2020-11-16T22:01:41.182 INFO:tasks.rados.rados.2.smithi057.stdout:19: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1903617 to 2302526 tid 2 2020-11-16T22:01:41.182 INFO:tasks.rados.rados.2.smithi057.stdout: waiting on 16 2020-11-16T22:01:41.182 INFO:tasks.rados.rados.2.smithi057.stdout:5: finishing write tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.183 INFO:tasks.rados.rados.2.smithi057.stdout:5: finishing write tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.183 INFO:tasks.rados.rados.2.smithi057.stdout:5: finishing write tid 4 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.183 INFO:tasks.rados.rados.2.smithi057.stdout:5: finishing write tid 5 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.183 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3 (ObjNum 4 snap 0 seq_num 4) dirty exists 2020-11-16T22:01:41.183 INFO:tasks.rados.rados.2.smithi057.stdout:5: left oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 4 snap 0 seq_num 4) 2020-11-16T22:01:41.184 INFO:tasks.rados.rados.2.smithi057.stdout:6: finishing write tid 1 to smithi05720651-6 2020-11-16T22:01:41.184 INFO:tasks.rados.rados.2.smithi057.stdout:5: done (15 left) 2020-11-16T22:01:41.184 INFO:tasks.rados.rados.2.smithi057.stdout:20: write initial oid 20 2020-11-16T22:01:41.184 INFO:tasks.rados.rados.2.smithi057.stdout:20: seq_num 19 ranges {719333=462437,1962099=357234} 2020-11-16T22:01:41.189 INFO:tasks.rados.rados.2.smithi057.stdout:20: writing smithi05720651-20 from 719333 to 1181770 tid 1 2020-11-16T22:01:41.195 INFO:tasks.rados.rados.2.smithi057.stdout:20: writing smithi05720651-20 from 1962099 to 2319333 tid 2 2020-11-16T22:01:41.195 INFO:tasks.rados.rados.2.smithi057.stdout: waiting on 16 2020-11-16T22:01:41.196 INFO:tasks.rados.rados.2.smithi057.stdout:2: finishing write tid 1 to smithi05720651-2 2020-11-16T22:01:41.196 INFO:tasks.rados.rados.2.smithi057.stdout:6: finishing write tid 2 to smithi05720651-6 2020-11-16T22:01:41.196 INFO:tasks.rados.rados.2.smithi057.stdout:6: finishing write tid 4 to smithi05720651-6 2020-11-16T22:01:41.196 INFO:tasks.rados.rados.2.smithi057.stdout:6: finishing write tid 5 to smithi05720651-6 2020-11-16T22:01:41.196 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 3 (ObjNum 5 snap 0 seq_num 5) dirty exists 2020-11-16T22:01:41.196 INFO:tasks.rados.rados.2.smithi057.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2020-11-16T22:01:41.196 INFO:tasks.rados.rados.2.smithi057.stdout:7: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.197 INFO:tasks.rados.rados.2.smithi057.stdout:6: done (15 left) 2020-11-16T22:01:41.197 INFO:tasks.rados.rados.2.smithi057.stdout:21: write initial oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.197 INFO:tasks.rados.rados.2.smithi057.stdout:21: seq_num 20 ranges {736140=537686,2020581=315559} 2020-11-16T22:01:41.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:40 smithi057 bash[10301]: cluster 2020-11-16T22:01:39.560942+0000 mgr.x (mgr.24115) 271 : cluster [DBG] pgmap v275: 17 pgs: 5 creating+peering, 5 unknown, 7 active+clean; 0 B data, 67 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:41.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:40 smithi057 bash[10301]: audit 2020-11-16T22:01:40.645012+0000 mon.c (mon.2) 21 : audit [INF] from='client.? v1:172.21.15.57:0/3494825153' entity='client.2' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2020-11-16T22:01:41.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:40 smithi057 bash[10301]: audit 2020-11-16T22:01:40.646163+0000 mon.a (mon.0) 696 : audit [INF] from='client.34682 ' entity='client.2' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2020-11-16T22:01:41.202 INFO:tasks.rados.rados.2.smithi057.stdout:21: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 736140 to 1273826 tid 1 2020-11-16T22:01:41.209 INFO:tasks.rados.rados.2.smithi057.stdout:21: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2020581 to 2336140 tid 2 2020-11-16T22:01:41.209 INFO:tasks.rados.rados.2.smithi057.stdout: waiting on 16 2020-11-16T22:01:41.209 INFO:tasks.rados.rados.2.smithi057.stdout:2: finishing write tid 2 to smithi05720651-2 2020-11-16T22:01:41.209 INFO:tasks.rados.rados.2.smithi057.stdout:2: finishing write tid 4 to smithi05720651-2 2020-11-16T22:01:41.209 INFO:tasks.rados.rados.2.smithi057.stdout:2: finishing write tid 5 to smithi05720651-2 2020-11-16T22:01:41.209 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 4 (ObjNum 1 snap 0 seq_num 1) dirty exists 2020-11-16T22:01:41.209 INFO:tasks.rados.rados.2.smithi057.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2020-11-16T22:01:41.210 INFO:tasks.rados.rados.2.smithi057.stdout:7: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.210 INFO:tasks.rados.rados.2.smithi057.stdout:8: finishing write tid 1 to smithi05720651-8 2020-11-16T22:01:41.210 INFO:tasks.rados.rados.2.smithi057.stdout:2: done (15 left) 2020-11-16T22:01:41.210 INFO:tasks.rados.rados.2.smithi057.stdout:22: write initial oid 22 2020-11-16T22:01:41.210 INFO:tasks.rados.rados.2.smithi057.stdout:22: seq_num 21 ranges {752947=612935,1962710=390237} 2020-11-16T22:01:41.216 INFO:tasks.rados.rados.2.smithi057.stdout:22: writing smithi05720651-22 from 752947 to 1365882 tid 1 2020-11-16T22:01:41.222 INFO:tasks.rados.rados.2.smithi057.stdout:22: writing smithi05720651-22 from 1962710 to 2352947 tid 2 2020-11-16T22:01:41.222 INFO:tasks.rados.rados.2.smithi057.stdout: waiting on 16 2020-11-16T22:01:41.222 INFO:tasks.rados.rados.2.smithi057.stdout:8: finishing write tid 2 to smithi05720651-8 2020-11-16T22:01:41.222 INFO:tasks.rados.rados.2.smithi057.stdout:8: finishing write tid 4 to smithi05720651-8 2020-11-16T22:01:41.222 INFO:tasks.rados.rados.2.smithi057.stdout:8: finishing write tid 5 to smithi05720651-8 2020-11-16T22:01:41.223 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 6 (ObjNum 7 snap 0 seq_num 7) dirty exists 2020-11-16T22:01:41.223 INFO:tasks.rados.rados.2.smithi057.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2020-11-16T22:01:41.223 INFO:tasks.rados.rados.2.smithi057.stdout:9: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.223 INFO:tasks.rados.rados.2.smithi057.stdout:9: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.223 INFO:tasks.rados.rados.2.smithi057.stdout:9: finishing write tid 4 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.223 INFO:tasks.rados.rados.2.smithi057.stdout:10: finishing write tid 1 to smithi05720651-10 2020-11-16T22:01:41.223 INFO:tasks.rados.rados.2.smithi057.stdout:10: finishing write tid 2 to smithi05720651-10 2020-11-16T22:01:41.224 INFO:tasks.rados.rados.2.smithi057.stdout:10: finishing write tid 4 to smithi05720651-10 2020-11-16T22:01:41.224 INFO:tasks.rados.rados.2.smithi057.stdout:10: finishing write tid 5 to smithi05720651-10 2020-11-16T22:01:41.224 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 3 (ObjNum 9 snap 0 seq_num 9) dirty exists 2020-11-16T22:01:41.224 INFO:tasks.rados.rados.2.smithi057.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2020-11-16T22:01:41.224 INFO:tasks.rados.rados.2.smithi057.stdout:11: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.224 INFO:tasks.rados.rados.2.smithi057.stdout:11: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.224 INFO:tasks.rados.rados.2.smithi057.stdout:11: finishing write tid 4 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.225 INFO:tasks.rados.rados.2.smithi057.stdout:11: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.225 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 6 (ObjNum 10 snap 0 seq_num 10) dirty exists 2020-11-16T22:01:41.225 INFO:tasks.rados.rados.2.smithi057.stdout:11: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 10 snap 0 seq_num 10) 2020-11-16T22:01:41.225 INFO:tasks.rados.rados.2.smithi057.stdout:12: finishing write tid 1 to smithi05720651-12 2020-11-16T22:01:41.225 INFO:tasks.rados.rados.2.smithi057.stdout:12: finishing write tid 2 to smithi05720651-12 2020-11-16T22:01:41.225 INFO:tasks.rados.rados.2.smithi057.stdout:12: finishing write tid 4 to smithi05720651-12 2020-11-16T22:01:41.225 INFO:tasks.rados.rados.2.smithi057.stdout:8: done (15 left) 2020-11-16T22:01:41.226 INFO:tasks.rados.rados.2.smithi057.stdout:10: done (14 left) 2020-11-16T22:01:41.226 INFO:tasks.rados.rados.2.smithi057.stdout:11: done (13 left) 2020-11-16T22:01:41.226 INFO:tasks.rados.rados.2.smithi057.stdout:23: write initial oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.226 INFO:tasks.rados.rados.2.smithi057.stdout:23: seq_num 22 ranges {769754=688184,2021192=348562} 2020-11-16T22:01:41.239 INFO:tasks.rados.rados.2.smithi057.stdout:23: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 769754 to 1457938 tid 1 2020-11-16T22:01:41.244 INFO:tasks.rados.rados.2.smithi057.stdout:23: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2021192 to 2369754 tid 2 2020-11-16T22:01:41.245 INFO:tasks.rados.rados.2.smithi057.stdout:24: write initial oid 24 2020-11-16T22:01:41.245 INFO:tasks.rados.rados.2.smithi057.stdout:24: seq_num 23 ranges {786561=479786,1796027=467664} 2020-11-16T22:01:41.252 INFO:tasks.rados.rados.2.smithi057.stdout:24: writing smithi05720651-24 from 786561 to 1266347 tid 1 2020-11-16T22:01:41.258 INFO:tasks.rados.rados.2.smithi057.stdout:24: writing smithi05720651-24 from 1796027 to 2263691 tid 2 2020-11-16T22:01:41.258 INFO:tasks.rados.rados.2.smithi057.stdout:25: write initial oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.258 INFO:tasks.rados.rados.2.smithi057.stdout:25: seq_num 24 ranges {403368=555035,1454509=727675} 2020-11-16T22:01:41.263 INFO:tasks.rados.rados.2.smithi057.stdout:25: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 403368 to 958403 tid 1 2020-11-16T22:01:41.270 INFO:tasks.rados.rados.2.smithi057.stdout:25: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1454509 to 2182184 tid 2 2020-11-16T22:01:41.270 INFO:tasks.rados.rados.2.smithi057.stdout: waiting on 16 2020-11-16T22:01:41.271 INFO:tasks.rados.rados.2.smithi057.stdout:12: finishing write tid 5 to smithi05720651-12 2020-11-16T22:01:41.271 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 3 (ObjNum 11 snap 0 seq_num 11) dirty exists 2020-11-16T22:01:41.271 INFO:tasks.rados.rados.2.smithi057.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2020-11-16T22:01:41.271 INFO:tasks.rados.rados.2.smithi057.stdout:12: done (15 left) 2020-11-16T22:01:41.271 INFO:tasks.rados.rados.2.smithi057.stdout:26: write initial oid 26 2020-11-16T22:01:41.271 INFO:tasks.rados.rados.2.smithi057.stdout:26: seq_num 25 ranges {420175=630284,1796638=471333} 2020-11-16T22:01:41.277 INFO:tasks.rados.rados.2.smithi057.stdout:26: writing smithi05720651-26 from 420175 to 1050459 tid 1 2020-11-16T22:01:41.284 INFO:tasks.rados.rados.2.smithi057.stdout:26: writing smithi05720651-26 from 1796638 to 2267971 tid 2 2020-11-16T22:01:41.284 INFO:tasks.rados.rados.2.smithi057.stdout: waiting on 16 2020-11-16T22:01:41.285 INFO:tasks.rados.rados.2.smithi057.stdout:13: finishing write tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.285 INFO:tasks.rados.rados.2.smithi057.stdout:13: finishing write tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.285 INFO:tasks.rados.rados.2.smithi057.stdout:13: finishing write tid 4 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.285 INFO:tasks.rados.rados.2.smithi057.stdout:13: finishing write tid 5 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.285 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 9 (ObjNum 12 snap 0 seq_num 12) dirty exists 2020-11-16T22:01:41.285 INFO:tasks.rados.rados.2.smithi057.stdout:13: left oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 12 snap 0 seq_num 12) 2020-11-16T22:01:41.286 INFO:tasks.rados.rados.2.smithi057.stdout:9: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.286 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3 (ObjNum 8 snap 0 seq_num 8) dirty exists 2020-11-16T22:01:41.286 INFO:tasks.rados.rados.2.smithi057.stdout:9: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 8 snap 0 seq_num 8) 2020-11-16T22:01:41.286 INFO:tasks.rados.rados.2.smithi057.stdout:7: finishing write tid 4 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.286 INFO:tasks.rados.rados.2.smithi057.stdout:15: finishing write tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.286 INFO:tasks.rados.rados.2.smithi057.stdout:15: finishing write tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.286 INFO:tasks.rados.rados.2.smithi057.stdout:15: finishing write tid 4 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.287 INFO:tasks.rados.rados.2.smithi057.stdout:15: finishing write tid 5 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.287 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 6 (ObjNum 14 snap 0 seq_num 14) dirty exists 2020-11-16T22:01:41.287 INFO:tasks.rados.rados.2.smithi057.stdout:15: left oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 14 snap 0 seq_num 14) 2020-11-16T22:01:41.287 INFO:tasks.rados.rados.2.smithi057.stdout:16: finishing write tid 1 to smithi05720651-16 2020-11-16T22:01:41.287 INFO:tasks.rados.rados.2.smithi057.stdout:16: finishing write tid 2 to smithi05720651-16 2020-11-16T22:01:41.287 INFO:tasks.rados.rados.2.smithi057.stdout:9: done (15 left) 2020-11-16T22:01:41.287 INFO:tasks.rados.rados.2.smithi057.stdout:13: done (14 left) 2020-11-16T22:01:41.288 INFO:tasks.rados.rados.2.smithi057.stdout:15: done (13 left) 2020-11-16T22:01:41.288 INFO:tasks.rados.rados.2.smithi057.stdout:27: write initial oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.288 INFO:tasks.rados.rados.2.smithi057.stdout:27: seq_num 26 ranges {436982=705533,1855120=581862} 2020-11-16T22:01:41.290 INFO:tasks.rados.rados.2.smithi057.stdout:27: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 436982 to 1142515 tid 1 2020-11-16T22:01:41.298 INFO:tasks.rados.rados.2.smithi057.stdout:27: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1855120 to 2436982 tid 2 2020-11-16T22:01:41.298 INFO:tasks.rados.rados.2.smithi057.stdout:28: write initial oid 28 2020-11-16T22:01:41.298 INFO:tasks.rados.rados.2.smithi057.stdout:28: seq_num 27 ranges {453789=780782,1913602=475002} 2020-11-16T22:01:41.305 INFO:tasks.rados.rados.2.smithi057.stdout:28: writing smithi05720651-28 from 453789 to 1234571 tid 1 2020-11-16T22:01:41.312 INFO:tasks.rados.rados.2.smithi057.stdout:28: writing smithi05720651-28 from 1913602 to 2388604 tid 2 2020-11-16T22:01:41.312 INFO:tasks.rados.rados.2.smithi057.stdout:29: write initial oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.312 INFO:tasks.rados.rados.2.smithi057.stdout:29: seq_num 28 ranges {470596=456031,1572084=618660} 2020-11-16T22:01:41.318 INFO:tasks.rados.rados.2.smithi057.stdout:29: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 470596 to 926627 tid 1 2020-11-16T22:01:41.325 INFO:tasks.rados.rados.2.smithi057.stdout:29: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1572084 to 2190744 tid 2 2020-11-16T22:01:41.326 INFO:tasks.rados.rados.2.smithi057.stdout: waiting on 16 2020-11-16T22:01:41.326 INFO:tasks.rados.rados.2.smithi057.stdout:16: finishing write tid 4 to smithi05720651-16 2020-11-16T22:01:41.326 INFO:tasks.rados.rados.2.smithi057.stdout:16: finishing write tid 5 to smithi05720651-16 2020-11-16T22:01:41.326 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 9 (ObjNum 15 snap 0 seq_num 15) dirty exists 2020-11-16T22:01:41.326 INFO:tasks.rados.rados.2.smithi057.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2020-11-16T22:01:41.326 INFO:tasks.rados.rados.2.smithi057.stdout:17: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.326 INFO:tasks.rados.rados.2.smithi057.stdout:16: done (15 left) 2020-11-16T22:01:41.327 INFO:tasks.rados.rados.2.smithi057.stdout:30: write initial oid 30 2020-11-16T22:01:41.327 INFO:tasks.rados.rados.2.smithi057.stdout:30: seq_num 29 ranges {487403=531280,1514213=478671} 2020-11-16T22:01:41.331 INFO:tasks.rados.rados.2.smithi057.stdout:30: writing smithi05720651-30 from 487403 to 1018683 tid 1 2020-11-16T22:01:41.336 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:40 smithi016 bash[10302]: cluster 2020-11-16T22:01:39.560942+0000 mgr.x (mgr.24115) 271 : cluster [DBG] pgmap v275: 17 pgs: 5 creating+peering, 5 unknown, 7 active+clean; 0 B data, 67 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:41.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:40 smithi016 bash[10302]: audit 2020-11-16T22:01:40.645012+0000 mon.c (mon.2) 21 : audit [INF] from='client.? v1:172.21.15.57:0/3494825153' entity='client.2' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2020-11-16T22:01:41.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:40 smithi016 bash[10302]: audit 2020-11-16T22:01:40.646163+0000 mon.a (mon.0) 696 : audit [INF] from='client.34682 ' entity='client.2' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2020-11-16T22:01:41.338 INFO:tasks.rados.rados.2.smithi057.stdout:30: writing smithi05720651-30 from 1514213 to 1992884 tid 2 2020-11-16T22:01:41.338 INFO:tasks.rados.rados.2.smithi057.stdout: waiting on 16 2020-11-16T22:01:41.338 INFO:tasks.rados.rados.2.smithi057.stdout:17: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.338 INFO:tasks.rados.rados.2.smithi057.stdout:17: finishing write tid 4 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.338 INFO:tasks.rados.rados.2.smithi057.stdout:7: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.338 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 6 (ObjNum 6 snap 0 seq_num 6) dirty exists 2020-11-16T22:01:41.339 INFO:tasks.rados.rados.2.smithi057.stdout:7: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 6 snap 0 seq_num 6) 2020-11-16T22:01:41.339 INFO:tasks.rados.rados.2.smithi057.stdout:17: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.339 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3 (ObjNum 16 snap 0 seq_num 16) dirty exists 2020-11-16T22:01:41.339 INFO:tasks.rados.rados.2.smithi057.stdout:17: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 16 snap 0 seq_num 16) 2020-11-16T22:01:41.339 INFO:tasks.rados.rados.2.smithi057.stdout:18: finishing write tid 1 to smithi05720651-18 2020-11-16T22:01:41.339 INFO:tasks.rados.rados.2.smithi057.stdout:18: finishing write tid 2 to smithi05720651-18 2020-11-16T22:01:41.339 INFO:tasks.rados.rados.2.smithi057.stdout:7: done (15 left) 2020-11-16T22:01:41.339 INFO:tasks.rados.rados.2.smithi057.stdout:17: done (14 left) 2020-11-16T22:01:41.340 INFO:tasks.rados.rados.2.smithi057.stdout:31: write initial oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.340 INFO:tasks.rados.rados.2.smithi057.stdout:31: seq_num 30 ranges {504210=606529,1572695=622329} 2020-11-16T22:01:41.343 INFO:tasks.rados.rados.2.smithi057.stdout:31: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 504210 to 1110739 tid 1 2020-11-16T22:01:41.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:40 smithi195 bash[10218]: cluster 2020-11-16T22:01:39.560942+0000 mgr.x (mgr.24115) 271 : cluster [DBG] pgmap v275: 17 pgs: 5 creating+peering, 5 unknown, 7 active+clean; 0 B data, 67 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:41.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:40 smithi195 bash[10218]: audit 2020-11-16T22:01:40.645012+0000 mon.c (mon.2) 21 : audit [INF] from='client.? v1:172.21.15.57:0/3494825153' entity='client.2' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2020-11-16T22:01:41.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:40 smithi195 bash[10218]: audit 2020-11-16T22:01:40.646163+0000 mon.a (mon.0) 696 : audit [INF] from='client.34682 ' entity='client.2' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2020-11-16T22:01:41.350 INFO:tasks.rados.rados.2.smithi057.stdout:31: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1572695 to 2195024 tid 2 2020-11-16T22:01:41.350 INFO:tasks.rados.rados.2.smithi057.stdout:32: write initial oid 32 2020-11-16T22:01:41.350 INFO:tasks.rados.rados.2.smithi057.stdout:32: seq_num 31 ranges {521017=798131,1747530=482340} 2020-11-16T22:01:41.357 INFO:tasks.rados.rados.2.smithi057.stdout:32: writing smithi05720651-32 from 521017 to 1319148 tid 1 2020-11-16T22:01:41.363 INFO:tasks.rados.rados.2.smithi057.stdout:32: writing smithi05720651-32 from 1747530 to 2229870 tid 2 2020-11-16T22:01:41.363 INFO:tasks.rados.rados.2.smithi057.stdout: waiting on 16 2020-11-16T22:01:41.364 INFO:tasks.rados.rados.2.smithi057.stdout:18: finishing write tid 4 to smithi05720651-18 2020-11-16T22:01:41.364 INFO:tasks.rados.rados.2.smithi057.stdout:19: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.364 INFO:tasks.rados.rados.2.smithi057.stdout:19: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.364 INFO:tasks.rados.rados.2.smithi057.stdout:19: finishing write tid 4 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.364 INFO:tasks.rados.rados.2.smithi057.stdout:19: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.364 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 12 (ObjNum 18 snap 0 seq_num 18) dirty exists 2020-11-16T22:01:41.364 INFO:tasks.rados.rados.2.smithi057.stdout:19: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 18 snap 0 seq_num 18) 2020-11-16T22:01:41.365 INFO:tasks.rados.rados.2.smithi057.stdout:20: finishing write tid 1 to smithi05720651-20 2020-11-16T22:01:41.365 INFO:tasks.rados.rados.2.smithi057.stdout:20: finishing write tid 2 to smithi05720651-20 2020-11-16T22:01:41.365 INFO:tasks.rados.rados.2.smithi057.stdout:20: finishing write tid 4 to smithi05720651-20 2020-11-16T22:01:41.365 INFO:tasks.rados.rados.2.smithi057.stdout:20: finishing write tid 5 to smithi05720651-20 2020-11-16T22:01:41.365 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 6 (ObjNum 19 snap 0 seq_num 19) dirty exists 2020-11-16T22:01:41.365 INFO:tasks.rados.rados.2.smithi057.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2020-11-16T22:01:41.365 INFO:tasks.rados.rados.2.smithi057.stdout:21: finishing write tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.366 INFO:tasks.rados.rados.2.smithi057.stdout:21: finishing write tid 2 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.366 INFO:tasks.rados.rados.2.smithi057.stdout:21: finishing write tid 4 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.366 INFO:tasks.rados.rados.2.smithi057.stdout:21: finishing write tid 5 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.366 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 6 (ObjNum 20 snap 0 seq_num 20) dirty exists 2020-11-16T22:01:41.366 INFO:tasks.rados.rados.2.smithi057.stdout:21: left oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 20 snap 0 seq_num 20) 2020-11-16T22:01:41.366 INFO:tasks.rados.rados.2.smithi057.stdout:22: finishing write tid 1 to smithi05720651-22 2020-11-16T22:01:41.366 INFO:tasks.rados.rados.2.smithi057.stdout:22: finishing write tid 2 to smithi05720651-22 2020-11-16T22:01:41.367 INFO:tasks.rados.rados.2.smithi057.stdout:22: finishing write tid 4 to smithi05720651-22 2020-11-16T22:01:41.367 INFO:tasks.rados.rados.2.smithi057.stdout:18: finishing write tid 5 to smithi05720651-18 2020-11-16T22:01:41.367 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 3 (ObjNum 17 snap 0 seq_num 17) dirty exists 2020-11-16T22:01:41.367 INFO:tasks.rados.rados.2.smithi057.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2020-11-16T22:01:41.367 INFO:tasks.rados.rados.2.smithi057.stdout:22: finishing write tid 5 to smithi05720651-22 2020-11-16T22:01:41.367 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 6 (ObjNum 21 snap 0 seq_num 21) dirty exists 2020-11-16T22:01:41.367 INFO:tasks.rados.rados.2.smithi057.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2020-11-16T22:01:41.368 INFO:tasks.rados.rados.2.smithi057.stdout:14: finishing write tid 1 to smithi05720651-14 2020-11-16T22:01:41.368 INFO:tasks.rados.rados.2.smithi057.stdout:14: finishing write tid 2 to smithi05720651-14 2020-11-16T22:01:41.368 INFO:tasks.rados.rados.2.smithi057.stdout:14: finishing write tid 4 to smithi05720651-14 2020-11-16T22:01:41.368 INFO:tasks.rados.rados.2.smithi057.stdout:14: finishing write tid 5 to smithi05720651-14 2020-11-16T22:01:41.368 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 9 (ObjNum 13 snap 0 seq_num 13) dirty exists 2020-11-16T22:01:41.368 INFO:tasks.rados.rados.2.smithi057.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2020-11-16T22:01:41.368 INFO:tasks.rados.rados.2.smithi057.stdout:23: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.368 INFO:tasks.rados.rados.2.smithi057.stdout:23: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.369 INFO:tasks.rados.rados.2.smithi057.stdout:23: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.369 INFO:tasks.rados.rados.2.smithi057.stdout:24: finishing write tid 1 to smithi05720651-24 2020-11-16T22:01:41.369 INFO:tasks.rados.rados.2.smithi057.stdout:24: finishing write tid 2 to smithi05720651-24 2020-11-16T22:01:41.369 INFO:tasks.rados.rados.2.smithi057.stdout:24: finishing write tid 4 to smithi05720651-24 2020-11-16T22:01:41.369 INFO:tasks.rados.rados.2.smithi057.stdout:24: finishing write tid 5 to smithi05720651-24 2020-11-16T22:01:41.369 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 9 (ObjNum 23 snap 0 seq_num 23) dirty exists 2020-11-16T22:01:41.369 INFO:tasks.rados.rados.2.smithi057.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2020-11-16T22:01:41.370 INFO:tasks.rados.rados.2.smithi057.stdout:25: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.370 INFO:tasks.rados.rados.2.smithi057.stdout:25: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.370 INFO:tasks.rados.rados.2.smithi057.stdout:25: finishing write tid 4 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.370 INFO:tasks.rados.rados.2.smithi057.stdout:25: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.370 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 6 (ObjNum 24 snap 0 seq_num 24) dirty exists 2020-11-16T22:01:41.370 INFO:tasks.rados.rados.2.smithi057.stdout:25: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 24 snap 0 seq_num 24) 2020-11-16T22:01:41.370 INFO:tasks.rados.rados.2.smithi057.stdout:23: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.371 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 6 (ObjNum 22 snap 0 seq_num 22) dirty exists 2020-11-16T22:01:41.371 INFO:tasks.rados.rados.2.smithi057.stdout:23: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 22 snap 0 seq_num 22) 2020-11-16T22:01:41.371 INFO:tasks.rados.rados.2.smithi057.stdout:26: finishing write tid 1 to smithi05720651-26 2020-11-16T22:01:41.371 INFO:tasks.rados.rados.2.smithi057.stdout:26: finishing write tid 2 to smithi05720651-26 2020-11-16T22:01:41.371 INFO:tasks.rados.rados.2.smithi057.stdout:26: finishing write tid 4 to smithi05720651-26 2020-11-16T22:01:41.371 INFO:tasks.rados.rados.2.smithi057.stdout:26: finishing write tid 5 to smithi05720651-26 2020-11-16T22:01:41.371 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 12 (ObjNum 25 snap 0 seq_num 25) dirty exists 2020-11-16T22:01:41.372 INFO:tasks.rados.rados.2.smithi057.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2020-11-16T22:01:41.372 INFO:tasks.rados.rados.2.smithi057.stdout:27: finishing write tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.372 INFO:tasks.rados.rados.2.smithi057.stdout:27: finishing write tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.372 INFO:tasks.rados.rados.2.smithi057.stdout:27: finishing write tid 4 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.372 INFO:tasks.rados.rados.2.smithi057.stdout:27: finishing write tid 5 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.372 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 15 (ObjNum 26 snap 0 seq_num 26) dirty exists 2020-11-16T22:01:41.372 INFO:tasks.rados.rados.2.smithi057.stdout:27: left oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 26 snap 0 seq_num 26) 2020-11-16T22:01:41.373 INFO:tasks.rados.rados.2.smithi057.stdout:28: finishing write tid 1 to smithi05720651-28 2020-11-16T22:01:41.373 INFO:tasks.rados.rados.2.smithi057.stdout:28: finishing write tid 2 to smithi05720651-28 2020-11-16T22:01:41.373 INFO:tasks.rados.rados.2.smithi057.stdout:28: finishing write tid 4 to smithi05720651-28 2020-11-16T22:01:41.373 INFO:tasks.rados.rados.2.smithi057.stdout:28: finishing write tid 5 to smithi05720651-28 2020-11-16T22:01:41.373 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 9 (ObjNum 27 snap 0 seq_num 27) dirty exists 2020-11-16T22:01:41.373 INFO:tasks.rados.rados.2.smithi057.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2020-11-16T22:01:41.373 INFO:tasks.rados.rados.2.smithi057.stdout:29: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.373 INFO:tasks.rados.rados.2.smithi057.stdout:29: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.374 INFO:tasks.rados.rados.2.smithi057.stdout:29: finishing write tid 4 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.374 INFO:tasks.rados.rados.2.smithi057.stdout:29: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.374 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3 (ObjNum 28 snap 0 seq_num 28) dirty exists 2020-11-16T22:01:41.374 INFO:tasks.rados.rados.2.smithi057.stdout:29: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 28 snap 0 seq_num 28) 2020-11-16T22:01:41.374 INFO:tasks.rados.rados.2.smithi057.stdout:30: finishing write tid 1 to smithi05720651-30 2020-11-16T22:01:41.374 INFO:tasks.rados.rados.2.smithi057.stdout:30: finishing write tid 2 to smithi05720651-30 2020-11-16T22:01:41.374 INFO:tasks.rados.rados.2.smithi057.stdout:30: finishing write tid 4 to smithi05720651-30 2020-11-16T22:01:41.375 INFO:tasks.rados.rados.2.smithi057.stdout:30: finishing write tid 5 to smithi05720651-30 2020-11-16T22:01:41.375 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 12 (ObjNum 29 snap 0 seq_num 29) dirty exists 2020-11-16T22:01:41.375 INFO:tasks.rados.rados.2.smithi057.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2020-11-16T22:01:41.375 INFO:tasks.rados.rados.2.smithi057.stdout:31: finishing write tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.375 INFO:tasks.rados.rados.2.smithi057.stdout:31: finishing write tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.375 INFO:tasks.rados.rados.2.smithi057.stdout:31: finishing write tid 4 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.375 INFO:tasks.rados.rados.2.smithi057.stdout:14: done (15 left) 2020-11-16T22:01:41.376 INFO:tasks.rados.rados.2.smithi057.stdout:18: done (14 left) 2020-11-16T22:01:41.376 INFO:tasks.rados.rados.2.smithi057.stdout:19: done (13 left) 2020-11-16T22:01:41.376 INFO:tasks.rados.rados.2.smithi057.stdout:20: done (12 left) 2020-11-16T22:01:41.376 INFO:tasks.rados.rados.2.smithi057.stdout:21: done (11 left) 2020-11-16T22:01:41.376 INFO:tasks.rados.rados.2.smithi057.stdout:22: done (10 left) 2020-11-16T22:01:41.376 INFO:tasks.rados.rados.2.smithi057.stdout:23: done (9 left) 2020-11-16T22:01:41.376 INFO:tasks.rados.rados.2.smithi057.stdout:24: done (8 left) 2020-11-16T22:01:41.376 INFO:tasks.rados.rados.2.smithi057.stdout:25: done (7 left) 2020-11-16T22:01:41.377 INFO:tasks.rados.rados.2.smithi057.stdout:26: done (6 left) 2020-11-16T22:01:41.377 INFO:tasks.rados.rados.2.smithi057.stdout:27: done (5 left) 2020-11-16T22:01:41.377 INFO:tasks.rados.rados.2.smithi057.stdout:28: done (4 left) 2020-11-16T22:01:41.377 INFO:tasks.rados.rados.2.smithi057.stdout:29: done (3 left) 2020-11-16T22:01:41.377 INFO:tasks.rados.rados.2.smithi057.stdout:30: done (2 left) 2020-11-16T22:01:41.377 INFO:tasks.rados.rados.2.smithi057.stdout:33: write initial oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.377 INFO:tasks.rados.rados.2.smithi057.stdout:33: seq_num 32 ranges {537824=473380,1806012=625998} 2020-11-16T22:01:41.378 INFO:tasks.rados.rados.2.smithi057.stdout:33: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 537824 to 1011204 tid 1 2020-11-16T22:01:41.378 INFO:tasks.rados.rados.2.smithi057.stdout:33: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1806012 to 2432010 tid 2 2020-11-16T22:01:41.378 INFO:tasks.rados.rados.2.smithi057.stdout:34: write initial oid 34 2020-11-16T22:01:41.379 INFO:tasks.rados.rados.2.smithi057.stdout:34: seq_num 33 ranges {554631=548629,1748141=486009} 2020-11-16T22:01:41.383 INFO:tasks.rados.rados.2.smithi057.stdout:34: writing smithi05720651-34 from 554631 to 1103260 tid 1 2020-11-16T22:01:41.390 INFO:tasks.rados.rados.2.smithi057.stdout:34: writing smithi05720651-34 from 1748141 to 2234150 tid 2 2020-11-16T22:01:41.390 INFO:tasks.rados.rados.2.smithi057.stdout:35: write initial oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.390 INFO:tasks.rados.rados.2.smithi057.stdout:35: seq_num 34 ranges {571438=623878,1806623=629667} 2020-11-16T22:01:41.397 INFO:tasks.rados.rados.2.smithi057.stdout:35: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 571438 to 1195316 tid 1 2020-11-16T22:01:41.404 INFO:tasks.rados.rados.2.smithi057.stdout:35: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1806623 to 2436290 tid 2 2020-11-16T22:01:41.404 INFO:tasks.rados.rados.2.smithi057.stdout:36: write initial oid 36 2020-11-16T22:01:41.404 INFO:tasks.rados.rados.2.smithi057.stdout:36: seq_num 35 ranges {588245=699127,1865105=489678} 2020-11-16T22:01:41.411 INFO:tasks.rados.rados.2.smithi057.stdout:36: writing smithi05720651-36 from 588245 to 1287372 tid 1 2020-11-16T22:01:41.417 INFO:tasks.rados.rados.2.smithi057.stdout:36: writing smithi05720651-36 from 1865105 to 2354783 tid 2 2020-11-16T22:01:41.418 INFO:tasks.rados.rados.2.smithi057.stdout:37: write initial oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.418 INFO:tasks.rados.rados.2.smithi057.stdout:37: seq_num 36 ranges {605052=774376,1923587=633336} 2020-11-16T22:01:41.426 INFO:tasks.rados.rados.2.smithi057.stdout:37: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 605052 to 1379428 tid 1 2020-11-16T22:01:41.433 INFO:tasks.rados.rados.2.smithi057.stdout:37: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1923587 to 2556923 tid 2 2020-11-16T22:01:41.433 INFO:tasks.rados.rados.2.smithi057.stdout:38: write initial oid 38 2020-11-16T22:01:41.433 INFO:tasks.rados.rados.2.smithi057.stdout:38: seq_num 37 ranges {621859=449625,1865716=756143} 2020-11-16T22:01:41.438 INFO:tasks.rados.rados.2.smithi057.stdout:38: writing smithi05720651-38 from 621859 to 1071484 tid 1 2020-11-16T22:01:41.448 INFO:tasks.rados.rados.2.smithi057.stdout:38: writing smithi05720651-38 from 1865716 to 2621859 tid 2 2020-11-16T22:01:41.448 INFO:tasks.rados.rados.2.smithi057.stdout:39: write initial oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.448 INFO:tasks.rados.rados.2.smithi057.stdout:39: seq_num 38 ranges {638666=524874,1924198=637005} 2020-11-16T22:01:41.454 INFO:tasks.rados.rados.2.smithi057.stdout:39: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 638666 to 1163540 tid 1 2020-11-16T22:01:41.462 INFO:tasks.rados.rados.2.smithi057.stdout:39: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1924198 to 2561203 tid 2 2020-11-16T22:01:41.462 INFO:tasks.rados.rados.2.smithi057.stdout:40: write initial oid 40 2020-11-16T22:01:41.462 INFO:tasks.rados.rados.2.smithi057.stdout:40: seq_num 39 ranges {655473=716476,2099033=556440} 2020-11-16T22:01:41.470 INFO:tasks.rados.rados.2.smithi057.stdout:40: writing smithi05720651-40 from 655473 to 1371949 tid 1 2020-11-16T22:01:41.477 INFO:tasks.rados.rados.2.smithi057.stdout:40: writing smithi05720651-40 from 2099033 to 2655473 tid 2 2020-11-16T22:01:41.477 INFO:tasks.rados.rados.2.smithi057.stdout:41: write initial oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.478 INFO:tasks.rados.rados.2.smithi057.stdout:41: seq_num 40 ranges {672280=791725,2157515=514765} 2020-11-16T22:01:41.485 INFO:tasks.rados.rados.2.smithi057.stdout:41: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 672280 to 1464005 tid 1 2020-11-16T22:01:41.493 INFO:tasks.rados.rados.2.smithi057.stdout:41: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2157515 to 2672280 tid 2 2020-11-16T22:01:41.493 INFO:tasks.rados.rados.2.smithi057.stdout:42: write initial oid 42 2020-11-16T22:01:41.493 INFO:tasks.rados.rados.2.smithi057.stdout:42: seq_num 41 ranges {689087=466974,1699644=784332} 2020-11-16T22:01:41.499 INFO:tasks.rados.rados.2.smithi057.stdout:42: writing smithi05720651-42 from 689087 to 1156061 tid 1 2020-11-16T22:01:41.507 INFO:tasks.rados.rados.2.smithi057.stdout:42: writing smithi05720651-42 from 1699644 to 2483976 tid 2 2020-11-16T22:01:41.507 INFO:tasks.rados.rados.2.smithi057.stdout:43: write initial oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.507 INFO:tasks.rados.rados.2.smithi057.stdout:43: seq_num 42 ranges {705894=542223,1758126=644343} 2020-11-16T22:01:41.514 INFO:tasks.rados.rados.2.smithi057.stdout:43: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 705894 to 1248117 tid 1 2020-11-16T22:01:41.521 INFO:tasks.rados.rados.2.smithi057.stdout:43: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1758126 to 2402469 tid 2 2020-11-16T22:01:41.521 INFO:tasks.rados.rados.2.smithi057.stdout:44: write initial oid 44 2020-11-16T22:01:41.521 INFO:tasks.rados.rados.2.smithi057.stdout:44: seq_num 43 ranges {722701=617472,1816608=788001} 2020-11-16T22:01:41.529 INFO:tasks.rados.rados.2.smithi057.stdout:44: writing smithi05720651-44 from 722701 to 1340173 tid 1 2020-11-16T22:01:41.536 INFO:tasks.rados.rados.2.smithi057.stdout:44: writing smithi05720651-44 from 1816608 to 2604609 tid 2 2020-11-16T22:01:41.536 INFO:tasks.rados.rados.2.smithi057.stdout:45: write initial oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.536 INFO:tasks.rados.rados.2.smithi057.stdout:45: seq_num 44 ranges {739508=692721,1875090=648012} 2020-11-16T22:01:41.544 INFO:tasks.rados.rados.2.smithi057.stdout:45: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 739508 to 1432229 tid 1 2020-11-16T22:01:41.551 INFO:tasks.rados.rados.2.smithi057.stdout:45: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1875090 to 2523102 tid 2 2020-11-16T22:01:41.551 INFO:tasks.rados.rados.2.smithi057.stdout:46: write initial oid 46 2020-11-16T22:01:41.551 INFO:tasks.rados.rados.2.smithi057.stdout:46: seq_num 45 ranges {756315=767970,1933572=791670} 2020-11-16T22:01:41.559 INFO:tasks.rados.rados.2.smithi057.stdout:46: writing smithi05720651-46 from 756315 to 1524285 tid 1 2020-11-16T22:01:41.566 INFO:tasks.rados.rados.2.smithi057.stdout:46: writing smithi05720651-46 from 1933572 to 2725242 tid 2 2020-11-16T22:01:41.567 INFO:tasks.rados.rados.2.smithi057.stdout: waiting on 16 2020-11-16T22:01:41.567 INFO:tasks.rados.rados.2.smithi057.stdout:32: finishing write tid 1 to smithi05720651-32 2020-11-16T22:01:41.567 INFO:tasks.rados.rados.2.smithi057.stdout:32: finishing write tid 2 to smithi05720651-32 2020-11-16T22:01:41.567 INFO:tasks.rados.rados.2.smithi057.stdout:32: finishing write tid 4 to smithi05720651-32 2020-11-16T22:01:41.567 INFO:tasks.rados.rados.2.smithi057.stdout:32: finishing write tid 5 to smithi05720651-32 2020-11-16T22:01:41.567 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 18 (ObjNum 31 snap 0 seq_num 31) dirty exists 2020-11-16T22:01:41.568 INFO:tasks.rados.rados.2.smithi057.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2020-11-16T22:01:41.568 INFO:tasks.rados.rados.2.smithi057.stdout:33: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.568 INFO:tasks.rados.rados.2.smithi057.stdout:32: done (15 left) 2020-11-16T22:01:41.568 INFO:tasks.rados.rados.2.smithi057.stdout:47: write initial oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.568 INFO:tasks.rados.rados.2.smithi057.stdout:47: seq_num 46 ranges {773122=559572,1992054=651681} 2020-11-16T22:01:41.575 INFO:tasks.rados.rados.2.smithi057.stdout:47: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 773122 to 1332694 tid 1 2020-11-16T22:01:41.582 INFO:tasks.rados.rados.2.smithi057.stdout:47: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1992054 to 2643735 tid 2 2020-11-16T22:01:41.583 INFO:tasks.rados.rados.2.smithi057.stdout: waiting on 16 2020-11-16T22:01:41.583 INFO:tasks.rados.rados.2.smithi057.stdout:33: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.583 INFO:tasks.rados.rados.2.smithi057.stdout:33: finishing write tid 4 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.583 INFO:tasks.rados.rados.2.smithi057.stdout:33: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.583 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3 (ObjNum 32 snap 0 seq_num 32) dirty exists 2020-11-16T22:01:41.583 INFO:tasks.rados.rados.2.smithi057.stdout:33: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 32 snap 0 seq_num 32) 2020-11-16T22:01:41.584 INFO:tasks.rados.rados.2.smithi057.stdout:34: finishing write tid 1 to smithi05720651-34 2020-11-16T22:01:41.584 INFO:tasks.rados.rados.2.smithi057.stdout:34: finishing write tid 2 to smithi05720651-34 2020-11-16T22:01:41.584 INFO:tasks.rados.rados.2.smithi057.stdout:34: finishing write tid 4 to smithi05720651-34 2020-11-16T22:01:41.584 INFO:tasks.rados.rados.2.smithi057.stdout:34: finishing write tid 5 to smithi05720651-34 2020-11-16T22:01:41.584 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 9 (ObjNum 33 snap 0 seq_num 33) dirty exists 2020-11-16T22:01:41.584 INFO:tasks.rados.rados.2.smithi057.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2020-11-16T22:01:41.584 INFO:tasks.rados.rados.2.smithi057.stdout:35: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.585 INFO:tasks.rados.rados.2.smithi057.stdout:35: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.585 INFO:tasks.rados.rados.2.smithi057.stdout:35: finishing write tid 4 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.585 INFO:tasks.rados.rados.2.smithi057.stdout:35: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.585 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 15 (ObjNum 34 snap 0 seq_num 34) dirty exists 2020-11-16T22:01:41.585 INFO:tasks.rados.rados.2.smithi057.stdout:35: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 34 snap 0 seq_num 34) 2020-11-16T22:01:41.585 INFO:tasks.rados.rados.2.smithi057.stdout:36: finishing write tid 1 to smithi05720651-36 2020-11-16T22:01:41.585 INFO:tasks.rados.rados.2.smithi057.stdout:36: finishing write tid 2 to smithi05720651-36 2020-11-16T22:01:41.586 INFO:tasks.rados.rados.2.smithi057.stdout:33: done (15 left) 2020-11-16T22:01:41.586 INFO:tasks.rados.rados.2.smithi057.stdout:34: done (14 left) 2020-11-16T22:01:41.586 INFO:tasks.rados.rados.2.smithi057.stdout:35: done (13 left) 2020-11-16T22:01:41.586 INFO:tasks.rados.rados.2.smithi057.stdout:48: write initial oid 48 2020-11-16T22:01:41.586 INFO:tasks.rados.rados.2.smithi057.stdout:48: seq_num 47 ranges {789929=634821,2050536=739393} 2020-11-16T22:01:41.590 INFO:tasks.rados.rados.2.smithi057.stdout:48: writing smithi05720651-48 from 789929 to 1424750 tid 1 2020-11-16T22:01:41.598 INFO:tasks.rados.rados.2.smithi057.stdout:48: writing smithi05720651-48 from 2050536 to 2789929 tid 2 2020-11-16T22:01:41.599 INFO:tasks.rados.rados.2.smithi057.stdout:49: write initial oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.599 INFO:tasks.rados.rados.2.smithi057.stdout:49: seq_num 48 ranges {406736=710070,1709018=655350} 2020-11-16T22:01:41.605 INFO:tasks.rados.rados.2.smithi057.stdout:49: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 406736 to 1116806 tid 1 2020-11-16T22:01:41.612 INFO:tasks.rados.rados.2.smithi057.stdout:49: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1709018 to 2364368 tid 2 2020-11-16T22:01:41.612 INFO:tasks.rados.rados.2.smithi057.stdout:50: write initial oid 50 2020-11-16T22:01:41.612 INFO:tasks.rados.rados.2.smithi057.stdout:50: seq_num 49 ranges {423543=785319,1767500=799008} 2020-11-16T22:01:41.619 INFO:tasks.rados.rados.2.smithi057.stdout:50: writing smithi05720651-50 from 423543 to 1208862 tid 1 2020-11-16T22:01:41.627 INFO:tasks.rados.rados.2.smithi057.stdout:50: writing smithi05720651-50 from 1767500 to 2566508 tid 2 2020-11-16T22:01:41.627 INFO:tasks.rados.rados.2.smithi057.stdout: waiting on 16 2020-11-16T22:01:41.628 INFO:tasks.rados.rados.2.smithi057.stdout:36: finishing write tid 4 to smithi05720651-36 2020-11-16T22:01:41.628 INFO:tasks.rados.rados.2.smithi057.stdout:36: finishing write tid 5 to smithi05720651-36 2020-11-16T22:01:41.628 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 12 (ObjNum 35 snap 0 seq_num 35) dirty exists 2020-11-16T22:01:41.628 INFO:tasks.rados.rados.2.smithi057.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2020-11-16T22:01:41.628 INFO:tasks.rados.rados.2.smithi057.stdout:31: finishing write tid 5 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.628 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3 (ObjNum 30 snap 0 seq_num 30) dirty exists 2020-11-16T22:01:41.628 INFO:tasks.rados.rados.2.smithi057.stdout:31: left oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 30 snap 0 seq_num 30) 2020-11-16T22:01:41.629 INFO:tasks.rados.rados.2.smithi057.stdout:37: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.629 INFO:tasks.rados.rados.2.smithi057.stdout:37: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.629 INFO:tasks.rados.rados.2.smithi057.stdout:31: done (15 left) 2020-11-16T22:01:41.629 INFO:tasks.rados.rados.2.smithi057.stdout:36: done (14 left) 2020-11-16T22:01:41.629 INFO:tasks.rados.rados.2.smithi057.stdout:51: write oid 16 current snap is 0 2020-11-16T22:01:41.629 INFO:tasks.rados.rados.2.smithi057.stdout:51: seq_num 50 ranges {440350=460568,1309629=542666,2323973=516377} 2020-11-16T22:01:41.632 INFO:tasks.rados.rados.2.smithi057.stdout:51: writing smithi05720651-16 from 440350 to 900918 tid 1 2020-11-16T22:01:41.637 INFO:tasks.rados.rados.2.smithi057.stdout:51: writing smithi05720651-16 from 1309629 to 1852295 tid 2 2020-11-16T22:01:41.644 INFO:tasks.rados.rados.2.smithi057.stdout:51: writing smithi05720651-16 from 2323973 to 2840350 tid 3 2020-11-16T22:01:41.644 INFO:tasks.rados.rados.2.smithi057.stdout:52: rollback oid 26 current snap is 0 2020-11-16T22:01:41.644 INFO:tasks.rados.rados.2.smithi057.stdout:52: done (15 left) 2020-11-16T22:01:41.644 INFO:tasks.rados.rados.2.smithi057.stdout:53: snap_create 2020-11-16T22:01:41.644 INFO:tasks.rados.rados.2.smithi057.stdout:37: finishing write tid 4 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.644 INFO:tasks.rados.rados.2.smithi057.stdout:38: finishing write tid 1 to smithi05720651-38 2020-11-16T22:01:41.645 INFO:tasks.rados.rados.2.smithi057.stdout:38: finishing write tid 2 to smithi05720651-38 2020-11-16T22:01:41.645 INFO:tasks.rados.rados.2.smithi057.stdout:38: finishing write tid 4 to smithi05720651-38 2020-11-16T22:01:41.645 INFO:tasks.rados.rados.2.smithi057.stdout:38: finishing write tid 5 to smithi05720651-38 2020-11-16T22:01:41.645 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 9 (ObjNum 37 snap 0 seq_num 37) dirty exists 2020-11-16T22:01:41.645 INFO:tasks.rados.rados.2.smithi057.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2020-11-16T22:01:41.645 INFO:tasks.rados.rados.2.smithi057.stdout:39: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.645 INFO:tasks.rados.rados.2.smithi057.stdout:39: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.646 INFO:tasks.rados.rados.2.smithi057.stdout:39: finishing write tid 4 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.646 INFO:tasks.rados.rados.2.smithi057.stdout:39: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.646 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 18 (ObjNum 38 snap 0 seq_num 38) dirty exists 2020-11-16T22:01:41.646 INFO:tasks.rados.rados.2.smithi057.stdout:39: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 38 snap 0 seq_num 38) 2020-11-16T22:01:41.646 INFO:tasks.rados.rados.2.smithi057.stdout:40: finishing write tid 1 to smithi05720651-40 2020-11-16T22:01:41.646 INFO:tasks.rados.rados.2.smithi057.stdout:40: finishing write tid 2 to smithi05720651-40 2020-11-16T22:01:41.646 INFO:tasks.rados.rados.2.smithi057.stdout:40: finishing write tid 4 to smithi05720651-40 2020-11-16T22:01:41.647 INFO:tasks.rados.rados.2.smithi057.stdout:40: finishing write tid 5 to smithi05720651-40 2020-11-16T22:01:41.647 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 21 (ObjNum 39 snap 0 seq_num 39) dirty exists 2020-11-16T22:01:41.647 INFO:tasks.rados.rados.2.smithi057.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2020-11-16T22:01:41.647 INFO:tasks.rados.rados.2.smithi057.stdout:41: finishing write tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.647 INFO:tasks.rados.rados.2.smithi057.stdout:41: finishing write tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.647 INFO:tasks.rados.rados.2.smithi057.stdout:42: finishing write tid 1 to smithi05720651-42 2020-11-16T22:01:41.647 INFO:tasks.rados.rados.2.smithi057.stdout:42: finishing write tid 2 to smithi05720651-42 2020-11-16T22:01:41.648 INFO:tasks.rados.rados.2.smithi057.stdout:42: finishing write tid 4 to smithi05720651-42 2020-11-16T22:01:41.648 INFO:tasks.rados.rados.2.smithi057.stdout:42: finishing write tid 5 to smithi05720651-42 2020-11-16T22:01:41.648 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 6 (ObjNum 41 snap 0 seq_num 41) dirty exists 2020-11-16T22:01:41.648 INFO:tasks.rados.rados.2.smithi057.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2020-11-16T22:01:41.648 INFO:tasks.rados.rados.2.smithi057.stdout:41: finishing write tid 4 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.648 INFO:tasks.rados.rados.2.smithi057.stdout:41: finishing write tid 5 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.648 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 15 (ObjNum 40 snap 0 seq_num 40) dirty exists 2020-11-16T22:01:41.649 INFO:tasks.rados.rados.2.smithi057.stdout:41: left oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 40 snap 0 seq_num 40) 2020-11-16T22:01:41.649 INFO:tasks.rados.rados.2.smithi057.stdout:44: finishing write tid 1 to smithi05720651-44 2020-11-16T22:01:41.649 INFO:tasks.rados.rados.2.smithi057.stdout:44: finishing write tid 2 to smithi05720651-44 2020-11-16T22:01:41.649 INFO:tasks.rados.rados.2.smithi057.stdout:44: finishing write tid 4 to smithi05720651-44 2020-11-16T22:01:41.649 INFO:tasks.rados.rados.2.smithi057.stdout:44: finishing write tid 5 to smithi05720651-44 2020-11-16T22:01:41.649 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 9 (ObjNum 43 snap 0 seq_num 43) dirty exists 2020-11-16T22:01:41.649 INFO:tasks.rados.rados.2.smithi057.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2020-11-16T22:01:41.649 INFO:tasks.rados.rados.2.smithi057.stdout:45: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.650 INFO:tasks.rados.rados.2.smithi057.stdout:45: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.650 INFO:tasks.rados.rados.2.smithi057.stdout:45: finishing write tid 4 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.650 INFO:tasks.rados.rados.2.smithi057.stdout:45: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.650 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 6 (ObjNum 44 snap 0 seq_num 44) dirty exists 2020-11-16T22:01:41.650 INFO:tasks.rados.rados.2.smithi057.stdout:45: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 44 snap 0 seq_num 44) 2020-11-16T22:01:41.650 INFO:tasks.rados.rados.2.smithi057.stdout:43: finishing write tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.651 INFO:tasks.rados.rados.2.smithi057.stdout:46: finishing write tid 1 to smithi05720651-46 2020-11-16T22:01:41.651 INFO:tasks.rados.rados.2.smithi057.stdout:43: finishing write tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.651 INFO:tasks.rados.rados.2.smithi057.stdout:43: finishing write tid 4 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.651 INFO:tasks.rados.rados.2.smithi057.stdout:43: finishing write tid 5 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.651 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 19 (ObjNum 42 snap 0 seq_num 42) dirty exists 2020-11-16T22:01:41.651 INFO:tasks.rados.rados.2.smithi057.stdout:43: left oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 42 snap 0 seq_num 42) 2020-11-16T22:01:41.651 INFO:tasks.rados.rados.2.smithi057.stdout:46: finishing write tid 2 to smithi05720651-46 2020-11-16T22:01:41.651 INFO:tasks.rados.rados.2.smithi057.stdout:47: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.652 INFO:tasks.rados.rados.2.smithi057.stdout:47: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.652 INFO:tasks.rados.rados.2.smithi057.stdout:47: finishing write tid 4 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.652 INFO:tasks.rados.rados.2.smithi057.stdout:47: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.652 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 24 (ObjNum 46 snap 0 seq_num 46) dirty exists 2020-11-16T22:01:41.652 INFO:tasks.rados.rados.2.smithi057.stdout:47: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 46 snap 0 seq_num 46) 2020-11-16T22:01:41.652 INFO:tasks.rados.rados.2.smithi057.stdout:48: finishing write tid 1 to smithi05720651-48 2020-11-16T22:01:41.652 INFO:tasks.rados.rados.2.smithi057.stdout:48: finishing write tid 2 to smithi05720651-48 2020-11-16T22:01:41.653 INFO:tasks.rados.rados.2.smithi057.stdout:48: finishing write tid 4 to smithi05720651-48 2020-11-16T22:01:41.653 INFO:tasks.rados.rados.2.smithi057.stdout:48: finishing write tid 5 to smithi05720651-48 2020-11-16T22:01:41.653 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 6 (ObjNum 47 snap 0 seq_num 47) dirty exists 2020-11-16T22:01:41.653 INFO:tasks.rados.rados.2.smithi057.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2020-11-16T22:01:41.653 INFO:tasks.rados.rados.2.smithi057.stdout:49: finishing write tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.653 INFO:tasks.rados.rados.2.smithi057.stdout:49: finishing write tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.653 INFO:tasks.rados.rados.2.smithi057.stdout:49: finishing write tid 4 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.654 INFO:tasks.rados.rados.2.smithi057.stdout:49: finishing write tid 5 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.654 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 15 (ObjNum 48 snap 0 seq_num 48) dirty exists 2020-11-16T22:01:41.654 INFO:tasks.rados.rados.2.smithi057.stdout:49: left oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 48 snap 0 seq_num 48) 2020-11-16T22:01:41.654 INFO:tasks.rados.rados.2.smithi057.stdout:50: finishing write tid 1 to smithi05720651-50 2020-11-16T22:01:41.654 INFO:tasks.rados.rados.2.smithi057.stdout:50: finishing write tid 2 to smithi05720651-50 2020-11-16T22:01:41.654 INFO:tasks.rados.rados.2.smithi057.stdout:50: finishing write tid 4 to smithi05720651-50 2020-11-16T22:01:41.654 INFO:tasks.rados.rados.2.smithi057.stdout:50: finishing write tid 5 to smithi05720651-50 2020-11-16T22:01:41.655 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 21 (ObjNum 49 snap 0 seq_num 49) dirty exists 2020-11-16T22:01:41.655 INFO:tasks.rados.rados.2.smithi057.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2020-11-16T22:01:41.655 INFO:tasks.rados.rados.2.smithi057.stdout:46: finishing write tid 4 to smithi05720651-46 2020-11-16T22:01:41.655 INFO:tasks.rados.rados.2.smithi057.stdout:46: finishing write tid 5 to smithi05720651-46 2020-11-16T22:01:41.655 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 21 (ObjNum 45 snap 0 seq_num 45) dirty exists 2020-11-16T22:01:41.655 INFO:tasks.rados.rados.2.smithi057.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2020-11-16T22:01:41.655 INFO:tasks.rados.rados.2.smithi057.stdout:51: finishing write tid 1 to smithi05720651-16 2020-11-16T22:01:41.656 INFO:tasks.rados.rados.2.smithi057.stdout:51: finishing write tid 2 to smithi05720651-16 2020-11-16T22:01:41.760 INFO:tasks.rados.rados.2.smithi057.stdout:37: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:41.760 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 6 (ObjNum 36 snap 0 seq_num 36) dirty exists 2020-11-16T22:01:41.760 INFO:tasks.rados.rados.2.smithi057.stdout:37: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 36 snap 0 seq_num 36) 2020-11-16T22:01:41.762 INFO:tasks.rados.rados.2.smithi057.stdout:51: finishing write tid 3 to smithi05720651-16 2020-11-16T22:01:41.950 INFO:tasks.rados.rados.2.smithi057.stdout:51: finishing write tid 5 to smithi05720651-16 2020-11-16T22:01:41.950 INFO:tasks.rados.rados.2.smithi057.stdout:51: finishing write tid 6 to smithi05720651-16 2020-11-16T22:01:41.951 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 25 (ObjNum 50 snap 0 seq_num 50) dirty exists 2020-11-16T22:01:41.951 INFO:tasks.rados.rados.2.smithi057.stdout:51: left oid 16 (ObjNum 50 snap 0 seq_num 50) 2020-11-16T22:01:41.954 INFO:tasks.rados.rados.2.smithi057.stdout:37: done (15 left) 2020-11-16T22:01:41.955 INFO:tasks.rados.rados.2.smithi057.stdout:38: done (14 left) 2020-11-16T22:01:41.955 INFO:tasks.rados.rados.2.smithi057.stdout:39: done (13 left) 2020-11-16T22:01:41.955 INFO:tasks.rados.rados.2.smithi057.stdout:40: done (12 left) 2020-11-16T22:01:41.955 INFO:tasks.rados.rados.2.smithi057.stdout:41: done (11 left) 2020-11-16T22:01:41.955 INFO:tasks.rados.rados.2.smithi057.stdout:42: done (10 left) 2020-11-16T22:01:41.955 INFO:tasks.rados.rados.2.smithi057.stdout:43: done (9 left) 2020-11-16T22:01:41.956 INFO:tasks.rados.rados.2.smithi057.stdout:44: done (8 left) 2020-11-16T22:01:41.956 INFO:tasks.rados.rados.2.smithi057.stdout:45: done (7 left) 2020-11-16T22:01:41.956 INFO:tasks.rados.rados.2.smithi057.stdout:46: done (6 left) 2020-11-16T22:01:41.956 INFO:tasks.rados.rados.2.smithi057.stdout:47: done (5 left) 2020-11-16T22:01:41.956 INFO:tasks.rados.rados.2.smithi057.stdout:48: done (4 left) 2020-11-16T22:01:41.956 INFO:tasks.rados.rados.2.smithi057.stdout:49: done (3 left) 2020-11-16T22:01:41.956 INFO:tasks.rados.rados.2.smithi057.stdout:50: done (2 left) 2020-11-16T22:01:41.957 INFO:tasks.rados.rados.2.smithi057.stdout:51: done (1 left) 2020-11-16T22:01:41.957 INFO:tasks.rados.rados.2.smithi057.stdout:53: done (0 left) 2020-11-16T22:01:41.957 INFO:tasks.rados.rados.2.smithi057.stdout:54: copy_from oid 46 from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 1 2020-11-16T22:01:41.957 INFO:tasks.rados.rados.2.smithi057.stdout:55: delete oid 42 current snap is 1 2020-11-16T22:01:41.960 INFO:tasks.rados.rados.2.smithi057.stdout:55: done (1 left) 2020-11-16T22:01:41.960 INFO:tasks.rados.rados.2.smithi057.stdout:56: copy_from oid 36 from oid 38 current snap is 1 2020-11-16T22:01:41.960 INFO:tasks.rados.rados.2.smithi057.stdout:57: snap_remove snap 0 2020-11-16T22:01:42.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:41 smithi016 bash[10302]: audit 2020-11-16T22:01:40.948689+0000 mon.a (mon.0) 697 : audit [INF] from='client.34682 ' entity='client.2' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2020-11-16T22:01:42.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:41 smithi016 bash[10302]: cluster 2020-11-16T22:01:40.948800+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e75: 12 total, 12 up, 12 in 2020-11-16T22:01:42.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:41 smithi195 bash[10218]: audit 2020-11-16T22:01:40.948689+0000 mon.a (mon.0) 697 : audit [INF] from='client.34682 ' entity='client.2' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2020-11-16T22:01:42.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:41 smithi195 bash[10218]: cluster 2020-11-16T22:01:40.948800+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e75: 12 total, 12 up, 12 in 2020-11-16T22:01:42.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:41 smithi057 bash[10301]: audit 2020-11-16T22:01:40.948689+0000 mon.a (mon.0) 697 : audit [INF] from='client.34682 ' entity='client.2' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2020-11-16T22:01:42.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:41 smithi057 bash[10301]: cluster 2020-11-16T22:01:40.948800+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e75: 12 total, 12 up, 12 in 2020-11-16T22:01:42.963 INFO:tasks.rados.rados.2.smithi057.stdout:57: done (2 left) 2020-11-16T22:01:42.963 INFO:tasks.rados.rados.2.smithi057.stdout:58: snap_create 2020-11-16T22:01:42.964 INFO:tasks.rados.rados.2.smithi057.stdout:54: finishing copy_from to smithi05720651-46 2020-11-16T22:01:42.964 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 6 (ObjNum 36 snap 0 seq_num 36) dirty exists 2020-11-16T22:01:42.964 INFO:tasks.rados.rados.2.smithi057.stdout:54: finishing copy_from racing read to smithi05720651-46 2020-11-16T22:01:42.964 INFO:tasks.rados.rados.2.smithi057.stdout:56: finishing copy_from to smithi05720651-36 2020-11-16T22:01:42.964 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 9 (ObjNum 37 snap 0 seq_num 37) dirty exists 2020-11-16T22:01:42.964 INFO:tasks.rados.rados.2.smithi057.stdout:56: finishing copy_from racing read to smithi05720651-36 2020-11-16T22:01:43.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:42 smithi016 bash[10302]: cluster 2020-11-16T22:01:41.561554+0000 mgr.x (mgr.24115) 272 : cluster [DBG] pgmap v277: 17 pgs: 17 active+clean; 0 B data, 67 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:43.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:42 smithi016 bash[10302]: cluster 2020-11-16T22:01:41.965079+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e76: 12 total, 12 up, 12 in 2020-11-16T22:01:43.349 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:01:42 smithi195 bash[18679]: debug 2020-11-16T22:01:42.965+0000 7f9943e00700 -1 osd.1 pg_epoch: 77 pg[2.4( v 76'8 (0'0,76'8] local-lis/les=71/72 n=3 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,0] r=0 lpr=71 crt=76'8 lcod 75'6 mlcod 75'6 active+clean+snaptrim trimq=[2~1]] removing snap head 2020-11-16T22:01:43.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:42 smithi195 bash[10218]: cluster 2020-11-16T22:01:41.561554+0000 mgr.x (mgr.24115) 272 : cluster [DBG] pgmap v277: 17 pgs: 17 active+clean; 0 B data, 67 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:43.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:42 smithi195 bash[10218]: cluster 2020-11-16T22:01:41.965079+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e76: 12 total, 12 up, 12 in 2020-11-16T22:01:43.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:42 smithi057 bash[10301]: cluster 2020-11-16T22:01:41.561554+0000 mgr.x (mgr.24115) 272 : cluster [DBG] pgmap v277: 17 pgs: 17 active+clean; 0 B data, 67 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:01:43.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:42 smithi057 bash[10301]: cluster 2020-11-16T22:01:41.965079+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e76: 12 total, 12 up, 12 in 2020-11-16T22:01:43.972 INFO:tasks.rados.rados.2.smithi057.stdout:54: done (2 left) 2020-11-16T22:01:43.973 INFO:tasks.rados.rados.2.smithi057.stdout:56: done (1 left) 2020-11-16T22:01:43.973 INFO:tasks.rados.rados.2.smithi057.stdout:58: done (0 left) 2020-11-16T22:01:43.973 INFO:tasks.rados.rados.2.smithi057.stdout:59: snap_remove snap 1 2020-11-16T22:01:44.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:43 smithi016 bash[10302]: cluster 2020-11-16T22:01:42.973758+0000 mon.a (mon.0) 700 : cluster [DBG] osdmap e77: 12 total, 12 up, 12 in 2020-11-16T22:01:44.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:43 smithi195 bash[10218]: cluster 2020-11-16T22:01:42.973758+0000 mon.a (mon.0) 700 : cluster [DBG] osdmap e77: 12 total, 12 up, 12 in 2020-11-16T22:01:44.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:43 smithi057 bash[10301]: cluster 2020-11-16T22:01:42.973758+0000 mon.a (mon.0) 700 : cluster [DBG] osdmap e77: 12 total, 12 up, 12 in 2020-11-16T22:01:44.974 INFO:tasks.rados.rados.2.smithi057.stdout:59: done (0 left) 2020-11-16T22:01:44.975 INFO:tasks.rados.rados.2.smithi057.stdout:60: write oid 46 current snap is 2 2020-11-16T22:01:44.975 INFO:tasks.rados.rados.2.smithi057.stdout:60: seq_num 52 ranges {473964=611066,1826593=546335,2778819=95145} 2020-11-16T22:01:44.988 INFO:tasks.rados.rados.2.smithi057.stdout:60: writing smithi05720651-46 from 473964 to 1085030 tid 1 2020-11-16T22:01:44.996 INFO:tasks.rados.rados.2.smithi057.stdout:60: writing smithi05720651-46 from 1826593 to 2372928 tid 2 2020-11-16T22:01:44.999 INFO:tasks.rados.rados.2.smithi057.stdout:60: writing smithi05720651-46 from 2778819 to 2873964 tid 3 2020-11-16T22:01:44.999 INFO:tasks.rados.rados.2.smithi057.stdout:61: read oid 28 snap -1 2020-11-16T22:01:44.999 INFO:tasks.rados.rados.2.smithi057.stdout:61: expect (ObjNum 27 snap 0 seq_num 27) 2020-11-16T22:01:44.999 INFO:tasks.rados.rados.2.smithi057.stdout:62: snap_create 2020-11-16T22:01:45.000 INFO:tasks.rados.rados.2.smithi057.stdout:60: finishing write tid 1 to smithi05720651-46 2020-11-16T22:01:45.003 INFO:tasks.rados.rados.2.smithi057.stdout:60: finishing write tid 2 to smithi05720651-46 2020-11-16T22:01:45.004 INFO:tasks.rados.rados.2.smithi057.stdout:60: finishing write tid 3 to smithi05720651-46 2020-11-16T22:01:45.004 INFO:tasks.rados.rados.2.smithi057.stdout:60: finishing write tid 5 to smithi05720651-46 2020-11-16T22:01:45.005 INFO:tasks.rados.rados.2.smithi057.stdout:60: finishing write tid 6 to smithi05720651-46 2020-11-16T22:01:45.005 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 33 (ObjNum 52 snap 2 seq_num 52) dirty exists 2020-11-16T22:01:45.006 INFO:tasks.rados.rados.2.smithi057.stdout:60: left oid 46 (ObjNum 52 snap 2 seq_num 52) 2020-11-16T22:01:45.006 INFO:tasks.rados.rados.2.smithi057.stdout:61: expect (ObjNum 27 snap 0 seq_num 27) 2020-11-16T22:01:45.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:44 smithi016 bash[10302]: cluster 2020-11-16T22:01:43.562275+0000 mgr.x (mgr.24115) 273 : cluster [DBG] pgmap v280: 17 pgs: 17 active+clean; 41 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 3.1 MiB/s wr, 18 op/s 2020-11-16T22:01:45.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:44 smithi016 bash[10302]: cluster 2020-11-16T22:01:43.982339+0000 mon.a (mon.0) 701 : cluster [DBG] osdmap e78: 12 total, 12 up, 12 in 2020-11-16T22:01:45.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:44 smithi195 bash[10218]: cluster 2020-11-16T22:01:43.562275+0000 mgr.x (mgr.24115) 273 : cluster [DBG] pgmap v280: 17 pgs: 17 active+clean; 41 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 3.1 MiB/s wr, 18 op/s 2020-11-16T22:01:45.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:44 smithi195 bash[10218]: cluster 2020-11-16T22:01:43.982339+0000 mon.a (mon.0) 701 : cluster [DBG] osdmap e78: 12 total, 12 up, 12 in 2020-11-16T22:01:45.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:44 smithi057 bash[10301]: cluster 2020-11-16T22:01:43.562275+0000 mgr.x (mgr.24115) 273 : cluster [DBG] pgmap v280: 17 pgs: 17 active+clean; 41 MiB data, 89 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 3.1 MiB/s wr, 18 op/s 2020-11-16T22:01:45.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:44 smithi057 bash[10301]: cluster 2020-11-16T22:01:43.982339+0000 mon.a (mon.0) 701 : cluster [DBG] osdmap e78: 12 total, 12 up, 12 in 2020-11-16T22:01:45.991 INFO:tasks.rados.rados.2.smithi057.stdout:60: done (2 left) 2020-11-16T22:01:45.992 INFO:tasks.rados.rados.2.smithi057.stdout:61: done (1 left) 2020-11-16T22:01:45.992 INFO:tasks.rados.rados.2.smithi057.stdout:62: done (0 left) 2020-11-16T22:01:45.992 INFO:tasks.rados.rados.2.smithi057.stdout:63: read oid 30 snap -1 2020-11-16T22:01:45.993 INFO:tasks.rados.rados.2.smithi057.stdout:63: expect (ObjNum 29 snap 0 seq_num 29) 2020-11-16T22:01:45.993 INFO:tasks.rados.rados.2.smithi057.stdout:64: read oid 12 snap -1 2020-11-16T22:01:45.993 INFO:tasks.rados.rados.2.smithi057.stdout:64: expect (ObjNum 11 snap 0 seq_num 11) 2020-11-16T22:01:45.993 INFO:tasks.rados.rados.2.smithi057.stdout:65: write oid 26 current snap is 3 2020-11-16T22:01:45.993 INFO:tasks.rados.rados.2.smithi057.stdout:65: seq_num 53 ranges {490771=686315,1885075=406346} 2020-11-16T22:01:46.004 INFO:tasks.rados.rados.2.smithi057.stdout:65: writing smithi05720651-26 from 490771 to 1177086 tid 1 2020-11-16T22:01:46.012 INFO:tasks.rados.rados.2.smithi057.stdout:65: writing smithi05720651-26 from 1885075 to 2291421 tid 2 2020-11-16T22:01:46.012 INFO:tasks.rados.rados.2.smithi057.stdout:66: write oid 6 current snap is 3 2020-11-16T22:01:46.013 INFO:tasks.rados.rados.2.smithi057.stdout:66: seq_num 54 ranges {507578=477917,1543557=550004,2833665=73913} 2020-11-16T22:01:46.018 INFO:tasks.rados.rados.2.smithi057.stdout:66: writing smithi05720651-6 from 507578 to 985495 tid 1 2020-11-16T22:01:46.024 INFO:tasks.rados.rados.2.smithi057.stdout:66: writing smithi05720651-6 from 1543557 to 2093561 tid 2 2020-11-16T22:01:46.029 INFO:tasks.rados.rados.2.smithi057.stdout:66: writing smithi05720651-6 from 2833665 to 2907578 tid 3 2020-11-16T22:01:46.029 INFO:tasks.rados.rados.2.smithi057.stdout:67: read oid 38 snap -1 2020-11-16T22:01:46.029 INFO:tasks.rados.rados.2.smithi057.stdout:67: expect (ObjNum 37 snap 0 seq_num 37) 2020-11-16T22:01:46.030 INFO:tasks.rados.rados.2.smithi057.stdout:68: read oid 46 snap -1 2020-11-16T22:01:46.030 INFO:tasks.rados.rados.2.smithi057.stdout:68: expect (ObjNum 52 snap 2 seq_num 52) 2020-11-16T22:01:46.030 INFO:tasks.rados.rados.2.smithi057.stdout:69: rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 3 2020-11-16T22:01:46.030 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 2 2020-11-16T22:01:46.030 INFO:tasks.rados.rados.2.smithi057.stdout:64: expect (ObjNum 11 snap 0 seq_num 11) 2020-11-16T22:01:46.100 INFO:tasks.rados.rados.2.smithi057.stdout:63: expect (ObjNum 29 snap 0 seq_num 29) 2020-11-16T22:01:46.178 INFO:tasks.rados.rados.2.smithi057.stdout:65: finishing write tid 1 to smithi05720651-26 2020-11-16T22:01:46.178 INFO:tasks.rados.rados.2.smithi057.stdout:65: finishing write tid 2 to smithi05720651-26 2020-11-16T22:01:46.178 INFO:tasks.rados.rados.2.smithi057.stdout:65: finishing write tid 4 to smithi05720651-26 2020-11-16T22:01:46.178 INFO:tasks.rados.rados.2.smithi057.stdout:65: finishing write tid 5 to smithi05720651-26 2020-11-16T22:01:46.179 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 28 (ObjNum 53 snap 3 seq_num 53) dirty exists 2020-11-16T22:01:46.179 INFO:tasks.rados.rados.2.smithi057.stdout:65: left oid 26 (ObjNum 53 snap 3 seq_num 53) 2020-11-16T22:01:46.179 INFO:tasks.rados.rados.2.smithi057.stdout:66: finishing write tid 1 to smithi05720651-6 2020-11-16T22:01:46.179 INFO:tasks.rados.rados.2.smithi057.stdout:63: done (6 left) 2020-11-16T22:01:46.180 INFO:tasks.rados.rados.2.smithi057.stdout:64: done (5 left) 2020-11-16T22:01:46.180 INFO:tasks.rados.rados.2.smithi057.stdout:65: done (4 left) 2020-11-16T22:01:46.180 INFO:tasks.rados.rados.2.smithi057.stdout:70: snap_create 2020-11-16T22:01:46.180 INFO:tasks.rados.rados.2.smithi057.stdout:66: finishing write tid 2 to smithi05720651-6 2020-11-16T22:01:46.180 INFO:tasks.rados.rados.2.smithi057.stdout:66: finishing write tid 3 to smithi05720651-6 2020-11-16T22:01:46.181 INFO:tasks.rados.rados.2.smithi057.stdout:66: finishing write tid 5 to smithi05720651-6 2020-11-16T22:01:46.181 INFO:tasks.rados.rados.2.smithi057.stdout:66: finishing write tid 6 to smithi05720651-6 2020-11-16T22:01:46.181 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 26 (ObjNum 54 snap 3 seq_num 54) dirty exists 2020-11-16T22:01:46.181 INFO:tasks.rados.rados.2.smithi057.stdout:66: left oid 6 (ObjNum 54 snap 3 seq_num 54) 2020-11-16T22:01:46.181 INFO:tasks.rados.rados.2.smithi057.stdout:68: expect (ObjNum 52 snap 2 seq_num 52) 2020-11-16T22:01:46.305 INFO:tasks.rados.rados.2.smithi057.stdout:69: finishing rollback tid 0 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:46.305 INFO:tasks.rados.rados.2.smithi057.stdout:69: finishing rollback tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:46.306 INFO:tasks.rados.rados.2.smithi057.stdout:69: finishing rollback tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:46.306 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 37 (ObjNum 4 snap 0 seq_num 4) dirty exists 2020-11-16T22:01:46.306 INFO:tasks.rados.rados.2.smithi057.stdout:67: expect (ObjNum 37 snap 0 seq_num 37) 2020-11-16T22:01:46.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:45 smithi016 bash[10302]: cluster 2020-11-16T22:01:44.983999+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e79: 12 total, 12 up, 12 in 2020-11-16T22:01:46.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:45 smithi195 bash[10218]: cluster 2020-11-16T22:01:44.983999+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e79: 12 total, 12 up, 12 in 2020-11-16T22:01:46.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:45 smithi057 bash[10301]: cluster 2020-11-16T22:01:44.983999+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e79: 12 total, 12 up, 12 in 2020-11-16T22:01:46.994 INFO:tasks.rados.rados.2.smithi057.stdout:66: done (4 left) 2020-11-16T22:01:46.995 INFO:tasks.rados.rados.2.smithi057.stdout:67: done (3 left) 2020-11-16T22:01:46.995 INFO:tasks.rados.rados.2.smithi057.stdout:68: done (2 left) 2020-11-16T22:01:46.996 INFO:tasks.rados.rados.2.smithi057.stdout:69: done (1 left) 2020-11-16T22:01:46.996 INFO:tasks.rados.rados.2.smithi057.stdout:70: done (0 left) 2020-11-16T22:01:46.996 INFO:tasks.rados.rados.2.smithi057.stdout:71: rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 4 2020-11-16T22:01:46.996 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 2 2020-11-16T22:01:46.996 INFO:tasks.rados.rados.2.smithi057.stdout:72: write oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 4 2020-11-16T22:01:46.997 INFO:tasks.rados.rados.2.smithi057.stdout:72: seq_num 55 ranges {524385=553166,1602039=410015,2577441=346944} 2020-11-16T22:01:47.006 INFO:tasks.rados.rados.2.smithi057.stdout:72: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 524385 to 1077551 tid 1 2020-11-16T22:01:47.013 INFO:tasks.rados.rados.2.smithi057.stdout:72: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1602039 to 2012054 tid 2 2020-11-16T22:01:47.018 INFO:tasks.rados.rados.2.smithi057.stdout:72: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2577441 to 2924385 tid 3 2020-11-16T22:01:47.019 INFO:tasks.rados.rados.2.smithi057.stdout:73: delete oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 4 2020-11-16T22:01:47.019 INFO:tasks.rados.rados.2.smithi057.stdout:71: finishing rollback tid 0 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:47.019 INFO:tasks.rados.rados.2.smithi057.stdout:71: finishing rollback tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:47.019 INFO:tasks.rados.rados.2.smithi057.stdout:71: finishing rollback tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:47.019 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 23 (ObjNum 48 snap 0 seq_num 48) dirty exists 2020-11-16T22:01:47.019 INFO:tasks.rados.rados.2.smithi057.stdout:72: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:47.020 INFO:tasks.rados.rados.2.smithi057.stdout:72: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:47.023 INFO:tasks.rados.rados.2.smithi057.stdout:72: finishing write tid 3 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:47.023 INFO:tasks.rados.rados.2.smithi057.stdout:72: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:47.023 INFO:tasks.rados.rados.2.smithi057.stdout:72: finishing write tid 6 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:47.023 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 28 (ObjNum 55 snap 4 seq_num 55) dirty exists 2020-11-16T22:01:47.023 INFO:tasks.rados.rados.2.smithi057.stdout:72: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 55 snap 4 seq_num 55) 2020-11-16T22:01:47.025 INFO:tasks.rados.rados.2.smithi057.stdout:71: done (2 left) 2020-11-16T22:01:47.026 INFO:tasks.rados.rados.2.smithi057.stdout:72: done (1 left) 2020-11-16T22:01:47.026 INFO:tasks.rados.rados.2.smithi057.stdout:73: done (0 left) 2020-11-16T22:01:47.026 INFO:tasks.rados.rados.2.smithi057.stdout:74: write (excl) oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 4 2020-11-16T22:01:47.026 INFO:tasks.rados.rados.2.smithi057.stdout:74: seq_num 57 ranges {557999=703664,1719003=413684,2632287=325712} 2020-11-16T22:01:47.033 INFO:tasks.rados.rados.2.smithi057.stdout:74: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 557999 to 1261663 tid 1 2020-11-16T22:01:47.038 INFO:tasks.rados.rados.2.smithi057.stdout:74: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1719003 to 2132687 tid 2 2020-11-16T22:01:47.043 INFO:tasks.rados.rados.2.smithi057.stdout:74: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2632287 to 2957999 tid 3 2020-11-16T22:01:47.043 INFO:tasks.rados.rados.2.smithi057.stdout:75: write (excl) oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 4 2020-11-16T22:01:47.044 INFO:tasks.rados.rados.2.smithi057.stdout:75: seq_num 58 ranges {574806=778913,2061132=557342} 2020-11-16T22:01:47.051 INFO:tasks.rados.rados.2.smithi057.stdout:75: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 574806 to 1353719 tid 1 2020-11-16T22:01:47.058 INFO:tasks.rados.rados.2.smithi057.stdout:75: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2061132 to 2618474 tid 2 2020-11-16T22:01:47.058 INFO:tasks.rados.rados.2.smithi057.stdout:76: snap_create 2020-11-16T22:01:47.059 INFO:tasks.rados.rados.2.smithi057.stdout:74: finishing write tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:47.059 INFO:tasks.rados.rados.2.smithi057.stdout:74: finishing write tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:47.059 INFO:tasks.rados.rados.2.smithi057.stdout:74: finishing write tid 3 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:47.059 INFO:tasks.rados.rados.2.smithi057.stdout:74: finishing write tid 5 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:47.059 INFO:tasks.rados.rados.2.smithi057.stdout:74: finishing write tid 6 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:47.059 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 42 (ObjNum 57 snap 4 seq_num 57) dirty exists 2020-11-16T22:01:47.060 INFO:tasks.rados.rados.2.smithi057.stdout:74: left oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 57 snap 4 seq_num 57) 2020-11-16T22:01:47.060 INFO:tasks.rados.rados.2.smithi057.stdout:75: finishing write tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:47.064 INFO:tasks.rados.rados.2.smithi057.stdout:75: finishing write tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:47.064 INFO:tasks.rados.rados.2.smithi057.stdout:75: finishing write tid 4 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:47.065 INFO:tasks.rados.rados.2.smithi057.stdout:75: finishing write tid 5 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:47.065 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 46 (ObjNum 58 snap 4 seq_num 58) dirty exists 2020-11-16T22:01:47.065 INFO:tasks.rados.rados.2.smithi057.stdout:75: left oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 58 snap 4 seq_num 58) 2020-11-16T22:01:47.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:47 smithi016 bash[10302]: cluster 2020-11-16T22:01:45.562935+0000 mgr.x (mgr.24115) 274 : cluster [DBG] pgmap v283: 17 pgs: 17 active+clean; 73 MiB data, 116 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.4 MiB/s wr, 32 op/s 2020-11-16T22:01:47.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:47 smithi016 bash[10302]: cluster 2020-11-16T22:01:46.001516+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e80: 12 total, 12 up, 12 in 2020-11-16T22:01:47.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:47 smithi195 bash[10218]: cluster 2020-11-16T22:01:45.562935+0000 mgr.x (mgr.24115) 274 : cluster [DBG] pgmap v283: 17 pgs: 17 active+clean; 73 MiB data, 116 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.4 MiB/s wr, 32 op/s 2020-11-16T22:01:47.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:47 smithi195 bash[10218]: cluster 2020-11-16T22:01:46.001516+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e80: 12 total, 12 up, 12 in 2020-11-16T22:01:47.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:47 smithi057 bash[10301]: cluster 2020-11-16T22:01:45.562935+0000 mgr.x (mgr.24115) 274 : cluster [DBG] pgmap v283: 17 pgs: 17 active+clean; 73 MiB data, 116 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 6.4 MiB/s wr, 32 op/s 2020-11-16T22:01:47.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:47 smithi057 bash[10301]: cluster 2020-11-16T22:01:46.001516+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e80: 12 total, 12 up, 12 in 2020-11-16T22:01:48.015 INFO:tasks.rados.rados.2.smithi057.stdout:74: done (2 left) 2020-11-16T22:01:48.016 INFO:tasks.rados.rados.2.smithi057.stdout:75: done (1 left) 2020-11-16T22:01:48.016 INFO:tasks.rados.rados.2.smithi057.stdout:76: done (0 left) 2020-11-16T22:01:48.016 INFO:tasks.rados.rados.2.smithi057.stdout:77: read oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:01:48.017 INFO:tasks.rados.rados.2.smithi057.stdout:77: expect (ObjNum 30 snap 0 seq_num 30) 2020-11-16T22:01:48.017 INFO:tasks.rados.rados.2.smithi057.stdout:78: delete oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 5 2020-11-16T22:01:48.022 INFO:tasks.rados.rados.2.smithi057.stdout:78: done (1 left) 2020-11-16T22:01:48.022 INFO:tasks.rados.rados.2.smithi057.stdout:79: rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 5 2020-11-16T22:01:48.023 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 3 2020-11-16T22:01:48.023 INFO:tasks.rados.rados.2.smithi057.stdout:80: copy_from oid 42 from oid 22 current snap is 5 2020-11-16T22:01:48.023 INFO:tasks.rados.rados.2.smithi057.stdout:81: write (excl) oid 40 current snap is 5 2020-11-16T22:01:48.023 INFO:tasks.rados.rados.2.smithi057.stdout:81: seq_num 60 ranges {608420=529411,1778096=561011,2881850=126570} 2020-11-16T22:01:48.036 INFO:tasks.rados.rados.2.smithi057.stdout:81: writing smithi05720651-40 from 608420 to 1137831 tid 1 2020-11-16T22:01:48.044 INFO:tasks.rados.rados.2.smithi057.stdout:81: writing smithi05720651-40 from 1778096 to 2339107 tid 2 2020-11-16T22:01:48.047 INFO:tasks.rados.rados.2.smithi057.stdout:81: writing smithi05720651-40 from 2881850 to 3008420 tid 3 2020-11-16T22:01:48.048 INFO:tasks.rados.rados.2.smithi057.stdout:82: write (excl) oid 28 current snap is 5 2020-11-16T22:01:48.048 INFO:tasks.rados.rados.2.smithi057.stdout:82: seq_num 61 ranges {625227=721013,1952931=704669} 2020-11-16T22:01:48.055 INFO:tasks.rados.rados.2.smithi057.stdout:82: writing smithi05720651-28 from 625227 to 1346240 tid 1 2020-11-16T22:01:48.063 INFO:tasks.rados.rados.2.smithi057.stdout:82: writing smithi05720651-28 from 1952931 to 2657600 tid 2 2020-11-16T22:01:48.063 INFO:tasks.rados.rados.2.smithi057.stdout:83: snap_create 2020-11-16T22:01:48.064 INFO:tasks.rados.rados.2.smithi057.stdout:79: finishing rollback tid 0 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:48.064 INFO:tasks.rados.rados.2.smithi057.stdout:79: finishing rollback tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:48.064 INFO:tasks.rados.rados.2.smithi057.stdout:79: finishing rollback tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:48.064 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 14 (ObjNum 8 snap 0 seq_num 8) dirty exists 2020-11-16T22:01:48.064 INFO:tasks.rados.rados.2.smithi057.stdout:81: finishing write tid 1 to smithi05720651-40 2020-11-16T22:01:48.064 INFO:tasks.rados.rados.2.smithi057.stdout:77: expect (ObjNum 30 snap 0 seq_num 30) 2020-11-16T22:01:48.139 INFO:tasks.rados.rados.2.smithi057.stdout:81: finishing write tid 2 to smithi05720651-40 2020-11-16T22:01:48.139 INFO:tasks.rados.rados.2.smithi057.stdout:81: finishing write tid 3 to smithi05720651-40 2020-11-16T22:01:48.139 INFO:tasks.rados.rados.2.smithi057.stdout:81: finishing write tid 5 to smithi05720651-40 2020-11-16T22:01:48.140 INFO:tasks.rados.rados.2.smithi057.stdout:81: finishing write tid 6 to smithi05720651-40 2020-11-16T22:01:48.140 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 33 (ObjNum 60 snap 5 seq_num 60) dirty exists 2020-11-16T22:01:48.140 INFO:tasks.rados.rados.2.smithi057.stdout:81: left oid 40 (ObjNum 60 snap 5 seq_num 60) 2020-11-16T22:01:48.140 INFO:tasks.rados.rados.2.smithi057.stdout:80: finishing copy_from to smithi05720651-42 2020-11-16T22:01:48.140 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 6 (ObjNum 21 snap 0 seq_num 21) dirty exists 2020-11-16T22:01:48.140 INFO:tasks.rados.rados.2.smithi057.stdout:80: finishing copy_from racing read to smithi05720651-42 2020-11-16T22:01:48.140 INFO:tasks.rados.rados.2.smithi057.stdout:82: finishing write tid 1 to smithi05720651-28 2020-11-16T22:01:48.141 INFO:tasks.rados.rados.2.smithi057.stdout:82: finishing write tid 2 to smithi05720651-28 2020-11-16T22:01:48.141 INFO:tasks.rados.rados.2.smithi057.stdout:82: finishing write tid 4 to smithi05720651-28 2020-11-16T22:01:48.141 INFO:tasks.rados.rados.2.smithi057.stdout:82: finishing write tid 5 to smithi05720651-28 2020-11-16T22:01:48.141 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 32 (ObjNum 61 snap 5 seq_num 61) dirty exists 2020-11-16T22:01:48.141 INFO:tasks.rados.rados.2.smithi057.stdout:82: left oid 28 (ObjNum 61 snap 5 seq_num 61) 2020-11-16T22:01:48.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:48 smithi016 bash[10302]: cluster 2020-11-16T22:01:47.004387+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e81: 12 total, 12 up, 12 in 2020-11-16T22:01:48.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:48 smithi195 bash[10218]: cluster 2020-11-16T22:01:47.004387+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e81: 12 total, 12 up, 12 in 2020-11-16T22:01:48.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:48 smithi057 bash[10301]: cluster 2020-11-16T22:01:47.004387+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e81: 12 total, 12 up, 12 in 2020-11-16T22:01:49.015 INFO:tasks.rados.rados.2.smithi057.stdout:77: done (5 left) 2020-11-16T22:01:49.015 INFO:tasks.rados.rados.2.smithi057.stdout:79: done (4 left) 2020-11-16T22:01:49.015 INFO:tasks.rados.rados.2.smithi057.stdout:80: done (3 left) 2020-11-16T22:01:49.015 INFO:tasks.rados.rados.2.smithi057.stdout:81: done (2 left) 2020-11-16T22:01:49.015 INFO:tasks.rados.rados.2.smithi057.stdout:82: done (1 left) 2020-11-16T22:01:49.016 INFO:tasks.rados.rados.2.smithi057.stdout:83: done (0 left) 2020-11-16T22:01:49.016 INFO:tasks.rados.rados.2.smithi057.stdout:84: snap_remove snap 5 2020-11-16T22:01:49.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:49 smithi016 bash[10302]: cluster 2020-11-16T22:01:48.022615+0000 mon.a (mon.0) 705 : cluster [DBG] osdmap e82: 12 total, 12 up, 12 in 2020-11-16T22:01:49.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:49 smithi016 bash[10302]: audit 2020-11-16T22:01:48.403352+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:01:48.400610\"}"}]: dispatch 2020-11-16T22:01:49.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:49 smithi016 bash[10302]: audit 2020-11-16T22:01:48.409259+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:01:48.400610\"}"}]': finished 2020-11-16T22:01:49.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:49 smithi016 bash[10302]: audit 2020-11-16T22:01:48.411749+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:01:49.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:49 smithi016 bash[10302]: audit 2020-11-16T22:01:48.416590+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:01:49.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:49 smithi195 bash[10218]: cluster 2020-11-16T22:01:48.022615+0000 mon.a (mon.0) 705 : cluster [DBG] osdmap e82: 12 total, 12 up, 12 in 2020-11-16T22:01:49.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:49 smithi195 bash[10218]: audit 2020-11-16T22:01:48.403352+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:01:48.400610\"}"}]: dispatch 2020-11-16T22:01:49.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:49 smithi195 bash[10218]: audit 2020-11-16T22:01:48.409259+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:01:48.400610\"}"}]': finished 2020-11-16T22:01:49.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:49 smithi195 bash[10218]: audit 2020-11-16T22:01:48.411749+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:01:49.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:49 smithi195 bash[10218]: audit 2020-11-16T22:01:48.416590+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:01:49.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:49 smithi057 bash[10301]: cluster 2020-11-16T22:01:48.022615+0000 mon.a (mon.0) 705 : cluster [DBG] osdmap e82: 12 total, 12 up, 12 in 2020-11-16T22:01:49.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:49 smithi057 bash[10301]: audit 2020-11-16T22:01:48.403352+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:01:48.400610\"}"}]: dispatch 2020-11-16T22:01:49.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:49 smithi057 bash[10301]: audit 2020-11-16T22:01:48.409259+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793003\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793244\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793541\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.793789\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:55:57.794025\", \"created\": \"2020-11-16T21:55:56.917880\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T21:55:57.794353\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:01:48.400610\"}"}]': finished 2020-11-16T22:01:49.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:49 smithi057 bash[10301]: audit 2020-11-16T22:01:48.411749+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:01:49.449 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:49 smithi057 bash[10301]: audit 2020-11-16T22:01:48.416590+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:01:50.039 INFO:tasks.rados.rados.2.smithi057.stdout:84: done (0 left) 2020-11-16T22:01:50.040 INFO:tasks.rados.rados.2.smithi057.stdout:85: read oid 12 snap -1 2020-11-16T22:01:50.040 INFO:tasks.rados.rados.2.smithi057.stdout:85: expect (ObjNum 11 snap 0 seq_num 11) 2020-11-16T22:01:50.040 INFO:tasks.rados.rados.2.smithi057.stdout:86: read oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:01:50.040 INFO:tasks.rados.rados.2.smithi057.stdout:86: expect (ObjNum 42 snap 0 seq_num 42) 2020-11-16T22:01:50.040 INFO:tasks.rados.rados.2.smithi057.stdout:87: snap_create 2020-11-16T22:01:50.053 INFO:tasks.rados.rados.2.smithi057.stdout:85: expect (ObjNum 11 snap 0 seq_num 11) 2020-11-16T22:01:50.125 INFO:tasks.rados.rados.2.smithi057.stdout:86: expect (ObjNum 42 snap 0 seq_num 42) 2020-11-16T22:01:50.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:50 smithi016 bash[10302]: cluster 2020-11-16T22:01:49.026494+0000 mon.a (mon.0) 710 : cluster [DBG] osdmap e83: 12 total, 12 up, 12 in 2020-11-16T22:01:50.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:50 smithi195 bash[10218]: cluster 2020-11-16T22:01:49.026494+0000 mon.a (mon.0) 710 : cluster [DBG] osdmap e83: 12 total, 12 up, 12 in 2020-11-16T22:01:50.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:50 smithi057 bash[10301]: cluster 2020-11-16T22:01:49.026494+0000 mon.a (mon.0) 710 : cluster [DBG] osdmap e83: 12 total, 12 up, 12 in 2020-11-16T22:01:51.056 INFO:tasks.rados.rados.2.smithi057.stdout:85: done (2 left) 2020-11-16T22:01:51.057 INFO:tasks.rados.rados.2.smithi057.stdout:86: done (1 left) 2020-11-16T22:01:51.057 INFO:tasks.rados.rados.2.smithi057.stdout:87: done (0 left) 2020-11-16T22:01:51.057 INFO:tasks.rados.rados.2.smithi057.stdout:88: snap_remove snap 2 2020-11-16T22:01:51.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:51 smithi016 bash[10302]: cluster 2020-11-16T22:01:49.564539+0000 mgr.x (mgr.24115) 276 : cluster [DBG] pgmap v289: 17 pgs: 17 active+clean; 115 MiB data, 189 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.4 MiB/s wr, 31 op/s 2020-11-16T22:01:51.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:51 smithi016 bash[10302]: cluster 2020-11-16T22:01:50.051283+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e84: 12 total, 12 up, 12 in 2020-11-16T22:01:51.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:51 smithi195 bash[10218]: cluster 2020-11-16T22:01:49.564539+0000 mgr.x (mgr.24115) 276 : cluster [DBG] pgmap v289: 17 pgs: 17 active+clean; 115 MiB data, 189 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.4 MiB/s wr, 31 op/s 2020-11-16T22:01:51.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:51 smithi195 bash[10218]: cluster 2020-11-16T22:01:50.051283+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e84: 12 total, 12 up, 12 in 2020-11-16T22:01:51.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:51 smithi057 bash[10301]: cluster 2020-11-16T22:01:49.564539+0000 mgr.x (mgr.24115) 276 : cluster [DBG] pgmap v289: 17 pgs: 17 active+clean; 115 MiB data, 189 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 6.4 MiB/s wr, 31 op/s 2020-11-16T22:01:51.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:51 smithi057 bash[10301]: cluster 2020-11-16T22:01:50.051283+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e84: 12 total, 12 up, 12 in 2020-11-16T22:01:52.069 INFO:tasks.rados.rados.2.smithi057.stdout:88: done (0 left) 2020-11-16T22:01:52.069 INFO:tasks.rados.rados.2.smithi057.stdout:89: snap_create 2020-11-16T22:01:52.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:52 smithi016 bash[10302]: cluster 2020-11-16T22:01:51.063751+0000 mon.a (mon.0) 712 : cluster [DBG] osdmap e85: 12 total, 12 up, 12 in 2020-11-16T22:01:52.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:52 smithi195 bash[10218]: cluster 2020-11-16T22:01:51.063751+0000 mon.a (mon.0) 712 : cluster [DBG] osdmap e85: 12 total, 12 up, 12 in 2020-11-16T22:01:52.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:52 smithi057 bash[10301]: cluster 2020-11-16T22:01:51.063751+0000 mon.a (mon.0) 712 : cluster [DBG] osdmap e85: 12 total, 12 up, 12 in 2020-11-16T22:01:53.068 INFO:tasks.rados.rados.2.smithi057.stdout:89: done (0 left) 2020-11-16T22:01:53.069 INFO:tasks.rados.rados.2.smithi057.stdout:90: write (excl) oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 8 2020-11-16T22:01:53.069 INFO:tasks.rados.rados.2.smithi057.stdout:90: seq_num 62 ranges {642034=796262,1895060=564680} 2020-11-16T22:01:53.085 INFO:tasks.rados.rados.2.smithi057.stdout:90: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 642034 to 1438296 tid 1 2020-11-16T22:01:53.091 INFO:tasks.rados.rados.2.smithi057.stdout:90: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1895060 to 2459740 tid 2 2020-11-16T22:01:53.092 INFO:tasks.rados.rados.2.smithi057.stdout:91: read oid 44 snap 7 2020-11-16T22:01:53.092 INFO:tasks.rados.rados.2.smithi057.stdout:91: expect (ObjNum 43 snap 0 seq_num 43) 2020-11-16T22:01:53.092 INFO:tasks.rados.rados.2.smithi057.stdout:92: copy_from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 8 2020-11-16T22:01:53.092 INFO:tasks.rados.rados.2.smithi057.stdout:93: snap_create 2020-11-16T22:01:53.097 INFO:tasks.rados.rados.2.smithi057.stdout:91: expect (ObjNum 43 snap 0 seq_num 43) 2020-11-16T22:01:53.183 INFO:tasks.rados.rados.2.smithi057.stdout:90: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:53.183 INFO:tasks.rados.rados.2.smithi057.stdout:90: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:53.183 INFO:tasks.rados.rados.2.smithi057.stdout:90: finishing write tid 4 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:53.184 INFO:tasks.rados.rados.2.smithi057.stdout:90: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:53.184 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 13 (ObjNum 62 snap 8 seq_num 62) dirty exists 2020-11-16T22:01:53.184 INFO:tasks.rados.rados.2.smithi057.stdout:90: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 62 snap 8 seq_num 62) 2020-11-16T22:01:53.184 INFO:tasks.rados.rados.2.smithi057.stdout:92: finishing copy_from to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:53.184 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 15 (ObjNum 34 snap 0 seq_num 34) dirty exists 2020-11-16T22:01:53.184 INFO:tasks.rados.rados.2.smithi057.stdout:92: finishing copy_from racing read to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:53.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:53 smithi016 bash[10302]: cluster 2020-11-16T22:01:51.565271+0000 mgr.x (mgr.24115) 277 : cluster [DBG] pgmap v292: 17 pgs: 17 active+clean; 126 MiB data, 203 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 26 op/s 2020-11-16T22:01:53.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:53 smithi016 bash[10302]: cluster 2020-11-16T22:01:52.073020+0000 mon.a (mon.0) 713 : cluster [DBG] osdmap e86: 12 total, 12 up, 12 in 2020-11-16T22:01:53.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:53 smithi195 bash[10218]: cluster 2020-11-16T22:01:51.565271+0000 mgr.x (mgr.24115) 277 : cluster [DBG] pgmap v292: 17 pgs: 17 active+clean; 126 MiB data, 203 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 26 op/s 2020-11-16T22:01:53.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:53 smithi195 bash[10218]: cluster 2020-11-16T22:01:52.073020+0000 mon.a (mon.0) 713 : cluster [DBG] osdmap e86: 12 total, 12 up, 12 in 2020-11-16T22:01:53.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:53 smithi057 bash[10301]: cluster 2020-11-16T22:01:51.565271+0000 mgr.x (mgr.24115) 277 : cluster [DBG] pgmap v292: 17 pgs: 17 active+clean; 126 MiB data, 203 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 26 op/s 2020-11-16T22:01:53.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:53 smithi057 bash[10301]: cluster 2020-11-16T22:01:52.073020+0000 mon.a (mon.0) 713 : cluster [DBG] osdmap e86: 12 total, 12 up, 12 in 2020-11-16T22:01:54.084 INFO:tasks.rados.rados.2.smithi057.stdout:90: done (3 left) 2020-11-16T22:01:54.085 INFO:tasks.rados.rados.2.smithi057.stdout:91: done (2 left) 2020-11-16T22:01:54.085 INFO:tasks.rados.rados.2.smithi057.stdout:92: done (1 left) 2020-11-16T22:01:54.085 INFO:tasks.rados.rados.2.smithi057.stdout:93: done (0 left) 2020-11-16T22:01:54.085 INFO:tasks.rados.rados.2.smithi057.stdout:94: snap_remove snap 6 2020-11-16T22:01:54.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:54 smithi016 bash[10302]: cluster 2020-11-16T22:01:53.075417+0000 mon.a (mon.0) 714 : cluster [DBG] osdmap e87: 12 total, 12 up, 12 in 2020-11-16T22:01:54.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:54 smithi195 bash[10218]: cluster 2020-11-16T22:01:53.075417+0000 mon.a (mon.0) 714 : cluster [DBG] osdmap e87: 12 total, 12 up, 12 in 2020-11-16T22:01:54.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:54 smithi057 bash[10301]: cluster 2020-11-16T22:01:53.075417+0000 mon.a (mon.0) 714 : cluster [DBG] osdmap e87: 12 total, 12 up, 12 in 2020-11-16T22:01:54.858 INFO:tasks.rados.rados.2.smithi057.stdout:94: done (0 left) 2020-11-16T22:01:54.858 INFO:tasks.rados.rados.2.smithi057.stdout:95: snap_remove snap 8 2020-11-16T22:01:55.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:55 smithi016 bash[10302]: cluster 2020-11-16T22:01:53.565798+0000 mgr.x (mgr.24115) 278 : cluster [DBG] pgmap v295: 17 pgs: 17 active+clean; 126 MiB data, 206 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 26 op/s 2020-11-16T22:01:55.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:55 smithi016 bash[10302]: cluster 2020-11-16T22:01:54.095770+0000 mon.a (mon.0) 715 : cluster [DBG] osdmap e88: 12 total, 12 up, 12 in 2020-11-16T22:01:55.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:55 smithi016 bash[10302]: cluster 2020-11-16T22:01:54.868042+0000 mon.a (mon.0) 716 : cluster [DBG] osdmap e89: 12 total, 12 up, 12 in 2020-11-16T22:01:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:55 smithi195 bash[10218]: cluster 2020-11-16T22:01:53.565798+0000 mgr.x (mgr.24115) 278 : cluster [DBG] pgmap v295: 17 pgs: 17 active+clean; 126 MiB data, 206 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 26 op/s 2020-11-16T22:01:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:55 smithi195 bash[10218]: cluster 2020-11-16T22:01:54.095770+0000 mon.a (mon.0) 715 : cluster [DBG] osdmap e88: 12 total, 12 up, 12 in 2020-11-16T22:01:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:55 smithi195 bash[10218]: cluster 2020-11-16T22:01:54.868042+0000 mon.a (mon.0) 716 : cluster [DBG] osdmap e89: 12 total, 12 up, 12 in 2020-11-16T22:01:55.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:55 smithi057 bash[10301]: cluster 2020-11-16T22:01:53.565798+0000 mgr.x (mgr.24115) 278 : cluster [DBG] pgmap v295: 17 pgs: 17 active+clean; 126 MiB data, 206 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 26 op/s 2020-11-16T22:01:55.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:55 smithi057 bash[10301]: cluster 2020-11-16T22:01:54.095770+0000 mon.a (mon.0) 715 : cluster [DBG] osdmap e88: 12 total, 12 up, 12 in 2020-11-16T22:01:55.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:55 smithi057 bash[10301]: cluster 2020-11-16T22:01:54.868042+0000 mon.a (mon.0) 716 : cluster [DBG] osdmap e89: 12 total, 12 up, 12 in 2020-11-16T22:01:55.869 INFO:tasks.rados.rados.2.smithi057.stdout:95: done (0 left) 2020-11-16T22:01:55.869 INFO:tasks.rados.rados.2.smithi057.stdout:96: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:01:55.870 INFO:tasks.rados.rados.2.smithi057.stdout:96: expect (ObjNum 22 snap 0 seq_num 22) 2020-11-16T22:01:55.870 INFO:tasks.rados.rados.2.smithi057.stdout:97: rollback oid 6 current snap is 9 2020-11-16T22:01:55.870 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 6 to 7 2020-11-16T22:01:55.870 INFO:tasks.rados.rados.2.smithi057.stdout:98: snap_remove snap 4 2020-11-16T22:01:56.870 INFO:tasks.rados.rados.2.smithi057.stdout:98: done (2 left) 2020-11-16T22:01:56.870 INFO:tasks.rados.rados.2.smithi057.stdout:99: write oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 9 2020-11-16T22:01:56.871 INFO:tasks.rados.rados.2.smithi057.stdout:99: seq_num 63 ranges {658841=471511,1553542=708338,2964119=94722} 2020-11-16T22:01:56.881 INFO:tasks.rados.rados.2.smithi057.stdout:99: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 658841 to 1130352 tid 1 2020-11-16T22:01:56.889 INFO:tasks.rados.rados.2.smithi057.stdout:99: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1553542 to 2261880 tid 2 2020-11-16T22:01:56.894 INFO:tasks.rados.rados.2.smithi057.stdout:99: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2964119 to 3058841 tid 3 2020-11-16T22:01:56.894 INFO:tasks.rados.rados.2.smithi057.stdout:100: snap_create 2020-11-16T22:01:56.894 INFO:tasks.rados.rados.2.smithi057.stdout:97: finishing rollback tid 0 to smithi05720651-6 2020-11-16T22:01:56.894 INFO:tasks.rados.rados.2.smithi057.stdout:97: finishing rollback tid 1 to smithi05720651-6 2020-11-16T22:01:56.894 INFO:tasks.rados.rados.2.smithi057.stdout:97: finishing rollback tid 2 to smithi05720651-6 2020-11-16T22:01:56.895 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 32 (ObjNum 54 snap 3 seq_num 54) dirty exists 2020-11-16T22:01:56.895 INFO:tasks.rados.rados.2.smithi057.stdout:96: expect (ObjNum 22 snap 0 seq_num 22) 2020-11-16T22:01:56.973 INFO:tasks.rados.rados.2.smithi057.stdout:99: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:56.973 INFO:tasks.rados.rados.2.smithi057.stdout:99: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:56.973 INFO:tasks.rados.rados.2.smithi057.stdout:99: finishing write tid 3 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:56.974 INFO:tasks.rados.rados.2.smithi057.stdout:99: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:56.974 INFO:tasks.rados.rados.2.smithi057.stdout:99: finishing write tid 6 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:56.974 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 14 (ObjNum 63 snap 9 seq_num 63) dirty exists 2020-11-16T22:01:56.974 INFO:tasks.rados.rados.2.smithi057.stdout:99: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 63 snap 9 seq_num 63) 2020-11-16T22:01:57.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:56 smithi057 bash[10301]: cluster 2020-11-16T22:01:55.566426+0000 mgr.x (mgr.24115) 279 : cluster [DBG] pgmap v298: 17 pgs: 17 active+clean; 129 MiB data, 207 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 332 KiB/s wr, 5 op/s 2020-11-16T22:01:57.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:56 smithi057 bash[10301]: cluster 2020-11-16T22:01:55.878136+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e90: 12 total, 12 up, 12 in 2020-11-16T22:01:57.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:56 smithi016 bash[10302]: cluster 2020-11-16T22:01:55.566426+0000 mgr.x (mgr.24115) 279 : cluster [DBG] pgmap v298: 17 pgs: 17 active+clean; 129 MiB data, 207 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 332 KiB/s wr, 5 op/s 2020-11-16T22:01:57.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:56 smithi016 bash[10302]: cluster 2020-11-16T22:01:55.878136+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e90: 12 total, 12 up, 12 in 2020-11-16T22:01:57.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:56 smithi195 bash[10218]: cluster 2020-11-16T22:01:55.566426+0000 mgr.x (mgr.24115) 279 : cluster [DBG] pgmap v298: 17 pgs: 17 active+clean; 129 MiB data, 207 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 332 KiB/s wr, 5 op/s 2020-11-16T22:01:57.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:56 smithi195 bash[10218]: cluster 2020-11-16T22:01:55.878136+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e90: 12 total, 12 up, 12 in 2020-11-16T22:01:57.887 INFO:tasks.rados.rados.2.smithi057.stdout:96: done (3 left) 2020-11-16T22:01:57.887 INFO:tasks.rados.rados.2.smithi057.stdout:97: done (2 left) 2020-11-16T22:01:57.888 INFO:tasks.rados.rados.2.smithi057.stdout:99: done (1 left) 2020-11-16T22:01:57.888 INFO:tasks.rados.rados.2.smithi057.stdout:100: done (0 left) 2020-11-16T22:01:57.888 INFO:tasks.rados.rados.2.smithi057.stdout:101: copy_from oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 10 2020-11-16T22:01:57.888 INFO:tasks.rados.rados.2.smithi057.stdout:102: rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 10 2020-11-16T22:01:57.888 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 3 2020-11-16T22:01:57.888 INFO:tasks.rados.rados.2.smithi057.stdout:103: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:01:57.889 INFO:tasks.rados.rados.2.smithi057.stdout:103: expect (ObjNum 62 snap 8 seq_num 62) 2020-11-16T22:01:57.889 INFO:tasks.rados.rados.2.smithi057.stdout:104: delete oid 16 current snap is 10 2020-11-16T22:01:57.893 INFO:tasks.rados.rados.2.smithi057.stdout:104: done (3 left) 2020-11-16T22:01:57.893 INFO:tasks.rados.rados.2.smithi057.stdout:105: write oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 10 2020-11-16T22:01:57.894 INFO:tasks.rados.rados.2.smithi057.stdout:105: seq_num 65 ranges {692455=622009,2070506=712007} 2020-11-16T22:01:57.907 INFO:tasks.rados.rados.2.smithi057.stdout:105: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 692455 to 1314464 tid 1 2020-11-16T22:01:57.915 INFO:tasks.rados.rados.2.smithi057.stdout:105: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2070506 to 2782513 tid 2 2020-11-16T22:01:57.915 INFO:tasks.rados.rados.2.smithi057.stdout:106: read oid 38 snap -1 2020-11-16T22:01:57.915 INFO:tasks.rados.rados.2.smithi057.stdout:106: expect (ObjNum 37 snap 0 seq_num 37) 2020-11-16T22:01:57.916 INFO:tasks.rados.rados.2.smithi057.stdout:107: snap_remove snap 9 2020-11-16T22:01:57.916 INFO:tasks.rados.rados.2.smithi057.stdout:102: finishing rollback tid 0 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:58.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:57 smithi057 bash[10301]: cluster 2020-11-16T22:01:56.880895+0000 mon.a (mon.0) 718 : cluster [DBG] osdmap e91: 12 total, 12 up, 12 in 2020-11-16T22:01:58.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:57 smithi016 bash[10302]: cluster 2020-11-16T22:01:56.880895+0000 mon.a (mon.0) 718 : cluster [DBG] osdmap e91: 12 total, 12 up, 12 in 2020-11-16T22:01:58.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:57 smithi195 bash[10218]: cluster 2020-11-16T22:01:56.880895+0000 mon.a (mon.0) 718 : cluster [DBG] osdmap e91: 12 total, 12 up, 12 in 2020-11-16T22:01:58.899 INFO:tasks.rados.rados.2.smithi057.stdout:107: done (5 left) 2020-11-16T22:01:58.900 INFO:tasks.rados.rados.2.smithi057.stdout:108: read oid 2 snap -1 2020-11-16T22:01:58.900 INFO:tasks.rados.rados.2.smithi057.stdout:108: expect (ObjNum 1 snap 0 seq_num 1) 2020-11-16T22:01:58.900 INFO:tasks.rados.rados.2.smithi057.stdout:109: read oid 6 snap 7 2020-11-16T22:01:58.900 INFO:tasks.rados.rados.2.smithi057.stdout:109: expect (ObjNum 54 snap 3 seq_num 54) 2020-11-16T22:01:58.900 INFO:tasks.rados.rados.2.smithi057.stdout:110: copy_from oid 40 from oid 4 current snap is 10 2020-11-16T22:01:58.900 INFO:tasks.rados.rados.2.smithi057.stdout:102: finishing rollback tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:58.901 INFO:tasks.rados.rados.2.smithi057.stdout:102: finishing rollback tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:58.901 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 18 (ObjNum 16 snap 0 seq_num 16) dirty exists 2020-11-16T22:01:58.901 INFO:tasks.rados.rados.2.smithi057.stdout:102: done (7 left) 2020-11-16T22:01:58.901 INFO:tasks.rados.rados.2.smithi057.stdout:111: snap_remove snap 3 2020-11-16T22:01:59.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:58 smithi057 bash[10301]: cluster 2020-11-16T22:01:57.567130+0000 mgr.x (mgr.24115) 280 : cluster [DBG] pgmap v301: 17 pgs: 17 active+clean; 129 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 960 KiB/s wr, 8 op/s 2020-11-16T22:01:59.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:58 smithi057 bash[10301]: cluster 2020-11-16T22:01:57.897359+0000 mon.a (mon.0) 719 : cluster [DBG] osdmap e92: 12 total, 12 up, 12 in 2020-11-16T22:01:59.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:58 smithi016 bash[10302]: cluster 2020-11-16T22:01:57.567130+0000 mgr.x (mgr.24115) 280 : cluster [DBG] pgmap v301: 17 pgs: 17 active+clean; 129 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 960 KiB/s wr, 8 op/s 2020-11-16T22:01:59.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:58 smithi016 bash[10302]: cluster 2020-11-16T22:01:57.897359+0000 mon.a (mon.0) 719 : cluster [DBG] osdmap e92: 12 total, 12 up, 12 in 2020-11-16T22:01:59.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:58 smithi195 bash[10218]: cluster 2020-11-16T22:01:57.567130+0000 mgr.x (mgr.24115) 280 : cluster [DBG] pgmap v301: 17 pgs: 17 active+clean; 129 MiB data, 211 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 960 KiB/s wr, 8 op/s 2020-11-16T22:01:59.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:58 smithi195 bash[10218]: cluster 2020-11-16T22:01:57.897359+0000 mon.a (mon.0) 719 : cluster [DBG] osdmap e92: 12 total, 12 up, 12 in 2020-11-16T22:01:59.863 INFO:tasks.rados.rados.2.smithi057.stdout:111: done (7 left) 2020-11-16T22:01:59.864 INFO:tasks.rados.rados.2.smithi057.stdout:112: read oid 18 snap -1 2020-11-16T22:01:59.864 INFO:tasks.rados.rados.2.smithi057.stdout:112: expect (ObjNum 17 snap 0 seq_num 17) 2020-11-16T22:01:59.864 INFO:tasks.rados.rados.2.smithi057.stdout:113: write (excl) oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 10 2020-11-16T22:01:59.864 INFO:tasks.rados.rados.2.smithi057.stdout:113: seq_num 66 ranges {709262=697258,2012635=572018,3046388=62874} 2020-11-16T22:01:59.875 INFO:tasks.rados.rados.2.smithi057.stdout:113: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 709262 to 1406520 tid 1 2020-11-16T22:01:59.882 INFO:tasks.rados.rados.2.smithi057.stdout:113: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2012635 to 2584653 tid 2 2020-11-16T22:01:59.886 INFO:tasks.rados.rados.2.smithi057.stdout:113: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3046388 to 3109262 tid 3 2020-11-16T22:01:59.886 INFO:tasks.rados.rados.2.smithi057.stdout:114: snap_create 2020-11-16T22:01:59.886 INFO:tasks.rados.rados.2.smithi057.stdout:103: expect (ObjNum 62 snap 8 seq_num 62) 2020-11-16T22:01:59.981 INFO:tasks.rados.rados.2.smithi057.stdout:101: finishing copy_from to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:59.982 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 6 (ObjNum 6 snap 0 seq_num 6) dirty exists 2020-11-16T22:01:59.982 INFO:tasks.rados.rados.2.smithi057.stdout:101: finishing copy_from racing read to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:59.982 INFO:tasks.rados.rados.2.smithi057.stdout:105: finishing write tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:59.982 INFO:tasks.rados.rados.2.smithi057.stdout:105: finishing write tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:01:59.983 INFO:tasks.rados.rados.2.smithi057.stdout:106: expect (ObjNum 37 snap 0 seq_num 37) 2020-11-16T22:02:00.061 INFO:tasks.rados.rados.2.smithi057.stdout:105: finishing write tid 4 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:00.061 INFO:tasks.rados.rados.2.smithi057.stdout:105: finishing write tid 5 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:00.062 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 43 (ObjNum 65 snap 10 seq_num 65) dirty exists 2020-11-16T22:02:00.062 INFO:tasks.rados.rados.2.smithi057.stdout:105: left oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 65 snap 10 seq_num 65) 2020-11-16T22:02:00.062 INFO:tasks.rados.rados.2.smithi057.stdout:109: expect (ObjNum 54 snap 3 seq_num 54) 2020-11-16T22:02:00.185 INFO:tasks.rados.rados.2.smithi057.stdout:108: expect (ObjNum 1 snap 0 seq_num 1) 2020-11-16T22:02:00.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:59 smithi057 bash[10301]: cluster 2020-11-16T22:01:58.906653+0000 mon.a (mon.0) 720 : cluster [DBG] osdmap e93: 12 total, 12 up, 12 in 2020-11-16T22:02:00.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:01:59 smithi057 bash[10301]: cluster 2020-11-16T22:01:59.869051+0000 mon.a (mon.0) 721 : cluster [DBG] osdmap e94: 12 total, 12 up, 12 in 2020-11-16T22:02:00.244 INFO:tasks.rados.rados.2.smithi057.stdout:110: finishing copy_from to smithi05720651-40 2020-11-16T22:02:00.245 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 3 (ObjNum 3 snap 0 seq_num 3) dirty exists 2020-11-16T22:02:00.245 INFO:tasks.rados.rados.2.smithi057.stdout:110: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:02:00.245 INFO:tasks.rados.rados.2.smithi057.stdout:113: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:00.245 INFO:tasks.rados.rados.2.smithi057.stdout:113: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:00.245 INFO:tasks.rados.rados.2.smithi057.stdout:113: finishing write tid 3 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:00.246 INFO:tasks.rados.rados.2.smithi057.stdout:113: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:00.246 INFO:tasks.rados.rados.2.smithi057.stdout:113: finishing write tid 6 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:00.246 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 19 (ObjNum 66 snap 10 seq_num 66) dirty exists 2020-11-16T22:02:00.246 INFO:tasks.rados.rados.2.smithi057.stdout:113: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 66 snap 10 seq_num 66) 2020-11-16T22:02:00.246 INFO:tasks.rados.rados.2.smithi057.stdout:112: expect (ObjNum 17 snap 0 seq_num 17) 2020-11-16T22:02:00.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:59 smithi016 bash[10302]: cluster 2020-11-16T22:01:58.906653+0000 mon.a (mon.0) 720 : cluster [DBG] osdmap e93: 12 total, 12 up, 12 in 2020-11-16T22:02:00.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:01:59 smithi016 bash[10302]: cluster 2020-11-16T22:01:59.869051+0000 mon.a (mon.0) 721 : cluster [DBG] osdmap e94: 12 total, 12 up, 12 in 2020-11-16T22:02:00.337 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:01:59 smithi016 bash[19825]: debug 2020-11-16T22:01:59.892+0000 7f0e16c22700 -1 osd.7 pg_epoch: 94 pg[2.8( v 94'60 (0'0,94'60] local-lis/les=71/72 n=9 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [7,9] r=0 lpr=71 luod=93'58 crt=94'60 lcod 92'56 mlcod 92'56 active+clean+snaptrim trimq=[7~1] ps=[8~1,b~1,e~1,12~1]] removing snap head 2020-11-16T22:02:00.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:59 smithi195 bash[10218]: cluster 2020-11-16T22:01:58.906653+0000 mon.a (mon.0) 720 : cluster [DBG] osdmap e93: 12 total, 12 up, 12 in 2020-11-16T22:02:00.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:01:59 smithi195 bash[10218]: cluster 2020-11-16T22:01:59.869051+0000 mon.a (mon.0) 721 : cluster [DBG] osdmap e94: 12 total, 12 up, 12 in 2020-11-16T22:02:00.876 INFO:tasks.rados.rados.2.smithi057.stdout:101: done (9 left) 2020-11-16T22:02:00.876 INFO:tasks.rados.rados.2.smithi057.stdout:103: done (8 left) 2020-11-16T22:02:00.876 INFO:tasks.rados.rados.2.smithi057.stdout:105: done (7 left) 2020-11-16T22:02:00.876 INFO:tasks.rados.rados.2.smithi057.stdout:106: done (6 left) 2020-11-16T22:02:00.877 INFO:tasks.rados.rados.2.smithi057.stdout:108: done (5 left) 2020-11-16T22:02:00.877 INFO:tasks.rados.rados.2.smithi057.stdout:109: done (4 left) 2020-11-16T22:02:00.877 INFO:tasks.rados.rados.2.smithi057.stdout:110: done (3 left) 2020-11-16T22:02:00.877 INFO:tasks.rados.rados.2.smithi057.stdout:112: done (2 left) 2020-11-16T22:02:00.877 INFO:tasks.rados.rados.2.smithi057.stdout:113: done (1 left) 2020-11-16T22:02:00.878 INFO:tasks.rados.rados.2.smithi057.stdout:114: done (0 left) 2020-11-16T22:02:00.878 INFO:tasks.rados.rados.2.smithi057.stdout:115: snap_create 2020-11-16T22:02:01.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:00 smithi057 bash[10301]: cluster 2020-11-16T22:01:59.567804+0000 mgr.x (mgr.24115) 281 : cluster [DBG] pgmap v304: 17 pgs: 17 active+clean; 129 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 628 KiB/s wr, 2 op/s 2020-11-16T22:02:01.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:00 smithi057 bash[10301]: cluster 2020-11-16T22:02:00.883982+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e95: 12 total, 12 up, 12 in 2020-11-16T22:02:01.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:00 smithi016 bash[10302]: cluster 2020-11-16T22:01:59.567804+0000 mgr.x (mgr.24115) 281 : cluster [DBG] pgmap v304: 17 pgs: 17 active+clean; 129 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 628 KiB/s wr, 2 op/s 2020-11-16T22:02:01.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:00 smithi016 bash[10302]: cluster 2020-11-16T22:02:00.883982+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e95: 12 total, 12 up, 12 in 2020-11-16T22:02:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:00 smithi195 bash[10218]: cluster 2020-11-16T22:01:59.567804+0000 mgr.x (mgr.24115) 281 : cluster [DBG] pgmap v304: 17 pgs: 17 active+clean; 129 MiB data, 212 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 628 KiB/s wr, 2 op/s 2020-11-16T22:02:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:00 smithi195 bash[10218]: cluster 2020-11-16T22:02:00.883982+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e95: 12 total, 12 up, 12 in 2020-11-16T22:02:01.875 INFO:tasks.rados.rados.2.smithi057.stdout:115: done (0 left) 2020-11-16T22:02:01.875 INFO:tasks.rados.rados.2.smithi057.stdout:116: read oid 28 snap -1 2020-11-16T22:02:01.875 INFO:tasks.rados.rados.2.smithi057.stdout:116: expect (ObjNum 61 snap 5 seq_num 61) 2020-11-16T22:02:01.876 INFO:tasks.rados.rados.2.smithi057.stdout:117: read oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 11 2020-11-16T22:02:01.876 INFO:tasks.rados.rados.2.smithi057.stdout:117: expect (ObjNum 42 snap 0 seq_num 42) 2020-11-16T22:02:01.876 INFO:tasks.rados.rados.2.smithi057.stdout:118: snap_create 2020-11-16T22:02:01.887 INFO:tasks.rados.rados.2.smithi057.stdout:117: expect (ObjNum 42 snap 0 seq_num 42) 2020-11-16T22:02:01.979 INFO:tasks.rados.rados.2.smithi057.stdout:116: expect (ObjNum 61 snap 5 seq_num 61) 2020-11-16T22:02:02.885 INFO:tasks.rados.rados.2.smithi057.stdout:116: done (2 left) 2020-11-16T22:02:02.886 INFO:tasks.rados.rados.2.smithi057.stdout:117: done (1 left) 2020-11-16T22:02:02.886 INFO:tasks.rados.rados.2.smithi057.stdout:118: done (0 left) 2020-11-16T22:02:02.886 INFO:tasks.rados.rados.2.smithi057.stdout:119: rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 13 2020-11-16T22:02:02.886 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 7 2020-11-16T22:02:02.886 INFO:tasks.rados.rados.2.smithi057.stdout:120: snap_create 2020-11-16T22:02:02.899 INFO:tasks.rados.rados.2.smithi057.stdout:119: finishing rollback tid 0 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:02.901 INFO:tasks.rados.rados.2.smithi057.stdout:119: finishing rollback tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:02.901 INFO:tasks.rados.rados.2.smithi057.stdout:119: finishing rollback tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:02.901 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 40 (ObjNum 18 snap 0 seq_num 18) dirty exists 2020-11-16T22:02:03.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:02 smithi057 bash[10301]: cluster 2020-11-16T22:02:01.568457+0000 mgr.x (mgr.24115) 282 : cluster [DBG] pgmap v307: 17 pgs: 17 active+clean; 130 MiB data, 220 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2020-11-16T22:02:03.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:02 smithi057 bash[10301]: cluster 2020-11-16T22:02:01.886868+0000 mon.a (mon.0) 723 : cluster [DBG] osdmap e96: 12 total, 12 up, 12 in 2020-11-16T22:02:03.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:02 smithi016 bash[10302]: cluster 2020-11-16T22:02:01.568457+0000 mgr.x (mgr.24115) 282 : cluster [DBG] pgmap v307: 17 pgs: 17 active+clean; 130 MiB data, 220 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2020-11-16T22:02:03.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:02 smithi016 bash[10302]: cluster 2020-11-16T22:02:01.886868+0000 mon.a (mon.0) 723 : cluster [DBG] osdmap e96: 12 total, 12 up, 12 in 2020-11-16T22:02:03.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:02 smithi195 bash[10218]: cluster 2020-11-16T22:02:01.568457+0000 mgr.x (mgr.24115) 282 : cluster [DBG] pgmap v307: 17 pgs: 17 active+clean; 130 MiB data, 220 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2020-11-16T22:02:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:02 smithi195 bash[10218]: cluster 2020-11-16T22:02:01.886868+0000 mon.a (mon.0) 723 : cluster [DBG] osdmap e96: 12 total, 12 up, 12 in 2020-11-16T22:02:03.902 INFO:tasks.rados.rados.2.smithi057.stdout:119: done (1 left) 2020-11-16T22:02:03.902 INFO:tasks.rados.rados.2.smithi057.stdout:120: done (0 left) 2020-11-16T22:02:03.902 INFO:tasks.rados.rados.2.smithi057.stdout:121: write oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 14 2020-11-16T22:02:03.903 INFO:tasks.rados.rados.2.smithi057.stdout:121: seq_num 67 ranges {726069=772507,2071117=715676} 2020-11-16T22:02:03.916 INFO:tasks.rados.rados.2.smithi057.stdout:121: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 726069 to 1498576 tid 1 2020-11-16T22:02:03.924 INFO:tasks.rados.rados.2.smithi057.stdout:121: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2071117 to 2786793 tid 2 2020-11-16T22:02:03.924 INFO:tasks.rados.rados.2.smithi057.stdout:122: snap_remove snap 7 2020-11-16T22:02:04.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:03 smithi057 bash[10301]: cluster 2020-11-16T22:02:02.888943+0000 mon.a (mon.0) 724 : cluster [DBG] osdmap e97: 12 total, 12 up, 12 in 2020-11-16T22:02:04.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:03 smithi016 bash[10302]: cluster 2020-11-16T22:02:02.888943+0000 mon.a (mon.0) 724 : cluster [DBG] osdmap e97: 12 total, 12 up, 12 in 2020-11-16T22:02:04.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:03 smithi195 bash[10218]: cluster 2020-11-16T22:02:02.888943+0000 mon.a (mon.0) 724 : cluster [DBG] osdmap e97: 12 total, 12 up, 12 in 2020-11-16T22:02:04.862 INFO:tasks.rados.rados.2.smithi057.stdout:121: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:04.862 INFO:tasks.rados.rados.2.smithi057.stdout:122: done (1 left) 2020-11-16T22:02:04.863 INFO:tasks.rados.rados.2.smithi057.stdout:123: read oid 40 snap -1 2020-11-16T22:02:04.863 INFO:tasks.rados.rados.2.smithi057.stdout:123: expect (ObjNum 3 snap 0 seq_num 3) 2020-11-16T22:02:04.863 INFO:tasks.rados.rados.2.smithi057.stdout:124: copy_from oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 14 2020-11-16T22:02:04.863 INFO:tasks.rados.rados.2.smithi057.stdout:121: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:04.863 INFO:tasks.rados.rados.2.smithi057.stdout:121: finishing write tid 4 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:04.863 INFO:tasks.rados.rados.2.smithi057.stdout:121: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:04.863 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 50 (ObjNum 67 snap 14 seq_num 67) dirty exists 2020-11-16T22:02:04.864 INFO:tasks.rados.rados.2.smithi057.stdout:121: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 67 snap 14 seq_num 67) 2020-11-16T22:02:04.864 INFO:tasks.rados.rados.2.smithi057.stdout:121: done (2 left) 2020-11-16T22:02:04.864 INFO:tasks.rados.rados.2.smithi057.stdout:125: snap_remove snap 13 2020-11-16T22:02:05.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:04 smithi057 bash[10301]: cluster 2020-11-16T22:02:03.569167+0000 mgr.x (mgr.24115) 283 : cluster [DBG] pgmap v310: 17 pgs: 17 active+clean; 131 MiB data, 216 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.9 MiB/s wr, 19 op/s 2020-11-16T22:02:05.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:04 smithi057 bash[10301]: cluster 2020-11-16T22:02:03.912448+0000 mon.a (mon.0) 725 : cluster [DBG] osdmap e98: 12 total, 12 up, 12 in 2020-11-16T22:02:05.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:04 smithi057 bash[10301]: cluster 2020-11-16T22:02:04.871069+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e99: 12 total, 12 up, 12 in 2020-11-16T22:02:05.337 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:02:04 smithi016 bash[19825]: debug 2020-11-16T22:02:04.867+0000 7f0e12c1a700 -1 osd.7 pg_epoch: 99 pg[2.8( v 94'64 (0'0,94'64] local-lis/les=71/72 n=7 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [7,9] r=0 lpr=71 crt=94'64 lcod 94'62 mlcod 94'62 active+clean+snaptrim trimq=[d~1] ps=[7~1]] removing snap head 2020-11-16T22:02:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:04 smithi016 bash[10302]: cluster 2020-11-16T22:02:03.569167+0000 mgr.x (mgr.24115) 283 : cluster [DBG] pgmap v310: 17 pgs: 17 active+clean; 131 MiB data, 216 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.9 MiB/s wr, 19 op/s 2020-11-16T22:02:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:04 smithi016 bash[10302]: cluster 2020-11-16T22:02:03.912448+0000 mon.a (mon.0) 725 : cluster [DBG] osdmap e98: 12 total, 12 up, 12 in 2020-11-16T22:02:05.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:04 smithi016 bash[10302]: cluster 2020-11-16T22:02:04.871069+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e99: 12 total, 12 up, 12 in 2020-11-16T22:02:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:04 smithi195 bash[10218]: cluster 2020-11-16T22:02:03.569167+0000 mgr.x (mgr.24115) 283 : cluster [DBG] pgmap v310: 17 pgs: 17 active+clean; 131 MiB data, 216 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.9 MiB/s wr, 19 op/s 2020-11-16T22:02:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:04 smithi195 bash[10218]: cluster 2020-11-16T22:02:03.912448+0000 mon.a (mon.0) 725 : cluster [DBG] osdmap e98: 12 total, 12 up, 12 in 2020-11-16T22:02:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:04 smithi195 bash[10218]: cluster 2020-11-16T22:02:04.871069+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e99: 12 total, 12 up, 12 in 2020-11-16T22:02:05.875 INFO:tasks.rados.rados.2.smithi057.stdout:125: done (2 left) 2020-11-16T22:02:05.876 INFO:tasks.rados.rados.2.smithi057.stdout:126: copy_from oid 20 from oid 12 current snap is 14 2020-11-16T22:02:05.876 INFO:tasks.rados.rados.2.smithi057.stdout:124: finishing copy_from to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:05.876 INFO:tasks.rados.rados.2.smithi057.stdout:124: got expected ENOENT (src dne) 2020-11-16T22:02:05.876 INFO:tasks.rados.rados.2.smithi057.stdout:124: finishing copy_from racing read to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:05.876 INFO:tasks.rados.rados.2.smithi057.stdout:123: expect (ObjNum 3 snap 0 seq_num 3) 2020-11-16T22:02:05.947 INFO:tasks.rados.rados.2.smithi057.stdout:123: done (2 left) 2020-11-16T22:02:05.948 INFO:tasks.rados.rados.2.smithi057.stdout:124: done (1 left) 2020-11-16T22:02:05.948 INFO:tasks.rados.rados.2.smithi057.stdout:127: read oid 34 snap -1 2020-11-16T22:02:05.948 INFO:tasks.rados.rados.2.smithi057.stdout:127: expect (ObjNum 33 snap 0 seq_num 33) 2020-11-16T22:02:05.948 INFO:tasks.rados.rados.2.smithi057.stdout:128: snap_create 2020-11-16T22:02:05.955 INFO:tasks.rados.rados.2.smithi057.stdout:127: expect (ObjNum 33 snap 0 seq_num 33) 2020-11-16T22:02:06.035 INFO:tasks.rados.rados.2.smithi057.stdout:126: finishing copy_from to smithi05720651-20 2020-11-16T22:02:06.036 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 3 (ObjNum 11 snap 0 seq_num 11) dirty exists 2020-11-16T22:02:06.036 INFO:tasks.rados.rados.2.smithi057.stdout:126: finishing copy_from racing read to smithi05720651-20 2020-11-16T22:02:06.907 INFO:tasks.rados.rados.2.smithi057.stdout:126: done (2 left) 2020-11-16T22:02:06.907 INFO:tasks.rados.rados.2.smithi057.stdout:127: done (1 left) 2020-11-16T22:02:06.908 INFO:tasks.rados.rados.2.smithi057.stdout:128: done (0 left) 2020-11-16T22:02:06.908 INFO:tasks.rados.rados.2.smithi057.stdout:129: write (excl) oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 15 2020-11-16T22:02:06.908 INFO:tasks.rados.rados.2.smithi057.stdout:129: seq_num 68 ranges {742876=447756,1729599=575687,3101234=41642} 2020-11-16T22:02:06.923 INFO:tasks.rados.rados.2.smithi057.stdout:129: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 742876 to 1190632 tid 1 2020-11-16T22:02:06.930 INFO:tasks.rados.rados.2.smithi057.stdout:129: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1729599 to 2305286 tid 2 2020-11-16T22:02:06.935 INFO:tasks.rados.rados.2.smithi057.stdout:129: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3101234 to 3142876 tid 3 2020-11-16T22:02:06.935 INFO:tasks.rados.rados.2.smithi057.stdout:129: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:06.935 INFO:tasks.rados.rados.2.smithi057.stdout:130: read oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:06.935 INFO:tasks.rados.rados.2.smithi057.stdout:130: expect (ObjNum 14 snap 0 seq_num 14) 2020-11-16T22:02:06.936 INFO:tasks.rados.rados.2.smithi057.stdout:131: snap_create 2020-11-16T22:02:06.940 INFO:tasks.rados.rados.2.smithi057.stdout:129: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:06.940 INFO:tasks.rados.rados.2.smithi057.stdout:129: finishing write tid 3 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:06.944 INFO:tasks.rados.rados.2.smithi057.stdout:130: expect (ObjNum 14 snap 0 seq_num 14) 2020-11-16T22:02:07.016 INFO:tasks.rados.rados.2.smithi057.stdout:129: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:07.016 INFO:tasks.rados.rados.2.smithi057.stdout:129: finishing write tid 6 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:07.017 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 29 (ObjNum 68 snap 15 seq_num 68) dirty exists 2020-11-16T22:02:07.017 INFO:tasks.rados.rados.2.smithi057.stdout:129: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 68 snap 15 seq_num 68) 2020-11-16T22:02:07.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:06 smithi057 bash[10301]: cluster 2020-11-16T22:02:05.569841+0000 mgr.x (mgr.24115) 284 : cluster [DBG] pgmap v313: 17 pgs: 17 active+clean; 128 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 689 KiB/s wr, 5 op/s 2020-11-16T22:02:07.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:06 smithi057 bash[10301]: cluster 2020-11-16T22:02:05.883247+0000 mon.a (mon.0) 727 : cluster [DBG] osdmap e100: 12 total, 12 up, 12 in 2020-11-16T22:02:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:06 smithi016 bash[10302]: cluster 2020-11-16T22:02:05.569841+0000 mgr.x (mgr.24115) 284 : cluster [DBG] pgmap v313: 17 pgs: 17 active+clean; 128 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 689 KiB/s wr, 5 op/s 2020-11-16T22:02:07.404 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:06 smithi016 bash[10302]: cluster 2020-11-16T22:02:05.883247+0000 mon.a (mon.0) 727 : cluster [DBG] osdmap e100: 12 total, 12 up, 12 in 2020-11-16T22:02:07.405 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:06 smithi195 bash[10218]: cluster 2020-11-16T22:02:05.569841+0000 mgr.x (mgr.24115) 284 : cluster [DBG] pgmap v313: 17 pgs: 17 active+clean; 128 MiB data, 213 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 689 KiB/s wr, 5 op/s 2020-11-16T22:02:07.405 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:06 smithi195 bash[10218]: cluster 2020-11-16T22:02:05.883247+0000 mon.a (mon.0) 727 : cluster [DBG] osdmap e100: 12 total, 12 up, 12 in 2020-11-16T22:02:07.918 INFO:tasks.rados.rados.2.smithi057.stdout:129: done (2 left) 2020-11-16T22:02:07.918 INFO:tasks.rados.rados.2.smithi057.stdout:130: done (1 left) 2020-11-16T22:02:07.918 INFO:tasks.rados.rados.2.smithi057.stdout:131: done (0 left) 2020-11-16T22:02:07.918 INFO:tasks.rados.rados.2.smithi057.stdout:132: snap_create 2020-11-16T22:02:08.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:07 smithi057 bash[10301]: cluster 2020-11-16T22:02:06.918677+0000 mon.a (mon.0) 728 : cluster [DBG] osdmap e101: 12 total, 12 up, 12 in 2020-11-16T22:02:08.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:07 smithi016 bash[10302]: cluster 2020-11-16T22:02:06.918677+0000 mon.a (mon.0) 728 : cluster [DBG] osdmap e101: 12 total, 12 up, 12 in 2020-11-16T22:02:08.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:07 smithi195 bash[10218]: cluster 2020-11-16T22:02:06.918677+0000 mon.a (mon.0) 728 : cluster [DBG] osdmap e101: 12 total, 12 up, 12 in 2020-11-16T22:02:08.928 INFO:tasks.rados.rados.2.smithi057.stdout:132: done (0 left) 2020-11-16T22:02:08.928 INFO:tasks.rados.rados.2.smithi057.stdout:133: snap_create 2020-11-16T22:02:09.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:08 smithi057 bash[10301]: cluster 2020-11-16T22:02:07.570605+0000 mgr.x (mgr.24115) 285 : cluster [DBG] pgmap v316: 17 pgs: 17 active+clean; 116 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 363 KiB/s wr, 8 op/s 2020-11-16T22:02:09.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:08 smithi057 bash[10301]: cluster 2020-11-16T22:02:07.929679+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e102: 12 total, 12 up, 12 in 2020-11-16T22:02:09.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:08 smithi016 bash[10302]: cluster 2020-11-16T22:02:07.570605+0000 mgr.x (mgr.24115) 285 : cluster [DBG] pgmap v316: 17 pgs: 17 active+clean; 116 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 363 KiB/s wr, 8 op/s 2020-11-16T22:02:09.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:08 smithi016 bash[10302]: cluster 2020-11-16T22:02:07.929679+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e102: 12 total, 12 up, 12 in 2020-11-16T22:02:09.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:08 smithi195 bash[10218]: cluster 2020-11-16T22:02:07.570605+0000 mgr.x (mgr.24115) 285 : cluster [DBG] pgmap v316: 17 pgs: 17 active+clean; 116 MiB data, 201 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 363 KiB/s wr, 8 op/s 2020-11-16T22:02:09.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:08 smithi195 bash[10218]: cluster 2020-11-16T22:02:07.929679+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e102: 12 total, 12 up, 12 in 2020-11-16T22:02:09.861 INFO:tasks.rados.rados.2.smithi057.stdout:133: done (0 left) 2020-11-16T22:02:09.862 INFO:tasks.rados.rados.2.smithi057.stdout:134: delete oid 36 current snap is 18 2020-11-16T22:02:09.867 INFO:tasks.rados.rados.2.smithi057.stdout:134: done (0 left) 2020-11-16T22:02:09.867 INFO:tasks.rados.rados.2.smithi057.stdout:135: read oid 22 snap -1 2020-11-16T22:02:09.867 INFO:tasks.rados.rados.2.smithi057.stdout:135: expect (ObjNum 21 snap 0 seq_num 21) 2020-11-16T22:02:09.867 INFO:tasks.rados.rados.2.smithi057.stdout:136: delete oid 50 current snap is 18 2020-11-16T22:02:09.870 INFO:tasks.rados.rados.2.smithi057.stdout:135: expect (ObjNum 21 snap 0 seq_num 21) 2020-11-16T22:02:09.948 INFO:tasks.rados.rados.2.smithi057.stdout:135: done (1 left) 2020-11-16T22:02:09.949 INFO:tasks.rados.rados.2.smithi057.stdout:136: done (0 left) 2020-11-16T22:02:09.949 INFO:tasks.rados.rados.2.smithi057.stdout:137: rollback oid 6 current snap is 18 2020-11-16T22:02:09.949 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 6 to 15 2020-11-16T22:02:09.949 INFO:tasks.rados.rados.2.smithi057.stdout:138: write (excl) oid 16 current snap is 18 2020-11-16T22:02:09.949 INFO:tasks.rados.rados.2.smithi057.stdout:138: seq_num 71 ranges {793297=789856,2305045=723014} 2020-11-16T22:02:09.962 INFO:tasks.rados.rados.2.smithi057.stdout:138: writing smithi05720651-16 from 793297 to 1583153 tid 1 2020-11-16T22:02:09.971 INFO:tasks.rados.rados.2.smithi057.stdout:138: writing smithi05720651-16 from 2305045 to 3028059 tid 2 2020-11-16T22:02:09.971 INFO:tasks.rados.rados.2.smithi057.stdout:139: write (excl) oid 48 current snap is 18 2020-11-16T22:02:09.971 INFO:tasks.rados.rados.2.smithi057.stdout:139: seq_num 72 ranges {410104=465105,1563527=583025,2810926=399178} 2020-11-16T22:02:09.976 INFO:tasks.rados.rados.2.smithi057.stdout:139: writing smithi05720651-48 from 410104 to 875209 tid 1 2020-11-16T22:02:09.983 INFO:tasks.rados.rados.2.smithi057.stdout:139: writing smithi05720651-48 from 1563527 to 2146552 tid 2 2020-11-16T22:02:09.990 INFO:tasks.rados.rados.2.smithi057.stdout:139: writing smithi05720651-48 from 2810926 to 3210104 tid 3 2020-11-16T22:02:09.990 INFO:tasks.rados.rados.2.smithi057.stdout:140: read oid 4 snap -1 2020-11-16T22:02:09.990 INFO:tasks.rados.rados.2.smithi057.stdout:140: expect (ObjNum 3 snap 0 seq_num 3) 2020-11-16T22:02:09.991 INFO:tasks.rados.rados.2.smithi057.stdout:141: snap_create 2020-11-16T22:02:09.991 INFO:tasks.rados.rados.2.smithi057.stdout:137: finishing rollback tid 0 to smithi05720651-6 2020-11-16T22:02:09.991 INFO:tasks.rados.rados.2.smithi057.stdout:137: finishing rollback tid 1 to smithi05720651-6 2020-11-16T22:02:09.991 INFO:tasks.rados.rados.2.smithi057.stdout:138: finishing write tid 1 to smithi05720651-16 2020-11-16T22:02:09.991 INFO:tasks.rados.rados.2.smithi057.stdout:138: finishing write tid 2 to smithi05720651-16 2020-11-16T22:02:09.991 INFO:tasks.rados.rados.2.smithi057.stdout:138: finishing write tid 4 to smithi05720651-16 2020-11-16T22:02:09.991 INFO:tasks.rados.rados.2.smithi057.stdout:139: finishing write tid 1 to smithi05720651-48 2020-11-16T22:02:09.992 INFO:tasks.rados.rados.2.smithi057.stdout:138: finishing write tid 5 to smithi05720651-16 2020-11-16T22:02:09.992 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 69 (ObjNum 71 snap 18 seq_num 71) dirty exists 2020-11-16T22:02:09.992 INFO:tasks.rados.rados.2.smithi057.stdout:138: left oid 16 (ObjNum 71 snap 18 seq_num 71) 2020-11-16T22:02:09.992 INFO:tasks.rados.rados.2.smithi057.stdout:139: finishing write tid 2 to smithi05720651-48 2020-11-16T22:02:09.994 INFO:tasks.rados.rados.2.smithi057.stdout:139: finishing write tid 3 to smithi05720651-48 2020-11-16T22:02:09.996 INFO:tasks.rados.rados.2.smithi057.stdout:139: finishing write tid 5 to smithi05720651-48 2020-11-16T22:02:09.996 INFO:tasks.rados.rados.2.smithi057.stdout:139: finishing write tid 6 to smithi05720651-48 2020-11-16T22:02:09.997 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 11 (ObjNum 72 snap 18 seq_num 72) dirty exists 2020-11-16T22:02:09.997 INFO:tasks.rados.rados.2.smithi057.stdout:139: left oid 48 (ObjNum 72 snap 18 seq_num 72) 2020-11-16T22:02:09.997 INFO:tasks.rados.rados.2.smithi057.stdout:140: expect (ObjNum 3 snap 0 seq_num 3) 2020-11-16T22:02:10.147 INFO:tasks.rados.rados.2.smithi057.stdout:137: finishing rollback tid 2 to smithi05720651-6 2020-11-16T22:02:10.148 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 50 (ObjNum 54 snap 3 seq_num 54) dirty exists 2020-11-16T22:02:10.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:09 smithi057 bash[10301]: cluster 2020-11-16T22:02:08.932556+0000 mon.a (mon.0) 730 : cluster [DBG] osdmap e103: 12 total, 12 up, 12 in 2020-11-16T22:02:10.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:09 smithi057 bash[10301]: cluster 2020-11-16T22:02:09.872155+0000 mon.a (mon.0) 731 : cluster [DBG] osdmap e104: 12 total, 12 up, 12 in 2020-11-16T22:02:10.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:09 smithi016 bash[10302]: cluster 2020-11-16T22:02:08.932556+0000 mon.a (mon.0) 730 : cluster [DBG] osdmap e103: 12 total, 12 up, 12 in 2020-11-16T22:02:10.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:09 smithi016 bash[10302]: cluster 2020-11-16T22:02:09.872155+0000 mon.a (mon.0) 731 : cluster [DBG] osdmap e104: 12 total, 12 up, 12 in 2020-11-16T22:02:10.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:09 smithi195 bash[10218]: cluster 2020-11-16T22:02:08.932556+0000 mon.a (mon.0) 730 : cluster [DBG] osdmap e103: 12 total, 12 up, 12 in 2020-11-16T22:02:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:09 smithi195 bash[10218]: cluster 2020-11-16T22:02:09.872155+0000 mon.a (mon.0) 731 : cluster [DBG] osdmap e104: 12 total, 12 up, 12 in 2020-11-16T22:02:10.947 INFO:tasks.rados.rados.2.smithi057.stdout:137: done (4 left) 2020-11-16T22:02:10.947 INFO:tasks.rados.rados.2.smithi057.stdout:138: done (3 left) 2020-11-16T22:02:10.947 INFO:tasks.rados.rados.2.smithi057.stdout:139: done (2 left) 2020-11-16T22:02:10.947 INFO:tasks.rados.rados.2.smithi057.stdout:140: done (1 left) 2020-11-16T22:02:10.948 INFO:tasks.rados.rados.2.smithi057.stdout:141: done (0 left) 2020-11-16T22:02:10.948 INFO:tasks.rados.rados.2.smithi057.stdout:142: read oid 18 snap -1 2020-11-16T22:02:10.948 INFO:tasks.rados.rados.2.smithi057.stdout:142: expect (ObjNum 17 snap 0 seq_num 17) 2020-11-16T22:02:10.948 INFO:tasks.rados.rados.2.smithi057.stdout:143: delete oid 34 current snap is 19 2020-11-16T22:02:10.954 INFO:tasks.rados.rados.2.smithi057.stdout:143: done (1 left) 2020-11-16T22:02:10.955 INFO:tasks.rados.rados.2.smithi057.stdout:144: delete oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 19 2020-11-16T22:02:10.959 INFO:tasks.rados.rados.2.smithi057.stdout:144: done (1 left) 2020-11-16T22:02:10.959 INFO:tasks.rados.rados.2.smithi057.stdout:145: copy_from oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 19 2020-11-16T22:02:10.960 INFO:tasks.rados.rados.2.smithi057.stdout:146: delete oid 28 current snap is 19 2020-11-16T22:02:10.963 INFO:tasks.rados.rados.2.smithi057.stdout:146: done (2 left) 2020-11-16T22:02:10.963 INFO:tasks.rados.rados.2.smithi057.stdout:147: snap_create 2020-11-16T22:02:10.965 INFO:tasks.rados.rados.2.smithi057.stdout:142: expect (ObjNum 17 snap 0 seq_num 17) 2020-11-16T22:02:11.040 INFO:tasks.rados.rados.2.smithi057.stdout:145: finishing copy_from to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:11.041 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 6 (ObjNum 44 snap 0 seq_num 44) dirty exists 2020-11-16T22:02:11.041 INFO:tasks.rados.rados.2.smithi057.stdout:145: finishing copy_from racing read to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:11.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:10 smithi016 bash[10302]: cluster 2020-11-16T22:02:09.571392+0000 mgr.x (mgr.24115) 286 : cluster [DBG] pgmap v319: 17 pgs: 17 active+clean; 118 MiB data, 206 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 533 KiB/s wr, 7 op/s 2020-11-16T22:02:11.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:10 smithi195 bash[10218]: cluster 2020-11-16T22:02:09.571392+0000 mgr.x (mgr.24115) 286 : cluster [DBG] pgmap v319: 17 pgs: 17 active+clean; 118 MiB data, 206 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 533 KiB/s wr, 7 op/s 2020-11-16T22:02:11.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:10 smithi057 bash[10301]: cluster 2020-11-16T22:02:09.571392+0000 mgr.x (mgr.24115) 286 : cluster [DBG] pgmap v319: 17 pgs: 17 active+clean; 118 MiB data, 206 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 533 KiB/s wr, 7 op/s 2020-11-16T22:02:11.964 INFO:tasks.rados.rados.2.smithi057.stdout:142: done (2 left) 2020-11-16T22:02:11.965 INFO:tasks.rados.rados.2.smithi057.stdout:145: done (1 left) 2020-11-16T22:02:11.965 INFO:tasks.rados.rados.2.smithi057.stdout:147: done (0 left) 2020-11-16T22:02:11.965 INFO:tasks.rados.rados.2.smithi057.stdout:148: rollback oid 42 current snap is 20 2020-11-16T22:02:11.965 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 42 to 17 2020-11-16T22:02:11.965 INFO:tasks.rados.rados.2.smithi057.stdout:149: snap_remove snap 19 2020-11-16T22:02:12.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:11 smithi016 bash[10302]: cluster 2020-11-16T22:02:10.957450+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e105: 12 total, 12 up, 12 in 2020-11-16T22:02:12.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:11 smithi195 bash[10218]: cluster 2020-11-16T22:02:10.957450+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e105: 12 total, 12 up, 12 in 2020-11-16T22:02:12.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:11 smithi057 bash[10301]: cluster 2020-11-16T22:02:10.957450+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e105: 12 total, 12 up, 12 in 2020-11-16T22:02:12.968 INFO:tasks.rados.rados.2.smithi057.stdout:149: done (1 left) 2020-11-16T22:02:12.969 INFO:tasks.rados.rados.2.smithi057.stdout:150: write oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 20 2020-11-16T22:02:12.969 INFO:tasks.rados.rados.2.smithi057.stdout:150: seq_num 76 ranges {477332=766101,1681102=474010,2687912=589420} 2020-11-16T22:02:12.984 INFO:tasks.rados.rados.2.smithi057.stdout:150: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 477332 to 1243433 tid 1 2020-11-16T22:02:12.989 INFO:tasks.rados.rados.2.smithi057.stdout:150: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1681102 to 2155112 tid 2 2020-11-16T22:02:12.996 INFO:tasks.rados.rados.2.smithi057.stdout:150: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2687912 to 3277332 tid 3 2020-11-16T22:02:12.996 INFO:tasks.rados.rados.2.smithi057.stdout:151: rollback oid 38 current snap is 20 2020-11-16T22:02:12.996 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 38 to 11 2020-11-16T22:02:12.996 INFO:tasks.rados.rados.2.smithi057.stdout:148: finishing rollback tid 0 to smithi05720651-42 2020-11-16T22:02:12.996 INFO:tasks.rados.rados.2.smithi057.stdout:152: delete oid 2 current snap is 20 2020-11-16T22:02:12.997 INFO:tasks.rados.rados.2.smithi057.stdout:148: finishing rollback tid 1 to smithi05720651-42 2020-11-16T22:02:12.997 INFO:tasks.rados.rados.2.smithi057.stdout:148: finishing rollback tid 2 to smithi05720651-42 2020-11-16T22:02:12.997 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 25 (ObjNum 21 snap 0 seq_num 21) dirty exists 2020-11-16T22:02:12.998 INFO:tasks.rados.rados.2.smithi057.stdout:150: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.000 INFO:tasks.rados.rados.2.smithi057.stdout:150: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.001 INFO:tasks.rados.rados.2.smithi057.stdout:151: finishing rollback tid 0 to smithi05720651-38 2020-11-16T22:02:13.002 INFO:tasks.rados.rados.2.smithi057.stdout:150: finishing write tid 3 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.002 INFO:tasks.rados.rados.2.smithi057.stdout:150: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.002 INFO:tasks.rados.rados.2.smithi057.stdout:151: finishing rollback tid 1 to smithi05720651-38 2020-11-16T22:02:13.003 INFO:tasks.rados.rados.2.smithi057.stdout:150: finishing write tid 6 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.003 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 32 (ObjNum 76 snap 20 seq_num 76) dirty exists 2020-11-16T22:02:13.003 INFO:tasks.rados.rados.2.smithi057.stdout:150: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 76 snap 20 seq_num 76) 2020-11-16T22:02:13.003 INFO:tasks.rados.rados.2.smithi057.stdout:148: done (3 left) 2020-11-16T22:02:13.003 INFO:tasks.rados.rados.2.smithi057.stdout:150: done (2 left) 2020-11-16T22:02:13.003 INFO:tasks.rados.rados.2.smithi057.stdout:152: done (1 left) 2020-11-16T22:02:13.003 INFO:tasks.rados.rados.2.smithi057.stdout:153: rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 20 2020-11-16T22:02:13.004 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 15 2020-11-16T22:02:13.004 INFO:tasks.rados.rados.2.smithi057.stdout:154: write oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 20 2020-11-16T22:02:13.004 INFO:tasks.rados.rados.2.smithi057.stdout:154: seq_num 78 ranges {510946=632952,1798066=477679,2742758=457217} 2020-11-16T22:02:13.009 INFO:tasks.rados.rados.2.smithi057.stdout:154: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 510946 to 1143898 tid 1 2020-11-16T22:02:13.018 INFO:tasks.rados.rados.2.smithi057.stdout:154: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1798066 to 2275745 tid 2 2020-11-16T22:02:13.023 INFO:tasks.rados.rados.2.smithi057.stdout:154: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2742758 to 3199975 tid 3 2020-11-16T22:02:13.023 INFO:tasks.rados.rados.2.smithi057.stdout:155: delete oid 28 current snap is 20 2020-11-16T22:02:13.024 INFO:tasks.rados.rados.2.smithi057.stdout:151: finishing rollback tid 2 to smithi05720651-38 2020-11-16T22:02:13.024 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 33 (ObjNum 37 snap 0 seq_num 37) dirty exists 2020-11-16T22:02:13.024 INFO:tasks.rados.rados.2.smithi057.stdout:153: finishing rollback tid 0 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.024 INFO:tasks.rados.rados.2.smithi057.stdout:153: finishing rollback tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.024 INFO:tasks.rados.rados.2.smithi057.stdout:153: finishing rollback tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.024 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 73 (ObjNum 42 snap 0 seq_num 42) dirty exists 2020-11-16T22:02:13.024 INFO:tasks.rados.rados.2.smithi057.stdout:154: finishing write tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.025 INFO:tasks.rados.rados.2.smithi057.stdout:154: finishing write tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.028 INFO:tasks.rados.rados.2.smithi057.stdout:154: finishing write tid 3 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.028 INFO:tasks.rados.rados.2.smithi057.stdout:154: finishing write tid 5 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.029 INFO:tasks.rados.rados.2.smithi057.stdout:154: finishing write tid 6 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.029 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 55 (ObjNum 78 snap 20 seq_num 78) dirty exists 2020-11-16T22:02:13.029 INFO:tasks.rados.rados.2.smithi057.stdout:154: left oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 78 snap 20 seq_num 78) 2020-11-16T22:02:13.029 INFO:tasks.rados.rados.2.smithi057.stdout:151: done (3 left) 2020-11-16T22:02:13.030 INFO:tasks.rados.rados.2.smithi057.stdout:153: done (2 left) 2020-11-16T22:02:13.030 INFO:tasks.rados.rados.2.smithi057.stdout:154: done (1 left) 2020-11-16T22:02:13.030 INFO:tasks.rados.rados.2.smithi057.stdout:155: done (0 left) 2020-11-16T22:02:13.030 INFO:tasks.rados.rados.2.smithi057.stdout:156: write (excl) oid 2 current snap is 20 2020-11-16T22:02:13.030 INFO:tasks.rados.rados.2.smithi057.stdout:156: seq_num 80 ranges {544560=783450,1915030=481348,2797604=479761} 2020-11-16T22:02:13.037 INFO:tasks.rados.rados.2.smithi057.stdout:156: writing smithi05720651-2 from 544560 to 1328010 tid 1 2020-11-16T22:02:13.044 INFO:tasks.rados.rados.2.smithi057.stdout:156: writing smithi05720651-2 from 1915030 to 2396378 tid 2 2020-11-16T22:02:13.049 INFO:tasks.rados.rados.2.smithi057.stdout:156: writing smithi05720651-2 from 2797604 to 3277365 tid 3 2020-11-16T22:02:13.049 INFO:tasks.rados.rados.2.smithi057.stdout:157: copy_from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 20 2020-11-16T22:02:13.050 INFO:tasks.rados.rados.2.smithi057.stdout:158: read oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:13.050 INFO:tasks.rados.rados.2.smithi057.stdout:158: expect (ObjNum 42 snap 0 seq_num 42) 2020-11-16T22:02:13.050 INFO:tasks.rados.rados.2.smithi057.stdout:159: write (excl) oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 20 2020-11-16T22:02:13.050 INFO:tasks.rados.rados.2.smithi057.stdout:159: seq_num 81 ranges {561367=458699,1573512=741359,2941380=419987} 2020-11-16T22:02:13.055 INFO:tasks.rados.rados.2.smithi057.stdout:159: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 561367 to 1020066 tid 1 2020-11-16T22:02:13.063 INFO:tasks.rados.rados.2.smithi057.stdout:159: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1573512 to 2314871 tid 2 2020-11-16T22:02:13.069 INFO:tasks.rados.rados.2.smithi057.stdout:159: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2941380 to 3361367 tid 3 2020-11-16T22:02:13.069 INFO:tasks.rados.rados.2.smithi057.stdout:160: read oid 36 snap -1 2020-11-16T22:02:13.069 INFO:tasks.rados.rados.2.smithi057.stdout:160: expect deleted 2020-11-16T22:02:13.069 INFO:tasks.rados.rados.2.smithi057.stdout:161: delete oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 20 2020-11-16T22:02:13.069 INFO:tasks.rados.rados.2.smithi057.stdout:156: finishing write tid 1 to smithi05720651-2 2020-11-16T22:02:13.070 INFO:tasks.rados.rados.2.smithi057.stdout:156: finishing write tid 2 to smithi05720651-2 2020-11-16T22:02:13.070 INFO:tasks.rados.rados.2.smithi057.stdout:156: finishing write tid 3 to smithi05720651-2 2020-11-16T22:02:13.070 INFO:tasks.rados.rados.2.smithi057.stdout:156: finishing write tid 5 to smithi05720651-2 2020-11-16T22:02:13.070 INFO:tasks.rados.rados.2.smithi057.stdout:156: finishing write tid 6 to smithi05720651-2 2020-11-16T22:02:13.070 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 63 (ObjNum 80 snap 20 seq_num 80) dirty exists 2020-11-16T22:02:13.070 INFO:tasks.rados.rados.2.smithi057.stdout:156: left oid 2 (ObjNum 80 snap 20 seq_num 80) 2020-11-16T22:02:13.071 INFO:tasks.rados.rados.2.smithi057.stdout:158: expect (ObjNum 42 snap 0 seq_num 42) 2020-11-16T22:02:13.159 INFO:tasks.rados.rados.2.smithi057.stdout:159: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.159 INFO:tasks.rados.rados.2.smithi057.stdout:157: finishing copy_from to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.159 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 43 (ObjNum 65 snap 10 seq_num 65) dirty exists 2020-11-16T22:02:13.160 INFO:tasks.rados.rados.2.smithi057.stdout:157: finishing copy_from racing read to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.160 INFO:tasks.rados.rados.2.smithi057.stdout:159: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.160 INFO:tasks.rados.rados.2.smithi057.stdout:159: finishing write tid 3 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.160 INFO:tasks.rados.rados.2.smithi057.stdout:159: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.160 INFO:tasks.rados.rados.2.smithi057.stdout:159: finishing write tid 6 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.160 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 68 (ObjNum 81 snap 20 seq_num 81) dirty exists 2020-11-16T22:02:13.161 INFO:tasks.rados.rados.2.smithi057.stdout:159: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 81 snap 20 seq_num 81) 2020-11-16T22:02:13.161 INFO:tasks.rados.rados.2.smithi057.stdout:156: done (5 left) 2020-11-16T22:02:13.161 INFO:tasks.rados.rados.2.smithi057.stdout:157: done (4 left) 2020-11-16T22:02:13.161 INFO:tasks.rados.rados.2.smithi057.stdout:158: done (3 left) 2020-11-16T22:02:13.161 INFO:tasks.rados.rados.2.smithi057.stdout:159: done (2 left) 2020-11-16T22:02:13.161 INFO:tasks.rados.rados.2.smithi057.stdout:160: done (1 left) 2020-11-16T22:02:13.162 INFO:tasks.rados.rados.2.smithi057.stdout:161: done (0 left) 2020-11-16T22:02:13.162 INFO:tasks.rados.rados.2.smithi057.stdout:162: read oid 22 snap -1 2020-11-16T22:02:13.162 INFO:tasks.rados.rados.2.smithi057.stdout:162: expect (ObjNum 21 snap 0 seq_num 21) 2020-11-16T22:02:13.162 INFO:tasks.rados.rados.2.smithi057.stdout:163: write (excl) oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 20 2020-11-16T22:02:13.162 INFO:tasks.rados.rados.2.smithi057.stdout:163: seq_num 83 ranges {594981=609197,1974123=745028,3279873=115108} 2020-11-16T22:02:13.175 INFO:tasks.rados.rados.2.smithi057.stdout:163: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 594981 to 1204178 tid 1 2020-11-16T22:02:13.184 INFO:tasks.rados.rados.2.smithi057.stdout:163: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1974123 to 2719151 tid 2 2020-11-16T22:02:13.188 INFO:tasks.rados.rados.2.smithi057.stdout:163: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3279873 to 3394981 tid 3 2020-11-16T22:02:13.188 INFO:tasks.rados.rados.2.smithi057.stdout:164: snap_create 2020-11-16T22:02:13.189 INFO:tasks.rados.rados.2.smithi057.stdout:162: expect (ObjNum 21 snap 0 seq_num 21) 2020-11-16T22:02:13.267 INFO:tasks.rados.rados.2.smithi057.stdout:163: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.268 INFO:tasks.rados.rados.2.smithi057.stdout:163: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.268 INFO:tasks.rados.rados.2.smithi057.stdout:163: finishing write tid 3 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.268 INFO:tasks.rados.rados.2.smithi057.stdout:163: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.268 INFO:tasks.rados.rados.2.smithi057.stdout:163: finishing write tid 6 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:13.268 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 64 (ObjNum 83 snap 20 seq_num 83) dirty exists 2020-11-16T22:02:13.268 INFO:tasks.rados.rados.2.smithi057.stdout:163: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 83 snap 20 seq_num 83) 2020-11-16T22:02:13.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:12 smithi016 bash[10302]: cluster 2020-11-16T22:02:11.572176+0000 mgr.x (mgr.24115) 287 : cluster [DBG] pgmap v322: 17 pgs: 17 active+clean; 125 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2020-11-16T22:02:13.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:12 smithi016 bash[10302]: cluster 2020-11-16T22:02:11.975256+0000 mon.a (mon.0) 733 : cluster [DBG] osdmap e106: 12 total, 12 up, 12 in 2020-11-16T22:02:13.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:12 smithi195 bash[10218]: cluster 2020-11-16T22:02:11.572176+0000 mgr.x (mgr.24115) 287 : cluster [DBG] pgmap v322: 17 pgs: 17 active+clean; 125 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2020-11-16T22:02:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:12 smithi195 bash[10218]: cluster 2020-11-16T22:02:11.975256+0000 mon.a (mon.0) 733 : cluster [DBG] osdmap e106: 12 total, 12 up, 12 in 2020-11-16T22:02:13.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:12 smithi057 bash[10301]: cluster 2020-11-16T22:02:11.572176+0000 mgr.x (mgr.24115) 287 : cluster [DBG] pgmap v322: 17 pgs: 17 active+clean; 125 MiB data, 210 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 1.8 MiB/s wr, 11 op/s 2020-11-16T22:02:13.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:12 smithi057 bash[10301]: cluster 2020-11-16T22:02:11.975256+0000 mon.a (mon.0) 733 : cluster [DBG] osdmap e106: 12 total, 12 up, 12 in 2020-11-16T22:02:13.986 INFO:tasks.rados.rados.2.smithi057.stdout:162: done (2 left) 2020-11-16T22:02:13.986 INFO:tasks.rados.rados.2.smithi057.stdout:163: done (1 left) 2020-11-16T22:02:13.986 INFO:tasks.rados.rados.2.smithi057.stdout:164: done (0 left) 2020-11-16T22:02:13.987 INFO:tasks.rados.rados.2.smithi057.stdout:165: write (excl) oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 21 2020-11-16T22:02:13.987 INFO:tasks.rados.rados.2.smithi057.stdout:165: seq_num 84 ranges {611788=400799,1748958=488686,2907296=504492} 2020-11-16T22:02:13.997 INFO:tasks.rados.rados.2.smithi057.stdout:165: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 611788 to 1012587 tid 1 2020-11-16T22:02:14.004 INFO:tasks.rados.rados.2.smithi057.stdout:165: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1748958 to 2237644 tid 2 2020-11-16T22:02:14.011 INFO:tasks.rados.rados.2.smithi057.stdout:165: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2907296 to 3411788 tid 3 2020-11-16T22:02:14.011 INFO:tasks.rados.rados.2.smithi057.stdout:166: snap_remove snap 14 2020-11-16T22:02:14.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:13 smithi016 bash[10302]: cluster 2020-11-16T22:02:12.977660+0000 mon.a (mon.0) 734 : cluster [DBG] osdmap e107: 12 total, 12 up, 12 in 2020-11-16T22:02:14.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:13 smithi195 bash[10218]: cluster 2020-11-16T22:02:12.977660+0000 mon.a (mon.0) 734 : cluster [DBG] osdmap e107: 12 total, 12 up, 12 in 2020-11-16T22:02:14.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:13 smithi057 bash[10301]: cluster 2020-11-16T22:02:12.977660+0000 mon.a (mon.0) 734 : cluster [DBG] osdmap e107: 12 total, 12 up, 12 in 2020-11-16T22:02:14.866 INFO:tasks.rados.rados.2.smithi057.stdout:166: done (1 left) 2020-11-16T22:02:14.866 INFO:tasks.rados.rados.2.smithi057.stdout:167: rollback oid 8 current snap is 21 2020-11-16T22:02:14.866 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 8 to 17 2020-11-16T22:02:14.866 INFO:tasks.rados.rados.2.smithi057.stdout:168: snap_remove snap 18 2020-11-16T22:02:15.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:14 smithi016 bash[10302]: cluster 2020-11-16T22:02:13.572912+0000 mgr.x (mgr.24115) 288 : cluster [DBG] pgmap v325: 17 pgs: 17 active+clean; 127 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2020-11-16T22:02:15.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:14 smithi016 bash[10302]: cluster 2020-11-16T22:02:13.995766+0000 mon.a (mon.0) 735 : cluster [DBG] osdmap e108: 12 total, 12 up, 12 in 2020-11-16T22:02:15.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:14 smithi016 bash[10302]: cluster 2020-11-16T22:02:14.875475+0000 mon.a (mon.0) 736 : cluster [DBG] osdmap e109: 12 total, 12 up, 12 in 2020-11-16T22:02:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:14 smithi195 bash[10218]: cluster 2020-11-16T22:02:13.572912+0000 mgr.x (mgr.24115) 288 : cluster [DBG] pgmap v325: 17 pgs: 17 active+clean; 127 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2020-11-16T22:02:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:14 smithi195 bash[10218]: cluster 2020-11-16T22:02:13.995766+0000 mon.a (mon.0) 735 : cluster [DBG] osdmap e108: 12 total, 12 up, 12 in 2020-11-16T22:02:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:14 smithi195 bash[10218]: cluster 2020-11-16T22:02:14.875475+0000 mon.a (mon.0) 736 : cluster [DBG] osdmap e109: 12 total, 12 up, 12 in 2020-11-16T22:02:15.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:14 smithi057 bash[10301]: cluster 2020-11-16T22:02:13.572912+0000 mgr.x (mgr.24115) 288 : cluster [DBG] pgmap v325: 17 pgs: 17 active+clean; 127 MiB data, 219 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2020-11-16T22:02:15.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:14 smithi057 bash[10301]: cluster 2020-11-16T22:02:13.995766+0000 mon.a (mon.0) 735 : cluster [DBG] osdmap e108: 12 total, 12 up, 12 in 2020-11-16T22:02:15.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:14 smithi057 bash[10301]: cluster 2020-11-16T22:02:14.875475+0000 mon.a (mon.0) 736 : cluster [DBG] osdmap e109: 12 total, 12 up, 12 in 2020-11-16T22:02:15.879 INFO:tasks.rados.rados.2.smithi057.stdout:168: done (2 left) 2020-11-16T22:02:15.880 INFO:tasks.rados.rados.2.smithi057.stdout:169: write (excl) oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 21 2020-11-16T22:02:15.880 INFO:tasks.rados.rados.2.smithi057.stdout:169: seq_num 85 ranges {628595=476048,1807440=632344,2934719=452474} 2020-11-16T22:02:15.891 INFO:tasks.rados.rados.2.smithi057.stdout:169: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 628595 to 1104643 tid 1 2020-11-16T22:02:15.900 INFO:tasks.rados.rados.2.smithi057.stdout:169: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1807440 to 2439784 tid 2 2020-11-16T22:02:15.905 INFO:tasks.rados.rados.2.smithi057.stdout:169: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2934719 to 3387193 tid 3 2020-11-16T22:02:15.905 INFO:tasks.rados.rados.2.smithi057.stdout:170: write (excl) oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 21 2020-11-16T22:02:15.906 INFO:tasks.rados.rados.2.smithi057.stdout:170: seq_num 86 ranges {645402=551297,1749569=492355,2845789=599613} 2020-11-16T22:02:15.912 INFO:tasks.rados.rados.2.smithi057.stdout:170: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 645402 to 1196699 tid 1 2020-11-16T22:02:15.918 INFO:tasks.rados.rados.2.smithi057.stdout:170: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1749569 to 2241924 tid 2 2020-11-16T22:02:15.926 INFO:tasks.rados.rados.2.smithi057.stdout:170: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2845789 to 3445402 tid 3 2020-11-16T22:02:15.926 INFO:tasks.rados.rados.2.smithi057.stdout:171: rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 21 2020-11-16T22:02:15.926 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 10 2020-11-16T22:02:15.926 INFO:tasks.rados.rados.2.smithi057.stdout:165: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.927 INFO:tasks.rados.rados.2.smithi057.stdout:172: copy_from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 30 current snap is 21 2020-11-16T22:02:15.927 INFO:tasks.rados.rados.2.smithi057.stdout:165: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.927 INFO:tasks.rados.rados.2.smithi057.stdout:173: snap_create 2020-11-16T22:02:15.927 INFO:tasks.rados.rados.2.smithi057.stdout:165: finishing write tid 3 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.927 INFO:tasks.rados.rados.2.smithi057.stdout:165: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.927 INFO:tasks.rados.rados.2.smithi057.stdout:165: finishing write tid 6 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.928 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 26 (ObjNum 84 snap 21 seq_num 84) dirty exists 2020-11-16T22:02:15.928 INFO:tasks.rados.rados.2.smithi057.stdout:165: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 84 snap 21 seq_num 84) 2020-11-16T22:02:15.928 INFO:tasks.rados.rados.2.smithi057.stdout:167: finishing rollback tid 0 to smithi05720651-8 2020-11-16T22:02:15.928 INFO:tasks.rados.rados.2.smithi057.stdout:167: finishing rollback tid 1 to smithi05720651-8 2020-11-16T22:02:15.928 INFO:tasks.rados.rados.2.smithi057.stdout:167: finishing rollback tid 2 to smithi05720651-8 2020-11-16T22:02:15.928 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 13 (ObjNum 7 snap 0 seq_num 7) dirty exists 2020-11-16T22:02:15.928 INFO:tasks.rados.rados.2.smithi057.stdout:169: finishing write tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.929 INFO:tasks.rados.rados.2.smithi057.stdout:169: finishing write tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.929 INFO:tasks.rados.rados.2.smithi057.stdout:169: finishing write tid 3 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.929 INFO:tasks.rados.rados.2.smithi057.stdout:169: finishing write tid 5 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.929 INFO:tasks.rados.rados.2.smithi057.stdout:169: finishing write tid 6 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.929 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 20 (ObjNum 85 snap 21 seq_num 85) dirty exists 2020-11-16T22:02:15.929 INFO:tasks.rados.rados.2.smithi057.stdout:169: left oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 85 snap 21 seq_num 85) 2020-11-16T22:02:15.929 INFO:tasks.rados.rados.2.smithi057.stdout:170: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.930 INFO:tasks.rados.rados.2.smithi057.stdout:170: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.930 INFO:tasks.rados.rados.2.smithi057.stdout:171: finishing rollback tid 0 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.931 INFO:tasks.rados.rados.2.smithi057.stdout:171: finishing rollback tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.931 INFO:tasks.rados.rados.2.smithi057.stdout:171: finishing rollback tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.931 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 19 (ObjNum 2 snap 0 seq_num 2) dirty exists 2020-11-16T22:02:15.932 INFO:tasks.rados.rados.2.smithi057.stdout:170: finishing write tid 3 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.932 INFO:tasks.rados.rados.2.smithi057.stdout:170: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.933 INFO:tasks.rados.rados.2.smithi057.stdout:170: finishing write tid 6 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.933 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 47 (ObjNum 86 snap 21 seq_num 86) dirty exists 2020-11-16T22:02:15.933 INFO:tasks.rados.rados.2.smithi057.stdout:170: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 86 snap 21 seq_num 86) 2020-11-16T22:02:15.946 INFO:tasks.rados.rados.2.smithi057.stdout:172: finishing copy_from to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:15.946 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 12 (ObjNum 29 snap 0 seq_num 29) dirty exists 2020-11-16T22:02:15.946 INFO:tasks.rados.rados.2.smithi057.stdout:172: finishing copy_from racing read to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:16.888 INFO:tasks.rados.rados.2.smithi057.stdout:165: done (6 left) 2020-11-16T22:02:16.888 INFO:tasks.rados.rados.2.smithi057.stdout:167: done (5 left) 2020-11-16T22:02:16.888 INFO:tasks.rados.rados.2.smithi057.stdout:169: done (4 left) 2020-11-16T22:02:16.888 INFO:tasks.rados.rados.2.smithi057.stdout:170: done (3 left) 2020-11-16T22:02:16.889 INFO:tasks.rados.rados.2.smithi057.stdout:171: done (2 left) 2020-11-16T22:02:16.889 INFO:tasks.rados.rados.2.smithi057.stdout:172: done (1 left) 2020-11-16T22:02:16.889 INFO:tasks.rados.rados.2.smithi057.stdout:173: done (0 left) 2020-11-16T22:02:16.889 INFO:tasks.rados.rados.2.smithi057.stdout:174: read oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:16.889 INFO:tasks.rados.rados.2.smithi057.stdout:174: expect (ObjNum 34 snap 0 seq_num 34) 2020-11-16T22:02:16.889 INFO:tasks.rados.rados.2.smithi057.stdout:175: delete oid 44 current snap is 22 2020-11-16T22:02:16.894 INFO:tasks.rados.rados.2.smithi057.stdout:175: done (1 left) 2020-11-16T22:02:16.895 INFO:tasks.rados.rados.2.smithi057.stdout:176: write (excl) oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 22 2020-11-16T22:02:16.895 INFO:tasks.rados.rados.2.smithi057.stdout:176: seq_num 88 ranges {679016=701795,1866533=496024,2900635=402643} 2020-11-16T22:02:16.906 INFO:tasks.rados.rados.2.smithi057.stdout:176: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 679016 to 1380811 tid 1 2020-11-16T22:02:16.912 INFO:tasks.rados.rados.2.smithi057.stdout:176: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1866533 to 2362557 tid 2 2020-11-16T22:02:16.918 INFO:tasks.rados.rados.2.smithi057.stdout:176: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2900635 to 3303278 tid 3 2020-11-16T22:02:16.918 INFO:tasks.rados.rados.2.smithi057.stdout:177: write oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 22 2020-11-16T22:02:16.918 INFO:tasks.rados.rados.2.smithi057.stdout:177: seq_num 89 ranges {695823=777044,1925015=639682,3328058=167765} 2020-11-16T22:02:16.926 INFO:tasks.rados.rados.2.smithi057.stdout:177: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 695823 to 1472867 tid 1 2020-11-16T22:02:16.932 INFO:tasks.rados.rados.2.smithi057.stdout:177: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1925015 to 2564697 tid 2 2020-11-16T22:02:16.938 INFO:tasks.rados.rados.2.smithi057.stdout:177: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3328058 to 3495823 tid 3 2020-11-16T22:02:16.938 INFO:tasks.rados.rados.2.smithi057.stdout:178: snap_create 2020-11-16T22:02:16.938 INFO:tasks.rados.rados.2.smithi057.stdout:174: expect (ObjNum 34 snap 0 seq_num 34) 2020-11-16T22:02:17.023 INFO:tasks.rados.rados.2.smithi057.stdout:176: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:17.024 INFO:tasks.rados.rados.2.smithi057.stdout:176: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:17.024 INFO:tasks.rados.rados.2.smithi057.stdout:176: finishing write tid 3 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:17.024 INFO:tasks.rados.rados.2.smithi057.stdout:176: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:17.024 INFO:tasks.rados.rados.2.smithi057.stdout:176: finishing write tid 6 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:17.024 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 70 (ObjNum 88 snap 22 seq_num 88) dirty exists 2020-11-16T22:02:17.024 INFO:tasks.rados.rados.2.smithi057.stdout:176: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 88 snap 22 seq_num 88) 2020-11-16T22:02:17.025 INFO:tasks.rados.rados.2.smithi057.stdout:177: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:17.025 INFO:tasks.rados.rados.2.smithi057.stdout:177: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:17.025 INFO:tasks.rados.rados.2.smithi057.stdout:177: finishing write tid 3 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:17.025 INFO:tasks.rados.rados.2.smithi057.stdout:177: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:17.025 INFO:tasks.rados.rados.2.smithi057.stdout:177: finishing write tid 6 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:17.025 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 19 (ObjNum 89 snap 22 seq_num 89) dirty exists 2020-11-16T22:02:17.025 INFO:tasks.rados.rados.2.smithi057.stdout:177: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 89 snap 22 seq_num 89) 2020-11-16T22:02:17.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:16 smithi057 bash[10301]: cluster 2020-11-16T22:02:15.573644+0000 mgr.x (mgr.24115) 289 : cluster [DBG] pgmap v328: 17 pgs: 17 active+clean; 128 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 712 KiB/s wr, 11 op/s 2020-11-16T22:02:17.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:16 smithi057 bash[10301]: cluster 2020-11-16T22:02:15.886842+0000 mon.a (mon.0) 737 : cluster [DBG] osdmap e110: 12 total, 12 up, 12 in 2020-11-16T22:02:17.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:16 smithi016 bash[10302]: cluster 2020-11-16T22:02:15.573644+0000 mgr.x (mgr.24115) 289 : cluster [DBG] pgmap v328: 17 pgs: 17 active+clean; 128 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 712 KiB/s wr, 11 op/s 2020-11-16T22:02:17.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:16 smithi016 bash[10302]: cluster 2020-11-16T22:02:15.886842+0000 mon.a (mon.0) 737 : cluster [DBG] osdmap e110: 12 total, 12 up, 12 in 2020-11-16T22:02:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:16 smithi195 bash[10218]: cluster 2020-11-16T22:02:15.573644+0000 mgr.x (mgr.24115) 289 : cluster [DBG] pgmap v328: 17 pgs: 17 active+clean; 128 MiB data, 223 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 712 KiB/s wr, 11 op/s 2020-11-16T22:02:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:16 smithi195 bash[10218]: cluster 2020-11-16T22:02:15.886842+0000 mon.a (mon.0) 737 : cluster [DBG] osdmap e110: 12 total, 12 up, 12 in 2020-11-16T22:02:17.897 INFO:tasks.rados.rados.2.smithi057.stdout:174: done (3 left) 2020-11-16T22:02:17.898 INFO:tasks.rados.rados.2.smithi057.stdout:176: done (2 left) 2020-11-16T22:02:17.898 INFO:tasks.rados.rados.2.smithi057.stdout:177: done (1 left) 2020-11-16T22:02:17.898 INFO:tasks.rados.rados.2.smithi057.stdout:178: done (0 left) 2020-11-16T22:02:17.898 INFO:tasks.rados.rados.2.smithi057.stdout:179: rollback oid 48 current snap is 23 2020-11-16T22:02:17.898 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 48 to 16 2020-11-16T22:02:17.899 INFO:tasks.rados.rados.2.smithi057.stdout:180: snap_remove snap 11 2020-11-16T22:02:18.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:17 smithi057 bash[10301]: cluster 2020-11-16T22:02:16.895682+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e111: 12 total, 12 up, 12 in 2020-11-16T22:02:18.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:17 smithi016 bash[10302]: cluster 2020-11-16T22:02:16.895682+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e111: 12 total, 12 up, 12 in 2020-11-16T22:02:18.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:17 smithi195 bash[10218]: cluster 2020-11-16T22:02:16.895682+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e111: 12 total, 12 up, 12 in 2020-11-16T22:02:18.897 INFO:tasks.rados.rados.2.smithi057.stdout:180: done (1 left) 2020-11-16T22:02:18.897 INFO:tasks.rados.rados.2.smithi057.stdout:181: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 23 2020-11-16T22:02:18.898 INFO:tasks.rados.rados.2.smithi057.stdout:181: seq_num 90 ranges {712630=452293,1583497=499693,2555481=425187} 2020-11-16T22:02:18.906 INFO:tasks.rados.rados.2.smithi057.stdout:181: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 712630 to 1164923 tid 1 2020-11-16T22:02:18.912 INFO:tasks.rados.rados.2.smithi057.stdout:181: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1583497 to 2083190 tid 2 2020-11-16T22:02:18.917 INFO:tasks.rados.rados.2.smithi057.stdout:181: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2555481 to 2980668 tid 3 2020-11-16T22:02:18.917 INFO:tasks.rados.rados.2.smithi057.stdout:182: snap_remove snap 17 2020-11-16T22:02:19.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:18 smithi057 bash[10301]: cluster 2020-11-16T22:02:17.574291+0000 mgr.x (mgr.24115) 290 : cluster [DBG] pgmap v331: 17 pgs: 17 active+clean; 143 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 3.4 MiB/s wr, 21 op/s 2020-11-16T22:02:19.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:18 smithi057 bash[10301]: cluster 2020-11-16T22:02:17.905021+0000 mon.a (mon.0) 739 : cluster [DBG] osdmap e112: 12 total, 12 up, 12 in 2020-11-16T22:02:19.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:18 smithi016 bash[10302]: cluster 2020-11-16T22:02:17.574291+0000 mgr.x (mgr.24115) 290 : cluster [DBG] pgmap v331: 17 pgs: 17 active+clean; 143 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 3.4 MiB/s wr, 21 op/s 2020-11-16T22:02:19.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:18 smithi016 bash[10302]: cluster 2020-11-16T22:02:17.905021+0000 mon.a (mon.0) 739 : cluster [DBG] osdmap e112: 12 total, 12 up, 12 in 2020-11-16T22:02:19.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:18 smithi195 bash[10218]: cluster 2020-11-16T22:02:17.574291+0000 mgr.x (mgr.24115) 290 : cluster [DBG] pgmap v331: 17 pgs: 17 active+clean; 143 MiB data, 243 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 3.4 MiB/s wr, 21 op/s 2020-11-16T22:02:19.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:18 smithi195 bash[10218]: cluster 2020-11-16T22:02:17.905021+0000 mon.a (mon.0) 739 : cluster [DBG] osdmap e112: 12 total, 12 up, 12 in 2020-11-16T22:02:19.907 INFO:tasks.rados.rados.2.smithi057.stdout:182: done (2 left) 2020-11-16T22:02:19.908 INFO:tasks.rados.rados.2.smithi057.stdout:183: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:19.908 INFO:tasks.rados.rados.2.smithi057.stdout:183: expect (ObjNum 0 snap 0 seq_num 0) 2020-11-16T22:02:19.908 INFO:tasks.rados.rados.2.smithi057.stdout:184: delete oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 23 2020-11-16T22:02:19.908 INFO:tasks.rados.rados.2.smithi057.stdout:179: finishing rollback tid 0 to smithi05720651-48 2020-11-16T22:02:19.908 INFO:tasks.rados.rados.2.smithi057.stdout:179: finishing rollback tid 1 to smithi05720651-48 2020-11-16T22:02:19.908 INFO:tasks.rados.rados.2.smithi057.stdout:179: finishing rollback tid 2 to smithi05720651-48 2020-11-16T22:02:19.908 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 17 (ObjNum 47 snap 0 seq_num 47) dirty exists 2020-11-16T22:02:19.909 INFO:tasks.rados.rados.2.smithi057.stdout:181: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:19.909 INFO:tasks.rados.rados.2.smithi057.stdout:181: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:19.909 INFO:tasks.rados.rados.2.smithi057.stdout:181: finishing write tid 3 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:19.909 INFO:tasks.rados.rados.2.smithi057.stdout:181: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:19.909 INFO:tasks.rados.rados.2.smithi057.stdout:181: finishing write tid 6 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:19.909 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 91 (ObjNum 90 snap 23 seq_num 90) dirty exists 2020-11-16T22:02:19.909 INFO:tasks.rados.rados.2.smithi057.stdout:181: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 90 snap 23 seq_num 90) 2020-11-16T22:02:19.916 INFO:tasks.rados.rados.2.smithi057.stdout:179: done (3 left) 2020-11-16T22:02:19.917 INFO:tasks.rados.rados.2.smithi057.stdout:181: done (2 left) 2020-11-16T22:02:19.917 INFO:tasks.rados.rados.2.smithi057.stdout:184: done (1 left) 2020-11-16T22:02:19.917 INFO:tasks.rados.rados.2.smithi057.stdout:185: write (excl) oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 23 2020-11-16T22:02:19.917 INFO:tasks.rados.rados.2.smithi057.stdout:185: seq_num 92 ranges {746244=719144,2100461=503362,3126680=419564} 2020-11-16T22:02:19.925 INFO:tasks.rados.rados.2.smithi057.stdout:185: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 746244 to 1465388 tid 1 2020-11-16T22:02:19.931 INFO:tasks.rados.rados.2.smithi057.stdout:185: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2100461 to 2603823 tid 2 2020-11-16T22:02:19.937 INFO:tasks.rados.rados.2.smithi057.stdout:185: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3126680 to 3546244 tid 3 2020-11-16T22:02:19.937 INFO:tasks.rados.rados.2.smithi057.stdout:186: rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 23 2020-11-16T22:02:19.937 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 10 2020-11-16T22:02:19.937 INFO:tasks.rados.rados.2.smithi057.stdout:183: expect (ObjNum 0 snap 0 seq_num 0) 2020-11-16T22:02:19.999 INFO:tasks.rados.rados.2.smithi057.stdout:185: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:19.999 INFO:tasks.rados.rados.2.smithi057.stdout:185: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:20.000 INFO:tasks.rados.rados.2.smithi057.stdout:183: done (2 left) 2020-11-16T22:02:20.000 INFO:tasks.rados.rados.2.smithi057.stdout:187: snap_remove snap 16 2020-11-16T22:02:20.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:19 smithi057 bash[10301]: cluster 2020-11-16T22:02:18.907728+0000 mon.a (mon.0) 740 : cluster [DBG] osdmap e113: 12 total, 12 up, 12 in 2020-11-16T22:02:20.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:19 smithi016 bash[10302]: cluster 2020-11-16T22:02:18.907728+0000 mon.a (mon.0) 740 : cluster [DBG] osdmap e113: 12 total, 12 up, 12 in 2020-11-16T22:02:20.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:19 smithi195 bash[10218]: cluster 2020-11-16T22:02:18.907728+0000 mon.a (mon.0) 740 : cluster [DBG] osdmap e113: 12 total, 12 up, 12 in 2020-11-16T22:02:20.930 INFO:tasks.rados.rados.2.smithi057.stdout:187: done (2 left) 2020-11-16T22:02:20.930 INFO:tasks.rados.rados.2.smithi057.stdout:188: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:20.931 INFO:tasks.rados.rados.2.smithi057.stdout:188: expect (ObjNum 29 snap 0 seq_num 29) 2020-11-16T22:02:20.931 INFO:tasks.rados.rados.2.smithi057.stdout:189: read oid 24 snap -1 2020-11-16T22:02:20.931 INFO:tasks.rados.rados.2.smithi057.stdout:189: expect (ObjNum 23 snap 0 seq_num 23) 2020-11-16T22:02:20.931 INFO:tasks.rados.rados.2.smithi057.stdout:190: rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 23 2020-11-16T22:02:20.932 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 22 2020-11-16T22:02:20.932 INFO:tasks.rados.rados.2.smithi057.stdout:191: snap_create 2020-11-16T22:02:20.932 INFO:tasks.rados.rados.2.smithi057.stdout:185: finishing write tid 3 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:20.932 INFO:tasks.rados.rados.2.smithi057.stdout:185: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:20.932 INFO:tasks.rados.rados.2.smithi057.stdout:185: finishing write tid 6 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:20.932 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 59 (ObjNum 92 snap 23 seq_num 92) dirty exists 2020-11-16T22:02:20.932 INFO:tasks.rados.rados.2.smithi057.stdout:185: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 92 snap 23 seq_num 92) 2020-11-16T22:02:20.933 INFO:tasks.rados.rados.2.smithi057.stdout:186: finishing rollback tid 0 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:20.933 INFO:tasks.rados.rados.2.smithi057.stdout:186: finishing rollback tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:20.933 INFO:tasks.rados.rados.2.smithi057.stdout:186: finishing rollback tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:20.933 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 47 (ObjNum 16 snap 0 seq_num 16) dirty exists 2020-11-16T22:02:20.941 INFO:tasks.rados.rados.2.smithi057.stdout:190: finishing rollback tid 0 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:20.942 INFO:tasks.rados.rados.2.smithi057.stdout:190: finishing rollback tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:20.942 INFO:tasks.rados.rados.2.smithi057.stdout:190: finishing rollback tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:20.943 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 101 (ObjNum 65 snap 10 seq_num 65) dirty exists 2020-11-16T22:02:20.947 INFO:tasks.rados.rados.2.smithi057.stdout:188: expect (ObjNum 29 snap 0 seq_num 29) 2020-11-16T22:02:21.027 INFO:tasks.rados.rados.2.smithi057.stdout:189: expect (ObjNum 23 snap 0 seq_num 23) 2020-11-16T22:02:21.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:20 smithi057 bash[10301]: cluster 2020-11-16T22:02:19.574959+0000 mgr.x (mgr.24115) 291 : cluster [DBG] pgmap v334: 17 pgs: 17 active+clean; 143 MiB data, 245 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 14 op/s 2020-11-16T22:02:21.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:20 smithi057 bash[10301]: cluster 2020-11-16T22:02:19.917639+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e114: 12 total, 12 up, 12 in 2020-11-16T22:02:21.336 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:20 smithi016 bash[10302]: cluster 2020-11-16T22:02:19.574959+0000 mgr.x (mgr.24115) 291 : cluster [DBG] pgmap v334: 17 pgs: 17 active+clean; 143 MiB data, 245 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 14 op/s 2020-11-16T22:02:21.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:20 smithi016 bash[10302]: cluster 2020-11-16T22:02:19.917639+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e114: 12 total, 12 up, 12 in 2020-11-16T22:02:21.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:20 smithi195 bash[10218]: cluster 2020-11-16T22:02:19.574959+0000 mgr.x (mgr.24115) 291 : cluster [DBG] pgmap v334: 17 pgs: 17 active+clean; 143 MiB data, 245 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 14 op/s 2020-11-16T22:02:21.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:20 smithi195 bash[10218]: cluster 2020-11-16T22:02:19.917639+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e114: 12 total, 12 up, 12 in 2020-11-16T22:02:21.934 INFO:tasks.rados.rados.2.smithi057.stdout:185: done (5 left) 2020-11-16T22:02:21.934 INFO:tasks.rados.rados.2.smithi057.stdout:186: done (4 left) 2020-11-16T22:02:21.935 INFO:tasks.rados.rados.2.smithi057.stdout:188: done (3 left) 2020-11-16T22:02:21.935 INFO:tasks.rados.rados.2.smithi057.stdout:189: done (2 left) 2020-11-16T22:02:21.935 INFO:tasks.rados.rados.2.smithi057.stdout:190: done (1 left) 2020-11-16T22:02:21.935 INFO:tasks.rados.rados.2.smithi057.stdout:191: done (0 left) 2020-11-16T22:02:21.935 INFO:tasks.rados.rados.2.smithi057.stdout:192: read oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:21.935 INFO:tasks.rados.rados.2.smithi057.stdout:192: expect deleted 2020-11-16T22:02:21.935 INFO:tasks.rados.rados.2.smithi057.stdout:193: rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 24 2020-11-16T22:02:21.936 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 15 2020-11-16T22:02:21.936 INFO:tasks.rados.rados.2.smithi057.stdout:194: snap_create 2020-11-16T22:02:21.948 INFO:tasks.rados.rados.2.smithi057.stdout:193: finishing rollback tid 0 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:21.948 INFO:tasks.rados.rados.2.smithi057.stdout:193: finishing rollback tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:21.949 INFO:tasks.rados.rados.2.smithi057.stdout:193: finishing rollback tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:21.949 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 87 (ObjNum 14 snap 0 seq_num 14) dirty exists 2020-11-16T22:02:22.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:21 smithi057 bash[10301]: cluster 2020-11-16T22:02:20.941255+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e115: 12 total, 12 up, 12 in 2020-11-16T22:02:22.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:21 smithi057 bash[10301]: audit 2020-11-16T22:02:21.249399+0000 mon.b (mon.1) 285 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:02:22.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:21 smithi057 bash[10301]: audit 2020-11-16T22:02:21.251095+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:02:22.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:21 smithi057 bash[10301]: audit 2020-11-16T22:02:21.256682+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:02:22.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:21 smithi016 bash[10302]: cluster 2020-11-16T22:02:20.941255+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e115: 12 total, 12 up, 12 in 2020-11-16T22:02:22.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:21 smithi016 bash[10302]: audit 2020-11-16T22:02:21.249399+0000 mon.b (mon.1) 285 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:02:22.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:21 smithi016 bash[10302]: audit 2020-11-16T22:02:21.251095+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:02:22.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:21 smithi016 bash[10302]: audit 2020-11-16T22:02:21.256682+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:02:22.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:21 smithi195 bash[10218]: cluster 2020-11-16T22:02:20.941255+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e115: 12 total, 12 up, 12 in 2020-11-16T22:02:22.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:21 smithi195 bash[10218]: audit 2020-11-16T22:02:21.249399+0000 mon.b (mon.1) 285 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:02:22.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:21 smithi195 bash[10218]: audit 2020-11-16T22:02:21.251095+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:02:22.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:21 smithi195 bash[10218]: audit 2020-11-16T22:02:21.256682+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:02:22.950 INFO:tasks.rados.rados.2.smithi057.stdout:192: done (2 left) 2020-11-16T22:02:22.950 INFO:tasks.rados.rados.2.smithi057.stdout:193: done (1 left) 2020-11-16T22:02:22.950 INFO:tasks.rados.rados.2.smithi057.stdout:194: done (0 left) 2020-11-16T22:02:22.951 INFO:tasks.rados.rados.2.smithi057.stdout:195: write oid 24 current snap is 25 2020-11-16T22:02:22.951 INFO:tasks.rados.rados.2.smithi057.stdout:195: seq_num 93 ranges {763051=794393,2158943=647020,3437750=125301} 2020-11-16T22:02:22.965 INFO:tasks.rados.rados.2.smithi057.stdout:195: writing smithi05720651-24 from 763051 to 1557444 tid 1 2020-11-16T22:02:22.972 INFO:tasks.rados.rados.2.smithi057.stdout:195: writing smithi05720651-24 from 2158943 to 2805963 tid 2 2020-11-16T22:02:22.977 INFO:tasks.rados.rados.2.smithi057.stdout:195: writing smithi05720651-24 from 3437750 to 3563051 tid 3 2020-11-16T22:02:22.977 INFO:tasks.rados.rados.2.smithi057.stdout:196: snap_create 2020-11-16T22:02:22.978 INFO:tasks.rados.rados.2.smithi057.stdout:195: finishing write tid 1 to smithi05720651-24 2020-11-16T22:02:22.980 INFO:tasks.rados.rados.2.smithi057.stdout:195: finishing write tid 2 to smithi05720651-24 2020-11-16T22:02:22.980 INFO:tasks.rados.rados.2.smithi057.stdout:195: finishing write tid 3 to smithi05720651-24 2020-11-16T22:02:22.981 INFO:tasks.rados.rados.2.smithi057.stdout:195: finishing write tid 5 to smithi05720651-24 2020-11-16T22:02:22.981 INFO:tasks.rados.rados.2.smithi057.stdout:195: finishing write tid 6 to smithi05720651-24 2020-11-16T22:02:22.981 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 36 (ObjNum 93 snap 25 seq_num 93) dirty exists 2020-11-16T22:02:22.981 INFO:tasks.rados.rados.2.smithi057.stdout:195: left oid 24 (ObjNum 93 snap 25 seq_num 93) 2020-11-16T22:02:23.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:22 smithi057 bash[10301]: cluster 2020-11-16T22:02:21.575641+0000 mgr.x (mgr.24115) 292 : cluster [DBG] pgmap v337: 17 pgs: 17 active+clean; 155 MiB data, 266 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2020-11-16T22:02:23.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:22 smithi057 bash[10301]: cluster 2020-11-16T22:02:21.943385+0000 mon.a (mon.0) 745 : cluster [DBG] osdmap e116: 12 total, 12 up, 12 in 2020-11-16T22:02:23.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:22 smithi016 bash[10302]: cluster 2020-11-16T22:02:21.575641+0000 mgr.x (mgr.24115) 292 : cluster [DBG] pgmap v337: 17 pgs: 17 active+clean; 155 MiB data, 266 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2020-11-16T22:02:23.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:22 smithi016 bash[10302]: cluster 2020-11-16T22:02:21.943385+0000 mon.a (mon.0) 745 : cluster [DBG] osdmap e116: 12 total, 12 up, 12 in 2020-11-16T22:02:23.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:22 smithi195 bash[10218]: cluster 2020-11-16T22:02:21.575641+0000 mgr.x (mgr.24115) 292 : cluster [DBG] pgmap v337: 17 pgs: 17 active+clean; 155 MiB data, 266 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2020-11-16T22:02:23.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:22 smithi195 bash[10218]: cluster 2020-11-16T22:02:21.943385+0000 mon.a (mon.0) 745 : cluster [DBG] osdmap e116: 12 total, 12 up, 12 in 2020-11-16T22:02:23.961 INFO:tasks.rados.rados.2.smithi057.stdout:195: done (1 left) 2020-11-16T22:02:23.961 INFO:tasks.rados.rados.2.smithi057.stdout:196: done (0 left) 2020-11-16T22:02:23.961 INFO:tasks.rados.rados.2.smithi057.stdout:197: snap_remove snap 20 2020-11-16T22:02:24.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:23 smithi016 bash[10302]: cluster 2020-11-16T22:02:22.961050+0000 mon.a (mon.0) 746 : cluster [DBG] osdmap e117: 12 total, 12 up, 12 in 2020-11-16T22:02:24.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:23 smithi195 bash[10218]: cluster 2020-11-16T22:02:22.961050+0000 mon.a (mon.0) 746 : cluster [DBG] osdmap e117: 12 total, 12 up, 12 in 2020-11-16T22:02:24.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:23 smithi057 bash[10301]: cluster 2020-11-16T22:02:22.961050+0000 mon.a (mon.0) 746 : cluster [DBG] osdmap e117: 12 total, 12 up, 12 in 2020-11-16T22:02:24.866 INFO:tasks.rados.rados.2.smithi057.stdout:197: done (0 left) 2020-11-16T22:02:24.866 INFO:tasks.rados.rados.2.smithi057.stdout:198: write (excl) oid 36 current snap is 26 2020-11-16T22:02:24.867 INFO:tasks.rados.rados.2.smithi057.stdout:198: seq_num 94 ranges {779858=469642,1817425=507031,2781526=586628} 2020-11-16T22:02:24.881 INFO:tasks.rados.rados.2.smithi057.stdout:198: writing smithi05720651-36 from 779858 to 1249500 tid 1 2020-11-16T22:02:24.888 INFO:tasks.rados.rados.2.smithi057.stdout:198: writing smithi05720651-36 from 1817425 to 2324456 tid 2 2020-11-16T22:02:24.894 INFO:tasks.rados.rados.2.smithi057.stdout:198: writing smithi05720651-36 from 2781526 to 3368154 tid 3 2020-11-16T22:02:24.895 INFO:tasks.rados.rados.2.smithi057.stdout:199: rollback oid 20 current snap is 26 2020-11-16T22:02:24.895 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 20 to 21 2020-11-16T22:02:24.895 INFO:tasks.rados.rados.2.smithi057.stdout:198: finishing write tid 1 to smithi05720651-36 2020-11-16T22:02:24.895 INFO:tasks.rados.rados.2.smithi057.stdout:200: snap_remove snap 10 2020-11-16T22:02:25.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:24 smithi016 bash[10302]: cluster 2020-11-16T22:02:23.576311+0000 mgr.x (mgr.24115) 293 : cluster [DBG] pgmap v340: 17 pgs: 17 active+clean; 156 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.4 MiB/s wr, 15 op/s 2020-11-16T22:02:25.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:24 smithi016 bash[10302]: cluster 2020-11-16T22:02:23.970724+0000 mon.a (mon.0) 747 : cluster [DBG] osdmap e118: 12 total, 12 up, 12 in 2020-11-16T22:02:25.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:24 smithi016 bash[10302]: cluster 2020-11-16T22:02:24.876226+0000 mon.a (mon.0) 748 : cluster [DBG] osdmap e119: 12 total, 12 up, 12 in 2020-11-16T22:02:25.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:24 smithi195 bash[10218]: cluster 2020-11-16T22:02:23.576311+0000 mgr.x (mgr.24115) 293 : cluster [DBG] pgmap v340: 17 pgs: 17 active+clean; 156 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.4 MiB/s wr, 15 op/s 2020-11-16T22:02:25.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:24 smithi195 bash[10218]: cluster 2020-11-16T22:02:23.970724+0000 mon.a (mon.0) 747 : cluster [DBG] osdmap e118: 12 total, 12 up, 12 in 2020-11-16T22:02:25.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:24 smithi195 bash[10218]: cluster 2020-11-16T22:02:24.876226+0000 mon.a (mon.0) 748 : cluster [DBG] osdmap e119: 12 total, 12 up, 12 in 2020-11-16T22:02:25.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:24 smithi057 bash[10301]: cluster 2020-11-16T22:02:23.576311+0000 mgr.x (mgr.24115) 293 : cluster [DBG] pgmap v340: 17 pgs: 17 active+clean; 156 MiB data, 269 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 2.4 MiB/s wr, 15 op/s 2020-11-16T22:02:25.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:24 smithi057 bash[10301]: cluster 2020-11-16T22:02:23.970724+0000 mon.a (mon.0) 747 : cluster [DBG] osdmap e118: 12 total, 12 up, 12 in 2020-11-16T22:02:25.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:24 smithi057 bash[10301]: cluster 2020-11-16T22:02:24.876226+0000 mon.a (mon.0) 748 : cluster [DBG] osdmap e119: 12 total, 12 up, 12 in 2020-11-16T22:02:25.876 INFO:tasks.rados.rados.2.smithi057.stdout:200: done (2 left) 2020-11-16T22:02:25.877 INFO:tasks.rados.rados.2.smithi057.stdout:201: write oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 26 2020-11-16T22:02:25.877 INFO:tasks.rados.rados.2.smithi057.stdout:201: seq_num 95 ranges {796665=544891,1759554=650689,2976243=620422} 2020-11-16T22:02:25.888 INFO:tasks.rados.rados.2.smithi057.stdout:201: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 796665 to 1341556 tid 1 2020-11-16T22:02:25.894 INFO:tasks.rados.rados.2.smithi057.stdout:201: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1759554 to 2410243 tid 2 2020-11-16T22:02:25.901 INFO:tasks.rados.rados.2.smithi057.stdout:201: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2976243 to 3596665 tid 3 2020-11-16T22:02:25.901 INFO:tasks.rados.rados.2.smithi057.stdout:202: delete oid 24 current snap is 26 2020-11-16T22:02:25.901 INFO:tasks.rados.rados.2.smithi057.stdout:198: finishing write tid 2 to smithi05720651-36 2020-11-16T22:02:25.901 INFO:tasks.rados.rados.2.smithi057.stdout:199: finishing rollback tid 0 to smithi05720651-20 2020-11-16T22:02:25.901 INFO:tasks.rados.rados.2.smithi057.stdout:199: finishing rollback tid 1 to smithi05720651-20 2020-11-16T22:02:25.902 INFO:tasks.rados.rados.2.smithi057.stdout:198: finishing write tid 3 to smithi05720651-36 2020-11-16T22:02:25.902 INFO:tasks.rados.rados.2.smithi057.stdout:199: finishing rollback tid 2 to smithi05720651-20 2020-11-16T22:02:25.902 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 29 (ObjNum 11 snap 0 seq_num 11) dirty exists 2020-11-16T22:02:25.902 INFO:tasks.rados.rados.2.smithi057.stdout:198: finishing write tid 5 to smithi05720651-36 2020-11-16T22:02:25.902 INFO:tasks.rados.rados.2.smithi057.stdout:198: finishing write tid 6 to smithi05720651-36 2020-11-16T22:02:25.902 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 96 (ObjNum 94 snap 26 seq_num 94) dirty exists 2020-11-16T22:02:25.902 INFO:tasks.rados.rados.2.smithi057.stdout:198: left oid 36 (ObjNum 94 snap 26 seq_num 94) 2020-11-16T22:02:25.903 INFO:tasks.rados.rados.2.smithi057.stdout:201: finishing write tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:25.903 INFO:tasks.rados.rados.2.smithi057.stdout:201: finishing write tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:25.905 INFO:tasks.rados.rados.2.smithi057.stdout:201: finishing write tid 3 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:25.905 INFO:tasks.rados.rados.2.smithi057.stdout:201: finishing write tid 5 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:25.906 INFO:tasks.rados.rados.2.smithi057.stdout:201: finishing write tid 6 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:25.906 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 98 (ObjNum 95 snap 26 seq_num 95) dirty exists 2020-11-16T22:02:25.906 INFO:tasks.rados.rados.2.smithi057.stdout:201: left oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 95 snap 26 seq_num 95) 2020-11-16T22:02:25.908 INFO:tasks.rados.rados.2.smithi057.stdout:198: done (3 left) 2020-11-16T22:02:25.909 INFO:tasks.rados.rados.2.smithi057.stdout:199: done (2 left) 2020-11-16T22:02:25.909 INFO:tasks.rados.rados.2.smithi057.stdout:201: done (1 left) 2020-11-16T22:02:25.909 INFO:tasks.rados.rados.2.smithi057.stdout:202: done (0 left) 2020-11-16T22:02:25.909 INFO:tasks.rados.rados.2.smithi057.stdout:203: snap_create 2020-11-16T22:02:26.879 INFO:tasks.rados.rados.2.smithi057.stdout:203: done (0 left) 2020-11-16T22:02:26.880 INFO:tasks.rados.rados.2.smithi057.stdout:204: write (excl) oid 48 current snap is 27 2020-11-16T22:02:26.880 INFO:tasks.rados.rados.2.smithi057.stdout:204: seq_num 97 ranges {430279=695389,1876518=654358,3031089=536797} 2020-11-16T22:02:26.892 INFO:tasks.rados.rados.2.smithi057.stdout:204: writing smithi05720651-48 from 430279 to 1125668 tid 1 2020-11-16T22:02:26.900 INFO:tasks.rados.rados.2.smithi057.stdout:204: writing smithi05720651-48 from 1876518 to 2530876 tid 2 2020-11-16T22:02:26.907 INFO:tasks.rados.rados.2.smithi057.stdout:204: writing smithi05720651-48 from 3031089 to 3567886 tid 3 2020-11-16T22:02:26.907 INFO:tasks.rados.rados.2.smithi057.stdout:205: rollback oid 36 current snap is 27 2020-11-16T22:02:26.907 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 36 to 22 2020-11-16T22:02:26.907 INFO:tasks.rados.rados.2.smithi057.stdout:204: finishing write tid 1 to smithi05720651-48 2020-11-16T22:02:26.907 INFO:tasks.rados.rados.2.smithi057.stdout:206: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:26.908 INFO:tasks.rados.rados.2.smithi057.stdout:206: expect (ObjNum 20 snap 0 seq_num 20) 2020-11-16T22:02:26.908 INFO:tasks.rados.rados.2.smithi057.stdout:207: write oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 27 2020-11-16T22:02:26.908 INFO:tasks.rados.rados.2.smithi057.stdout:207: seq_num 98 ranges {447086=770638,1935000=798016,3458512=188574} 2020-11-16T22:02:26.913 INFO:tasks.rados.rados.2.smithi057.stdout:207: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 447086 to 1217724 tid 1 2020-11-16T22:02:26.922 INFO:tasks.rados.rados.2.smithi057.stdout:207: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1935000 to 2733016 tid 2 2020-11-16T22:02:26.928 INFO:tasks.rados.rados.2.smithi057.stdout:207: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3458512 to 3647086 tid 3 2020-11-16T22:02:26.928 INFO:tasks.rados.rados.2.smithi057.stdout:208: delete oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 27 2020-11-16T22:02:26.928 INFO:tasks.rados.rados.2.smithi057.stdout:204: finishing write tid 2 to smithi05720651-48 2020-11-16T22:02:26.928 INFO:tasks.rados.rados.2.smithi057.stdout:205: finishing rollback tid 0 to smithi05720651-36 2020-11-16T22:02:26.928 INFO:tasks.rados.rados.2.smithi057.stdout:204: finishing write tid 3 to smithi05720651-48 2020-11-16T22:02:26.928 INFO:tasks.rados.rados.2.smithi057.stdout:204: finishing write tid 5 to smithi05720651-48 2020-11-16T22:02:26.929 INFO:tasks.rados.rados.2.smithi057.stdout:206: expect (ObjNum 20 snap 0 seq_num 20) 2020-11-16T22:02:27.007 INFO:tasks.rados.rados.2.smithi057.stdout:204: finishing write tid 6 to smithi05720651-48 2020-11-16T22:02:27.007 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 32 (ObjNum 97 snap 27 seq_num 97) dirty exists 2020-11-16T22:02:27.008 INFO:tasks.rados.rados.2.smithi057.stdout:204: left oid 48 (ObjNum 97 snap 27 seq_num 97) 2020-11-16T22:02:27.008 INFO:tasks.rados.rados.2.smithi057.stdout:205: finishing rollback tid 1 to smithi05720651-36 2020-11-16T22:02:27.008 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 105 (ObjNum 321 snap 0 seq_num 1864380722) dirty dne 2020-11-16T22:02:27.008 INFO:tasks.rados.rados.2.smithi057.stdout:207: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:27.008 INFO:tasks.rados.rados.2.smithi057.stdout:207: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:27.008 INFO:tasks.rados.rados.2.smithi057.stdout:207: finishing write tid 3 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:27.009 INFO:tasks.rados.rados.2.smithi057.stdout:204: done (4 left) 2020-11-16T22:02:27.009 INFO:tasks.rados.rados.2.smithi057.stdout:205: done (3 left) 2020-11-16T22:02:27.009 INFO:tasks.rados.rados.2.smithi057.stdout:206: done (2 left) 2020-11-16T22:02:27.009 INFO:tasks.rados.rados.2.smithi057.stdout:208: done (1 left) 2020-11-16T22:02:27.009 INFO:tasks.rados.rados.2.smithi057.stdout:209: snap_create 2020-11-16T22:02:27.138 INFO:tasks.rados.rados.2.smithi057.stdout:207: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:27.139 INFO:tasks.rados.rados.2.smithi057.stdout:207: finishing write tid 6 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:27.139 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 110 (ObjNum 98 snap 27 seq_num 98) dirty exists 2020-11-16T22:02:27.139 INFO:tasks.rados.rados.2.smithi057.stdout:207: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 98 snap 27 seq_num 98) 2020-11-16T22:02:27.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:26 smithi057 bash[10301]: cluster 2020-11-16T22:02:25.576977+0000 mgr.x (mgr.24115) 294 : cluster [DBG] pgmap v343: 17 pgs: 17 active+clean; 158 MiB data, 272 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 383 KiB/s wr, 6 op/s 2020-11-16T22:02:27.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:26 smithi057 bash[10301]: cluster 2020-11-16T22:02:25.886709+0000 mon.a (mon.0) 749 : cluster [DBG] osdmap e120: 12 total, 12 up, 12 in 2020-11-16T22:02:27.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:26 smithi016 bash[10302]: cluster 2020-11-16T22:02:25.576977+0000 mgr.x (mgr.24115) 294 : cluster [DBG] pgmap v343: 17 pgs: 17 active+clean; 158 MiB data, 272 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 383 KiB/s wr, 6 op/s 2020-11-16T22:02:27.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:26 smithi016 bash[10302]: cluster 2020-11-16T22:02:25.886709+0000 mon.a (mon.0) 749 : cluster [DBG] osdmap e120: 12 total, 12 up, 12 in 2020-11-16T22:02:27.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:26 smithi195 bash[10218]: cluster 2020-11-16T22:02:25.576977+0000 mgr.x (mgr.24115) 294 : cluster [DBG] pgmap v343: 17 pgs: 17 active+clean; 158 MiB data, 272 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 383 KiB/s wr, 6 op/s 2020-11-16T22:02:27.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:26 smithi195 bash[10218]: cluster 2020-11-16T22:02:25.886709+0000 mon.a (mon.0) 749 : cluster [DBG] osdmap e120: 12 total, 12 up, 12 in 2020-11-16T22:02:27.895 INFO:tasks.rados.rados.2.smithi057.stdout:207: done (1 left) 2020-11-16T22:02:27.895 INFO:tasks.rados.rados.2.smithi057.stdout:209: done (0 left) 2020-11-16T22:02:27.895 INFO:tasks.rados.rados.2.smithi057.stdout:210: read oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:27.895 INFO:tasks.rados.rados.2.smithi057.stdout:210: expect deleted 2020-11-16T22:02:27.896 INFO:tasks.rados.rados.2.smithi057.stdout:211: snap_remove snap 22 2020-11-16T22:02:28.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:27 smithi057 bash[10301]: cluster 2020-11-16T22:02:26.889305+0000 mon.a (mon.0) 750 : cluster [DBG] osdmap e121: 12 total, 12 up, 12 in 2020-11-16T22:02:28.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:27 smithi016 bash[10302]: cluster 2020-11-16T22:02:26.889305+0000 mon.a (mon.0) 750 : cluster [DBG] osdmap e121: 12 total, 12 up, 12 in 2020-11-16T22:02:28.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:27 smithi195 bash[10218]: cluster 2020-11-16T22:02:26.889305+0000 mon.a (mon.0) 750 : cluster [DBG] osdmap e121: 12 total, 12 up, 12 in 2020-11-16T22:02:28.907 INFO:tasks.rados.rados.2.smithi057.stdout:211: done (1 left) 2020-11-16T22:02:28.907 INFO:tasks.rados.rados.2.smithi057.stdout:212: read oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:28.907 INFO:tasks.rados.rados.2.smithi057.stdout:212: expect (ObjNum 48 snap 0 seq_num 48) 2020-11-16T22:02:28.907 INFO:tasks.rados.rados.2.smithi057.stdout:213: copy_from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 50 current snap is 28 2020-11-16T22:02:28.907 INFO:tasks.rados.rados.2.smithi057.stdout:210: done (2 left) 2020-11-16T22:02:28.908 INFO:tasks.rados.rados.2.smithi057.stdout:214: read oid 34 snap -1 2020-11-16T22:02:28.908 INFO:tasks.rados.rados.2.smithi057.stdout:214: expect deleted 2020-11-16T22:02:28.908 INFO:tasks.rados.rados.2.smithi057.stdout:215: delete oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 28 2020-11-16T22:02:28.917 INFO:tasks.rados.rados.2.smithi057.stdout:212: expect (ObjNum 48 snap 0 seq_num 48) 2020-11-16T22:02:29.006 INFO:tasks.rados.rados.2.smithi057.stdout:213: finishing copy_from to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:29.006 INFO:tasks.rados.rados.2.smithi057.stdout:213: got expected ENOENT (src dne) 2020-11-16T22:02:29.007 INFO:tasks.rados.rados.2.smithi057.stdout:213: finishing copy_from racing read to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:29.007 INFO:tasks.rados.rados.2.smithi057.stdout:212: done (3 left) 2020-11-16T22:02:29.007 INFO:tasks.rados.rados.2.smithi057.stdout:213: done (2 left) 2020-11-16T22:02:29.007 INFO:tasks.rados.rados.2.smithi057.stdout:214: done (1 left) 2020-11-16T22:02:29.007 INFO:tasks.rados.rados.2.smithi057.stdout:215: done (0 left) 2020-11-16T22:02:29.007 INFO:tasks.rados.rados.2.smithi057.stdout:216: snap_remove snap 12 2020-11-16T22:02:29.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:28 smithi057 bash[10301]: cluster 2020-11-16T22:02:27.577684+0000 mgr.x (mgr.24115) 295 : cluster [DBG] pgmap v346: 17 pgs: 17 active+clean; 157 MiB data, 272 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 383 KiB/s wr, 6 op/s 2020-11-16T22:02:29.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:28 smithi057 bash[10301]: cluster 2020-11-16T22:02:27.906150+0000 mon.a (mon.0) 751 : cluster [DBG] osdmap e122: 12 total, 12 up, 12 in 2020-11-16T22:02:29.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:28 smithi016 bash[10302]: cluster 2020-11-16T22:02:27.577684+0000 mgr.x (mgr.24115) 295 : cluster [DBG] pgmap v346: 17 pgs: 17 active+clean; 157 MiB data, 272 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 383 KiB/s wr, 6 op/s 2020-11-16T22:02:29.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:28 smithi016 bash[10302]: cluster 2020-11-16T22:02:27.906150+0000 mon.a (mon.0) 751 : cluster [DBG] osdmap e122: 12 total, 12 up, 12 in 2020-11-16T22:02:29.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:28 smithi195 bash[10218]: cluster 2020-11-16T22:02:27.577684+0000 mgr.x (mgr.24115) 295 : cluster [DBG] pgmap v346: 17 pgs: 17 active+clean; 157 MiB data, 272 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 383 KiB/s wr, 6 op/s 2020-11-16T22:02:29.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:28 smithi195 bash[10218]: cluster 2020-11-16T22:02:27.906150+0000 mon.a (mon.0) 751 : cluster [DBG] osdmap e122: 12 total, 12 up, 12 in 2020-11-16T22:02:29.868 INFO:tasks.rados.rados.2.smithi057.stdout:216: done (0 left) 2020-11-16T22:02:29.869 INFO:tasks.rados.rados.2.smithi057.stdout:217: read oid 26 snap -1 2020-11-16T22:02:29.869 INFO:tasks.rados.rados.2.smithi057.stdout:217: expect (ObjNum 53 snap 3 seq_num 53) 2020-11-16T22:02:29.869 INFO:tasks.rados.rados.2.smithi057.stdout:218: rollback oid 50 current snap is 28 2020-11-16T22:02:29.869 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 50 to 23 2020-11-16T22:02:29.869 INFO:tasks.rados.rados.2.smithi057.stdout:219: snap_create 2020-11-16T22:02:29.879 INFO:tasks.rados.rados.2.smithi057.stdout:218: finishing rollback tid 1 to smithi05720651-50 2020-11-16T22:02:29.879 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 46 (ObjNum 129 snap 0 seq_num 1120350264) dirty dne 2020-11-16T22:02:29.883 INFO:tasks.rados.rados.2.smithi057.stdout:217: expect (ObjNum 53 snap 3 seq_num 53) 2020-11-16T22:02:30.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:29 smithi057 bash[10301]: cluster 2020-11-16T22:02:28.913916+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e123: 12 total, 12 up, 12 in 2020-11-16T22:02:30.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:29 smithi057 bash[10301]: audit 2020-11-16T22:02:29.719672+0000 mon.b (mon.1) 286 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:02:30.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:29 smithi057 bash[10301]: audit 2020-11-16T22:02:29.721331+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:02:30.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:29 smithi057 bash[10301]: audit 2020-11-16T22:02:29.728250+0000 mon.b (mon.1) 287 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:02:30.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:29 smithi057 bash[10301]: audit 2020-11-16T22:02:29.729818+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:02:30.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:29 smithi057 bash[10301]: cluster 2020-11-16T22:02:29.878669+0000 mon.a (mon.0) 755 : cluster [DBG] osdmap e124: 12 total, 12 up, 12 in 2020-11-16T22:02:30.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:29 smithi016 bash[10302]: cluster 2020-11-16T22:02:28.913916+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e123: 12 total, 12 up, 12 in 2020-11-16T22:02:30.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:29 smithi016 bash[10302]: audit 2020-11-16T22:02:29.719672+0000 mon.b (mon.1) 286 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:02:30.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:29 smithi016 bash[10302]: audit 2020-11-16T22:02:29.721331+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:02:30.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:29 smithi016 bash[10302]: audit 2020-11-16T22:02:29.728250+0000 mon.b (mon.1) 287 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:02:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:29 smithi016 bash[10302]: audit 2020-11-16T22:02:29.729818+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:02:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:29 smithi016 bash[10302]: cluster 2020-11-16T22:02:29.878669+0000 mon.a (mon.0) 755 : cluster [DBG] osdmap e124: 12 total, 12 up, 12 in 2020-11-16T22:02:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:29 smithi195 bash[10218]: cluster 2020-11-16T22:02:28.913916+0000 mon.a (mon.0) 752 : cluster [DBG] osdmap e123: 12 total, 12 up, 12 in 2020-11-16T22:02:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:29 smithi195 bash[10218]: audit 2020-11-16T22:02:29.719672+0000 mon.b (mon.1) 286 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:02:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:29 smithi195 bash[10218]: audit 2020-11-16T22:02:29.721331+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:02:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:29 smithi195 bash[10218]: audit 2020-11-16T22:02:29.728250+0000 mon.b (mon.1) 287 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:02:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:29 smithi195 bash[10218]: audit 2020-11-16T22:02:29.729818+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:02:30.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:29 smithi195 bash[10218]: cluster 2020-11-16T22:02:29.878669+0000 mon.a (mon.0) 755 : cluster [DBG] osdmap e124: 12 total, 12 up, 12 in 2020-11-16T22:02:30.882 INFO:tasks.rados.rados.2.smithi057.stdout:217: done (2 left) 2020-11-16T22:02:30.882 INFO:tasks.rados.rados.2.smithi057.stdout:218: done (1 left) 2020-11-16T22:02:30.882 INFO:tasks.rados.rados.2.smithi057.stdout:219: done (0 left) 2020-11-16T22:02:30.882 INFO:tasks.rados.rados.2.smithi057.stdout:220: write (excl) oid 4 current snap is 29 2020-11-16T22:02:30.883 INFO:tasks.rados.rados.2.smithi057.stdout:220: seq_num 101 ranges {497507=712738,1710446=661696,3140781=556726} 2020-11-16T22:02:30.896 INFO:tasks.rados.rados.2.smithi057.stdout:220: writing smithi05720651-4 from 497507 to 1210245 tid 1 2020-11-16T22:02:30.903 INFO:tasks.rados.rados.2.smithi057.stdout:220: writing smithi05720651-4 from 1710446 to 2372142 tid 2 2020-11-16T22:02:30.911 INFO:tasks.rados.rados.2.smithi057.stdout:220: writing smithi05720651-4 from 3140781 to 3697507 tid 3 2020-11-16T22:02:30.912 INFO:tasks.rados.rados.2.smithi057.stdout:221: copy_from oid 18 from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 29 2020-11-16T22:02:30.912 INFO:tasks.rados.rados.2.smithi057.stdout:220: finishing write tid 1 to smithi05720651-4 2020-11-16T22:02:30.912 INFO:tasks.rados.rados.2.smithi057.stdout:220: finishing write tid 2 to smithi05720651-4 2020-11-16T22:02:30.912 INFO:tasks.rados.rados.2.smithi057.stdout:222: snap_create 2020-11-16T22:02:30.916 INFO:tasks.rados.rados.2.smithi057.stdout:220: finishing write tid 3 to smithi05720651-4 2020-11-16T22:02:30.916 INFO:tasks.rados.rados.2.smithi057.stdout:220: finishing write tid 5 to smithi05720651-4 2020-11-16T22:02:30.917 INFO:tasks.rados.rados.2.smithi057.stdout:220: finishing write tid 6 to smithi05720651-4 2020-11-16T22:02:30.917 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 44 (ObjNum 101 snap 29 seq_num 101) dirty exists 2020-11-16T22:02:30.917 INFO:tasks.rados.rados.2.smithi057.stdout:220: left oid 4 (ObjNum 101 snap 29 seq_num 101) 2020-11-16T22:02:30.932 INFO:tasks.rados.rados.2.smithi057.stdout:221: finishing copy_from to smithi05720651-18 2020-11-16T22:02:30.932 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 59 (ObjNum 92 snap 23 seq_num 92) dirty exists 2020-11-16T22:02:30.933 INFO:tasks.rados.rados.2.smithi057.stdout:221: finishing copy_from racing read to smithi05720651-18 2020-11-16T22:02:31.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:30 smithi057 bash[10301]: cluster 2020-11-16T22:02:29.578462+0000 mgr.x (mgr.24115) 296 : cluster [DBG] pgmap v349: 17 pgs: 17 active+clean; 159 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 461 KiB/s wr, 5 op/s 2020-11-16T22:02:31.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:30 smithi057 bash[10301]: cluster 2020-11-16T22:02:30.888852+0000 mon.a (mon.0) 756 : cluster [DBG] osdmap e125: 12 total, 12 up, 12 in 2020-11-16T22:02:31.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:30 smithi016 bash[10302]: cluster 2020-11-16T22:02:29.578462+0000 mgr.x (mgr.24115) 296 : cluster [DBG] pgmap v349: 17 pgs: 17 active+clean; 159 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 461 KiB/s wr, 5 op/s 2020-11-16T22:02:31.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:30 smithi016 bash[10302]: cluster 2020-11-16T22:02:30.888852+0000 mon.a (mon.0) 756 : cluster [DBG] osdmap e125: 12 total, 12 up, 12 in 2020-11-16T22:02:31.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:30 smithi195 bash[10218]: cluster 2020-11-16T22:02:29.578462+0000 mgr.x (mgr.24115) 296 : cluster [DBG] pgmap v349: 17 pgs: 17 active+clean; 159 MiB data, 278 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 461 KiB/s wr, 5 op/s 2020-11-16T22:02:31.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:30 smithi195 bash[10218]: cluster 2020-11-16T22:02:30.888852+0000 mon.a (mon.0) 756 : cluster [DBG] osdmap e125: 12 total, 12 up, 12 in 2020-11-16T22:02:31.922 INFO:tasks.rados.rados.2.smithi057.stdout:220: done (2 left) 2020-11-16T22:02:31.923 INFO:tasks.rados.rados.2.smithi057.stdout:221: done (1 left) 2020-11-16T22:02:31.923 INFO:tasks.rados.rados.2.smithi057.stdout:222: done (0 left) 2020-11-16T22:02:31.923 INFO:tasks.rados.rados.2.smithi057.stdout:223: delete oid 6 current snap is 30 2020-11-16T22:02:31.930 INFO:tasks.rados.rados.2.smithi057.stdout:223: done (0 left) 2020-11-16T22:02:31.930 INFO:tasks.rados.rados.2.smithi057.stdout:224: snap_create 2020-11-16T22:02:32.934 INFO:tasks.rados.rados.2.smithi057.stdout:224: done (0 left) 2020-11-16T22:02:32.934 INFO:tasks.rados.rados.2.smithi057.stdout:225: write oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 31 2020-11-16T22:02:32.934 INFO:tasks.rados.rados.2.smithi057.stdout:225: seq_num 103 ranges {531121=463236,1711057=665365,3079274=651847} 2020-11-16T22:02:32.947 INFO:tasks.rados.rados.2.smithi057.stdout:225: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 531121 to 994357 tid 1 2020-11-16T22:02:32.955 INFO:tasks.rados.rados.2.smithi057.stdout:225: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1711057 to 2376422 tid 2 2020-11-16T22:02:32.963 INFO:tasks.rados.rados.2.smithi057.stdout:225: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3079274 to 3731121 tid 3 2020-11-16T22:02:32.963 INFO:tasks.rados.rados.2.smithi057.stdout:226: snap_create 2020-11-16T22:02:32.963 INFO:tasks.rados.rados.2.smithi057.stdout:225: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:32.964 INFO:tasks.rados.rados.2.smithi057.stdout:225: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:32.969 INFO:tasks.rados.rados.2.smithi057.stdout:225: finishing write tid 3 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:32.970 INFO:tasks.rados.rados.2.smithi057.stdout:225: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:32.970 INFO:tasks.rados.rados.2.smithi057.stdout:225: finishing write tid 6 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:32.970 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 124 (ObjNum 103 snap 31 seq_num 103) dirty exists 2020-11-16T22:02:32.970 INFO:tasks.rados.rados.2.smithi057.stdout:225: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 103 snap 31 seq_num 103) 2020-11-16T22:02:33.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:32 smithi057 bash[10301]: cluster 2020-11-16T22:02:31.579193+0000 mgr.x (mgr.24115) 297 : cluster [DBG] pgmap v352: 17 pgs: 17 active+clean; 169 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.5 MiB/s wr, 15 op/s 2020-11-16T22:02:33.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:32 smithi057 bash[10301]: cluster 2020-11-16T22:02:31.933352+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e126: 12 total, 12 up, 12 in 2020-11-16T22:02:33.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:32 smithi016 bash[10302]: cluster 2020-11-16T22:02:31.579193+0000 mgr.x (mgr.24115) 297 : cluster [DBG] pgmap v352: 17 pgs: 17 active+clean; 169 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.5 MiB/s wr, 15 op/s 2020-11-16T22:02:33.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:32 smithi016 bash[10302]: cluster 2020-11-16T22:02:31.933352+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e126: 12 total, 12 up, 12 in 2020-11-16T22:02:33.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:32 smithi195 bash[10218]: cluster 2020-11-16T22:02:31.579193+0000 mgr.x (mgr.24115) 297 : cluster [DBG] pgmap v352: 17 pgs: 17 active+clean; 169 MiB data, 287 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.5 MiB/s wr, 15 op/s 2020-11-16T22:02:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:32 smithi195 bash[10218]: cluster 2020-11-16T22:02:31.933352+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e126: 12 total, 12 up, 12 in 2020-11-16T22:02:33.942 INFO:tasks.rados.rados.2.smithi057.stdout:225: done (1 left) 2020-11-16T22:02:33.943 INFO:tasks.rados.rados.2.smithi057.stdout:226: done (0 left) 2020-11-16T22:02:33.943 INFO:tasks.rados.rados.2.smithi057.stdout:227: write (excl) oid 16 current snap is 32 2020-11-16T22:02:33.943 INFO:tasks.rados.rados.2.smithi057.stdout:227: seq_num 104 ranges {547928=538485,1769539=409023,2706697=532054} 2020-11-16T22:02:33.958 INFO:tasks.rados.rados.2.smithi057.stdout:227: writing smithi05720651-16 from 547928 to 1086413 tid 1 2020-11-16T22:02:33.965 INFO:tasks.rados.rados.2.smithi057.stdout:227: writing smithi05720651-16 from 1769539 to 2178562 tid 2 2020-11-16T22:02:33.971 INFO:tasks.rados.rados.2.smithi057.stdout:227: writing smithi05720651-16 from 2706697 to 3238751 tid 3 2020-11-16T22:02:33.971 INFO:tasks.rados.rados.2.smithi057.stdout:228: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 30 2020-11-16T22:02:33.971 INFO:tasks.rados.rados.2.smithi057.stdout:228: expect (ObjNum 89 snap 22 seq_num 89) 2020-11-16T22:02:33.971 INFO:tasks.rados.rados.2.smithi057.stdout:229: write (excl) oid 34 current snap is 32 2020-11-16T22:02:33.972 INFO:tasks.rados.rados.2.smithi057.stdout:229: seq_num 105 ranges {564735=613734,1828021=669034,3134120=630615} 2020-11-16T22:02:33.978 INFO:tasks.rados.rados.2.smithi057.stdout:229: writing smithi05720651-34 from 564735 to 1178469 tid 1 2020-11-16T22:02:33.985 INFO:tasks.rados.rados.2.smithi057.stdout:229: writing smithi05720651-34 from 1828021 to 2497055 tid 2 2020-11-16T22:02:33.993 INFO:tasks.rados.rados.2.smithi057.stdout:229: writing smithi05720651-34 from 3134120 to 3764735 tid 3 2020-11-16T22:02:33.993 INFO:tasks.rados.rados.2.smithi057.stdout:230: write (excl) oid 14 current snap is 32 2020-11-16T22:02:33.994 INFO:tasks.rados.rados.2.smithi057.stdout:230: seq_num 106 ranges {581542=688983,1886503=412692,2761543=670951} 2020-11-16T22:02:34.000 INFO:tasks.rados.rados.2.smithi057.stdout:230: writing smithi05720651-14 from 581542 to 1270525 tid 1 2020-11-16T22:02:34.006 INFO:tasks.rados.rados.2.smithi057.stdout:230: writing smithi05720651-14 from 1886503 to 2299195 tid 2 2020-11-16T22:02:34.013 INFO:tasks.rados.rados.2.smithi057.stdout:230: writing smithi05720651-14 from 2761543 to 3432494 tid 3 2020-11-16T22:02:34.013 INFO:tasks.rados.rados.2.smithi057.stdout:231: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 15 2020-11-16T22:02:34.014 INFO:tasks.rados.rados.2.smithi057.stdout:231: expect (ObjNum 66 snap 10 seq_num 66) 2020-11-16T22:02:34.014 INFO:tasks.rados.rados.2.smithi057.stdout:232: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 25 2020-11-16T22:02:34.014 INFO:tasks.rados.rados.2.smithi057.stdout:232: expect (ObjNum 62 snap 8 seq_num 62) 2020-11-16T22:02:34.014 INFO:tasks.rados.rados.2.smithi057.stdout:233: write (excl) oid 32 current snap is 32 2020-11-16T22:02:34.014 INFO:tasks.rados.rados.2.smithi057.stdout:233: seq_num 107 ranges {598349=480585,1544985=672703,2905319=482223} 2020-11-16T22:02:34.019 INFO:tasks.rados.rados.2.smithi057.stdout:233: writing smithi05720651-32 from 598349 to 1078934 tid 1 2020-11-16T22:02:34.026 INFO:tasks.rados.rados.2.smithi057.stdout:233: writing smithi05720651-32 from 1544985 to 2217688 tid 2 2020-11-16T22:02:34.032 INFO:tasks.rados.rados.2.smithi057.stdout:233: writing smithi05720651-32 from 2905319 to 3387542 tid 3 2020-11-16T22:02:34.033 INFO:tasks.rados.rados.2.smithi057.stdout:234: snap_remove snap 21 2020-11-16T22:02:34.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:33 smithi057 bash[10301]: cluster 2020-11-16T22:02:32.942968+0000 mon.a (mon.0) 758 : cluster [DBG] osdmap e127: 12 total, 12 up, 12 in 2020-11-16T22:02:34.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:33 smithi016 bash[10302]: cluster 2020-11-16T22:02:32.942968+0000 mon.a (mon.0) 758 : cluster [DBG] osdmap e127: 12 total, 12 up, 12 in 2020-11-16T22:02:34.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:33 smithi195 bash[10218]: cluster 2020-11-16T22:02:32.942968+0000 mon.a (mon.0) 758 : cluster [DBG] osdmap e127: 12 total, 12 up, 12 in 2020-11-16T22:02:34.872 INFO:tasks.rados.rados.2.smithi057.stdout:234: done (7 left) 2020-11-16T22:02:34.872 INFO:tasks.rados.rados.2.smithi057.stdout:235: delete oid 18 current snap is 32 2020-11-16T22:02:34.872 INFO:tasks.rados.rados.2.smithi057.stdout:227: finishing write tid 1 to smithi05720651-16 2020-11-16T22:02:34.873 INFO:tasks.rados.rados.2.smithi057.stdout:227: finishing write tid 2 to smithi05720651-16 2020-11-16T22:02:34.873 INFO:tasks.rados.rados.2.smithi057.stdout:227: finishing write tid 3 to smithi05720651-16 2020-11-16T22:02:34.873 INFO:tasks.rados.rados.2.smithi057.stdout:229: finishing write tid 1 to smithi05720651-34 2020-11-16T22:02:34.873 INFO:tasks.rados.rados.2.smithi057.stdout:228: expect (ObjNum 89 snap 22 seq_num 89) 2020-11-16T22:02:35.020 INFO:tasks.rados.rados.2.smithi057.stdout:229: finishing write tid 2 to smithi05720651-34 2020-11-16T22:02:35.020 INFO:tasks.rados.rados.2.smithi057.stdout:229: finishing write tid 3 to smithi05720651-34 2020-11-16T22:02:35.020 INFO:tasks.rados.rados.2.smithi057.stdout:229: finishing write tid 5 to smithi05720651-34 2020-11-16T22:02:35.020 INFO:tasks.rados.rados.2.smithi057.stdout:229: finishing write tid 6 to smithi05720651-34 2020-11-16T22:02:35.020 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 48 (ObjNum 105 snap 32 seq_num 105) dirty exists 2020-11-16T22:02:35.021 INFO:tasks.rados.rados.2.smithi057.stdout:229: left oid 34 (ObjNum 105 snap 32 seq_num 105) 2020-11-16T22:02:35.021 INFO:tasks.rados.rados.2.smithi057.stdout:230: finishing write tid 1 to smithi05720651-14 2020-11-16T22:02:35.021 INFO:tasks.rados.rados.2.smithi057.stdout:230: finishing write tid 2 to smithi05720651-14 2020-11-16T22:02:35.021 INFO:tasks.rados.rados.2.smithi057.stdout:230: finishing write tid 3 to smithi05720651-14 2020-11-16T22:02:35.021 INFO:tasks.rados.rados.2.smithi057.stdout:230: finishing write tid 5 to smithi05720651-14 2020-11-16T22:02:35.021 INFO:tasks.rados.rados.2.smithi057.stdout:232: expect (ObjNum 62 snap 8 seq_num 62) 2020-11-16T22:02:35.110 INFO:tasks.rados.rados.2.smithi057.stdout:230: finishing write tid 6 to smithi05720651-14 2020-11-16T22:02:35.110 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 136 (ObjNum 106 snap 32 seq_num 106) dirty exists 2020-11-16T22:02:35.111 INFO:tasks.rados.rados.2.smithi057.stdout:230: left oid 14 (ObjNum 106 snap 32 seq_num 106) 2020-11-16T22:02:35.111 INFO:tasks.rados.rados.2.smithi057.stdout:231: expect (ObjNum 66 snap 10 seq_num 66) 2020-11-16T22:02:35.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:34 smithi057 bash[10301]: cluster 2020-11-16T22:02:33.579873+0000 mgr.x (mgr.24115) 298 : cluster [DBG] pgmap v355: 17 pgs: 17 active+clean; 169 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.5 MiB/s wr, 15 op/s 2020-11-16T22:02:35.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:34 smithi057 bash[10301]: cluster 2020-11-16T22:02:33.952417+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e128: 12 total, 12 up, 12 in 2020-11-16T22:02:35.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:34 smithi057 bash[10301]: cluster 2020-11-16T22:02:34.879213+0000 mon.a (mon.0) 760 : cluster [DBG] osdmap e129: 12 total, 12 up, 12 in 2020-11-16T22:02:35.241 INFO:tasks.rados.rados.2.smithi057.stdout:233: finishing write tid 1 to smithi05720651-32 2020-11-16T22:02:35.242 INFO:tasks.rados.rados.2.smithi057.stdout:233: finishing write tid 2 to smithi05720651-32 2020-11-16T22:02:35.242 INFO:tasks.rados.rados.2.smithi057.stdout:233: finishing write tid 3 to smithi05720651-32 2020-11-16T22:02:35.242 INFO:tasks.rados.rados.2.smithi057.stdout:233: finishing write tid 5 to smithi05720651-32 2020-11-16T22:02:35.242 INFO:tasks.rados.rados.2.smithi057.stdout:233: finishing write tid 6 to smithi05720651-32 2020-11-16T22:02:35.242 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 141 (ObjNum 107 snap 32 seq_num 107) dirty exists 2020-11-16T22:02:35.243 INFO:tasks.rados.rados.2.smithi057.stdout:233: left oid 32 (ObjNum 107 snap 32 seq_num 107) 2020-11-16T22:02:35.243 INFO:tasks.rados.rados.2.smithi057.stdout:227: finishing write tid 5 to smithi05720651-16 2020-11-16T22:02:35.243 INFO:tasks.rados.rados.2.smithi057.stdout:227: finishing write tid 6 to smithi05720651-16 2020-11-16T22:02:35.243 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 113 (ObjNum 104 snap 32 seq_num 104) dirty exists 2020-11-16T22:02:35.243 INFO:tasks.rados.rados.2.smithi057.stdout:227: left oid 16 (ObjNum 104 snap 32 seq_num 104) 2020-11-16T22:02:35.243 INFO:tasks.rados.rados.2.smithi057.stdout:227: done (7 left) 2020-11-16T22:02:35.243 INFO:tasks.rados.rados.2.smithi057.stdout:228: done (6 left) 2020-11-16T22:02:35.244 INFO:tasks.rados.rados.2.smithi057.stdout:229: done (5 left) 2020-11-16T22:02:35.244 INFO:tasks.rados.rados.2.smithi057.stdout:230: done (4 left) 2020-11-16T22:02:35.244 INFO:tasks.rados.rados.2.smithi057.stdout:231: done (3 left) 2020-11-16T22:02:35.244 INFO:tasks.rados.rados.2.smithi057.stdout:232: done (2 left) 2020-11-16T22:02:35.245 INFO:tasks.rados.rados.2.smithi057.stdout:233: done (1 left) 2020-11-16T22:02:35.245 INFO:tasks.rados.rados.2.smithi057.stdout:235: done (0 left) 2020-11-16T22:02:35.245 INFO:tasks.rados.rados.2.smithi057.stdout:236: write (excl) oid 4 current snap is 32 2020-11-16T22:02:35.245 INFO:tasks.rados.rados.2.smithi057.stdout:236: seq_num 109 ranges {631963=631083,2061949=560019,3243812=504767} 2020-11-16T22:02:35.260 INFO:tasks.rados.rados.2.smithi057.stdout:236: writing smithi05720651-4 from 631963 to 1263046 tid 1 2020-11-16T22:02:35.267 INFO:tasks.rados.rados.2.smithi057.stdout:236: writing smithi05720651-4 from 2061949 to 2621968 tid 2 2020-11-16T22:02:35.274 INFO:tasks.rados.rados.2.smithi057.stdout:236: writing smithi05720651-4 from 3243812 to 3748579 tid 3 2020-11-16T22:02:35.274 INFO:tasks.rados.rados.2.smithi057.stdout:237: snap_remove snap 26 2020-11-16T22:02:35.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:34 smithi016 bash[10302]: cluster 2020-11-16T22:02:33.579873+0000 mgr.x (mgr.24115) 298 : cluster [DBG] pgmap v355: 17 pgs: 17 active+clean; 169 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.5 MiB/s wr, 15 op/s 2020-11-16T22:02:35.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:34 smithi016 bash[10302]: cluster 2020-11-16T22:02:33.952417+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e128: 12 total, 12 up, 12 in 2020-11-16T22:02:35.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:34 smithi016 bash[10302]: cluster 2020-11-16T22:02:34.879213+0000 mon.a (mon.0) 760 : cluster [DBG] osdmap e129: 12 total, 12 up, 12 in 2020-11-16T22:02:35.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:34 smithi195 bash[10218]: cluster 2020-11-16T22:02:33.579873+0000 mgr.x (mgr.24115) 298 : cluster [DBG] pgmap v355: 17 pgs: 17 active+clean; 169 MiB data, 292 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.5 MiB/s wr, 15 op/s 2020-11-16T22:02:35.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:34 smithi195 bash[10218]: cluster 2020-11-16T22:02:33.952417+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e128: 12 total, 12 up, 12 in 2020-11-16T22:02:35.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:34 smithi195 bash[10218]: cluster 2020-11-16T22:02:34.879213+0000 mon.a (mon.0) 760 : cluster [DBG] osdmap e129: 12 total, 12 up, 12 in 2020-11-16T22:02:35.961 INFO:tasks.rados.rados.2.smithi057.stdout:237: done (1 left) 2020-11-16T22:02:35.962 INFO:tasks.rados.rados.2.smithi057.stdout:238: delete oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 32 2020-11-16T22:02:35.962 INFO:tasks.rados.rados.2.smithi057.stdout:236: finishing write tid 1 to smithi05720651-4 2020-11-16T22:02:35.962 INFO:tasks.rados.rados.2.smithi057.stdout:236: finishing write tid 2 to smithi05720651-4 2020-11-16T22:02:35.962 INFO:tasks.rados.rados.2.smithi057.stdout:236: finishing write tid 3 to smithi05720651-4 2020-11-16T22:02:35.962 INFO:tasks.rados.rados.2.smithi057.stdout:236: finishing write tid 5 to smithi05720651-4 2020-11-16T22:02:35.963 INFO:tasks.rados.rados.2.smithi057.stdout:236: finishing write tid 6 to smithi05720651-4 2020-11-16T22:02:35.963 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 57 (ObjNum 109 snap 32 seq_num 109) dirty exists 2020-11-16T22:02:35.963 INFO:tasks.rados.rados.2.smithi057.stdout:236: left oid 4 (ObjNum 109 snap 32 seq_num 109) 2020-11-16T22:02:35.967 INFO:tasks.rados.rados.2.smithi057.stdout:236: done (1 left) 2020-11-16T22:02:35.968 INFO:tasks.rados.rados.2.smithi057.stdout:238: done (0 left) 2020-11-16T22:02:35.968 INFO:tasks.rados.rados.2.smithi057.stdout:239: rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 32 2020-11-16T22:02:35.968 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 27 2020-11-16T22:02:35.968 INFO:tasks.rados.rados.2.smithi057.stdout:240: write oid 36 current snap is 32 2020-11-16T22:02:35.968 INFO:tasks.rados.rados.2.smithi057.stdout:240: seq_num 111 ranges {665577=781581,2062560=563688,3182305=643664} 2020-11-16T22:02:35.977 INFO:tasks.rados.rados.2.smithi057.stdout:240: writing smithi05720651-36 from 665577 to 1447158 tid 1 2020-11-16T22:02:35.984 INFO:tasks.rados.rados.2.smithi057.stdout:240: writing smithi05720651-36 from 2062560 to 2626248 tid 2 2020-11-16T22:02:35.992 INFO:tasks.rados.rados.2.smithi057.stdout:240: writing smithi05720651-36 from 3182305 to 3825969 tid 3 2020-11-16T22:02:35.992 INFO:tasks.rados.rados.2.smithi057.stdout:241: snap_remove snap 29 2020-11-16T22:02:36.966 INFO:tasks.rados.rados.2.smithi057.stdout:241: done (2 left) 2020-11-16T22:02:36.967 INFO:tasks.rados.rados.2.smithi057.stdout:242: snap_create 2020-11-16T22:02:36.968 INFO:tasks.rados.rados.2.smithi057.stdout:239: finishing rollback tid 0 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:36.968 INFO:tasks.rados.rados.2.smithi057.stdout:239: finishing rollback tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:36.968 INFO:tasks.rados.rados.2.smithi057.stdout:239: finishing rollback tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:36.969 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 123 (ObjNum 14 snap 0 seq_num 14) dirty exists 2020-11-16T22:02:36.969 INFO:tasks.rados.rados.2.smithi057.stdout:240: finishing write tid 1 to smithi05720651-36 2020-11-16T22:02:36.969 INFO:tasks.rados.rados.2.smithi057.stdout:240: finishing write tid 2 to smithi05720651-36 2020-11-16T22:02:36.970 INFO:tasks.rados.rados.2.smithi057.stdout:240: finishing write tid 3 to smithi05720651-36 2020-11-16T22:02:36.970 INFO:tasks.rados.rados.2.smithi057.stdout:240: finishing write tid 5 to smithi05720651-36 2020-11-16T22:02:36.971 INFO:tasks.rados.rados.2.smithi057.stdout:240: finishing write tid 6 to smithi05720651-36 2020-11-16T22:02:36.971 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 134 (ObjNum 111 snap 32 seq_num 111) dirty exists 2020-11-16T22:02:36.971 INFO:tasks.rados.rados.2.smithi057.stdout:240: left oid 36 (ObjNum 111 snap 32 seq_num 111) 2020-11-16T22:02:37.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:36 smithi016 bash[10302]: cluster 2020-11-16T22:02:35.580579+0000 mgr.x (mgr.24115) 299 : cluster [DBG] pgmap v358: 17 pgs: 17 active+clean; 171 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 907 KiB/s wr, 4 op/s 2020-11-16T22:02:37.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:36 smithi016 bash[10302]: cluster 2020-11-16T22:02:35.963092+0000 mon.a (mon.0) 761 : cluster [DBG] osdmap e130: 12 total, 12 up, 12 in 2020-11-16T22:02:37.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:36 smithi195 bash[10218]: cluster 2020-11-16T22:02:35.580579+0000 mgr.x (mgr.24115) 299 : cluster [DBG] pgmap v358: 17 pgs: 17 active+clean; 171 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 907 KiB/s wr, 4 op/s 2020-11-16T22:02:37.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:36 smithi195 bash[10218]: cluster 2020-11-16T22:02:35.963092+0000 mon.a (mon.0) 761 : cluster [DBG] osdmap e130: 12 total, 12 up, 12 in 2020-11-16T22:02:37.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:36 smithi057 bash[10301]: cluster 2020-11-16T22:02:35.580579+0000 mgr.x (mgr.24115) 299 : cluster [DBG] pgmap v358: 17 pgs: 17 active+clean; 171 MiB data, 300 MiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 907 KiB/s wr, 4 op/s 2020-11-16T22:02:37.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:36 smithi057 bash[10301]: cluster 2020-11-16T22:02:35.963092+0000 mon.a (mon.0) 761 : cluster [DBG] osdmap e130: 12 total, 12 up, 12 in 2020-11-16T22:02:37.977 INFO:tasks.rados.rados.2.smithi057.stdout:239: done (2 left) 2020-11-16T22:02:37.977 INFO:tasks.rados.rados.2.smithi057.stdout:240: done (1 left) 2020-11-16T22:02:37.977 INFO:tasks.rados.rados.2.smithi057.stdout:242: done (0 left) 2020-11-16T22:02:37.977 INFO:tasks.rados.rados.2.smithi057.stdout:243: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 31 2020-11-16T22:02:37.978 INFO:tasks.rados.rados.2.smithi057.stdout:243: expect deleted 2020-11-16T22:02:37.978 INFO:tasks.rados.rados.2.smithi057.stdout:244: snap_create 2020-11-16T22:02:38.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:37 smithi016 bash[10302]: cluster 2020-11-16T22:02:36.974031+0000 mon.a (mon.0) 762 : cluster [DBG] osdmap e131: 12 total, 12 up, 12 in 2020-11-16T22:02:38.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:37 smithi195 bash[10218]: cluster 2020-11-16T22:02:36.974031+0000 mon.a (mon.0) 762 : cluster [DBG] osdmap e131: 12 total, 12 up, 12 in 2020-11-16T22:02:38.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:37 smithi057 bash[10301]: cluster 2020-11-16T22:02:36.974031+0000 mon.a (mon.0) 762 : cluster [DBG] osdmap e131: 12 total, 12 up, 12 in 2020-11-16T22:02:38.975 INFO:tasks.rados.rados.2.smithi057.stdout:243: done (1 left) 2020-11-16T22:02:38.976 INFO:tasks.rados.rados.2.smithi057.stdout:244: done (0 left) 2020-11-16T22:02:38.976 INFO:tasks.rados.rados.2.smithi057.stdout:245: write oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 34 2020-11-16T22:02:38.976 INFO:tasks.rados.rados.2.smithi057.stdout:245: seq_num 112 ranges {682384=456830,1721042=423699,2809728=454936,3731357=151027} 2020-11-16T22:02:38.989 INFO:tasks.rados.rados.2.smithi057.stdout:245: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 682384 to 1139214 tid 1 2020-11-16T22:02:38.994 INFO:tasks.rados.rados.2.smithi057.stdout:245: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1721042 to 2144741 tid 2 2020-11-16T22:02:39.001 INFO:tasks.rados.rados.2.smithi057.stdout:245: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2809728 to 3264664 tid 3 2020-11-16T22:02:39.004 INFO:tasks.rados.rados.2.smithi057.stdout:245: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3731357 to 3882384 tid 4 2020-11-16T22:02:39.004 INFO:tasks.rados.rados.2.smithi057.stdout:246: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 28 2020-11-16T22:02:39.005 INFO:tasks.rados.rados.2.smithi057.stdout:246: expect (ObjNum 18 snap 0 seq_num 18) 2020-11-16T22:02:39.005 INFO:tasks.rados.rados.2.smithi057.stdout:247: write (excl) oid 46 current snap is 34 2020-11-16T22:02:39.005 INFO:tasks.rados.rados.2.smithi057.stdout:247: seq_num 113 ranges {699191=532079,1779524=567357,2837151=666208} 2020-11-16T22:02:39.011 INFO:tasks.rados.rados.2.smithi057.stdout:247: writing smithi05720651-46 from 699191 to 1231270 tid 1 2020-11-16T22:02:39.018 INFO:tasks.rados.rados.2.smithi057.stdout:247: writing smithi05720651-46 from 1779524 to 2346881 tid 2 2020-11-16T22:02:39.025 INFO:tasks.rados.rados.2.smithi057.stdout:247: writing smithi05720651-46 from 2837151 to 3503359 tid 3 2020-11-16T22:02:39.025 INFO:tasks.rados.rados.2.smithi057.stdout:248: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 31 2020-11-16T22:02:39.025 INFO:tasks.rados.rados.2.smithi057.stdout:248: expect (ObjNum 90 snap 23 seq_num 90) 2020-11-16T22:02:39.025 INFO:tasks.rados.rados.2.smithi057.stdout:249: rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 34 2020-11-16T22:02:39.026 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 27 2020-11-16T22:02:39.026 INFO:tasks.rados.rados.2.smithi057.stdout:245: finishing write tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:39.026 INFO:tasks.rados.rados.2.smithi057.stdout:250: copy_from oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 34 2020-11-16T22:02:39.026 INFO:tasks.rados.rados.2.smithi057.stdout:245: finishing write tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:39.026 INFO:tasks.rados.rados.2.smithi057.stdout:245: finishing write tid 3 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:39.026 INFO:tasks.rados.rados.2.smithi057.stdout:245: finishing write tid 4 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:39.026 INFO:tasks.rados.rados.2.smithi057.stdout:245: finishing write tid 6 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:39.027 INFO:tasks.rados.rados.2.smithi057.stdout:245: finishing write tid 7 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:39.027 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 43 (ObjNum 112 snap 34 seq_num 112) dirty exists 2020-11-16T22:02:39.027 INFO:tasks.rados.rados.2.smithi057.stdout:245: left oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 112 snap 34 seq_num 112) 2020-11-16T22:02:39.027 INFO:tasks.rados.rados.2.smithi057.stdout:245: done (5 left) 2020-11-16T22:02:39.027 INFO:tasks.rados.rados.2.smithi057.stdout:251: rollback oid 6 current snap is 34 2020-11-16T22:02:39.027 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 6 to 25 2020-11-16T22:02:39.027 INFO:tasks.rados.rados.2.smithi057.stdout:246: expect (ObjNum 18 snap 0 seq_num 18) 2020-11-16T22:02:39.104 INFO:tasks.rados.rados.2.smithi057.stdout:249: finishing rollback tid 0 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:39.105 INFO:tasks.rados.rados.2.smithi057.stdout:249: finishing rollback tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:39.105 INFO:tasks.rados.rados.2.smithi057.stdout:249: finishing rollback tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:39.105 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 151 (ObjNum 34 snap 0 seq_num 34) dirty exists 2020-11-16T22:02:39.105 INFO:tasks.rados.rados.2.smithi057.stdout:247: finishing write tid 1 to smithi05720651-46 2020-11-16T22:02:39.105 INFO:tasks.rados.rados.2.smithi057.stdout:246: done (5 left) 2020-11-16T22:02:39.105 INFO:tasks.rados.rados.2.smithi057.stdout:249: done (4 left) 2020-11-16T22:02:39.106 INFO:tasks.rados.rados.2.smithi057.stdout:252: snap_remove snap 23 2020-11-16T22:02:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:38 smithi016 bash[10302]: cluster 2020-11-16T22:02:37.581232+0000 mgr.x (mgr.24115) 300 : cluster [DBG] pgmap v361: 17 pgs: 17 active+clean; 175 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2020-11-16T22:02:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:38 smithi016 bash[10302]: cluster 2020-11-16T22:02:37.984816+0000 mon.a (mon.0) 763 : cluster [DBG] osdmap e132: 12 total, 12 up, 12 in 2020-11-16T22:02:39.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:38 smithi195 bash[10218]: cluster 2020-11-16T22:02:37.581232+0000 mgr.x (mgr.24115) 300 : cluster [DBG] pgmap v361: 17 pgs: 17 active+clean; 175 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2020-11-16T22:02:39.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:38 smithi195 bash[10218]: cluster 2020-11-16T22:02:37.984816+0000 mon.a (mon.0) 763 : cluster [DBG] osdmap e132: 12 total, 12 up, 12 in 2020-11-16T22:02:39.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:38 smithi057 bash[10301]: cluster 2020-11-16T22:02:37.581232+0000 mgr.x (mgr.24115) 300 : cluster [DBG] pgmap v361: 17 pgs: 17 active+clean; 175 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 1.6 MiB/s wr, 13 op/s 2020-11-16T22:02:39.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:38 smithi057 bash[10301]: cluster 2020-11-16T22:02:37.984816+0000 mon.a (mon.0) 763 : cluster [DBG] osdmap e132: 12 total, 12 up, 12 in 2020-11-16T22:02:39.883 INFO:tasks.rados.rados.2.smithi057.stdout:252: done (4 left) 2020-11-16T22:02:39.884 INFO:tasks.rados.rados.2.smithi057.stdout:253: read oid 40 snap 25 2020-11-16T22:02:39.884 INFO:tasks.rados.rados.2.smithi057.stdout:253: expect (ObjNum 3 snap 0 seq_num 3) 2020-11-16T22:02:39.884 INFO:tasks.rados.rados.2.smithi057.stdout:254: delete oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 34 2020-11-16T22:02:39.884 INFO:tasks.rados.rados.2.smithi057.stdout:251: finishing rollback tid 1 to smithi05720651-6 2020-11-16T22:02:39.884 INFO:tasks.rados.rados.2.smithi057.stdout:251: finishing rollback tid 2 to smithi05720651-6 2020-11-16T22:02:39.885 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 153 (ObjNum 54 snap 3 seq_num 54) dirty exists 2020-11-16T22:02:39.885 INFO:tasks.rados.rados.2.smithi057.stdout:247: finishing write tid 2 to smithi05720651-46 2020-11-16T22:02:39.885 INFO:tasks.rados.rados.2.smithi057.stdout:247: finishing write tid 3 to smithi05720651-46 2020-11-16T22:02:39.885 INFO:tasks.rados.rados.2.smithi057.stdout:248: expect (ObjNum 90 snap 23 seq_num 90) 2020-11-16T22:02:40.087 INFO:tasks.rados.rados.2.smithi057.stdout:247: finishing write tid 5 to smithi05720651-46 2020-11-16T22:02:40.087 INFO:tasks.rados.rados.2.smithi057.stdout:247: finishing write tid 6 to smithi05720651-46 2020-11-16T22:02:40.087 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 134 (ObjNum 113 snap 34 seq_num 113) dirty exists 2020-11-16T22:02:40.087 INFO:tasks.rados.rados.2.smithi057.stdout:247: left oid 46 (ObjNum 113 snap 34 seq_num 113) 2020-11-16T22:02:40.087 INFO:tasks.rados.rados.2.smithi057.stdout:250: finishing copy_from to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:40.088 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 73 (ObjNum 42 snap 0 seq_num 42) dirty exists 2020-11-16T22:02:40.088 INFO:tasks.rados.rados.2.smithi057.stdout:250: finishing copy_from racing read to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:40.088 INFO:tasks.rados.rados.2.smithi057.stdout:247: done (5 left) 2020-11-16T22:02:40.088 INFO:tasks.rados.rados.2.smithi057.stdout:248: done (4 left) 2020-11-16T22:02:40.088 INFO:tasks.rados.rados.2.smithi057.stdout:250: done (3 left) 2020-11-16T22:02:40.088 INFO:tasks.rados.rados.2.smithi057.stdout:251: done (2 left) 2020-11-16T22:02:40.088 INFO:tasks.rados.rados.2.smithi057.stdout:254: done (1 left) 2020-11-16T22:02:40.089 INFO:tasks.rados.rados.2.smithi057.stdout:255: delete oid 20 current snap is 34 2020-11-16T22:02:40.089 INFO:tasks.rados.rados.2.smithi057.stdout:253: expect (ObjNum 3 snap 0 seq_num 3) 2020-11-16T22:02:40.147 INFO:tasks.rados.rados.2.smithi057.stdout:253: done (1 left) 2020-11-16T22:02:40.148 INFO:tasks.rados.rados.2.smithi057.stdout:255: done (0 left) 2020-11-16T22:02:40.148 INFO:tasks.rados.rados.2.smithi057.stdout:256: write (excl) oid 44 current snap is 34 2020-11-16T22:02:40.148 INFO:tasks.rados.rados.2.smithi057.stdout:256: seq_num 116 ranges {749612=474179,1954970=431037,2919420=616377} 2020-11-16T22:02:40.164 INFO:tasks.rados.rados.2.smithi057.stdout:256: writing smithi05720651-44 from 749612 to 1223791 tid 1 2020-11-16T22:02:40.170 INFO:tasks.rados.rados.2.smithi057.stdout:256: writing smithi05720651-44 from 1954970 to 2386007 tid 2 2020-11-16T22:02:40.177 INFO:tasks.rados.rados.2.smithi057.stdout:256: writing smithi05720651-44 from 2919420 to 3535797 tid 3 2020-11-16T22:02:40.178 INFO:tasks.rados.rados.2.smithi057.stdout:257: delete oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 34 2020-11-16T22:02:40.178 INFO:tasks.rados.rados.2.smithi057.stdout:256: finishing write tid 1 to smithi05720651-44 2020-11-16T22:02:40.178 INFO:tasks.rados.rados.2.smithi057.stdout:256: finishing write tid 2 to smithi05720651-44 2020-11-16T22:02:40.181 INFO:tasks.rados.rados.2.smithi057.stdout:256: finishing write tid 3 to smithi05720651-44 2020-11-16T22:02:40.181 INFO:tasks.rados.rados.2.smithi057.stdout:257: done (1 left) 2020-11-16T22:02:40.181 INFO:tasks.rados.rados.2.smithi057.stdout:258: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 34 2020-11-16T22:02:40.182 INFO:tasks.rados.rados.2.smithi057.stdout:258: seq_num 118 ranges {783226=624677,2071934=434706,2974266=638921} 2020-11-16T22:02:40.189 INFO:tasks.rados.rados.2.smithi057.stdout:258: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 783226 to 1407903 tid 1 2020-11-16T22:02:40.196 INFO:tasks.rados.rados.2.smithi057.stdout:258: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2071934 to 2506640 tid 2 2020-11-16T22:02:40.202 INFO:tasks.rados.rados.2.smithi057.stdout:258: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2974266 to 3613187 tid 3 2020-11-16T22:02:40.203 INFO:tasks.rados.rados.2.smithi057.stdout:259: read oid 18 snap -1 2020-11-16T22:02:40.203 INFO:tasks.rados.rados.2.smithi057.stdout:259: expect deleted 2020-11-16T22:02:40.203 INFO:tasks.rados.rados.2.smithi057.stdout:260: read oid 10 snap 31 2020-11-16T22:02:40.203 INFO:tasks.rados.rados.2.smithi057.stdout:260: expect (ObjNum 9 snap 0 seq_num 9) 2020-11-16T22:02:40.203 INFO:tasks.rados.rados.2.smithi057.stdout:261: rollback oid 50 current snap is 34 2020-11-16T22:02:40.203 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 50 to 27 2020-11-16T22:02:40.204 INFO:tasks.rados.rados.2.smithi057.stdout:256: finishing write tid 5 to smithi05720651-44 2020-11-16T22:02:40.204 INFO:tasks.rados.rados.2.smithi057.stdout:262: read oid 16 snap -1 2020-11-16T22:02:40.204 INFO:tasks.rados.rados.2.smithi057.stdout:262: expect (ObjNum 104 snap 32 seq_num 104) 2020-11-16T22:02:40.204 INFO:tasks.rados.rados.2.smithi057.stdout:263: snap_remove snap 30 2020-11-16T22:02:40.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:39 smithi016 bash[10302]: cluster 2020-11-16T22:02:38.985868+0000 mon.a (mon.0) 764 : cluster [DBG] osdmap e133: 12 total, 12 up, 12 in 2020-11-16T22:02:40.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:39 smithi016 bash[10302]: cluster 2020-11-16T22:02:39.880940+0000 mon.a (mon.0) 765 : cluster [DBG] osdmap e134: 12 total, 12 up, 12 in 2020-11-16T22:02:40.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:39 smithi195 bash[10218]: cluster 2020-11-16T22:02:38.985868+0000 mon.a (mon.0) 764 : cluster [DBG] osdmap e133: 12 total, 12 up, 12 in 2020-11-16T22:02:40.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:39 smithi195 bash[10218]: cluster 2020-11-16T22:02:39.880940+0000 mon.a (mon.0) 765 : cluster [DBG] osdmap e134: 12 total, 12 up, 12 in 2020-11-16T22:02:40.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:39 smithi057 bash[10301]: cluster 2020-11-16T22:02:38.985868+0000 mon.a (mon.0) 764 : cluster [DBG] osdmap e133: 12 total, 12 up, 12 in 2020-11-16T22:02:40.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:39 smithi057 bash[10301]: cluster 2020-11-16T22:02:39.880940+0000 mon.a (mon.0) 765 : cluster [DBG] osdmap e134: 12 total, 12 up, 12 in 2020-11-16T22:02:41.001 INFO:tasks.rados.rados.2.smithi057.stdout:263: done (6 left) 2020-11-16T22:02:41.001 INFO:tasks.rados.rados.2.smithi057.stdout:264: delete oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 34 2020-11-16T22:02:41.001 INFO:tasks.rados.rados.2.smithi057.stdout:256: finishing write tid 6 to smithi05720651-44 2020-11-16T22:02:41.001 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 29 (ObjNum 116 snap 34 seq_num 116) dirty exists 2020-11-16T22:02:41.002 INFO:tasks.rados.rados.2.smithi057.stdout:256: left oid 44 (ObjNum 116 snap 34 seq_num 116) 2020-11-16T22:02:41.002 INFO:tasks.rados.rados.2.smithi057.stdout:258: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:41.002 INFO:tasks.rados.rados.2.smithi057.stdout:258: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:41.002 INFO:tasks.rados.rados.2.smithi057.stdout:261: finishing rollback tid 1 to smithi05720651-50 2020-11-16T22:02:41.002 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 46 (ObjNum 385 snap 0 seq_num 2932843152) dirty dne 2020-11-16T22:02:41.002 INFO:tasks.rados.rados.2.smithi057.stdout:258: finishing write tid 3 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:41.002 INFO:tasks.rados.rados.2.smithi057.stdout:258: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:41.003 INFO:tasks.rados.rados.2.smithi057.stdout:258: finishing write tid 6 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:41.003 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 166 (ObjNum 118 snap 34 seq_num 118) dirty exists 2020-11-16T22:02:41.003 INFO:tasks.rados.rados.2.smithi057.stdout:258: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 118 snap 34 seq_num 118) 2020-11-16T22:02:41.003 INFO:tasks.rados.rados.2.smithi057.stdout:260: expect (ObjNum 9 snap 0 seq_num 9) 2020-11-16T22:02:41.070 INFO:tasks.rados.rados.2.smithi057.stdout:262: expect (ObjNum 104 snap 32 seq_num 104) 2020-11-16T22:02:41.228 INFO:tasks.rados.rados.2.smithi057.stdout:256: done (6 left) 2020-11-16T22:02:41.228 INFO:tasks.rados.rados.2.smithi057.stdout:258: done (5 left) 2020-11-16T22:02:41.229 INFO:tasks.rados.rados.2.smithi057.stdout:259: done (4 left) 2020-11-16T22:02:41.229 INFO:tasks.rados.rados.2.smithi057.stdout:260: done (3 left) 2020-11-16T22:02:41.229 INFO:tasks.rados.rados.2.smithi057.stdout:261: done (2 left) 2020-11-16T22:02:41.229 INFO:tasks.rados.rados.2.smithi057.stdout:262: done (1 left) 2020-11-16T22:02:41.229 INFO:tasks.rados.rados.2.smithi057.stdout:264: done (0 left) 2020-11-16T22:02:41.230 INFO:tasks.rados.rados.2.smithi057.stdout:265: copy_from oid 22 from oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 34 2020-11-16T22:02:41.230 INFO:tasks.rados.rados.2.smithi057.stdout:266: delete oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 34 2020-11-16T22:02:41.234 INFO:tasks.rados.rados.2.smithi057.stdout:266: done (1 left) 2020-11-16T22:02:41.235 INFO:tasks.rados.rados.2.smithi057.stdout:267: snap_create 2020-11-16T22:02:41.247 INFO:tasks.rados.rados.2.smithi057.stdout:265: finishing copy_from to smithi05720651-22 2020-11-16T22:02:41.247 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 23 (ObjNum 48 snap 0 seq_num 48) dirty exists 2020-11-16T22:02:41.247 INFO:tasks.rados.rados.2.smithi057.stdout:265: finishing copy_from racing read to smithi05720651-22 2020-11-16T22:02:41.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:41 smithi016 bash[10302]: cluster 2020-11-16T22:02:39.581900+0000 mgr.x (mgr.24115) 301 : cluster [DBG] pgmap v364: 17 pgs: 17 active+clean; 179 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2020-11-16T22:02:41.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:41 smithi195 bash[10218]: cluster 2020-11-16T22:02:39.581900+0000 mgr.x (mgr.24115) 301 : cluster [DBG] pgmap v364: 17 pgs: 17 active+clean; 179 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2020-11-16T22:02:41.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:41 smithi057 bash[10301]: cluster 2020-11-16T22:02:39.581900+0000 mgr.x (mgr.24115) 301 : cluster [DBG] pgmap v364: 17 pgs: 17 active+clean; 179 MiB data, 307 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2020-11-16T22:02:42.013 INFO:tasks.rados.rados.2.smithi057.stdout:265: done (1 left) 2020-11-16T22:02:42.013 INFO:tasks.rados.rados.2.smithi057.stdout:267: done (0 left) 2020-11-16T22:02:42.014 INFO:tasks.rados.rados.2.smithi057.stdout:268: snap_create 2020-11-16T22:02:42.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:42 smithi016 bash[10302]: cluster 2020-11-16T22:02:41.010394+0000 mon.a (mon.0) 766 : cluster [DBG] osdmap e135: 12 total, 12 up, 12 in 2020-11-16T22:02:42.392 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:42 smithi195 bash[10218]: cluster 2020-11-16T22:02:41.010394+0000 mon.a (mon.0) 766 : cluster [DBG] osdmap e135: 12 total, 12 up, 12 in 2020-11-16T22:02:42.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:42 smithi057 bash[10301]: cluster 2020-11-16T22:02:41.010394+0000 mon.a (mon.0) 766 : cluster [DBG] osdmap e135: 12 total, 12 up, 12 in 2020-11-16T22:02:43.012 INFO:tasks.rados.rados.2.smithi057.stdout:268: done (0 left) 2020-11-16T22:02:43.013 INFO:tasks.rados.rados.2.smithi057.stdout:269: read oid 48 snap -1 2020-11-16T22:02:43.013 INFO:tasks.rados.rados.2.smithi057.stdout:269: expect (ObjNum 97 snap 27 seq_num 97) 2020-11-16T22:02:43.013 INFO:tasks.rados.rados.2.smithi057.stdout:270: copy_from oid 4 from oid 24 current snap is 36 2020-11-16T22:02:43.013 INFO:tasks.rados.rados.2.smithi057.stdout:271: write oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 36 2020-11-16T22:02:43.013 INFO:tasks.rados.rados.2.smithi057.stdout:271: seq_num 121 ranges {433647=450424,1331027=582033} 2020-11-16T22:02:43.021 INFO:tasks.rados.rados.2.smithi057.stdout:271: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 433647 to 884071 tid 1 2020-11-16T22:02:43.029 INFO:tasks.rados.rados.2.smithi057.stdout:271: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1331027 to 1913060 tid 2 2020-11-16T22:02:43.029 INFO:tasks.rados.rados.2.smithi057.stdout:272: read oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:43.030 INFO:tasks.rados.rados.2.smithi057.stdout:272: expect (ObjNum 95 snap 26 seq_num 95) 2020-11-16T22:02:43.030 INFO:tasks.rados.rados.2.smithi057.stdout:273: copy_from oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 36 2020-11-16T22:02:43.030 INFO:tasks.rados.rados.2.smithi057.stdout:271: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:43.030 INFO:tasks.rados.rados.2.smithi057.stdout:274: read oid 8 snap 25 2020-11-16T22:02:43.030 INFO:tasks.rados.rados.2.smithi057.stdout:274: expect (ObjNum 7 snap 0 seq_num 7) 2020-11-16T22:02:43.030 INFO:tasks.rados.rados.2.smithi057.stdout:275: read oid 44 snap -1 2020-11-16T22:02:43.031 INFO:tasks.rados.rados.2.smithi057.stdout:275: expect (ObjNum 116 snap 34 seq_num 116) 2020-11-16T22:02:43.031 INFO:tasks.rados.rados.2.smithi057.stdout:276: read oid 28 snap -1 2020-11-16T22:02:43.031 INFO:tasks.rados.rados.2.smithi057.stdout:276: expect deleted 2020-11-16T22:02:43.031 INFO:tasks.rados.rados.2.smithi057.stdout:277: write (excl) oid 38 current snap is 36 2020-11-16T22:02:43.031 INFO:tasks.rados.rados.2.smithi057.stdout:277: seq_num 122 ranges {450454=642026,1505862=544592} 2020-11-16T22:02:43.036 INFO:tasks.rados.rados.2.smithi057.stdout:277: writing smithi05720651-38 from 450454 to 1092480 tid 1 2020-11-16T22:02:43.042 INFO:tasks.rados.rados.2.smithi057.stdout:277: writing smithi05720651-38 from 1505862 to 2050454 tid 2 2020-11-16T22:02:43.042 INFO:tasks.rados.rados.2.smithi057.stdout:278: read oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:43.043 INFO:tasks.rados.rados.2.smithi057.stdout:278: expect (ObjNum 34 snap 0 seq_num 34) 2020-11-16T22:02:43.043 INFO:tasks.rados.rados.2.smithi057.stdout:279: copy_from oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 14 current snap is 36 2020-11-16T22:02:43.043 INFO:tasks.rados.rados.2.smithi057.stdout:269: expect (ObjNum 97 snap 27 seq_num 97) 2020-11-16T22:02:43.208 INFO:tasks.rados.rados.2.smithi057.stdout:270: finishing copy_from to smithi05720651-4 2020-11-16T22:02:43.208 INFO:tasks.rados.rados.2.smithi057.stdout:270: got expected ENOENT (src dne) 2020-11-16T22:02:43.209 INFO:tasks.rados.rados.2.smithi057.stdout:270: finishing copy_from racing read to smithi05720651-4 2020-11-16T22:02:43.209 INFO:tasks.rados.rados.2.smithi057.stdout:271: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:43.209 INFO:tasks.rados.rados.2.smithi057.stdout:271: finishing write tid 4 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:43.209 INFO:tasks.rados.rados.2.smithi057.stdout:269: done (10 left) 2020-11-16T22:02:43.209 INFO:tasks.rados.rados.2.smithi057.stdout:270: done (9 left) 2020-11-16T22:02:43.209 INFO:tasks.rados.rados.2.smithi057.stdout:276: done (8 left) 2020-11-16T22:02:43.210 INFO:tasks.rados.rados.2.smithi057.stdout:280: rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 36 2020-11-16T22:02:43.210 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 24 2020-11-16T22:02:43.210 INFO:tasks.rados.rados.2.smithi057.stdout:271: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:43.210 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 44 (ObjNum 121 snap 36 seq_num 121) dirty exists 2020-11-16T22:02:43.210 INFO:tasks.rados.rados.2.smithi057.stdout:271: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 121 snap 36 seq_num 121) 2020-11-16T22:02:43.210 INFO:tasks.rados.rados.2.smithi057.stdout:275: expect (ObjNum 116 snap 34 seq_num 116) 2020-11-16T22:02:43.332 INFO:tasks.rados.rados.2.smithi057.stdout:277: finishing write tid 1 to smithi05720651-38 2020-11-16T22:02:43.332 INFO:tasks.rados.rados.2.smithi057.stdout:274: expect (ObjNum 7 snap 0 seq_num 7) 2020-11-16T22:02:43.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:43 smithi016 bash[10302]: cluster 2020-11-16T22:02:41.582586+0000 mgr.x (mgr.24115) 302 : cluster [DBG] pgmap v367: 17 pgs: 17 active+clean; 188 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.5 MiB/s wr, 19 op/s 2020-11-16T22:02:43.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:43 smithi016 bash[10302]: cluster 2020-11-16T22:02:42.018291+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e136: 12 total, 12 up, 12 in 2020-11-16T22:02:43.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:43 smithi195 bash[10218]: cluster 2020-11-16T22:02:41.582586+0000 mgr.x (mgr.24115) 302 : cluster [DBG] pgmap v367: 17 pgs: 17 active+clean; 188 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.5 MiB/s wr, 19 op/s 2020-11-16T22:02:43.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:43 smithi195 bash[10218]: cluster 2020-11-16T22:02:42.018291+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e136: 12 total, 12 up, 12 in 2020-11-16T22:02:43.396 INFO:tasks.rados.rados.2.smithi057.stdout:277: finishing write tid 2 to smithi05720651-38 2020-11-16T22:02:43.396 INFO:tasks.rados.rados.2.smithi057.stdout:277: finishing write tid 4 to smithi05720651-38 2020-11-16T22:02:43.396 INFO:tasks.rados.rados.2.smithi057.stdout:277: finishing write tid 5 to smithi05720651-38 2020-11-16T22:02:43.397 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 81 (ObjNum 122 snap 36 seq_num 122) dirty exists 2020-11-16T22:02:43.397 INFO:tasks.rados.rados.2.smithi057.stdout:277: left oid 38 (ObjNum 122 snap 36 seq_num 122) 2020-11-16T22:02:43.397 INFO:tasks.rados.rados.2.smithi057.stdout:278: expect (ObjNum 34 snap 0 seq_num 34) 2020-11-16T22:02:43.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:43 smithi057 bash[10301]: cluster 2020-11-16T22:02:41.582586+0000 mgr.x (mgr.24115) 302 : cluster [DBG] pgmap v367: 17 pgs: 17 active+clean; 188 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.5 MiB/s wr, 19 op/s 2020-11-16T22:02:43.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:43 smithi057 bash[10301]: cluster 2020-11-16T22:02:42.018291+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e136: 12 total, 12 up, 12 in 2020-11-16T22:02:43.471 INFO:tasks.rados.rados.2.smithi057.stdout:272: expect (ObjNum 95 snap 26 seq_num 95) 2020-11-16T22:02:43.661 INFO:tasks.rados.rados.2.smithi057.stdout:273: finishing copy_from to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:43.662 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 40 (ObjNum 18 snap 0 seq_num 18) dirty exists 2020-11-16T22:02:43.662 INFO:tasks.rados.rados.2.smithi057.stdout:273: finishing copy_from racing read to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:43.662 INFO:tasks.rados.rados.2.smithi057.stdout:279: finishing copy_from to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:43.662 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 136 (ObjNum 106 snap 32 seq_num 106) dirty exists 2020-11-16T22:02:43.662 INFO:tasks.rados.rados.2.smithi057.stdout:279: finishing copy_from racing read to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:43.662 INFO:tasks.rados.rados.2.smithi057.stdout:280: finishing rollback tid 0 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:43.663 INFO:tasks.rados.rados.2.smithi057.stdout:280: finishing rollback tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:43.663 INFO:tasks.rados.rados.2.smithi057.stdout:280: finishing rollback tid 2 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:43.663 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 76 (ObjNum 0 snap 0 seq_num 0) dirty exists 2020-11-16T22:02:43.663 INFO:tasks.rados.rados.2.smithi057.stdout:271: done (8 left) 2020-11-16T22:02:43.663 INFO:tasks.rados.rados.2.smithi057.stdout:272: done (7 left) 2020-11-16T22:02:43.663 INFO:tasks.rados.rados.2.smithi057.stdout:273: done (6 left) 2020-11-16T22:02:43.663 INFO:tasks.rados.rados.2.smithi057.stdout:274: done (5 left) 2020-11-16T22:02:43.664 INFO:tasks.rados.rados.2.smithi057.stdout:275: done (4 left) 2020-11-16T22:02:43.664 INFO:tasks.rados.rados.2.smithi057.stdout:277: done (3 left) 2020-11-16T22:02:43.664 INFO:tasks.rados.rados.2.smithi057.stdout:278: done (2 left) 2020-11-16T22:02:43.664 INFO:tasks.rados.rados.2.smithi057.stdout:279: done (1 left) 2020-11-16T22:02:43.664 INFO:tasks.rados.rados.2.smithi057.stdout:280: done (0 left) 2020-11-16T22:02:43.664 INFO:tasks.rados.rados.2.smithi057.stdout:281: delete oid 32 current snap is 36 2020-11-16T22:02:43.666 INFO:tasks.rados.rados.2.smithi057.stdout:281: done (0 left) 2020-11-16T22:02:43.666 INFO:tasks.rados.rados.2.smithi057.stdout:282: snap_remove snap 24 2020-11-16T22:02:44.029 INFO:tasks.rados.rados.2.smithi057.stdout:282: done (0 left) 2020-11-16T22:02:44.029 INFO:tasks.rados.rados.2.smithi057.stdout:283: delete oid 28 current snap is 36 2020-11-16T22:02:44.035 INFO:tasks.rados.rados.2.smithi057.stdout:283: done (0 left) 2020-11-16T22:02:44.036 INFO:tasks.rados.rados.2.smithi057.stdout:284: rollback oid 38 current snap is 36 2020-11-16T22:02:44.036 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 38 to 32 2020-11-16T22:02:44.036 INFO:tasks.rados.rados.2.smithi057.stdout:285: read oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:44.036 INFO:tasks.rados.rados.2.smithi057.stdout:285: expect (ObjNum 34 snap 0 seq_num 34) 2020-11-16T22:02:44.036 INFO:tasks.rados.rados.2.smithi057.stdout:286: write oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 36 2020-11-16T22:02:44.036 INFO:tasks.rados.rados.2.smithi057.stdout:286: seq_num 125 ranges {500875=467773,1564955=535920} 2020-11-16T22:02:44.042 INFO:tasks.rados.rados.2.smithi057.stdout:286: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 500875 to 968648 tid 1 2020-11-16T22:02:44.049 INFO:tasks.rados.rados.2.smithi057.stdout:286: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1564955 to 2100875 tid 2 2020-11-16T22:02:44.049 INFO:tasks.rados.rados.2.smithi057.stdout:287: read oid 2 snap -1 2020-11-16T22:02:44.050 INFO:tasks.rados.rados.2.smithi057.stdout:287: expect (ObjNum 80 snap 20 seq_num 80) 2020-11-16T22:02:44.050 INFO:tasks.rados.rados.2.smithi057.stdout:288: read oid 42 snap 35 2020-11-16T22:02:44.050 INFO:tasks.rados.rados.2.smithi057.stdout:288: expect (ObjNum 21 snap 0 seq_num 21) 2020-11-16T22:02:44.050 INFO:tasks.rados.rados.2.smithi057.stdout:289: read oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:44.050 INFO:tasks.rados.rados.2.smithi057.stdout:289: expect deleted 2020-11-16T22:02:44.050 INFO:tasks.rados.rados.2.smithi057.stdout:290: write (excl) oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 36 2020-11-16T22:02:44.050 INFO:tasks.rados.rados.2.smithi057.stdout:284: finishing rollback tid 0 to smithi05720651-38 2020-11-16T22:02:44.051 INFO:tasks.rados.rados.2.smithi057.stdout:290: seq_num 126 ranges {517682=543022,1623437=494245} 2020-11-16T22:02:44.055 INFO:tasks.rados.rados.2.smithi057.stdout:290: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 517682 to 1060704 tid 1 2020-11-16T22:02:44.061 INFO:tasks.rados.rados.2.smithi057.stdout:290: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1623437 to 2117682 tid 2 2020-11-16T22:02:44.062 INFO:tasks.rados.rados.2.smithi057.stdout:291: copy_from oid 30 from oid 4 current snap is 36 2020-11-16T22:02:44.062 INFO:tasks.rados.rados.2.smithi057.stdout:284: finishing rollback tid 1 to smithi05720651-38 2020-11-16T22:02:44.062 INFO:tasks.rados.rados.2.smithi057.stdout:284: finishing rollback tid 2 to smithi05720651-38 2020-11-16T22:02:44.062 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 88 (ObjNum 37 snap 0 seq_num 37) dirty exists 2020-11-16T22:02:44.062 INFO:tasks.rados.rados.2.smithi057.stdout:285: expect (ObjNum 34 snap 0 seq_num 34) 2020-11-16T22:02:44.142 INFO:tasks.rados.rados.2.smithi057.stdout:286: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:44.143 INFO:tasks.rados.rados.2.smithi057.stdout:286: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:44.143 INFO:tasks.rados.rados.2.smithi057.stdout:284: done (7 left) 2020-11-16T22:02:44.143 INFO:tasks.rados.rados.2.smithi057.stdout:285: done (6 left) 2020-11-16T22:02:44.143 INFO:tasks.rados.rados.2.smithi057.stdout:289: done (5 left) 2020-11-16T22:02:44.143 INFO:tasks.rados.rados.2.smithi057.stdout:292: snap_create 2020-11-16T22:02:44.143 INFO:tasks.rados.rados.2.smithi057.stdout:286: finishing write tid 4 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:44.144 INFO:tasks.rados.rados.2.smithi057.stdout:286: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:44.144 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 173 (ObjNum 125 snap 36 seq_num 125) dirty exists 2020-11-16T22:02:44.144 INFO:tasks.rados.rados.2.smithi057.stdout:286: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 125 snap 36 seq_num 125) 2020-11-16T22:02:44.144 INFO:tasks.rados.rados.2.smithi057.stdout:287: expect (ObjNum 80 snap 20 seq_num 80) 2020-11-16T22:02:44.241 INFO:tasks.rados.rados.2.smithi057.stdout:288: expect (ObjNum 21 snap 0 seq_num 21) 2020-11-16T22:02:44.314 INFO:tasks.rados.rados.2.smithi057.stdout:290: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:44.315 INFO:tasks.rados.rados.2.smithi057.stdout:290: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:44.315 INFO:tasks.rados.rados.2.smithi057.stdout:290: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:44.315 INFO:tasks.rados.rados.2.smithi057.stdout:290: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:44.315 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 63 (ObjNum 126 snap 36 seq_num 126) dirty exists 2020-11-16T22:02:44.315 INFO:tasks.rados.rados.2.smithi057.stdout:290: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 126 snap 36 seq_num 126) 2020-11-16T22:02:44.315 INFO:tasks.rados.rados.2.smithi057.stdout:291: finishing copy_from to smithi05720651-30 2020-11-16T22:02:44.315 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 57 (ObjNum 109 snap 32 seq_num 109) dirty exists 2020-11-16T22:02:44.316 INFO:tasks.rados.rados.2.smithi057.stdout:291: finishing copy_from racing read to smithi05720651-30 2020-11-16T22:02:44.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:44 smithi016 bash[10302]: cluster 2020-11-16T22:02:43.022966+0000 mon.a (mon.0) 768 : cluster [DBG] osdmap e137: 12 total, 12 up, 12 in 2020-11-16T22:02:44.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:44 smithi195 bash[10218]: cluster 2020-11-16T22:02:43.022966+0000 mon.a (mon.0) 768 : cluster [DBG] osdmap e137: 12 total, 12 up, 12 in 2020-11-16T22:02:44.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:44 smithi057 bash[10301]: cluster 2020-11-16T22:02:43.022966+0000 mon.a (mon.0) 768 : cluster [DBG] osdmap e137: 12 total, 12 up, 12 in 2020-11-16T22:02:44.875 INFO:tasks.rados.rados.2.smithi057.stdout:286: done (5 left) 2020-11-16T22:02:44.876 INFO:tasks.rados.rados.2.smithi057.stdout:287: done (4 left) 2020-11-16T22:02:44.876 INFO:tasks.rados.rados.2.smithi057.stdout:288: done (3 left) 2020-11-16T22:02:44.876 INFO:tasks.rados.rados.2.smithi057.stdout:290: done (2 left) 2020-11-16T22:02:44.876 INFO:tasks.rados.rados.2.smithi057.stdout:291: done (1 left) 2020-11-16T22:02:44.876 INFO:tasks.rados.rados.2.smithi057.stdout:292: done (0 left) 2020-11-16T22:02:44.876 INFO:tasks.rados.rados.2.smithi057.stdout:293: snap_remove snap 32 2020-11-16T22:02:45.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:45 smithi016 bash[10302]: cluster 2020-11-16T22:02:43.583276+0000 mgr.x (mgr.24115) 303 : cluster [DBG] pgmap v370: 17 pgs: 17 active+clean; 191 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2020-11-16T22:02:45.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:45 smithi016 bash[10302]: cluster 2020-11-16T22:02:44.040377+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e138: 12 total, 12 up, 12 in 2020-11-16T22:02:45.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:45 smithi016 bash[10302]: cluster 2020-11-16T22:02:44.882629+0000 mon.a (mon.0) 770 : cluster [DBG] osdmap e139: 12 total, 12 up, 12 in 2020-11-16T22:02:45.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:45 smithi195 bash[10218]: cluster 2020-11-16T22:02:43.583276+0000 mgr.x (mgr.24115) 303 : cluster [DBG] pgmap v370: 17 pgs: 17 active+clean; 191 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2020-11-16T22:02:45.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:45 smithi195 bash[10218]: cluster 2020-11-16T22:02:44.040377+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e138: 12 total, 12 up, 12 in 2020-11-16T22:02:45.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:45 smithi195 bash[10218]: cluster 2020-11-16T22:02:44.882629+0000 mon.a (mon.0) 770 : cluster [DBG] osdmap e139: 12 total, 12 up, 12 in 2020-11-16T22:02:45.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:45 smithi057 bash[10301]: cluster 2020-11-16T22:02:43.583276+0000 mgr.x (mgr.24115) 303 : cluster [DBG] pgmap v370: 17 pgs: 17 active+clean; 191 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2020-11-16T22:02:45.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:45 smithi057 bash[10301]: cluster 2020-11-16T22:02:44.040377+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e138: 12 total, 12 up, 12 in 2020-11-16T22:02:45.448 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:45 smithi057 bash[10301]: cluster 2020-11-16T22:02:44.882629+0000 mon.a (mon.0) 770 : cluster [DBG] osdmap e139: 12 total, 12 up, 12 in 2020-11-16T22:02:45.876 INFO:tasks.rados.rados.2.smithi057.stdout:293: done (0 left) 2020-11-16T22:02:45.876 INFO:tasks.rados.rados.2.smithi057.stdout:294: delete oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 37 2020-11-16T22:02:45.885 INFO:tasks.rados.rados.2.smithi057.stdout:294: done (0 left) 2020-11-16T22:02:45.885 INFO:tasks.rados.rados.2.smithi057.stdout:295: delete oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 37 2020-11-16T22:02:45.888 INFO:tasks.rados.rados.2.smithi057.stdout:295: done (0 left) 2020-11-16T22:02:45.888 INFO:tasks.rados.rados.2.smithi057.stdout:296: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:45.888 INFO:tasks.rados.rados.2.smithi057.stdout:296: expect (ObjNum 62 snap 8 seq_num 62) 2020-11-16T22:02:45.888 INFO:tasks.rados.rados.2.smithi057.stdout:297: delete oid 16 current snap is 37 2020-11-16T22:02:45.891 INFO:tasks.rados.rados.2.smithi057.stdout:297: done (1 left) 2020-11-16T22:02:45.891 INFO:tasks.rados.rados.2.smithi057.stdout:298: write (excl) oid 34 current snap is 37 2020-11-16T22:02:45.891 INFO:tasks.rados.rados.2.smithi057.stdout:298: seq_num 130 ranges {584910=560371,1857365=327545} 2020-11-16T22:02:45.899 INFO:tasks.rados.rados.2.smithi057.stdout:298: writing smithi05720651-34 from 584910 to 1145281 tid 1 2020-11-16T22:02:45.906 INFO:tasks.rados.rados.2.smithi057.stdout:298: writing smithi05720651-34 from 1857365 to 2184910 tid 2 2020-11-16T22:02:45.907 INFO:tasks.rados.rados.2.smithi057.stdout:299: copy_from oid 42 from oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 37 2020-11-16T22:02:45.907 INFO:tasks.rados.rados.2.smithi057.stdout:298: finishing write tid 1 to smithi05720651-34 2020-11-16T22:02:45.907 INFO:tasks.rados.rados.2.smithi057.stdout:296: expect (ObjNum 62 snap 8 seq_num 62) 2020-11-16T22:02:46.004 INFO:tasks.rados.rados.2.smithi057.stdout:299: finishing copy_from to smithi05720651-42 2020-11-16T22:02:46.005 INFO:tasks.rados.rados.2.smithi057.stdout:299: got expected ENOENT (src dne) 2020-11-16T22:02:46.005 INFO:tasks.rados.rados.2.smithi057.stdout:299: finishing copy_from racing read to smithi05720651-42 2020-11-16T22:02:46.005 INFO:tasks.rados.rados.2.smithi057.stdout:298: finishing write tid 2 to smithi05720651-34 2020-11-16T22:02:46.005 INFO:tasks.rados.rados.2.smithi057.stdout:298: finishing write tid 4 to smithi05720651-34 2020-11-16T22:02:46.006 INFO:tasks.rados.rados.2.smithi057.stdout:298: finishing write tid 5 to smithi05720651-34 2020-11-16T22:02:46.006 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 81 (ObjNum 130 snap 37 seq_num 130) dirty exists 2020-11-16T22:02:46.006 INFO:tasks.rados.rados.2.smithi057.stdout:298: left oid 34 (ObjNum 130 snap 37 seq_num 130) 2020-11-16T22:02:46.007 INFO:tasks.rados.rados.2.smithi057.stdout:296: done (2 left) 2020-11-16T22:02:46.007 INFO:tasks.rados.rados.2.smithi057.stdout:298: done (1 left) 2020-11-16T22:02:46.007 INFO:tasks.rados.rados.2.smithi057.stdout:299: done (0 left) 2020-11-16T22:02:46.007 INFO:tasks.rados.rados.2.smithi057.stdout:300: read oid 34 snap 34 2020-11-16T22:02:46.008 INFO:tasks.rados.rados.2.smithi057.stdout:300: expect (ObjNum 105 snap 32 seq_num 105) 2020-11-16T22:02:46.008 INFO:tasks.rados.rados.2.smithi057.stdout:301: read oid 40 snap -1 2020-11-16T22:02:46.008 INFO:tasks.rados.rados.2.smithi057.stdout:301: expect (ObjNum 3 snap 0 seq_num 3) 2020-11-16T22:02:46.008 INFO:tasks.rados.rados.2.smithi057.stdout:302: snap_remove snap 25 2020-11-16T22:02:46.888 INFO:tasks.rados.rados.2.smithi057.stdout:302: done (2 left) 2020-11-16T22:02:46.888 INFO:tasks.rados.rados.2.smithi057.stdout:303: write oid 2 current snap is 37 2020-11-16T22:02:46.888 INFO:tasks.rados.rados.2.smithi057.stdout:303: seq_num 131 ranges {601717=635620,1799494=402223} 2020-11-16T22:02:46.898 INFO:tasks.rados.rados.2.smithi057.stdout:303: writing smithi05720651-2 from 601717 to 1237337 tid 1 2020-11-16T22:02:46.905 INFO:tasks.rados.rados.2.smithi057.stdout:303: writing smithi05720651-2 from 1799494 to 2201717 tid 2 2020-11-16T22:02:46.905 INFO:tasks.rados.rados.2.smithi057.stdout:304: delete oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 37 2020-11-16T22:02:46.905 INFO:tasks.rados.rados.2.smithi057.stdout:301: expect (ObjNum 3 snap 0 seq_num 3) 2020-11-16T22:02:46.970 INFO:tasks.rados.rados.2.smithi057.stdout:300: expect (ObjNum 105 snap 32 seq_num 105) 2020-11-16T22:02:47.082 INFO:tasks.rados.rados.2.smithi057.stdout:303: finishing write tid 1 to smithi05720651-2 2020-11-16T22:02:47.082 INFO:tasks.rados.rados.2.smithi057.stdout:303: finishing write tid 2 to smithi05720651-2 2020-11-16T22:02:47.083 INFO:tasks.rados.rados.2.smithi057.stdout:303: finishing write tid 4 to smithi05720651-2 2020-11-16T22:02:47.083 INFO:tasks.rados.rados.2.smithi057.stdout:303: finishing write tid 5 to smithi05720651-2 2020-11-16T22:02:47.083 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 198 (ObjNum 131 snap 37 seq_num 131) dirty exists 2020-11-16T22:02:47.083 INFO:tasks.rados.rados.2.smithi057.stdout:303: left oid 2 (ObjNum 131 snap 37 seq_num 131) 2020-11-16T22:02:47.083 INFO:tasks.rados.rados.2.smithi057.stdout:300: done (3 left) 2020-11-16T22:02:47.083 INFO:tasks.rados.rados.2.smithi057.stdout:301: done (2 left) 2020-11-16T22:02:47.083 INFO:tasks.rados.rados.2.smithi057.stdout:303: done (1 left) 2020-11-16T22:02:47.084 INFO:tasks.rados.rados.2.smithi057.stdout:304: done (0 left) 2020-11-16T22:02:47.084 INFO:tasks.rados.rados.2.smithi057.stdout:305: snap_remove snap 34 2020-11-16T22:02:47.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:46 smithi057 bash[10301]: cluster 2020-11-16T22:02:45.583917+0000 mgr.x (mgr.24115) 304 : cluster [DBG] pgmap v373: 17 pgs: 17 active+clean; 201 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 2.6 MiB/s wr, 10 op/s 2020-11-16T22:02:47.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:46 smithi057 bash[10301]: cluster 2020-11-16T22:02:45.884824+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e140: 12 total, 12 up, 12 in 2020-11-16T22:02:47.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:46 smithi016 bash[10302]: cluster 2020-11-16T22:02:45.583917+0000 mgr.x (mgr.24115) 304 : cluster [DBG] pgmap v373: 17 pgs: 17 active+clean; 201 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 2.6 MiB/s wr, 10 op/s 2020-11-16T22:02:47.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:46 smithi016 bash[10302]: cluster 2020-11-16T22:02:45.884824+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e140: 12 total, 12 up, 12 in 2020-11-16T22:02:47.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:46 smithi195 bash[10218]: cluster 2020-11-16T22:02:45.583917+0000 mgr.x (mgr.24115) 304 : cluster [DBG] pgmap v373: 17 pgs: 17 active+clean; 201 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 2.6 MiB/s wr, 10 op/s 2020-11-16T22:02:47.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:46 smithi195 bash[10218]: cluster 2020-11-16T22:02:45.884824+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e140: 12 total, 12 up, 12 in 2020-11-16T22:02:47.911 INFO:tasks.rados.rados.2.smithi057.stdout:305: done (0 left) 2020-11-16T22:02:47.912 INFO:tasks.rados.rados.2.smithi057.stdout:306: snap_remove snap 36 2020-11-16T22:02:48.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:47 smithi057 bash[10301]: cluster 2020-11-16T22:02:46.897252+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e141: 12 total, 12 up, 12 in 2020-11-16T22:02:48.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:47 smithi016 bash[10302]: cluster 2020-11-16T22:02:46.897252+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e141: 12 total, 12 up, 12 in 2020-11-16T22:02:48.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:47 smithi195 bash[10218]: cluster 2020-11-16T22:02:46.897252+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e141: 12 total, 12 up, 12 in 2020-11-16T22:02:48.915 INFO:tasks.rados.rados.2.smithi057.stdout:306: done (0 left) 2020-11-16T22:02:48.916 INFO:tasks.rados.rados.2.smithi057.stdout:307: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:48.916 INFO:tasks.rados.rados.2.smithi057.stdout:307: expect (ObjNum 118 snap 34 seq_num 118) 2020-11-16T22:02:48.916 INFO:tasks.rados.rados.2.smithi057.stdout:308: write (excl) oid 22 current snap is 37 2020-11-16T22:02:48.916 INFO:tasks.rados.rados.2.smithi057.stdout:308: seq_num 133 ranges {635331=786118,1916458=318873} 2020-11-16T22:02:48.928 INFO:tasks.rados.rados.2.smithi057.stdout:308: writing smithi05720651-22 from 635331 to 1421449 tid 1 2020-11-16T22:02:48.933 INFO:tasks.rados.rados.2.smithi057.stdout:308: writing smithi05720651-22 from 1916458 to 2235331 tid 2 2020-11-16T22:02:48.933 INFO:tasks.rados.rados.2.smithi057.stdout:309: snap_remove snap 15 2020-11-16T22:02:49.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:48 smithi057 bash[10301]: cluster 2020-11-16T22:02:47.584583+0000 mgr.x (mgr.24115) 305 : cluster [DBG] pgmap v376: 17 pgs: 17 active+clean; 211 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 4.4 MiB/s wr, 30 op/s 2020-11-16T22:02:49.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:48 smithi057 bash[10301]: cluster 2020-11-16T22:02:47.919970+0000 mon.a (mon.0) 773 : cluster [DBG] osdmap e142: 12 total, 12 up, 12 in 2020-11-16T22:02:49.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:48 smithi016 bash[10302]: cluster 2020-11-16T22:02:47.584583+0000 mgr.x (mgr.24115) 305 : cluster [DBG] pgmap v376: 17 pgs: 17 active+clean; 211 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 4.4 MiB/s wr, 30 op/s 2020-11-16T22:02:49.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:48 smithi016 bash[10302]: cluster 2020-11-16T22:02:47.919970+0000 mon.a (mon.0) 773 : cluster [DBG] osdmap e142: 12 total, 12 up, 12 in 2020-11-16T22:02:49.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:48 smithi195 bash[10218]: cluster 2020-11-16T22:02:47.584583+0000 mgr.x (mgr.24115) 305 : cluster [DBG] pgmap v376: 17 pgs: 17 active+clean; 211 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 4.4 MiB/s wr, 30 op/s 2020-11-16T22:02:49.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:48 smithi195 bash[10218]: cluster 2020-11-16T22:02:47.919970+0000 mon.a (mon.0) 773 : cluster [DBG] osdmap e142: 12 total, 12 up, 12 in 2020-11-16T22:02:49.879 INFO:tasks.rados.rados.2.smithi057.stdout:309: done (2 left) 2020-11-16T22:02:49.879 INFO:tasks.rados.rados.2.smithi057.stdout:310: copy_from oid 36 from oid 46 current snap is 37 2020-11-16T22:02:49.885 INFO:tasks.rados.rados.2.smithi057.stdout:307: expect (ObjNum 118 snap 34 seq_num 118) 2020-11-16T22:02:50.123 INFO:tasks.rados.rados.2.smithi057.stdout:308: finishing write tid 1 to smithi05720651-22 2020-11-16T22:02:50.123 INFO:tasks.rados.rados.2.smithi057.stdout:308: finishing write tid 2 to smithi05720651-22 2020-11-16T22:02:50.123 INFO:tasks.rados.rados.2.smithi057.stdout:308: finishing write tid 4 to smithi05720651-22 2020-11-16T22:02:50.124 INFO:tasks.rados.rados.2.smithi057.stdout:308: finishing write tid 5 to smithi05720651-22 2020-11-16T22:02:50.124 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 41 (ObjNum 133 snap 37 seq_num 133) dirty exists 2020-11-16T22:02:50.124 INFO:tasks.rados.rados.2.smithi057.stdout:308: left oid 22 (ObjNum 133 snap 37 seq_num 133) 2020-11-16T22:02:50.124 INFO:tasks.rados.rados.2.smithi057.stdout:310: finishing copy_from to smithi05720651-36 2020-11-16T22:02:50.124 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 134 (ObjNum 113 snap 34 seq_num 113) dirty exists 2020-11-16T22:02:50.124 INFO:tasks.rados.rados.2.smithi057.stdout:310: finishing copy_from racing read to smithi05720651-36 2020-11-16T22:02:50.124 INFO:tasks.rados.rados.2.smithi057.stdout:307: done (2 left) 2020-11-16T22:02:50.125 INFO:tasks.rados.rados.2.smithi057.stdout:308: done (1 left) 2020-11-16T22:02:50.125 INFO:tasks.rados.rados.2.smithi057.stdout:310: done (0 left) 2020-11-16T22:02:50.125 INFO:tasks.rados.rados.2.smithi057.stdout:311: snap_create 2020-11-16T22:02:50.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:49 smithi057 bash[10301]: cluster 2020-11-16T22:02:48.921727+0000 mon.a (mon.0) 774 : cluster [DBG] osdmap e143: 12 total, 12 up, 12 in 2020-11-16T22:02:50.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:49 smithi057 bash[10301]: cluster 2020-11-16T22:02:49.885103+0000 mon.a (mon.0) 775 : cluster [DBG] osdmap e144: 12 total, 12 up, 12 in 2020-11-16T22:02:50.198 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:02:49 smithi057 bash[12595]: debug 2020-11-16T22:02:49.881+0000 7f737819a700 -1 osd.8 pg_epoch: 144 pg[2.f( v 124'19 (0'0,124'19] local-lis/les=71/72 n=2 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,9] r=0 lpr=71 crt=124'19 lcod 120'17 mlcod 120'17 active+clean+snaptrim trimq=[1c~1] ps=[2b~2,3a~1,3e~1,41~1]] removing snap head 2020-11-16T22:02:50.198 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:02:49 smithi057 bash[12595]: debug 2020-11-16T22:02:49.889+0000 7f737919c700 -1 osd.8 pg_epoch: 144 pg[2.5( v 141'145 (0'0,141'145] local-lis/les=71/72 n=10 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,0] r=0 lpr=71 crt=141'145 lcod 140'143 mlcod 140'143 active+clean+snaptrim trimq=[1c~1] ps=[2b~2,3a~1,3e~1,41~1]] removing snap head 2020-11-16T22:02:50.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:49 smithi016 bash[10302]: cluster 2020-11-16T22:02:48.921727+0000 mon.a (mon.0) 774 : cluster [DBG] osdmap e143: 12 total, 12 up, 12 in 2020-11-16T22:02:50.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:49 smithi016 bash[10302]: cluster 2020-11-16T22:02:49.885103+0000 mon.a (mon.0) 775 : cluster [DBG] osdmap e144: 12 total, 12 up, 12 in 2020-11-16T22:02:50.337 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 22:02:49 smithi016 bash[15120]: debug 2020-11-16T22:02:49.995+0000 7f8fc2db1700 -1 osd.5 pg_epoch: 144 pg[2.3( v 143'196 (0'0,143'196] local-lis/les=71/72 n=16 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [5,2] r=0 lpr=71 crt=143'196 lcod 142'194 mlcod 142'194 active+clean+snaptrim trimq=[1c~1] ps=[2b~2,3a~1,3e~1,41~1]] removing snap head 2020-11-16T22:02:50.338 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 22:02:49 smithi016 bash[15120]: debug 2020-11-16T22:02:49.995+0000 7f8fc2db1700 -1 osd.5 pg_epoch: 144 pg[2.3( v 144'198 (0'0,144'198] local-lis/les=71/72 n=14 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [5,2] r=0 lpr=71 luod=143'196 crt=144'198 lcod 142'194 mlcod 142'194 active+clean+snaptrim trimq=[1c~1] ps=[2b~2,3a~1,3e~1,41~1]] removing snap head 2020-11-16T22:02:50.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:49 smithi195 bash[10218]: cluster 2020-11-16T22:02:48.921727+0000 mon.a (mon.0) 774 : cluster [DBG] osdmap e143: 12 total, 12 up, 12 in 2020-11-16T22:02:50.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:49 smithi195 bash[10218]: cluster 2020-11-16T22:02:49.885103+0000 mon.a (mon.0) 775 : cluster [DBG] osdmap e144: 12 total, 12 up, 12 in 2020-11-16T22:02:50.349 INFO:journalctl@ceph.osd.2.smithi195.stdout:Nov 16 22:02:50 smithi195 bash[21024]: debug 2020-11-16T22:02:50.000+0000 7f3c15f2f700 -1 osd.2 pg_epoch: 144 pg[2.e( v 142'76 (0'0,142'76] local-lis/les=71/72 n=7 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [2,3] r=0 lpr=71 crt=142'76 lcod 141'74 mlcod 141'74 active+clean+snaptrim trimq=[1c~1] ps=[2b~2,3a~1,3e~1,41~1]] removing snap head 2020-11-16T22:02:50.933 INFO:tasks.rados.rados.2.smithi057.stdout:311: done (0 left) 2020-11-16T22:02:50.933 INFO:tasks.rados.rados.2.smithi057.stdout:312: write oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 38 2020-11-16T22:02:50.933 INFO:tasks.rados.rados.2.smithi057.stdout:312: seq_num 134 ranges {652138=461367,1574940=677198} 2020-11-16T22:02:50.943 INFO:tasks.rados.rados.2.smithi057.stdout:312: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 652138 to 1113505 tid 1 2020-11-16T22:02:50.951 INFO:tasks.rados.rados.2.smithi057.stdout:312: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1574940 to 2252138 tid 2 2020-11-16T22:02:50.951 INFO:tasks.rados.rados.2.smithi057.stdout:313: snap_remove snap 27 2020-11-16T22:02:51.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:50 smithi057 bash[10301]: cluster 2020-11-16T22:02:49.585273+0000 mgr.x (mgr.24115) 306 : cluster [DBG] pgmap v379: 17 pgs: 17 active+clean; 213 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 2.7 MiB/s wr, 27 op/s 2020-11-16T22:02:51.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:50 smithi016 bash[10302]: cluster 2020-11-16T22:02:49.585273+0000 mgr.x (mgr.24115) 306 : cluster [DBG] pgmap v379: 17 pgs: 17 active+clean; 213 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 2.7 MiB/s wr, 27 op/s 2020-11-16T22:02:51.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:50 smithi195 bash[10218]: cluster 2020-11-16T22:02:49.585273+0000 mgr.x (mgr.24115) 306 : cluster [DBG] pgmap v379: 17 pgs: 17 active+clean; 213 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 2.7 MiB/s wr, 27 op/s 2020-11-16T22:02:51.954 INFO:tasks.rados.rados.2.smithi057.stdout:313: done (1 left) 2020-11-16T22:02:51.954 INFO:tasks.rados.rados.2.smithi057.stdout:314: write (excl) oid 48 current snap is 38 2020-11-16T22:02:51.954 INFO:tasks.rados.rados.2.smithi057.stdout:314: seq_num 135 ranges {668945=536616,1633422=491363} 2020-11-16T22:02:51.963 INFO:tasks.rados.rados.2.smithi057.stdout:314: writing smithi05720651-48 from 668945 to 1205561 tid 1 2020-11-16T22:02:51.968 INFO:tasks.rados.rados.2.smithi057.stdout:314: writing smithi05720651-48 from 1633422 to 2124785 tid 2 2020-11-16T22:02:51.968 INFO:tasks.rados.rados.2.smithi057.stdout:315: read oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:51.969 INFO:tasks.rados.rados.2.smithi057.stdout:315: expect (ObjNum 18 snap 0 seq_num 18) 2020-11-16T22:02:51.969 INFO:tasks.rados.rados.2.smithi057.stdout:316: write (excl) oid 32 current snap is 38 2020-11-16T22:02:51.969 INFO:tasks.rados.rados.2.smithi057.stdout:316: seq_num 136 ranges {685752=611865,1975551=310201} 2020-11-16T22:02:51.976 INFO:tasks.rados.rados.2.smithi057.stdout:316: writing smithi05720651-32 from 685752 to 1297617 tid 1 2020-11-16T22:02:51.982 INFO:tasks.rados.rados.2.smithi057.stdout:316: writing smithi05720651-32 from 1975551 to 2285752 tid 2 2020-11-16T22:02:51.982 INFO:tasks.rados.rados.2.smithi057.stdout:317: rollback oid 24 current snap is 38 2020-11-16T22:02:51.982 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 24 to 28 2020-11-16T22:02:51.982 INFO:tasks.rados.rados.2.smithi057.stdout:312: finishing write tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:51.983 INFO:tasks.rados.rados.2.smithi057.stdout:312: finishing write tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:51.983 INFO:tasks.rados.rados.2.smithi057.stdout:318: snap_create 2020-11-16T22:02:51.983 INFO:tasks.rados.rados.2.smithi057.stdout:312: finishing write tid 4 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:51.983 INFO:tasks.rados.rados.2.smithi057.stdout:312: finishing write tid 5 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:02:51.983 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 226 (ObjNum 134 snap 38 seq_num 134) dirty exists 2020-11-16T22:02:51.983 INFO:tasks.rados.rados.2.smithi057.stdout:312: left oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 134 snap 38 seq_num 134) 2020-11-16T22:02:51.983 INFO:tasks.rados.rados.2.smithi057.stdout:314: finishing write tid 1 to smithi05720651-48 2020-11-16T22:02:51.984 INFO:tasks.rados.rados.2.smithi057.stdout:314: finishing write tid 2 to smithi05720651-48 2020-11-16T22:02:51.984 INFO:tasks.rados.rados.2.smithi057.stdout:314: finishing write tid 4 to smithi05720651-48 2020-11-16T22:02:51.984 INFO:tasks.rados.rados.2.smithi057.stdout:314: finishing write tid 5 to smithi05720651-48 2020-11-16T22:02:51.984 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 79 (ObjNum 135 snap 38 seq_num 135) dirty exists 2020-11-16T22:02:51.984 INFO:tasks.rados.rados.2.smithi057.stdout:314: left oid 48 (ObjNum 135 snap 38 seq_num 135) 2020-11-16T22:02:51.984 INFO:tasks.rados.rados.2.smithi057.stdout:315: expect (ObjNum 18 snap 0 seq_num 18) 2020-11-16T22:02:52.055 INFO:tasks.rados.rados.2.smithi057.stdout:317: finishing rollback tid 1 to smithi05720651-24 2020-11-16T22:02:52.056 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 0 (ObjNum 129 snap 0 seq_num 0) dirty dne 2020-11-16T22:02:52.056 INFO:tasks.rados.rados.2.smithi057.stdout:316: finishing write tid 1 to smithi05720651-32 2020-11-16T22:02:52.056 INFO:tasks.rados.rados.2.smithi057.stdout:316: finishing write tid 2 to smithi05720651-32 2020-11-16T22:02:52.056 INFO:tasks.rados.rados.2.smithi057.stdout:316: finishing write tid 4 to smithi05720651-32 2020-11-16T22:02:52.056 INFO:tasks.rados.rados.2.smithi057.stdout:316: finishing write tid 5 to smithi05720651-32 2020-11-16T22:02:52.056 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 233 (ObjNum 136 snap 38 seq_num 136) dirty exists 2020-11-16T22:02:52.057 INFO:tasks.rados.rados.2.smithi057.stdout:316: left oid 32 (ObjNum 136 snap 38 seq_num 136) 2020-11-16T22:02:52.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:51 smithi057 bash[10301]: cluster 2020-11-16T22:02:50.941897+0000 mon.a (mon.0) 776 : cluster [DBG] osdmap e145: 12 total, 12 up, 12 in 2020-11-16T22:02:52.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:51 smithi016 bash[10302]: cluster 2020-11-16T22:02:50.941897+0000 mon.a (mon.0) 776 : cluster [DBG] osdmap e145: 12 total, 12 up, 12 in 2020-11-16T22:02:52.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:51 smithi195 bash[10218]: cluster 2020-11-16T22:02:50.941897+0000 mon.a (mon.0) 776 : cluster [DBG] osdmap e145: 12 total, 12 up, 12 in 2020-11-16T22:02:52.953 INFO:tasks.rados.rados.2.smithi057.stdout:312: done (5 left) 2020-11-16T22:02:52.954 INFO:tasks.rados.rados.2.smithi057.stdout:314: done (4 left) 2020-11-16T22:02:52.954 INFO:tasks.rados.rados.2.smithi057.stdout:315: done (3 left) 2020-11-16T22:02:52.954 INFO:tasks.rados.rados.2.smithi057.stdout:316: done (2 left) 2020-11-16T22:02:52.954 INFO:tasks.rados.rados.2.smithi057.stdout:317: done (1 left) 2020-11-16T22:02:52.954 INFO:tasks.rados.rados.2.smithi057.stdout:318: done (0 left) 2020-11-16T22:02:52.954 INFO:tasks.rados.rados.2.smithi057.stdout:319: write (excl) oid 10 current snap is 39 2020-11-16T22:02:52.955 INFO:tasks.rados.rados.2.smithi057.stdout:319: seq_num 137 ranges {702559=403467,1750386=495032} 2020-11-16T22:02:52.965 INFO:tasks.rados.rados.2.smithi057.stdout:319: writing smithi05720651-10 from 702559 to 1106026 tid 1 2020-11-16T22:02:52.974 INFO:tasks.rados.rados.2.smithi057.stdout:319: writing smithi05720651-10 from 1750386 to 2245418 tid 2 2020-11-16T22:02:52.974 INFO:tasks.rados.rados.2.smithi057.stdout:320: snap_remove snap 37 2020-11-16T22:02:53.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:52 smithi016 bash[10302]: cluster 2020-11-16T22:02:51.585979+0000 mgr.x (mgr.24115) 307 : cluster [DBG] pgmap v382: 17 pgs: 17 active+clean; 192 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1018 KiB/s wr, 15 op/s 2020-11-16T22:02:53.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:52 smithi016 bash[10302]: cluster 2020-11-16T22:02:51.959860+0000 mon.a (mon.0) 777 : cluster [DBG] osdmap e146: 12 total, 12 up, 12 in 2020-11-16T22:02:53.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:52 smithi195 bash[10218]: cluster 2020-11-16T22:02:51.585979+0000 mgr.x (mgr.24115) 307 : cluster [DBG] pgmap v382: 17 pgs: 17 active+clean; 192 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1018 KiB/s wr, 15 op/s 2020-11-16T22:02:53.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:52 smithi195 bash[10218]: cluster 2020-11-16T22:02:51.959860+0000 mon.a (mon.0) 777 : cluster [DBG] osdmap e146: 12 total, 12 up, 12 in 2020-11-16T22:02:53.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:52 smithi057 bash[10301]: cluster 2020-11-16T22:02:51.585979+0000 mgr.x (mgr.24115) 307 : cluster [DBG] pgmap v382: 17 pgs: 17 active+clean; 192 MiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1018 KiB/s wr, 15 op/s 2020-11-16T22:02:53.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:52 smithi057 bash[10301]: cluster 2020-11-16T22:02:51.959860+0000 mon.a (mon.0) 777 : cluster [DBG] osdmap e146: 12 total, 12 up, 12 in 2020-11-16T22:02:53.973 INFO:tasks.rados.rados.2.smithi057.stdout:320: done (1 left) 2020-11-16T22:02:53.973 INFO:tasks.rados.rados.2.smithi057.stdout:321: write oid 48 current snap is 39 2020-11-16T22:02:53.974 INFO:tasks.rados.rados.2.smithi057.stdout:321: seq_num 138 ranges {719366=478716,1808868=510498} 2020-11-16T22:02:53.985 INFO:tasks.rados.rados.2.smithi057.stdout:321: writing smithi05720651-48 from 719366 to 1198082 tid 1 2020-11-16T22:02:53.992 INFO:tasks.rados.rados.2.smithi057.stdout:321: writing smithi05720651-48 from 1808868 to 2319366 tid 2 2020-11-16T22:02:53.993 INFO:tasks.rados.rados.2.smithi057.stdout:322: copy_from oid 18 from oid 46 current snap is 39 2020-11-16T22:02:53.993 INFO:tasks.rados.rados.2.smithi057.stdout:319: finishing write tid 1 to smithi05720651-10 2020-11-16T22:02:53.993 INFO:tasks.rados.rados.2.smithi057.stdout:319: finishing write tid 2 to smithi05720651-10 2020-11-16T22:02:53.993 INFO:tasks.rados.rados.2.smithi057.stdout:319: finishing write tid 4 to smithi05720651-10 2020-11-16T22:02:53.993 INFO:tasks.rados.rados.2.smithi057.stdout:319: finishing write tid 5 to smithi05720651-10 2020-11-16T22:02:53.993 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 159 (ObjNum 137 snap 39 seq_num 137) dirty exists 2020-11-16T22:02:53.993 INFO:tasks.rados.rados.2.smithi057.stdout:319: left oid 10 (ObjNum 137 snap 39 seq_num 137) 2020-11-16T22:02:53.994 INFO:tasks.rados.rados.2.smithi057.stdout:319: done (2 left) 2020-11-16T22:02:53.994 INFO:tasks.rados.rados.2.smithi057.stdout:323: read oid 38 snap -1 2020-11-16T22:02:53.994 INFO:tasks.rados.rados.2.smithi057.stdout:323: expect (ObjNum 37 snap 0 seq_num 37) 2020-11-16T22:02:53.994 INFO:tasks.rados.rados.2.smithi057.stdout:324: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:53.994 INFO:tasks.rados.rados.2.smithi057.stdout:324: expect (ObjNum 121 snap 36 seq_num 121) 2020-11-16T22:02:53.994 INFO:tasks.rados.rados.2.smithi057.stdout:325: copy_from oid 44 from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 39 2020-11-16T22:02:53.994 INFO:tasks.rados.rados.2.smithi057.stdout:326: snap_create 2020-11-16T22:02:53.999 INFO:tasks.rados.rados.2.smithi057.stdout:325: finishing copy_from to smithi05720651-44 2020-11-16T22:02:53.999 INFO:tasks.rados.rados.2.smithi057.stdout:325: got expected ENOENT (src dne) 2020-11-16T22:02:53.999 INFO:tasks.rados.rados.2.smithi057.stdout:325: finishing copy_from racing read to smithi05720651-44 2020-11-16T22:02:54.000 INFO:tasks.rados.rados.2.smithi057.stdout:321: finishing write tid 1 to smithi05720651-48 2020-11-16T22:02:54.000 INFO:tasks.rados.rados.2.smithi057.stdout:321: finishing write tid 2 to smithi05720651-48 2020-11-16T22:02:54.001 INFO:tasks.rados.rados.2.smithi057.stdout:321: finishing write tid 4 to smithi05720651-48 2020-11-16T22:02:54.001 INFO:tasks.rados.rados.2.smithi057.stdout:321: finishing write tid 5 to smithi05720651-48 2020-11-16T22:02:54.002 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 82 (ObjNum 138 snap 39 seq_num 138) dirty exists 2020-11-16T22:02:54.002 INFO:tasks.rados.rados.2.smithi057.stdout:321: left oid 48 (ObjNum 138 snap 39 seq_num 138) 2020-11-16T22:02:54.003 INFO:tasks.rados.rados.2.smithi057.stdout:324: expect (ObjNum 121 snap 36 seq_num 121) 2020-11-16T22:02:54.096 INFO:tasks.rados.rados.2.smithi057.stdout:323: expect (ObjNum 37 snap 0 seq_num 37) 2020-11-16T22:02:54.176 INFO:tasks.rados.rados.2.smithi057.stdout:322: finishing copy_from to smithi05720651-18 2020-11-16T22:02:54.177 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 134 (ObjNum 113 snap 34 seq_num 113) dirty exists 2020-11-16T22:02:54.177 INFO:tasks.rados.rados.2.smithi057.stdout:322: finishing copy_from racing read to smithi05720651-18 2020-11-16T22:02:54.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:53 smithi016 bash[10302]: cluster 2020-11-16T22:02:52.962410+0000 mon.a (mon.0) 778 : cluster [DBG] osdmap e147: 12 total, 12 up, 12 in 2020-11-16T22:02:54.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:53 smithi195 bash[10218]: cluster 2020-11-16T22:02:52.962410+0000 mon.a (mon.0) 778 : cluster [DBG] osdmap e147: 12 total, 12 up, 12 in 2020-11-16T22:02:54.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:53 smithi057 bash[10301]: cluster 2020-11-16T22:02:52.962410+0000 mon.a (mon.0) 778 : cluster [DBG] osdmap e147: 12 total, 12 up, 12 in 2020-11-16T22:02:54.876 INFO:tasks.rados.rados.2.smithi057.stdout:321: done (5 left) 2020-11-16T22:02:54.876 INFO:tasks.rados.rados.2.smithi057.stdout:322: done (4 left) 2020-11-16T22:02:54.876 INFO:tasks.rados.rados.2.smithi057.stdout:323: done (3 left) 2020-11-16T22:02:54.877 INFO:tasks.rados.rados.2.smithi057.stdout:324: done (2 left) 2020-11-16T22:02:54.877 INFO:tasks.rados.rados.2.smithi057.stdout:325: done (1 left) 2020-11-16T22:02:54.877 INFO:tasks.rados.rados.2.smithi057.stdout:326: done (0 left) 2020-11-16T22:02:54.877 INFO:tasks.rados.rados.2.smithi057.stdout:327: copy_from oid 42 from oid 24 current snap is 40 2020-11-16T22:02:54.877 INFO:tasks.rados.rados.2.smithi057.stdout:328: snap_create 2020-11-16T22:02:54.892 INFO:tasks.rados.rados.2.smithi057.stdout:327: finishing copy_from to smithi05720651-42 2020-11-16T22:02:54.892 INFO:tasks.rados.rados.2.smithi057.stdout:327: got expected ENOENT (src dne) 2020-11-16T22:02:54.893 INFO:tasks.rados.rados.2.smithi057.stdout:327: finishing copy_from racing read to smithi05720651-42 2020-11-16T22:02:55.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:54 smithi016 bash[10302]: cluster 2020-11-16T22:02:53.586634+0000 mgr.x (mgr.24115) 308 : cluster [DBG] pgmap v385: 17 pgs: 17 active+clean; 186 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2020-11-16T22:02:55.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:54 smithi016 bash[10302]: cluster 2020-11-16T22:02:53.980847+0000 mon.a (mon.0) 779 : cluster [DBG] osdmap e148: 12 total, 12 up, 12 in 2020-11-16T22:02:55.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:54 smithi016 bash[10302]: cluster 2020-11-16T22:02:54.886146+0000 mon.a (mon.0) 780 : cluster [DBG] osdmap e149: 12 total, 12 up, 12 in 2020-11-16T22:02:55.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:54 smithi195 bash[10218]: cluster 2020-11-16T22:02:53.586634+0000 mgr.x (mgr.24115) 308 : cluster [DBG] pgmap v385: 17 pgs: 17 active+clean; 186 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2020-11-16T22:02:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:54 smithi195 bash[10218]: cluster 2020-11-16T22:02:53.980847+0000 mon.a (mon.0) 779 : cluster [DBG] osdmap e148: 12 total, 12 up, 12 in 2020-11-16T22:02:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:54 smithi195 bash[10218]: cluster 2020-11-16T22:02:54.886146+0000 mon.a (mon.0) 780 : cluster [DBG] osdmap e149: 12 total, 12 up, 12 in 2020-11-16T22:02:55.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:54 smithi057 bash[10301]: cluster 2020-11-16T22:02:53.586634+0000 mgr.x (mgr.24115) 308 : cluster [DBG] pgmap v385: 17 pgs: 17 active+clean; 186 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.0 MiB/s wr, 10 op/s 2020-11-16T22:02:55.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:54 smithi057 bash[10301]: cluster 2020-11-16T22:02:53.980847+0000 mon.a (mon.0) 779 : cluster [DBG] osdmap e148: 12 total, 12 up, 12 in 2020-11-16T22:02:55.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:54 smithi057 bash[10301]: cluster 2020-11-16T22:02:54.886146+0000 mon.a (mon.0) 780 : cluster [DBG] osdmap e149: 12 total, 12 up, 12 in 2020-11-16T22:02:55.887 INFO:tasks.rados.rados.2.smithi057.stdout:327: done (1 left) 2020-11-16T22:02:55.887 INFO:tasks.rados.rados.2.smithi057.stdout:328: done (0 left) 2020-11-16T22:02:55.887 INFO:tasks.rados.rados.2.smithi057.stdout:329: snap_remove snap 40 2020-11-16T22:02:56.889 INFO:tasks.rados.rados.2.smithi057.stdout:329: done (0 left) 2020-11-16T22:02:56.889 INFO:tasks.rados.rados.2.smithi057.stdout:330: delete oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 41 2020-11-16T22:02:56.895 INFO:tasks.rados.rados.2.smithi057.stdout:330: done (0 left) 2020-11-16T22:02:56.895 INFO:tasks.rados.rados.2.smithi057.stdout:331: copy_from oid 12 from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 41 2020-11-16T22:02:56.895 INFO:tasks.rados.rados.2.smithi057.stdout:332: read oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:02:56.895 INFO:tasks.rados.rados.2.smithi057.stdout:332: expect (ObjNum 78 snap 20 seq_num 78) 2020-11-16T22:02:56.895 INFO:tasks.rados.rados.2.smithi057.stdout:333: snap_remove snap 28 2020-11-16T22:02:57.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:56 smithi057 bash[10301]: cluster 2020-11-16T22:02:55.587391+0000 mgr.x (mgr.24115) 309 : cluster [DBG] pgmap v388: 17 pgs: 17 active+clean; 170 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.4 MiB/s wr, 3 op/s 2020-11-16T22:02:57.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:56 smithi057 bash[10301]: cluster 2020-11-16T22:02:55.896704+0000 mon.a (mon.0) 781 : cluster [DBG] osdmap e150: 12 total, 12 up, 12 in 2020-11-16T22:02:57.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:56 smithi016 bash[10302]: cluster 2020-11-16T22:02:55.587391+0000 mgr.x (mgr.24115) 309 : cluster [DBG] pgmap v388: 17 pgs: 17 active+clean; 170 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.4 MiB/s wr, 3 op/s 2020-11-16T22:02:57.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:56 smithi016 bash[10302]: cluster 2020-11-16T22:02:55.896704+0000 mon.a (mon.0) 781 : cluster [DBG] osdmap e150: 12 total, 12 up, 12 in 2020-11-16T22:02:57.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:56 smithi195 bash[10218]: cluster 2020-11-16T22:02:55.587391+0000 mgr.x (mgr.24115) 309 : cluster [DBG] pgmap v388: 17 pgs: 17 active+clean; 170 MiB data, 321 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.4 MiB/s wr, 3 op/s 2020-11-16T22:02:57.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:56 smithi195 bash[10218]: cluster 2020-11-16T22:02:55.896704+0000 mon.a (mon.0) 781 : cluster [DBG] osdmap e150: 12 total, 12 up, 12 in 2020-11-16T22:02:57.907 INFO:tasks.rados.rados.2.smithi057.stdout:333: done (2 left) 2020-11-16T22:02:57.907 INFO:tasks.rados.rados.2.smithi057.stdout:334: delete oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 41 2020-11-16T22:02:57.907 INFO:tasks.rados.rados.2.smithi057.stdout:331: finishing copy_from to smithi05720651-12 2020-11-16T22:02:57.907 INFO:tasks.rados.rados.2.smithi057.stdout:331: got expected ENOENT (src dne) 2020-11-16T22:02:57.907 INFO:tasks.rados.rados.2.smithi057.stdout:331: finishing copy_from racing read to smithi05720651-12 2020-11-16T22:02:57.908 INFO:tasks.rados.rados.2.smithi057.stdout:332: expect (ObjNum 78 snap 20 seq_num 78) 2020-11-16T22:02:58.065 INFO:tasks.rados.rados.2.smithi057.stdout:331: done (2 left) 2020-11-16T22:02:58.066 INFO:tasks.rados.rados.2.smithi057.stdout:332: done (1 left) 2020-11-16T22:02:58.066 INFO:tasks.rados.rados.2.smithi057.stdout:334: done (0 left) 2020-11-16T22:02:58.066 INFO:tasks.rados.rados.2.smithi057.stdout:335: snap_remove snap 31 2020-11-16T22:02:58.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:57 smithi057 bash[10301]: cluster 2020-11-16T22:02:56.899355+0000 mon.a (mon.0) 782 : cluster [DBG] osdmap e151: 12 total, 12 up, 12 in 2020-11-16T22:02:58.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:57 smithi016 bash[10302]: cluster 2020-11-16T22:02:56.899355+0000 mon.a (mon.0) 782 : cluster [DBG] osdmap e151: 12 total, 12 up, 12 in 2020-11-16T22:02:58.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:57 smithi195 bash[10218]: cluster 2020-11-16T22:02:56.899355+0000 mon.a (mon.0) 782 : cluster [DBG] osdmap e151: 12 total, 12 up, 12 in 2020-11-16T22:02:58.915 INFO:tasks.rados.rados.2.smithi057.stdout:335: done (0 left) 2020-11-16T22:02:58.916 INFO:tasks.rados.rados.2.smithi057.stdout:336: snap_create 2020-11-16T22:02:59.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:58 smithi057 bash[10301]: cluster 2020-11-16T22:02:57.588107+0000 mgr.x (mgr.24115) 310 : cluster [DBG] pgmap v391: 17 pgs: 17 active+clean; 176 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 2.3 MiB/s wr, 10 op/s 2020-11-16T22:02:59.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:58 smithi057 bash[10301]: cluster 2020-11-16T22:02:57.916556+0000 mon.a (mon.0) 783 : cluster [DBG] osdmap e152: 12 total, 12 up, 12 in 2020-11-16T22:02:59.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:58 smithi016 bash[10302]: cluster 2020-11-16T22:02:57.588107+0000 mgr.x (mgr.24115) 310 : cluster [DBG] pgmap v391: 17 pgs: 17 active+clean; 176 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 2.3 MiB/s wr, 10 op/s 2020-11-16T22:02:59.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:58 smithi016 bash[10302]: cluster 2020-11-16T22:02:57.916556+0000 mon.a (mon.0) 783 : cluster [DBG] osdmap e152: 12 total, 12 up, 12 in 2020-11-16T22:02:59.338 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 22:02:58 smithi016 bash[17468]: debug 2020-11-16T22:02:58.923+0000 7fd65f6d4700 -1 osd.6 pg_epoch: 153 pg[2.7( v 153'122 (0'0,153'122] local-lis/les=71/72 n=6 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [6,10] r=0 lpr=71 luod=152'120 crt=153'122 lcod 152'118 mlcod 152'118 active+clean+snaptrim trimq=[36~1] ps=[1c~1,30~1,33~1,47~1,4c~1]] removing snap head 2020-11-16T22:02:59.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:58 smithi195 bash[10218]: cluster 2020-11-16T22:02:57.588107+0000 mgr.x (mgr.24115) 310 : cluster [DBG] pgmap v391: 17 pgs: 17 active+clean; 176 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 2.3 MiB/s wr, 10 op/s 2020-11-16T22:02:59.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:58 smithi195 bash[10218]: cluster 2020-11-16T22:02:57.916556+0000 mon.a (mon.0) 783 : cluster [DBG] osdmap e152: 12 total, 12 up, 12 in 2020-11-16T22:02:59.879 INFO:tasks.rados.rados.2.smithi057.stdout:336: done (0 left) 2020-11-16T22:02:59.879 INFO:tasks.rados.rados.2.smithi057.stdout:337: snap_remove snap 35 2020-11-16T22:03:00.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:59 smithi057 bash[10301]: cluster 2020-11-16T22:02:58.925530+0000 mon.a (mon.0) 784 : cluster [DBG] osdmap e153: 12 total, 12 up, 12 in 2020-11-16T22:03:00.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:02:59 smithi057 bash[10301]: cluster 2020-11-16T22:02:59.886077+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e154: 12 total, 12 up, 12 in 2020-11-16T22:03:00.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:59 smithi016 bash[10302]: cluster 2020-11-16T22:02:58.925530+0000 mon.a (mon.0) 784 : cluster [DBG] osdmap e153: 12 total, 12 up, 12 in 2020-11-16T22:03:00.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:02:59 smithi016 bash[10302]: cluster 2020-11-16T22:02:59.886077+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e154: 12 total, 12 up, 12 in 2020-11-16T22:03:00.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:59 smithi195 bash[10218]: cluster 2020-11-16T22:02:58.925530+0000 mon.a (mon.0) 784 : cluster [DBG] osdmap e153: 12 total, 12 up, 12 in 2020-11-16T22:03:00.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:02:59 smithi195 bash[10218]: cluster 2020-11-16T22:02:59.886077+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e154: 12 total, 12 up, 12 in 2020-11-16T22:03:00.890 INFO:tasks.rados.rados.2.smithi057.stdout:337: done (0 left) 2020-11-16T22:03:00.891 INFO:tasks.rados.rados.2.smithi057.stdout:338: snap_create 2020-11-16T22:03:01.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:00 smithi057 bash[10301]: cluster 2020-11-16T22:02:59.588818+0000 mgr.x (mgr.24115) 311 : cluster [DBG] pgmap v394: 17 pgs: 17 active+clean; 177 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2020-11-16T22:03:01.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:00 smithi057 bash[10301]: cluster 2020-11-16T22:03:00.899711+0000 mon.a (mon.0) 786 : cluster [DBG] osdmap e155: 12 total, 12 up, 12 in 2020-11-16T22:03:01.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:00 smithi016 bash[10302]: cluster 2020-11-16T22:02:59.588818+0000 mgr.x (mgr.24115) 311 : cluster [DBG] pgmap v394: 17 pgs: 17 active+clean; 177 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2020-11-16T22:03:01.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:00 smithi016 bash[10302]: cluster 2020-11-16T22:03:00.899711+0000 mon.a (mon.0) 786 : cluster [DBG] osdmap e155: 12 total, 12 up, 12 in 2020-11-16T22:03:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:00 smithi195 bash[10218]: cluster 2020-11-16T22:02:59.588818+0000 mgr.x (mgr.24115) 311 : cluster [DBG] pgmap v394: 17 pgs: 17 active+clean; 177 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.4 MiB/s wr, 9 op/s 2020-11-16T22:03:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:00 smithi195 bash[10218]: cluster 2020-11-16T22:03:00.899711+0000 mon.a (mon.0) 786 : cluster [DBG] osdmap e155: 12 total, 12 up, 12 in 2020-11-16T22:03:01.895 INFO:tasks.rados.rados.2.smithi057.stdout:338: done (0 left) 2020-11-16T22:03:01.895 INFO:tasks.rados.rados.2.smithi057.stdout:339: copy_from oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 44 current snap is 43 2020-11-16T22:03:01.895 INFO:tasks.rados.rados.2.smithi057.stdout:340: snap_create 2020-11-16T22:03:01.928 INFO:tasks.rados.rados.2.smithi057.stdout:339: finishing copy_from to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:01.929 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 29 (ObjNum 116 snap 34 seq_num 116) dirty exists 2020-11-16T22:03:01.929 INFO:tasks.rados.rados.2.smithi057.stdout:339: finishing copy_from racing read to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:02.901 INFO:tasks.rados.rados.2.smithi057.stdout:339: done (1 left) 2020-11-16T22:03:02.901 INFO:tasks.rados.rados.2.smithi057.stdout:340: done (0 left) 2020-11-16T22:03:02.901 INFO:tasks.rados.rados.2.smithi057.stdout:341: delete oid 12 current snap is 44 2020-11-16T22:03:02.911 INFO:tasks.rados.rados.2.smithi057.stdout:341: done (0 left) 2020-11-16T22:03:02.911 INFO:tasks.rados.rados.2.smithi057.stdout:342: delete oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 44 2020-11-16T22:03:02.919 INFO:tasks.rados.rados.2.smithi057.stdout:342: done (0 left) 2020-11-16T22:03:02.919 INFO:tasks.rados.rados.2.smithi057.stdout:343: write (excl) oid 40 current snap is 44 2020-11-16T22:03:02.919 INFO:tasks.rados.rados.2.smithi057.stdout:343: seq_num 143 ranges {403401=454961,1584925=506039} 2020-11-16T22:03:02.930 INFO:tasks.rados.rados.2.smithi057.stdout:343: writing smithi05720651-40 from 403401 to 858362 tid 1 2020-11-16T22:03:02.937 INFO:tasks.rados.rados.2.smithi057.stdout:343: writing smithi05720651-40 from 1584925 to 2090964 tid 2 2020-11-16T22:03:02.937 INFO:tasks.rados.rados.2.smithi057.stdout:344: write (excl) oid 48 current snap is 44 2020-11-16T22:03:02.937 INFO:tasks.rados.rados.2.smithi057.stdout:344: seq_num 144 ranges {420208=530210,1527054=766050} 2020-11-16T22:03:02.942 INFO:tasks.rados.rados.2.smithi057.stdout:344: writing smithi05720651-48 from 420208 to 950418 tid 1 2020-11-16T22:03:02.951 INFO:tasks.rados.rados.2.smithi057.stdout:344: writing smithi05720651-48 from 1527054 to 2293104 tid 2 2020-11-16T22:03:02.951 INFO:tasks.rados.rados.2.smithi057.stdout:345: read oid 2 snap 41 2020-11-16T22:03:02.951 INFO:tasks.rados.rados.2.smithi057.stdout:345: expect (ObjNum 131 snap 37 seq_num 131) 2020-11-16T22:03:02.951 INFO:tasks.rados.rados.2.smithi057.stdout:346: delete oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 44 2020-11-16T22:03:02.951 INFO:tasks.rados.rados.2.smithi057.stdout:343: finishing write tid 1 to smithi05720651-40 2020-11-16T22:03:02.952 INFO:tasks.rados.rados.2.smithi057.stdout:343: finishing write tid 2 to smithi05720651-40 2020-11-16T22:03:02.952 INFO:tasks.rados.rados.2.smithi057.stdout:343: finishing write tid 4 to smithi05720651-40 2020-11-16T22:03:02.952 INFO:tasks.rados.rados.2.smithi057.stdout:343: finishing write tid 5 to smithi05720651-40 2020-11-16T22:03:02.952 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 281 (ObjNum 143 snap 44 seq_num 143) dirty exists 2020-11-16T22:03:02.952 INFO:tasks.rados.rados.2.smithi057.stdout:343: left oid 40 (ObjNum 143 snap 44 seq_num 143) 2020-11-16T22:03:02.952 INFO:tasks.rados.rados.2.smithi057.stdout:344: finishing write tid 1 to smithi05720651-48 2020-11-16T22:03:02.956 INFO:tasks.rados.rados.2.smithi057.stdout:345: expect (ObjNum 131 snap 37 seq_num 131) 2020-11-16T22:03:03.052 INFO:tasks.rados.rados.2.smithi057.stdout:344: finishing write tid 2 to smithi05720651-48 2020-11-16T22:03:03.053 INFO:tasks.rados.rados.2.smithi057.stdout:344: finishing write tid 4 to smithi05720651-48 2020-11-16T22:03:03.053 INFO:tasks.rados.rados.2.smithi057.stdout:344: finishing write tid 5 to smithi05720651-48 2020-11-16T22:03:03.053 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 96 (ObjNum 144 snap 44 seq_num 144) dirty exists 2020-11-16T22:03:03.053 INFO:tasks.rados.rados.2.smithi057.stdout:344: left oid 48 (ObjNum 144 snap 44 seq_num 144) 2020-11-16T22:03:03.053 INFO:tasks.rados.rados.2.smithi057.stdout:343: done (3 left) 2020-11-16T22:03:03.053 INFO:tasks.rados.rados.2.smithi057.stdout:344: done (2 left) 2020-11-16T22:03:03.054 INFO:tasks.rados.rados.2.smithi057.stdout:345: done (1 left) 2020-11-16T22:03:03.054 INFO:tasks.rados.rados.2.smithi057.stdout:346: done (0 left) 2020-11-16T22:03:03.054 INFO:tasks.rados.rados.2.smithi057.stdout:347: read oid 46 snap -1 2020-11-16T22:03:03.054 INFO:tasks.rados.rados.2.smithi057.stdout:347: expect (ObjNum 113 snap 34 seq_num 113) 2020-11-16T22:03:03.054 INFO:tasks.rados.rados.2.smithi057.stdout:348: snap_create 2020-11-16T22:03:03.067 INFO:tasks.rados.rados.2.smithi057.stdout:347: expect (ObjNum 113 snap 34 seq_num 113) 2020-11-16T22:03:03.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:02 smithi057 bash[10301]: cluster 2020-11-16T22:03:01.589576+0000 mgr.x (mgr.24115) 312 : cluster [DBG] pgmap v397: 17 pgs: 17 active+clean; 163 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 242 KiB/s wr, 3 op/s 2020-11-16T22:03:03.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:02 smithi057 bash[10301]: cluster 2020-11-16T22:03:01.902554+0000 mon.a (mon.0) 787 : cluster [DBG] osdmap e156: 12 total, 12 up, 12 in 2020-11-16T22:03:03.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:02 smithi016 bash[10302]: cluster 2020-11-16T22:03:01.589576+0000 mgr.x (mgr.24115) 312 : cluster [DBG] pgmap v397: 17 pgs: 17 active+clean; 163 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 242 KiB/s wr, 3 op/s 2020-11-16T22:03:03.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:02 smithi016 bash[10302]: cluster 2020-11-16T22:03:01.902554+0000 mon.a (mon.0) 787 : cluster [DBG] osdmap e156: 12 total, 12 up, 12 in 2020-11-16T22:03:03.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:02 smithi195 bash[10218]: cluster 2020-11-16T22:03:01.589576+0000 mgr.x (mgr.24115) 312 : cluster [DBG] pgmap v397: 17 pgs: 17 active+clean; 163 MiB data, 316 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 242 KiB/s wr, 3 op/s 2020-11-16T22:03:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:02 smithi195 bash[10218]: cluster 2020-11-16T22:03:01.902554+0000 mon.a (mon.0) 787 : cluster [DBG] osdmap e156: 12 total, 12 up, 12 in 2020-11-16T22:03:03.921 INFO:tasks.rados.rados.2.smithi057.stdout:347: done (1 left) 2020-11-16T22:03:03.922 INFO:tasks.rados.rados.2.smithi057.stdout:348: done (0 left) 2020-11-16T22:03:03.922 INFO:tasks.rados.rados.2.smithi057.stdout:349: snap_create 2020-11-16T22:03:04.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:03 smithi057 bash[10301]: cluster 2020-11-16T22:03:02.904612+0000 mon.a (mon.0) 788 : cluster [DBG] osdmap e157: 12 total, 12 up, 12 in 2020-11-16T22:03:04.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:03 smithi016 bash[10302]: cluster 2020-11-16T22:03:02.904612+0000 mon.a (mon.0) 788 : cluster [DBG] osdmap e157: 12 total, 12 up, 12 in 2020-11-16T22:03:04.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:03 smithi195 bash[10218]: cluster 2020-11-16T22:03:02.904612+0000 mon.a (mon.0) 788 : cluster [DBG] osdmap e157: 12 total, 12 up, 12 in 2020-11-16T22:03:04.884 INFO:tasks.rados.rados.2.smithi057.stdout:349: done (0 left) 2020-11-16T22:03:04.884 INFO:tasks.rados.rados.2.smithi057.stdout:350: write oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 46 2020-11-16T22:03:04.884 INFO:tasks.rados.rados.2.smithi057.stdout:350: seq_num 146 ranges {453822=797061,1760371=653366} 2020-11-16T22:03:04.894 INFO:tasks.rados.rados.2.smithi057.stdout:350: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 453822 to 1250883 tid 1 2020-11-16T22:03:04.902 INFO:tasks.rados.rados.2.smithi057.stdout:350: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1760371 to 2413737 tid 2 2020-11-16T22:03:04.902 INFO:tasks.rados.rados.2.smithi057.stdout:351: copy_from oid 26 from oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 46 2020-11-16T22:03:04.902 INFO:tasks.rados.rados.2.smithi057.stdout:352: snap_create 2020-11-16T22:03:04.903 INFO:tasks.rados.rados.2.smithi057.stdout:350: finishing write tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:04.907 INFO:tasks.rados.rados.2.smithi057.stdout:350: finishing write tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:04.907 INFO:tasks.rados.rados.2.smithi057.stdout:350: finishing write tid 4 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:04.908 INFO:tasks.rados.rados.2.smithi057.stdout:350: finishing write tid 5 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:04.908 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 175 (ObjNum 146 snap 46 seq_num 146) dirty exists 2020-11-16T22:03:04.908 INFO:tasks.rados.rados.2.smithi057.stdout:350: left oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 146 snap 46 seq_num 146) 2020-11-16T22:03:04.926 INFO:tasks.rados.rados.2.smithi057.stdout:351: finishing copy_from to smithi05720651-26 2020-11-16T22:03:04.926 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 55 (ObjNum 78 snap 20 seq_num 78) dirty exists 2020-11-16T22:03:04.926 INFO:tasks.rados.rados.2.smithi057.stdout:351: finishing copy_from racing read to smithi05720651-26 2020-11-16T22:03:05.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:04 smithi057 bash[10301]: cluster 2020-11-16T22:03:03.590265+0000 mgr.x (mgr.24115) 313 : cluster [DBG] pgmap v400: 17 pgs: 17 active+clean; 158 MiB data, 308 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 0 B/s wr, 2 op/s 2020-11-16T22:03:05.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:04 smithi057 bash[10301]: cluster 2020-11-16T22:03:03.928669+0000 mon.a (mon.0) 789 : cluster [DBG] osdmap e158: 12 total, 12 up, 12 in 2020-11-16T22:03:05.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:04 smithi057 bash[10301]: cluster 2020-11-16T22:03:04.890423+0000 mon.a (mon.0) 790 : cluster [DBG] osdmap e159: 12 total, 12 up, 12 in 2020-11-16T22:03:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:04 smithi016 bash[10302]: cluster 2020-11-16T22:03:03.590265+0000 mgr.x (mgr.24115) 313 : cluster [DBG] pgmap v400: 17 pgs: 17 active+clean; 158 MiB data, 308 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 0 B/s wr, 2 op/s 2020-11-16T22:03:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:04 smithi016 bash[10302]: cluster 2020-11-16T22:03:03.928669+0000 mon.a (mon.0) 789 : cluster [DBG] osdmap e158: 12 total, 12 up, 12 in 2020-11-16T22:03:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:04 smithi016 bash[10302]: cluster 2020-11-16T22:03:04.890423+0000 mon.a (mon.0) 790 : cluster [DBG] osdmap e159: 12 total, 12 up, 12 in 2020-11-16T22:03:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:04 smithi195 bash[10218]: cluster 2020-11-16T22:03:03.590265+0000 mgr.x (mgr.24115) 313 : cluster [DBG] pgmap v400: 17 pgs: 17 active+clean; 158 MiB data, 308 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 0 B/s wr, 2 op/s 2020-11-16T22:03:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:04 smithi195 bash[10218]: cluster 2020-11-16T22:03:03.928669+0000 mon.a (mon.0) 789 : cluster [DBG] osdmap e158: 12 total, 12 up, 12 in 2020-11-16T22:03:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:04 smithi195 bash[10218]: cluster 2020-11-16T22:03:04.890423+0000 mon.a (mon.0) 790 : cluster [DBG] osdmap e159: 12 total, 12 up, 12 in 2020-11-16T22:03:05.893 INFO:tasks.rados.rados.2.smithi057.stdout:350: done (2 left) 2020-11-16T22:03:05.893 INFO:tasks.rados.rados.2.smithi057.stdout:351: done (1 left) 2020-11-16T22:03:05.893 INFO:tasks.rados.rados.2.smithi057.stdout:352: done (0 left) 2020-11-16T22:03:05.893 INFO:tasks.rados.rados.2.smithi057.stdout:353: delete oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 47 2020-11-16T22:03:05.900 INFO:tasks.rados.rados.2.smithi057.stdout:353: done (0 left) 2020-11-16T22:03:05.900 INFO:tasks.rados.rados.2.smithi057.stdout:354: delete oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 47 2020-11-16T22:03:05.906 INFO:tasks.rados.rados.2.smithi057.stdout:354: done (0 left) 2020-11-16T22:03:05.907 INFO:tasks.rados.rados.2.smithi057.stdout:355: snap_create 2020-11-16T22:03:06.904 INFO:tasks.rados.rados.2.smithi057.stdout:355: done (0 left) 2020-11-16T22:03:06.904 INFO:tasks.rados.rados.2.smithi057.stdout:356: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:03:06.904 INFO:tasks.rados.rados.2.smithi057.stdout:356: expect (ObjNum 118 snap 34 seq_num 118) 2020-11-16T22:03:06.905 INFO:tasks.rados.rados.2.smithi057.stdout:357: write oid 26 current snap is 48 2020-11-16T22:03:06.905 INFO:tasks.rados.rados.2.smithi057.stdout:357: seq_num 149 ranges {504243=622808,1819464=517046} 2020-11-16T22:03:06.914 INFO:tasks.rados.rados.2.smithi057.stdout:357: writing smithi05720651-26 from 504243 to 1127051 tid 1 2020-11-16T22:03:06.922 INFO:tasks.rados.rados.2.smithi057.stdout:357: writing smithi05720651-26 from 1819464 to 2336510 tid 2 2020-11-16T22:03:06.922 INFO:tasks.rados.rados.2.smithi057.stdout:358: read oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:03:06.922 INFO:tasks.rados.rados.2.smithi057.stdout:358: expect deleted 2020-11-16T22:03:06.922 INFO:tasks.rados.rados.2.smithi057.stdout:359: snap_remove snap 47 2020-11-16T22:03:07.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:06 smithi057 bash[10301]: cluster 2020-11-16T22:03:05.590939+0000 mgr.x (mgr.24115) 314 : cluster [DBG] pgmap v403: 17 pgs: 17 active+clean; 157 MiB data, 306 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2020-11-16T22:03:07.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:06 smithi057 bash[10301]: cluster 2020-11-16T22:03:05.904312+0000 mon.a (mon.0) 791 : cluster [DBG] osdmap e160: 12 total, 12 up, 12 in 2020-11-16T22:03:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:06 smithi016 bash[10302]: cluster 2020-11-16T22:03:05.590939+0000 mgr.x (mgr.24115) 314 : cluster [DBG] pgmap v403: 17 pgs: 17 active+clean; 157 MiB data, 306 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2020-11-16T22:03:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:06 smithi016 bash[10302]: cluster 2020-11-16T22:03:05.904312+0000 mon.a (mon.0) 791 : cluster [DBG] osdmap e160: 12 total, 12 up, 12 in 2020-11-16T22:03:07.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:06 smithi195 bash[10218]: cluster 2020-11-16T22:03:05.590939+0000 mgr.x (mgr.24115) 314 : cluster [DBG] pgmap v403: 17 pgs: 17 active+clean; 157 MiB data, 306 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2020-11-16T22:03:07.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:06 smithi195 bash[10218]: cluster 2020-11-16T22:03:05.904312+0000 mon.a (mon.0) 791 : cluster [DBG] osdmap e160: 12 total, 12 up, 12 in 2020-11-16T22:03:07.912 INFO:tasks.rados.rados.2.smithi057.stdout:359: done (3 left) 2020-11-16T22:03:07.912 INFO:tasks.rados.rados.2.smithi057.stdout:360: write oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 48 2020-11-16T22:03:07.912 INFO:tasks.rados.rados.2.smithi057.stdout:360: seq_num 150 ranges {521050=698057,1877946=643104} 2020-11-16T22:03:07.922 INFO:tasks.rados.rados.2.smithi057.stdout:360: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 521050 to 1219107 tid 1 2020-11-16T22:03:07.930 INFO:tasks.rados.rados.2.smithi057.stdout:360: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1877946 to 2521050 tid 2 2020-11-16T22:03:07.930 INFO:tasks.rados.rados.2.smithi057.stdout:361: snap_create 2020-11-16T22:03:07.930 INFO:tasks.rados.rados.2.smithi057.stdout:356: expect (ObjNum 118 snap 34 seq_num 118) 2020-11-16T22:03:08.177 INFO:tasks.rados.rados.2.smithi057.stdout:357: finishing write tid 1 to smithi05720651-26 2020-11-16T22:03:08.177 INFO:tasks.rados.rados.2.smithi057.stdout:357: finishing write tid 2 to smithi05720651-26 2020-11-16T22:03:08.178 INFO:tasks.rados.rados.2.smithi057.stdout:357: finishing write tid 4 to smithi05720651-26 2020-11-16T22:03:08.178 INFO:tasks.rados.rados.2.smithi057.stdout:357: finishing write tid 5 to smithi05720651-26 2020-11-16T22:03:08.178 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 287 (ObjNum 149 snap 48 seq_num 149) dirty exists 2020-11-16T22:03:08.178 INFO:tasks.rados.rados.2.smithi057.stdout:357: left oid 26 (ObjNum 149 snap 48 seq_num 149) 2020-11-16T22:03:08.178 INFO:tasks.rados.rados.2.smithi057.stdout:360: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:08.178 INFO:tasks.rados.rados.2.smithi057.stdout:360: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:08.179 INFO:tasks.rados.rados.2.smithi057.stdout:360: finishing write tid 4 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:08.179 INFO:tasks.rados.rados.2.smithi057.stdout:360: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:08.179 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 239 (ObjNum 150 snap 48 seq_num 150) dirty exists 2020-11-16T22:03:08.179 INFO:tasks.rados.rados.2.smithi057.stdout:360: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 150 snap 48 seq_num 150) 2020-11-16T22:03:08.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:07 smithi057 bash[10301]: cluster 2020-11-16T22:03:06.913312+0000 mon.a (mon.0) 792 : cluster [DBG] osdmap e161: 12 total, 12 up, 12 in 2020-11-16T22:03:08.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:07 smithi016 bash[10302]: cluster 2020-11-16T22:03:06.913312+0000 mon.a (mon.0) 792 : cluster [DBG] osdmap e161: 12 total, 12 up, 12 in 2020-11-16T22:03:08.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:07 smithi195 bash[10218]: cluster 2020-11-16T22:03:06.913312+0000 mon.a (mon.0) 792 : cluster [DBG] osdmap e161: 12 total, 12 up, 12 in 2020-11-16T22:03:08.921 INFO:tasks.rados.rados.2.smithi057.stdout:356: done (4 left) 2020-11-16T22:03:08.921 INFO:tasks.rados.rados.2.smithi057.stdout:357: done (3 left) 2020-11-16T22:03:08.921 INFO:tasks.rados.rados.2.smithi057.stdout:358: done (2 left) 2020-11-16T22:03:08.921 INFO:tasks.rados.rados.2.smithi057.stdout:360: done (1 left) 2020-11-16T22:03:08.921 INFO:tasks.rados.rados.2.smithi057.stdout:361: done (0 left) 2020-11-16T22:03:08.922 INFO:tasks.rados.rados.2.smithi057.stdout:362: copy_from oid 42 from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 49 2020-11-16T22:03:08.922 INFO:tasks.rados.rados.2.smithi057.stdout:363: copy_from oid 36 from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 49 2020-11-16T22:03:08.922 INFO:tasks.rados.rados.2.smithi057.stdout:364: copy_from oid 6 from oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 49 2020-11-16T22:03:08.922 INFO:tasks.rados.rados.2.smithi057.stdout:365: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:03:08.922 INFO:tasks.rados.rados.2.smithi057.stdout:365: expect (ObjNum 121 snap 36 seq_num 121) 2020-11-16T22:03:08.922 INFO:tasks.rados.rados.2.smithi057.stdout:366: write (excl) oid 40 current snap is 49 2020-11-16T22:03:08.922 INFO:tasks.rados.rados.2.smithi057.stdout:366: seq_num 151 ranges {537857=773306,1936428=520715} 2020-11-16T22:03:08.936 INFO:tasks.rados.rados.2.smithi057.stdout:366: writing smithi05720651-40 from 537857 to 1311163 tid 1 2020-11-16T22:03:08.942 INFO:tasks.rados.rados.2.smithi057.stdout:366: writing smithi05720651-40 from 1936428 to 2457143 tid 2 2020-11-16T22:03:08.942 INFO:tasks.rados.rados.2.smithi057.stdout:367: snap_remove snap 38 2020-11-16T22:03:09.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:08 smithi057 bash[10301]: cluster 2020-11-16T22:03:07.591621+0000 mgr.x (mgr.24115) 315 : cluster [DBG] pgmap v406: 17 pgs: 17 active+clean; 165 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 2.0 MiB/s wr, 7 op/s 2020-11-16T22:03:09.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:08 smithi057 bash[10301]: cluster 2020-11-16T22:03:07.922943+0000 mon.a (mon.0) 793 : cluster [DBG] osdmap e162: 12 total, 12 up, 12 in 2020-11-16T22:03:09.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:08 smithi016 bash[10302]: cluster 2020-11-16T22:03:07.591621+0000 mgr.x (mgr.24115) 315 : cluster [DBG] pgmap v406: 17 pgs: 17 active+clean; 165 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 2.0 MiB/s wr, 7 op/s 2020-11-16T22:03:09.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:08 smithi016 bash[10302]: cluster 2020-11-16T22:03:07.922943+0000 mon.a (mon.0) 793 : cluster [DBG] osdmap e162: 12 total, 12 up, 12 in 2020-11-16T22:03:09.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:08 smithi195 bash[10218]: cluster 2020-11-16T22:03:07.591621+0000 mgr.x (mgr.24115) 315 : cluster [DBG] pgmap v406: 17 pgs: 17 active+clean; 165 MiB data, 323 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 2.0 MiB/s wr, 7 op/s 2020-11-16T22:03:09.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:08 smithi195 bash[10218]: cluster 2020-11-16T22:03:07.922943+0000 mon.a (mon.0) 793 : cluster [DBG] osdmap e162: 12 total, 12 up, 12 in 2020-11-16T22:03:09.881 INFO:tasks.rados.rados.2.smithi057.stdout:367: done (5 left) 2020-11-16T22:03:09.881 INFO:tasks.rados.rados.2.smithi057.stdout:368: snap_remove snap 42 2020-11-16T22:03:10.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:09 smithi057 bash[10301]: cluster 2020-11-16T22:03:08.932028+0000 mon.a (mon.0) 794 : cluster [DBG] osdmap e163: 12 total, 12 up, 12 in 2020-11-16T22:03:10.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:09 smithi057 bash[10301]: cluster 2020-11-16T22:03:09.891600+0000 mon.a (mon.0) 795 : cluster [DBG] osdmap e164: 12 total, 12 up, 12 in 2020-11-16T22:03:10.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:09 smithi016 bash[10302]: cluster 2020-11-16T22:03:08.932028+0000 mon.a (mon.0) 794 : cluster [DBG] osdmap e163: 12 total, 12 up, 12 in 2020-11-16T22:03:10.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:09 smithi016 bash[10302]: cluster 2020-11-16T22:03:09.891600+0000 mon.a (mon.0) 795 : cluster [DBG] osdmap e164: 12 total, 12 up, 12 in 2020-11-16T22:03:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:09 smithi195 bash[10218]: cluster 2020-11-16T22:03:08.932028+0000 mon.a (mon.0) 794 : cluster [DBG] osdmap e163: 12 total, 12 up, 12 in 2020-11-16T22:03:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:09 smithi195 bash[10218]: cluster 2020-11-16T22:03:09.891600+0000 mon.a (mon.0) 795 : cluster [DBG] osdmap e164: 12 total, 12 up, 12 in 2020-11-16T22:03:10.892 INFO:tasks.rados.rados.2.smithi057.stdout:368: done (5 left) 2020-11-16T22:03:10.892 INFO:tasks.rados.rados.2.smithi057.stdout:369: read oid 26 snap 46 2020-11-16T22:03:10.892 INFO:tasks.rados.rados.2.smithi057.stdout:369: expect (ObjNum 78 snap 20 seq_num 78) 2020-11-16T22:03:10.893 INFO:tasks.rados.rados.2.smithi057.stdout:370: read oid 38 snap -1 2020-11-16T22:03:10.893 INFO:tasks.rados.rados.2.smithi057.stdout:370: expect (ObjNum 37 snap 0 seq_num 37) 2020-11-16T22:03:10.893 INFO:tasks.rados.rados.2.smithi057.stdout:371: snap_create 2020-11-16T22:03:10.893 INFO:tasks.rados.rados.2.smithi057.stdout:363: finishing copy_from to smithi05720651-36 2020-11-16T22:03:10.893 INFO:tasks.rados.rados.2.smithi057.stdout:363: got expected ENOENT (src dne) 2020-11-16T22:03:10.893 INFO:tasks.rados.rados.2.smithi057.stdout:363: finishing copy_from racing read to smithi05720651-36 2020-11-16T22:03:10.893 INFO:tasks.rados.rados.2.smithi057.stdout:365: expect (ObjNum 121 snap 36 seq_num 121) 2020-11-16T22:03:10.997 INFO:tasks.rados.rados.2.smithi057.stdout:362: finishing copy_from to smithi05720651-42 2020-11-16T22:03:10.997 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 239 (ObjNum 150 snap 48 seq_num 150) dirty exists 2020-11-16T22:03:10.997 INFO:tasks.rados.rados.2.smithi057.stdout:362: finishing copy_from racing read to smithi05720651-42 2020-11-16T22:03:10.997 INFO:tasks.rados.rados.2.smithi057.stdout:364: finishing copy_from to smithi05720651-6 2020-11-16T22:03:10.997 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 175 (ObjNum 146 snap 46 seq_num 146) dirty exists 2020-11-16T22:03:10.998 INFO:tasks.rados.rados.2.smithi057.stdout:364: finishing copy_from racing read to smithi05720651-6 2020-11-16T22:03:10.998 INFO:tasks.rados.rados.2.smithi057.stdout:366: finishing write tid 1 to smithi05720651-40 2020-11-16T22:03:10.998 INFO:tasks.rados.rados.2.smithi057.stdout:366: finishing write tid 2 to smithi05720651-40 2020-11-16T22:03:10.998 INFO:tasks.rados.rados.2.smithi057.stdout:366: finishing write tid 4 to smithi05720651-40 2020-11-16T22:03:10.998 INFO:tasks.rados.rados.2.smithi057.stdout:366: finishing write tid 5 to smithi05720651-40 2020-11-16T22:03:10.998 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 293 (ObjNum 151 snap 49 seq_num 151) dirty exists 2020-11-16T22:03:10.999 INFO:tasks.rados.rados.2.smithi057.stdout:366: left oid 40 (ObjNum 151 snap 49 seq_num 151) 2020-11-16T22:03:10.999 INFO:tasks.rados.rados.2.smithi057.stdout:370: expect (ObjNum 37 snap 0 seq_num 37) 2020-11-16T22:03:11.076 INFO:tasks.rados.rados.2.smithi057.stdout:369: expect (ObjNum 78 snap 20 seq_num 78) 2020-11-16T22:03:11.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:10 smithi057 bash[10301]: cluster 2020-11-16T22:03:09.592318+0000 mgr.x (mgr.24115) 316 : cluster [DBG] pgmap v409: 17 pgs: 17 active+clean; 166 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 2.3 MiB/s wr, 8 op/s 2020-11-16T22:03:11.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:10 smithi057 bash[10301]: cluster 2020-11-16T22:03:10.901839+0000 mon.a (mon.0) 796 : cluster [DBG] osdmap e165: 12 total, 12 up, 12 in 2020-11-16T22:03:11.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:10 smithi016 bash[10302]: cluster 2020-11-16T22:03:09.592318+0000 mgr.x (mgr.24115) 316 : cluster [DBG] pgmap v409: 17 pgs: 17 active+clean; 166 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 2.3 MiB/s wr, 8 op/s 2020-11-16T22:03:11.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:10 smithi016 bash[10302]: cluster 2020-11-16T22:03:10.901839+0000 mon.a (mon.0) 796 : cluster [DBG] osdmap e165: 12 total, 12 up, 12 in 2020-11-16T22:03:11.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:10 smithi195 bash[10218]: cluster 2020-11-16T22:03:09.592318+0000 mgr.x (mgr.24115) 316 : cluster [DBG] pgmap v409: 17 pgs: 17 active+clean; 166 MiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 2.3 MiB/s wr, 8 op/s 2020-11-16T22:03:11.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:10 smithi195 bash[10218]: cluster 2020-11-16T22:03:10.901839+0000 mon.a (mon.0) 796 : cluster [DBG] osdmap e165: 12 total, 12 up, 12 in 2020-11-16T22:03:11.897 INFO:tasks.rados.rados.2.smithi057.stdout:362: done (7 left) 2020-11-16T22:03:11.898 INFO:tasks.rados.rados.2.smithi057.stdout:363: done (6 left) 2020-11-16T22:03:11.898 INFO:tasks.rados.rados.2.smithi057.stdout:364: done (5 left) 2020-11-16T22:03:11.898 INFO:tasks.rados.rados.2.smithi057.stdout:365: done (4 left) 2020-11-16T22:03:11.898 INFO:tasks.rados.rados.2.smithi057.stdout:366: done (3 left) 2020-11-16T22:03:11.898 INFO:tasks.rados.rados.2.smithi057.stdout:369: done (2 left) 2020-11-16T22:03:11.899 INFO:tasks.rados.rados.2.smithi057.stdout:370: done (1 left) 2020-11-16T22:03:11.899 INFO:tasks.rados.rados.2.smithi057.stdout:371: done (0 left) 2020-11-16T22:03:11.899 INFO:tasks.rados.rados.2.smithi057.stdout:372: read oid 18 snap -1 2020-11-16T22:03:11.899 INFO:tasks.rados.rados.2.smithi057.stdout:372: expect (ObjNum 113 snap 34 seq_num 113) 2020-11-16T22:03:11.900 INFO:tasks.rados.rados.2.smithi057.stdout:373: read oid 32 snap -1 2020-11-16T22:03:11.900 INFO:tasks.rados.rados.2.smithi057.stdout:373: expect (ObjNum 136 snap 38 seq_num 136) 2020-11-16T22:03:11.900 INFO:tasks.rados.rados.2.smithi057.stdout:374: snap_create 2020-11-16T22:03:11.907 INFO:tasks.rados.rados.2.smithi057.stdout:373: expect (ObjNum 136 snap 38 seq_num 136) 2020-11-16T22:03:11.985 INFO:tasks.rados.rados.2.smithi057.stdout:372: expect (ObjNum 113 snap 34 seq_num 113) 2020-11-16T22:03:12.900 INFO:tasks.rados.rados.2.smithi057.stdout:372: done (2 left) 2020-11-16T22:03:12.900 INFO:tasks.rados.rados.2.smithi057.stdout:373: done (1 left) 2020-11-16T22:03:12.901 INFO:tasks.rados.rados.2.smithi057.stdout:374: done (0 left) 2020-11-16T22:03:12.901 INFO:tasks.rados.rados.2.smithi057.stdout:375: write (excl) oid 16 current snap is 51 2020-11-16T22:03:12.901 INFO:tasks.rados.rados.2.smithi057.stdout:375: seq_num 152 ranges {554664=448555,1478557=664373} 2020-11-16T22:03:12.912 INFO:tasks.rados.rados.2.smithi057.stdout:375: writing smithi05720651-16 from 554664 to 1003219 tid 1 2020-11-16T22:03:12.919 INFO:tasks.rados.rados.2.smithi057.stdout:375: writing smithi05720651-16 from 1478557 to 2142930 tid 2 2020-11-16T22:03:12.919 INFO:tasks.rados.rados.2.smithi057.stdout:376: write (excl) oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 51 2020-11-16T22:03:12.919 INFO:tasks.rados.rados.2.smithi057.stdout:376: seq_num 153 ranges {571471=640157,1653392=524384} 2020-11-16T22:03:12.926 INFO:tasks.rados.rados.2.smithi057.stdout:376: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 571471 to 1211628 tid 1 2020-11-16T22:03:12.932 INFO:tasks.rados.rados.2.smithi057.stdout:376: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1653392 to 2177776 tid 2 2020-11-16T22:03:12.932 INFO:tasks.rados.rados.2.smithi057.stdout:377: snap_remove snap 46 2020-11-16T22:03:13.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:12 smithi057 bash[10301]: cluster 2020-11-16T22:03:11.593038+0000 mgr.x (mgr.24115) 317 : cluster [DBG] pgmap v412: 17 pgs: 17 active+clean; 177 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.7 MiB/s wr, 12 op/s 2020-11-16T22:03:13.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:12 smithi057 bash[10301]: cluster 2020-11-16T22:03:11.904377+0000 mon.a (mon.0) 797 : cluster [DBG] osdmap e166: 12 total, 12 up, 12 in 2020-11-16T22:03:13.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:12 smithi016 bash[10302]: cluster 2020-11-16T22:03:11.593038+0000 mgr.x (mgr.24115) 317 : cluster [DBG] pgmap v412: 17 pgs: 17 active+clean; 177 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.7 MiB/s wr, 12 op/s 2020-11-16T22:03:13.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:12 smithi016 bash[10302]: cluster 2020-11-16T22:03:11.904377+0000 mon.a (mon.0) 797 : cluster [DBG] osdmap e166: 12 total, 12 up, 12 in 2020-11-16T22:03:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:12 smithi195 bash[10218]: cluster 2020-11-16T22:03:11.593038+0000 mgr.x (mgr.24115) 317 : cluster [DBG] pgmap v412: 17 pgs: 17 active+clean; 177 MiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.7 MiB/s wr, 12 op/s 2020-11-16T22:03:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:12 smithi195 bash[10218]: cluster 2020-11-16T22:03:11.904377+0000 mon.a (mon.0) 797 : cluster [DBG] osdmap e166: 12 total, 12 up, 12 in 2020-11-16T22:03:13.919 INFO:tasks.rados.rados.2.smithi057.stdout:377: done (2 left) 2020-11-16T22:03:13.920 INFO:tasks.rados.rados.2.smithi057.stdout:378: read oid 6 snap 41 2020-11-16T22:03:13.920 INFO:tasks.rados.rados.2.smithi057.stdout:378: expect (ObjNum 54 snap 3 seq_num 54) 2020-11-16T22:03:13.920 INFO:tasks.rados.rados.2.smithi057.stdout:379: snap_create 2020-11-16T22:03:13.920 INFO:tasks.rados.rados.2.smithi057.stdout:375: finishing write tid 1 to smithi05720651-16 2020-11-16T22:03:13.920 INFO:tasks.rados.rados.2.smithi057.stdout:375: finishing write tid 2 to smithi05720651-16 2020-11-16T22:03:13.920 INFO:tasks.rados.rados.2.smithi057.stdout:375: finishing write tid 4 to smithi05720651-16 2020-11-16T22:03:13.921 INFO:tasks.rados.rados.2.smithi057.stdout:375: finishing write tid 5 to smithi05720651-16 2020-11-16T22:03:13.921 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 249 (ObjNum 152 snap 51 seq_num 152) dirty exists 2020-11-16T22:03:13.921 INFO:tasks.rados.rados.2.smithi057.stdout:375: left oid 16 (ObjNum 152 snap 51 seq_num 152) 2020-11-16T22:03:13.921 INFO:tasks.rados.rados.2.smithi057.stdout:376: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:13.921 INFO:tasks.rados.rados.2.smithi057.stdout:376: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:13.921 INFO:tasks.rados.rados.2.smithi057.stdout:376: finishing write tid 4 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:13.921 INFO:tasks.rados.rados.2.smithi057.stdout:376: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:13.922 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 242 (ObjNum 153 snap 51 seq_num 153) dirty exists 2020-11-16T22:03:13.922 INFO:tasks.rados.rados.2.smithi057.stdout:376: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 153 snap 51 seq_num 153) 2020-11-16T22:03:13.935 INFO:tasks.rados.rados.2.smithi057.stdout:378: expect (ObjNum 54 snap 3 seq_num 54) 2020-11-16T22:03:14.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:13 smithi057 bash[10301]: cluster 2020-11-16T22:03:12.906655+0000 mon.a (mon.0) 798 : cluster [DBG] osdmap e167: 12 total, 12 up, 12 in 2020-11-16T22:03:14.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:13 smithi057 bash[10301]: audit 2020-11-16T22:03:13.291298+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:03:13.288495\"}"}]: dispatch 2020-11-16T22:03:14.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:13 smithi057 bash[10301]: audit 2020-11-16T22:03:13.297578+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:03:13.288495\"}"}]': finished 2020-11-16T22:03:14.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:13 smithi057 bash[10301]: audit 2020-11-16T22:03:13.302505+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:03:13.299831\"}"}]: dispatch 2020-11-16T22:03:14.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:13 smithi057 bash[10301]: audit 2020-11-16T22:03:13.308003+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:03:13.299831\"}"}]': finished 2020-11-16T22:03:14.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:13 smithi057 bash[10301]: audit 2020-11-16T22:03:13.310257+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:03:14.199 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:13 smithi057 bash[10301]: audit 2020-11-16T22:03:13.315155+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:03:14.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:13 smithi016 bash[10302]: cluster 2020-11-16T22:03:12.906655+0000 mon.a (mon.0) 798 : cluster [DBG] osdmap e167: 12 total, 12 up, 12 in 2020-11-16T22:03:14.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:13 smithi016 bash[10302]: audit 2020-11-16T22:03:13.291298+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:03:13.288495\"}"}]: dispatch 2020-11-16T22:03:14.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:13 smithi016 bash[10302]: audit 2020-11-16T22:03:13.297578+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:03:13.288495\"}"}]': finished 2020-11-16T22:03:14.339 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:13 smithi016 bash[10302]: audit 2020-11-16T22:03:13.302505+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:03:13.299831\"}"}]: dispatch 2020-11-16T22:03:14.339 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:13 smithi016 bash[10302]: audit 2020-11-16T22:03:13.308003+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:03:13.299831\"}"}]': finished 2020-11-16T22:03:14.339 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:13 smithi016 bash[10302]: audit 2020-11-16T22:03:13.310257+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:03:14.339 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:13 smithi016 bash[10302]: audit 2020-11-16T22:03:13.315155+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:03:14.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:13 smithi195 bash[10218]: cluster 2020-11-16T22:03:12.906655+0000 mon.a (mon.0) 798 : cluster [DBG] osdmap e167: 12 total, 12 up, 12 in 2020-11-16T22:03:14.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:13 smithi195 bash[10218]: audit 2020-11-16T22:03:13.291298+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:03:13.288495\"}"}]: dispatch 2020-11-16T22:03:14.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:13 smithi195 bash[10218]: audit 2020-11-16T22:03:13.297578+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.747807\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748015\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.748685\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749230\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:59:18.749738\", \"created\": \"2020-11-16T21:59:17.849548\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T21:59:18.750326\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:03:13.288495\"}"}]': finished 2020-11-16T22:03:14.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:13 smithi195 bash[10218]: audit 2020-11-16T22:03:13.302505+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:03:13.299831\"}"}]: dispatch 2020-11-16T22:03:14.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:13 smithi195 bash[10218]: audit 2020-11-16T22:03:13.308003+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800435\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T21:57:36.800646\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.800777\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801291\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801638\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2020-11-16T21:57:36.801795\", \"created\": \"2020-11-16T21:57:35.868755\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T21:57:36.802008\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:03:13.299831\"}"}]': finished 2020-11-16T22:03:14.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:13 smithi195 bash[10218]: audit 2020-11-16T22:03:13.310257+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:03:14.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:13 smithi195 bash[10218]: audit 2020-11-16T22:03:13.315155+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:03:14.883 INFO:tasks.rados.rados.2.smithi057.stdout:375: done (3 left) 2020-11-16T22:03:14.884 INFO:tasks.rados.rados.2.smithi057.stdout:376: done (2 left) 2020-11-16T22:03:14.884 INFO:tasks.rados.rados.2.smithi057.stdout:378: done (1 left) 2020-11-16T22:03:14.884 INFO:tasks.rados.rados.2.smithi057.stdout:379: done (0 left) 2020-11-16T22:03:14.884 INFO:tasks.rados.rados.2.smithi057.stdout:380: snap_create 2020-11-16T22:03:15.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:14 smithi057 bash[10301]: cluster 2020-11-16T22:03:13.593762+0000 mgr.x (mgr.24115) 318 : cluster [DBG] pgmap v415: 17 pgs: 17 active+clean; 176 MiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2020-11-16T22:03:15.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:14 smithi057 bash[10301]: cluster 2020-11-16T22:03:13.929928+0000 mon.a (mon.0) 805 : cluster [DBG] osdmap e168: 12 total, 12 up, 12 in 2020-11-16T22:03:15.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:14 smithi057 bash[10301]: cluster 2020-11-16T22:03:14.892531+0000 mon.a (mon.0) 806 : cluster [DBG] osdmap e169: 12 total, 12 up, 12 in 2020-11-16T22:03:15.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:14 smithi016 bash[10302]: cluster 2020-11-16T22:03:13.593762+0000 mgr.x (mgr.24115) 318 : cluster [DBG] pgmap v415: 17 pgs: 17 active+clean; 176 MiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2020-11-16T22:03:15.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:14 smithi016 bash[10302]: cluster 2020-11-16T22:03:13.929928+0000 mon.a (mon.0) 805 : cluster [DBG] osdmap e168: 12 total, 12 up, 12 in 2020-11-16T22:03:15.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:14 smithi016 bash[10302]: cluster 2020-11-16T22:03:14.892531+0000 mon.a (mon.0) 806 : cluster [DBG] osdmap e169: 12 total, 12 up, 12 in 2020-11-16T22:03:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:14 smithi195 bash[10218]: cluster 2020-11-16T22:03:13.593762+0000 mgr.x (mgr.24115) 318 : cluster [DBG] pgmap v415: 17 pgs: 17 active+clean; 176 MiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2020-11-16T22:03:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:14 smithi195 bash[10218]: cluster 2020-11-16T22:03:13.929928+0000 mon.a (mon.0) 805 : cluster [DBG] osdmap e168: 12 total, 12 up, 12 in 2020-11-16T22:03:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:14 smithi195 bash[10218]: cluster 2020-11-16T22:03:14.892531+0000 mon.a (mon.0) 806 : cluster [DBG] osdmap e169: 12 total, 12 up, 12 in 2020-11-16T22:03:15.894 INFO:tasks.rados.rados.2.smithi057.stdout:380: done (0 left) 2020-11-16T22:03:15.895 INFO:tasks.rados.rados.2.smithi057.stdout:381: rollback oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 53 2020-11-16T22:03:15.895 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 43 2020-11-16T22:03:15.895 INFO:tasks.rados.rados.2.smithi057.stdout:382: delete oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 53 2020-11-16T22:03:15.895 INFO:tasks.rados.rados.2.smithi057.stdout:381: finishing rollback tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:15.896 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 49 snap 0 seq_num 1) dirty dne 2020-11-16T22:03:15.901 INFO:tasks.rados.rados.2.smithi057.stdout:381: done (1 left) 2020-11-16T22:03:15.901 INFO:tasks.rados.rados.2.smithi057.stdout:382: done (0 left) 2020-11-16T22:03:15.902 INFO:tasks.rados.rados.2.smithi057.stdout:383: delete oid 2 current snap is 53 2020-11-16T22:03:15.906 INFO:tasks.rados.rados.2.smithi057.stdout:383: done (0 left) 2020-11-16T22:03:15.906 INFO:tasks.rados.rados.2.smithi057.stdout:384: rollback oid 40 current snap is 53 2020-11-16T22:03:15.906 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 40 to 48 2020-11-16T22:03:15.907 INFO:tasks.rados.rados.2.smithi057.stdout:385: snap_create 2020-11-16T22:03:15.914 INFO:tasks.rados.rados.2.smithi057.stdout:384: finishing rollback tid 0 to smithi05720651-40 2020-11-16T22:03:15.915 INFO:tasks.rados.rados.2.smithi057.stdout:384: finishing rollback tid 1 to smithi05720651-40 2020-11-16T22:03:16.415 INFO:tasks.rados.rados.2.smithi057.stdout:384: finishing rollback tid 2 to smithi05720651-40 2020-11-16T22:03:16.415 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 315 (ObjNum 143 snap 44 seq_num 143) dirty exists 2020-11-16T22:03:16.902 INFO:tasks.rados.rados.2.smithi057.stdout:384: done (1 left) 2020-11-16T22:03:16.903 INFO:tasks.rados.rados.2.smithi057.stdout:385: done (0 left) 2020-11-16T22:03:16.903 INFO:tasks.rados.rados.2.smithi057.stdout:386: copy_from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 44 current snap is 54 2020-11-16T22:03:16.903 INFO:tasks.rados.rados.2.smithi057.stdout:387: snap_create 2020-11-16T22:03:16.931 INFO:tasks.rados.rados.2.smithi057.stdout:386: finishing copy_from to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:16.932 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 29 (ObjNum 116 snap 34 seq_num 116) dirty exists 2020-11-16T22:03:16.932 INFO:tasks.rados.rados.2.smithi057.stdout:386: finishing copy_from racing read to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:17.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:16 smithi057 bash[10301]: cluster 2020-11-16T22:03:15.594417+0000 mgr.x (mgr.24115) 319 : cluster [DBG] pgmap v418: 17 pgs: 17 active+clean; 176 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2 op/s 2020-11-16T22:03:17.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:16 smithi057 bash[10301]: cluster 2020-11-16T22:03:15.903877+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e170: 12 total, 12 up, 12 in 2020-11-16T22:03:17.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:16 smithi016 bash[10302]: cluster 2020-11-16T22:03:15.594417+0000 mgr.x (mgr.24115) 319 : cluster [DBG] pgmap v418: 17 pgs: 17 active+clean; 176 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2 op/s 2020-11-16T22:03:17.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:16 smithi016 bash[10302]: cluster 2020-11-16T22:03:15.903877+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e170: 12 total, 12 up, 12 in 2020-11-16T22:03:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:16 smithi195 bash[10218]: cluster 2020-11-16T22:03:15.594417+0000 mgr.x (mgr.24115) 319 : cluster [DBG] pgmap v418: 17 pgs: 17 active+clean; 176 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2 op/s 2020-11-16T22:03:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:16 smithi195 bash[10218]: cluster 2020-11-16T22:03:15.903877+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e170: 12 total, 12 up, 12 in 2020-11-16T22:03:17.913 INFO:tasks.rados.rados.2.smithi057.stdout:386: done (1 left) 2020-11-16T22:03:17.914 INFO:tasks.rados.rados.2.smithi057.stdout:387: done (0 left) 2020-11-16T22:03:17.914 INFO:tasks.rados.rados.2.smithi057.stdout:388: read oid 8 snap -1 2020-11-16T22:03:17.914 INFO:tasks.rados.rados.2.smithi057.stdout:388: expect (ObjNum 7 snap 0 seq_num 7) 2020-11-16T22:03:17.914 INFO:tasks.rados.rados.2.smithi057.stdout:389: delete oid 46 current snap is 55 2020-11-16T22:03:17.920 INFO:tasks.rados.rados.2.smithi057.stdout:389: done (1 left) 2020-11-16T22:03:17.921 INFO:tasks.rados.rados.2.smithi057.stdout:390: rollback oid 22 current snap is 55 2020-11-16T22:03:17.921 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 22 to 41 2020-11-16T22:03:17.921 INFO:tasks.rados.rados.2.smithi057.stdout:391: snap_remove snap 53 2020-11-16T22:03:18.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:17 smithi057 bash[10301]: cluster 2020-11-16T22:03:16.913464+0000 mon.a (mon.0) 808 : cluster [DBG] osdmap e171: 12 total, 12 up, 12 in 2020-11-16T22:03:18.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:17 smithi016 bash[10302]: cluster 2020-11-16T22:03:16.913464+0000 mon.a (mon.0) 808 : cluster [DBG] osdmap e171: 12 total, 12 up, 12 in 2020-11-16T22:03:18.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:17 smithi195 bash[10218]: cluster 2020-11-16T22:03:16.913464+0000 mon.a (mon.0) 808 : cluster [DBG] osdmap e171: 12 total, 12 up, 12 in 2020-11-16T22:03:18.930 INFO:tasks.rados.rados.2.smithi057.stdout:391: done (2 left) 2020-11-16T22:03:18.931 INFO:tasks.rados.rados.2.smithi057.stdout:392: write (excl) oid 48 current snap is 55 2020-11-16T22:03:18.931 INFO:tasks.rados.rados.2.smithi057.stdout:392: seq_num 157 ranges {638699=541153,1770967=531722} 2020-11-16T22:03:18.941 INFO:tasks.rados.rados.2.smithi057.stdout:392: writing smithi05720651-48 from 638699 to 1179852 tid 1 2020-11-16T22:03:18.949 INFO:tasks.rados.rados.2.smithi057.stdout:392: writing smithi05720651-48 from 1770967 to 2302689 tid 2 2020-11-16T22:03:18.949 INFO:tasks.rados.rados.2.smithi057.stdout:393: delete oid 16 current snap is 55 2020-11-16T22:03:18.949 INFO:tasks.rados.rados.2.smithi057.stdout:388: expect (ObjNum 7 snap 0 seq_num 7) 2020-11-16T22:03:19.022 INFO:tasks.rados.rados.2.smithi057.stdout:390: finishing rollback tid 0 to smithi05720651-22 2020-11-16T22:03:19.022 INFO:tasks.rados.rados.2.smithi057.stdout:390: finishing rollback tid 1 to smithi05720651-22 2020-11-16T22:03:19.022 INFO:tasks.rados.rados.2.smithi057.stdout:390: finishing rollback tid 2 to smithi05720651-22 2020-11-16T22:03:19.023 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 63 (ObjNum 133 snap 37 seq_num 133) dirty exists 2020-11-16T22:03:19.023 INFO:tasks.rados.rados.2.smithi057.stdout:392: finishing write tid 1 to smithi05720651-48 2020-11-16T22:03:19.023 INFO:tasks.rados.rados.2.smithi057.stdout:388: done (3 left) 2020-11-16T22:03:19.023 INFO:tasks.rados.rados.2.smithi057.stdout:390: done (2 left) 2020-11-16T22:03:19.023 INFO:tasks.rados.rados.2.smithi057.stdout:393: done (1 left) 2020-11-16T22:03:19.023 INFO:tasks.rados.rados.2.smithi057.stdout:394: delete oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 55 2020-11-16T22:03:19.023 INFO:tasks.rados.rados.2.smithi057.stdout:392: finishing write tid 2 to smithi05720651-48 2020-11-16T22:03:19.024 INFO:tasks.rados.rados.2.smithi057.stdout:392: finishing write tid 4 to smithi05720651-48 2020-11-16T22:03:19.024 INFO:tasks.rados.rados.2.smithi057.stdout:392: finishing write tid 5 to smithi05720651-48 2020-11-16T22:03:19.024 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 104 (ObjNum 157 snap 55 seq_num 157) dirty exists 2020-11-16T22:03:19.024 INFO:tasks.rados.rados.2.smithi057.stdout:392: left oid 48 (ObjNum 157 snap 55 seq_num 157) 2020-11-16T22:03:19.026 INFO:tasks.rados.rados.2.smithi057.stdout:392: done (1 left) 2020-11-16T22:03:19.026 INFO:tasks.rados.rados.2.smithi057.stdout:394: done (0 left) 2020-11-16T22:03:19.026 INFO:tasks.rados.rados.2.smithi057.stdout:395: delete oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 55 2020-11-16T22:03:19.028 INFO:tasks.rados.rados.2.smithi057.stdout:395: done (0 left) 2020-11-16T22:03:19.029 INFO:tasks.rados.rados.2.smithi057.stdout:396: read oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:03:19.029 INFO:tasks.rados.rados.2.smithi057.stdout:396: expect deleted 2020-11-16T22:03:19.029 INFO:tasks.rados.rados.2.smithi057.stdout:397: rollback oid 10 current snap is 55 2020-11-16T22:03:19.029 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 10 to 54 2020-11-16T22:03:19.029 INFO:tasks.rados.rados.2.smithi057.stdout:398: read oid 48 snap -1 2020-11-16T22:03:19.029 INFO:tasks.rados.rados.2.smithi057.stdout:398: expect (ObjNum 157 snap 55 seq_num 157) 2020-11-16T22:03:19.029 INFO:tasks.rados.rados.2.smithi057.stdout:399: snap_create 2020-11-16T22:03:19.033 INFO:tasks.rados.rados.2.smithi057.stdout:397: finishing rollback tid 0 to smithi05720651-10 2020-11-16T22:03:19.033 INFO:tasks.rados.rados.2.smithi057.stdout:397: finishing rollback tid 1 to smithi05720651-10 2020-11-16T22:03:19.034 INFO:tasks.rados.rados.2.smithi057.stdout:397: finishing rollback tid 2 to smithi05720651-10 2020-11-16T22:03:19.034 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 185 (ObjNum 137 snap 39 seq_num 137) dirty exists 2020-11-16T22:03:19.036 INFO:tasks.rados.rados.2.smithi057.stdout:398: expect (ObjNum 157 snap 55 seq_num 157) 2020-11-16T22:03:19.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:18 smithi057 bash[10301]: cluster 2020-11-16T22:03:17.595101+0000 mgr.x (mgr.24115) 320 : cluster [DBG] pgmap v421: 17 pgs: 17 active+clean; 180 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 557 KiB/s wr, 12 op/s 2020-11-16T22:03:19.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:18 smithi057 bash[10301]: cluster 2020-11-16T22:03:17.922096+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e172: 12 total, 12 up, 12 in 2020-11-16T22:03:19.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:18 smithi016 bash[10302]: cluster 2020-11-16T22:03:17.595101+0000 mgr.x (mgr.24115) 320 : cluster [DBG] pgmap v421: 17 pgs: 17 active+clean; 180 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 557 KiB/s wr, 12 op/s 2020-11-16T22:03:19.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:18 smithi016 bash[10302]: cluster 2020-11-16T22:03:17.922096+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e172: 12 total, 12 up, 12 in 2020-11-16T22:03:19.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:18 smithi195 bash[10218]: cluster 2020-11-16T22:03:17.595101+0000 mgr.x (mgr.24115) 320 : cluster [DBG] pgmap v421: 17 pgs: 17 active+clean; 180 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 557 KiB/s wr, 12 op/s 2020-11-16T22:03:19.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:18 smithi195 bash[10218]: cluster 2020-11-16T22:03:17.922096+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e172: 12 total, 12 up, 12 in 2020-11-16T22:03:19.887 INFO:tasks.rados.rados.2.smithi057.stdout:396: done (3 left) 2020-11-16T22:03:19.888 INFO:tasks.rados.rados.2.smithi057.stdout:397: done (2 left) 2020-11-16T22:03:19.888 INFO:tasks.rados.rados.2.smithi057.stdout:398: done (1 left) 2020-11-16T22:03:19.888 INFO:tasks.rados.rados.2.smithi057.stdout:399: done (0 left) 2020-11-16T22:03:19.888 INFO:tasks.rados.rados.2.smithi057.stdout:400: write (excl) oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 56 2020-11-16T22:03:19.888 INFO:tasks.rados.rados.2.smithi057.stdout:400: seq_num 161 ranges {705927=558502,2004895=422707} 2020-11-16T22:03:19.901 INFO:tasks.rados.rados.2.smithi057.stdout:400: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 705927 to 1264429 tid 1 2020-11-16T22:03:19.908 INFO:tasks.rados.rados.2.smithi057.stdout:400: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2004895 to 2427602 tid 2 2020-11-16T22:03:19.908 INFO:tasks.rados.rados.2.smithi057.stdout:401: write oid 18 current snap is 56 2020-11-16T22:03:19.908 INFO:tasks.rados.rados.2.smithi057.stdout:401: seq_num 162 ranges {722734=633751,2063377=659357} 2020-11-16T22:03:19.915 INFO:tasks.rados.rados.2.smithi057.stdout:401: writing smithi05720651-18 from 722734 to 1356485 tid 1 2020-11-16T22:03:19.924 INFO:tasks.rados.rados.2.smithi057.stdout:401: writing smithi05720651-18 from 2063377 to 2722734 tid 2 2020-11-16T22:03:19.924 INFO:tasks.rados.rados.2.smithi057.stdout:402: delete oid 4 current snap is 56 2020-11-16T22:03:19.924 INFO:tasks.rados.rados.2.smithi057.stdout:400: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:19.925 INFO:tasks.rados.rados.2.smithi057.stdout:400: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:19.925 INFO:tasks.rados.rados.2.smithi057.stdout:400: finishing write tid 4 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:19.925 INFO:tasks.rados.rados.2.smithi057.stdout:400: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:19.925 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 251 (ObjNum 161 snap 56 seq_num 161) dirty exists 2020-11-16T22:03:19.925 INFO:tasks.rados.rados.2.smithi057.stdout:400: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 161 snap 56 seq_num 161) 2020-11-16T22:03:19.929 INFO:tasks.rados.rados.2.smithi057.stdout:401: finishing write tid 1 to smithi05720651-18 2020-11-16T22:03:19.930 INFO:tasks.rados.rados.2.smithi057.stdout:400: done (2 left) 2020-11-16T22:03:19.930 INFO:tasks.rados.rados.2.smithi057.stdout:402: done (1 left) 2020-11-16T22:03:19.930 INFO:tasks.rados.rados.2.smithi057.stdout:403: write oid 22 current snap is 56 2020-11-16T22:03:19.930 INFO:tasks.rados.rados.2.smithi057.stdout:403: seq_num 164 ranges {756348=784249,2063988=686387} 2020-11-16T22:03:19.939 INFO:tasks.rados.rados.2.smithi057.stdout:403: writing smithi05720651-22 from 756348 to 1540597 tid 1 2020-11-16T22:03:19.946 INFO:tasks.rados.rados.2.smithi057.stdout:403: writing smithi05720651-22 from 2063988 to 2750375 tid 2 2020-11-16T22:03:19.946 INFO:tasks.rados.rados.2.smithi057.stdout:404: read oid 38 snap -1 2020-11-16T22:03:19.947 INFO:tasks.rados.rados.2.smithi057.stdout:404: expect (ObjNum 37 snap 0 seq_num 37) 2020-11-16T22:03:19.947 INFO:tasks.rados.rados.2.smithi057.stdout:405: delete oid 50 current snap is 56 2020-11-16T22:03:19.947 INFO:tasks.rados.rados.2.smithi057.stdout:401: finishing write tid 2 to smithi05720651-18 2020-11-16T22:03:19.947 INFO:tasks.rados.rados.2.smithi057.stdout:401: finishing write tid 4 to smithi05720651-18 2020-11-16T22:03:19.947 INFO:tasks.rados.rados.2.smithi057.stdout:401: finishing write tid 5 to smithi05720651-18 2020-11-16T22:03:19.947 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 137 (ObjNum 162 snap 56 seq_num 162) dirty exists 2020-11-16T22:03:19.947 INFO:tasks.rados.rados.2.smithi057.stdout:401: left oid 18 (ObjNum 162 snap 56 seq_num 162) 2020-11-16T22:03:19.948 INFO:tasks.rados.rados.2.smithi057.stdout:403: finishing write tid 1 to smithi05720651-22 2020-11-16T22:03:19.950 INFO:tasks.rados.rados.2.smithi057.stdout:401: done (3 left) 2020-11-16T22:03:19.950 INFO:tasks.rados.rados.2.smithi057.stdout:405: done (2 left) 2020-11-16T22:03:19.950 INFO:tasks.rados.rados.2.smithi057.stdout:406: write oid 6 current snap is 56 2020-11-16T22:03:19.950 INFO:tasks.rados.rados.2.smithi057.stdout:406: seq_num 166 ranges {789962=534747,1780952=690056} 2020-11-16T22:03:19.957 INFO:tasks.rados.rados.2.smithi057.stdout:406: writing smithi05720651-6 from 789962 to 1324709 tid 1 2020-11-16T22:03:19.964 INFO:tasks.rados.rados.2.smithi057.stdout:406: writing smithi05720651-6 from 1780952 to 2471008 tid 2 2020-11-16T22:03:19.964 INFO:tasks.rados.rados.2.smithi057.stdout:407: read oid 34 snap -1 2020-11-16T22:03:19.964 INFO:tasks.rados.rados.2.smithi057.stdout:407: expect (ObjNum 130 snap 37 seq_num 130) 2020-11-16T22:03:19.964 INFO:tasks.rados.rados.2.smithi057.stdout:408: snap_create 2020-11-16T22:03:19.965 INFO:tasks.rados.rados.2.smithi057.stdout:403: finishing write tid 2 to smithi05720651-22 2020-11-16T22:03:19.965 INFO:tasks.rados.rados.2.smithi057.stdout:403: finishing write tid 4 to smithi05720651-22 2020-11-16T22:03:19.965 INFO:tasks.rados.rados.2.smithi057.stdout:403: finishing write tid 5 to smithi05720651-22 2020-11-16T22:03:19.965 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 69 (ObjNum 164 snap 56 seq_num 164) dirty exists 2020-11-16T22:03:19.965 INFO:tasks.rados.rados.2.smithi057.stdout:403: left oid 22 (ObjNum 164 snap 56 seq_num 164) 2020-11-16T22:03:19.965 INFO:tasks.rados.rados.2.smithi057.stdout:404: expect (ObjNum 37 snap 0 seq_num 37) 2020-11-16T22:03:20.054 INFO:tasks.rados.rados.2.smithi057.stdout:406: finishing write tid 1 to smithi05720651-6 2020-11-16T22:03:20.054 INFO:tasks.rados.rados.2.smithi057.stdout:407: expect (ObjNum 130 snap 37 seq_num 130) 2020-11-16T22:03:20.152 INFO:tasks.rados.rados.2.smithi057.stdout:406: finishing write tid 2 to smithi05720651-6 2020-11-16T22:03:20.152 INFO:tasks.rados.rados.2.smithi057.stdout:406: finishing write tid 4 to smithi05720651-6 2020-11-16T22:03:20.153 INFO:tasks.rados.rados.2.smithi057.stdout:406: finishing write tid 5 to smithi05720651-6 2020-11-16T22:03:20.153 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 256 (ObjNum 166 snap 56 seq_num 166) dirty exists 2020-11-16T22:03:20.153 INFO:tasks.rados.rados.2.smithi057.stdout:406: left oid 6 (ObjNum 166 snap 56 seq_num 166) 2020-11-16T22:03:20.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:19 smithi057 bash[10301]: cluster 2020-11-16T22:03:18.932582+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e173: 12 total, 12 up, 12 in 2020-11-16T22:03:20.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:19 smithi057 bash[10301]: cluster 2020-11-16T22:03:19.894612+0000 mon.a (mon.0) 811 : cluster [DBG] osdmap e174: 12 total, 12 up, 12 in 2020-11-16T22:03:20.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:19 smithi016 bash[10302]: cluster 2020-11-16T22:03:18.932582+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e173: 12 total, 12 up, 12 in 2020-11-16T22:03:20.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:19 smithi016 bash[10302]: cluster 2020-11-16T22:03:19.894612+0000 mon.a (mon.0) 811 : cluster [DBG] osdmap e174: 12 total, 12 up, 12 in 2020-11-16T22:03:20.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:19 smithi195 bash[10218]: cluster 2020-11-16T22:03:18.932582+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e173: 12 total, 12 up, 12 in 2020-11-16T22:03:20.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:19 smithi195 bash[10218]: cluster 2020-11-16T22:03:19.894612+0000 mon.a (mon.0) 811 : cluster [DBG] osdmap e174: 12 total, 12 up, 12 in 2020-11-16T22:03:20.944 INFO:tasks.rados.rados.2.smithi057.stdout:403: done (4 left) 2020-11-16T22:03:20.945 INFO:tasks.rados.rados.2.smithi057.stdout:404: done (3 left) 2020-11-16T22:03:20.945 INFO:tasks.rados.rados.2.smithi057.stdout:406: done (2 left) 2020-11-16T22:03:20.945 INFO:tasks.rados.rados.2.smithi057.stdout:407: done (1 left) 2020-11-16T22:03:20.945 INFO:tasks.rados.rados.2.smithi057.stdout:408: done (0 left) 2020-11-16T22:03:20.945 INFO:tasks.rados.rados.2.smithi057.stdout:409: copy_from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 57 2020-11-16T22:03:20.946 INFO:tasks.rados.rados.2.smithi057.stdout:410: delete oid 28 current snap is 57 2020-11-16T22:03:20.948 INFO:tasks.rados.rados.2.smithi057.stdout:410: done (1 left) 2020-11-16T22:03:20.949 INFO:tasks.rados.rados.2.smithi057.stdout:411: write oid 12 current snap is 57 2020-11-16T22:03:20.949 INFO:tasks.rados.rados.2.smithi057.stdout:411: seq_num 168 ranges {423576=401598,1497916=693725} 2020-11-16T22:03:20.960 INFO:tasks.rados.rados.2.smithi057.stdout:411: writing smithi05720651-12 from 423576 to 825174 tid 1 2020-11-16T22:03:20.969 INFO:tasks.rados.rados.2.smithi057.stdout:411: writing smithi05720651-12 from 1497916 to 2191641 tid 2 2020-11-16T22:03:20.969 INFO:tasks.rados.rados.2.smithi057.stdout:412: delete oid 28 current snap is 57 2020-11-16T22:03:20.969 INFO:tasks.rados.rados.2.smithi057.stdout:411: finishing write tid 1 to smithi05720651-12 2020-11-16T22:03:20.974 INFO:tasks.rados.rados.2.smithi057.stdout:409: finishing copy_from to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:20.974 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 151 (ObjNum 34 snap 0 seq_num 34) dirty exists 2020-11-16T22:03:20.974 INFO:tasks.rados.rados.2.smithi057.stdout:409: finishing copy_from racing read to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:20.975 INFO:tasks.rados.rados.2.smithi057.stdout:409: done (2 left) 2020-11-16T22:03:20.975 INFO:tasks.rados.rados.2.smithi057.stdout:412: done (1 left) 2020-11-16T22:03:20.975 INFO:tasks.rados.rados.2.smithi057.stdout:413: write oid 46 current snap is 57 2020-11-16T22:03:20.975 INFO:tasks.rados.rados.2.smithi057.stdout:413: seq_num 170 ranges {457190=552096,1614880=581041,2785791=71399} 2020-11-16T22:03:20.987 INFO:tasks.rados.rados.2.smithi057.stdout:413: writing smithi05720651-46 from 457190 to 1009286 tid 1 2020-11-16T22:03:20.993 INFO:tasks.rados.rados.2.smithi057.stdout:413: writing smithi05720651-46 from 1614880 to 2195921 tid 2 2020-11-16T22:03:20.997 INFO:tasks.rados.rados.2.smithi057.stdout:413: writing smithi05720651-46 from 2785791 to 2857190 tid 3 2020-11-16T22:03:20.998 INFO:tasks.rados.rados.2.smithi057.stdout:414: delete oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 57 2020-11-16T22:03:20.998 INFO:tasks.rados.rados.2.smithi057.stdout:411: finishing write tid 2 to smithi05720651-12 2020-11-16T22:03:20.998 INFO:tasks.rados.rados.2.smithi057.stdout:411: finishing write tid 4 to smithi05720651-12 2020-11-16T22:03:20.998 INFO:tasks.rados.rados.2.smithi057.stdout:411: finishing write tid 5 to smithi05720651-12 2020-11-16T22:03:20.998 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 72 (ObjNum 168 snap 57 seq_num 168) dirty exists 2020-11-16T22:03:20.998 INFO:tasks.rados.rados.2.smithi057.stdout:411: left oid 12 (ObjNum 168 snap 57 seq_num 168) 2020-11-16T22:03:20.998 INFO:tasks.rados.rados.2.smithi057.stdout:413: finishing write tid 1 to smithi05720651-46 2020-11-16T22:03:21.024 INFO:tasks.rados.rados.2.smithi057.stdout:413: finishing write tid 2 to smithi05720651-46 2020-11-16T22:03:21.025 INFO:tasks.rados.rados.2.smithi057.stdout:413: finishing write tid 3 to smithi05720651-46 2020-11-16T22:03:21.025 INFO:tasks.rados.rados.2.smithi057.stdout:413: finishing write tid 5 to smithi05720651-46 2020-11-16T22:03:21.026 INFO:tasks.rados.rados.2.smithi057.stdout:413: finishing write tid 6 to smithi05720651-46 2020-11-16T22:03:21.026 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 261 (ObjNum 170 snap 57 seq_num 170) dirty exists 2020-11-16T22:03:21.027 INFO:tasks.rados.rados.2.smithi057.stdout:413: left oid 46 (ObjNum 170 snap 57 seq_num 170) 2020-11-16T22:03:21.027 INFO:tasks.rados.rados.2.smithi057.stdout:411: done (2 left) 2020-11-16T22:03:21.027 INFO:tasks.rados.rados.2.smithi057.stdout:413: done (1 left) 2020-11-16T22:03:21.027 INFO:tasks.rados.rados.2.smithi057.stdout:414: done (0 left) 2020-11-16T22:03:21.028 INFO:tasks.rados.rados.2.smithi057.stdout:415: delete oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 57 2020-11-16T22:03:21.029 INFO:tasks.rados.rados.2.smithi057.stdout:415: done (0 left) 2020-11-16T22:03:21.030 INFO:tasks.rados.rados.2.smithi057.stdout:416: write (excl) oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 57 2020-11-16T22:03:21.030 INFO:tasks.rados.rados.2.smithi057.stdout:416: seq_num 173 ranges {507611=777843,2073973=444721} 2020-11-16T22:03:21.043 INFO:tasks.rados.rados.2.smithi057.stdout:416: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 507611 to 1285454 tid 1 2020-11-16T22:03:21.052 INFO:tasks.rados.rados.2.smithi057.stdout:416: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2073973 to 2518694 tid 2 2020-11-16T22:03:21.052 INFO:tasks.rados.rados.2.smithi057.stdout:417: read oid 16 snap -1 2020-11-16T22:03:21.052 INFO:tasks.rados.rados.2.smithi057.stdout:417: expect deleted 2020-11-16T22:03:21.052 INFO:tasks.rados.rados.2.smithi057.stdout:418: read oid 8 snap -1 2020-11-16T22:03:21.052 INFO:tasks.rados.rados.2.smithi057.stdout:418: expect (ObjNum 7 snap 0 seq_num 7) 2020-11-16T22:03:21.053 INFO:tasks.rados.rados.2.smithi057.stdout:419: read oid 38 snap -1 2020-11-16T22:03:21.053 INFO:tasks.rados.rados.2.smithi057.stdout:419: expect (ObjNum 37 snap 0 seq_num 37) 2020-11-16T22:03:21.053 INFO:tasks.rados.rados.2.smithi057.stdout:420: snap_create 2020-11-16T22:03:21.053 INFO:tasks.rados.rados.2.smithi057.stdout:416: finishing write tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:21.060 INFO:tasks.rados.rados.2.smithi057.stdout:418: expect (ObjNum 7 snap 0 seq_num 7) 2020-11-16T22:03:21.130 INFO:tasks.rados.rados.2.smithi057.stdout:416: finishing write tid 2 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:21.131 INFO:tasks.rados.rados.2.smithi057.stdout:416: finishing write tid 4 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:21.131 INFO:tasks.rados.rados.2.smithi057.stdout:416: finishing write tid 5 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:21.131 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 132 (ObjNum 173 snap 57 seq_num 173) dirty exists 2020-11-16T22:03:21.131 INFO:tasks.rados.rados.2.smithi057.stdout:416: left oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 173 snap 57 seq_num 173) 2020-11-16T22:03:21.131 INFO:tasks.rados.rados.2.smithi057.stdout:419: expect (ObjNum 37 snap 0 seq_num 37) 2020-11-16T22:03:21.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:20 smithi057 bash[10301]: cluster 2020-11-16T22:03:19.595802+0000 mgr.x (mgr.24115) 321 : cluster [DBG] pgmap v424: 17 pgs: 17 active+clean; 180 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 557 KiB/s wr, 12 op/s 2020-11-16T22:03:21.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:20 smithi016 bash[10302]: cluster 2020-11-16T22:03:19.595802+0000 mgr.x (mgr.24115) 321 : cluster [DBG] pgmap v424: 17 pgs: 17 active+clean; 180 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 557 KiB/s wr, 12 op/s 2020-11-16T22:03:21.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:20 smithi195 bash[10218]: cluster 2020-11-16T22:03:19.595802+0000 mgr.x (mgr.24115) 321 : cluster [DBG] pgmap v424: 17 pgs: 17 active+clean; 180 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 557 KiB/s wr, 12 op/s 2020-11-16T22:03:21.954 INFO:tasks.rados.rados.2.smithi057.stdout:416: done (4 left) 2020-11-16T22:03:21.954 INFO:tasks.rados.rados.2.smithi057.stdout:417: done (3 left) 2020-11-16T22:03:21.954 INFO:tasks.rados.rados.2.smithi057.stdout:418: done (2 left) 2020-11-16T22:03:21.954 INFO:tasks.rados.rados.2.smithi057.stdout:419: done (1 left) 2020-11-16T22:03:21.954 INFO:tasks.rados.rados.2.smithi057.stdout:420: done (0 left) 2020-11-16T22:03:21.955 INFO:tasks.rados.rados.2.smithi057.stdout:421: write (excl) oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 58 2020-11-16T22:03:21.955 INFO:tasks.rados.rados.2.smithi057.stdout:421: seq_num 174 ranges {524418=453092,1732455=588379,2779130=145288} 2020-11-16T22:03:21.965 INFO:tasks.rados.rados.2.smithi057.stdout:421: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 524418 to 977510 tid 1 2020-11-16T22:03:21.973 INFO:tasks.rados.rados.2.smithi057.stdout:421: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1732455 to 2320834 tid 2 2020-11-16T22:03:21.977 INFO:tasks.rados.rados.2.smithi057.stdout:421: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2779130 to 2924418 tid 3 2020-11-16T22:03:21.977 INFO:tasks.rados.rados.2.smithi057.stdout:422: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 44 2020-11-16T22:03:21.977 INFO:tasks.rados.rados.2.smithi057.stdout:422: expect (ObjNum 126 snap 36 seq_num 126) 2020-11-16T22:03:21.977 INFO:tasks.rados.rados.2.smithi057.stdout:423: read oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:03:21.978 INFO:tasks.rados.rados.2.smithi057.stdout:423: expect (ObjNum 18 snap 0 seq_num 18) 2020-11-16T22:03:21.978 INFO:tasks.rados.rados.2.smithi057.stdout:424: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:03:21.978 INFO:tasks.rados.rados.2.smithi057.stdout:424: expect deleted 2020-11-16T22:03:21.978 INFO:tasks.rados.rados.2.smithi057.stdout:425: copy_from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 30 current snap is 58 2020-11-16T22:03:21.978 INFO:tasks.rados.rados.2.smithi057.stdout:421: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:21.978 INFO:tasks.rados.rados.2.smithi057.stdout:426: snap_create 2020-11-16T22:03:21.988 INFO:tasks.rados.rados.2.smithi057.stdout:422: expect (ObjNum 126 snap 36 seq_num 126) 2020-11-16T22:03:22.087 INFO:tasks.rados.rados.2.smithi057.stdout:421: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:22.087 INFO:tasks.rados.rados.2.smithi057.stdout:421: finishing write tid 3 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:22.087 INFO:tasks.rados.rados.2.smithi057.stdout:421: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:22.087 INFO:tasks.rados.rados.2.smithi057.stdout:421: finishing write tid 6 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:22.087 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 320 (ObjNum 174 snap 58 seq_num 174) dirty exists 2020-11-16T22:03:22.088 INFO:tasks.rados.rados.2.smithi057.stdout:421: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 174 snap 58 seq_num 174) 2020-11-16T22:03:22.088 INFO:tasks.rados.rados.2.smithi057.stdout:423: expect (ObjNum 18 snap 0 seq_num 18) 2020-11-16T22:03:22.155 INFO:tasks.rados.rados.2.smithi057.stdout:425: finishing copy_from to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:22.156 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 57 (ObjNum 109 snap 32 seq_num 109) dirty exists 2020-11-16T22:03:22.156 INFO:tasks.rados.rados.2.smithi057.stdout:425: finishing copy_from racing read to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:22.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:21 smithi016 bash[10302]: cluster 2020-11-16T22:03:20.954420+0000 mon.a (mon.0) 812 : cluster [DBG] osdmap e175: 12 total, 12 up, 12 in 2020-11-16T22:03:22.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:21 smithi195 bash[10218]: cluster 2020-11-16T22:03:20.954420+0000 mon.a (mon.0) 812 : cluster [DBG] osdmap e175: 12 total, 12 up, 12 in 2020-11-16T22:03:22.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:21 smithi057 bash[10301]: cluster 2020-11-16T22:03:20.954420+0000 mon.a (mon.0) 812 : cluster [DBG] osdmap e175: 12 total, 12 up, 12 in 2020-11-16T22:03:22.970 INFO:tasks.rados.rados.2.smithi057.stdout:421: done (5 left) 2020-11-16T22:03:22.970 INFO:tasks.rados.rados.2.smithi057.stdout:422: done (4 left) 2020-11-16T22:03:22.970 INFO:tasks.rados.rados.2.smithi057.stdout:423: done (3 left) 2020-11-16T22:03:22.971 INFO:tasks.rados.rados.2.smithi057.stdout:424: done (2 left) 2020-11-16T22:03:22.971 INFO:tasks.rados.rados.2.smithi057.stdout:425: done (1 left) 2020-11-16T22:03:22.971 INFO:tasks.rados.rados.2.smithi057.stdout:426: done (0 left) 2020-11-16T22:03:22.971 INFO:tasks.rados.rados.2.smithi057.stdout:427: read oid 2 snap -1 2020-11-16T22:03:22.971 INFO:tasks.rados.rados.2.smithi057.stdout:427: expect deleted 2020-11-16T22:03:22.971 INFO:tasks.rados.rados.2.smithi057.stdout:428: write (excl) oid 4 current snap is 59 2020-11-16T22:03:22.971 INFO:tasks.rados.rados.2.smithi057.stdout:428: seq_num 175 ranges {541225=644694,1907290=448390} 2020-11-16T22:03:22.985 INFO:tasks.rados.rados.2.smithi057.stdout:428: writing smithi05720651-4 from 541225 to 1185919 tid 1 2020-11-16T22:03:22.992 INFO:tasks.rados.rados.2.smithi057.stdout:428: writing smithi05720651-4 from 1907290 to 2355680 tid 2 2020-11-16T22:03:22.992 INFO:tasks.rados.rados.2.smithi057.stdout:429: read oid 46 snap -1 2020-11-16T22:03:22.993 INFO:tasks.rados.rados.2.smithi057.stdout:429: expect (ObjNum 170 snap 57 seq_num 170) 2020-11-16T22:03:22.993 INFO:tasks.rados.rados.2.smithi057.stdout:430: delete oid 42 current snap is 59 2020-11-16T22:03:22.995 INFO:tasks.rados.rados.2.smithi057.stdout:428: finishing write tid 1 to smithi05720651-4 2020-11-16T22:03:22.998 INFO:tasks.rados.rados.2.smithi057.stdout:427: done (3 left) 2020-11-16T22:03:22.998 INFO:tasks.rados.rados.2.smithi057.stdout:430: done (2 left) 2020-11-16T22:03:22.998 INFO:tasks.rados.rados.2.smithi057.stdout:431: read oid 22 snap -1 2020-11-16T22:03:22.998 INFO:tasks.rados.rados.2.smithi057.stdout:431: expect (ObjNum 164 snap 56 seq_num 164) 2020-11-16T22:03:22.998 INFO:tasks.rados.rados.2.smithi057.stdout:432: write oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 59 2020-11-16T22:03:22.999 INFO:tasks.rados.rados.2.smithi057.stdout:432: seq_num 177 ranges {574839=795192,1907901=452059} 2020-11-16T22:03:23.006 INFO:tasks.rados.rados.2.smithi057.stdout:432: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 574839 to 1370031 tid 1 2020-11-16T22:03:23.013 INFO:tasks.rados.rados.2.smithi057.stdout:432: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1907901 to 2359960 tid 2 2020-11-16T22:03:23.013 INFO:tasks.rados.rados.2.smithi057.stdout:433: snap_create 2020-11-16T22:03:23.013 INFO:tasks.rados.rados.2.smithi057.stdout:428: finishing write tid 2 to smithi05720651-4 2020-11-16T22:03:23.013 INFO:tasks.rados.rados.2.smithi057.stdout:428: finishing write tid 4 to smithi05720651-4 2020-11-16T22:03:23.013 INFO:tasks.rados.rados.2.smithi057.stdout:428: finishing write tid 5 to smithi05720651-4 2020-11-16T22:03:23.013 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 114 (ObjNum 175 snap 59 seq_num 175) dirty exists 2020-11-16T22:03:23.014 INFO:tasks.rados.rados.2.smithi057.stdout:428: left oid 4 (ObjNum 175 snap 59 seq_num 175) 2020-11-16T22:03:23.014 INFO:tasks.rados.rados.2.smithi057.stdout:429: expect (ObjNum 170 snap 57 seq_num 170) 2020-11-16T22:03:23.107 INFO:tasks.rados.rados.2.smithi057.stdout:431: expect (ObjNum 164 snap 56 seq_num 164) 2020-11-16T22:03:23.259 INFO:tasks.rados.rados.2.smithi057.stdout:432: finishing write tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:23.260 INFO:tasks.rados.rados.2.smithi057.stdout:432: finishing write tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:23.260 INFO:tasks.rados.rados.2.smithi057.stdout:432: finishing write tid 4 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:23.260 INFO:tasks.rados.rados.2.smithi057.stdout:432: finishing write tid 5 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:23.260 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 324 (ObjNum 177 snap 59 seq_num 177) dirty exists 2020-11-16T22:03:23.260 INFO:tasks.rados.rados.2.smithi057.stdout:432: left oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 177 snap 59 seq_num 177) 2020-11-16T22:03:23.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:22 smithi016 bash[10302]: cluster 2020-11-16T22:03:21.596485+0000 mgr.x (mgr.24115) 322 : cluster [DBG] pgmap v427: 17 pgs: 17 active+clean; 188 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2020-11-16T22:03:23.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:22 smithi016 bash[10302]: cluster 2020-11-16T22:03:21.964684+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e176: 12 total, 12 up, 12 in 2020-11-16T22:03:23.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:22 smithi195 bash[10218]: cluster 2020-11-16T22:03:21.596485+0000 mgr.x (mgr.24115) 322 : cluster [DBG] pgmap v427: 17 pgs: 17 active+clean; 188 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2020-11-16T22:03:23.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:22 smithi195 bash[10218]: cluster 2020-11-16T22:03:21.964684+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e176: 12 total, 12 up, 12 in 2020-11-16T22:03:23.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:22 smithi057 bash[10301]: cluster 2020-11-16T22:03:21.596485+0000 mgr.x (mgr.24115) 322 : cluster [DBG] pgmap v427: 17 pgs: 17 active+clean; 188 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2020-11-16T22:03:23.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:22 smithi057 bash[10301]: cluster 2020-11-16T22:03:21.964684+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e176: 12 total, 12 up, 12 in 2020-11-16T22:03:23.974 INFO:tasks.rados.rados.2.smithi057.stdout:428: done (4 left) 2020-11-16T22:03:23.975 INFO:tasks.rados.rados.2.smithi057.stdout:429: done (3 left) 2020-11-16T22:03:23.975 INFO:tasks.rados.rados.2.smithi057.stdout:431: done (2 left) 2020-11-16T22:03:23.975 INFO:tasks.rados.rados.2.smithi057.stdout:432: done (1 left) 2020-11-16T22:03:23.975 INFO:tasks.rados.rados.2.smithi057.stdout:433: done (0 left) 2020-11-16T22:03:23.975 INFO:tasks.rados.rados.2.smithi057.stdout:434: copy_from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 28 current snap is 60 2020-11-16T22:03:23.975 INFO:tasks.rados.rados.2.smithi057.stdout:435: read oid 46 snap -1 2020-11-16T22:03:23.975 INFO:tasks.rados.rados.2.smithi057.stdout:435: expect (ObjNum 170 snap 57 seq_num 170) 2020-11-16T22:03:23.976 INFO:tasks.rados.rados.2.smithi057.stdout:436: snap_create 2020-11-16T22:03:23.988 INFO:tasks.rados.rados.2.smithi057.stdout:435: expect (ObjNum 170 snap 57 seq_num 170) 2020-11-16T22:03:24.086 INFO:tasks.rados.rados.2.smithi057.stdout:434: finishing copy_from to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:24.087 INFO:tasks.rados.rados.2.smithi057.stdout:434: got expected ENOENT (src dne) 2020-11-16T22:03:24.087 INFO:tasks.rados.rados.2.smithi057.stdout:434: finishing copy_from racing read to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:24.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:23 smithi016 bash[10302]: cluster 2020-11-16T22:03:22.973520+0000 mon.a (mon.0) 814 : cluster [DBG] osdmap e177: 12 total, 12 up, 12 in 2020-11-16T22:03:24.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:23 smithi195 bash[10218]: cluster 2020-11-16T22:03:22.973520+0000 mon.a (mon.0) 814 : cluster [DBG] osdmap e177: 12 total, 12 up, 12 in 2020-11-16T22:03:24.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:23 smithi057 bash[10301]: cluster 2020-11-16T22:03:22.973520+0000 mon.a (mon.0) 814 : cluster [DBG] osdmap e177: 12 total, 12 up, 12 in 2020-11-16T22:03:24.890 INFO:tasks.rados.rados.2.smithi057.stdout:434: done (2 left) 2020-11-16T22:03:24.891 INFO:tasks.rados.rados.2.smithi057.stdout:435: done (1 left) 2020-11-16T22:03:24.891 INFO:tasks.rados.rados.2.smithi057.stdout:436: done (0 left) 2020-11-16T22:03:24.891 INFO:tasks.rados.rados.2.smithi057.stdout:437: snap_remove snap 54 2020-11-16T22:03:25.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:24 smithi016 bash[10302]: cluster 2020-11-16T22:03:23.597180+0000 mgr.x (mgr.24115) 323 : cluster [DBG] pgmap v430: 17 pgs: 17 active+clean; 189 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2020-11-16T22:03:25.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:24 smithi016 bash[10302]: cluster 2020-11-16T22:03:23.982959+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e178: 12 total, 12 up, 12 in 2020-11-16T22:03:25.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:24 smithi016 bash[10302]: cluster 2020-11-16T22:03:24.897206+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e179: 12 total, 12 up, 12 in 2020-11-16T22:03:25.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:24 smithi195 bash[10218]: cluster 2020-11-16T22:03:23.597180+0000 mgr.x (mgr.24115) 323 : cluster [DBG] pgmap v430: 17 pgs: 17 active+clean; 189 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2020-11-16T22:03:25.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:24 smithi195 bash[10218]: cluster 2020-11-16T22:03:23.982959+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e178: 12 total, 12 up, 12 in 2020-11-16T22:03:25.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:24 smithi195 bash[10218]: cluster 2020-11-16T22:03:24.897206+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e179: 12 total, 12 up, 12 in 2020-11-16T22:03:25.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:24 smithi057 bash[10301]: cluster 2020-11-16T22:03:23.597180+0000 mgr.x (mgr.24115) 323 : cluster [DBG] pgmap v430: 17 pgs: 17 active+clean; 189 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.0 MiB/s wr, 16 op/s 2020-11-16T22:03:25.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:24 smithi057 bash[10301]: cluster 2020-11-16T22:03:23.982959+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e178: 12 total, 12 up, 12 in 2020-11-16T22:03:25.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:24 smithi057 bash[10301]: cluster 2020-11-16T22:03:24.897206+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e179: 12 total, 12 up, 12 in 2020-11-16T22:03:25.897 INFO:tasks.rados.rados.2.smithi057.stdout:437: done (0 left) 2020-11-16T22:03:25.897 INFO:tasks.rados.rados.2.smithi057.stdout:438: read oid 40 snap -1 2020-11-16T22:03:25.897 INFO:tasks.rados.rados.2.smithi057.stdout:438: expect (ObjNum 143 snap 44 seq_num 143) 2020-11-16T22:03:25.897 INFO:tasks.rados.rados.2.smithi057.stdout:439: read oid 14 snap -1 2020-11-16T22:03:25.897 INFO:tasks.rados.rados.2.smithi057.stdout:439: expect (ObjNum 106 snap 32 seq_num 106) 2020-11-16T22:03:25.898 INFO:tasks.rados.rados.2.smithi057.stdout:440: snap_create 2020-11-16T22:03:26.210 INFO:tasks.rados.rados.2.smithi057.stdout:438: expect (ObjNum 143 snap 44 seq_num 143) 2020-11-16T22:03:26.323 INFO:tasks.rados.rados.2.smithi057.stdout:439: expect (ObjNum 106 snap 32 seq_num 106) 2020-11-16T22:03:26.894 INFO:tasks.rados.rados.2.smithi057.stdout:438: done (2 left) 2020-11-16T22:03:26.895 INFO:tasks.rados.rados.2.smithi057.stdout:439: done (1 left) 2020-11-16T22:03:26.895 INFO:tasks.rados.rados.2.smithi057.stdout:440: done (0 left) 2020-11-16T22:03:26.895 INFO:tasks.rados.rados.2.smithi057.stdout:441: write oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 62 2020-11-16T22:03:26.895 INFO:tasks.rados.rados.2.smithi057.stdout:441: seq_num 178 ranges {591646=470441,1566383=595717,2888822=102824} 2020-11-16T22:03:26.906 INFO:tasks.rados.rados.2.smithi057.stdout:441: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 591646 to 1062087 tid 1 2020-11-16T22:03:26.914 INFO:tasks.rados.rados.2.smithi057.stdout:441: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1566383 to 2162100 tid 2 2020-11-16T22:03:26.919 INFO:tasks.rados.rados.2.smithi057.stdout:441: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2888822 to 2991646 tid 3 2020-11-16T22:03:26.920 INFO:tasks.rados.rados.2.smithi057.stdout:442: write (excl) oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 62 2020-11-16T22:03:26.920 INFO:tasks.rados.rados.2.smithi057.stdout:442: seq_num 179 ranges {608453=545690,1624865=455728,2632598=375855} 2020-11-16T22:03:26.926 INFO:tasks.rados.rados.2.smithi057.stdout:442: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 608453 to 1154143 tid 1 2020-11-16T22:03:26.931 INFO:tasks.rados.rados.2.smithi057.stdout:442: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1624865 to 2080593 tid 2 2020-11-16T22:03:26.937 INFO:tasks.rados.rados.2.smithi057.stdout:442: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2632598 to 3008453 tid 3 2020-11-16T22:03:26.937 INFO:tasks.rados.rados.2.smithi057.stdout:443: copy_from oid 46 from oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 62 2020-11-16T22:03:26.937 INFO:tasks.rados.rados.2.smithi057.stdout:441: finishing write tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:26.938 INFO:tasks.rados.rados.2.smithi057.stdout:441: finishing write tid 2 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:26.938 INFO:tasks.rados.rados.2.smithi057.stdout:441: finishing write tid 3 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:26.938 INFO:tasks.rados.rados.2.smithi057.stdout:441: finishing write tid 5 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:26.938 INFO:tasks.rados.rados.2.smithi057.stdout:441: finishing write tid 6 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:26.938 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 137 (ObjNum 178 snap 62 seq_num 178) dirty exists 2020-11-16T22:03:26.938 INFO:tasks.rados.rados.2.smithi057.stdout:441: left oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 178 snap 62 seq_num 178) 2020-11-16T22:03:26.938 INFO:tasks.rados.rados.2.smithi057.stdout:441: done (2 left) 2020-11-16T22:03:26.939 INFO:tasks.rados.rados.2.smithi057.stdout:444: write (excl) oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 62 2020-11-16T22:03:26.939 INFO:tasks.rados.rados.2.smithi057.stdout:444: seq_num 180 ranges {625260=620939,1683347=599386,2943668=81592} 2020-11-16T22:03:26.944 INFO:tasks.rados.rados.2.smithi057.stdout:444: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 625260 to 1246199 tid 1 2020-11-16T22:03:26.950 INFO:tasks.rados.rados.2.smithi057.stdout:444: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1683347 to 2282733 tid 2 2020-11-16T22:03:26.955 INFO:tasks.rados.rados.2.smithi057.stdout:444: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2943668 to 3025260 tid 3 2020-11-16T22:03:26.955 INFO:tasks.rados.rados.2.smithi057.stdout:445: snap_remove snap 45 2020-11-16T22:03:27.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:26 smithi057 bash[10301]: cluster 2020-11-16T22:03:25.597866+0000 mgr.x (mgr.24115) 324 : cluster [DBG] pgmap v433: 17 pgs: 17 active+clean; 196 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2020-11-16T22:03:27.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:26 smithi057 bash[10301]: cluster 2020-11-16T22:03:25.899611+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e180: 12 total, 12 up, 12 in 2020-11-16T22:03:27.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:26 smithi016 bash[10302]: cluster 2020-11-16T22:03:25.597866+0000 mgr.x (mgr.24115) 324 : cluster [DBG] pgmap v433: 17 pgs: 17 active+clean; 196 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2020-11-16T22:03:27.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:26 smithi016 bash[10302]: cluster 2020-11-16T22:03:25.899611+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e180: 12 total, 12 up, 12 in 2020-11-16T22:03:27.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:26 smithi195 bash[10218]: cluster 2020-11-16T22:03:25.597866+0000 mgr.x (mgr.24115) 324 : cluster [DBG] pgmap v433: 17 pgs: 17 active+clean; 196 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2020-11-16T22:03:27.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:26 smithi195 bash[10218]: cluster 2020-11-16T22:03:25.899611+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e180: 12 total, 12 up, 12 in 2020-11-16T22:03:27.915 INFO:tasks.rados.rados.2.smithi057.stdout:445: done (3 left) 2020-11-16T22:03:27.916 INFO:tasks.rados.rados.2.smithi057.stdout:446: read oid 10 snap -1 2020-11-16T22:03:27.916 INFO:tasks.rados.rados.2.smithi057.stdout:446: expect (ObjNum 137 snap 39 seq_num 137) 2020-11-16T22:03:27.916 INFO:tasks.rados.rados.2.smithi057.stdout:447: copy_from oid 28 from oid 16 current snap is 62 2020-11-16T22:03:27.916 INFO:tasks.rados.rados.2.smithi057.stdout:448: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:03:27.916 INFO:tasks.rados.rados.2.smithi057.stdout:448: expect (ObjNum 121 snap 36 seq_num 121) 2020-11-16T22:03:27.916 INFO:tasks.rados.rados.2.smithi057.stdout:449: read oid 30 snap 52 2020-11-16T22:03:27.916 INFO:tasks.rados.rados.2.smithi057.stdout:449: expect (ObjNum 109 snap 32 seq_num 109) 2020-11-16T22:03:27.917 INFO:tasks.rados.rados.2.smithi057.stdout:450: snap_remove snap 51 2020-11-16T22:03:28.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:27 smithi057 bash[10301]: cluster 2020-11-16T22:03:26.902428+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e181: 12 total, 12 up, 12 in 2020-11-16T22:03:28.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:27 smithi016 bash[10302]: cluster 2020-11-16T22:03:26.902428+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e181: 12 total, 12 up, 12 in 2020-11-16T22:03:28.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:27 smithi195 bash[10218]: cluster 2020-11-16T22:03:26.902428+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e181: 12 total, 12 up, 12 in 2020-11-16T22:03:28.917 INFO:tasks.rados.rados.2.smithi057.stdout:450: done (7 left) 2020-11-16T22:03:28.918 INFO:tasks.rados.rados.2.smithi057.stdout:451: write oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 62 2020-11-16T22:03:28.918 INFO:tasks.rados.rados.2.smithi057.stdout:451: seq_num 181 ranges {642067=696188,2025476=459397,2971091=70976} 2020-11-16T22:03:28.926 INFO:tasks.rados.rados.2.smithi057.stdout:451: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 642067 to 1338255 tid 1 2020-11-16T22:03:28.932 INFO:tasks.rados.rados.2.smithi057.stdout:451: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2025476 to 2484873 tid 2 2020-11-16T22:03:28.936 INFO:tasks.rados.rados.2.smithi057.stdout:451: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2971091 to 3042067 tid 3 2020-11-16T22:03:28.936 INFO:tasks.rados.rados.2.smithi057.stdout:452: write (excl) oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 62 2020-11-16T22:03:28.936 INFO:tasks.rados.rados.2.smithi057.stdout:452: seq_num 182 ranges {658874=771437,2083958=603055} 2020-11-16T22:03:28.944 INFO:tasks.rados.rados.2.smithi057.stdout:452: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 658874 to 1430311 tid 1 2020-11-16T22:03:28.951 INFO:tasks.rados.rados.2.smithi057.stdout:452: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2083958 to 2687013 tid 2 2020-11-16T22:03:28.952 INFO:tasks.rados.rados.2.smithi057.stdout:453: snap_remove snap 61 2020-11-16T22:03:29.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:28 smithi057 bash[10301]: cluster 2020-11-16T22:03:27.598564+0000 mgr.x (mgr.24115) 325 : cluster [DBG] pgmap v436: 17 pgs: 17 active+clean; 207 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.3 MiB/s wr, 29 op/s 2020-11-16T22:03:29.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:28 smithi057 bash[10301]: cluster 2020-11-16T22:03:27.921892+0000 mon.a (mon.0) 819 : cluster [DBG] osdmap e182: 12 total, 12 up, 12 in 2020-11-16T22:03:29.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:28 smithi016 bash[10302]: cluster 2020-11-16T22:03:27.598564+0000 mgr.x (mgr.24115) 325 : cluster [DBG] pgmap v436: 17 pgs: 17 active+clean; 207 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.3 MiB/s wr, 29 op/s 2020-11-16T22:03:29.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:28 smithi016 bash[10302]: cluster 2020-11-16T22:03:27.921892+0000 mon.a (mon.0) 819 : cluster [DBG] osdmap e182: 12 total, 12 up, 12 in 2020-11-16T22:03:29.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:28 smithi195 bash[10218]: cluster 2020-11-16T22:03:27.598564+0000 mgr.x (mgr.24115) 325 : cluster [DBG] pgmap v436: 17 pgs: 17 active+clean; 207 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 3.3 MiB/s wr, 29 op/s 2020-11-16T22:03:29.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:28 smithi195 bash[10218]: cluster 2020-11-16T22:03:27.921892+0000 mon.a (mon.0) 819 : cluster [DBG] osdmap e182: 12 total, 12 up, 12 in 2020-11-16T22:03:29.933 INFO:tasks.rados.rados.2.smithi057.stdout:453: done (9 left) 2020-11-16T22:03:29.933 INFO:tasks.rados.rados.2.smithi057.stdout:454: delete oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 62 2020-11-16T22:03:29.933 INFO:tasks.rados.rados.2.smithi057.stdout:442: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:29.934 INFO:tasks.rados.rados.2.smithi057.stdout:442: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:29.934 INFO:tasks.rados.rados.2.smithi057.stdout:442: finishing write tid 3 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:29.934 INFO:tasks.rados.rados.2.smithi057.stdout:442: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:29.934 INFO:tasks.rados.rados.2.smithi057.stdout:442: finishing write tid 6 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:29.934 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 333 (ObjNum 179 snap 62 seq_num 179) dirty exists 2020-11-16T22:03:29.934 INFO:tasks.rados.rados.2.smithi057.stdout:442: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 179 snap 62 seq_num 179) 2020-11-16T22:03:29.934 INFO:tasks.rados.rados.2.smithi057.stdout:444: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:29.935 INFO:tasks.rados.rados.2.smithi057.stdout:444: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:29.935 INFO:tasks.rados.rados.2.smithi057.stdout:443: finishing copy_from to smithi05720651-46 2020-11-16T22:03:29.935 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 151 (ObjNum 34 snap 0 seq_num 34) dirty exists 2020-11-16T22:03:29.935 INFO:tasks.rados.rados.2.smithi057.stdout:443: finishing copy_from racing read to smithi05720651-46 2020-11-16T22:03:29.935 INFO:tasks.rados.rados.2.smithi057.stdout:444: finishing write tid 3 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:29.935 INFO:tasks.rados.rados.2.smithi057.stdout:444: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:29.935 INFO:tasks.rados.rados.2.smithi057.stdout:444: finishing write tid 6 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:29.936 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 193 (ObjNum 180 snap 62 seq_num 180) dirty exists 2020-11-16T22:03:29.936 INFO:tasks.rados.rados.2.smithi057.stdout:444: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 180 snap 62 seq_num 180) 2020-11-16T22:03:29.936 INFO:tasks.rados.rados.2.smithi057.stdout:448: expect (ObjNum 121 snap 36 seq_num 121) 2020-11-16T22:03:30.033 INFO:tasks.rados.rados.2.smithi057.stdout:447: finishing copy_from to smithi05720651-28 2020-11-16T22:03:30.034 INFO:tasks.rados.rados.2.smithi057.stdout:447: got expected ENOENT (src dne) 2020-11-16T22:03:30.034 INFO:tasks.rados.rados.2.smithi057.stdout:447: finishing copy_from racing read to smithi05720651-28 2020-11-16T22:03:30.034 INFO:tasks.rados.rados.2.smithi057.stdout:446: expect (ObjNum 137 snap 39 seq_num 137) 2020-11-16T22:03:30.138 INFO:tasks.rados.rados.2.smithi057.stdout:449: expect (ObjNum 109 snap 32 seq_num 109) 2020-11-16T22:03:30.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:29 smithi057 bash[10301]: cluster 2020-11-16T22:03:28.923977+0000 mon.a (mon.0) 820 : cluster [DBG] osdmap e183: 12 total, 12 up, 12 in 2020-11-16T22:03:30.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:29 smithi057 bash[10301]: audit 2020-11-16T22:03:29.724459+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:03:30.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:29 smithi057 bash[10301]: audit 2020-11-16T22:03:29.733997+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:03:30.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:29 smithi016 bash[10302]: cluster 2020-11-16T22:03:28.923977+0000 mon.a (mon.0) 820 : cluster [DBG] osdmap e183: 12 total, 12 up, 12 in 2020-11-16T22:03:30.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:29 smithi016 bash[10302]: audit 2020-11-16T22:03:29.724459+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:03:30.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:29 smithi016 bash[10302]: audit 2020-11-16T22:03:29.733997+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:03:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:29 smithi195 bash[10218]: cluster 2020-11-16T22:03:28.923977+0000 mon.a (mon.0) 820 : cluster [DBG] osdmap e183: 12 total, 12 up, 12 in 2020-11-16T22:03:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:29 smithi195 bash[10218]: audit 2020-11-16T22:03:29.724459+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:03:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:29 smithi195 bash[10218]: audit 2020-11-16T22:03:29.733997+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:03:30.350 INFO:tasks.rados.rados.2.smithi057.stdout:451: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.350 INFO:tasks.rados.rados.2.smithi057.stdout:451: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.351 INFO:tasks.rados.rados.2.smithi057.stdout:451: finishing write tid 3 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.351 INFO:tasks.rados.rados.2.smithi057.stdout:451: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.351 INFO:tasks.rados.rados.2.smithi057.stdout:452: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.351 INFO:tasks.rados.rados.2.smithi057.stdout:452: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.351 INFO:tasks.rados.rados.2.smithi057.stdout:452: finishing write tid 4 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.351 INFO:tasks.rados.rados.2.smithi057.stdout:452: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.351 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 268 (ObjNum 182 snap 62 seq_num 182) dirty exists 2020-11-16T22:03:30.352 INFO:tasks.rados.rados.2.smithi057.stdout:452: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 182 snap 62 seq_num 182) 2020-11-16T22:03:30.352 INFO:tasks.rados.rados.2.smithi057.stdout:451: finishing write tid 6 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.352 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 77 (ObjNum 181 snap 62 seq_num 181) dirty exists 2020-11-16T22:03:30.352 INFO:tasks.rados.rados.2.smithi057.stdout:451: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 181 snap 62 seq_num 181) 2020-11-16T22:03:30.352 INFO:tasks.rados.rados.2.smithi057.stdout:442: done (9 left) 2020-11-16T22:03:30.352 INFO:tasks.rados.rados.2.smithi057.stdout:443: done (8 left) 2020-11-16T22:03:30.352 INFO:tasks.rados.rados.2.smithi057.stdout:444: done (7 left) 2020-11-16T22:03:30.353 INFO:tasks.rados.rados.2.smithi057.stdout:446: done (6 left) 2020-11-16T22:03:30.353 INFO:tasks.rados.rados.2.smithi057.stdout:447: done (5 left) 2020-11-16T22:03:30.353 INFO:tasks.rados.rados.2.smithi057.stdout:448: done (4 left) 2020-11-16T22:03:30.353 INFO:tasks.rados.rados.2.smithi057.stdout:449: done (3 left) 2020-11-16T22:03:30.353 INFO:tasks.rados.rados.2.smithi057.stdout:451: done (2 left) 2020-11-16T22:03:30.353 INFO:tasks.rados.rados.2.smithi057.stdout:452: done (1 left) 2020-11-16T22:03:30.353 INFO:tasks.rados.rados.2.smithi057.stdout:454: done (0 left) 2020-11-16T22:03:30.353 INFO:tasks.rados.rados.2.smithi057.stdout:455: write (excl) oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 62 2020-11-16T22:03:30.354 INFO:tasks.rados.rados.2.smithi057.stdout:455: seq_num 184 ranges {692488=638288,1917275=606724} 2020-11-16T22:03:30.367 INFO:tasks.rados.rados.2.smithi057.stdout:455: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 692488 to 1330776 tid 1 2020-11-16T22:03:30.374 INFO:tasks.rados.rados.2.smithi057.stdout:455: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1917275 to 2523999 tid 2 2020-11-16T22:03:30.374 INFO:tasks.rados.rados.2.smithi057.stdout:456: copy_from oid 38 from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 62 2020-11-16T22:03:30.374 INFO:tasks.rados.rados.2.smithi057.stdout:457: copy_from oid 12 from oid 26 current snap is 62 2020-11-16T22:03:30.375 INFO:tasks.rados.rados.2.smithi057.stdout:458: rollback oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 62 2020-11-16T22:03:30.375 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 41 2020-11-16T22:03:30.375 INFO:tasks.rados.rados.2.smithi057.stdout:459: rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 62 2020-11-16T22:03:30.375 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 58 2020-11-16T22:03:30.375 INFO:tasks.rados.rados.2.smithi057.stdout:460: rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 62 2020-11-16T22:03:30.375 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 43 2020-11-16T22:03:30.375 INFO:tasks.rados.rados.2.smithi057.stdout:461: copy_from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 62 2020-11-16T22:03:30.376 INFO:tasks.rados.rados.2.smithi057.stdout:462: read oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:03:30.376 INFO:tasks.rados.rados.2.smithi057.stdout:462: expect (ObjNum 34 snap 0 seq_num 34) 2020-11-16T22:03:30.376 INFO:tasks.rados.rados.2.smithi057.stdout:463: rollback oid 22 current snap is 62 2020-11-16T22:03:30.376 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 22 to 43 2020-11-16T22:03:30.376 INFO:tasks.rados.rados.2.smithi057.stdout:464: snap_create 2020-11-16T22:03:30.377 INFO:tasks.rados.rados.2.smithi057.stdout:455: finishing write tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.378 INFO:tasks.rados.rados.2.smithi057.stdout:463: finishing rollback tid 0 to smithi05720651-22 2020-11-16T22:03:30.379 INFO:tasks.rados.rados.2.smithi057.stdout:463: finishing rollback tid 1 to smithi05720651-22 2020-11-16T22:03:30.379 INFO:tasks.rados.rados.2.smithi057.stdout:459: finishing rollback tid 0 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.380 INFO:tasks.rados.rados.2.smithi057.stdout:459: finishing rollback tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.380 INFO:tasks.rados.rados.2.smithi057.stdout:463: finishing rollback tid 2 to smithi05720651-22 2020-11-16T22:03:30.381 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 82 (ObjNum 133 snap 37 seq_num 133) dirty exists 2020-11-16T22:03:30.381 INFO:tasks.rados.rados.2.smithi057.stdout:459: finishing rollback tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.381 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 203 (ObjNum 146 snap 46 seq_num 146) dirty exists 2020-11-16T22:03:30.383 INFO:tasks.rados.rados.2.smithi057.stdout:455: finishing write tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.384 INFO:tasks.rados.rados.2.smithi057.stdout:458: finishing rollback tid 0 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.384 INFO:tasks.rados.rados.2.smithi057.stdout:455: finishing write tid 4 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.384 INFO:tasks.rados.rados.2.smithi057.stdout:455: finishing write tid 5 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.384 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 361 (ObjNum 184 snap 62 seq_num 184) dirty exists 2020-11-16T22:03:30.385 INFO:tasks.rados.rados.2.smithi057.stdout:455: left oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 184 snap 62 seq_num 184) 2020-11-16T22:03:30.391 INFO:tasks.rados.rados.2.smithi057.stdout:462: expect (ObjNum 34 snap 0 seq_num 34) 2020-11-16T22:03:30.474 INFO:tasks.rados.rados.2.smithi057.stdout:458: finishing rollback tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.475 INFO:tasks.rados.rados.2.smithi057.stdout:458: finishing rollback tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.475 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 276 (ObjNum 78 snap 20 seq_num 78) dirty exists 2020-11-16T22:03:30.475 INFO:tasks.rados.rados.2.smithi057.stdout:460: finishing rollback tid 0 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.475 INFO:tasks.rados.rados.2.smithi057.stdout:460: finishing rollback tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.475 INFO:tasks.rados.rados.2.smithi057.stdout:460: finishing rollback tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.475 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 279 (ObjNum 125 snap 36 seq_num 125) dirty exists 2020-11-16T22:03:30.476 INFO:tasks.rados.rados.2.smithi057.stdout:457: finishing copy_from to smithi05720651-12 2020-11-16T22:03:30.476 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 287 (ObjNum 149 snap 48 seq_num 149) dirty exists 2020-11-16T22:03:30.476 INFO:tasks.rados.rados.2.smithi057.stdout:457: finishing copy_from racing read to smithi05720651-12 2020-11-16T22:03:30.476 INFO:tasks.rados.rados.2.smithi057.stdout:456: finishing copy_from to smithi05720651-38 2020-11-16T22:03:30.476 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 193 (ObjNum 180 snap 62 seq_num 180) dirty exists 2020-11-16T22:03:30.476 INFO:tasks.rados.rados.2.smithi057.stdout:456: finishing copy_from racing read to smithi05720651-38 2020-11-16T22:03:30.943 INFO:tasks.rados.rados.2.smithi057.stdout:455: done (9 left) 2020-11-16T22:03:30.943 INFO:tasks.rados.rados.2.smithi057.stdout:456: done (8 left) 2020-11-16T22:03:30.944 INFO:tasks.rados.rados.2.smithi057.stdout:457: done (7 left) 2020-11-16T22:03:30.944 INFO:tasks.rados.rados.2.smithi057.stdout:458: done (6 left) 2020-11-16T22:03:30.944 INFO:tasks.rados.rados.2.smithi057.stdout:459: done (5 left) 2020-11-16T22:03:30.944 INFO:tasks.rados.rados.2.smithi057.stdout:460: done (4 left) 2020-11-16T22:03:30.944 INFO:tasks.rados.rados.2.smithi057.stdout:462: done (3 left) 2020-11-16T22:03:30.944 INFO:tasks.rados.rados.2.smithi057.stdout:463: done (2 left) 2020-11-16T22:03:30.944 INFO:tasks.rados.rados.2.smithi057.stdout:464: done (1 left) 2020-11-16T22:03:30.945 INFO:tasks.rados.rados.2.smithi057.stdout:465: copy_from oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 10 current snap is 63 2020-11-16T22:03:30.945 INFO:tasks.rados.rados.2.smithi057.stdout:466: snap_create 2020-11-16T22:03:30.970 INFO:tasks.rados.rados.2.smithi057.stdout:465: finishing copy_from to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:30.971 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 185 (ObjNum 137 snap 39 seq_num 137) dirty exists 2020-11-16T22:03:30.971 INFO:tasks.rados.rados.2.smithi057.stdout:465: finishing copy_from racing read to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:31.147 INFO:tasks.rados.rados.2.smithi057.stdout:461: finishing copy_from to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:31.148 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 151 (ObjNum 34 snap 0 seq_num 34) dirty exists 2020-11-16T22:03:31.148 INFO:tasks.rados.rados.2.smithi057.stdout:461: finishing copy_from racing read to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:31.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:30 smithi057 bash[10301]: cluster 2020-11-16T22:03:29.599248+0000 mgr.x (mgr.24115) 326 : cluster [DBG] pgmap v439: 17 pgs: 17 active+clean; 210 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.3 MiB/s wr, 23 op/s 2020-11-16T22:03:31.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:30 smithi057 bash[10301]: cluster 2020-11-16T22:03:29.944144+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e184: 12 total, 12 up, 12 in 2020-11-16T22:03:31.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:30 smithi016 bash[10302]: cluster 2020-11-16T22:03:29.599248+0000 mgr.x (mgr.24115) 326 : cluster [DBG] pgmap v439: 17 pgs: 17 active+clean; 210 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.3 MiB/s wr, 23 op/s 2020-11-16T22:03:31.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:30 smithi016 bash[10302]: cluster 2020-11-16T22:03:29.944144+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e184: 12 total, 12 up, 12 in 2020-11-16T22:03:31.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:30 smithi195 bash[10218]: cluster 2020-11-16T22:03:29.599248+0000 mgr.x (mgr.24115) 326 : cluster [DBG] pgmap v439: 17 pgs: 17 active+clean; 210 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.3 MiB/s wr, 23 op/s 2020-11-16T22:03:31.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:30 smithi195 bash[10218]: cluster 2020-11-16T22:03:29.944144+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e184: 12 total, 12 up, 12 in 2020-11-16T22:03:31.955 INFO:tasks.rados.rados.2.smithi057.stdout:461: done (2 left) 2020-11-16T22:03:31.955 INFO:tasks.rados.rados.2.smithi057.stdout:465: done (1 left) 2020-11-16T22:03:31.955 INFO:tasks.rados.rados.2.smithi057.stdout:466: done (0 left) 2020-11-16T22:03:31.955 INFO:tasks.rados.rados.2.smithi057.stdout:467: read oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:03:31.955 INFO:tasks.rados.rados.2.smithi057.stdout:467: expect deleted 2020-11-16T22:03:31.955 INFO:tasks.rados.rados.2.smithi057.stdout:468: rollback oid 16 current snap is 64 2020-11-16T22:03:31.956 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 16 to 52 2020-11-16T22:03:31.956 INFO:tasks.rados.rados.2.smithi057.stdout:469: write oid 28 current snap is 64 2020-11-16T22:03:31.956 INFO:tasks.rados.rados.2.smithi057.stdout:469: seq_num 185 ranges {709295=713537,1859404=750382} 2020-11-16T22:03:31.969 INFO:tasks.rados.rados.2.smithi057.stdout:469: writing smithi05720651-28 from 709295 to 1422832 tid 1 2020-11-16T22:03:31.976 INFO:tasks.rados.rados.2.smithi057.stdout:469: writing smithi05720651-28 from 1859404 to 2609786 tid 2 2020-11-16T22:03:31.976 INFO:tasks.rados.rados.2.smithi057.stdout:470: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:03:31.976 INFO:tasks.rados.rados.2.smithi057.stdout:470: expect deleted 2020-11-16T22:03:31.976 INFO:tasks.rados.rados.2.smithi057.stdout:471: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:03:31.977 INFO:tasks.rados.rados.2.smithi057.stdout:471: expect (ObjNum 125 snap 36 seq_num 125) 2020-11-16T22:03:31.977 INFO:tasks.rados.rados.2.smithi057.stdout:472: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:03:31.977 INFO:tasks.rados.rados.2.smithi057.stdout:472: expect (ObjNum 181 snap 62 seq_num 181) 2020-11-16T22:03:31.977 INFO:tasks.rados.rados.2.smithi057.stdout:473: snap_remove snap 43 2020-11-16T22:03:32.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:31 smithi016 bash[10302]: cluster 2020-11-16T22:03:30.953963+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e185: 12 total, 12 up, 12 in 2020-11-16T22:03:32.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:31 smithi195 bash[10218]: cluster 2020-11-16T22:03:30.953963+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e185: 12 total, 12 up, 12 in 2020-11-16T22:03:32.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:31 smithi057 bash[10301]: cluster 2020-11-16T22:03:30.953963+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e185: 12 total, 12 up, 12 in 2020-11-16T22:03:32.966 INFO:tasks.rados.rados.2.smithi057.stdout:473: done (6 left) 2020-11-16T22:03:32.967 INFO:tasks.rados.rados.2.smithi057.stdout:474: write (excl) oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 64 2020-11-16T22:03:32.967 INFO:tasks.rados.rados.2.smithi057.stdout:474: seq_num 186 ranges {726102=788786,1917886=610393,3108206=17896} 2020-11-16T22:03:32.976 INFO:tasks.rados.rados.2.smithi057.stdout:474: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 726102 to 1514888 tid 1 2020-11-16T22:03:32.982 INFO:tasks.rados.rados.2.smithi057.stdout:474: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1917886 to 2528279 tid 2 2020-11-16T22:03:32.986 INFO:tasks.rados.rados.2.smithi057.stdout:474: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3108206 to 3126102 tid 3 2020-11-16T22:03:32.986 INFO:tasks.rados.rados.2.smithi057.stdout:475: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:03:32.986 INFO:tasks.rados.rados.2.smithi057.stdout:475: expect (ObjNum 34 snap 0 seq_num 34) 2020-11-16T22:03:32.986 INFO:tasks.rados.rados.2.smithi057.stdout:476: write oid 30 current snap is 64 2020-11-16T22:03:32.986 INFO:tasks.rados.rados.2.smithi057.stdout:476: seq_num 187 ranges {742909=464035,1976368=754051} 2020-11-16T22:03:32.992 INFO:tasks.rados.rados.2.smithi057.stdout:476: writing smithi05720651-30 from 742909 to 1206944 tid 1 2020-11-16T22:03:33.001 INFO:tasks.rados.rados.2.smithi057.stdout:476: writing smithi05720651-30 from 1976368 to 2730419 tid 2 2020-11-16T22:03:33.002 INFO:tasks.rados.rados.2.smithi057.stdout:477: snap_remove snap 59 2020-11-16T22:03:33.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:32 smithi016 bash[10302]: cluster 2020-11-16T22:03:31.599961+0000 mgr.x (mgr.24115) 327 : cluster [DBG] pgmap v442: 17 pgs: 17 active+clean; 226 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 3.8 MiB/s wr, 18 op/s 2020-11-16T22:03:33.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:32 smithi016 bash[10302]: cluster 2020-11-16T22:03:31.963490+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e186: 12 total, 12 up, 12 in 2020-11-16T22:03:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:32 smithi195 bash[10218]: cluster 2020-11-16T22:03:31.599961+0000 mgr.x (mgr.24115) 327 : cluster [DBG] pgmap v442: 17 pgs: 17 active+clean; 226 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 3.8 MiB/s wr, 18 op/s 2020-11-16T22:03:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:32 smithi195 bash[10218]: cluster 2020-11-16T22:03:31.963490+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e186: 12 total, 12 up, 12 in 2020-11-16T22:03:33.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:32 smithi057 bash[10301]: cluster 2020-11-16T22:03:31.599961+0000 mgr.x (mgr.24115) 327 : cluster [DBG] pgmap v442: 17 pgs: 17 active+clean; 226 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 3.8 MiB/s wr, 18 op/s 2020-11-16T22:03:33.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:32 smithi057 bash[10301]: cluster 2020-11-16T22:03:31.963490+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e186: 12 total, 12 up, 12 in 2020-11-16T22:03:33.977 INFO:tasks.rados.rados.2.smithi057.stdout:477: done (9 left) 2020-11-16T22:03:33.978 INFO:tasks.rados.rados.2.smithi057.stdout:478: snap_remove snap 56 2020-11-16T22:03:34.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:33 smithi016 bash[10302]: cluster 2020-11-16T22:03:32.973153+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e187: 12 total, 12 up, 12 in 2020-11-16T22:03:34.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:33 smithi195 bash[10218]: cluster 2020-11-16T22:03:32.973153+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e187: 12 total, 12 up, 12 in 2020-11-16T22:03:34.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:33 smithi057 bash[10301]: cluster 2020-11-16T22:03:32.973153+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e187: 12 total, 12 up, 12 in 2020-11-16T22:03:34.897 INFO:tasks.rados.rados.2.smithi057.stdout:478: done (9 left) 2020-11-16T22:03:34.898 INFO:tasks.rados.rados.2.smithi057.stdout:479: write (excl) oid 26 current snap is 64 2020-11-16T22:03:34.898 INFO:tasks.rados.rados.2.smithi057.stdout:479: seq_num 188 ranges {759716=539284,2034850=614062} 2020-11-16T22:03:34.904 INFO:tasks.rados.rados.2.smithi057.stdout:479: writing smithi05720651-26 from 759716 to 1299000 tid 1 2020-11-16T22:03:34.913 INFO:tasks.rados.rados.2.smithi057.stdout:479: writing smithi05720651-26 from 2034850 to 2648912 tid 2 2020-11-16T22:03:34.913 INFO:tasks.rados.rados.2.smithi057.stdout:480: rollback oid 10 current snap is 64 2020-11-16T22:03:34.913 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 10 to 60 2020-11-16T22:03:34.913 INFO:tasks.rados.rados.2.smithi057.stdout:468: finishing rollback tid 1 to smithi05720651-16 2020-11-16T22:03:34.913 INFO:tasks.rados.rados.2.smithi057.stdout:468: finishing rollback tid 2 to smithi05720651-16 2020-11-16T22:03:34.913 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 282 (ObjNum 152 snap 51 seq_num 152) dirty exists 2020-11-16T22:03:34.914 INFO:tasks.rados.rados.2.smithi057.stdout:469: finishing write tid 1 to smithi05720651-28 2020-11-16T22:03:34.914 INFO:tasks.rados.rados.2.smithi057.stdout:467: done (10 left) 2020-11-16T22:03:34.914 INFO:tasks.rados.rados.2.smithi057.stdout:468: done (9 left) 2020-11-16T22:03:34.914 INFO:tasks.rados.rados.2.smithi057.stdout:481: copy_from oid 20 from oid 6 current snap is 64 2020-11-16T22:03:34.914 INFO:tasks.rados.rados.2.smithi057.stdout:469: finishing write tid 2 to smithi05720651-28 2020-11-16T22:03:34.914 INFO:tasks.rados.rados.2.smithi057.stdout:469: finishing write tid 4 to smithi05720651-28 2020-11-16T22:03:34.914 INFO:tasks.rados.rados.2.smithi057.stdout:469: finishing write tid 5 to smithi05720651-28 2020-11-16T22:03:34.914 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 206 (ObjNum 185 snap 64 seq_num 185) dirty exists 2020-11-16T22:03:34.915 INFO:tasks.rados.rados.2.smithi057.stdout:469: left oid 28 (ObjNum 185 snap 64 seq_num 185) 2020-11-16T22:03:34.915 INFO:tasks.rados.rados.2.smithi057.stdout:471: expect (ObjNum 125 snap 36 seq_num 125) 2020-11-16T22:03:35.002 INFO:tasks.rados.rados.2.smithi057.stdout:472: expect (ObjNum 181 snap 62 seq_num 181) 2020-11-16T22:03:35.096 INFO:tasks.rados.rados.2.smithi057.stdout:475: expect (ObjNum 34 snap 0 seq_num 34) 2020-11-16T22:03:35.174 INFO:tasks.rados.rados.2.smithi057.stdout:476: finishing write tid 1 to smithi05720651-30 2020-11-16T22:03:35.174 INFO:tasks.rados.rados.2.smithi057.stdout:476: finishing write tid 2 to smithi05720651-30 2020-11-16T22:03:35.175 INFO:tasks.rados.rados.2.smithi057.stdout:476: finishing write tid 4 to smithi05720651-30 2020-11-16T22:03:35.175 INFO:tasks.rados.rados.2.smithi057.stdout:476: finishing write tid 5 to smithi05720651-30 2020-11-16T22:03:35.175 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 290 (ObjNum 187 snap 64 seq_num 187) dirty exists 2020-11-16T22:03:35.175 INFO:tasks.rados.rados.2.smithi057.stdout:476: left oid 30 (ObjNum 187 snap 64 seq_num 187) 2020-11-16T22:03:35.175 INFO:tasks.rados.rados.2.smithi057.stdout:474: finishing write tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:35.175 INFO:tasks.rados.rados.2.smithi057.stdout:474: finishing write tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:35.175 INFO:tasks.rados.rados.2.smithi057.stdout:474: finishing write tid 3 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:35.176 INFO:tasks.rados.rados.2.smithi057.stdout:474: finishing write tid 5 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:35.176 INFO:tasks.rados.rados.2.smithi057.stdout:474: finishing write tid 6 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:35.176 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 215 (ObjNum 186 snap 64 seq_num 186) dirty exists 2020-11-16T22:03:35.176 INFO:tasks.rados.rados.2.smithi057.stdout:474: left oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 186 snap 64 seq_num 186) 2020-11-16T22:03:35.176 INFO:tasks.rados.rados.2.smithi057.stdout:480: finishing rollback tid 0 to smithi05720651-10 2020-11-16T22:03:35.176 INFO:tasks.rados.rados.2.smithi057.stdout:480: finishing rollback tid 1 to smithi05720651-10 2020-11-16T22:03:35.176 INFO:tasks.rados.rados.2.smithi057.stdout:479: finishing write tid 1 to smithi05720651-26 2020-11-16T22:03:35.177 INFO:tasks.rados.rados.2.smithi057.stdout:480: finishing rollback tid 2 to smithi05720651-10 2020-11-16T22:03:35.177 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 223 (ObjNum 137 snap 39 seq_num 137) dirty exists 2020-11-16T22:03:35.177 INFO:tasks.rados.rados.2.smithi057.stdout:479: finishing write tid 2 to smithi05720651-26 2020-11-16T22:03:35.177 INFO:tasks.rados.rados.2.smithi057.stdout:479: finishing write tid 4 to smithi05720651-26 2020-11-16T22:03:35.177 INFO:tasks.rados.rados.2.smithi057.stdout:469: done (9 left) 2020-11-16T22:03:35.177 INFO:tasks.rados.rados.2.smithi057.stdout:470: done (8 left) 2020-11-16T22:03:35.177 INFO:tasks.rados.rados.2.smithi057.stdout:471: done (7 left) 2020-11-16T22:03:35.178 INFO:tasks.rados.rados.2.smithi057.stdout:472: done (6 left) 2020-11-16T22:03:35.178 INFO:tasks.rados.rados.2.smithi057.stdout:474: done (5 left) 2020-11-16T22:03:35.178 INFO:tasks.rados.rados.2.smithi057.stdout:475: done (4 left) 2020-11-16T22:03:35.178 INFO:tasks.rados.rados.2.smithi057.stdout:476: done (3 left) 2020-11-16T22:03:35.178 INFO:tasks.rados.rados.2.smithi057.stdout:480: done (2 left) 2020-11-16T22:03:35.178 INFO:tasks.rados.rados.2.smithi057.stdout:482: copy_from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 18 current snap is 64 2020-11-16T22:03:35.178 INFO:tasks.rados.rados.2.smithi057.stdout:479: finishing write tid 5 to smithi05720651-26 2020-11-16T22:03:35.179 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 385 (ObjNum 188 snap 64 seq_num 188) dirty exists 2020-11-16T22:03:35.179 INFO:tasks.rados.rados.2.smithi057.stdout:479: left oid 26 (ObjNum 188 snap 64 seq_num 188) 2020-11-16T22:03:35.179 INFO:tasks.rados.rados.2.smithi057.stdout:481: finishing copy_from to smithi05720651-20 2020-11-16T22:03:35.179 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 256 (ObjNum 166 snap 56 seq_num 166) dirty exists 2020-11-16T22:03:35.179 INFO:tasks.rados.rados.2.smithi057.stdout:481: finishing copy_from racing read to smithi05720651-20 2020-11-16T22:03:35.179 INFO:tasks.rados.rados.2.smithi057.stdout:479: done (2 left) 2020-11-16T22:03:35.179 INFO:tasks.rados.rados.2.smithi057.stdout:481: done (1 left) 2020-11-16T22:03:35.180 INFO:tasks.rados.rados.2.smithi057.stdout:483: rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 64 2020-11-16T22:03:35.180 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 44 2020-11-16T22:03:35.180 INFO:tasks.rados.rados.2.smithi057.stdout:484: write (excl) oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 64 2020-11-16T22:03:35.180 INFO:tasks.rados.rados.2.smithi057.stdout:484: seq_num 189 ranges {776523=614533,1976979=757720} 2020-11-16T22:03:35.191 INFO:tasks.rados.rados.2.smithi057.stdout:484: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 776523 to 1391056 tid 1 2020-11-16T22:03:35.199 INFO:tasks.rados.rados.2.smithi057.stdout:484: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1976979 to 2734699 tid 2 2020-11-16T22:03:35.200 INFO:tasks.rados.rados.2.smithi057.stdout:485: snap_remove snap 33 2020-11-16T22:03:35.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:34 smithi016 bash[10302]: cluster 2020-11-16T22:03:33.600644+0000 mgr.x (mgr.24115) 328 : cluster [DBG] pgmap v445: 17 pgs: 17 active+clean; 231 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.3 MiB/s wr, 21 op/s 2020-11-16T22:03:35.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:34 smithi016 bash[10302]: cluster 2020-11-16T22:03:33.982795+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e188: 12 total, 12 up, 12 in 2020-11-16T22:03:35.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:34 smithi016 bash[10302]: cluster 2020-11-16T22:03:34.898397+0000 mon.a (mon.0) 828 : cluster [DBG] osdmap e189: 12 total, 12 up, 12 in 2020-11-16T22:03:35.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:34 smithi195 bash[10218]: cluster 2020-11-16T22:03:33.600644+0000 mgr.x (mgr.24115) 328 : cluster [DBG] pgmap v445: 17 pgs: 17 active+clean; 231 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.3 MiB/s wr, 21 op/s 2020-11-16T22:03:35.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:34 smithi195 bash[10218]: cluster 2020-11-16T22:03:33.982795+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e188: 12 total, 12 up, 12 in 2020-11-16T22:03:35.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:34 smithi195 bash[10218]: cluster 2020-11-16T22:03:34.898397+0000 mon.a (mon.0) 828 : cluster [DBG] osdmap e189: 12 total, 12 up, 12 in 2020-11-16T22:03:35.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:34 smithi057 bash[10301]: cluster 2020-11-16T22:03:33.600644+0000 mgr.x (mgr.24115) 328 : cluster [DBG] pgmap v445: 17 pgs: 17 active+clean; 231 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.3 MiB/s wr, 21 op/s 2020-11-16T22:03:35.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:34 smithi057 bash[10301]: cluster 2020-11-16T22:03:33.982795+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e188: 12 total, 12 up, 12 in 2020-11-16T22:03:35.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:34 smithi057 bash[10301]: cluster 2020-11-16T22:03:34.898397+0000 mon.a (mon.0) 828 : cluster [DBG] osdmap e189: 12 total, 12 up, 12 in 2020-11-16T22:03:35.988 INFO:tasks.rados.rados.2.smithi057.stdout:485: done (3 left) 2020-11-16T22:03:35.988 INFO:tasks.rados.rados.2.smithi057.stdout:486: snap_remove snap 49 2020-11-16T22:03:36.587 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 22:03:36 smithi016 bash[17468]: debug 2020-11-16T22:03:36.306+0000 7fd65f6d4700 -1 osd.6 pg_epoch: 190 pg[2.7( v 189'149 (0'0,189'149] local-lis/les=71/72 n=7 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [6,10] r=0 lpr=71 crt=189'149 lcod 188'147 mlcod 188'147 active+clean+snaptrim trimq=[3b~1] ps=[53~1,65~1,68~1,6b~1]] removing snap head 2020-11-16T22:03:36.991 INFO:tasks.rados.rados.2.smithi057.stdout:486: done (3 left) 2020-11-16T22:03:36.991 INFO:tasks.rados.rados.2.smithi057.stdout:487: rollback oid 40 current snap is 64 2020-11-16T22:03:36.992 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 40 to 63 2020-11-16T22:03:36.992 INFO:tasks.rados.rados.2.smithi057.stdout:483: finishing rollback tid 0 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:36.992 INFO:tasks.rados.rados.2.smithi057.stdout:483: finishing rollback tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:36.992 INFO:tasks.rados.rados.2.smithi057.stdout:483: finishing rollback tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:36.992 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 299 (ObjNum 125 snap 36 seq_num 125) dirty exists 2020-11-16T22:03:36.992 INFO:tasks.rados.rados.2.smithi057.stdout:482: finishing copy_from to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:36.993 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 137 (ObjNum 162 snap 56 seq_num 162) dirty exists 2020-11-16T22:03:36.993 INFO:tasks.rados.rados.2.smithi057.stdout:484: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:36.993 INFO:tasks.rados.rados.2.smithi057.stdout:484: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:36.993 INFO:tasks.rados.rados.2.smithi057.stdout:484: finishing write tid 4 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:36.993 INFO:tasks.rados.rados.2.smithi057.stdout:484: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:36.993 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 247 (ObjNum 189 snap 64 seq_num 189) dirty exists 2020-11-16T22:03:36.993 INFO:tasks.rados.rados.2.smithi057.stdout:484: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 189 snap 64 seq_num 189) 2020-11-16T22:03:36.994 INFO:tasks.rados.rados.2.smithi057.stdout:482: finishing copy_from racing read to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:36.994 INFO:tasks.rados.rados.2.smithi057.stdout:482: done (3 left) 2020-11-16T22:03:36.994 INFO:tasks.rados.rados.2.smithi057.stdout:483: done (2 left) 2020-11-16T22:03:36.994 INFO:tasks.rados.rados.2.smithi057.stdout:484: done (1 left) 2020-11-16T22:03:36.994 INFO:tasks.rados.rados.2.smithi057.stdout:488: read oid 30 snap 62 2020-11-16T22:03:36.994 INFO:tasks.rados.rados.2.smithi057.stdout:488: expect (ObjNum 109 snap 32 seq_num 109) 2020-11-16T22:03:36.994 INFO:tasks.rados.rados.2.smithi057.stdout:489: delete oid 24 current snap is 64 2020-11-16T22:03:36.999 INFO:tasks.rados.rados.2.smithi057.stdout:489: done (2 left) 2020-11-16T22:03:36.999 INFO:tasks.rados.rados.2.smithi057.stdout:490: copy_from oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 20 current snap is 64 2020-11-16T22:03:36.999 INFO:tasks.rados.rados.2.smithi057.stdout:491: write oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 64 2020-11-16T22:03:36.999 INFO:tasks.rados.rados.2.smithi057.stdout:491: seq_num 191 ranges {410137=481384,1410296=761389,2728968=481169} 2020-11-16T22:03:37.006 INFO:tasks.rados.rados.2.smithi057.stdout:491: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 410137 to 891521 tid 1 2020-11-16T22:03:37.014 INFO:tasks.rados.rados.2.smithi057.stdout:491: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1410296 to 2171685 tid 2 2020-11-16T22:03:37.020 INFO:tasks.rados.rados.2.smithi057.stdout:491: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2728968 to 3210137 tid 3 2020-11-16T22:03:37.020 INFO:tasks.rados.rados.2.smithi057.stdout:492: copy_from oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 10 current snap is 64 2020-11-16T22:03:37.020 INFO:tasks.rados.rados.2.smithi057.stdout:487: finishing rollback tid 0 to smithi05720651-40 2020-11-16T22:03:37.021 INFO:tasks.rados.rados.2.smithi057.stdout:487: finishing rollback tid 1 to smithi05720651-40 2020-11-16T22:03:37.021 INFO:tasks.rados.rados.2.smithi057.stdout:487: finishing rollback tid 2 to smithi05720651-40 2020-11-16T22:03:37.021 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 405 (ObjNum 143 snap 44 seq_num 143) dirty exists 2020-11-16T22:03:37.021 INFO:tasks.rados.rados.2.smithi057.stdout:487: done (4 left) 2020-11-16T22:03:37.021 INFO:tasks.rados.rados.2.smithi057.stdout:493: copy_from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 24 current snap is 64 2020-11-16T22:03:37.021 INFO:tasks.rados.rados.2.smithi057.stdout:488: expect (ObjNum 109 snap 32 seq_num 109) 2020-11-16T22:03:37.244 INFO:tasks.rados.rados.2.smithi057.stdout:491: finishing write tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:37.245 INFO:tasks.rados.rados.2.smithi057.stdout:491: finishing write tid 2 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:37.245 INFO:tasks.rados.rados.2.smithi057.stdout:490: finishing copy_from to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:37.245 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 256 (ObjNum 166 snap 56 seq_num 166) dirty exists 2020-11-16T22:03:37.245 INFO:tasks.rados.rados.2.smithi057.stdout:490: finishing copy_from racing read to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:37.246 INFO:tasks.rados.rados.2.smithi057.stdout:491: finishing write tid 3 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:37.246 INFO:tasks.rados.rados.2.smithi057.stdout:491: finishing write tid 5 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:37.246 INFO:tasks.rados.rados.2.smithi057.stdout:491: finishing write tid 6 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:37.246 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 123 (ObjNum 191 snap 64 seq_num 191) dirty exists 2020-11-16T22:03:37.246 INFO:tasks.rados.rados.2.smithi057.stdout:491: left oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 191 snap 64 seq_num 191) 2020-11-16T22:03:37.247 INFO:tasks.rados.rados.2.smithi057.stdout:493: finishing copy_from to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:37.247 INFO:tasks.rados.rados.2.smithi057.stdout:493: got expected ENOENT (src dne) 2020-11-16T22:03:37.247 INFO:tasks.rados.rados.2.smithi057.stdout:488: done (4 left) 2020-11-16T22:03:37.248 INFO:tasks.rados.rados.2.smithi057.stdout:490: done (3 left) 2020-11-16T22:03:37.248 INFO:tasks.rados.rados.2.smithi057.stdout:491: done (2 left) 2020-11-16T22:03:37.248 INFO:tasks.rados.rados.2.smithi057.stdout:494: read oid 8 snap -1 2020-11-16T22:03:37.248 INFO:tasks.rados.rados.2.smithi057.stdout:494: expect (ObjNum 7 snap 0 seq_num 7) 2020-11-16T22:03:37.248 INFO:tasks.rados.rados.2.smithi057.stdout:495: write (excl) oid 2 current snap is 64 2020-11-16T22:03:37.248 INFO:tasks.rados.rados.2.smithi057.stdout:495: seq_num 192 ranges {426944=556633,1468778=621400,2872744=354200} 2020-11-16T22:03:37.258 INFO:tasks.rados.rados.2.smithi057.stdout:495: writing smithi05720651-2 from 426944 to 983577 tid 1 2020-11-16T22:03:37.264 INFO:tasks.rados.rados.2.smithi057.stdout:495: writing smithi05720651-2 from 1468778 to 2090178 tid 2 2020-11-16T22:03:37.270 INFO:tasks.rados.rados.2.smithi057.stdout:495: writing smithi05720651-2 from 2872744 to 3226944 tid 3 2020-11-16T22:03:37.271 INFO:tasks.rados.rados.2.smithi057.stdout:496: copy_from oid 6 from oid 20 current snap is 64 2020-11-16T22:03:37.271 INFO:tasks.rados.rados.2.smithi057.stdout:493: finishing copy_from racing read to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:37.271 INFO:tasks.rados.rados.2.smithi057.stdout:492: finishing copy_from to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:37.271 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 223 (ObjNum 137 snap 39 seq_num 137) dirty exists 2020-11-16T22:03:37.271 INFO:tasks.rados.rados.2.smithi057.stdout:492: finishing copy_from racing read to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:37.271 INFO:tasks.rados.rados.2.smithi057.stdout:492: done (4 left) 2020-11-16T22:03:37.272 INFO:tasks.rados.rados.2.smithi057.stdout:493: done (3 left) 2020-11-16T22:03:37.272 INFO:tasks.rados.rados.2.smithi057.stdout:497: write oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 64 2020-11-16T22:03:37.272 INFO:tasks.rados.rados.2.smithi057.stdout:497: seq_num 193 ranges {443751=631882,1810907=765058,3067461=176290} 2020-11-16T22:03:37.276 INFO:tasks.rados.rados.2.smithi057.stdout:497: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 443751 to 1075633 tid 1 2020-11-16T22:03:37.285 INFO:tasks.rados.rados.2.smithi057.stdout:497: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1810907 to 2575965 tid 2 2020-11-16T22:03:37.289 INFO:tasks.rados.rados.2.smithi057.stdout:497: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3067461 to 3243751 tid 3 2020-11-16T22:03:37.289 INFO:tasks.rados.rados.2.smithi057.stdout:498: snap_remove snap 41 2020-11-16T22:03:37.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:37 smithi016 bash[10302]: cluster 2020-11-16T22:03:35.601344+0000 mgr.x (mgr.24115) 329 : cluster [DBG] pgmap v448: 17 pgs: 17 active+clean; 239 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 2.1 MiB/s wr, 10 op/s 2020-11-16T22:03:37.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:37 smithi016 bash[10302]: cluster 2020-11-16T22:03:35.996054+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e190: 12 total, 12 up, 12 in 2020-11-16T22:03:37.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:37 smithi195 bash[10218]: cluster 2020-11-16T22:03:35.601344+0000 mgr.x (mgr.24115) 329 : cluster [DBG] pgmap v448: 17 pgs: 17 active+clean; 239 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 2.1 MiB/s wr, 10 op/s 2020-11-16T22:03:37.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:37 smithi195 bash[10218]: cluster 2020-11-16T22:03:35.996054+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e190: 12 total, 12 up, 12 in 2020-11-16T22:03:37.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:37 smithi057 bash[10301]: cluster 2020-11-16T22:03:35.601344+0000 mgr.x (mgr.24115) 329 : cluster [DBG] pgmap v448: 17 pgs: 17 active+clean; 239 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 2.1 MiB/s wr, 10 op/s 2020-11-16T22:03:37.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:37 smithi057 bash[10301]: cluster 2020-11-16T22:03:35.996054+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e190: 12 total, 12 up, 12 in 2020-11-16T22:03:38.010 INFO:tasks.rados.rados.2.smithi057.stdout:498: done (4 left) 2020-11-16T22:03:38.010 INFO:tasks.rados.rados.2.smithi057.stdout:499: write oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 64 2020-11-16T22:03:38.010 INFO:tasks.rados.rados.2.smithi057.stdout:499: seq_num 194 ranges {460558=707131,1869389=508716,3094884=165674} 2020-11-16T22:03:38.018 INFO:tasks.rados.rados.2.smithi057.stdout:499: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 460558 to 1167689 tid 1 2020-11-16T22:03:38.025 INFO:tasks.rados.rados.2.smithi057.stdout:499: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1869389 to 2378105 tid 2 2020-11-16T22:03:38.030 INFO:tasks.rados.rados.2.smithi057.stdout:499: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3094884 to 3260558 tid 3 2020-11-16T22:03:38.030 INFO:tasks.rados.rados.2.smithi057.stdout:500: delete oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 64 2020-11-16T22:03:38.030 INFO:tasks.rados.rados.2.smithi057.stdout:494: expect (ObjNum 7 snap 0 seq_num 7) 2020-11-16T22:03:38.102 INFO:tasks.rados.rados.2.smithi057.stdout:495: finishing write tid 1 to smithi05720651-2 2020-11-16T22:03:38.103 INFO:tasks.rados.rados.2.smithi057.stdout:495: finishing write tid 2 to smithi05720651-2 2020-11-16T22:03:38.103 INFO:tasks.rados.rados.2.smithi057.stdout:495: finishing write tid 3 to smithi05720651-2 2020-11-16T22:03:38.103 INFO:tasks.rados.rados.2.smithi057.stdout:495: finishing write tid 5 to smithi05720651-2 2020-11-16T22:03:38.103 INFO:tasks.rados.rados.2.smithi057.stdout:495: finishing write tid 6 to smithi05720651-2 2020-11-16T22:03:38.103 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 423 (ObjNum 192 snap 64 seq_num 192) dirty exists 2020-11-16T22:03:38.103 INFO:tasks.rados.rados.2.smithi057.stdout:495: left oid 2 (ObjNum 192 snap 64 seq_num 192) 2020-11-16T22:03:38.104 INFO:tasks.rados.rados.2.smithi057.stdout:497: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:38.104 INFO:tasks.rados.rados.2.smithi057.stdout:497: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:38.104 INFO:tasks.rados.rados.2.smithi057.stdout:497: finishing write tid 3 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:38.104 INFO:tasks.rados.rados.2.smithi057.stdout:497: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:38.104 INFO:tasks.rados.rados.2.smithi057.stdout:497: finishing write tid 6 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:38.104 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 197 (ObjNum 193 snap 64 seq_num 193) dirty exists 2020-11-16T22:03:38.105 INFO:tasks.rados.rados.2.smithi057.stdout:497: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 193 snap 64 seq_num 193) 2020-11-16T22:03:38.105 INFO:tasks.rados.rados.2.smithi057.stdout:496: finishing copy_from to smithi05720651-6 2020-11-16T22:03:38.105 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 256 (ObjNum 166 snap 56 seq_num 166) dirty exists 2020-11-16T22:03:38.105 INFO:tasks.rados.rados.2.smithi057.stdout:496: finishing copy_from racing read to smithi05720651-6 2020-11-16T22:03:38.105 INFO:tasks.rados.rados.2.smithi057.stdout:499: finishing write tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:38.105 INFO:tasks.rados.rados.2.smithi057.stdout:499: finishing write tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:38.105 INFO:tasks.rados.rados.2.smithi057.stdout:499: finishing write tid 3 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:38.106 INFO:tasks.rados.rados.2.smithi057.stdout:499: finishing write tid 5 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:38.106 INFO:tasks.rados.rados.2.smithi057.stdout:499: finishing write tid 6 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:38.106 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 324 (ObjNum 194 snap 64 seq_num 194) dirty exists 2020-11-16T22:03:38.106 INFO:tasks.rados.rados.2.smithi057.stdout:499: left oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 194 snap 64 seq_num 194) 2020-11-16T22:03:38.106 INFO:tasks.rados.rados.2.smithi057.stdout:494: done (5 left) 2020-11-16T22:03:38.106 INFO:tasks.rados.rados.2.smithi057.stdout:495: done (4 left) 2020-11-16T22:03:38.107 INFO:tasks.rados.rados.2.smithi057.stdout:496: done (3 left) 2020-11-16T22:03:38.107 INFO:tasks.rados.rados.2.smithi057.stdout:497: done (2 left) 2020-11-16T22:03:38.107 INFO:tasks.rados.rados.2.smithi057.stdout:499: done (1 left) 2020-11-16T22:03:38.107 INFO:tasks.rados.rados.2.smithi057.stdout:500: done (0 left) 2020-11-16T22:03:38.107 INFO:tasks.rados.rados.2.smithi057.stdout:501: snap_create 2020-11-16T22:03:38.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:38 smithi016 bash[10302]: cluster 2020-11-16T22:03:36.999325+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e191: 12 total, 12 up, 12 in 2020-11-16T22:03:38.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:38 smithi195 bash[10218]: cluster 2020-11-16T22:03:36.999325+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e191: 12 total, 12 up, 12 in 2020-11-16T22:03:38.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:38 smithi057 bash[10301]: cluster 2020-11-16T22:03:36.999325+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e191: 12 total, 12 up, 12 in 2020-11-16T22:03:39.024 INFO:tasks.rados.rados.2.smithi057.stdout:501: done (0 left) 2020-11-16T22:03:39.024 INFO:tasks.rados.rados.2.smithi057.stdout:502: snap_create 2020-11-16T22:03:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:39 smithi016 bash[10302]: cluster 2020-11-16T22:03:37.602043+0000 mgr.x (mgr.24115) 330 : cluster [DBG] pgmap v451: 17 pgs: 17 active+clean; 227 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2020-11-16T22:03:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:39 smithi016 bash[10302]: cluster 2020-11-16T22:03:38.017810+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e192: 12 total, 12 up, 12 in 2020-11-16T22:03:39.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:39 smithi195 bash[10218]: cluster 2020-11-16T22:03:37.602043+0000 mgr.x (mgr.24115) 330 : cluster [DBG] pgmap v451: 17 pgs: 17 active+clean; 227 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2020-11-16T22:03:39.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:39 smithi195 bash[10218]: cluster 2020-11-16T22:03:38.017810+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e192: 12 total, 12 up, 12 in 2020-11-16T22:03:39.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:39 smithi057 bash[10301]: cluster 2020-11-16T22:03:37.602043+0000 mgr.x (mgr.24115) 330 : cluster [DBG] pgmap v451: 17 pgs: 17 active+clean; 227 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2020-11-16T22:03:39.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:39 smithi057 bash[10301]: cluster 2020-11-16T22:03:38.017810+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e192: 12 total, 12 up, 12 in 2020-11-16T22:03:39.895 INFO:tasks.rados.rados.2.smithi057.stdout:502: done (0 left) 2020-11-16T22:03:39.895 INFO:tasks.rados.rados.2.smithi057.stdout:503: write oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 66 2020-11-16T22:03:39.895 INFO:tasks.rados.rados.2.smithi057.stdout:503: seq_num 196 ranges {494172=457629,1586353=512385,2749730=544442} 2020-11-16T22:03:39.907 INFO:tasks.rados.rados.2.smithi057.stdout:503: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 494172 to 951801 tid 1 2020-11-16T22:03:39.914 INFO:tasks.rados.rados.2.smithi057.stdout:503: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1586353 to 2098738 tid 2 2020-11-16T22:03:39.921 INFO:tasks.rados.rados.2.smithi057.stdout:503: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2749730 to 3294172 tid 3 2020-11-16T22:03:39.921 INFO:tasks.rados.rados.2.smithi057.stdout:504: snap_create 2020-11-16T22:03:39.921 INFO:tasks.rados.rados.2.smithi057.stdout:503: finishing write tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:39.925 INFO:tasks.rados.rados.2.smithi057.stdout:503: finishing write tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:39.926 INFO:tasks.rados.rados.2.smithi057.stdout:503: finishing write tid 3 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:39.926 INFO:tasks.rados.rados.2.smithi057.stdout:503: finishing write tid 5 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:40.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:40 smithi016 bash[10302]: cluster 2020-11-16T22:03:39.026651+0000 mon.a (mon.0) 832 : cluster [DBG] osdmap e193: 12 total, 12 up, 12 in 2020-11-16T22:03:40.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:40 smithi016 bash[10302]: cluster 2020-11-16T22:03:39.901179+0000 mon.a (mon.0) 833 : cluster [DBG] osdmap e194: 12 total, 12 up, 12 in 2020-11-16T22:03:40.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:40 smithi195 bash[10218]: cluster 2020-11-16T22:03:39.026651+0000 mon.a (mon.0) 832 : cluster [DBG] osdmap e193: 12 total, 12 up, 12 in 2020-11-16T22:03:40.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:40 smithi195 bash[10218]: cluster 2020-11-16T22:03:39.901179+0000 mon.a (mon.0) 833 : cluster [DBG] osdmap e194: 12 total, 12 up, 12 in 2020-11-16T22:03:40.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:40 smithi057 bash[10301]: cluster 2020-11-16T22:03:39.026651+0000 mon.a (mon.0) 832 : cluster [DBG] osdmap e193: 12 total, 12 up, 12 in 2020-11-16T22:03:40.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:40 smithi057 bash[10301]: cluster 2020-11-16T22:03:39.901179+0000 mon.a (mon.0) 833 : cluster [DBG] osdmap e194: 12 total, 12 up, 12 in 2020-11-16T22:03:40.525 INFO:tasks.rados.rados.2.smithi057.stdout:503: finishing write tid 6 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:40.526 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 244 (ObjNum 196 snap 66 seq_num 196) dirty exists 2020-11-16T22:03:40.526 INFO:tasks.rados.rados.2.smithi057.stdout:503: left oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 196 snap 66 seq_num 196) 2020-11-16T22:03:40.909 INFO:tasks.rados.rados.2.smithi057.stdout:503: done (1 left) 2020-11-16T22:03:40.910 INFO:tasks.rados.rados.2.smithi057.stdout:504: done (0 left) 2020-11-16T22:03:40.910 INFO:tasks.rados.rados.2.smithi057.stdout:505: delete oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 67 2020-11-16T22:03:40.914 INFO:tasks.rados.rados.2.smithi057.stdout:505: done (0 left) 2020-11-16T22:03:40.914 INFO:tasks.rados.rados.2.smithi057.stdout:506: delete oid 30 current snap is 67 2020-11-16T22:03:40.919 INFO:tasks.rados.rados.2.smithi057.stdout:506: done (0 left) 2020-11-16T22:03:40.919 INFO:tasks.rados.rados.2.smithi057.stdout:507: copy_from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 28 current snap is 67 2020-11-16T22:03:40.919 INFO:tasks.rados.rados.2.smithi057.stdout:508: copy_from oid 22 from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 67 2020-11-16T22:03:40.919 INFO:tasks.rados.rados.2.smithi057.stdout:509: write oid 46 current snap is 67 2020-11-16T22:03:40.919 INFO:tasks.rados.rados.2.smithi057.stdout:509: seq_num 199 ranges {544593=799729,1761799=776065,2948352=396241} 2020-11-16T22:03:40.931 INFO:tasks.rados.rados.2.smithi057.stdout:509: writing smithi05720651-46 from 544593 to 1344322 tid 1 2020-11-16T22:03:40.938 INFO:tasks.rados.rados.2.smithi057.stdout:509: writing smithi05720651-46 from 1761799 to 2537864 tid 2 2020-11-16T22:03:40.943 INFO:tasks.rados.rados.2.smithi057.stdout:509: writing smithi05720651-46 from 2948352 to 3344593 tid 3 2020-11-16T22:03:40.943 INFO:tasks.rados.rados.2.smithi057.stdout:510: write (excl) oid 36 current snap is 67 2020-11-16T22:03:40.943 INFO:tasks.rados.rados.2.smithi057.stdout:510: seq_num 200 ranges {561400=474978,1820281=519723,2859422=457579} 2020-11-16T22:03:40.949 INFO:tasks.rados.rados.2.smithi057.stdout:510: writing smithi05720651-36 from 561400 to 1036378 tid 1 2020-11-16T22:03:40.956 INFO:tasks.rados.rados.2.smithi057.stdout:510: writing smithi05720651-36 from 1820281 to 2340004 tid 2 2020-11-16T22:03:40.962 INFO:tasks.rados.rados.2.smithi057.stdout:510: writing smithi05720651-36 from 2859422 to 3317001 tid 3 2020-11-16T22:03:40.963 INFO:tasks.rados.rados.2.smithi057.stdout:511: snap_create 2020-11-16T22:03:40.963 INFO:tasks.rados.rados.2.smithi057.stdout:509: finishing write tid 1 to smithi05720651-46 2020-11-16T22:03:40.963 INFO:tasks.rados.rados.2.smithi057.stdout:509: finishing write tid 2 to smithi05720651-46 2020-11-16T22:03:40.963 INFO:tasks.rados.rados.2.smithi057.stdout:509: finishing write tid 3 to smithi05720651-46 2020-11-16T22:03:40.963 INFO:tasks.rados.rados.2.smithi057.stdout:509: finishing write tid 5 to smithi05720651-46 2020-11-16T22:03:40.963 INFO:tasks.rados.rados.2.smithi057.stdout:509: finishing write tid 6 to smithi05720651-46 2020-11-16T22:03:40.963 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 328 (ObjNum 199 snap 67 seq_num 199) dirty exists 2020-11-16T22:03:40.964 INFO:tasks.rados.rados.2.smithi057.stdout:509: left oid 46 (ObjNum 199 snap 67 seq_num 199) 2020-11-16T22:03:40.964 INFO:tasks.rados.rados.2.smithi057.stdout:510: finishing write tid 1 to smithi05720651-36 2020-11-16T22:03:40.964 INFO:tasks.rados.rados.2.smithi057.stdout:510: finishing write tid 2 to smithi05720651-36 2020-11-16T22:03:40.967 INFO:tasks.rados.rados.2.smithi057.stdout:510: finishing write tid 3 to smithi05720651-36 2020-11-16T22:03:40.968 INFO:tasks.rados.rados.2.smithi057.stdout:510: finishing write tid 5 to smithi05720651-36 2020-11-16T22:03:40.968 INFO:tasks.rados.rados.2.smithi057.stdout:510: finishing write tid 6 to smithi05720651-36 2020-11-16T22:03:40.968 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 249 (ObjNum 200 snap 67 seq_num 200) dirty exists 2020-11-16T22:03:40.968 INFO:tasks.rados.rados.2.smithi057.stdout:510: left oid 36 (ObjNum 200 snap 67 seq_num 200) 2020-11-16T22:03:41.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:41 smithi016 bash[10302]: cluster 2020-11-16T22:03:39.602730+0000 mgr.x (mgr.24115) 331 : cluster [DBG] pgmap v454: 17 pgs: 17 active+clean; 223 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2020-11-16T22:03:41.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:41 smithi016 bash[10302]: cluster 2020-11-16T22:03:40.915198+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e195: 12 total, 12 up, 12 in 2020-11-16T22:03:41.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:41 smithi195 bash[10218]: cluster 2020-11-16T22:03:39.602730+0000 mgr.x (mgr.24115) 331 : cluster [DBG] pgmap v454: 17 pgs: 17 active+clean; 223 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2020-11-16T22:03:41.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:41 smithi195 bash[10218]: cluster 2020-11-16T22:03:40.915198+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e195: 12 total, 12 up, 12 in 2020-11-16T22:03:41.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:41 smithi057 bash[10301]: cluster 2020-11-16T22:03:39.602730+0000 mgr.x (mgr.24115) 331 : cluster [DBG] pgmap v454: 17 pgs: 17 active+clean; 223 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2020-11-16T22:03:41.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:41 smithi057 bash[10301]: cluster 2020-11-16T22:03:40.915198+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e195: 12 total, 12 up, 12 in 2020-11-16T22:03:41.575 INFO:tasks.rados.rados.2.smithi057.stdout:507: finishing copy_from to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:41.576 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 206 (ObjNum 185 snap 64 seq_num 185) dirty exists 2020-11-16T22:03:41.576 INFO:tasks.rados.rados.2.smithi057.stdout:507: finishing copy_from racing read to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:41.886 INFO:tasks.rados.rados.2.smithi057.stdout:508: finishing copy_from to smithi05720651-22 2020-11-16T22:03:41.887 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 137 (ObjNum 162 snap 56 seq_num 162) dirty exists 2020-11-16T22:03:41.887 INFO:tasks.rados.rados.2.smithi057.stdout:508: finishing copy_from racing read to smithi05720651-22 2020-11-16T22:03:41.907 INFO:tasks.rados.rados.2.smithi057.stdout:507: done (4 left) 2020-11-16T22:03:41.907 INFO:tasks.rados.rados.2.smithi057.stdout:508: done (3 left) 2020-11-16T22:03:41.907 INFO:tasks.rados.rados.2.smithi057.stdout:509: done (2 left) 2020-11-16T22:03:41.907 INFO:tasks.rados.rados.2.smithi057.stdout:510: done (1 left) 2020-11-16T22:03:41.908 INFO:tasks.rados.rados.2.smithi057.stdout:511: done (0 left) 2020-11-16T22:03:41.908 INFO:tasks.rados.rados.2.smithi057.stdout:512: write oid 38 current snap is 68 2020-11-16T22:03:41.908 INFO:tasks.rados.rados.2.smithi057.stdout:512: seq_num 201 ranges {578207=550227,1762410=779734,3286845=91362} 2020-11-16T22:03:41.913 INFO:tasks.rados.rados.2.smithi057.stdout:512: writing smithi05720651-38 from 578207 to 1128434 tid 1 2020-11-16T22:03:41.922 INFO:tasks.rados.rados.2.smithi057.stdout:512: writing smithi05720651-38 from 1762410 to 2542144 tid 2 2020-11-16T22:03:41.927 INFO:tasks.rados.rados.2.smithi057.stdout:512: writing smithi05720651-38 from 3286845 to 3378207 tid 3 2020-11-16T22:03:41.927 INFO:tasks.rados.rados.2.smithi057.stdout:513: rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 68 2020-11-16T22:03:41.927 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 62 2020-11-16T22:03:41.928 INFO:tasks.rados.rados.2.smithi057.stdout:512: finishing write tid 1 to smithi05720651-38 2020-11-16T22:03:41.928 INFO:tasks.rados.rados.2.smithi057.stdout:514: snap_remove snap 66 2020-11-16T22:03:42.911 INFO:tasks.rados.rados.2.smithi057.stdout:514: done (2 left) 2020-11-16T22:03:42.911 INFO:tasks.rados.rados.2.smithi057.stdout:515: read oid 12 snap -1 2020-11-16T22:03:42.912 INFO:tasks.rados.rados.2.smithi057.stdout:515: expect (ObjNum 149 snap 48 seq_num 149) 2020-11-16T22:03:42.912 INFO:tasks.rados.rados.2.smithi057.stdout:516: read oid 42 snap -1 2020-11-16T22:03:42.912 INFO:tasks.rados.rados.2.smithi057.stdout:516: expect deleted 2020-11-16T22:03:42.912 INFO:tasks.rados.rados.2.smithi057.stdout:517: write (excl) oid 28 current snap is 68 2020-11-16T22:03:42.912 INFO:tasks.rados.rados.2.smithi057.stdout:517: seq_num 202 ranges {595014=625476,1820892=523392,2797915=596476} 2020-11-16T22:03:42.925 INFO:tasks.rados.rados.2.smithi057.stdout:517: writing smithi05720651-28 from 595014 to 1220490 tid 1 2020-11-16T22:03:42.932 INFO:tasks.rados.rados.2.smithi057.stdout:517: writing smithi05720651-28 from 1820892 to 2344284 tid 2 2020-11-16T22:03:42.938 INFO:tasks.rados.rados.2.smithi057.stdout:517: writing smithi05720651-28 from 2797915 to 3394391 tid 3 2020-11-16T22:03:42.938 INFO:tasks.rados.rados.2.smithi057.stdout:518: snap_create 2020-11-16T22:03:42.939 INFO:tasks.rados.rados.2.smithi057.stdout:512: finishing write tid 2 to smithi05720651-38 2020-11-16T22:03:42.939 INFO:tasks.rados.rados.2.smithi057.stdout:512: finishing write tid 3 to smithi05720651-38 2020-11-16T22:03:42.939 INFO:tasks.rados.rados.2.smithi057.stdout:512: finishing write tid 5 to smithi05720651-38 2020-11-16T22:03:42.939 INFO:tasks.rados.rados.2.smithi057.stdout:512: finishing write tid 6 to smithi05720651-38 2020-11-16T22:03:42.939 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 201 (ObjNum 201 snap 68 seq_num 201) dirty exists 2020-11-16T22:03:42.939 INFO:tasks.rados.rados.2.smithi057.stdout:512: left oid 38 (ObjNum 201 snap 68 seq_num 201) 2020-11-16T22:03:42.939 INFO:tasks.rados.rados.2.smithi057.stdout:513: finishing rollback tid 0 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:42.939 INFO:tasks.rados.rados.2.smithi057.stdout:513: finishing rollback tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:42.940 INFO:tasks.rados.rados.2.smithi057.stdout:513: finishing rollback tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:42.940 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 250 (ObjNum 34 snap 0 seq_num 34) dirty exists 2020-11-16T22:03:42.940 INFO:tasks.rados.rados.2.smithi057.stdout:515: expect (ObjNum 149 snap 48 seq_num 149) 2020-11-16T22:03:43.085 INFO:tasks.rados.rados.2.smithi057.stdout:517: finishing write tid 1 to smithi05720651-28 2020-11-16T22:03:43.085 INFO:tasks.rados.rados.2.smithi057.stdout:517: finishing write tid 2 to smithi05720651-28 2020-11-16T22:03:43.085 INFO:tasks.rados.rados.2.smithi057.stdout:517: finishing write tid 3 to smithi05720651-28 2020-11-16T22:03:43.086 INFO:tasks.rados.rados.2.smithi057.stdout:517: finishing write tid 5 to smithi05720651-28 2020-11-16T22:03:43.086 INFO:tasks.rados.rados.2.smithi057.stdout:517: finishing write tid 6 to smithi05720651-28 2020-11-16T22:03:43.086 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 256 (ObjNum 202 snap 68 seq_num 202) dirty exists 2020-11-16T22:03:43.086 INFO:tasks.rados.rados.2.smithi057.stdout:517: left oid 28 (ObjNum 202 snap 68 seq_num 202) 2020-11-16T22:03:43.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:42 smithi057 bash[10301]: cluster 2020-11-16T22:03:41.603423+0000 mgr.x (mgr.24115) 332 : cluster [DBG] pgmap v457: 17 pgs: 17 active+clean; 211 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 4.7 MiB/s wr, 14 op/s 2020-11-16T22:03:43.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:42 smithi057 bash[10301]: cluster 2020-11-16T22:03:41.918080+0000 mon.a (mon.0) 835 : cluster [DBG] osdmap e196: 12 total, 12 up, 12 in 2020-11-16T22:03:43.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:42 smithi016 bash[10302]: cluster 2020-11-16T22:03:41.603423+0000 mgr.x (mgr.24115) 332 : cluster [DBG] pgmap v457: 17 pgs: 17 active+clean; 211 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 4.7 MiB/s wr, 14 op/s 2020-11-16T22:03:43.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:42 smithi016 bash[10302]: cluster 2020-11-16T22:03:41.918080+0000 mon.a (mon.0) 835 : cluster [DBG] osdmap e196: 12 total, 12 up, 12 in 2020-11-16T22:03:43.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:42 smithi195 bash[10218]: cluster 2020-11-16T22:03:41.603423+0000 mgr.x (mgr.24115) 332 : cluster [DBG] pgmap v457: 17 pgs: 17 active+clean; 211 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 4.7 MiB/s wr, 14 op/s 2020-11-16T22:03:43.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:42 smithi195 bash[10218]: cluster 2020-11-16T22:03:41.918080+0000 mon.a (mon.0) 835 : cluster [DBG] osdmap e196: 12 total, 12 up, 12 in 2020-11-16T22:03:43.931 INFO:tasks.rados.rados.2.smithi057.stdout:512: done (5 left) 2020-11-16T22:03:43.931 INFO:tasks.rados.rados.2.smithi057.stdout:513: done (4 left) 2020-11-16T22:03:43.931 INFO:tasks.rados.rados.2.smithi057.stdout:515: done (3 left) 2020-11-16T22:03:43.931 INFO:tasks.rados.rados.2.smithi057.stdout:516: done (2 left) 2020-11-16T22:03:43.931 INFO:tasks.rados.rados.2.smithi057.stdout:517: done (1 left) 2020-11-16T22:03:43.931 INFO:tasks.rados.rados.2.smithi057.stdout:518: done (0 left) 2020-11-16T22:03:43.932 INFO:tasks.rados.rados.2.smithi057.stdout:519: snap_remove snap 68 2020-11-16T22:03:44.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:43 smithi057 bash[10301]: cluster 2020-11-16T22:03:42.921417+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e197: 12 total, 12 up, 12 in 2020-11-16T22:03:44.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:43 smithi016 bash[10302]: cluster 2020-11-16T22:03:42.921417+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e197: 12 total, 12 up, 12 in 2020-11-16T22:03:44.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:43 smithi195 bash[10218]: cluster 2020-11-16T22:03:42.921417+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e197: 12 total, 12 up, 12 in 2020-11-16T22:03:44.896 INFO:tasks.rados.rados.2.smithi057.stdout:519: done (0 left) 2020-11-16T22:03:44.897 INFO:tasks.rados.rados.2.smithi057.stdout:520: snap_remove snap 67 2020-11-16T22:03:45.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:44 smithi057 bash[10301]: cluster 2020-11-16T22:03:43.604112+0000 mgr.x (mgr.24115) 333 : cluster [DBG] pgmap v460: 17 pgs: 17 active+clean; 211 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 3.6 MiB/s wr, 13 op/s 2020-11-16T22:03:45.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:44 smithi057 bash[10301]: cluster 2020-11-16T22:03:43.938241+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e198: 12 total, 12 up, 12 in 2020-11-16T22:03:45.198 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:44 smithi057 bash[10301]: cluster 2020-11-16T22:03:44.904340+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e199: 12 total, 12 up, 12 in 2020-11-16T22:03:45.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:44 smithi016 bash[10302]: cluster 2020-11-16T22:03:43.604112+0000 mgr.x (mgr.24115) 333 : cluster [DBG] pgmap v460: 17 pgs: 17 active+clean; 211 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 3.6 MiB/s wr, 13 op/s 2020-11-16T22:03:45.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:44 smithi016 bash[10302]: cluster 2020-11-16T22:03:43.938241+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e198: 12 total, 12 up, 12 in 2020-11-16T22:03:45.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:44 smithi016 bash[10302]: cluster 2020-11-16T22:03:44.904340+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e199: 12 total, 12 up, 12 in 2020-11-16T22:03:45.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:44 smithi195 bash[10218]: cluster 2020-11-16T22:03:43.604112+0000 mgr.x (mgr.24115) 333 : cluster [DBG] pgmap v460: 17 pgs: 17 active+clean; 211 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 3.6 MiB/s wr, 13 op/s 2020-11-16T22:03:45.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:44 smithi195 bash[10218]: cluster 2020-11-16T22:03:43.938241+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e198: 12 total, 12 up, 12 in 2020-11-16T22:03:45.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:44 smithi195 bash[10218]: cluster 2020-11-16T22:03:44.904340+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e199: 12 total, 12 up, 12 in 2020-11-16T22:03:45.911 INFO:tasks.rados.rados.2.smithi057.stdout:520: done (0 left) 2020-11-16T22:03:45.911 INFO:tasks.rados.rados.2.smithi057.stdout:521: write oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 69 2020-11-16T22:03:45.911 INFO:tasks.rados.rados.2.smithi057.stdout:521: seq_num 203 ranges {611821=700725,1879374=783403,3341691=70130} 2020-11-16T22:03:45.922 INFO:tasks.rados.rados.2.smithi057.stdout:521: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 611821 to 1312546 tid 1 2020-11-16T22:03:45.930 INFO:tasks.rados.rados.2.smithi057.stdout:521: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1879374 to 2662777 tid 2 2020-11-16T22:03:45.934 INFO:tasks.rados.rados.2.smithi057.stdout:521: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3341691 to 3411821 tid 3 2020-11-16T22:03:45.935 INFO:tasks.rados.rados.2.smithi057.stdout:522: snap_remove snap 57 2020-11-16T22:03:46.934 INFO:tasks.rados.rados.2.smithi057.stdout:522: done (1 left) 2020-11-16T22:03:46.934 INFO:tasks.rados.rados.2.smithi057.stdout:523: copy_from oid 40 from oid 34 current snap is 69 2020-11-16T22:03:46.934 INFO:tasks.rados.rados.2.smithi057.stdout:521: finishing write tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:46.934 INFO:tasks.rados.rados.2.smithi057.stdout:521: finishing write tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:46.935 INFO:tasks.rados.rados.2.smithi057.stdout:521: finishing write tid 3 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:46.935 INFO:tasks.rados.rados.2.smithi057.stdout:521: finishing write tid 5 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:46.935 INFO:tasks.rados.rados.2.smithi057.stdout:521: finishing write tid 6 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:46.935 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 337 (ObjNum 203 snap 69 seq_num 203) dirty exists 2020-11-16T22:03:46.935 INFO:tasks.rados.rados.2.smithi057.stdout:521: left oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 203 snap 69 seq_num 203) 2020-11-16T22:03:46.935 INFO:tasks.rados.rados.2.smithi057.stdout:521: done (1 left) 2020-11-16T22:03:46.936 INFO:tasks.rados.rados.2.smithi057.stdout:524: rollback oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 69 2020-11-16T22:03:46.936 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 58 2020-11-16T22:03:46.936 INFO:tasks.rados.rados.2.smithi057.stdout:525: snap_remove snap 50 2020-11-16T22:03:47.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:46 smithi057 bash[10301]: cluster 2020-11-16T22:03:45.604807+0000 mgr.x (mgr.24115) 334 : cluster [DBG] pgmap v463: 17 pgs: 17 active+clean; 219 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.8 MiB/s wr, 8 op/s 2020-11-16T22:03:47.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:46 smithi057 bash[10301]: cluster 2020-11-16T22:03:45.917092+0000 mon.a (mon.0) 839 : cluster [DBG] osdmap e200: 12 total, 12 up, 12 in 2020-11-16T22:03:47.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:46 smithi016 bash[10302]: cluster 2020-11-16T22:03:45.604807+0000 mgr.x (mgr.24115) 334 : cluster [DBG] pgmap v463: 17 pgs: 17 active+clean; 219 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.8 MiB/s wr, 8 op/s 2020-11-16T22:03:47.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:46 smithi016 bash[10302]: cluster 2020-11-16T22:03:45.917092+0000 mon.a (mon.0) 839 : cluster [DBG] osdmap e200: 12 total, 12 up, 12 in 2020-11-16T22:03:47.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:46 smithi195 bash[10218]: cluster 2020-11-16T22:03:45.604807+0000 mgr.x (mgr.24115) 334 : cluster [DBG] pgmap v463: 17 pgs: 17 active+clean; 219 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.8 MiB/s wr, 8 op/s 2020-11-16T22:03:47.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:46 smithi195 bash[10218]: cluster 2020-11-16T22:03:45.917092+0000 mon.a (mon.0) 839 : cluster [DBG] osdmap e200: 12 total, 12 up, 12 in 2020-11-16T22:03:47.943 INFO:tasks.rados.rados.2.smithi057.stdout:525: done (2 left) 2020-11-16T22:03:47.944 INFO:tasks.rados.rados.2.smithi057.stdout:526: write (excl) oid 10 current snap is 69 2020-11-16T22:03:47.944 INFO:tasks.rados.rados.2.smithi057.stdout:526: seq_num 204 ranges {628628=775974,1937856=527061,3252761=175867} 2020-11-16T22:03:47.959 INFO:tasks.rados.rados.2.smithi057.stdout:526: writing smithi05720651-10 from 628628 to 1404602 tid 1 2020-11-16T22:03:47.965 INFO:tasks.rados.rados.2.smithi057.stdout:526: writing smithi05720651-10 from 1937856 to 2464917 tid 2 2020-11-16T22:03:47.971 INFO:tasks.rados.rados.2.smithi057.stdout:526: writing smithi05720651-10 from 3252761 to 3428628 tid 3 2020-11-16T22:03:47.971 INFO:tasks.rados.rados.2.smithi057.stdout:527: rollback oid 28 current snap is 69 2020-11-16T22:03:47.971 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 28 to 44 2020-11-16T22:03:47.971 INFO:tasks.rados.rados.2.smithi057.stdout:524: finishing rollback tid 0 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:47.972 INFO:tasks.rados.rados.2.smithi057.stdout:528: rollback oid 22 current snap is 69 2020-11-16T22:03:47.972 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 22 to 52 2020-11-16T22:03:47.972 INFO:tasks.rados.rados.2.smithi057.stdout:524: finishing rollback tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:47.972 INFO:tasks.rados.rados.2.smithi057.stdout:524: finishing rollback tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:47.972 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 332 (ObjNum 150 snap 48 seq_num 150) dirty exists 2020-11-16T22:03:47.972 INFO:tasks.rados.rados.2.smithi057.stdout:523: finishing copy_from to smithi05720651-40 2020-11-16T22:03:47.972 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 81 (ObjNum 130 snap 37 seq_num 130) dirty exists 2020-11-16T22:03:47.973 INFO:tasks.rados.rados.2.smithi057.stdout:523: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:03:47.973 INFO:tasks.rados.rados.2.smithi057.stdout:526: finishing write tid 1 to smithi05720651-10 2020-11-16T22:03:47.973 INFO:tasks.rados.rados.2.smithi057.stdout:526: finishing write tid 2 to smithi05720651-10 2020-11-16T22:03:47.973 INFO:tasks.rados.rados.2.smithi057.stdout:523: done (4 left) 2020-11-16T22:03:47.973 INFO:tasks.rados.rados.2.smithi057.stdout:524: done (3 left) 2020-11-16T22:03:47.973 INFO:tasks.rados.rados.2.smithi057.stdout:529: snap_remove snap 65 2020-11-16T22:03:48.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:47 smithi057 bash[10301]: cluster 2020-11-16T22:03:46.944336+0000 mon.a (mon.0) 840 : cluster [DBG] osdmap e201: 12 total, 12 up, 12 in 2020-11-16T22:03:48.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:47 smithi016 bash[10302]: cluster 2020-11-16T22:03:46.944336+0000 mon.a (mon.0) 840 : cluster [DBG] osdmap e201: 12 total, 12 up, 12 in 2020-11-16T22:03:48.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:47 smithi195 bash[10218]: cluster 2020-11-16T22:03:46.944336+0000 mon.a (mon.0) 840 : cluster [DBG] osdmap e201: 12 total, 12 up, 12 in 2020-11-16T22:03:48.948 INFO:tasks.rados.rados.2.smithi057.stdout:529: done (3 left) 2020-11-16T22:03:48.948 INFO:tasks.rados.rados.2.smithi057.stdout:530: read oid 42 snap -1 2020-11-16T22:03:48.948 INFO:tasks.rados.rados.2.smithi057.stdout:530: expect deleted 2020-11-16T22:03:48.948 INFO:tasks.rados.rados.2.smithi057.stdout:531: copy_from oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 69 2020-11-16T22:03:48.948 INFO:tasks.rados.rados.2.smithi057.stdout:528: finishing rollback tid 0 to smithi05720651-22 2020-11-16T22:03:48.949 INFO:tasks.rados.rados.2.smithi057.stdout:528: finishing rollback tid 1 to smithi05720651-22 2020-11-16T22:03:48.949 INFO:tasks.rados.rados.2.smithi057.stdout:528: finishing rollback tid 2 to smithi05720651-22 2020-11-16T22:03:48.949 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 290 (ObjNum 133 snap 37 seq_num 133) dirty exists 2020-11-16T22:03:48.949 INFO:tasks.rados.rados.2.smithi057.stdout:526: finishing write tid 3 to smithi05720651-10 2020-11-16T22:03:48.949 INFO:tasks.rados.rados.2.smithi057.stdout:526: finishing write tid 5 to smithi05720651-10 2020-11-16T22:03:48.949 INFO:tasks.rados.rados.2.smithi057.stdout:528: done (4 left) 2020-11-16T22:03:48.949 INFO:tasks.rados.rados.2.smithi057.stdout:532: snap_remove snap 55 2020-11-16T22:03:49.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:48 smithi016 bash[10302]: cluster 2020-11-16T22:03:47.605521+0000 mgr.x (mgr.24115) 335 : cluster [DBG] pgmap v466: 17 pgs: 17 active+clean; 227 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 12 op/s 2020-11-16T22:03:49.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:48 smithi016 bash[10302]: cluster 2020-11-16T22:03:47.954784+0000 mon.a (mon.0) 841 : cluster [DBG] osdmap e202: 12 total, 12 up, 12 in 2020-11-16T22:03:49.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:48 smithi195 bash[10218]: cluster 2020-11-16T22:03:47.605521+0000 mgr.x (mgr.24115) 335 : cluster [DBG] pgmap v466: 17 pgs: 17 active+clean; 227 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 12 op/s 2020-11-16T22:03:49.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:48 smithi195 bash[10218]: cluster 2020-11-16T22:03:47.954784+0000 mon.a (mon.0) 841 : cluster [DBG] osdmap e202: 12 total, 12 up, 12 in 2020-11-16T22:03:49.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:48 smithi057 bash[10301]: cluster 2020-11-16T22:03:47.605521+0000 mgr.x (mgr.24115) 335 : cluster [DBG] pgmap v466: 17 pgs: 17 active+clean; 227 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 12 op/s 2020-11-16T22:03:49.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:48 smithi057 bash[10301]: cluster 2020-11-16T22:03:47.954784+0000 mon.a (mon.0) 841 : cluster [DBG] osdmap e202: 12 total, 12 up, 12 in 2020-11-16T22:03:49.964 INFO:tasks.rados.rados.2.smithi057.stdout:532: done (4 left) 2020-11-16T22:03:49.965 INFO:tasks.rados.rados.2.smithi057.stdout:533: rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 69 2020-11-16T22:03:49.965 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 58 2020-11-16T22:03:49.965 INFO:tasks.rados.rados.2.smithi057.stdout:526: finishing write tid 6 to smithi05720651-10 2020-11-16T22:03:49.965 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 275 (ObjNum 204 snap 69 seq_num 204) dirty exists 2020-11-16T22:03:49.965 INFO:tasks.rados.rados.2.smithi057.stdout:526: left oid 10 (ObjNum 204 snap 69 seq_num 204) 2020-11-16T22:03:49.965 INFO:tasks.rados.rados.2.smithi057.stdout:527: finishing rollback tid 0 to smithi05720651-28 2020-11-16T22:03:49.966 INFO:tasks.rados.rados.2.smithi057.stdout:527: finishing rollback tid 1 to smithi05720651-28 2020-11-16T22:03:49.966 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 277 (ObjNum 353 snap 0 seq_num 1953066355) dirty dne 2020-11-16T22:03:49.966 INFO:tasks.rados.rados.2.smithi057.stdout:531: finishing copy_from to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:49.966 INFO:tasks.rados.rados.2.smithi057.stdout:531: got expected ENOENT (src dne) 2020-11-16T22:03:49.966 INFO:tasks.rados.rados.2.smithi057.stdout:531: finishing copy_from racing read to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:49.966 INFO:tasks.rados.rados.2.smithi057.stdout:526: done (4 left) 2020-11-16T22:03:49.966 INFO:tasks.rados.rados.2.smithi057.stdout:527: done (3 left) 2020-11-16T22:03:49.967 INFO:tasks.rados.rados.2.smithi057.stdout:530: done (2 left) 2020-11-16T22:03:49.967 INFO:tasks.rados.rados.2.smithi057.stdout:531: done (1 left) 2020-11-16T22:03:49.967 INFO:tasks.rados.rados.2.smithi057.stdout:534: snap_create 2020-11-16T22:03:49.972 INFO:tasks.rados.rados.2.smithi057.stdout:533: finishing rollback tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:49.973 INFO:tasks.rados.rados.2.smithi057.stdout:533: finishing rollback tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:49.973 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 354 (ObjNum 34 snap 0 seq_num 34) dirty exists 2020-11-16T22:03:50.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:49 smithi016 bash[10302]: cluster 2020-11-16T22:03:48.956513+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e203: 12 total, 12 up, 12 in 2020-11-16T22:03:50.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:49 smithi195 bash[10218]: cluster 2020-11-16T22:03:48.956513+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e203: 12 total, 12 up, 12 in 2020-11-16T22:03:50.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:49 smithi057 bash[10301]: cluster 2020-11-16T22:03:48.956513+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e203: 12 total, 12 up, 12 in 2020-11-16T22:03:50.974 INFO:tasks.rados.rados.2.smithi057.stdout:533: done (1 left) 2020-11-16T22:03:50.974 INFO:tasks.rados.rados.2.smithi057.stdout:534: done (0 left) 2020-11-16T22:03:50.975 INFO:tasks.rados.rados.2.smithi057.stdout:535: copy_from oid 10 from oid 34 current snap is 70 2020-11-16T22:03:50.975 INFO:tasks.rados.rados.2.smithi057.stdout:536: read oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:03:50.975 INFO:tasks.rados.rados.2.smithi057.stdout:536: expect (ObjNum 112 snap 34 seq_num 112) 2020-11-16T22:03:50.975 INFO:tasks.rados.rados.2.smithi057.stdout:537: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:03:50.975 INFO:tasks.rados.rados.2.smithi057.stdout:537: expect (ObjNum 150 snap 48 seq_num 150) 2020-11-16T22:03:50.975 INFO:tasks.rados.rados.2.smithi057.stdout:538: write (excl) oid 20 current snap is 70 2020-11-16T22:03:50.976 INFO:tasks.rados.rados.2.smithi057.stdout:538: seq_num 205 ranges {645435=451223,1879985=787072,3280184=165251} 2020-11-16T22:03:50.988 INFO:tasks.rados.rados.2.smithi057.stdout:538: writing smithi05720651-20 from 645435 to 1096658 tid 1 2020-11-16T22:03:50.999 INFO:tasks.rados.rados.2.smithi057.stdout:538: writing smithi05720651-20 from 1879985 to 2667057 tid 2 2020-11-16T22:03:51.003 INFO:tasks.rados.rados.2.smithi057.stdout:538: writing smithi05720651-20 from 3280184 to 3445435 tid 3 2020-11-16T22:03:51.003 INFO:tasks.rados.rados.2.smithi057.stdout:539: snap_remove snap 48 2020-11-16T22:03:51.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:50 smithi016 bash[10302]: cluster 2020-11-16T22:03:49.606235+0000 mgr.x (mgr.24115) 336 : cluster [DBG] pgmap v469: 17 pgs: 17 active+clean; 227 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.6 MiB/s wr, 4 op/s 2020-11-16T22:03:51.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:50 smithi016 bash[10302]: cluster 2020-11-16T22:03:49.974219+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e204: 12 total, 12 up, 12 in 2020-11-16T22:03:51.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:50 smithi195 bash[10218]: cluster 2020-11-16T22:03:49.606235+0000 mgr.x (mgr.24115) 336 : cluster [DBG] pgmap v469: 17 pgs: 17 active+clean; 227 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.6 MiB/s wr, 4 op/s 2020-11-16T22:03:51.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:50 smithi195 bash[10218]: cluster 2020-11-16T22:03:49.974219+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e204: 12 total, 12 up, 12 in 2020-11-16T22:03:51.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:50 smithi057 bash[10301]: cluster 2020-11-16T22:03:49.606235+0000 mgr.x (mgr.24115) 336 : cluster [DBG] pgmap v469: 17 pgs: 17 active+clean; 227 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.6 MiB/s wr, 4 op/s 2020-11-16T22:03:51.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:50 smithi057 bash[10301]: cluster 2020-11-16T22:03:49.974219+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e204: 12 total, 12 up, 12 in 2020-11-16T22:03:51.989 INFO:tasks.rados.rados.2.smithi057.stdout:539: done (4 left) 2020-11-16T22:03:51.990 INFO:tasks.rados.rados.2.smithi057.stdout:540: write oid 8 current snap is 70 2020-11-16T22:03:51.990 INFO:tasks.rados.rados.2.smithi057.stdout:540: seq_num 206 ranges {662242=642825,2054820=530730,3307607=154635} 2020-11-16T22:03:51.999 INFO:tasks.rados.rados.2.smithi057.stdout:540: writing smithi05720651-8 from 662242 to 1305067 tid 1 2020-11-16T22:03:52.007 INFO:tasks.rados.rados.2.smithi057.stdout:540: writing smithi05720651-8 from 2054820 to 2585550 tid 2 2020-11-16T22:03:52.012 INFO:tasks.rados.rados.2.smithi057.stdout:540: writing smithi05720651-8 from 3307607 to 3462242 tid 3 2020-11-16T22:03:52.012 INFO:tasks.rados.rados.2.smithi057.stdout:541: write oid 6 current snap is 70 2020-11-16T22:03:52.012 INFO:tasks.rados.rados.2.smithi057.stdout:541: seq_num 207 ranges {679049=718074,2113302=674388,3335030=144019} 2020-11-16T22:03:52.020 INFO:tasks.rados.rados.2.smithi057.stdout:541: writing smithi05720651-6 from 679049 to 1397123 tid 1 2020-11-16T22:03:52.028 INFO:tasks.rados.rados.2.smithi057.stdout:541: writing smithi05720651-6 from 2113302 to 2787690 tid 2 2020-11-16T22:03:52.032 INFO:tasks.rados.rados.2.smithi057.stdout:541: writing smithi05720651-6 from 3335030 to 3479049 tid 3 2020-11-16T22:03:52.033 INFO:tasks.rados.rados.2.smithi057.stdout:542: delete oid 24 current snap is 70 2020-11-16T22:03:52.033 INFO:tasks.rados.rados.2.smithi057.stdout:537: expect (ObjNum 150 snap 48 seq_num 150) 2020-11-16T22:03:52.116 INFO:tasks.rados.rados.2.smithi057.stdout:538: finishing write tid 1 to smithi05720651-20 2020-11-16T22:03:52.116 INFO:tasks.rados.rados.2.smithi057.stdout:535: finishing copy_from to smithi05720651-10 2020-11-16T22:03:52.117 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 81 (ObjNum 130 snap 37 seq_num 130) dirty exists 2020-11-16T22:03:52.117 INFO:tasks.rados.rados.2.smithi057.stdout:535: finishing copy_from racing read to smithi05720651-10 2020-11-16T22:03:52.117 INFO:tasks.rados.rados.2.smithi057.stdout:538: finishing write tid 2 to smithi05720651-20 2020-11-16T22:03:52.117 INFO:tasks.rados.rados.2.smithi057.stdout:538: finishing write tid 3 to smithi05720651-20 2020-11-16T22:03:52.117 INFO:tasks.rados.rados.2.smithi057.stdout:538: finishing write tid 5 to smithi05720651-20 2020-11-16T22:03:52.117 INFO:tasks.rados.rados.2.smithi057.stdout:538: finishing write tid 6 to smithi05720651-20 2020-11-16T22:03:52.117 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 260 (ObjNum 205 snap 70 seq_num 205) dirty exists 2020-11-16T22:03:52.118 INFO:tasks.rados.rados.2.smithi057.stdout:538: left oid 20 (ObjNum 205 snap 70 seq_num 205) 2020-11-16T22:03:52.118 INFO:tasks.rados.rados.2.smithi057.stdout:536: expect (ObjNum 112 snap 34 seq_num 112) 2020-11-16T22:03:52.238 INFO:tasks.rados.rados.2.smithi057.stdout:540: finishing write tid 1 to smithi05720651-8 2020-11-16T22:03:52.238 INFO:tasks.rados.rados.2.smithi057.stdout:540: finishing write tid 2 to smithi05720651-8 2020-11-16T22:03:52.239 INFO:tasks.rados.rados.2.smithi057.stdout:540: finishing write tid 3 to smithi05720651-8 2020-11-16T22:03:52.239 INFO:tasks.rados.rados.2.smithi057.stdout:540: finishing write tid 5 to smithi05720651-8 2020-11-16T22:03:52.239 INFO:tasks.rados.rados.2.smithi057.stdout:540: finishing write tid 6 to smithi05720651-8 2020-11-16T22:03:52.239 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 141 (ObjNum 206 snap 70 seq_num 206) dirty exists 2020-11-16T22:03:52.239 INFO:tasks.rados.rados.2.smithi057.stdout:540: left oid 8 (ObjNum 206 snap 70 seq_num 206) 2020-11-16T22:03:52.239 INFO:tasks.rados.rados.2.smithi057.stdout:541: finishing write tid 1 to smithi05720651-6 2020-11-16T22:03:52.240 INFO:tasks.rados.rados.2.smithi057.stdout:541: finishing write tid 2 to smithi05720651-6 2020-11-16T22:03:52.240 INFO:tasks.rados.rados.2.smithi057.stdout:541: finishing write tid 3 to smithi05720651-6 2020-11-16T22:03:52.240 INFO:tasks.rados.rados.2.smithi057.stdout:541: finishing write tid 5 to smithi05720651-6 2020-11-16T22:03:52.240 INFO:tasks.rados.rados.2.smithi057.stdout:541: finishing write tid 6 to smithi05720651-6 2020-11-16T22:03:52.240 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 379 (ObjNum 207 snap 70 seq_num 207) dirty exists 2020-11-16T22:03:52.240 INFO:tasks.rados.rados.2.smithi057.stdout:541: left oid 6 (ObjNum 207 snap 70 seq_num 207) 2020-11-16T22:03:52.240 INFO:tasks.rados.rados.2.smithi057.stdout:535: done (6 left) 2020-11-16T22:03:52.241 INFO:tasks.rados.rados.2.smithi057.stdout:536: done (5 left) 2020-11-16T22:03:52.241 INFO:tasks.rados.rados.2.smithi057.stdout:537: done (4 left) 2020-11-16T22:03:52.241 INFO:tasks.rados.rados.2.smithi057.stdout:538: done (3 left) 2020-11-16T22:03:52.241 INFO:tasks.rados.rados.2.smithi057.stdout:540: done (2 left) 2020-11-16T22:03:52.241 INFO:tasks.rados.rados.2.smithi057.stdout:541: done (1 left) 2020-11-16T22:03:52.241 INFO:tasks.rados.rados.2.smithi057.stdout:542: done (0 left) 2020-11-16T22:03:52.241 INFO:tasks.rados.rados.2.smithi057.stdout:543: delete oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 70 2020-11-16T22:03:52.243 INFO:tasks.rados.rados.2.smithi057.stdout:543: done (0 left) 2020-11-16T22:03:52.243 INFO:tasks.rados.rados.2.smithi057.stdout:544: write (excl) oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 70 2020-11-16T22:03:52.243 INFO:tasks.rados.rados.2.smithi057.stdout:544: seq_num 210 ranges {729470=543821,1772395=538068,2900946=403005} 2020-11-16T22:03:52.256 INFO:tasks.rados.rados.2.smithi057.stdout:544: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 729470 to 1273291 tid 1 2020-11-16T22:03:52.264 INFO:tasks.rados.rados.2.smithi057.stdout:544: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1772395 to 2310463 tid 2 2020-11-16T22:03:52.269 INFO:tasks.rados.rados.2.smithi057.stdout:544: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2900946 to 3303951 tid 3 2020-11-16T22:03:52.270 INFO:tasks.rados.rados.2.smithi057.stdout:545: snap_create 2020-11-16T22:03:52.270 INFO:tasks.rados.rados.2.smithi057.stdout:544: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:52.270 INFO:tasks.rados.rados.2.smithi057.stdout:544: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:52.274 INFO:tasks.rados.rados.2.smithi057.stdout:544: finishing write tid 3 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:52.275 INFO:tasks.rados.rados.2.smithi057.stdout:544: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:52.275 INFO:tasks.rados.rados.2.smithi057.stdout:544: finishing write tid 6 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:52.276 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 254 (ObjNum 210 snap 70 seq_num 210) dirty exists 2020-11-16T22:03:52.276 INFO:tasks.rados.rados.2.smithi057.stdout:544: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 210 snap 70 seq_num 210) 2020-11-16T22:03:52.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:51 smithi016 bash[10302]: cluster 2020-11-16T22:03:50.984359+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e205: 12 total, 12 up, 12 in 2020-11-16T22:03:52.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:51 smithi195 bash[10218]: cluster 2020-11-16T22:03:50.984359+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e205: 12 total, 12 up, 12 in 2020-11-16T22:03:52.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:51 smithi057 bash[10301]: cluster 2020-11-16T22:03:50.984359+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e205: 12 total, 12 up, 12 in 2020-11-16T22:03:52.994 INFO:tasks.rados.rados.2.smithi057.stdout:544: done (1 left) 2020-11-16T22:03:52.994 INFO:tasks.rados.rados.2.smithi057.stdout:545: done (0 left) 2020-11-16T22:03:52.994 INFO:tasks.rados.rados.2.smithi057.stdout:546: write (excl) oid 30 current snap is 71 2020-11-16T22:03:52.994 INFO:tasks.rados.rados.2.smithi057.stdout:546: seq_num 211 ranges {746277=619070,1830877=681726,2928369=617908} 2020-11-16T22:03:53.003 INFO:tasks.rados.rados.2.smithi057.stdout:546: writing smithi05720651-30 from 746277 to 1365347 tid 1 2020-11-16T22:03:53.010 INFO:tasks.rados.rados.2.smithi057.stdout:546: writing smithi05720651-30 from 1830877 to 2512603 tid 2 2020-11-16T22:03:53.016 INFO:tasks.rados.rados.2.smithi057.stdout:546: writing smithi05720651-30 from 2928369 to 3546277 tid 3 2020-11-16T22:03:53.017 INFO:tasks.rados.rados.2.smithi057.stdout:547: read oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:03:53.017 INFO:tasks.rados.rados.2.smithi057.stdout:547: expect (ObjNum 112 snap 34 seq_num 112) 2020-11-16T22:03:53.017 INFO:tasks.rados.rados.2.smithi057.stdout:548: delete oid 22 current snap is 71 2020-11-16T22:03:53.017 INFO:tasks.rados.rados.2.smithi057.stdout:546: finishing write tid 1 to smithi05720651-30 2020-11-16T22:03:53.017 INFO:tasks.rados.rados.2.smithi057.stdout:546: finishing write tid 2 to smithi05720651-30 2020-11-16T22:03:53.021 INFO:tasks.rados.rados.2.smithi057.stdout:548: done (2 left) 2020-11-16T22:03:53.021 INFO:tasks.rados.rados.2.smithi057.stdout:549: snap_create 2020-11-16T22:03:53.022 INFO:tasks.rados.rados.2.smithi057.stdout:546: finishing write tid 3 to smithi05720651-30 2020-11-16T22:03:53.022 INFO:tasks.rados.rados.2.smithi057.stdout:546: finishing write tid 5 to smithi05720651-30 2020-11-16T22:03:53.023 INFO:tasks.rados.rados.2.smithi057.stdout:546: finishing write tid 6 to smithi05720651-30 2020-11-16T22:03:53.023 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 363 (ObjNum 211 snap 71 seq_num 211) dirty exists 2020-11-16T22:03:53.023 INFO:tasks.rados.rados.2.smithi057.stdout:546: left oid 30 (ObjNum 211 snap 71 seq_num 211) 2020-11-16T22:03:53.030 INFO:tasks.rados.rados.2.smithi057.stdout:547: expect (ObjNum 112 snap 34 seq_num 112) 2020-11-16T22:03:53.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:52 smithi016 bash[10302]: cluster 2020-11-16T22:03:51.606889+0000 mgr.x (mgr.24115) 337 : cluster [DBG] pgmap v472: 17 pgs: 17 active+clean; 228 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.2 MiB/s wr, 5 op/s 2020-11-16T22:03:53.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:52 smithi016 bash[10302]: cluster 2020-11-16T22:03:51.994222+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e206: 12 total, 12 up, 12 in 2020-11-16T22:03:53.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:52 smithi195 bash[10218]: cluster 2020-11-16T22:03:51.606889+0000 mgr.x (mgr.24115) 337 : cluster [DBG] pgmap v472: 17 pgs: 17 active+clean; 228 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.2 MiB/s wr, 5 op/s 2020-11-16T22:03:53.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:52 smithi195 bash[10218]: cluster 2020-11-16T22:03:51.994222+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e206: 12 total, 12 up, 12 in 2020-11-16T22:03:53.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:52 smithi057 bash[10301]: cluster 2020-11-16T22:03:51.606889+0000 mgr.x (mgr.24115) 337 : cluster [DBG] pgmap v472: 17 pgs: 17 active+clean; 228 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.2 MiB/s wr, 5 op/s 2020-11-16T22:03:53.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:52 smithi057 bash[10301]: cluster 2020-11-16T22:03:51.994222+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e206: 12 total, 12 up, 12 in 2020-11-16T22:03:54.003 INFO:tasks.rados.rados.2.smithi057.stdout:546: done (2 left) 2020-11-16T22:03:54.003 INFO:tasks.rados.rados.2.smithi057.stdout:547: done (1 left) 2020-11-16T22:03:54.003 INFO:tasks.rados.rados.2.smithi057.stdout:549: done (0 left) 2020-11-16T22:03:54.003 INFO:tasks.rados.rados.2.smithi057.stdout:550: snap_create 2020-11-16T22:03:54.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:54 smithi016 bash[10302]: cluster 2020-11-16T22:03:53.004802+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e207: 12 total, 12 up, 12 in 2020-11-16T22:03:54.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:54 smithi195 bash[10218]: cluster 2020-11-16T22:03:53.004802+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e207: 12 total, 12 up, 12 in 2020-11-16T22:03:54.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:54 smithi057 bash[10301]: cluster 2020-11-16T22:03:53.004802+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e207: 12 total, 12 up, 12 in 2020-11-16T22:03:54.898 INFO:tasks.rados.rados.2.smithi057.stdout:550: done (0 left) 2020-11-16T22:03:54.898 INFO:tasks.rados.rados.2.smithi057.stdout:551: copy_from oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 36 current snap is 73 2020-11-16T22:03:54.899 INFO:tasks.rados.rados.2.smithi057.stdout:552: write (excl) oid 10 current snap is 73 2020-11-16T22:03:54.899 INFO:tasks.rados.rados.2.smithi057.stdout:552: seq_num 213 ranges {779891=485921,1947841=685395,3383215=196676} 2020-11-16T22:03:54.910 INFO:tasks.rados.rados.2.smithi057.stdout:552: writing smithi05720651-10 from 779891 to 1265812 tid 1 2020-11-16T22:03:54.918 INFO:tasks.rados.rados.2.smithi057.stdout:552: writing smithi05720651-10 from 1947841 to 2633236 tid 2 2020-11-16T22:03:54.924 INFO:tasks.rados.rados.2.smithi057.stdout:552: writing smithi05720651-10 from 3383215 to 3579891 tid 3 2020-11-16T22:03:54.924 INFO:tasks.rados.rados.2.smithi057.stdout:553: read oid 2 snap 60 2020-11-16T22:03:54.924 INFO:tasks.rados.rados.2.smithi057.stdout:553: expect deleted 2020-11-16T22:03:54.925 INFO:tasks.rados.rados.2.smithi057.stdout:554: snap_remove snap 63 2020-11-16T22:03:55.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:55 smithi016 bash[10302]: cluster 2020-11-16T22:03:53.607538+0000 mgr.x (mgr.24115) 338 : cluster [DBG] pgmap v475: 17 pgs: 17 active+clean; 229 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.6 MiB/s wr, 7 op/s 2020-11-16T22:03:55.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:55 smithi016 bash[10302]: cluster 2020-11-16T22:03:54.014285+0000 mon.a (mon.0) 847 : cluster [DBG] osdmap e208: 12 total, 12 up, 12 in 2020-11-16T22:03:55.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:55 smithi016 bash[10302]: cluster 2020-11-16T22:03:54.905342+0000 mon.a (mon.0) 848 : cluster [DBG] osdmap e209: 12 total, 12 up, 12 in 2020-11-16T22:03:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:55 smithi195 bash[10218]: cluster 2020-11-16T22:03:53.607538+0000 mgr.x (mgr.24115) 338 : cluster [DBG] pgmap v475: 17 pgs: 17 active+clean; 229 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.6 MiB/s wr, 7 op/s 2020-11-16T22:03:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:55 smithi195 bash[10218]: cluster 2020-11-16T22:03:54.014285+0000 mon.a (mon.0) 847 : cluster [DBG] osdmap e208: 12 total, 12 up, 12 in 2020-11-16T22:03:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:55 smithi195 bash[10218]: cluster 2020-11-16T22:03:54.905342+0000 mon.a (mon.0) 848 : cluster [DBG] osdmap e209: 12 total, 12 up, 12 in 2020-11-16T22:03:55.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:55 smithi057 bash[10301]: cluster 2020-11-16T22:03:53.607538+0000 mgr.x (mgr.24115) 338 : cluster [DBG] pgmap v475: 17 pgs: 17 active+clean; 229 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.6 MiB/s wr, 7 op/s 2020-11-16T22:03:55.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:55 smithi057 bash[10301]: cluster 2020-11-16T22:03:54.014285+0000 mon.a (mon.0) 847 : cluster [DBG] osdmap e208: 12 total, 12 up, 12 in 2020-11-16T22:03:55.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:55 smithi057 bash[10301]: cluster 2020-11-16T22:03:54.905342+0000 mon.a (mon.0) 848 : cluster [DBG] osdmap e209: 12 total, 12 up, 12 in 2020-11-16T22:03:55.909 INFO:tasks.rados.rados.2.smithi057.stdout:554: done (3 left) 2020-11-16T22:03:55.909 INFO:tasks.rados.rados.2.smithi057.stdout:555: snap_remove snap 58 2020-11-16T22:03:56.919 INFO:tasks.rados.rados.2.smithi057.stdout:555: done (3 left) 2020-11-16T22:03:56.919 INFO:tasks.rados.rados.2.smithi057.stdout:556: delete oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 73 2020-11-16T22:03:56.919 INFO:tasks.rados.rados.2.smithi057.stdout:552: finishing write tid 1 to smithi05720651-10 2020-11-16T22:03:56.919 INFO:tasks.rados.rados.2.smithi057.stdout:552: finishing write tid 2 to smithi05720651-10 2020-11-16T22:03:56.919 INFO:tasks.rados.rados.2.smithi057.stdout:552: finishing write tid 3 to smithi05720651-10 2020-11-16T22:03:56.920 INFO:tasks.rados.rados.2.smithi057.stdout:552: finishing write tid 5 to smithi05720651-10 2020-11-16T22:03:56.920 INFO:tasks.rados.rados.2.smithi057.stdout:551: finishing copy_from to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:56.920 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 249 (ObjNum 200 snap 67 seq_num 200) dirty exists 2020-11-16T22:03:56.920 INFO:tasks.rados.rados.2.smithi057.stdout:552: finishing write tid 6 to smithi05720651-10 2020-11-16T22:03:56.920 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 304 (ObjNum 213 snap 73 seq_num 213) dirty exists 2020-11-16T22:03:56.920 INFO:tasks.rados.rados.2.smithi057.stdout:552: left oid 10 (ObjNum 213 snap 73 seq_num 213) 2020-11-16T22:03:56.920 INFO:tasks.rados.rados.2.smithi057.stdout:551: finishing copy_from racing read to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:56.930 INFO:tasks.rados.rados.2.smithi057.stdout:551: done (3 left) 2020-11-16T22:03:56.930 INFO:tasks.rados.rados.2.smithi057.stdout:552: done (2 left) 2020-11-16T22:03:56.931 INFO:tasks.rados.rados.2.smithi057.stdout:553: done (1 left) 2020-11-16T22:03:56.931 INFO:tasks.rados.rados.2.smithi057.stdout:556: done (0 left) 2020-11-16T22:03:56.931 INFO:tasks.rados.rados.2.smithi057.stdout:557: read oid 42 snap 64 2020-11-16T22:03:56.931 INFO:tasks.rados.rados.2.smithi057.stdout:557: expect deleted 2020-11-16T22:03:56.931 INFO:tasks.rados.rados.2.smithi057.stdout:558: read oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:03:56.931 INFO:tasks.rados.rados.2.smithi057.stdout:558: expect (ObjNum 194 snap 64 seq_num 194) 2020-11-16T22:03:56.931 INFO:tasks.rados.rados.2.smithi057.stdout:559: copy_from oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 4 current snap is 73 2020-11-16T22:03:56.932 INFO:tasks.rados.rados.2.smithi057.stdout:560: write (excl) oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 73 2020-11-16T22:03:56.932 INFO:tasks.rados.rados.2.smithi057.stdout:560: seq_num 215 ranges {413505=636419,1664805=689064,3038061=492071} 2020-11-16T22:03:56.939 INFO:tasks.rados.rados.2.smithi057.stdout:560: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 413505 to 1049924 tid 1 2020-11-16T22:03:56.949 INFO:tasks.rados.rados.2.smithi057.stdout:560: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1664805 to 2353869 tid 2 2020-11-16T22:03:56.956 INFO:tasks.rados.rados.2.smithi057.stdout:560: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3038061 to 3530132 tid 3 2020-11-16T22:03:56.956 INFO:tasks.rados.rados.2.smithi057.stdout:561: write oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 73 2020-11-16T22:03:56.956 INFO:tasks.rados.rados.2.smithi057.stdout:561: seq_num 216 ranges {430312=711668,1723287=549075,2781837=703343} 2020-11-16T22:03:56.963 INFO:tasks.rados.rados.2.smithi057.stdout:561: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 430312 to 1141980 tid 1 2020-11-16T22:03:56.969 INFO:tasks.rados.rados.2.smithi057.stdout:561: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1723287 to 2272362 tid 2 2020-11-16T22:03:56.976 INFO:tasks.rados.rados.2.smithi057.stdout:561: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2781837 to 3485180 tid 3 2020-11-16T22:03:56.977 INFO:tasks.rados.rados.2.smithi057.stdout:562: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 64 2020-11-16T22:03:56.977 INFO:tasks.rados.rados.2.smithi057.stdout:562: expect (ObjNum 162 snap 56 seq_num 162) 2020-11-16T22:03:56.977 INFO:tasks.rados.rados.2.smithi057.stdout:563: snap_create 2020-11-16T22:03:56.977 INFO:tasks.rados.rados.2.smithi057.stdout:560: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:56.977 INFO:tasks.rados.rados.2.smithi057.stdout:558: expect (ObjNum 194 snap 64 seq_num 194) 2020-11-16T22:03:57.172 INFO:tasks.rados.rados.2.smithi057.stdout:560: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:57.172 INFO:tasks.rados.rados.2.smithi057.stdout:560: finishing write tid 3 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:57.172 INFO:tasks.rados.rados.2.smithi057.stdout:560: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:57.172 INFO:tasks.rados.rados.2.smithi057.stdout:560: finishing write tid 6 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:57.173 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 27 (ObjNum 215 snap 73 seq_num 215) dirty exists 2020-11-16T22:03:57.173 INFO:tasks.rados.rados.2.smithi057.stdout:560: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 215 snap 73 seq_num 215) 2020-11-16T22:03:57.173 INFO:tasks.rados.rados.2.smithi057.stdout:559: finishing copy_from to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:57.173 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 114 (ObjNum 175 snap 59 seq_num 175) dirty exists 2020-11-16T22:03:57.173 INFO:tasks.rados.rados.2.smithi057.stdout:559: finishing copy_from racing read to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:57.173 INFO:tasks.rados.rados.2.smithi057.stdout:561: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:57.173 INFO:tasks.rados.rados.2.smithi057.stdout:561: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:57.174 INFO:tasks.rados.rados.2.smithi057.stdout:561: finishing write tid 3 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:57.174 INFO:tasks.rados.rados.2.smithi057.stdout:561: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:57.174 INFO:tasks.rados.rados.2.smithi057.stdout:561: finishing write tid 6 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:57.174 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 190 (ObjNum 216 snap 73 seq_num 216) dirty exists 2020-11-16T22:03:57.174 INFO:tasks.rados.rados.2.smithi057.stdout:561: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 216 snap 73 seq_num 216) 2020-11-16T22:03:57.174 INFO:tasks.rados.rados.2.smithi057.stdout:562: expect (ObjNum 162 snap 56 seq_num 162) 2020-11-16T22:03:57.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:56 smithi057 bash[10301]: cluster 2020-11-16T22:03:55.608261+0000 mgr.x (mgr.24115) 339 : cluster [DBG] pgmap v478: 17 pgs: 17 active+clean; 239 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.3 MiB/s wr, 11 op/s 2020-11-16T22:03:57.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:56 smithi057 bash[10301]: cluster 2020-11-16T22:03:55.918995+0000 mon.a (mon.0) 849 : cluster [DBG] osdmap e210: 12 total, 12 up, 12 in 2020-11-16T22:03:57.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:56 smithi016 bash[10302]: cluster 2020-11-16T22:03:55.608261+0000 mgr.x (mgr.24115) 339 : cluster [DBG] pgmap v478: 17 pgs: 17 active+clean; 239 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.3 MiB/s wr, 11 op/s 2020-11-16T22:03:57.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:56 smithi016 bash[10302]: cluster 2020-11-16T22:03:55.918995+0000 mon.a (mon.0) 849 : cluster [DBG] osdmap e210: 12 total, 12 up, 12 in 2020-11-16T22:03:57.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:56 smithi195 bash[10218]: cluster 2020-11-16T22:03:55.608261+0000 mgr.x (mgr.24115) 339 : cluster [DBG] pgmap v478: 17 pgs: 17 active+clean; 239 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.3 MiB/s wr, 11 op/s 2020-11-16T22:03:57.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:56 smithi195 bash[10218]: cluster 2020-11-16T22:03:55.918995+0000 mon.a (mon.0) 849 : cluster [DBG] osdmap e210: 12 total, 12 up, 12 in 2020-11-16T22:03:57.937 INFO:tasks.rados.rados.2.smithi057.stdout:557: done (6 left) 2020-11-16T22:03:57.938 INFO:tasks.rados.rados.2.smithi057.stdout:558: done (5 left) 2020-11-16T22:03:57.938 INFO:tasks.rados.rados.2.smithi057.stdout:559: done (4 left) 2020-11-16T22:03:57.938 INFO:tasks.rados.rados.2.smithi057.stdout:560: done (3 left) 2020-11-16T22:03:57.938 INFO:tasks.rados.rados.2.smithi057.stdout:561: done (2 left) 2020-11-16T22:03:57.938 INFO:tasks.rados.rados.2.smithi057.stdout:562: done (1 left) 2020-11-16T22:03:57.938 INFO:tasks.rados.rados.2.smithi057.stdout:563: done (0 left) 2020-11-16T22:03:57.939 INFO:tasks.rados.rados.2.smithi057.stdout:564: snap_create 2020-11-16T22:03:58.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:57 smithi057 bash[10301]: cluster 2020-11-16T22:03:56.920884+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e211: 12 total, 12 up, 12 in 2020-11-16T22:03:58.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:57 smithi016 bash[10302]: cluster 2020-11-16T22:03:56.920884+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e211: 12 total, 12 up, 12 in 2020-11-16T22:03:58.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:57 smithi195 bash[10218]: cluster 2020-11-16T22:03:56.920884+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e211: 12 total, 12 up, 12 in 2020-11-16T22:03:58.940 INFO:tasks.rados.rados.2.smithi057.stdout:564: done (0 left) 2020-11-16T22:03:58.941 INFO:tasks.rados.rados.2.smithi057.stdout:565: write (excl) oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 75 2020-11-16T22:03:58.941 INFO:tasks.rados.rados.2.smithi057.stdout:565: seq_num 217 ranges {447119=786917,1665416=692733,2976554=514615} 2020-11-16T22:03:58.953 INFO:tasks.rados.rados.2.smithi057.stdout:565: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 447119 to 1234036 tid 1 2020-11-16T22:03:58.960 INFO:tasks.rados.rados.2.smithi057.stdout:565: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1665416 to 2358149 tid 2 2020-11-16T22:03:58.967 INFO:tasks.rados.rados.2.smithi057.stdout:565: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2976554 to 3491169 tid 3 2020-11-16T22:03:58.967 INFO:tasks.rados.rados.2.smithi057.stdout:566: delete oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 75 2020-11-16T22:03:58.967 INFO:tasks.rados.rados.2.smithi057.stdout:565: finishing write tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:58.972 INFO:tasks.rados.rados.2.smithi057.stdout:566: done (1 left) 2020-11-16T22:03:58.972 INFO:tasks.rados.rados.2.smithi057.stdout:567: snap_remove snap 39 2020-11-16T22:03:59.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:58 smithi057 bash[10301]: cluster 2020-11-16T22:03:57.608935+0000 mgr.x (mgr.24115) 340 : cluster [DBG] pgmap v481: 17 pgs: 17 active+clean; 244 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.8 MiB/s wr, 14 op/s 2020-11-16T22:03:59.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:58 smithi057 bash[10301]: cluster 2020-11-16T22:03:57.946257+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e212: 12 total, 12 up, 12 in 2020-11-16T22:03:59.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:58 smithi016 bash[10302]: cluster 2020-11-16T22:03:57.608935+0000 mgr.x (mgr.24115) 340 : cluster [DBG] pgmap v481: 17 pgs: 17 active+clean; 244 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.8 MiB/s wr, 14 op/s 2020-11-16T22:03:59.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:58 smithi016 bash[10302]: cluster 2020-11-16T22:03:57.946257+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e212: 12 total, 12 up, 12 in 2020-11-16T22:03:59.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:58 smithi195 bash[10218]: cluster 2020-11-16T22:03:57.608935+0000 mgr.x (mgr.24115) 340 : cluster [DBG] pgmap v481: 17 pgs: 17 active+clean; 244 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.8 MiB/s wr, 14 op/s 2020-11-16T22:03:59.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:58 smithi195 bash[10218]: cluster 2020-11-16T22:03:57.946257+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e212: 12 total, 12 up, 12 in 2020-11-16T22:03:59.901 INFO:tasks.rados.rados.2.smithi057.stdout:567: done (1 left) 2020-11-16T22:03:59.902 INFO:tasks.rados.rados.2.smithi057.stdout:568: read oid 26 snap -1 2020-11-16T22:03:59.902 INFO:tasks.rados.rados.2.smithi057.stdout:568: expect (ObjNum 188 snap 64 seq_num 188) 2020-11-16T22:03:59.902 INFO:tasks.rados.rados.2.smithi057.stdout:569: write (excl) oid 16 current snap is 75 2020-11-16T22:03:59.902 INFO:tasks.rados.rados.2.smithi057.stdout:569: seq_num 219 ranges {480733=537415,1782380=696402,3031400=537159} 2020-11-16T22:03:59.913 INFO:tasks.rados.rados.2.smithi057.stdout:569: writing smithi05720651-16 from 480733 to 1018148 tid 1 2020-11-16T22:03:59.916 INFO:tasks.rados.rados.2.smithi057.stdout:569: writing smithi05720651-16 from 1782380 to 2478782 tid 2 2020-11-16T22:03:59.923 INFO:tasks.rados.rados.2.smithi057.stdout:569: writing smithi05720651-16 from 3031400 to 3568559 tid 3 2020-11-16T22:03:59.924 INFO:tasks.rados.rados.2.smithi057.stdout:570: snap_create 2020-11-16T22:03:59.924 INFO:tasks.rados.rados.2.smithi057.stdout:565: finishing write tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:59.924 INFO:tasks.rados.rados.2.smithi057.stdout:565: finishing write tid 3 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:03:59.924 INFO:tasks.rados.rados.2.smithi057.stdout:569: finishing write tid 1 to smithi05720651-16 2020-11-16T22:03:59.924 INFO:tasks.rados.rados.2.smithi057.stdout:568: expect (ObjNum 188 snap 64 seq_num 188) 2020-11-16T22:04:00.135 INFO:tasks.rados.rados.2.smithi057.stdout:565: finishing write tid 5 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:00.135 INFO:tasks.rados.rados.2.smithi057.stdout:565: finishing write tid 6 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:00.135 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 502 (ObjNum 217 snap 75 seq_num 217) dirty exists 2020-11-16T22:04:00.135 INFO:tasks.rados.rados.2.smithi057.stdout:565: left oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 217 snap 75 seq_num 217) 2020-11-16T22:04:00.135 INFO:tasks.rados.rados.2.smithi057.stdout:569: finishing write tid 2 to smithi05720651-16 2020-11-16T22:04:00.136 INFO:tasks.rados.rados.2.smithi057.stdout:569: finishing write tid 3 to smithi05720651-16 2020-11-16T22:04:00.136 INFO:tasks.rados.rados.2.smithi057.stdout:569: finishing write tid 5 to smithi05720651-16 2020-11-16T22:04:00.136 INFO:tasks.rados.rados.2.smithi057.stdout:569: finishing write tid 6 to smithi05720651-16 2020-11-16T22:04:00.136 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 385 (ObjNum 219 snap 75 seq_num 219) dirty exists 2020-11-16T22:04:00.136 INFO:tasks.rados.rados.2.smithi057.stdout:569: left oid 16 (ObjNum 219 snap 75 seq_num 219) 2020-11-16T22:04:00.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:59 smithi057 bash[10301]: cluster 2020-11-16T22:03:58.949500+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e213: 12 total, 12 up, 12 in 2020-11-16T22:04:00.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:03:59 smithi057 bash[10301]: cluster 2020-11-16T22:03:59.908573+0000 mon.a (mon.0) 853 : cluster [DBG] osdmap e214: 12 total, 12 up, 12 in 2020-11-16T22:04:00.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:59 smithi016 bash[10302]: cluster 2020-11-16T22:03:58.949500+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e213: 12 total, 12 up, 12 in 2020-11-16T22:04:00.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:03:59 smithi016 bash[10302]: cluster 2020-11-16T22:03:59.908573+0000 mon.a (mon.0) 853 : cluster [DBG] osdmap e214: 12 total, 12 up, 12 in 2020-11-16T22:04:00.349 INFO:journalctl@ceph.osd.2.smithi195.stdout:Nov 16 22:04:00 smithi195 bash[21024]: debug 2020-11-16T22:04:00.006+0000 7f3c15f2f700 -1 osd.2 pg_epoch: 214 pg[2.e( v 214'115 (0'0,214'115] local-lis/les=71/72 n=4 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [2,3] r=0 lpr=71 luod=211'113 crt=214'115 lcod 210'111 mlcod 210'111 active+clean+snaptrim trimq=[4b~1] ps=[67~1,70~1]] removing snap head 2020-11-16T22:04:00.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:59 smithi195 bash[10218]: cluster 2020-11-16T22:03:58.949500+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e213: 12 total, 12 up, 12 in 2020-11-16T22:04:00.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:03:59 smithi195 bash[10218]: cluster 2020-11-16T22:03:59.908573+0000 mon.a (mon.0) 853 : cluster [DBG] osdmap e214: 12 total, 12 up, 12 in 2020-11-16T22:04:00.912 INFO:tasks.rados.rados.2.smithi057.stdout:565: done (3 left) 2020-11-16T22:04:00.913 INFO:tasks.rados.rados.2.smithi057.stdout:568: done (2 left) 2020-11-16T22:04:00.913 INFO:tasks.rados.rados.2.smithi057.stdout:569: done (1 left) 2020-11-16T22:04:00.913 INFO:tasks.rados.rados.2.smithi057.stdout:570: done (0 left) 2020-11-16T22:04:00.913 INFO:tasks.rados.rados.2.smithi057.stdout:571: read oid 20 snap 44 2020-11-16T22:04:00.913 INFO:tasks.rados.rados.2.smithi057.stdout:571: expect deleted 2020-11-16T22:04:00.913 INFO:tasks.rados.rados.2.smithi057.stdout:572: snap_remove snap 75 2020-11-16T22:04:01.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:00 smithi016 bash[10302]: cluster 2020-11-16T22:03:59.609637+0000 mgr.x (mgr.24115) 341 : cluster [DBG] pgmap v484: 17 pgs: 17 active+clean; 244 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 831 KiB/s wr, 3 op/s 2020-11-16T22:04:01.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:00 smithi016 bash[10302]: cluster 2020-11-16T22:04:00.921767+0000 mon.a (mon.0) 854 : cluster [DBG] osdmap e215: 12 total, 12 up, 12 in 2020-11-16T22:04:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:00 smithi195 bash[10218]: cluster 2020-11-16T22:03:59.609637+0000 mgr.x (mgr.24115) 341 : cluster [DBG] pgmap v484: 17 pgs: 17 active+clean; 244 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 831 KiB/s wr, 3 op/s 2020-11-16T22:04:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:00 smithi195 bash[10218]: cluster 2020-11-16T22:04:00.921767+0000 mon.a (mon.0) 854 : cluster [DBG] osdmap e215: 12 total, 12 up, 12 in 2020-11-16T22:04:01.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:00 smithi057 bash[10301]: cluster 2020-11-16T22:03:59.609637+0000 mgr.x (mgr.24115) 341 : cluster [DBG] pgmap v484: 17 pgs: 17 active+clean; 244 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 831 KiB/s wr, 3 op/s 2020-11-16T22:04:01.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:00 smithi057 bash[10301]: cluster 2020-11-16T22:04:00.921767+0000 mon.a (mon.0) 854 : cluster [DBG] osdmap e215: 12 total, 12 up, 12 in 2020-11-16T22:04:01.913 INFO:tasks.rados.rados.2.smithi057.stdout:572: done (1 left) 2020-11-16T22:04:01.914 INFO:tasks.rados.rados.2.smithi057.stdout:573: write oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 76 2020-11-16T22:04:01.914 INFO:tasks.rados.rados.2.smithi057.stdout:573: seq_num 220 ranges {497540=612664,1840862=440060,3058823=464784} 2020-11-16T22:04:01.925 INFO:tasks.rados.rados.2.smithi057.stdout:573: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 497540 to 1110204 tid 1 2020-11-16T22:04:01.932 INFO:tasks.rados.rados.2.smithi057.stdout:573: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1840862 to 2280922 tid 2 2020-11-16T22:04:01.939 INFO:tasks.rados.rados.2.smithi057.stdout:573: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3058823 to 3523607 tid 3 2020-11-16T22:04:01.939 INFO:tasks.rados.rados.2.smithi057.stdout:574: write (excl) oid 24 current snap is 76 2020-11-16T22:04:01.939 INFO:tasks.rados.rados.2.smithi057.stdout:574: seq_num 221 ranges {514347=404266,1499344=700071,2686246=676056} 2020-11-16T22:04:01.944 INFO:tasks.rados.rados.2.smithi057.stdout:574: writing smithi05720651-24 from 514347 to 918613 tid 1 2020-11-16T22:04:01.951 INFO:tasks.rados.rados.2.smithi057.stdout:574: writing smithi05720651-24 from 1499344 to 2199415 tid 2 2020-11-16T22:04:01.958 INFO:tasks.rados.rados.2.smithi057.stdout:574: writing smithi05720651-24 from 2686246 to 3362302 tid 3 2020-11-16T22:04:01.958 INFO:tasks.rados.rados.2.smithi057.stdout:575: snap_remove snap 71 2020-11-16T22:04:02.965 INFO:tasks.rados.rados.2.smithi057.stdout:575: done (3 left) 2020-11-16T22:04:02.966 INFO:tasks.rados.rados.2.smithi057.stdout:576: rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 76 2020-11-16T22:04:02.966 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 72 2020-11-16T22:04:02.966 INFO:tasks.rados.rados.2.smithi057.stdout:573: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:02.966 INFO:tasks.rados.rados.2.smithi057.stdout:573: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:02.966 INFO:tasks.rados.rados.2.smithi057.stdout:573: finishing write tid 3 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:02.967 INFO:tasks.rados.rados.2.smithi057.stdout:573: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:02.967 INFO:tasks.rados.rados.2.smithi057.stdout:573: finishing write tid 6 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:02.967 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 259 (ObjNum 220 snap 76 seq_num 220) dirty exists 2020-11-16T22:04:02.967 INFO:tasks.rados.rados.2.smithi057.stdout:573: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 220 snap 76 seq_num 220) 2020-11-16T22:04:02.967 INFO:tasks.rados.rados.2.smithi057.stdout:574: finishing write tid 1 to smithi05720651-24 2020-11-16T22:04:02.967 INFO:tasks.rados.rados.2.smithi057.stdout:574: finishing write tid 2 to smithi05720651-24 2020-11-16T22:04:02.967 INFO:tasks.rados.rados.2.smithi057.stdout:574: finishing write tid 3 to smithi05720651-24 2020-11-16T22:04:02.968 INFO:tasks.rados.rados.2.smithi057.stdout:574: finishing write tid 5 to smithi05720651-24 2020-11-16T22:04:02.968 INFO:tasks.rados.rados.2.smithi057.stdout:574: finishing write tid 6 to smithi05720651-24 2020-11-16T22:04:02.968 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 145 (ObjNum 221 snap 76 seq_num 221) dirty exists 2020-11-16T22:04:02.968 INFO:tasks.rados.rados.2.smithi057.stdout:574: left oid 24 (ObjNum 221 snap 76 seq_num 221) 2020-11-16T22:04:02.968 INFO:tasks.rados.rados.2.smithi057.stdout:571: done (3 left) 2020-11-16T22:04:02.968 INFO:tasks.rados.rados.2.smithi057.stdout:573: done (2 left) 2020-11-16T22:04:02.968 INFO:tasks.rados.rados.2.smithi057.stdout:574: done (1 left) 2020-11-16T22:04:02.968 INFO:tasks.rados.rados.2.smithi057.stdout:577: snap_remove snap 44 2020-11-16T22:04:03.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:02 smithi057 bash[10301]: cluster 2020-11-16T22:04:01.610342+0000 mgr.x (mgr.24115) 342 : cluster [DBG] pgmap v487: 17 pgs: 17 active+clean; 248 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2020-11-16T22:04:03.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:02 smithi057 bash[10301]: cluster 2020-11-16T22:04:01.924397+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e216: 12 total, 12 up, 12 in 2020-11-16T22:04:03.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:02 smithi016 bash[10302]: cluster 2020-11-16T22:04:01.610342+0000 mgr.x (mgr.24115) 342 : cluster [DBG] pgmap v487: 17 pgs: 17 active+clean; 248 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2020-11-16T22:04:03.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:02 smithi016 bash[10302]: cluster 2020-11-16T22:04:01.924397+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e216: 12 total, 12 up, 12 in 2020-11-16T22:04:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:02 smithi195 bash[10218]: cluster 2020-11-16T22:04:01.610342+0000 mgr.x (mgr.24115) 342 : cluster [DBG] pgmap v487: 17 pgs: 17 active+clean; 248 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2020-11-16T22:04:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:02 smithi195 bash[10218]: cluster 2020-11-16T22:04:01.924397+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e216: 12 total, 12 up, 12 in 2020-11-16T22:04:03.975 INFO:tasks.rados.rados.2.smithi057.stdout:577: done (1 left) 2020-11-16T22:04:03.975 INFO:tasks.rados.rados.2.smithi057.stdout:578: snap_create 2020-11-16T22:04:03.975 INFO:tasks.rados.rados.2.smithi057.stdout:576: finishing rollback tid 0 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:03.975 INFO:tasks.rados.rados.2.smithi057.stdout:576: finishing rollback tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:03.976 INFO:tasks.rados.rados.2.smithi057.stdout:576: finishing rollback tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:03.976 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 193 (ObjNum 137 snap 39 seq_num 137) dirty exists 2020-11-16T22:04:04.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:03 smithi016 bash[10302]: cluster 2020-11-16T22:04:02.974481+0000 mon.a (mon.0) 856 : cluster [DBG] osdmap e217: 12 total, 12 up, 12 in 2020-11-16T22:04:04.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:03 smithi195 bash[10218]: cluster 2020-11-16T22:04:02.974481+0000 mon.a (mon.0) 856 : cluster [DBG] osdmap e217: 12 total, 12 up, 12 in 2020-11-16T22:04:04.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:03 smithi057 bash[10301]: cluster 2020-11-16T22:04:02.974481+0000 mon.a (mon.0) 856 : cluster [DBG] osdmap e217: 12 total, 12 up, 12 in 2020-11-16T22:04:04.903 INFO:tasks.rados.rados.2.smithi057.stdout:576: done (1 left) 2020-11-16T22:04:04.903 INFO:tasks.rados.rados.2.smithi057.stdout:578: done (0 left) 2020-11-16T22:04:04.903 INFO:tasks.rados.rados.2.smithi057.stdout:579: write (excl) oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 77 2020-11-16T22:04:04.903 INFO:tasks.rados.rados.2.smithi057.stdout:579: seq_num 222 ranges {531154=479515,1557826=443729,2713669=487328,3679295=51859} 2020-11-16T22:04:04.913 INFO:tasks.rados.rados.2.smithi057.stdout:579: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 531154 to 1010669 tid 1 2020-11-16T22:04:04.920 INFO:tasks.rados.rados.2.smithi057.stdout:579: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1557826 to 2001555 tid 2 2020-11-16T22:04:04.927 INFO:tasks.rados.rados.2.smithi057.stdout:579: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2713669 to 3200997 tid 3 2020-11-16T22:04:04.930 INFO:tasks.rados.rados.2.smithi057.stdout:579: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3679295 to 3731154 tid 4 2020-11-16T22:04:04.931 INFO:tasks.rados.rados.2.smithi057.stdout:580: copy_from oid 22 from oid 40 current snap is 77 2020-11-16T22:04:04.931 INFO:tasks.rados.rados.2.smithi057.stdout:579: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:04.931 INFO:tasks.rados.rados.2.smithi057.stdout:579: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:04.931 INFO:tasks.rados.rados.2.smithi057.stdout:581: write (excl) oid 28 current snap is 77 2020-11-16T22:04:04.931 INFO:tasks.rados.rados.2.smithi057.stdout:581: seq_num 223 ranges {547961=554764,1616308=703740,2741092=698600} 2020-11-16T22:04:04.937 INFO:tasks.rados.rados.2.smithi057.stdout:581: writing smithi05720651-28 from 547961 to 1102725 tid 1 2020-11-16T22:04:04.943 INFO:tasks.rados.rados.2.smithi057.stdout:581: writing smithi05720651-28 from 1616308 to 2320048 tid 2 2020-11-16T22:04:04.951 INFO:tasks.rados.rados.2.smithi057.stdout:581: writing smithi05720651-28 from 2741092 to 3439692 tid 3 2020-11-16T22:04:04.951 INFO:tasks.rados.rados.2.smithi057.stdout:582: rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 77 2020-11-16T22:04:04.951 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 74 2020-11-16T22:04:04.951 INFO:tasks.rados.rados.2.smithi057.stdout:579: finishing write tid 3 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:04.952 INFO:tasks.rados.rados.2.smithi057.stdout:579: finishing write tid 4 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:04.952 INFO:tasks.rados.rados.2.smithi057.stdout:579: finishing write tid 6 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:04.952 INFO:tasks.rados.rados.2.smithi057.stdout:579: finishing write tid 7 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:04.952 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 423 (ObjNum 222 snap 77 seq_num 222) dirty exists 2020-11-16T22:04:04.952 INFO:tasks.rados.rados.2.smithi057.stdout:579: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 222 snap 77 seq_num 222) 2020-11-16T22:04:04.952 INFO:tasks.rados.rados.2.smithi057.stdout:581: finishing write tid 1 to smithi05720651-28 2020-11-16T22:04:04.952 INFO:tasks.rados.rados.2.smithi057.stdout:581: finishing write tid 2 to smithi05720651-28 2020-11-16T22:04:04.953 INFO:tasks.rados.rados.2.smithi057.stdout:579: done (3 left) 2020-11-16T22:04:04.953 INFO:tasks.rados.rados.2.smithi057.stdout:583: read oid 16 snap 74 2020-11-16T22:04:04.953 INFO:tasks.rados.rados.2.smithi057.stdout:583: expect (ObjNum 152 snap 51 seq_num 152) 2020-11-16T22:04:04.953 INFO:tasks.rados.rados.2.smithi057.stdout:584: read oid 50 snap -1 2020-11-16T22:04:04.953 INFO:tasks.rados.rados.2.smithi057.stdout:584: expect deleted 2020-11-16T22:04:04.953 INFO:tasks.rados.rados.2.smithi057.stdout:585: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:04.953 INFO:tasks.rados.rados.2.smithi057.stdout:585: expect (ObjNum 222 snap 77 seq_num 222) 2020-11-16T22:04:04.953 INFO:tasks.rados.rados.2.smithi057.stdout:586: delete oid 20 current snap is 77 2020-11-16T22:04:04.954 INFO:tasks.rados.rados.2.smithi057.stdout:580: finishing copy_from to smithi05720651-22 2020-11-16T22:04:04.954 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 81 (ObjNum 130 snap 37 seq_num 130) dirty exists 2020-11-16T22:04:04.955 INFO:tasks.rados.rados.2.smithi057.stdout:580: finishing copy_from racing read to smithi05720651-22 2020-11-16T22:04:04.955 INFO:tasks.rados.rados.2.smithi057.stdout:582: finishing rollback tid 0 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:04.956 INFO:tasks.rados.rados.2.smithi057.stdout:582: finishing rollback tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:04.956 INFO:tasks.rados.rados.2.smithi057.stdout:582: finishing rollback tid 2 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:04.957 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 155 (ObjNum 191 snap 64 seq_num 191) dirty exists 2020-11-16T22:04:04.957 INFO:tasks.rados.rados.2.smithi057.stdout:581: finishing write tid 3 to smithi05720651-28 2020-11-16T22:04:04.957 INFO:tasks.rados.rados.2.smithi057.stdout:581: finishing write tid 5 to smithi05720651-28 2020-11-16T22:04:04.957 INFO:tasks.rados.rados.2.smithi057.stdout:581: finishing write tid 6 to smithi05720651-28 2020-11-16T22:04:04.957 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 334 (ObjNum 223 snap 77 seq_num 223) dirty exists 2020-11-16T22:04:04.958 INFO:tasks.rados.rados.2.smithi057.stdout:581: left oid 28 (ObjNum 223 snap 77 seq_num 223) 2020-11-16T22:04:04.964 INFO:tasks.rados.rados.2.smithi057.stdout:580: done (6 left) 2020-11-16T22:04:04.964 INFO:tasks.rados.rados.2.smithi057.stdout:581: done (5 left) 2020-11-16T22:04:04.964 INFO:tasks.rados.rados.2.smithi057.stdout:582: done (4 left) 2020-11-16T22:04:04.964 INFO:tasks.rados.rados.2.smithi057.stdout:584: done (3 left) 2020-11-16T22:04:04.964 INFO:tasks.rados.rados.2.smithi057.stdout:586: done (2 left) 2020-11-16T22:04:04.964 INFO:tasks.rados.rados.2.smithi057.stdout:587: rollback oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 77 2020-11-16T22:04:04.965 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 69 2020-11-16T22:04:04.965 INFO:tasks.rados.rados.2.smithi057.stdout:588: read oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 64 2020-11-16T22:04:04.965 INFO:tasks.rados.rados.2.smithi057.stdout:588: expect (ObjNum 189 snap 64 seq_num 189) 2020-11-16T22:04:04.965 INFO:tasks.rados.rados.2.smithi057.stdout:589: write (excl) oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 77 2020-11-16T22:04:04.965 INFO:tasks.rados.rados.2.smithi057.stdout:589: seq_num 225 ranges {581575=705262,1733272=707409,3195938=437497} 2020-11-16T22:04:04.976 INFO:tasks.rados.rados.2.smithi057.stdout:589: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 581575 to 1286837 tid 1 2020-11-16T22:04:04.984 INFO:tasks.rados.rados.2.smithi057.stdout:589: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1733272 to 2440681 tid 2 2020-11-16T22:04:04.991 INFO:tasks.rados.rados.2.smithi057.stdout:589: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3195938 to 3633435 tid 3 2020-11-16T22:04:04.992 INFO:tasks.rados.rados.2.smithi057.stdout:590: copy_from oid 2 from oid 50 current snap is 77 2020-11-16T22:04:04.992 INFO:tasks.rados.rados.2.smithi057.stdout:587: finishing rollback tid 0 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:04.992 INFO:tasks.rados.rados.2.smithi057.stdout:587: finishing rollback tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:04.992 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 30 (ObjNum 49 snap 0 seq_num 2909626040) dirty dne 2020-11-16T22:04:04.992 INFO:tasks.rados.rados.2.smithi057.stdout:583: expect (ObjNum 152 snap 51 seq_num 152) 2020-11-16T22:04:05.071 INFO:tasks.rados.rados.2.smithi057.stdout:585: expect (ObjNum 222 snap 77 seq_num 222) 2020-11-16T22:04:05.260 INFO:tasks.rados.rados.2.smithi057.stdout:588: expect (ObjNum 189 snap 64 seq_num 189) 2020-11-16T22:04:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:04 smithi016 bash[10302]: cluster 2020-11-16T22:04:03.611035+0000 mgr.x (mgr.24115) 343 : cluster [DBG] pgmap v490: 17 pgs: 17 active+clean; 246 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.8 MiB/s wr, 15 op/s 2020-11-16T22:04:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:04 smithi016 bash[10302]: cluster 2020-11-16T22:04:03.984274+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e218: 12 total, 12 up, 12 in 2020-11-16T22:04:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:04 smithi016 bash[10302]: cluster 2020-11-16T22:04:04.909519+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e219: 12 total, 12 up, 12 in 2020-11-16T22:04:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:04 smithi195 bash[10218]: cluster 2020-11-16T22:04:03.611035+0000 mgr.x (mgr.24115) 343 : cluster [DBG] pgmap v490: 17 pgs: 17 active+clean; 246 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.8 MiB/s wr, 15 op/s 2020-11-16T22:04:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:04 smithi195 bash[10218]: cluster 2020-11-16T22:04:03.984274+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e218: 12 total, 12 up, 12 in 2020-11-16T22:04:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:04 smithi195 bash[10218]: cluster 2020-11-16T22:04:04.909519+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e219: 12 total, 12 up, 12 in 2020-11-16T22:04:05.396 INFO:tasks.rados.rados.2.smithi057.stdout:589: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:05.397 INFO:tasks.rados.rados.2.smithi057.stdout:589: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:05.397 INFO:tasks.rados.rados.2.smithi057.stdout:583: done (5 left) 2020-11-16T22:04:05.397 INFO:tasks.rados.rados.2.smithi057.stdout:585: done (4 left) 2020-11-16T22:04:05.397 INFO:tasks.rados.rados.2.smithi057.stdout:587: done (3 left) 2020-11-16T22:04:05.397 INFO:tasks.rados.rados.2.smithi057.stdout:588: done (2 left) 2020-11-16T22:04:05.397 INFO:tasks.rados.rados.2.smithi057.stdout:591: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:05.397 INFO:tasks.rados.rados.2.smithi057.stdout:591: expect (ObjNum 150 snap 48 seq_num 150) 2020-11-16T22:04:05.398 INFO:tasks.rados.rados.2.smithi057.stdout:592: write oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 77 2020-11-16T22:04:05.398 INFO:tasks.rados.rados.2.smithi057.stdout:592: seq_num 226 ranges {598382=780511,2075401=451067,3107008=648769} 2020-11-16T22:04:05.405 INFO:tasks.rados.rados.2.smithi057.stdout:592: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 598382 to 1378893 tid 1 2020-11-16T22:04:05.411 INFO:tasks.rados.rados.2.smithi057.stdout:592: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2075401 to 2526468 tid 2 2020-11-16T22:04:05.418 INFO:tasks.rados.rados.2.smithi057.stdout:592: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3107008 to 3755777 tid 3 2020-11-16T22:04:05.418 INFO:tasks.rados.rados.2.smithi057.stdout:593: read oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:05.418 INFO:tasks.rados.rados.2.smithi057.stdout:593: expect deleted 2020-11-16T22:04:05.419 INFO:tasks.rados.rados.2.smithi057.stdout:594: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:05.419 INFO:tasks.rados.rados.2.smithi057.stdout:594: expect deleted 2020-11-16T22:04:05.419 INFO:tasks.rados.rados.2.smithi057.stdout:595: snap_remove snap 70 2020-11-16T22:04:05.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:04 smithi057 bash[10301]: cluster 2020-11-16T22:04:03.611035+0000 mgr.x (mgr.24115) 343 : cluster [DBG] pgmap v490: 17 pgs: 17 active+clean; 246 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.8 MiB/s wr, 15 op/s 2020-11-16T22:04:05.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:04 smithi057 bash[10301]: cluster 2020-11-16T22:04:03.984274+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e218: 12 total, 12 up, 12 in 2020-11-16T22:04:05.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:04 smithi057 bash[10301]: cluster 2020-11-16T22:04:04.909519+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e219: 12 total, 12 up, 12 in 2020-11-16T22:04:05.986 INFO:tasks.rados.rados.2.smithi057.stdout:595: done (6 left) 2020-11-16T22:04:05.987 INFO:tasks.rados.rados.2.smithi057.stdout:596: rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 77 2020-11-16T22:04:05.987 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 62 2020-11-16T22:04:05.987 INFO:tasks.rados.rados.2.smithi057.stdout:590: finishing copy_from to smithi05720651-2 2020-11-16T22:04:05.987 INFO:tasks.rados.rados.2.smithi057.stdout:590: got expected ENOENT (src dne) 2020-11-16T22:04:05.987 INFO:tasks.rados.rados.2.smithi057.stdout:590: finishing copy_from racing read to smithi05720651-2 2020-11-16T22:04:05.988 INFO:tasks.rados.rados.2.smithi057.stdout:589: finishing write tid 3 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:05.988 INFO:tasks.rados.rados.2.smithi057.stdout:589: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:05.988 INFO:tasks.rados.rados.2.smithi057.stdout:589: finishing write tid 6 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:05.988 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 197 (ObjNum 225 snap 77 seq_num 225) dirty exists 2020-11-16T22:04:05.988 INFO:tasks.rados.rados.2.smithi057.stdout:589: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 225 snap 77 seq_num 225) 2020-11-16T22:04:05.988 INFO:tasks.rados.rados.2.smithi057.stdout:591: expect (ObjNum 150 snap 48 seq_num 150) 2020-11-16T22:04:06.066 INFO:tasks.rados.rados.2.smithi057.stdout:592: finishing write tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.066 INFO:tasks.rados.rados.2.smithi057.stdout:592: finishing write tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.066 INFO:tasks.rados.rados.2.smithi057.stdout:589: done (6 left) 2020-11-16T22:04:06.066 INFO:tasks.rados.rados.2.smithi057.stdout:590: done (5 left) 2020-11-16T22:04:06.067 INFO:tasks.rados.rados.2.smithi057.stdout:591: done (4 left) 2020-11-16T22:04:06.067 INFO:tasks.rados.rados.2.smithi057.stdout:597: read oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:06.067 INFO:tasks.rados.rados.2.smithi057.stdout:597: expect (ObjNum 137 snap 39 seq_num 137) 2020-11-16T22:04:06.067 INFO:tasks.rados.rados.2.smithi057.stdout:598: write (excl) oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 77 2020-11-16T22:04:06.067 INFO:tasks.rados.rados.2.smithi057.stdout:598: seq_num 227 ranges {615189=455760,1733883=711078,3134431=460041} 2020-11-16T22:04:06.071 INFO:tasks.rados.rados.2.smithi057.stdout:598: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 615189 to 1070949 tid 1 2020-11-16T22:04:06.080 INFO:tasks.rados.rados.2.smithi057.stdout:598: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1733883 to 2444961 tid 2 2020-11-16T22:04:06.087 INFO:tasks.rados.rados.2.smithi057.stdout:598: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3134431 to 3594472 tid 3 2020-11-16T22:04:06.087 INFO:tasks.rados.rados.2.smithi057.stdout:599: copy_from oid 28 from oid 36 current snap is 77 2020-11-16T22:04:06.087 INFO:tasks.rados.rados.2.smithi057.stdout:592: finishing write tid 3 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.088 INFO:tasks.rados.rados.2.smithi057.stdout:592: finishing write tid 5 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.088 INFO:tasks.rados.rados.2.smithi057.stdout:592: finishing write tid 6 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.088 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 428 (ObjNum 226 snap 77 seq_num 226) dirty exists 2020-11-16T22:04:06.088 INFO:tasks.rados.rados.2.smithi057.stdout:592: left oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 226 snap 77 seq_num 226) 2020-11-16T22:04:06.088 INFO:tasks.rados.rados.2.smithi057.stdout:592: done (6 left) 2020-11-16T22:04:06.088 INFO:tasks.rados.rados.2.smithi057.stdout:593: done (5 left) 2020-11-16T22:04:06.088 INFO:tasks.rados.rados.2.smithi057.stdout:594: done (4 left) 2020-11-16T22:04:06.089 INFO:tasks.rados.rados.2.smithi057.stdout:600: write oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 77 2020-11-16T22:04:06.089 INFO:tasks.rados.rados.2.smithi057.stdout:600: seq_num 228 ranges {631996=531009,1792365=454736,2761854=671313} 2020-11-16T22:04:06.093 INFO:tasks.rados.rados.2.smithi057.stdout:600: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 631996 to 1163005 tid 1 2020-11-16T22:04:06.100 INFO:tasks.rados.rados.2.smithi057.stdout:600: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1792365 to 2247101 tid 2 2020-11-16T22:04:06.107 INFO:tasks.rados.rados.2.smithi057.stdout:600: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2761854 to 3433167 tid 3 2020-11-16T22:04:06.107 INFO:tasks.rados.rados.2.smithi057.stdout:601: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 76 2020-11-16T22:04:06.107 INFO:tasks.rados.rados.2.smithi057.stdout:601: expect (ObjNum 137 snap 39 seq_num 137) 2020-11-16T22:04:06.108 INFO:tasks.rados.rados.2.smithi057.stdout:602: delete oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 77 2020-11-16T22:04:06.108 INFO:tasks.rados.rados.2.smithi057.stdout:596: finishing rollback tid 0 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.108 INFO:tasks.rados.rados.2.smithi057.stdout:596: finishing rollback tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.108 INFO:tasks.rados.rados.2.smithi057.stdout:596: finishing rollback tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.108 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 338 (ObjNum 146 snap 46 seq_num 146) dirty exists 2020-11-16T22:04:06.108 INFO:tasks.rados.rados.2.smithi057.stdout:597: expect (ObjNum 137 snap 39 seq_num 137) 2020-11-16T22:04:06.210 INFO:tasks.rados.rados.2.smithi057.stdout:598: finishing write tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.210 INFO:tasks.rados.rados.2.smithi057.stdout:598: finishing write tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.211 INFO:tasks.rados.rados.2.smithi057.stdout:598: finishing write tid 3 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.211 INFO:tasks.rados.rados.2.smithi057.stdout:598: finishing write tid 5 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.211 INFO:tasks.rados.rados.2.smithi057.stdout:598: finishing write tid 6 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.211 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 149 (ObjNum 227 snap 77 seq_num 227) dirty exists 2020-11-16T22:04:06.211 INFO:tasks.rados.rados.2.smithi057.stdout:598: left oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 227 snap 77 seq_num 227) 2020-11-16T22:04:06.211 INFO:tasks.rados.rados.2.smithi057.stdout:599: finishing copy_from to smithi05720651-28 2020-11-16T22:04:06.211 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 249 (ObjNum 200 snap 67 seq_num 200) dirty exists 2020-11-16T22:04:06.212 INFO:tasks.rados.rados.2.smithi057.stdout:599: finishing copy_from racing read to smithi05720651-28 2020-11-16T22:04:06.212 INFO:tasks.rados.rados.2.smithi057.stdout:600: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.212 INFO:tasks.rados.rados.2.smithi057.stdout:600: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.212 INFO:tasks.rados.rados.2.smithi057.stdout:600: finishing write tid 3 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.212 INFO:tasks.rados.rados.2.smithi057.stdout:601: expect (ObjNum 137 snap 39 seq_num 137) 2020-11-16T22:04:06.313 INFO:tasks.rados.rados.2.smithi057.stdout:600: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.313 INFO:tasks.rados.rados.2.smithi057.stdout:600: finishing write tid 6 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.314 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 535 (ObjNum 228 snap 77 seq_num 228) dirty exists 2020-11-16T22:04:06.314 INFO:tasks.rados.rados.2.smithi057.stdout:600: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 228 snap 77 seq_num 228) 2020-11-16T22:04:06.314 INFO:tasks.rados.rados.2.smithi057.stdout:596: done (6 left) 2020-11-16T22:04:06.314 INFO:tasks.rados.rados.2.smithi057.stdout:597: done (5 left) 2020-11-16T22:04:06.314 INFO:tasks.rados.rados.2.smithi057.stdout:598: done (4 left) 2020-11-16T22:04:06.314 INFO:tasks.rados.rados.2.smithi057.stdout:599: done (3 left) 2020-11-16T22:04:06.315 INFO:tasks.rados.rados.2.smithi057.stdout:600: done (2 left) 2020-11-16T22:04:06.315 INFO:tasks.rados.rados.2.smithi057.stdout:601: done (1 left) 2020-11-16T22:04:06.315 INFO:tasks.rados.rados.2.smithi057.stdout:602: done (0 left) 2020-11-16T22:04:06.315 INFO:tasks.rados.rados.2.smithi057.stdout:603: delete oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 77 2020-11-16T22:04:06.317 INFO:tasks.rados.rados.2.smithi057.stdout:603: done (0 left) 2020-11-16T22:04:06.317 INFO:tasks.rados.rados.2.smithi057.stdout:604: write (excl) oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 77 2020-11-16T22:04:06.317 INFO:tasks.rados.rados.2.smithi057.stdout:604: seq_num 231 ranges {682417=473109,1567811=602063,2844123=621482} 2020-11-16T22:04:06.324 INFO:tasks.rados.rados.2.smithi057.stdout:604: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 682417 to 1155526 tid 1 2020-11-16T22:04:06.330 INFO:tasks.rados.rados.2.smithi057.stdout:604: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1567811 to 2169874 tid 2 2020-11-16T22:04:06.338 INFO:tasks.rados.rados.2.smithi057.stdout:604: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2844123 to 3465605 tid 3 2020-11-16T22:04:06.338 INFO:tasks.rados.rados.2.smithi057.stdout:605: snap_create 2020-11-16T22:04:06.338 INFO:tasks.rados.rados.2.smithi057.stdout:604: finishing write tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.339 INFO:tasks.rados.rados.2.smithi057.stdout:604: finishing write tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.344 INFO:tasks.rados.rados.2.smithi057.stdout:604: finishing write tid 3 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.345 INFO:tasks.rados.rados.2.smithi057.stdout:604: finishing write tid 5 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.346 INFO:tasks.rados.rados.2.smithi057.stdout:604: finishing write tid 6 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:06.346 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 397 (ObjNum 231 snap 77 seq_num 231) dirty exists 2020-11-16T22:04:06.346 INFO:tasks.rados.rados.2.smithi057.stdout:604: left oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 231 snap 77 seq_num 231) 2020-11-16T22:04:06.989 INFO:tasks.rados.rados.2.smithi057.stdout:604: done (1 left) 2020-11-16T22:04:06.989 INFO:tasks.rados.rados.2.smithi057.stdout:605: done (0 left) 2020-11-16T22:04:06.989 INFO:tasks.rados.rados.2.smithi057.stdout:606: rollback oid 20 current snap is 78 2020-11-16T22:04:06.989 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 20 to 60 2020-11-16T22:04:06.989 INFO:tasks.rados.rados.2.smithi057.stdout:607: write (excl) oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 78 2020-11-16T22:04:06.990 INFO:tasks.rados.rados.2.smithi057.stdout:607: seq_num 232 ranges {699224=548358,2026293=462074,3271546=432754} 2020-11-16T22:04:07.001 INFO:tasks.rados.rados.2.smithi057.stdout:607: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 699224 to 1247582 tid 1 2020-11-16T22:04:07.008 INFO:tasks.rados.rados.2.smithi057.stdout:607: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2026293 to 2488367 tid 2 2020-11-16T22:04:07.015 INFO:tasks.rados.rados.2.smithi057.stdout:607: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3271546 to 3704300 tid 3 2020-11-16T22:04:07.015 INFO:tasks.rados.rados.2.smithi057.stdout:608: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:07.016 INFO:tasks.rados.rados.2.smithi057.stdout:608: expect deleted 2020-11-16T22:04:07.016 INFO:tasks.rados.rados.2.smithi057.stdout:609: rollback oid 16 current snap is 78 2020-11-16T22:04:07.016 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 16 to 76 2020-11-16T22:04:07.016 INFO:tasks.rados.rados.2.smithi057.stdout:606: finishing rollback tid 1 to smithi05720651-20 2020-11-16T22:04:07.016 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 261 (ObjNum 385 snap 0 seq_num 2930970048) dirty dne 2020-11-16T22:04:07.016 INFO:tasks.rados.rados.2.smithi057.stdout:607: finishing write tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:07.016 INFO:tasks.rados.rados.2.smithi057.stdout:606: done (3 left) 2020-11-16T22:04:07.017 INFO:tasks.rados.rados.2.smithi057.stdout:610: write (excl) oid 50 current snap is 78 2020-11-16T22:04:07.017 INFO:tasks.rados.rados.2.smithi057.stdout:610: seq_num 233 ranges {716031=623607,2084775=605732,3298969=617062} 2020-11-16T22:04:07.023 INFO:tasks.rados.rados.2.smithi057.stdout:610: writing smithi05720651-50 from 716031 to 1339638 tid 1 2020-11-16T22:04:07.030 INFO:tasks.rados.rados.2.smithi057.stdout:610: writing smithi05720651-50 from 2084775 to 2690507 tid 2 2020-11-16T22:04:07.037 INFO:tasks.rados.rados.2.smithi057.stdout:610: writing smithi05720651-50 from 3298969 to 3916031 tid 3 2020-11-16T22:04:07.037 INFO:tasks.rados.rados.2.smithi057.stdout:611: snap_create 2020-11-16T22:04:07.038 INFO:tasks.rados.rados.2.smithi057.stdout:607: finishing write tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:07.038 INFO:tasks.rados.rados.2.smithi057.stdout:607: finishing write tid 3 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:07.038 INFO:tasks.rados.rados.2.smithi057.stdout:607: finishing write tid 5 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:07.038 INFO:tasks.rados.rados.2.smithi057.stdout:607: finishing write tid 6 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:07.038 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 402 (ObjNum 232 snap 78 seq_num 232) dirty exists 2020-11-16T22:04:07.038 INFO:tasks.rados.rados.2.smithi057.stdout:607: left oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 232 snap 78 seq_num 232) 2020-11-16T22:04:07.039 INFO:tasks.rados.rados.2.smithi057.stdout:609: finishing rollback tid 0 to smithi05720651-16 2020-11-16T22:04:07.039 INFO:tasks.rados.rados.2.smithi057.stdout:609: finishing rollback tid 1 to smithi05720651-16 2020-11-16T22:04:07.039 INFO:tasks.rados.rados.2.smithi057.stdout:609: finishing rollback tid 2 to smithi05720651-16 2020-11-16T22:04:07.039 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 406 (ObjNum 219 snap 75 seq_num 219) dirty exists 2020-11-16T22:04:07.039 INFO:tasks.rados.rados.2.smithi057.stdout:610: finishing write tid 1 to smithi05720651-50 2020-11-16T22:04:07.039 INFO:tasks.rados.rados.2.smithi057.stdout:610: finishing write tid 2 to smithi05720651-50 2020-11-16T22:04:07.043 INFO:tasks.rados.rados.2.smithi057.stdout:610: finishing write tid 3 to smithi05720651-50 2020-11-16T22:04:07.043 INFO:tasks.rados.rados.2.smithi057.stdout:610: finishing write tid 5 to smithi05720651-50 2020-11-16T22:04:07.044 INFO:tasks.rados.rados.2.smithi057.stdout:610: finishing write tid 6 to smithi05720651-50 2020-11-16T22:04:07.044 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 438 (ObjNum 233 snap 78 seq_num 233) dirty exists 2020-11-16T22:04:07.044 INFO:tasks.rados.rados.2.smithi057.stdout:610: left oid 50 (ObjNum 233 snap 78 seq_num 233) 2020-11-16T22:04:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:07 smithi016 bash[10302]: cluster 2020-11-16T22:04:05.611706+0000 mgr.x (mgr.24115) 344 : cluster [DBG] pgmap v493: 17 pgs: 17 active+clean; 244 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2020-11-16T22:04:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:07 smithi016 bash[10302]: cluster 2020-11-16T22:04:05.995861+0000 mon.a (mon.0) 859 : cluster [DBG] osdmap e220: 12 total, 12 up, 12 in 2020-11-16T22:04:07.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:07 smithi195 bash[10218]: cluster 2020-11-16T22:04:05.611706+0000 mgr.x (mgr.24115) 344 : cluster [DBG] pgmap v493: 17 pgs: 17 active+clean; 244 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2020-11-16T22:04:07.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:07 smithi195 bash[10218]: cluster 2020-11-16T22:04:05.995861+0000 mon.a (mon.0) 859 : cluster [DBG] osdmap e220: 12 total, 12 up, 12 in 2020-11-16T22:04:07.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:07 smithi057 bash[10301]: cluster 2020-11-16T22:04:05.611706+0000 mgr.x (mgr.24115) 344 : cluster [DBG] pgmap v493: 17 pgs: 17 active+clean; 244 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 1.7 MiB/s wr, 10 op/s 2020-11-16T22:04:07.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:07 smithi057 bash[10301]: cluster 2020-11-16T22:04:05.995861+0000 mon.a (mon.0) 859 : cluster [DBG] osdmap e220: 12 total, 12 up, 12 in 2020-11-16T22:04:08.024 INFO:tasks.rados.rados.2.smithi057.stdout:607: done (4 left) 2020-11-16T22:04:08.024 INFO:tasks.rados.rados.2.smithi057.stdout:608: done (3 left) 2020-11-16T22:04:08.024 INFO:tasks.rados.rados.2.smithi057.stdout:609: done (2 left) 2020-11-16T22:04:08.024 INFO:tasks.rados.rados.2.smithi057.stdout:610: done (1 left) 2020-11-16T22:04:08.024 INFO:tasks.rados.rados.2.smithi057.stdout:611: done (0 left) 2020-11-16T22:04:08.025 INFO:tasks.rados.rados.2.smithi057.stdout:612: copy_from oid 42 from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 79 2020-11-16T22:04:08.025 INFO:tasks.rados.rados.2.smithi057.stdout:613: copy_from oid 32 from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 79 2020-11-16T22:04:08.025 INFO:tasks.rados.rados.2.smithi057.stdout:614: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:08.025 INFO:tasks.rados.rados.2.smithi057.stdout:614: expect (ObjNum 222 snap 77 seq_num 222) 2020-11-16T22:04:08.025 INFO:tasks.rados.rados.2.smithi057.stdout:615: read oid 16 snap -1 2020-11-16T22:04:08.025 INFO:tasks.rados.rados.2.smithi057.stdout:615: expect (ObjNum 219 snap 75 seq_num 219) 2020-11-16T22:04:08.026 INFO:tasks.rados.rados.2.smithi057.stdout:616: snap_create 2020-11-16T22:04:08.046 INFO:tasks.rados.rados.2.smithi057.stdout:614: expect (ObjNum 222 snap 77 seq_num 222) 2020-11-16T22:04:08.245 INFO:tasks.rados.rados.2.smithi057.stdout:612: finishing copy_from to smithi05720651-42 2020-11-16T22:04:08.245 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 259 (ObjNum 220 snap 76 seq_num 220) dirty exists 2020-11-16T22:04:08.245 INFO:tasks.rados.rados.2.smithi057.stdout:612: finishing copy_from racing read to smithi05720651-42 2020-11-16T22:04:08.246 INFO:tasks.rados.rados.2.smithi057.stdout:615: expect (ObjNum 219 snap 75 seq_num 219) 2020-11-16T22:04:08.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:08 smithi016 bash[10302]: cluster 2020-11-16T22:04:06.999218+0000 mon.a (mon.0) 860 : cluster [DBG] osdmap e221: 12 total, 12 up, 12 in 2020-11-16T22:04:08.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:08 smithi195 bash[10218]: cluster 2020-11-16T22:04:06.999218+0000 mon.a (mon.0) 860 : cluster [DBG] osdmap e221: 12 total, 12 up, 12 in 2020-11-16T22:04:08.410 INFO:tasks.rados.rados.2.smithi057.stdout:613: finishing copy_from to smithi05720651-32 2020-11-16T22:04:08.411 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 193 (ObjNum 180 snap 62 seq_num 180) dirty exists 2020-11-16T22:04:08.411 INFO:tasks.rados.rados.2.smithi057.stdout:613: finishing copy_from racing read to smithi05720651-32 2020-11-16T22:04:08.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:08 smithi057 bash[10301]: cluster 2020-11-16T22:04:06.999218+0000 mon.a (mon.0) 860 : cluster [DBG] osdmap e221: 12 total, 12 up, 12 in 2020-11-16T22:04:09.029 INFO:tasks.rados.rados.2.smithi057.stdout:612: done (4 left) 2020-11-16T22:04:09.030 INFO:tasks.rados.rados.2.smithi057.stdout:613: done (3 left) 2020-11-16T22:04:09.030 INFO:tasks.rados.rados.2.smithi057.stdout:614: done (2 left) 2020-11-16T22:04:09.030 INFO:tasks.rados.rados.2.smithi057.stdout:615: done (1 left) 2020-11-16T22:04:09.030 INFO:tasks.rados.rados.2.smithi057.stdout:616: done (0 left) 2020-11-16T22:04:09.030 INFO:tasks.rados.rados.2.smithi057.stdout:617: write oid 40 current snap is 80 2020-11-16T22:04:09.031 INFO:tasks.rados.rados.2.smithi057.stdout:617: seq_num 234 ranges {732838=698856,2026904=465743,3210039=571651} 2020-11-16T22:04:09.040 INFO:tasks.rados.rados.2.smithi057.stdout:617: writing smithi05720651-40 from 732838 to 1431694 tid 1 2020-11-16T22:04:09.046 INFO:tasks.rados.rados.2.smithi057.stdout:617: writing smithi05720651-40 from 2026904 to 2492647 tid 2 2020-11-16T22:04:09.054 INFO:tasks.rados.rados.2.smithi057.stdout:617: writing smithi05720651-40 from 3210039 to 3781690 tid 3 2020-11-16T22:04:09.054 INFO:tasks.rados.rados.2.smithi057.stdout:618: write (excl) oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 80 2020-11-16T22:04:09.054 INFO:tasks.rados.rados.2.smithi057.stdout:618: seq_num 235 ranges {749645=774105,2085386=609401,3237462=712183} 2020-11-16T22:04:09.062 INFO:tasks.rados.rados.2.smithi057.stdout:618: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 749645 to 1523750 tid 1 2020-11-16T22:04:09.069 INFO:tasks.rados.rados.2.smithi057.stdout:618: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2085386 to 2694787 tid 2 2020-11-16T22:04:09.076 INFO:tasks.rados.rados.2.smithi057.stdout:618: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3237462 to 3949645 tid 3 2020-11-16T22:04:09.076 INFO:tasks.rados.rados.2.smithi057.stdout:619: snap_remove snap 78 2020-11-16T22:04:09.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:09 smithi016 bash[10302]: cluster 2020-11-16T22:04:07.612360+0000 mgr.x (mgr.24115) 345 : cluster [DBG] pgmap v496: 17 pgs: 17 active+clean; 248 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.4 MiB/s wr, 21 op/s 2020-11-16T22:04:09.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:09 smithi016 bash[10302]: cluster 2020-11-16T22:04:08.026958+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e222: 12 total, 12 up, 12 in 2020-11-16T22:04:09.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:09 smithi195 bash[10218]: cluster 2020-11-16T22:04:07.612360+0000 mgr.x (mgr.24115) 345 : cluster [DBG] pgmap v496: 17 pgs: 17 active+clean; 248 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.4 MiB/s wr, 21 op/s 2020-11-16T22:04:09.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:09 smithi195 bash[10218]: cluster 2020-11-16T22:04:08.026958+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e222: 12 total, 12 up, 12 in 2020-11-16T22:04:09.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:09 smithi057 bash[10301]: cluster 2020-11-16T22:04:07.612360+0000 mgr.x (mgr.24115) 345 : cluster [DBG] pgmap v496: 17 pgs: 17 active+clean; 248 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.4 MiB/s wr, 21 op/s 2020-11-16T22:04:09.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:09 smithi057 bash[10301]: cluster 2020-11-16T22:04:08.026958+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e222: 12 total, 12 up, 12 in 2020-11-16T22:04:09.905 INFO:tasks.rados.rados.2.smithi057.stdout:619: done (2 left) 2020-11-16T22:04:09.906 INFO:tasks.rados.rados.2.smithi057.stdout:620: delete oid 10 current snap is 80 2020-11-16T22:04:09.906 INFO:tasks.rados.rados.2.smithi057.stdout:617: finishing write tid 1 to smithi05720651-40 2020-11-16T22:04:09.906 INFO:tasks.rados.rados.2.smithi057.stdout:617: finishing write tid 2 to smithi05720651-40 2020-11-16T22:04:09.906 INFO:tasks.rados.rados.2.smithi057.stdout:617: finishing write tid 3 to smithi05720651-40 2020-11-16T22:04:09.906 INFO:tasks.rados.rados.2.smithi057.stdout:617: finishing write tid 5 to smithi05720651-40 2020-11-16T22:04:09.906 INFO:tasks.rados.rados.2.smithi057.stdout:617: finishing write tid 6 to smithi05720651-40 2020-11-16T22:04:09.907 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 544 (ObjNum 234 snap 80 seq_num 234) dirty exists 2020-11-16T22:04:09.907 INFO:tasks.rados.rados.2.smithi057.stdout:617: left oid 40 (ObjNum 234 snap 80 seq_num 234) 2020-11-16T22:04:09.907 INFO:tasks.rados.rados.2.smithi057.stdout:618: finishing write tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:09.907 INFO:tasks.rados.rados.2.smithi057.stdout:618: finishing write tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:09.907 INFO:tasks.rados.rados.2.smithi057.stdout:618: finishing write tid 3 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:09.907 INFO:tasks.rados.rados.2.smithi057.stdout:618: finishing write tid 5 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:09.907 INFO:tasks.rados.rados.2.smithi057.stdout:618: finishing write tid 6 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:09.908 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 443 (ObjNum 235 snap 80 seq_num 235) dirty exists 2020-11-16T22:04:09.908 INFO:tasks.rados.rados.2.smithi057.stdout:618: left oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 235 snap 80 seq_num 235) 2020-11-16T22:04:09.916 INFO:tasks.rados.rados.2.smithi057.stdout:617: done (2 left) 2020-11-16T22:04:09.916 INFO:tasks.rados.rados.2.smithi057.stdout:618: done (1 left) 2020-11-16T22:04:09.917 INFO:tasks.rados.rados.2.smithi057.stdout:620: done (0 left) 2020-11-16T22:04:09.917 INFO:tasks.rados.rados.2.smithi057.stdout:621: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:09.917 INFO:tasks.rados.rados.2.smithi057.stdout:621: expect deleted 2020-11-16T22:04:09.917 INFO:tasks.rados.rados.2.smithi057.stdout:622: read oid 20 snap 77 2020-11-16T22:04:09.917 INFO:tasks.rados.rados.2.smithi057.stdout:622: expect deleted 2020-11-16T22:04:09.917 INFO:tasks.rados.rados.2.smithi057.stdout:623: delete oid 40 current snap is 80 2020-11-16T22:04:09.925 INFO:tasks.rados.rados.2.smithi057.stdout:621: done (2 left) 2020-11-16T22:04:09.926 INFO:tasks.rados.rados.2.smithi057.stdout:622: done (1 left) 2020-11-16T22:04:09.926 INFO:tasks.rados.rados.2.smithi057.stdout:623: done (0 left) 2020-11-16T22:04:09.926 INFO:tasks.rados.rados.2.smithi057.stdout:624: read oid 16 snap 74 2020-11-16T22:04:09.926 INFO:tasks.rados.rados.2.smithi057.stdout:624: expect (ObjNum 152 snap 51 seq_num 152) 2020-11-16T22:04:09.926 INFO:tasks.rados.rados.2.smithi057.stdout:625: read oid 24 snap 60 2020-11-16T22:04:09.927 INFO:tasks.rados.rados.2.smithi057.stdout:625: expect deleted 2020-11-16T22:04:09.927 INFO:tasks.rados.rados.2.smithi057.stdout:626: write oid 44 current snap is 80 2020-11-16T22:04:09.927 INFO:tasks.rados.rados.2.smithi057.stdout:626: seq_num 238 ranges {400066=716205,1860832=139234} 2020-11-16T22:04:09.937 INFO:tasks.rados.rados.2.smithi057.stdout:626: writing smithi05720651-44 from 400066 to 1116271 tid 1 2020-11-16T22:04:09.944 INFO:tasks.rados.rados.2.smithi057.stdout:626: writing smithi05720651-44 from 1860832 to 2000066 tid 2 2020-11-16T22:04:09.944 INFO:tasks.rados.rados.2.smithi057.stdout:627: copy_from oid 34 from oid 48 current snap is 80 2020-11-16T22:04:09.944 INFO:tasks.rados.rados.2.smithi057.stdout:624: expect (ObjNum 152 snap 51 seq_num 152) 2020-11-16T22:04:10.024 INFO:tasks.rados.rados.2.smithi057.stdout:626: finishing write tid 1 to smithi05720651-44 2020-11-16T22:04:10.024 INFO:tasks.rados.rados.2.smithi057.stdout:624: done (3 left) 2020-11-16T22:04:10.025 INFO:tasks.rados.rados.2.smithi057.stdout:625: done (2 left) 2020-11-16T22:04:10.025 INFO:tasks.rados.rados.2.smithi057.stdout:628: delete oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 80 2020-11-16T22:04:10.025 INFO:tasks.rados.rados.2.smithi057.stdout:626: finishing write tid 2 to smithi05720651-44 2020-11-16T22:04:10.025 INFO:tasks.rados.rados.2.smithi057.stdout:626: finishing write tid 4 to smithi05720651-44 2020-11-16T22:04:10.025 INFO:tasks.rados.rados.2.smithi057.stdout:626: finishing write tid 5 to smithi05720651-44 2020-11-16T22:04:10.025 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 294 (ObjNum 238 snap 80 seq_num 238) dirty exists 2020-11-16T22:04:10.025 INFO:tasks.rados.rados.2.smithi057.stdout:626: left oid 44 (ObjNum 238 snap 80 seq_num 238) 2020-11-16T22:04:10.026 INFO:tasks.rados.rados.2.smithi057.stdout:627: finishing copy_from to smithi05720651-34 2020-11-16T22:04:10.026 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 104 (ObjNum 157 snap 55 seq_num 157) dirty exists 2020-11-16T22:04:10.026 INFO:tasks.rados.rados.2.smithi057.stdout:627: finishing copy_from racing read to smithi05720651-34 2020-11-16T22:04:10.029 INFO:tasks.rados.rados.2.smithi057.stdout:626: done (2 left) 2020-11-16T22:04:10.029 INFO:tasks.rados.rados.2.smithi057.stdout:627: done (1 left) 2020-11-16T22:04:10.029 INFO:tasks.rados.rados.2.smithi057.stdout:628: done (0 left) 2020-11-16T22:04:10.030 INFO:tasks.rados.rados.2.smithi057.stdout:629: rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 80 2020-11-16T22:04:10.030 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 74 2020-11-16T22:04:10.030 INFO:tasks.rados.rados.2.smithi057.stdout:630: write oid 14 current snap is 80 2020-11-16T22:04:10.030 INFO:tasks.rados.rados.2.smithi057.stdout:630: seq_num 240 ranges {433680=466703,1577796=455884} 2020-11-16T22:04:10.034 INFO:tasks.rados.rados.2.smithi057.stdout:630: writing smithi05720651-14 from 433680 to 900383 tid 1 2020-11-16T22:04:10.042 INFO:tasks.rados.rados.2.smithi057.stdout:630: writing smithi05720651-14 from 1577796 to 2033680 tid 2 2020-11-16T22:04:10.043 INFO:tasks.rados.rados.2.smithi057.stdout:631: snap_remove snap 79 2020-11-16T22:04:10.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:10 smithi016 bash[10302]: cluster 2020-11-16T22:04:09.037262+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e223: 12 total, 12 up, 12 in 2020-11-16T22:04:10.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:10 smithi016 bash[10302]: cluster 2020-11-16T22:04:09.912291+0000 mon.a (mon.0) 863 : cluster [DBG] osdmap e224: 12 total, 12 up, 12 in 2020-11-16T22:04:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:10 smithi195 bash[10218]: cluster 2020-11-16T22:04:09.037262+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e223: 12 total, 12 up, 12 in 2020-11-16T22:04:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:10 smithi195 bash[10218]: cluster 2020-11-16T22:04:09.912291+0000 mon.a (mon.0) 863 : cluster [DBG] osdmap e224: 12 total, 12 up, 12 in 2020-11-16T22:04:10.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:10 smithi057 bash[10301]: cluster 2020-11-16T22:04:09.037262+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e223: 12 total, 12 up, 12 in 2020-11-16T22:04:10.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:10 smithi057 bash[10301]: cluster 2020-11-16T22:04:09.912291+0000 mon.a (mon.0) 863 : cluster [DBG] osdmap e224: 12 total, 12 up, 12 in 2020-11-16T22:04:11.046 INFO:tasks.rados.rados.2.smithi057.stdout:631: done (2 left) 2020-11-16T22:04:11.046 INFO:tasks.rados.rados.2.smithi057.stdout:632: read oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:11.046 INFO:tasks.rados.rados.2.smithi057.stdout:632: expect (ObjNum 180 snap 62 seq_num 180) 2020-11-16T22:04:11.047 INFO:tasks.rados.rados.2.smithi057.stdout:633: snap_create 2020-11-16T22:04:11.047 INFO:tasks.rados.rados.2.smithi057.stdout:629: finishing rollback tid 0 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:11.047 INFO:tasks.rados.rados.2.smithi057.stdout:629: finishing rollback tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:11.047 INFO:tasks.rados.rados.2.smithi057.stdout:629: finishing rollback tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:11.047 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 204 (ObjNum 193 snap 64 seq_num 193) dirty exists 2020-11-16T22:04:11.047 INFO:tasks.rados.rados.2.smithi057.stdout:630: finishing write tid 1 to smithi05720651-14 2020-11-16T22:04:11.048 INFO:tasks.rados.rados.2.smithi057.stdout:630: finishing write tid 2 to smithi05720651-14 2020-11-16T22:04:11.048 INFO:tasks.rados.rados.2.smithi057.stdout:630: finishing write tid 4 to smithi05720651-14 2020-11-16T22:04:11.048 INFO:tasks.rados.rados.2.smithi057.stdout:630: finishing write tid 5 to smithi05720651-14 2020-11-16T22:04:11.048 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 553 (ObjNum 240 snap 80 seq_num 240) dirty exists 2020-11-16T22:04:11.048 INFO:tasks.rados.rados.2.smithi057.stdout:630: left oid 14 (ObjNum 240 snap 80 seq_num 240) 2020-11-16T22:04:11.056 INFO:tasks.rados.rados.2.smithi057.stdout:632: expect (ObjNum 180 snap 62 seq_num 180) 2020-11-16T22:04:11.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:11 smithi016 bash[10302]: cluster 2020-11-16T22:04:09.613182+0000 mgr.x (mgr.24115) 346 : cluster [DBG] pgmap v499: 17 pgs: 17 active+clean; 248 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2020-11-16T22:04:11.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:11 smithi195 bash[10218]: cluster 2020-11-16T22:04:09.613182+0000 mgr.x (mgr.24115) 346 : cluster [DBG] pgmap v499: 17 pgs: 17 active+clean; 248 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2020-11-16T22:04:11.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:11 smithi057 bash[10301]: cluster 2020-11-16T22:04:09.613182+0000 mgr.x (mgr.24115) 346 : cluster [DBG] pgmap v499: 17 pgs: 17 active+clean; 248 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2020-11-16T22:04:12.055 INFO:tasks.rados.rados.2.smithi057.stdout:629: done (3 left) 2020-11-16T22:04:12.056 INFO:tasks.rados.rados.2.smithi057.stdout:630: done (2 left) 2020-11-16T22:04:12.056 INFO:tasks.rados.rados.2.smithi057.stdout:632: done (1 left) 2020-11-16T22:04:12.056 INFO:tasks.rados.rados.2.smithi057.stdout:633: done (0 left) 2020-11-16T22:04:12.056 INFO:tasks.rados.rados.2.smithi057.stdout:634: snap_remove snap 69 2020-11-16T22:04:12.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:12 smithi016 bash[10302]: cluster 2020-11-16T22:04:11.056082+0000 mon.a (mon.0) 864 : cluster [DBG] osdmap e225: 12 total, 12 up, 12 in 2020-11-16T22:04:12.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:12 smithi195 bash[10218]: cluster 2020-11-16T22:04:11.056082+0000 mon.a (mon.0) 864 : cluster [DBG] osdmap e225: 12 total, 12 up, 12 in 2020-11-16T22:04:12.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:12 smithi057 bash[10301]: cluster 2020-11-16T22:04:11.056082+0000 mon.a (mon.0) 864 : cluster [DBG] osdmap e225: 12 total, 12 up, 12 in 2020-11-16T22:04:13.065 INFO:tasks.rados.rados.2.smithi057.stdout:634: done (0 left) 2020-11-16T22:04:13.065 INFO:tasks.rados.rados.2.smithi057.stdout:635: snap_remove snap 64 2020-11-16T22:04:13.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:13 smithi016 bash[10302]: cluster 2020-11-16T22:04:11.613976+0000 mgr.x (mgr.24115) 347 : cluster [DBG] pgmap v502: 17 pgs: 17 active+clean; 277 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 6.1 MiB/s wr, 28 op/s 2020-11-16T22:04:13.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:13 smithi016 bash[10302]: cluster 2020-11-16T22:04:12.064852+0000 mon.a (mon.0) 865 : cluster [DBG] osdmap e226: 12 total, 12 up, 12 in 2020-11-16T22:04:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:13 smithi195 bash[10218]: cluster 2020-11-16T22:04:11.613976+0000 mgr.x (mgr.24115) 347 : cluster [DBG] pgmap v502: 17 pgs: 17 active+clean; 277 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 6.1 MiB/s wr, 28 op/s 2020-11-16T22:04:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:13 smithi195 bash[10218]: cluster 2020-11-16T22:04:12.064852+0000 mon.a (mon.0) 865 : cluster [DBG] osdmap e226: 12 total, 12 up, 12 in 2020-11-16T22:04:13.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:13 smithi057 bash[10301]: cluster 2020-11-16T22:04:11.613976+0000 mgr.x (mgr.24115) 347 : cluster [DBG] pgmap v502: 17 pgs: 17 active+clean; 277 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 6.1 MiB/s wr, 28 op/s 2020-11-16T22:04:13.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:13 smithi057 bash[10301]: cluster 2020-11-16T22:04:12.064852+0000 mon.a (mon.0) 865 : cluster [DBG] osdmap e226: 12 total, 12 up, 12 in 2020-11-16T22:04:14.074 INFO:tasks.rados.rados.2.smithi057.stdout:635: done (0 left) 2020-11-16T22:04:14.074 INFO:tasks.rados.rados.2.smithi057.stdout:636: delete oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 81 2020-11-16T22:04:14.082 INFO:tasks.rados.rados.2.smithi057.stdout:636: done (0 left) 2020-11-16T22:04:14.082 INFO:tasks.rados.rados.2.smithi057.stdout:637: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 80 2020-11-16T22:04:14.082 INFO:tasks.rados.rados.2.smithi057.stdout:637: expect (ObjNum 137 snap 39 seq_num 137) 2020-11-16T22:04:14.083 INFO:tasks.rados.rados.2.smithi057.stdout:638: read oid 38 snap -1 2020-11-16T22:04:14.083 INFO:tasks.rados.rados.2.smithi057.stdout:638: expect (ObjNum 201 snap 68 seq_num 201) 2020-11-16T22:04:14.083 INFO:tasks.rados.rados.2.smithi057.stdout:639: write oid 4 current snap is 81 2020-11-16T22:04:14.083 INFO:tasks.rados.rados.2.smithi057.stdout:639: seq_num 242 ranges {467294=617201,1578407=488887} 2020-11-16T22:04:14.095 INFO:tasks.rados.rados.2.smithi057.stdout:639: writing smithi05720651-4 from 467294 to 1084495 tid 1 2020-11-16T22:04:14.101 INFO:tasks.rados.rados.2.smithi057.stdout:639: writing smithi05720651-4 from 1578407 to 2067294 tid 2 2020-11-16T22:04:14.101 INFO:tasks.rados.rados.2.smithi057.stdout:640: rollback oid 46 current snap is 81 2020-11-16T22:04:14.102 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 46 to 76 2020-11-16T22:04:14.102 INFO:tasks.rados.rados.2.smithi057.stdout:637: expect (ObjNum 137 snap 39 seq_num 137) 2020-11-16T22:04:14.208 INFO:tasks.rados.rados.2.smithi057.stdout:638: expect (ObjNum 201 snap 68 seq_num 201) 2020-11-16T22:04:14.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:14 smithi016 bash[10302]: cluster 2020-11-16T22:04:13.075972+0000 mon.a (mon.0) 866 : cluster [DBG] osdmap e227: 12 total, 12 up, 12 in 2020-11-16T22:04:14.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:14 smithi195 bash[10218]: cluster 2020-11-16T22:04:13.075972+0000 mon.a (mon.0) 866 : cluster [DBG] osdmap e227: 12 total, 12 up, 12 in 2020-11-16T22:04:14.359 INFO:tasks.rados.rados.2.smithi057.stdout:637: done (3 left) 2020-11-16T22:04:14.360 INFO:tasks.rados.rados.2.smithi057.stdout:638: done (2 left) 2020-11-16T22:04:14.360 INFO:tasks.rados.rados.2.smithi057.stdout:641: write (excl) oid 30 current snap is 81 2020-11-16T22:04:14.360 INFO:tasks.rados.rados.2.smithi057.stdout:641: seq_num 243 ranges {484101=692450,1636889=447212} 2020-11-16T22:04:14.366 INFO:tasks.rados.rados.2.smithi057.stdout:641: writing smithi05720651-30 from 484101 to 1176551 tid 1 2020-11-16T22:04:14.372 INFO:tasks.rados.rados.2.smithi057.stdout:641: writing smithi05720651-30 from 1636889 to 2084101 tid 2 2020-11-16T22:04:14.372 INFO:tasks.rados.rados.2.smithi057.stdout:642: read oid 44 snap 72 2020-11-16T22:04:14.373 INFO:tasks.rados.rados.2.smithi057.stdout:642: expect (ObjNum 116 snap 34 seq_num 116) 2020-11-16T22:04:14.373 INFO:tasks.rados.rados.2.smithi057.stdout:643: snap_remove snap 62 2020-11-16T22:04:14.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:14 smithi057 bash[10301]: cluster 2020-11-16T22:04:13.075972+0000 mon.a (mon.0) 866 : cluster [DBG] osdmap e227: 12 total, 12 up, 12 in 2020-11-16T22:04:14.904 INFO:tasks.rados.rados.2.smithi057.stdout:643: done (4 left) 2020-11-16T22:04:14.905 INFO:tasks.rados.rados.2.smithi057.stdout:644: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:14.905 INFO:tasks.rados.rados.2.smithi057.stdout:644: expect deleted 2020-11-16T22:04:14.905 INFO:tasks.rados.rados.2.smithi057.stdout:645: snap_remove snap 60 2020-11-16T22:04:15.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:15 smithi016 bash[10302]: cluster 2020-11-16T22:04:13.614655+0000 mgr.x (mgr.24115) 348 : cluster [DBG] pgmap v505: 17 pgs: 17 active+clean; 280 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 6.7 MiB/s wr, 27 op/s 2020-11-16T22:04:15.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:15 smithi016 bash[10302]: cluster 2020-11-16T22:04:14.084360+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e228: 12 total, 12 up, 12 in 2020-11-16T22:04:15.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:15 smithi016 bash[10302]: cluster 2020-11-16T22:04:14.913610+0000 mon.a (mon.0) 868 : cluster [DBG] osdmap e229: 12 total, 12 up, 12 in 2020-11-16T22:04:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:15 smithi195 bash[10218]: cluster 2020-11-16T22:04:13.614655+0000 mgr.x (mgr.24115) 348 : cluster [DBG] pgmap v505: 17 pgs: 17 active+clean; 280 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 6.7 MiB/s wr, 27 op/s 2020-11-16T22:04:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:15 smithi195 bash[10218]: cluster 2020-11-16T22:04:14.084360+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e228: 12 total, 12 up, 12 in 2020-11-16T22:04:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:15 smithi195 bash[10218]: cluster 2020-11-16T22:04:14.913610+0000 mon.a (mon.0) 868 : cluster [DBG] osdmap e229: 12 total, 12 up, 12 in 2020-11-16T22:04:15.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:15 smithi057 bash[10301]: cluster 2020-11-16T22:04:13.614655+0000 mgr.x (mgr.24115) 348 : cluster [DBG] pgmap v505: 17 pgs: 17 active+clean; 280 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 6.7 MiB/s wr, 27 op/s 2020-11-16T22:04:15.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:15 smithi057 bash[10301]: cluster 2020-11-16T22:04:14.084360+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e228: 12 total, 12 up, 12 in 2020-11-16T22:04:15.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:15 smithi057 bash[10301]: cluster 2020-11-16T22:04:14.913610+0000 mon.a (mon.0) 868 : cluster [DBG] osdmap e229: 12 total, 12 up, 12 in 2020-11-16T22:04:15.917 INFO:tasks.rados.rados.2.smithi057.stdout:645: done (5 left) 2020-11-16T22:04:15.917 INFO:tasks.rados.rados.2.smithi057.stdout:646: write (excl) oid 6 current snap is 81 2020-11-16T22:04:15.917 INFO:tasks.rados.rados.2.smithi057.stdout:646: seq_num 244 ranges {500908=484052,1411724=689184} 2020-11-16T22:04:15.923 INFO:tasks.rados.rados.2.smithi057.stdout:646: writing smithi05720651-6 from 500908 to 984960 tid 1 2020-11-16T22:04:15.931 INFO:tasks.rados.rados.2.smithi057.stdout:646: writing smithi05720651-6 from 1411724 to 2100908 tid 2 2020-11-16T22:04:15.931 INFO:tasks.rados.rados.2.smithi057.stdout:647: rollback oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 81 2020-11-16T22:04:15.932 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 73 2020-11-16T22:04:15.932 INFO:tasks.rados.rados.2.smithi057.stdout:639: finishing write tid 1 to smithi05720651-4 2020-11-16T22:04:15.932 INFO:tasks.rados.rados.2.smithi057.stdout:648: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:15.932 INFO:tasks.rados.rados.2.smithi057.stdout:648: expect (ObjNum 227 snap 77 seq_num 227) 2020-11-16T22:04:15.932 INFO:tasks.rados.rados.2.smithi057.stdout:649: rollback oid 48 current snap is 81 2020-11-16T22:04:15.932 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 48 to 52 2020-11-16T22:04:15.932 INFO:tasks.rados.rados.2.smithi057.stdout:639: finishing write tid 2 to smithi05720651-4 2020-11-16T22:04:15.933 INFO:tasks.rados.rados.2.smithi057.stdout:639: finishing write tid 4 to smithi05720651-4 2020-11-16T22:04:15.933 INFO:tasks.rados.rados.2.smithi057.stdout:640: finishing rollback tid 0 to smithi05720651-46 2020-11-16T22:04:15.933 INFO:tasks.rados.rados.2.smithi057.stdout:640: finishing rollback tid 1 to smithi05720651-46 2020-11-16T22:04:15.933 INFO:tasks.rados.rados.2.smithi057.stdout:640: finishing rollback tid 2 to smithi05720651-46 2020-11-16T22:04:15.933 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 414 (ObjNum 199 snap 67 seq_num 199) dirty exists 2020-11-16T22:04:15.933 INFO:tasks.rados.rados.2.smithi057.stdout:639: finishing write tid 5 to smithi05720651-4 2020-11-16T22:04:15.934 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 264 (ObjNum 242 snap 81 seq_num 242) dirty exists 2020-11-16T22:04:15.934 INFO:tasks.rados.rados.2.smithi057.stdout:639: left oid 4 (ObjNum 242 snap 81 seq_num 242) 2020-11-16T22:04:15.934 INFO:tasks.rados.rados.2.smithi057.stdout:639: done (8 left) 2020-11-16T22:04:15.934 INFO:tasks.rados.rados.2.smithi057.stdout:640: done (7 left) 2020-11-16T22:04:15.934 INFO:tasks.rados.rados.2.smithi057.stdout:650: read oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 80 2020-11-16T22:04:15.934 INFO:tasks.rados.rados.2.smithi057.stdout:650: expect (ObjNum 180 snap 62 seq_num 180) 2020-11-16T22:04:15.934 INFO:tasks.rados.rados.2.smithi057.stdout:651: write (excl) oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 81 2020-11-16T22:04:15.935 INFO:tasks.rados.rados.2.smithi057.stdout:651: seq_num 245 ranges {517715=559301,1870206=247509} 2020-11-16T22:04:15.940 INFO:tasks.rados.rados.2.smithi057.stdout:651: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 517715 to 1077016 tid 1 2020-11-16T22:04:15.944 INFO:tasks.rados.rados.2.smithi057.stdout:651: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1870206 to 2117715 tid 2 2020-11-16T22:04:15.945 INFO:tasks.rados.rados.2.smithi057.stdout:652: rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 81 2020-11-16T22:04:15.945 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 76 2020-11-16T22:04:15.945 INFO:tasks.rados.rados.2.smithi057.stdout:641: finishing write tid 1 to smithi05720651-30 2020-11-16T22:04:15.945 INFO:tasks.rados.rados.2.smithi057.stdout:641: finishing write tid 2 to smithi05720651-30 2020-11-16T22:04:15.945 INFO:tasks.rados.rados.2.smithi057.stdout:641: finishing write tid 4 to smithi05720651-30 2020-11-16T22:04:15.945 INFO:tasks.rados.rados.2.smithi057.stdout:641: finishing write tid 5 to smithi05720651-30 2020-11-16T22:04:15.946 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 424 (ObjNum 243 snap 81 seq_num 243) dirty exists 2020-11-16T22:04:15.946 INFO:tasks.rados.rados.2.smithi057.stdout:641: left oid 30 (ObjNum 243 snap 81 seq_num 243) 2020-11-16T22:04:15.946 INFO:tasks.rados.rados.2.smithi057.stdout:641: done (9 left) 2020-11-16T22:04:15.946 INFO:tasks.rados.rados.2.smithi057.stdout:653: rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 81 2020-11-16T22:04:15.946 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 76 2020-11-16T22:04:15.946 INFO:tasks.rados.rados.2.smithi057.stdout:642: expect (ObjNum 116 snap 34 seq_num 116) 2020-11-16T22:04:16.071 INFO:tasks.rados.rados.2.smithi057.stdout:646: finishing write tid 1 to smithi05720651-6 2020-11-16T22:04:16.071 INFO:tasks.rados.rados.2.smithi057.stdout:649: finishing rollback tid 0 to smithi05720651-48 2020-11-16T22:04:16.072 INFO:tasks.rados.rados.2.smithi057.stdout:647: finishing rollback tid 0 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:16.072 INFO:tasks.rados.rados.2.smithi057.stdout:649: finishing rollback tid 1 to smithi05720651-48 2020-11-16T22:04:16.072 INFO:tasks.rados.rados.2.smithi057.stdout:649: finishing rollback tid 2 to smithi05720651-48 2020-11-16T22:04:16.072 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 168 (ObjNum 144 snap 44 seq_num 144) dirty exists 2020-11-16T22:04:16.072 INFO:tasks.rados.rados.2.smithi057.stdout:647: finishing rollback tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:16.072 INFO:tasks.rados.rados.2.smithi057.stdout:646: finishing write tid 2 to smithi05720651-6 2020-11-16T22:04:16.072 INFO:tasks.rados.rados.2.smithi057.stdout:646: finishing write tid 4 to smithi05720651-6 2020-11-16T22:04:16.073 INFO:tasks.rados.rados.2.smithi057.stdout:646: finishing write tid 5 to smithi05720651-6 2020-11-16T22:04:16.073 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 490 (ObjNum 244 snap 81 seq_num 244) dirty exists 2020-11-16T22:04:16.073 INFO:tasks.rados.rados.2.smithi057.stdout:646: left oid 6 (ObjNum 244 snap 81 seq_num 244) 2020-11-16T22:04:16.073 INFO:tasks.rados.rados.2.smithi057.stdout:647: finishing rollback tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:16.073 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 491 (ObjNum 194 snap 64 seq_num 194) dirty exists 2020-11-16T22:04:16.073 INFO:tasks.rados.rados.2.smithi057.stdout:650: expect (ObjNum 180 snap 62 seq_num 180) 2020-11-16T22:04:16.166 INFO:tasks.rados.rados.2.smithi057.stdout:652: finishing rollback tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:16.166 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 321 snap 0 seq_num 0) dirty dne 2020-11-16T22:04:16.166 INFO:tasks.rados.rados.2.smithi057.stdout:651: finishing write tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:16.167 INFO:tasks.rados.rados.2.smithi057.stdout:653: finishing rollback tid 0 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:16.167 INFO:tasks.rados.rados.2.smithi057.stdout:653: finishing rollback tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:16.167 INFO:tasks.rados.rados.2.smithi057.stdout:651: finishing write tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:16.167 INFO:tasks.rados.rados.2.smithi057.stdout:653: finishing rollback tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:16.167 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 371 (ObjNum 196 snap 66 seq_num 196) dirty exists 2020-11-16T22:04:16.167 INFO:tasks.rados.rados.2.smithi057.stdout:651: finishing write tid 4 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:16.167 INFO:tasks.rados.rados.2.smithi057.stdout:651: finishing write tid 5 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:16.168 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 436 (ObjNum 245 snap 81 seq_num 245) dirty exists 2020-11-16T22:04:16.168 INFO:tasks.rados.rados.2.smithi057.stdout:651: left oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 245 snap 81 seq_num 245) 2020-11-16T22:04:16.168 INFO:tasks.rados.rados.2.smithi057.stdout:648: expect (ObjNum 227 snap 77 seq_num 227) 2020-11-16T22:04:16.281 INFO:tasks.rados.rados.2.smithi057.stdout:642: done (9 left) 2020-11-16T22:04:16.281 INFO:tasks.rados.rados.2.smithi057.stdout:644: done (8 left) 2020-11-16T22:04:16.281 INFO:tasks.rados.rados.2.smithi057.stdout:646: done (7 left) 2020-11-16T22:04:16.281 INFO:tasks.rados.rados.2.smithi057.stdout:647: done (6 left) 2020-11-16T22:04:16.281 INFO:tasks.rados.rados.2.smithi057.stdout:648: done (5 left) 2020-11-16T22:04:16.281 INFO:tasks.rados.rados.2.smithi057.stdout:649: done (4 left) 2020-11-16T22:04:16.282 INFO:tasks.rados.rados.2.smithi057.stdout:650: done (3 left) 2020-11-16T22:04:16.282 INFO:tasks.rados.rados.2.smithi057.stdout:651: done (2 left) 2020-11-16T22:04:16.282 INFO:tasks.rados.rados.2.smithi057.stdout:652: done (1 left) 2020-11-16T22:04:16.283 INFO:tasks.rados.rados.2.smithi057.stdout:653: done (0 left) 2020-11-16T22:04:16.283 INFO:tasks.rados.rados.2.smithi057.stdout:654: read oid 20 snap 80 2020-11-16T22:04:16.283 INFO:tasks.rados.rados.2.smithi057.stdout:654: expect deleted 2020-11-16T22:04:16.283 INFO:tasks.rados.rados.2.smithi057.stdout:655: delete oid 8 current snap is 81 2020-11-16T22:04:16.287 INFO:tasks.rados.rados.2.smithi057.stdout:654: done (1 left) 2020-11-16T22:04:16.287 INFO:tasks.rados.rados.2.smithi057.stdout:655: done (0 left) 2020-11-16T22:04:16.287 INFO:tasks.rados.rados.2.smithi057.stdout:656: read oid 34 snap -1 2020-11-16T22:04:16.287 INFO:tasks.rados.rados.2.smithi057.stdout:656: expect (ObjNum 157 snap 55 seq_num 157) 2020-11-16T22:04:16.287 INFO:tasks.rados.rados.2.smithi057.stdout:657: snap_remove snap 74 2020-11-16T22:04:17.080 INFO:tasks.rados.rados.2.smithi057.stdout:657: done (1 left) 2020-11-16T22:04:17.080 INFO:tasks.rados.rados.2.smithi057.stdout:658: rollback oid 20 current snap is 81 2020-11-16T22:04:17.080 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 20 to 77 2020-11-16T22:04:17.080 INFO:tasks.rados.rados.2.smithi057.stdout:656: expect (ObjNum 157 snap 55 seq_num 157) 2020-11-16T22:04:17.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:16 smithi057 bash[10301]: cluster 2020-11-16T22:04:15.615366+0000 mgr.x (mgr.24115) 349 : cluster [DBG] pgmap v508: 17 pgs: 17 active+clean; 270 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 853 KiB/s wr, 6 op/s 2020-11-16T22:04:17.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:16 smithi057 bash[10301]: cluster 2020-11-16T22:04:15.924080+0000 mon.a (mon.0) 869 : cluster [DBG] osdmap e230: 12 total, 12 up, 12 in 2020-11-16T22:04:17.286 INFO:tasks.rados.rados.2.smithi057.stdout:658: finishing rollback tid 1 to smithi05720651-20 2020-11-16T22:04:17.286 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 261 (ObjNum 129 snap 0 seq_num 2932679040) dirty dne 2020-11-16T22:04:17.286 INFO:tasks.rados.rados.2.smithi057.stdout:656: done (1 left) 2020-11-16T22:04:17.287 INFO:tasks.rados.rados.2.smithi057.stdout:658: done (0 left) 2020-11-16T22:04:17.287 INFO:tasks.rados.rados.2.smithi057.stdout:659: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:17.287 INFO:tasks.rados.rados.2.smithi057.stdout:659: expect deleted 2020-11-16T22:04:17.288 INFO:tasks.rados.rados.2.smithi057.stdout:660: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:17.288 INFO:tasks.rados.rados.2.smithi057.stdout:660: expect deleted 2020-11-16T22:04:17.288 INFO:tasks.rados.rados.2.smithi057.stdout:661: write oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 81 2020-11-16T22:04:17.288 INFO:tasks.rados.rados.2.smithi057.stdout:661: seq_num 247 ranges {551329=709799,1870817=280512} 2020-11-16T22:04:17.293 INFO:tasks.rados.rados.2.smithi057.stdout:661: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 551329 to 1261128 tid 1 2020-11-16T22:04:17.299 INFO:tasks.rados.rados.2.smithi057.stdout:661: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1870817 to 2151329 tid 2 2020-11-16T22:04:17.300 INFO:tasks.rados.rados.2.smithi057.stdout:662: rollback oid 34 current snap is 81 2020-11-16T22:04:17.300 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 34 to 76 2020-11-16T22:04:17.300 INFO:tasks.rados.rados.2.smithi057.stdout:659: done (3 left) 2020-11-16T22:04:17.300 INFO:tasks.rados.rados.2.smithi057.stdout:660: done (2 left) 2020-11-16T22:04:17.300 INFO:tasks.rados.rados.2.smithi057.stdout:663: delete oid 24 current snap is 81 2020-11-16T22:04:17.303 INFO:tasks.rados.rados.2.smithi057.stdout:661: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:17.303 INFO:tasks.rados.rados.2.smithi057.stdout:663: done (2 left) 2020-11-16T22:04:17.304 INFO:tasks.rados.rados.2.smithi057.stdout:664: read oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 72 2020-11-16T22:04:17.304 INFO:tasks.rados.rados.2.smithi057.stdout:664: expect (ObjNum 109 snap 32 seq_num 109) 2020-11-16T22:04:17.304 INFO:tasks.rados.rados.2.smithi057.stdout:665: read oid 30 snap -1 2020-11-16T22:04:17.304 INFO:tasks.rados.rados.2.smithi057.stdout:665: expect (ObjNum 243 snap 81 seq_num 243) 2020-11-16T22:04:17.305 INFO:tasks.rados.rados.2.smithi057.stdout:666: snap_create 2020-11-16T22:04:17.305 INFO:tasks.rados.rados.2.smithi057.stdout:661: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:17.305 INFO:tasks.rados.rados.2.smithi057.stdout:662: finishing rollback tid 0 to smithi05720651-34 2020-11-16T22:04:17.305 INFO:tasks.rados.rados.2.smithi057.stdout:661: finishing write tid 4 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:17.305 INFO:tasks.rados.rados.2.smithi057.stdout:662: finishing rollback tid 1 to smithi05720651-34 2020-11-16T22:04:17.306 INFO:tasks.rados.rados.2.smithi057.stdout:661: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:17.306 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 200 (ObjNum 247 snap 81 seq_num 247) dirty exists 2020-11-16T22:04:17.306 INFO:tasks.rados.rados.2.smithi057.stdout:661: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 247 snap 81 seq_num 247) 2020-11-16T22:04:17.307 INFO:tasks.rados.rados.2.smithi057.stdout:662: finishing rollback tid 2 to smithi05720651-34 2020-11-16T22:04:17.307 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 267 (ObjNum 130 snap 37 seq_num 130) dirty exists 2020-11-16T22:04:17.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:16 smithi016 bash[10302]: cluster 2020-11-16T22:04:15.615366+0000 mgr.x (mgr.24115) 349 : cluster [DBG] pgmap v508: 17 pgs: 17 active+clean; 270 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 853 KiB/s wr, 6 op/s 2020-11-16T22:04:17.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:16 smithi016 bash[10302]: cluster 2020-11-16T22:04:15.924080+0000 mon.a (mon.0) 869 : cluster [DBG] osdmap e230: 12 total, 12 up, 12 in 2020-11-16T22:04:17.343 INFO:tasks.rados.rados.2.smithi057.stdout:664: expect (ObjNum 109 snap 32 seq_num 109) 2020-11-16T22:04:17.348 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:16 smithi195 bash[10218]: cluster 2020-11-16T22:04:15.615366+0000 mgr.x (mgr.24115) 349 : cluster [DBG] pgmap v508: 17 pgs: 17 active+clean; 270 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 853 KiB/s wr, 6 op/s 2020-11-16T22:04:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:16 smithi195 bash[10218]: cluster 2020-11-16T22:04:15.924080+0000 mon.a (mon.0) 869 : cluster [DBG] osdmap e230: 12 total, 12 up, 12 in 2020-11-16T22:04:17.563 INFO:tasks.rados.rados.2.smithi057.stdout:665: expect (ObjNum 243 snap 81 seq_num 243) 2020-11-16T22:04:18.091 INFO:tasks.rados.rados.2.smithi057.stdout:661: done (4 left) 2020-11-16T22:04:18.091 INFO:tasks.rados.rados.2.smithi057.stdout:662: done (3 left) 2020-11-16T22:04:18.092 INFO:tasks.rados.rados.2.smithi057.stdout:664: done (2 left) 2020-11-16T22:04:18.092 INFO:tasks.rados.rados.2.smithi057.stdout:665: done (1 left) 2020-11-16T22:04:18.092 INFO:tasks.rados.rados.2.smithi057.stdout:666: done (0 left) 2020-11-16T22:04:18.092 INFO:tasks.rados.rados.2.smithi057.stdout:667: write oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 82 2020-11-16T22:04:18.092 INFO:tasks.rados.rados.2.smithi057.stdout:667: seq_num 249 ranges {584943=460297,1587781=597162} 2020-11-16T22:04:18.102 INFO:tasks.rados.rados.2.smithi057.stdout:667: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 584943 to 1045240 tid 1 2020-11-16T22:04:18.110 INFO:tasks.rados.rados.2.smithi057.stdout:667: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1587781 to 2184943 tid 2 2020-11-16T22:04:18.110 INFO:tasks.rados.rados.2.smithi057.stdout:668: snap_remove snap 77 2020-11-16T22:04:18.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:18 smithi016 bash[10302]: cluster 2020-11-16T22:04:17.090077+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e231: 12 total, 12 up, 12 in 2020-11-16T22:04:18.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:18 smithi195 bash[10218]: cluster 2020-11-16T22:04:17.090077+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e231: 12 total, 12 up, 12 in 2020-11-16T22:04:18.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:18 smithi057 bash[10301]: cluster 2020-11-16T22:04:17.090077+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e231: 12 total, 12 up, 12 in 2020-11-16T22:04:19.102 INFO:tasks.rados.rados.2.smithi057.stdout:668: done (1 left) 2020-11-16T22:04:19.102 INFO:tasks.rados.rados.2.smithi057.stdout:669: snap_create 2020-11-16T22:04:19.103 INFO:tasks.rados.rados.2.smithi057.stdout:667: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:19.103 INFO:tasks.rados.rados.2.smithi057.stdout:667: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:19.103 INFO:tasks.rados.rados.2.smithi057.stdout:667: finishing write tid 4 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:19.103 INFO:tasks.rados.rados.2.smithi057.stdout:667: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:19.103 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 203 (ObjNum 249 snap 82 seq_num 249) dirty exists 2020-11-16T22:04:19.103 INFO:tasks.rados.rados.2.smithi057.stdout:667: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 249 snap 82 seq_num 249) 2020-11-16T22:04:19.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:19 smithi195 bash[10218]: cluster 2020-11-16T22:04:17.616090+0000 mgr.x (mgr.24115) 350 : cluster [DBG] pgmap v511: 17 pgs: 17 active+clean; 254 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 487 KiB/s wr, 12 op/s 2020-11-16T22:04:19.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:19 smithi195 bash[10218]: cluster 2020-11-16T22:04:18.100102+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e232: 12 total, 12 up, 12 in 2020-11-16T22:04:19.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:19 smithi057 bash[10301]: cluster 2020-11-16T22:04:17.616090+0000 mgr.x (mgr.24115) 350 : cluster [DBG] pgmap v511: 17 pgs: 17 active+clean; 254 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 487 KiB/s wr, 12 op/s 2020-11-16T22:04:19.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:19 smithi057 bash[10301]: cluster 2020-11-16T22:04:18.100102+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e232: 12 total, 12 up, 12 in 2020-11-16T22:04:19.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:19 smithi016 bash[10302]: cluster 2020-11-16T22:04:17.616090+0000 mgr.x (mgr.24115) 350 : cluster [DBG] pgmap v511: 17 pgs: 17 active+clean; 254 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 487 KiB/s wr, 12 op/s 2020-11-16T22:04:19.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:19 smithi016 bash[10302]: cluster 2020-11-16T22:04:18.100102+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e232: 12 total, 12 up, 12 in 2020-11-16T22:04:19.904 INFO:tasks.rados.rados.2.smithi057.stdout:667: done (1 left) 2020-11-16T22:04:19.905 INFO:tasks.rados.rados.2.smithi057.stdout:669: done (0 left) 2020-11-16T22:04:19.905 INFO:tasks.rados.rados.2.smithi057.stdout:670: snap_remove snap 73 2020-11-16T22:04:20.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:20 smithi057 bash[10301]: cluster 2020-11-16T22:04:19.109150+0000 mon.a (mon.0) 872 : cluster [DBG] osdmap e233: 12 total, 12 up, 12 in 2020-11-16T22:04:20.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:20 smithi057 bash[10301]: cluster 2020-11-16T22:04:19.915091+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e234: 12 total, 12 up, 12 in 2020-11-16T22:04:20.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:20 smithi016 bash[10302]: cluster 2020-11-16T22:04:19.109150+0000 mon.a (mon.0) 872 : cluster [DBG] osdmap e233: 12 total, 12 up, 12 in 2020-11-16T22:04:20.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:20 smithi016 bash[10302]: cluster 2020-11-16T22:04:19.915091+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e234: 12 total, 12 up, 12 in 2020-11-16T22:04:20.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:20 smithi195 bash[10218]: cluster 2020-11-16T22:04:19.109150+0000 mon.a (mon.0) 872 : cluster [DBG] osdmap e233: 12 total, 12 up, 12 in 2020-11-16T22:04:20.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:20 smithi195 bash[10218]: cluster 2020-11-16T22:04:19.915091+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e234: 12 total, 12 up, 12 in 2020-11-16T22:04:20.918 INFO:tasks.rados.rados.2.smithi057.stdout:670: done (0 left) 2020-11-16T22:04:20.918 INFO:tasks.rados.rados.2.smithi057.stdout:671: read oid 20 snap -1 2020-11-16T22:04:20.918 INFO:tasks.rados.rados.2.smithi057.stdout:671: expect deleted 2020-11-16T22:04:20.919 INFO:tasks.rados.rados.2.smithi057.stdout:672: write (excl) oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 83 2020-11-16T22:04:20.919 INFO:tasks.rados.rados.2.smithi057.stdout:672: seq_num 250 ranges {601750=535546,1929910=271840} 2020-11-16T22:04:20.926 INFO:tasks.rados.rados.2.smithi057.stdout:672: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 601750 to 1137296 tid 1 2020-11-16T22:04:20.932 INFO:tasks.rados.rados.2.smithi057.stdout:672: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1929910 to 2201750 tid 2 2020-11-16T22:04:20.932 INFO:tasks.rados.rados.2.smithi057.stdout:673: copy_from oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 48 current snap is 83 2020-11-16T22:04:20.933 INFO:tasks.rados.rados.2.smithi057.stdout:671: done (2 left) 2020-11-16T22:04:20.933 INFO:tasks.rados.rados.2.smithi057.stdout:674: snap_create 2020-11-16T22:04:20.935 INFO:tasks.rados.rados.2.smithi057.stdout:672: finishing write tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:20.938 INFO:tasks.rados.rados.2.smithi057.stdout:672: finishing write tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:20.939 INFO:tasks.rados.rados.2.smithi057.stdout:672: finishing write tid 4 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:20.939 INFO:tasks.rados.rados.2.smithi057.stdout:672: finishing write tid 5 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:20.939 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 154 (ObjNum 250 snap 83 seq_num 250) dirty exists 2020-11-16T22:04:20.940 INFO:tasks.rados.rados.2.smithi057.stdout:672: left oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 250 snap 83 seq_num 250) 2020-11-16T22:04:20.953 INFO:tasks.rados.rados.2.smithi057.stdout:673: finishing copy_from to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:20.953 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 168 (ObjNum 144 snap 44 seq_num 144) dirty exists 2020-11-16T22:04:20.953 INFO:tasks.rados.rados.2.smithi057.stdout:673: finishing copy_from racing read to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:21.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:21 smithi057 bash[10301]: cluster 2020-11-16T22:04:19.616793+0000 mgr.x (mgr.24115) 351 : cluster [DBG] pgmap v514: 17 pgs: 17 active+clean; 257 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 549 KiB/s wr, 10 op/s 2020-11-16T22:04:21.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:21 smithi057 bash[10301]: cluster 2020-11-16T22:04:20.923584+0000 mon.a (mon.0) 874 : cluster [DBG] osdmap e235: 12 total, 12 up, 12 in 2020-11-16T22:04:21.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:21 smithi016 bash[10302]: cluster 2020-11-16T22:04:19.616793+0000 mgr.x (mgr.24115) 351 : cluster [DBG] pgmap v514: 17 pgs: 17 active+clean; 257 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 549 KiB/s wr, 10 op/s 2020-11-16T22:04:21.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:21 smithi016 bash[10302]: cluster 2020-11-16T22:04:20.923584+0000 mon.a (mon.0) 874 : cluster [DBG] osdmap e235: 12 total, 12 up, 12 in 2020-11-16T22:04:21.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:21 smithi195 bash[10218]: cluster 2020-11-16T22:04:19.616793+0000 mgr.x (mgr.24115) 351 : cluster [DBG] pgmap v514: 17 pgs: 17 active+clean; 257 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 549 KiB/s wr, 10 op/s 2020-11-16T22:04:21.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:21 smithi195 bash[10218]: cluster 2020-11-16T22:04:20.923584+0000 mon.a (mon.0) 874 : cluster [DBG] osdmap e235: 12 total, 12 up, 12 in 2020-11-16T22:04:21.924 INFO:tasks.rados.rados.2.smithi057.stdout:672: done (2 left) 2020-11-16T22:04:21.924 INFO:tasks.rados.rados.2.smithi057.stdout:673: done (1 left) 2020-11-16T22:04:21.924 INFO:tasks.rados.rados.2.smithi057.stdout:674: done (0 left) 2020-11-16T22:04:21.925 INFO:tasks.rados.rados.2.smithi057.stdout:675: write oid 16 current snap is 84 2020-11-16T22:04:21.925 INFO:tasks.rados.rados.2.smithi057.stdout:675: seq_num 251 ranges {618557=727148,2104745=113812} 2020-11-16T22:04:21.937 INFO:tasks.rados.rados.2.smithi057.stdout:675: writing smithi05720651-16 from 618557 to 1345705 tid 1 2020-11-16T22:04:21.942 INFO:tasks.rados.rados.2.smithi057.stdout:675: writing smithi05720651-16 from 2104745 to 2218557 tid 2 2020-11-16T22:04:21.942 INFO:tasks.rados.rados.2.smithi057.stdout:676: delete oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 84 2020-11-16T22:04:21.948 INFO:tasks.rados.rados.2.smithi057.stdout:676: done (1 left) 2020-11-16T22:04:21.948 INFO:tasks.rados.rados.2.smithi057.stdout:677: read oid 26 snap -1 2020-11-16T22:04:21.948 INFO:tasks.rados.rados.2.smithi057.stdout:677: expect (ObjNum 188 snap 64 seq_num 188) 2020-11-16T22:04:21.948 INFO:tasks.rados.rados.2.smithi057.stdout:678: write oid 46 current snap is 84 2020-11-16T22:04:21.948 INFO:tasks.rados.rados.2.smithi057.stdout:678: seq_num 253 ranges {652171=477646,1821709=430462} 2020-11-16T22:04:21.955 INFO:tasks.rados.rados.2.smithi057.stdout:678: writing smithi05720651-46 from 652171 to 1129817 tid 1 2020-11-16T22:04:21.963 INFO:tasks.rados.rados.2.smithi057.stdout:678: writing smithi05720651-46 from 1821709 to 2252171 tid 2 2020-11-16T22:04:21.963 INFO:tasks.rados.rados.2.smithi057.stdout:679: delete oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 84 2020-11-16T22:04:21.963 INFO:tasks.rados.rados.2.smithi057.stdout:675: finishing write tid 1 to smithi05720651-16 2020-11-16T22:04:21.963 INFO:tasks.rados.rados.2.smithi057.stdout:675: finishing write tid 2 to smithi05720651-16 2020-11-16T22:04:21.963 INFO:tasks.rados.rados.2.smithi057.stdout:675: finishing write tid 4 to smithi05720651-16 2020-11-16T22:04:21.964 INFO:tasks.rados.rados.2.smithi057.stdout:675: finishing write tid 5 to smithi05720651-16 2020-11-16T22:04:21.964 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 460 (ObjNum 251 snap 84 seq_num 251) dirty exists 2020-11-16T22:04:21.964 INFO:tasks.rados.rados.2.smithi057.stdout:675: left oid 16 (ObjNum 251 snap 84 seq_num 251) 2020-11-16T22:04:21.964 INFO:tasks.rados.rados.2.smithi057.stdout:677: expect (ObjNum 188 snap 64 seq_num 188) 2020-11-16T22:04:22.168 INFO:tasks.rados.rados.2.smithi057.stdout:678: finishing write tid 1 to smithi05720651-46 2020-11-16T22:04:22.168 INFO:tasks.rados.rados.2.smithi057.stdout:678: finishing write tid 2 to smithi05720651-46 2020-11-16T22:04:22.169 INFO:tasks.rados.rados.2.smithi057.stdout:678: finishing write tid 4 to smithi05720651-46 2020-11-16T22:04:22.169 INFO:tasks.rados.rados.2.smithi057.stdout:678: finishing write tid 5 to smithi05720651-46 2020-11-16T22:04:22.169 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 464 (ObjNum 253 snap 84 seq_num 253) dirty exists 2020-11-16T22:04:22.169 INFO:tasks.rados.rados.2.smithi057.stdout:678: left oid 46 (ObjNum 253 snap 84 seq_num 253) 2020-11-16T22:04:22.169 INFO:tasks.rados.rados.2.smithi057.stdout:675: done (3 left) 2020-11-16T22:04:22.169 INFO:tasks.rados.rados.2.smithi057.stdout:677: done (2 left) 2020-11-16T22:04:22.169 INFO:tasks.rados.rados.2.smithi057.stdout:678: done (1 left) 2020-11-16T22:04:22.170 INFO:tasks.rados.rados.2.smithi057.stdout:679: done (0 left) 2020-11-16T22:04:22.170 INFO:tasks.rados.rados.2.smithi057.stdout:680: copy_from oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 12 current snap is 84 2020-11-16T22:04:22.170 INFO:tasks.rados.rados.2.smithi057.stdout:681: rollback oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 84 2020-11-16T22:04:22.170 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 83 2020-11-16T22:04:22.170 INFO:tasks.rados.rados.2.smithi057.stdout:682: rollback oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 84 2020-11-16T22:04:22.170 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 76 2020-11-16T22:04:22.170 INFO:tasks.rados.rados.2.smithi057.stdout:683: snap_remove snap 81 2020-11-16T22:04:23.117 INFO:tasks.rados.rados.2.smithi057.stdout:683: done (3 left) 2020-11-16T22:04:23.117 INFO:tasks.rados.rados.2.smithi057.stdout:684: delete oid 24 current snap is 84 2020-11-16T22:04:23.117 INFO:tasks.rados.rados.2.smithi057.stdout:682: finishing rollback tid 0 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:23.117 INFO:tasks.rados.rados.2.smithi057.stdout:681: finishing rollback tid 0 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:23.117 INFO:tasks.rados.rados.2.smithi057.stdout:682: finishing rollback tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:23.118 INFO:tasks.rados.rados.2.smithi057.stdout:681: finishing rollback tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:23.118 INFO:tasks.rados.rados.2.smithi057.stdout:682: finishing rollback tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:23.118 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 389 (ObjNum 180 snap 62 seq_num 180) dirty exists 2020-11-16T22:04:23.118 INFO:tasks.rados.rados.2.smithi057.stdout:681: finishing rollback tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:23.118 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 631 (ObjNum 174 snap 58 seq_num 174) dirty exists 2020-11-16T22:04:23.118 INFO:tasks.rados.rados.2.smithi057.stdout:680: finishing copy_from to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:23.118 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 287 (ObjNum 149 snap 48 seq_num 149) dirty exists 2020-11-16T22:04:23.119 INFO:tasks.rados.rados.2.smithi057.stdout:680: finishing copy_from racing read to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:23.124 INFO:tasks.rados.rados.2.smithi057.stdout:680: done (3 left) 2020-11-16T22:04:23.124 INFO:tasks.rados.rados.2.smithi057.stdout:681: done (2 left) 2020-11-16T22:04:23.124 INFO:tasks.rados.rados.2.smithi057.stdout:682: done (1 left) 2020-11-16T22:04:23.124 INFO:tasks.rados.rados.2.smithi057.stdout:684: done (0 left) 2020-11-16T22:04:23.124 INFO:tasks.rados.rados.2.smithi057.stdout:685: copy_from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 32 current snap is 84 2020-11-16T22:04:23.124 INFO:tasks.rados.rados.2.smithi057.stdout:686: read oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 83 2020-11-16T22:04:23.125 INFO:tasks.rados.rados.2.smithi057.stdout:686: expect (ObjNum 193 snap 64 seq_num 193) 2020-11-16T22:04:23.125 INFO:tasks.rados.rados.2.smithi057.stdout:687: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:23.125 INFO:tasks.rados.rados.2.smithi057.stdout:687: expect (ObjNum 174 snap 58 seq_num 174) 2020-11-16T22:04:23.125 INFO:tasks.rados.rados.2.smithi057.stdout:688: delete oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 84 2020-11-16T22:04:23.137 INFO:tasks.rados.rados.2.smithi057.stdout:688: done (3 left) 2020-11-16T22:04:23.137 INFO:tasks.rados.rados.2.smithi057.stdout:689: write (excl) oid 44 current snap is 84 2020-11-16T22:04:23.137 INFO:tasks.rados.rados.2.smithi057.stdout:689: seq_num 257 ranges {719399=778642,1939284=380115} 2020-11-16T22:04:23.150 INFO:tasks.rados.rados.2.smithi057.stdout:689: writing smithi05720651-44 from 719399 to 1498041 tid 1 2020-11-16T22:04:23.156 INFO:tasks.rados.rados.2.smithi057.stdout:689: writing smithi05720651-44 from 1939284 to 2319399 tid 2 2020-11-16T22:04:23.156 INFO:tasks.rados.rados.2.smithi057.stdout:690: rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 84 2020-11-16T22:04:23.156 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 82 2020-11-16T22:04:23.156 INFO:tasks.rados.rados.2.smithi057.stdout:686: expect (ObjNum 193 snap 64 seq_num 193) 2020-11-16T22:04:23.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:22 smithi057 bash[10301]: cluster 2020-11-16T22:04:21.617500+0000 mgr.x (mgr.24115) 352 : cluster [DBG] pgmap v517: 17 pgs: 17 active+clean; 246 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 754 KiB/s wr, 21 op/s 2020-11-16T22:04:23.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:22 smithi057 bash[10301]: cluster 2020-11-16T22:04:21.928168+0000 mon.a (mon.0) 875 : cluster [DBG] osdmap e236: 12 total, 12 up, 12 in 2020-11-16T22:04:23.257 INFO:tasks.rados.rados.2.smithi057.stdout:689: finishing write tid 1 to smithi05720651-44 2020-11-16T22:04:23.257 INFO:tasks.rados.rados.2.smithi057.stdout:687: expect (ObjNum 174 snap 58 seq_num 174) 2020-11-16T22:04:23.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:22 smithi016 bash[10302]: cluster 2020-11-16T22:04:21.617500+0000 mgr.x (mgr.24115) 352 : cluster [DBG] pgmap v517: 17 pgs: 17 active+clean; 246 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 754 KiB/s wr, 21 op/s 2020-11-16T22:04:23.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:22 smithi016 bash[10302]: cluster 2020-11-16T22:04:21.928168+0000 mon.a (mon.0) 875 : cluster [DBG] osdmap e236: 12 total, 12 up, 12 in 2020-11-16T22:04:23.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:22 smithi195 bash[10218]: cluster 2020-11-16T22:04:21.617500+0000 mgr.x (mgr.24115) 352 : cluster [DBG] pgmap v517: 17 pgs: 17 active+clean; 246 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 754 KiB/s wr, 21 op/s 2020-11-16T22:04:23.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:22 smithi195 bash[10218]: cluster 2020-11-16T22:04:21.928168+0000 mon.a (mon.0) 875 : cluster [DBG] osdmap e236: 12 total, 12 up, 12 in 2020-11-16T22:04:23.495 INFO:tasks.rados.rados.2.smithi057.stdout:690: finishing rollback tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:23.495 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 769 snap 0 seq_num 2932734176) dirty dne 2020-11-16T22:04:23.495 INFO:tasks.rados.rados.2.smithi057.stdout:685: finishing copy_from to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:23.496 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 193 (ObjNum 180 snap 62 seq_num 180) dirty exists 2020-11-16T22:04:23.496 INFO:tasks.rados.rados.2.smithi057.stdout:689: finishing write tid 2 to smithi05720651-44 2020-11-16T22:04:23.496 INFO:tasks.rados.rados.2.smithi057.stdout:689: finishing write tid 4 to smithi05720651-44 2020-11-16T22:04:23.496 INFO:tasks.rados.rados.2.smithi057.stdout:685: finishing copy_from racing read to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:23.496 INFO:tasks.rados.rados.2.smithi057.stdout:689: finishing write tid 5 to smithi05720651-44 2020-11-16T22:04:23.496 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 297 (ObjNum 257 snap 84 seq_num 257) dirty exists 2020-11-16T22:04:23.496 INFO:tasks.rados.rados.2.smithi057.stdout:689: left oid 44 (ObjNum 257 snap 84 seq_num 257) 2020-11-16T22:04:23.497 INFO:tasks.rados.rados.2.smithi057.stdout:685: done (4 left) 2020-11-16T22:04:23.497 INFO:tasks.rados.rados.2.smithi057.stdout:686: done (3 left) 2020-11-16T22:04:23.497 INFO:tasks.rados.rados.2.smithi057.stdout:687: done (2 left) 2020-11-16T22:04:23.497 INFO:tasks.rados.rados.2.smithi057.stdout:689: done (1 left) 2020-11-16T22:04:23.497 INFO:tasks.rados.rados.2.smithi057.stdout:690: done (0 left) 2020-11-16T22:04:23.497 INFO:tasks.rados.rados.2.smithi057.stdout:691: snap_create 2020-11-16T22:04:24.125 INFO:tasks.rados.rados.2.smithi057.stdout:691: done (0 left) 2020-11-16T22:04:24.126 INFO:tasks.rados.rados.2.smithi057.stdout:692: delete oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 85 2020-11-16T22:04:24.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:24 smithi057 bash[10301]: cluster 2020-11-16T22:04:23.125743+0000 mon.a (mon.0) 876 : cluster [DBG] osdmap e237: 12 total, 12 up, 12 in 2020-11-16T22:04:24.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:24 smithi016 bash[10302]: cluster 2020-11-16T22:04:23.125743+0000 mon.a (mon.0) 876 : cluster [DBG] osdmap e237: 12 total, 12 up, 12 in 2020-11-16T22:04:24.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:24 smithi195 bash[10218]: cluster 2020-11-16T22:04:23.125743+0000 mon.a (mon.0) 876 : cluster [DBG] osdmap e237: 12 total, 12 up, 12 in 2020-11-16T22:04:24.932 INFO:tasks.rados.rados.2.smithi057.stdout:692: done (0 left) 2020-11-16T22:04:24.932 INFO:tasks.rados.rados.2.smithi057.stdout:693: rollback oid 40 current snap is 85 2020-11-16T22:04:24.933 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 40 to 82 2020-11-16T22:04:24.933 INFO:tasks.rados.rados.2.smithi057.stdout:694: read oid 34 snap -1 2020-11-16T22:04:24.933 INFO:tasks.rados.rados.2.smithi057.stdout:694: expect (ObjNum 130 snap 37 seq_num 130) 2020-11-16T22:04:24.933 INFO:tasks.rados.rados.2.smithi057.stdout:695: delete oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 85 2020-11-16T22:04:24.936 INFO:tasks.rados.rados.2.smithi057.stdout:695: done (2 left) 2020-11-16T22:04:24.936 INFO:tasks.rados.rados.2.smithi057.stdout:696: copy_from oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 2 current snap is 85 2020-11-16T22:04:24.937 INFO:tasks.rados.rados.2.smithi057.stdout:693: finishing rollback tid 1 to smithi05720651-40 2020-11-16T22:04:24.937 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 545 (ObjNum 129 snap 0 seq_num 2932366192) dirty dne 2020-11-16T22:04:24.937 INFO:tasks.rados.rados.2.smithi057.stdout:693: done (2 left) 2020-11-16T22:04:24.937 INFO:tasks.rados.rados.2.smithi057.stdout:697: snap_create 2020-11-16T22:04:24.938 INFO:tasks.rados.rados.2.smithi057.stdout:694: expect (ObjNum 130 snap 37 seq_num 130) 2020-11-16T22:04:25.040 INFO:tasks.rados.rados.2.smithi057.stdout:696: finishing copy_from to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:25.040 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 423 (ObjNum 192 snap 64 seq_num 192) dirty exists 2020-11-16T22:04:25.041 INFO:tasks.rados.rados.2.smithi057.stdout:696: finishing copy_from racing read to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:25.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:25 smithi057 bash[10301]: cluster 2020-11-16T22:04:23.618176+0000 mgr.x (mgr.24115) 353 : cluster [DBG] pgmap v520: 17 pgs: 17 active+clean; 245 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 984 KiB/s wr, 18 op/s 2020-11-16T22:04:25.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:25 smithi057 bash[10301]: cluster 2020-11-16T22:04:24.136376+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e238: 12 total, 12 up, 12 in 2020-11-16T22:04:25.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:25 smithi057 bash[10301]: cluster 2020-11-16T22:04:24.916833+0000 mon.a (mon.0) 878 : cluster [DBG] osdmap e239: 12 total, 12 up, 12 in 2020-11-16T22:04:25.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:25 smithi016 bash[10302]: cluster 2020-11-16T22:04:23.618176+0000 mgr.x (mgr.24115) 353 : cluster [DBG] pgmap v520: 17 pgs: 17 active+clean; 245 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 984 KiB/s wr, 18 op/s 2020-11-16T22:04:25.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:25 smithi016 bash[10302]: cluster 2020-11-16T22:04:24.136376+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e238: 12 total, 12 up, 12 in 2020-11-16T22:04:25.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:25 smithi016 bash[10302]: cluster 2020-11-16T22:04:24.916833+0000 mon.a (mon.0) 878 : cluster [DBG] osdmap e239: 12 total, 12 up, 12 in 2020-11-16T22:04:25.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:25 smithi195 bash[10218]: cluster 2020-11-16T22:04:23.618176+0000 mgr.x (mgr.24115) 353 : cluster [DBG] pgmap v520: 17 pgs: 17 active+clean; 245 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 984 KiB/s wr, 18 op/s 2020-11-16T22:04:25.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:25 smithi195 bash[10218]: cluster 2020-11-16T22:04:24.136376+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e238: 12 total, 12 up, 12 in 2020-11-16T22:04:25.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:25 smithi195 bash[10218]: cluster 2020-11-16T22:04:24.916833+0000 mon.a (mon.0) 878 : cluster [DBG] osdmap e239: 12 total, 12 up, 12 in 2020-11-16T22:04:25.922 INFO:tasks.rados.rados.2.smithi057.stdout:694: done (2 left) 2020-11-16T22:04:25.922 INFO:tasks.rados.rados.2.smithi057.stdout:696: done (1 left) 2020-11-16T22:04:25.922 INFO:tasks.rados.rados.2.smithi057.stdout:697: done (0 left) 2020-11-16T22:04:25.922 INFO:tasks.rados.rados.2.smithi057.stdout:698: read oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:25.923 INFO:tasks.rados.rados.2.smithi057.stdout:698: expect (ObjNum 200 snap 67 seq_num 200) 2020-11-16T22:04:25.923 INFO:tasks.rados.rados.2.smithi057.stdout:699: write oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 86 2020-11-16T22:04:25.923 INFO:tasks.rados.rados.2.smithi057.stdout:699: seq_num 260 ranges {769820=720742,2114730=255090} 2020-11-16T22:04:25.941 INFO:tasks.rados.rados.2.smithi057.stdout:699: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 769820 to 1490562 tid 1 2020-11-16T22:04:25.946 INFO:tasks.rados.rados.2.smithi057.stdout:699: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2114730 to 2369820 tid 2 2020-11-16T22:04:25.947 INFO:tasks.rados.rados.2.smithi057.stdout:700: copy_from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 86 2020-11-16T22:04:25.947 INFO:tasks.rados.rados.2.smithi057.stdout:698: expect (ObjNum 200 snap 67 seq_num 200) 2020-11-16T22:04:26.194 INFO:tasks.rados.rados.2.smithi057.stdout:699: finishing write tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:26.195 INFO:tasks.rados.rados.2.smithi057.stdout:699: finishing write tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:26.195 INFO:tasks.rados.rados.2.smithi057.stdout:699: finishing write tid 4 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:26.195 INFO:tasks.rados.rados.2.smithi057.stdout:699: finishing write tid 5 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:26.195 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 426 (ObjNum 260 snap 86 seq_num 260) dirty exists 2020-11-16T22:04:26.195 INFO:tasks.rados.rados.2.smithi057.stdout:699: left oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 260 snap 86 seq_num 260) 2020-11-16T22:04:26.195 INFO:tasks.rados.rados.2.smithi057.stdout:700: finishing copy_from to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:26.196 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 259 (ObjNum 220 snap 76 seq_num 220) dirty exists 2020-11-16T22:04:26.196 INFO:tasks.rados.rados.2.smithi057.stdout:698: done (2 left) 2020-11-16T22:04:26.196 INFO:tasks.rados.rados.2.smithi057.stdout:699: done (1 left) 2020-11-16T22:04:26.196 INFO:tasks.rados.rados.2.smithi057.stdout:701: read oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 76 2020-11-16T22:04:26.196 INFO:tasks.rados.rados.2.smithi057.stdout:701: expect (ObjNum 193 snap 64 seq_num 193) 2020-11-16T22:04:26.196 INFO:tasks.rados.rados.2.smithi057.stdout:700: finishing copy_from racing read to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:26.196 INFO:tasks.rados.rados.2.smithi057.stdout:702: read oid 10 snap -1 2020-11-16T22:04:26.197 INFO:tasks.rados.rados.2.smithi057.stdout:702: expect deleted 2020-11-16T22:04:26.197 INFO:tasks.rados.rados.2.smithi057.stdout:700: done (2 left) 2020-11-16T22:04:26.197 INFO:tasks.rados.rados.2.smithi057.stdout:703: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 76 2020-11-16T22:04:26.197 INFO:tasks.rados.rados.2.smithi057.stdout:703: expect (ObjNum 162 snap 56 seq_num 162) 2020-11-16T22:04:26.197 INFO:tasks.rados.rados.2.smithi057.stdout:704: snap_remove snap 82 2020-11-16T22:04:27.132 INFO:tasks.rados.rados.2.smithi057.stdout:704: done (3 left) 2020-11-16T22:04:27.133 INFO:tasks.rados.rados.2.smithi057.stdout:705: rollback oid 46 current snap is 86 2020-11-16T22:04:27.133 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 46 to 72 2020-11-16T22:04:27.133 INFO:tasks.rados.rados.2.smithi057.stdout:701: expect (ObjNum 193 snap 64 seq_num 193) 2020-11-16T22:04:27.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:26 smithi057 bash[10301]: cluster 2020-11-16T22:04:25.618879+0000 mgr.x (mgr.24115) 354 : cluster [DBG] pgmap v523: 17 pgs: 17 active+clean; 254 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2.7 MiB/s wr, 9 op/s 2020-11-16T22:04:27.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:26 smithi057 bash[10301]: cluster 2020-11-16T22:04:25.928496+0000 mon.a (mon.0) 879 : cluster [DBG] osdmap e240: 12 total, 12 up, 12 in 2020-11-16T22:04:27.236 INFO:tasks.rados.rados.2.smithi057.stdout:703: expect (ObjNum 162 snap 56 seq_num 162) 2020-11-16T22:04:27.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:26 smithi016 bash[10302]: cluster 2020-11-16T22:04:25.618879+0000 mgr.x (mgr.24115) 354 : cluster [DBG] pgmap v523: 17 pgs: 17 active+clean; 254 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2.7 MiB/s wr, 9 op/s 2020-11-16T22:04:27.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:26 smithi016 bash[10302]: cluster 2020-11-16T22:04:25.928496+0000 mon.a (mon.0) 879 : cluster [DBG] osdmap e240: 12 total, 12 up, 12 in 2020-11-16T22:04:27.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:26 smithi195 bash[10218]: cluster 2020-11-16T22:04:25.618879+0000 mgr.x (mgr.24115) 354 : cluster [DBG] pgmap v523: 17 pgs: 17 active+clean; 254 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2.7 MiB/s wr, 9 op/s 2020-11-16T22:04:27.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:26 smithi195 bash[10218]: cluster 2020-11-16T22:04:25.928496+0000 mon.a (mon.0) 879 : cluster [DBG] osdmap e240: 12 total, 12 up, 12 in 2020-11-16T22:04:27.382 INFO:tasks.rados.rados.2.smithi057.stdout:705: finishing rollback tid 0 to smithi05720651-46 2020-11-16T22:04:27.382 INFO:tasks.rados.rados.2.smithi057.stdout:705: finishing rollback tid 1 to smithi05720651-46 2020-11-16T22:04:27.382 INFO:tasks.rados.rados.2.smithi057.stdout:705: finishing rollback tid 2 to smithi05720651-46 2020-11-16T22:04:27.382 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 474 (ObjNum 199 snap 67 seq_num 199) dirty exists 2020-11-16T22:04:27.383 INFO:tasks.rados.rados.2.smithi057.stdout:701: done (3 left) 2020-11-16T22:04:27.383 INFO:tasks.rados.rados.2.smithi057.stdout:702: done (2 left) 2020-11-16T22:04:27.383 INFO:tasks.rados.rados.2.smithi057.stdout:703: done (1 left) 2020-11-16T22:04:27.383 INFO:tasks.rados.rados.2.smithi057.stdout:705: done (0 left) 2020-11-16T22:04:27.383 INFO:tasks.rados.rados.2.smithi057.stdout:706: read oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:27.383 INFO:tasks.rados.rados.2.smithi057.stdout:706: expect (ObjNum 112 snap 34 seq_num 112) 2020-11-16T22:04:27.383 INFO:tasks.rados.rados.2.smithi057.stdout:707: copy_from oid 18 from oid 30 current snap is 86 2020-11-16T22:04:27.384 INFO:tasks.rados.rados.2.smithi057.stdout:708: write oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 86 2020-11-16T22:04:27.384 INFO:tasks.rados.rados.2.smithi057.stdout:708: seq_num 261 ranges {786627=795991,2173212=213415} 2020-11-16T22:04:27.398 INFO:tasks.rados.rados.2.smithi057.stdout:708: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 786627 to 1582618 tid 1 2020-11-16T22:04:27.403 INFO:tasks.rados.rados.2.smithi057.stdout:708: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2173212 to 2386627 tid 2 2020-11-16T22:04:27.403 INFO:tasks.rados.rados.2.smithi057.stdout:709: write (excl) oid 16 current snap is 86 2020-11-16T22:04:27.403 INFO:tasks.rados.rados.2.smithi057.stdout:709: seq_num 262 ranges {403434=471240,1315341=400756} 2020-11-16T22:04:27.408 INFO:tasks.rados.rados.2.smithi057.stdout:709: writing smithi05720651-16 from 403434 to 874674 tid 1 2020-11-16T22:04:27.413 INFO:tasks.rados.rados.2.smithi057.stdout:709: writing smithi05720651-16 from 1315341 to 1716097 tid 2 2020-11-16T22:04:27.413 INFO:tasks.rados.rados.2.smithi057.stdout:710: write (excl) oid 40 current snap is 86 2020-11-16T22:04:27.414 INFO:tasks.rados.rados.2.smithi057.stdout:710: seq_num 263 ranges {420241=546489,1373823=544414} 2020-11-16T22:04:27.419 INFO:tasks.rados.rados.2.smithi057.stdout:710: writing smithi05720651-40 from 420241 to 966730 tid 1 2020-11-16T22:04:27.424 INFO:tasks.rados.rados.2.smithi057.stdout:710: writing smithi05720651-40 from 1373823 to 1918237 tid 2 2020-11-16T22:04:27.425 INFO:tasks.rados.rados.2.smithi057.stdout:711: snap_remove snap 80 2020-11-16T22:04:28.142 INFO:tasks.rados.rados.2.smithi057.stdout:711: done (5 left) 2020-11-16T22:04:28.143 INFO:tasks.rados.rados.2.smithi057.stdout:712: copy_from oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 50 current snap is 86 2020-11-16T22:04:28.143 INFO:tasks.rados.rados.2.smithi057.stdout:706: expect (ObjNum 112 snap 34 seq_num 112) 2020-11-16T22:04:28.271 INFO:tasks.rados.rados.2.smithi057.stdout:707: finishing copy_from to smithi05720651-18 2020-11-16T22:04:28.271 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 424 (ObjNum 243 snap 81 seq_num 243) dirty exists 2020-11-16T22:04:28.271 INFO:tasks.rados.rados.2.smithi057.stdout:707: finishing copy_from racing read to smithi05720651-18 2020-11-16T22:04:28.271 INFO:tasks.rados.rados.2.smithi057.stdout:708: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:28.271 INFO:tasks.rados.rados.2.smithi057.stdout:708: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:28.272 INFO:tasks.rados.rados.2.smithi057.stdout:708: finishing write tid 4 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:28.272 INFO:tasks.rados.rados.2.smithi057.stdout:708: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:28.272 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 529 (ObjNum 261 snap 86 seq_num 261) dirty exists 2020-11-16T22:04:28.272 INFO:tasks.rados.rados.2.smithi057.stdout:708: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 261 snap 86 seq_num 261) 2020-11-16T22:04:28.272 INFO:tasks.rados.rados.2.smithi057.stdout:709: finishing write tid 1 to smithi05720651-16 2020-11-16T22:04:28.272 INFO:tasks.rados.rados.2.smithi057.stdout:709: finishing write tid 2 to smithi05720651-16 2020-11-16T22:04:28.272 INFO:tasks.rados.rados.2.smithi057.stdout:709: finishing write tid 4 to smithi05720651-16 2020-11-16T22:04:28.273 INFO:tasks.rados.rados.2.smithi057.stdout:709: finishing write tid 5 to smithi05720651-16 2020-11-16T22:04:28.273 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 484 (ObjNum 262 snap 86 seq_num 262) dirty exists 2020-11-16T22:04:28.273 INFO:tasks.rados.rados.2.smithi057.stdout:709: left oid 16 (ObjNum 262 snap 86 seq_num 262) 2020-11-16T22:04:28.273 INFO:tasks.rados.rados.2.smithi057.stdout:710: finishing write tid 1 to smithi05720651-40 2020-11-16T22:04:28.273 INFO:tasks.rados.rados.2.smithi057.stdout:710: finishing write tid 2 to smithi05720651-40 2020-11-16T22:04:28.273 INFO:tasks.rados.rados.2.smithi057.stdout:710: finishing write tid 4 to smithi05720651-40 2020-11-16T22:04:28.273 INFO:tasks.rados.rados.2.smithi057.stdout:710: finishing write tid 5 to smithi05720651-40 2020-11-16T22:04:28.274 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 639 (ObjNum 263 snap 86 seq_num 263) dirty exists 2020-11-16T22:04:28.274 INFO:tasks.rados.rados.2.smithi057.stdout:710: left oid 40 (ObjNum 263 snap 86 seq_num 263) 2020-11-16T22:04:28.274 INFO:tasks.rados.rados.2.smithi057.stdout:712: finishing copy_from to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:28.274 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 438 (ObjNum 233 snap 78 seq_num 233) dirty exists 2020-11-16T22:04:28.274 INFO:tasks.rados.rados.2.smithi057.stdout:712: finishing copy_from racing read to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:28.274 INFO:tasks.rados.rados.2.smithi057.stdout:706: done (5 left) 2020-11-16T22:04:28.274 INFO:tasks.rados.rados.2.smithi057.stdout:707: done (4 left) 2020-11-16T22:04:28.275 INFO:tasks.rados.rados.2.smithi057.stdout:708: done (3 left) 2020-11-16T22:04:28.275 INFO:tasks.rados.rados.2.smithi057.stdout:709: done (2 left) 2020-11-16T22:04:28.275 INFO:tasks.rados.rados.2.smithi057.stdout:710: done (1 left) 2020-11-16T22:04:28.275 INFO:tasks.rados.rados.2.smithi057.stdout:712: done (0 left) 2020-11-16T22:04:28.275 INFO:tasks.rados.rados.2.smithi057.stdout:713: write (excl) oid 6 current snap is 86 2020-11-16T22:04:28.275 INFO:tasks.rados.rados.2.smithi057.stdout:713: seq_num 264 ranges {437048=621738,1832305=404425} 2020-11-16T22:04:28.286 INFO:tasks.rados.rados.2.smithi057.stdout:713: writing smithi05720651-6 from 437048 to 1058786 tid 1 2020-11-16T22:04:28.293 INFO:tasks.rados.rados.2.smithi057.stdout:713: writing smithi05720651-6 from 1832305 to 2236730 tid 2 2020-11-16T22:04:28.293 INFO:tasks.rados.rados.2.smithi057.stdout:714: snap_remove snap 52 2020-11-16T22:04:28.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:28 smithi057 bash[10301]: cluster 2020-11-16T22:04:27.142824+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e241: 12 total, 12 up, 12 in 2020-11-16T22:04:28.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:28 smithi016 bash[10302]: cluster 2020-11-16T22:04:27.142824+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e241: 12 total, 12 up, 12 in 2020-11-16T22:04:28.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:28 smithi195 bash[10218]: cluster 2020-11-16T22:04:27.142824+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e241: 12 total, 12 up, 12 in 2020-11-16T22:04:29.153 INFO:tasks.rados.rados.2.smithi057.stdout:714: done (1 left) 2020-11-16T22:04:29.153 INFO:tasks.rados.rados.2.smithi057.stdout:715: delete oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 86 2020-11-16T22:04:29.153 INFO:tasks.rados.rados.2.smithi057.stdout:713: finishing write tid 1 to smithi05720651-6 2020-11-16T22:04:29.153 INFO:tasks.rados.rados.2.smithi057.stdout:713: finishing write tid 2 to smithi05720651-6 2020-11-16T22:04:29.153 INFO:tasks.rados.rados.2.smithi057.stdout:713: finishing write tid 4 to smithi05720651-6 2020-11-16T22:04:29.154 INFO:tasks.rados.rados.2.smithi057.stdout:713: finishing write tid 5 to smithi05720651-6 2020-11-16T22:04:29.154 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 541 (ObjNum 264 snap 86 seq_num 264) dirty exists 2020-11-16T22:04:29.154 INFO:tasks.rados.rados.2.smithi057.stdout:713: left oid 6 (ObjNum 264 snap 86 seq_num 264) 2020-11-16T22:04:29.161 INFO:tasks.rados.rados.2.smithi057.stdout:713: done (1 left) 2020-11-16T22:04:29.162 INFO:tasks.rados.rados.2.smithi057.stdout:715: done (0 left) 2020-11-16T22:04:29.162 INFO:tasks.rados.rados.2.smithi057.stdout:716: write oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 86 2020-11-16T22:04:29.162 INFO:tasks.rados.rados.2.smithi057.stdout:716: seq_num 266 ranges {470662=772236,1832916=408094} 2020-11-16T22:04:29.172 INFO:tasks.rados.rados.2.smithi057.stdout:716: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 470662 to 1242898 tid 1 2020-11-16T22:04:29.179 INFO:tasks.rados.rados.2.smithi057.stdout:716: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1832916 to 2241010 tid 2 2020-11-16T22:04:29.179 INFO:tasks.rados.rados.2.smithi057.stdout:717: write oid 36 current snap is 86 2020-11-16T22:04:29.180 INFO:tasks.rados.rados.2.smithi057.stdout:717: seq_num 267 ranges {487469=563838,1607751=551752} 2020-11-16T22:04:29.185 INFO:tasks.rados.rados.2.smithi057.stdout:717: writing smithi05720651-36 from 487469 to 1051307 tid 1 2020-11-16T22:04:29.192 INFO:tasks.rados.rados.2.smithi057.stdout:717: writing smithi05720651-36 from 1607751 to 2159503 tid 2 2020-11-16T22:04:29.192 INFO:tasks.rados.rados.2.smithi057.stdout:718: rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 86 2020-11-16T22:04:29.192 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 85 2020-11-16T22:04:29.192 INFO:tasks.rados.rados.2.smithi057.stdout:716: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:29.193 INFO:tasks.rados.rados.2.smithi057.stdout:716: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:29.193 INFO:tasks.rados.rados.2.smithi057.stdout:717: finishing write tid 1 to smithi05720651-36 2020-11-16T22:04:29.193 INFO:tasks.rados.rados.2.smithi057.stdout:719: rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 86 2020-11-16T22:04:29.193 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 72 2020-11-16T22:04:29.193 INFO:tasks.rados.rados.2.smithi057.stdout:720: rollback oid 44 current snap is 86 2020-11-16T22:04:29.193 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 44 to 83 2020-11-16T22:04:29.194 INFO:tasks.rados.rados.2.smithi057.stdout:721: snap_create 2020-11-16T22:04:29.195 INFO:tasks.rados.rados.2.smithi057.stdout:718: finishing rollback tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:29.195 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 537 (ObjNum 353 snap 0 seq_num 1953066355) dirty dne 2020-11-16T22:04:29.195 INFO:tasks.rados.rados.2.smithi057.stdout:719: finishing rollback tid 0 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:29.196 INFO:tasks.rados.rados.2.smithi057.stdout:719: finishing rollback tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:29.196 INFO:tasks.rados.rados.2.smithi057.stdout:717: finishing write tid 2 to smithi05720651-36 2020-11-16T22:04:29.196 INFO:tasks.rados.rados.2.smithi057.stdout:719: finishing rollback tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:29.197 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 234 (ObjNum 193 snap 64 seq_num 193) dirty exists 2020-11-16T22:04:29.197 INFO:tasks.rados.rados.2.smithi057.stdout:717: finishing write tid 4 to smithi05720651-36 2020-11-16T22:04:29.197 INFO:tasks.rados.rados.2.smithi057.stdout:717: finishing write tid 5 to smithi05720651-36 2020-11-16T22:04:29.197 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 429 (ObjNum 267 snap 86 seq_num 267) dirty exists 2020-11-16T22:04:29.198 INFO:tasks.rados.rados.2.smithi057.stdout:717: left oid 36 (ObjNum 267 snap 86 seq_num 267) 2020-11-16T22:04:29.198 INFO:tasks.rados.rados.2.smithi057.stdout:720: finishing rollback tid 0 to smithi05720651-44 2020-11-16T22:04:29.198 INFO:tasks.rados.rados.2.smithi057.stdout:720: finishing rollback tid 1 to smithi05720651-44 2020-11-16T22:04:29.198 INFO:tasks.rados.rados.2.smithi057.stdout:720: finishing rollback tid 2 to smithi05720651-44 2020-11-16T22:04:29.199 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 300 (ObjNum 238 snap 80 seq_num 238) dirty exists 2020-11-16T22:04:29.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:29 smithi057 bash[10301]: cluster 2020-11-16T22:04:27.619590+0000 mgr.x (mgr.24115) 355 : cluster [DBG] pgmap v526: 17 pgs: 17 active+clean; 256 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 2.8 MiB/s wr, 16 op/s 2020-11-16T22:04:29.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:29 smithi057 bash[10301]: cluster 2020-11-16T22:04:28.152431+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e242: 12 total, 12 up, 12 in 2020-11-16T22:04:29.533 INFO:tasks.rados.rados.2.smithi057.stdout:716: finishing write tid 4 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:29.533 INFO:tasks.rados.rados.2.smithi057.stdout:716: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:29.533 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 262 (ObjNum 266 snap 86 seq_num 266) dirty exists 2020-11-16T22:04:29.534 INFO:tasks.rados.rados.2.smithi057.stdout:716: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 266 snap 86 seq_num 266) 2020-11-16T22:04:29.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:29 smithi016 bash[10302]: cluster 2020-11-16T22:04:27.619590+0000 mgr.x (mgr.24115) 355 : cluster [DBG] pgmap v526: 17 pgs: 17 active+clean; 256 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 2.8 MiB/s wr, 16 op/s 2020-11-16T22:04:29.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:29 smithi016 bash[10302]: cluster 2020-11-16T22:04:28.152431+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e242: 12 total, 12 up, 12 in 2020-11-16T22:04:29.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:29 smithi195 bash[10218]: cluster 2020-11-16T22:04:27.619590+0000 mgr.x (mgr.24115) 355 : cluster [DBG] pgmap v526: 17 pgs: 17 active+clean; 256 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 2.8 MiB/s wr, 16 op/s 2020-11-16T22:04:29.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:29 smithi195 bash[10218]: cluster 2020-11-16T22:04:28.152431+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e242: 12 total, 12 up, 12 in 2020-11-16T22:04:29.599 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:04:29 smithi195 bash[18679]: debug 2020-11-16T22:04:29.166+0000 7f9942dfe700 -1 osd.1 pg_epoch: 243 pg[2.6( v 242'141 (0'0,242'141] local-lis/les=71/72 n=5 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,8] r=0 lpr=71 crt=242'141 lcod 241'139 mlcod 241'139 active+clean+snaptrim trimq=[60~1] ps=[8a~1,98~1,9e~1,a0~1]] removing snap head 2020-11-16T22:04:29.912 INFO:tasks.rados.rados.2.smithi057.stdout:716: done (5 left) 2020-11-16T22:04:29.913 INFO:tasks.rados.rados.2.smithi057.stdout:717: done (4 left) 2020-11-16T22:04:29.913 INFO:tasks.rados.rados.2.smithi057.stdout:718: done (3 left) 2020-11-16T22:04:29.913 INFO:tasks.rados.rados.2.smithi057.stdout:719: done (2 left) 2020-11-16T22:04:29.913 INFO:tasks.rados.rados.2.smithi057.stdout:720: done (1 left) 2020-11-16T22:04:29.913 INFO:tasks.rados.rados.2.smithi057.stdout:721: done (0 left) 2020-11-16T22:04:29.913 INFO:tasks.rados.rados.2.smithi057.stdout:722: write oid 20 current snap is 87 2020-11-16T22:04:29.913 INFO:tasks.rados.rados.2.smithi057.stdout:722: seq_num 268 ranges {504276=639087,1666233=695410} 2020-11-16T22:04:29.927 INFO:tasks.rados.rados.2.smithi057.stdout:722: writing smithi05720651-20 from 504276 to 1143363 tid 1 2020-11-16T22:04:29.934 INFO:tasks.rados.rados.2.smithi057.stdout:722: writing smithi05720651-20 from 1666233 to 2361643 tid 2 2020-11-16T22:04:29.934 INFO:tasks.rados.rados.2.smithi057.stdout:723: rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 87 2020-11-16T22:04:29.934 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 83 2020-11-16T22:04:29.935 INFO:tasks.rados.rados.2.smithi057.stdout:724: rollback oid 8 current snap is 87 2020-11-16T22:04:29.935 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 8 to 76 2020-11-16T22:04:29.935 INFO:tasks.rados.rados.2.smithi057.stdout:725: snap_create 2020-11-16T22:04:29.939 INFO:tasks.rados.rados.2.smithi057.stdout:722: finishing write tid 1 to smithi05720651-20 2020-11-16T22:04:29.942 INFO:tasks.rados.rados.2.smithi057.stdout:722: finishing write tid 2 to smithi05720651-20 2020-11-16T22:04:29.942 INFO:tasks.rados.rados.2.smithi057.stdout:722: finishing write tid 4 to smithi05720651-20 2020-11-16T22:04:29.943 INFO:tasks.rados.rados.2.smithi057.stdout:724: finishing rollback tid 1 to smithi05720651-8 2020-11-16T22:04:29.943 INFO:tasks.rados.rados.2.smithi057.stdout:722: finishing write tid 5 to smithi05720651-20 2020-11-16T22:04:29.943 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 270 (ObjNum 268 snap 87 seq_num 268) dirty exists 2020-11-16T22:04:29.944 INFO:tasks.rados.rados.2.smithi057.stdout:722: left oid 20 (ObjNum 268 snap 87 seq_num 268) 2020-11-16T22:04:29.944 INFO:tasks.rados.rados.2.smithi057.stdout:724: finishing rollback tid 2 to smithi05720651-8 2020-11-16T22:04:29.944 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 168 (ObjNum 206 snap 70 seq_num 206) dirty exists 2020-11-16T22:04:29.944 INFO:tasks.rados.rados.2.smithi057.stdout:723: finishing rollback tid 0 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:29.945 INFO:tasks.rados.rados.2.smithi057.stdout:723: finishing rollback tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:29.945 INFO:tasks.rados.rados.2.smithi057.stdout:723: finishing rollback tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:29.945 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 504 (ObjNum 137 snap 39 seq_num 137) dirty exists 2020-11-16T22:04:30.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:30 smithi057 bash[10301]: cluster 2020-11-16T22:04:29.162991+0000 mon.a (mon.0) 882 : cluster [DBG] osdmap e243: 12 total, 12 up, 12 in 2020-11-16T22:04:30.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:30 smithi057 bash[10301]: audit 2020-11-16T22:04:29.727474+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:04:30.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:30 smithi057 bash[10301]: audit 2020-11-16T22:04:29.737987+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:04:30.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:30 smithi057 bash[10301]: cluster 2020-11-16T22:04:29.918745+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e244: 12 total, 12 up, 12 in 2020-11-16T22:04:30.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:30 smithi016 bash[10302]: cluster 2020-11-16T22:04:29.162991+0000 mon.a (mon.0) 882 : cluster [DBG] osdmap e243: 12 total, 12 up, 12 in 2020-11-16T22:04:30.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:30 smithi016 bash[10302]: audit 2020-11-16T22:04:29.727474+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:04:30.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:30 smithi016 bash[10302]: audit 2020-11-16T22:04:29.737987+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:04:30.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:30 smithi016 bash[10302]: cluster 2020-11-16T22:04:29.918745+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e244: 12 total, 12 up, 12 in 2020-11-16T22:04:30.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:30 smithi195 bash[10218]: cluster 2020-11-16T22:04:29.162991+0000 mon.a (mon.0) 882 : cluster [DBG] osdmap e243: 12 total, 12 up, 12 in 2020-11-16T22:04:30.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:30 smithi195 bash[10218]: audit 2020-11-16T22:04:29.727474+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:04:30.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:30 smithi195 bash[10218]: audit 2020-11-16T22:04:29.737987+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:04:30.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:30 smithi195 bash[10218]: cluster 2020-11-16T22:04:29.918745+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e244: 12 total, 12 up, 12 in 2020-11-16T22:04:30.929 INFO:tasks.rados.rados.2.smithi057.stdout:722: done (3 left) 2020-11-16T22:04:30.929 INFO:tasks.rados.rados.2.smithi057.stdout:723: done (2 left) 2020-11-16T22:04:30.929 INFO:tasks.rados.rados.2.smithi057.stdout:724: done (1 left) 2020-11-16T22:04:30.929 INFO:tasks.rados.rados.2.smithi057.stdout:725: done (0 left) 2020-11-16T22:04:30.929 INFO:tasks.rados.rados.2.smithi057.stdout:726: write oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 88 2020-11-16T22:04:30.930 INFO:tasks.rados.rados.2.smithi057.stdout:726: seq_num 269 ranges {521083=714336,1724715=555421} 2020-11-16T22:04:30.941 INFO:tasks.rados.rados.2.smithi057.stdout:726: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 521083 to 1235419 tid 1 2020-11-16T22:04:30.947 INFO:tasks.rados.rados.2.smithi057.stdout:726: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1724715 to 2280136 tid 2 2020-11-16T22:04:30.947 INFO:tasks.rados.rados.2.smithi057.stdout:727: write oid 14 current snap is 88 2020-11-16T22:04:30.947 INFO:tasks.rados.rados.2.smithi057.stdout:727: seq_num 270 ranges {537890=789585,1783197=699079} 2020-11-16T22:04:30.954 INFO:tasks.rados.rados.2.smithi057.stdout:727: writing smithi05720651-14 from 537890 to 1327475 tid 1 2020-11-16T22:04:30.961 INFO:tasks.rados.rados.2.smithi057.stdout:727: writing smithi05720651-14 from 1783197 to 2482276 tid 2 2020-11-16T22:04:30.961 INFO:tasks.rados.rados.2.smithi057.stdout:728: snap_create 2020-11-16T22:04:30.962 INFO:tasks.rados.rados.2.smithi057.stdout:726: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:30.962 INFO:tasks.rados.rados.2.smithi057.stdout:726: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:30.962 INFO:tasks.rados.rados.2.smithi057.stdout:726: finishing write tid 4 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:30.962 INFO:tasks.rados.rados.2.smithi057.stdout:726: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:30.962 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 555 (ObjNum 269 snap 88 seq_num 269) dirty exists 2020-11-16T22:04:30.962 INFO:tasks.rados.rados.2.smithi057.stdout:726: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 269 snap 88 seq_num 269) 2020-11-16T22:04:30.967 INFO:tasks.rados.rados.2.smithi057.stdout:727: finishing write tid 1 to smithi05720651-14 2020-11-16T22:04:30.969 INFO:tasks.rados.rados.2.smithi057.stdout:727: finishing write tid 2 to smithi05720651-14 2020-11-16T22:04:30.969 INFO:tasks.rados.rados.2.smithi057.stdout:727: finishing write tid 4 to smithi05720651-14 2020-11-16T22:04:30.969 INFO:tasks.rados.rados.2.smithi057.stdout:727: finishing write tid 5 to smithi05720651-14 2020-11-16T22:04:30.970 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 663 (ObjNum 270 snap 88 seq_num 270) dirty exists 2020-11-16T22:04:30.970 INFO:tasks.rados.rados.2.smithi057.stdout:727: left oid 14 (ObjNum 270 snap 88 seq_num 270) 2020-11-16T22:04:31.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:31 smithi057 bash[10301]: cluster 2020-11-16T22:04:29.620414+0000 mgr.x (mgr.24115) 356 : cluster [DBG] pgmap v529: 17 pgs: 17 active+clean; 256 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 611 KiB/s wr, 9 op/s 2020-11-16T22:04:31.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:31 smithi057 bash[10301]: cluster 2020-11-16T22:04:30.932214+0000 mon.a (mon.0) 886 : cluster [DBG] osdmap e245: 12 total, 12 up, 12 in 2020-11-16T22:04:31.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:31 smithi016 bash[10302]: cluster 2020-11-16T22:04:29.620414+0000 mgr.x (mgr.24115) 356 : cluster [DBG] pgmap v529: 17 pgs: 17 active+clean; 256 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 611 KiB/s wr, 9 op/s 2020-11-16T22:04:31.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:31 smithi016 bash[10302]: cluster 2020-11-16T22:04:30.932214+0000 mon.a (mon.0) 886 : cluster [DBG] osdmap e245: 12 total, 12 up, 12 in 2020-11-16T22:04:31.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:31 smithi195 bash[10218]: cluster 2020-11-16T22:04:29.620414+0000 mgr.x (mgr.24115) 356 : cluster [DBG] pgmap v529: 17 pgs: 17 active+clean; 256 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 611 KiB/s wr, 9 op/s 2020-11-16T22:04:31.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:31 smithi195 bash[10218]: cluster 2020-11-16T22:04:30.932214+0000 mon.a (mon.0) 886 : cluster [DBG] osdmap e245: 12 total, 12 up, 12 in 2020-11-16T22:04:31.928 INFO:tasks.rados.rados.2.smithi057.stdout:726: done (2 left) 2020-11-16T22:04:31.928 INFO:tasks.rados.rados.2.smithi057.stdout:727: done (1 left) 2020-11-16T22:04:31.929 INFO:tasks.rados.rados.2.smithi057.stdout:728: done (0 left) 2020-11-16T22:04:31.929 INFO:tasks.rados.rados.2.smithi057.stdout:729: read oid 40 snap -1 2020-11-16T22:04:31.929 INFO:tasks.rados.rados.2.smithi057.stdout:729: expect (ObjNum 263 snap 86 seq_num 263) 2020-11-16T22:04:31.929 INFO:tasks.rados.rados.2.smithi057.stdout:730: rollback oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 89 2020-11-16T22:04:31.929 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 72 2020-11-16T22:04:31.929 INFO:tasks.rados.rados.2.smithi057.stdout:731: write (excl) oid 38 current snap is 89 2020-11-16T22:04:31.930 INFO:tasks.rados.rados.2.smithi057.stdout:731: seq_num 271 ranges {554697=464834,1725326=559090} 2020-11-16T22:04:31.942 INFO:tasks.rados.rados.2.smithi057.stdout:731: writing smithi05720651-38 from 554697 to 1019531 tid 1 2020-11-16T22:04:31.950 INFO:tasks.rados.rados.2.smithi057.stdout:731: writing smithi05720651-38 from 1725326 to 2284416 tid 2 2020-11-16T22:04:31.950 INFO:tasks.rados.rados.2.smithi057.stdout:732: snap_create 2020-11-16T22:04:31.950 INFO:tasks.rados.rados.2.smithi057.stdout:730: finishing rollback tid 0 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:31.950 INFO:tasks.rados.rados.2.smithi057.stdout:730: finishing rollback tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:31.951 INFO:tasks.rados.rados.2.smithi057.stdout:730: finishing rollback tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:31.951 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 559 (ObjNum 194 snap 64 seq_num 194) dirty exists 2020-11-16T22:04:31.951 INFO:tasks.rados.rados.2.smithi057.stdout:729: expect (ObjNum 263 snap 86 seq_num 263) 2020-11-16T22:04:32.025 INFO:tasks.rados.rados.2.smithi057.stdout:731: finishing write tid 1 to smithi05720651-38 2020-11-16T22:04:32.026 INFO:tasks.rados.rados.2.smithi057.stdout:731: finishing write tid 2 to smithi05720651-38 2020-11-16T22:04:32.026 INFO:tasks.rados.rados.2.smithi057.stdout:731: finishing write tid 4 to smithi05720651-38 2020-11-16T22:04:32.026 INFO:tasks.rados.rados.2.smithi057.stdout:731: finishing write tid 5 to smithi05720651-38 2020-11-16T22:04:32.026 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 238 (ObjNum 271 snap 89 seq_num 271) dirty exists 2020-11-16T22:04:32.027 INFO:tasks.rados.rados.2.smithi057.stdout:731: left oid 38 (ObjNum 271 snap 89 seq_num 271) 2020-11-16T22:04:32.942 INFO:tasks.rados.rados.2.smithi057.stdout:729: done (3 left) 2020-11-16T22:04:32.943 INFO:tasks.rados.rados.2.smithi057.stdout:730: done (2 left) 2020-11-16T22:04:32.943 INFO:tasks.rados.rados.2.smithi057.stdout:731: done (1 left) 2020-11-16T22:04:32.943 INFO:tasks.rados.rados.2.smithi057.stdout:732: done (0 left) 2020-11-16T22:04:32.943 INFO:tasks.rados.rados.2.smithi057.stdout:733: rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 90 2020-11-16T22:04:32.943 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 83 2020-11-16T22:04:32.944 INFO:tasks.rados.rados.2.smithi057.stdout:734: snap_create 2020-11-16T22:04:32.952 INFO:tasks.rados.rados.2.smithi057.stdout:733: finishing rollback tid 0 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:32.952 INFO:tasks.rados.rados.2.smithi057.stdout:733: finishing rollback tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:32.953 INFO:tasks.rados.rados.2.smithi057.stdout:733: finishing rollback tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:32.954 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 508 (ObjNum 245 snap 81 seq_num 245) dirty exists 2020-11-16T22:04:33.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:32 smithi057 bash[10301]: cluster 2020-11-16T22:04:31.621220+0000 mgr.x (mgr.24115) 357 : cluster [DBG] pgmap v532: 17 pgs: 17 active+clean; 215 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 5.2 MiB/s wr, 22 op/s 2020-11-16T22:04:33.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:32 smithi057 bash[10301]: cluster 2020-11-16T22:04:31.934893+0000 mon.a (mon.0) 887 : cluster [DBG] osdmap e246: 12 total, 12 up, 12 in 2020-11-16T22:04:33.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:32 smithi016 bash[10302]: cluster 2020-11-16T22:04:31.621220+0000 mgr.x (mgr.24115) 357 : cluster [DBG] pgmap v532: 17 pgs: 17 active+clean; 215 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 5.2 MiB/s wr, 22 op/s 2020-11-16T22:04:33.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:32 smithi016 bash[10302]: cluster 2020-11-16T22:04:31.934893+0000 mon.a (mon.0) 887 : cluster [DBG] osdmap e246: 12 total, 12 up, 12 in 2020-11-16T22:04:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:32 smithi195 bash[10218]: cluster 2020-11-16T22:04:31.621220+0000 mgr.x (mgr.24115) 357 : cluster [DBG] pgmap v532: 17 pgs: 17 active+clean; 215 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 5.2 MiB/s wr, 22 op/s 2020-11-16T22:04:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:32 smithi195 bash[10218]: cluster 2020-11-16T22:04:31.934893+0000 mon.a (mon.0) 887 : cluster [DBG] osdmap e246: 12 total, 12 up, 12 in 2020-11-16T22:04:33.947 INFO:tasks.rados.rados.2.smithi057.stdout:733: done (1 left) 2020-11-16T22:04:33.947 INFO:tasks.rados.rados.2.smithi057.stdout:734: done (0 left) 2020-11-16T22:04:33.947 INFO:tasks.rados.rados.2.smithi057.stdout:735: rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 91 2020-11-16T22:04:33.947 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 85 2020-11-16T22:04:33.948 INFO:tasks.rados.rados.2.smithi057.stdout:736: write oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 91 2020-11-16T22:04:33.948 INFO:tasks.rados.rados.2.smithi057.stdout:736: seq_num 272 ranges {571504=540083,1783808=702748} 2020-11-16T22:04:33.961 INFO:tasks.rados.rados.2.smithi057.stdout:736: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 571504 to 1111587 tid 1 2020-11-16T22:04:33.969 INFO:tasks.rados.rados.2.smithi057.stdout:736: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1783808 to 2486556 tid 2 2020-11-16T22:04:33.969 INFO:tasks.rados.rados.2.smithi057.stdout:737: snap_create 2020-11-16T22:04:33.970 INFO:tasks.rados.rados.2.smithi057.stdout:735: finishing rollback tid 0 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:33.970 INFO:tasks.rados.rados.2.smithi057.stdout:735: finishing rollback tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:33.970 INFO:tasks.rados.rados.2.smithi057.stdout:735: finishing rollback tid 2 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:33.970 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 242 (ObjNum 175 snap 59 seq_num 175) dirty exists 2020-11-16T22:04:33.976 INFO:tasks.rados.rados.2.smithi057.stdout:736: finishing write tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:33.977 INFO:tasks.rados.rados.2.smithi057.stdout:736: finishing write tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:33.977 INFO:tasks.rados.rados.2.smithi057.stdout:736: finishing write tid 4 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:33.978 INFO:tasks.rados.rados.2.smithi057.stdout:736: finishing write tid 5 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:33.978 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 512 (ObjNum 272 snap 91 seq_num 272) dirty exists 2020-11-16T22:04:33.978 INFO:tasks.rados.rados.2.smithi057.stdout:736: left oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 272 snap 91 seq_num 272) 2020-11-16T22:04:34.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:33 smithi057 bash[10301]: cluster 2020-11-16T22:04:32.946075+0000 mon.a (mon.0) 888 : cluster [DBG] osdmap e247: 12 total, 12 up, 12 in 2020-11-16T22:04:34.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:33 smithi016 bash[10302]: cluster 2020-11-16T22:04:32.946075+0000 mon.a (mon.0) 888 : cluster [DBG] osdmap e247: 12 total, 12 up, 12 in 2020-11-16T22:04:34.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:33 smithi195 bash[10218]: cluster 2020-11-16T22:04:32.946075+0000 mon.a (mon.0) 888 : cluster [DBG] osdmap e247: 12 total, 12 up, 12 in 2020-11-16T22:04:34.908 INFO:tasks.rados.rados.2.smithi057.stdout:735: done (2 left) 2020-11-16T22:04:34.909 INFO:tasks.rados.rados.2.smithi057.stdout:736: done (1 left) 2020-11-16T22:04:34.909 INFO:tasks.rados.rados.2.smithi057.stdout:737: done (0 left) 2020-11-16T22:04:34.909 INFO:tasks.rados.rados.2.smithi057.stdout:738: rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 92 2020-11-16T22:04:34.909 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 86 2020-11-16T22:04:34.909 INFO:tasks.rados.rados.2.smithi057.stdout:739: read oid 10 snap -1 2020-11-16T22:04:34.909 INFO:tasks.rados.rados.2.smithi057.stdout:739: expect deleted 2020-11-16T22:04:34.910 INFO:tasks.rados.rados.2.smithi057.stdout:740: delete oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 92 2020-11-16T22:04:34.915 INFO:tasks.rados.rados.2.smithi057.stdout:738: finishing rollback tid 0 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:34.916 INFO:tasks.rados.rados.2.smithi057.stdout:738: finishing rollback tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:34.916 INFO:tasks.rados.rados.2.smithi057.stdout:738: finishing rollback tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:34.916 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 516 (ObjNum 137 snap 39 seq_num 137) dirty exists 2020-11-16T22:04:34.917 INFO:tasks.rados.rados.2.smithi057.stdout:738: done (2 left) 2020-11-16T22:04:34.917 INFO:tasks.rados.rados.2.smithi057.stdout:739: done (1 left) 2020-11-16T22:04:34.917 INFO:tasks.rados.rados.2.smithi057.stdout:740: done (0 left) 2020-11-16T22:04:34.918 INFO:tasks.rados.rados.2.smithi057.stdout:741: delete oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 92 2020-11-16T22:04:34.925 INFO:tasks.rados.rados.2.smithi057.stdout:741: done (0 left) 2020-11-16T22:04:34.925 INFO:tasks.rados.rados.2.smithi057.stdout:742: write oid 28 current snap is 92 2020-11-16T22:04:34.925 INFO:tasks.rados.rados.2.smithi057.stdout:742: seq_num 275 ranges {621925=482183,1559254=566428} 2020-11-16T22:04:34.938 INFO:tasks.rados.rados.2.smithi057.stdout:742: writing smithi05720651-28 from 621925 to 1104108 tid 1 2020-11-16T22:04:34.945 INFO:tasks.rados.rados.2.smithi057.stdout:742: writing smithi05720651-28 from 1559254 to 2125682 tid 2 2020-11-16T22:04:34.946 INFO:tasks.rados.rados.2.smithi057.stdout:743: read oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:34.946 INFO:tasks.rados.rados.2.smithi057.stdout:743: expect (ObjNum 220 snap 76 seq_num 220) 2020-11-16T22:04:34.946 INFO:tasks.rados.rados.2.smithi057.stdout:744: snap_create 2020-11-16T22:04:34.946 INFO:tasks.rados.rados.2.smithi057.stdout:742: finishing write tid 1 to smithi05720651-28 2020-11-16T22:04:34.951 INFO:tasks.rados.rados.2.smithi057.stdout:742: finishing write tid 2 to smithi05720651-28 2020-11-16T22:04:34.951 INFO:tasks.rados.rados.2.smithi057.stdout:742: finishing write tid 4 to smithi05720651-28 2020-11-16T22:04:34.952 INFO:tasks.rados.rados.2.smithi057.stdout:742: finishing write tid 5 to smithi05720651-28 2020-11-16T22:04:34.952 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 433 (ObjNum 275 snap 92 seq_num 275) dirty exists 2020-11-16T22:04:34.952 INFO:tasks.rados.rados.2.smithi057.stdout:742: left oid 28 (ObjNum 275 snap 92 seq_num 275) 2020-11-16T22:04:34.961 INFO:tasks.rados.rados.2.smithi057.stdout:743: expect (ObjNum 220 snap 76 seq_num 220) 2020-11-16T22:04:35.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:34 smithi057 bash[10301]: cluster 2020-11-16T22:04:33.621909+0000 mgr.x (mgr.24115) 358 : cluster [DBG] pgmap v535: 17 pgs: 17 active+clean; 209 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 5.5 MiB/s wr, 23 op/s 2020-11-16T22:04:35.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:34 smithi057 bash[10301]: cluster 2020-11-16T22:04:33.955645+0000 mon.a (mon.0) 889 : cluster [DBG] osdmap e248: 12 total, 12 up, 12 in 2020-11-16T22:04:35.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:34 smithi057 bash[10301]: cluster 2020-11-16T22:04:34.920656+0000 mon.a (mon.0) 890 : cluster [DBG] osdmap e249: 12 total, 12 up, 12 in 2020-11-16T22:04:35.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:34 smithi016 bash[10302]: cluster 2020-11-16T22:04:33.621909+0000 mgr.x (mgr.24115) 358 : cluster [DBG] pgmap v535: 17 pgs: 17 active+clean; 209 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 5.5 MiB/s wr, 23 op/s 2020-11-16T22:04:35.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:34 smithi016 bash[10302]: cluster 2020-11-16T22:04:33.955645+0000 mon.a (mon.0) 889 : cluster [DBG] osdmap e248: 12 total, 12 up, 12 in 2020-11-16T22:04:35.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:34 smithi016 bash[10302]: cluster 2020-11-16T22:04:34.920656+0000 mon.a (mon.0) 890 : cluster [DBG] osdmap e249: 12 total, 12 up, 12 in 2020-11-16T22:04:35.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:34 smithi195 bash[10218]: cluster 2020-11-16T22:04:33.621909+0000 mgr.x (mgr.24115) 358 : cluster [DBG] pgmap v535: 17 pgs: 17 active+clean; 209 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 5.5 MiB/s wr, 23 op/s 2020-11-16T22:04:35.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:34 smithi195 bash[10218]: cluster 2020-11-16T22:04:33.955645+0000 mon.a (mon.0) 889 : cluster [DBG] osdmap e248: 12 total, 12 up, 12 in 2020-11-16T22:04:35.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:34 smithi195 bash[10218]: cluster 2020-11-16T22:04:34.920656+0000 mon.a (mon.0) 890 : cluster [DBG] osdmap e249: 12 total, 12 up, 12 in 2020-11-16T22:04:35.956 INFO:tasks.rados.rados.2.smithi057.stdout:742: done (2 left) 2020-11-16T22:04:35.957 INFO:tasks.rados.rados.2.smithi057.stdout:743: done (1 left) 2020-11-16T22:04:35.957 INFO:tasks.rados.rados.2.smithi057.stdout:744: done (0 left) 2020-11-16T22:04:35.957 INFO:tasks.rados.rados.2.smithi057.stdout:745: write oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 93 2020-11-16T22:04:35.957 INFO:tasks.rados.rados.2.smithi057.stdout:745: seq_num 276 ranges {638732=557432,1617736=710086} 2020-11-16T22:04:35.969 INFO:tasks.rados.rados.2.smithi057.stdout:745: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 638732 to 1196164 tid 1 2020-11-16T22:04:35.977 INFO:tasks.rados.rados.2.smithi057.stdout:745: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1617736 to 2327822 tid 2 2020-11-16T22:04:35.978 INFO:tasks.rados.rados.2.smithi057.stdout:746: snap_create 2020-11-16T22:04:35.979 INFO:tasks.rados.rados.2.smithi057.stdout:745: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:35.985 INFO:tasks.rados.rados.2.smithi057.stdout:745: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:35.985 INFO:tasks.rados.rados.2.smithi057.stdout:745: finishing write tid 4 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:35.985 INFO:tasks.rados.rados.2.smithi057.stdout:745: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:35.986 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 290 (ObjNum 276 snap 93 seq_num 276) dirty exists 2020-11-16T22:04:35.986 INFO:tasks.rados.rados.2.smithi057.stdout:745: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 276 snap 93 seq_num 276) 2020-11-16T22:04:36.967 INFO:tasks.rados.rados.2.smithi057.stdout:745: done (1 left) 2020-11-16T22:04:36.968 INFO:tasks.rados.rados.2.smithi057.stdout:746: done (0 left) 2020-11-16T22:04:36.968 INFO:tasks.rados.rados.2.smithi057.stdout:747: write oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 94 2020-11-16T22:04:36.968 INFO:tasks.rados.rados.2.smithi057.stdout:747: seq_num 277 ranges {655539=632681,2076218=570097} 2020-11-16T22:04:36.981 INFO:tasks.rados.rados.2.smithi057.stdout:747: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 655539 to 1288220 tid 1 2020-11-16T22:04:36.989 INFO:tasks.rados.rados.2.smithi057.stdout:747: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2076218 to 2646315 tid 2 2020-11-16T22:04:36.989 INFO:tasks.rados.rados.2.smithi057.stdout:748: rollback oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 94 2020-11-16T22:04:36.989 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 76 2020-11-16T22:04:36.989 INFO:tasks.rados.rados.2.smithi057.stdout:747: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:36.990 INFO:tasks.rados.rados.2.smithi057.stdout:749: write oid 26 current snap is 94 2020-11-16T22:04:36.990 INFO:tasks.rados.rados.2.smithi057.stdout:749: seq_num 278 ranges {672346=707930,2134700=537646} 2020-11-16T22:04:36.997 INFO:tasks.rados.rados.2.smithi057.stdout:749: writing smithi05720651-26 from 672346 to 1380276 tid 1 2020-11-16T22:04:37.004 INFO:tasks.rados.rados.2.smithi057.stdout:749: writing smithi05720651-26 from 2134700 to 2672346 tid 2 2020-11-16T22:04:37.004 INFO:tasks.rados.rados.2.smithi057.stdout:750: write (excl) oid 12 current snap is 94 2020-11-16T22:04:37.004 INFO:tasks.rados.rados.2.smithi057.stdout:750: seq_num 279 ranges {689153=783179,2076829=457413} 2020-11-16T22:04:37.012 INFO:tasks.rados.rados.2.smithi057.stdout:750: writing smithi05720651-12 from 689153 to 1472332 tid 1 2020-11-16T22:04:37.019 INFO:tasks.rados.rados.2.smithi057.stdout:750: writing smithi05720651-12 from 2076829 to 2534242 tid 2 2020-11-16T22:04:37.019 INFO:tasks.rados.rados.2.smithi057.stdout:751: copy_from oid 40 from oid 48 current snap is 94 2020-11-16T22:04:37.019 INFO:tasks.rados.rados.2.smithi057.stdout:747: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:37.019 INFO:tasks.rados.rados.2.smithi057.stdout:752: write oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 94 2020-11-16T22:04:37.019 INFO:tasks.rados.rados.2.smithi057.stdout:752: seq_num 280 ranges {705960=458428,1735311=717424} 2020-11-16T22:04:37.026 INFO:tasks.rados.rados.2.smithi057.stdout:752: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 705960 to 1164388 tid 1 2020-11-16T22:04:37.034 INFO:tasks.rados.rados.2.smithi057.stdout:752: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1735311 to 2452735 tid 2 2020-11-16T22:04:37.034 INFO:tasks.rados.rados.2.smithi057.stdout:747: finishing write tid 4 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:37.034 INFO:tasks.rados.rados.2.smithi057.stdout:753: read oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:37.034 INFO:tasks.rados.rados.2.smithi057.stdout:753: expect (ObjNum 194 snap 64 seq_num 194) 2020-11-16T22:04:37.034 INFO:tasks.rados.rados.2.smithi057.stdout:754: read oid 30 snap -1 2020-11-16T22:04:37.034 INFO:tasks.rados.rados.2.smithi057.stdout:754: expect (ObjNum 243 snap 81 seq_num 243) 2020-11-16T22:04:37.035 INFO:tasks.rados.rados.2.smithi057.stdout:755: read oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 86 2020-11-16T22:04:37.035 INFO:tasks.rados.rados.2.smithi057.stdout:755: expect deleted 2020-11-16T22:04:37.035 INFO:tasks.rados.rados.2.smithi057.stdout:756: snap_create 2020-11-16T22:04:37.035 INFO:tasks.rados.rados.2.smithi057.stdout:747: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:37.035 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 293 (ObjNum 277 snap 94 seq_num 277) dirty exists 2020-11-16T22:04:37.035 INFO:tasks.rados.rados.2.smithi057.stdout:747: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 277 snap 94 seq_num 277) 2020-11-16T22:04:37.035 INFO:tasks.rados.rados.2.smithi057.stdout:748: finishing rollback tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:37.036 INFO:tasks.rados.rados.2.smithi057.stdout:748: finishing rollback tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:37.036 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 36 (ObjNum 215 snap 73 seq_num 215) dirty exists 2020-11-16T22:04:37.036 INFO:tasks.rados.rados.2.smithi057.stdout:749: finishing write tid 1 to smithi05720651-26 2020-11-16T22:04:37.036 INFO:tasks.rados.rados.2.smithi057.stdout:749: finishing write tid 2 to smithi05720651-26 2020-11-16T22:04:37.036 INFO:tasks.rados.rados.2.smithi057.stdout:749: finishing write tid 4 to smithi05720651-26 2020-11-16T22:04:37.036 INFO:tasks.rados.rados.2.smithi057.stdout:749: finishing write tid 5 to smithi05720651-26 2020-11-16T22:04:37.036 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 667 (ObjNum 278 snap 94 seq_num 278) dirty exists 2020-11-16T22:04:37.037 INFO:tasks.rados.rados.2.smithi057.stdout:749: left oid 26 (ObjNum 278 snap 94 seq_num 278) 2020-11-16T22:04:37.037 INFO:tasks.rados.rados.2.smithi057.stdout:750: finishing write tid 1 to smithi05720651-12 2020-11-16T22:04:37.037 INFO:tasks.rados.rados.2.smithi057.stdout:750: finishing write tid 2 to smithi05720651-12 2020-11-16T22:04:37.037 INFO:tasks.rados.rados.2.smithi057.stdout:750: finishing write tid 4 to smithi05720651-12 2020-11-16T22:04:37.037 INFO:tasks.rados.rados.2.smithi057.stdout:750: finishing write tid 5 to smithi05720651-12 2020-11-16T22:04:37.037 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 303 (ObjNum 279 snap 94 seq_num 279) dirty exists 2020-11-16T22:04:37.037 INFO:tasks.rados.rados.2.smithi057.stdout:750: left oid 12 (ObjNum 279 snap 94 seq_num 279) 2020-11-16T22:04:37.038 INFO:tasks.rados.rados.2.smithi057.stdout:752: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:37.038 INFO:tasks.rados.rados.2.smithi057.stdout:751: finishing copy_from to smithi05720651-40 2020-11-16T22:04:37.038 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 168 (ObjNum 144 snap 44 seq_num 144) dirty exists 2020-11-16T22:04:37.038 INFO:tasks.rados.rados.2.smithi057.stdout:751: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:04:37.039 INFO:tasks.rados.rados.2.smithi057.stdout:752: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:37.040 INFO:tasks.rados.rados.2.smithi057.stdout:752: finishing write tid 4 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:37.040 INFO:tasks.rados.rados.2.smithi057.stdout:752: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:37.040 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 155 (ObjNum 280 snap 94 seq_num 280) dirty exists 2020-11-16T22:04:37.041 INFO:tasks.rados.rados.2.smithi057.stdout:752: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 280 snap 94 seq_num 280) 2020-11-16T22:04:37.042 INFO:tasks.rados.rados.2.smithi057.stdout:754: expect (ObjNum 243 snap 81 seq_num 243) 2020-11-16T22:04:37.131 INFO:tasks.rados.rados.2.smithi057.stdout:753: expect (ObjNum 194 snap 64 seq_num 194) 2020-11-16T22:04:37.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:36 smithi016 bash[10302]: cluster 2020-11-16T22:04:35.622601+0000 mgr.x (mgr.24115) 359 : cluster [DBG] pgmap v538: 17 pgs: 17 active+clean; 218 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 940 KiB/s wr, 7 op/s 2020-11-16T22:04:37.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:36 smithi016 bash[10302]: cluster 2020-11-16T22:04:35.967212+0000 mon.a (mon.0) 891 : cluster [DBG] osdmap e250: 12 total, 12 up, 12 in 2020-11-16T22:04:37.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:36 smithi195 bash[10218]: cluster 2020-11-16T22:04:35.622601+0000 mgr.x (mgr.24115) 359 : cluster [DBG] pgmap v538: 17 pgs: 17 active+clean; 218 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 940 KiB/s wr, 7 op/s 2020-11-16T22:04:37.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:36 smithi195 bash[10218]: cluster 2020-11-16T22:04:35.967212+0000 mon.a (mon.0) 891 : cluster [DBG] osdmap e250: 12 total, 12 up, 12 in 2020-11-16T22:04:37.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:36 smithi057 bash[10301]: cluster 2020-11-16T22:04:35.622601+0000 mgr.x (mgr.24115) 359 : cluster [DBG] pgmap v538: 17 pgs: 17 active+clean; 218 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 940 KiB/s wr, 7 op/s 2020-11-16T22:04:37.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:36 smithi057 bash[10301]: cluster 2020-11-16T22:04:35.967212+0000 mon.a (mon.0) 891 : cluster [DBG] osdmap e250: 12 total, 12 up, 12 in 2020-11-16T22:04:37.984 INFO:tasks.rados.rados.2.smithi057.stdout:747: done (9 left) 2020-11-16T22:04:37.984 INFO:tasks.rados.rados.2.smithi057.stdout:748: done (8 left) 2020-11-16T22:04:37.984 INFO:tasks.rados.rados.2.smithi057.stdout:749: done (7 left) 2020-11-16T22:04:37.984 INFO:tasks.rados.rados.2.smithi057.stdout:750: done (6 left) 2020-11-16T22:04:37.984 INFO:tasks.rados.rados.2.smithi057.stdout:751: done (5 left) 2020-11-16T22:04:37.985 INFO:tasks.rados.rados.2.smithi057.stdout:752: done (4 left) 2020-11-16T22:04:37.985 INFO:tasks.rados.rados.2.smithi057.stdout:753: done (3 left) 2020-11-16T22:04:37.985 INFO:tasks.rados.rados.2.smithi057.stdout:754: done (2 left) 2020-11-16T22:04:37.985 INFO:tasks.rados.rados.2.smithi057.stdout:755: done (1 left) 2020-11-16T22:04:37.985 INFO:tasks.rados.rados.2.smithi057.stdout:756: done (0 left) 2020-11-16T22:04:37.985 INFO:tasks.rados.rados.2.smithi057.stdout:757: read oid 18 snap -1 2020-11-16T22:04:37.985 INFO:tasks.rados.rados.2.smithi057.stdout:757: expect (ObjNum 243 snap 81 seq_num 243) 2020-11-16T22:04:37.985 INFO:tasks.rados.rados.2.smithi057.stdout:758: write (excl) oid 32 current snap is 95 2020-11-16T22:04:37.986 INFO:tasks.rados.rados.2.smithi057.stdout:758: seq_num 281 ranges {722767=533677,1793793=461082} 2020-11-16T22:04:38.000 INFO:tasks.rados.rados.2.smithi057.stdout:758: writing smithi05720651-32 from 722767 to 1256444 tid 1 2020-11-16T22:04:38.005 INFO:tasks.rados.rados.2.smithi057.stdout:758: writing smithi05720651-32 from 1793793 to 2254875 tid 2 2020-11-16T22:04:38.005 INFO:tasks.rados.rados.2.smithi057.stdout:759: write oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 95 2020-11-16T22:04:38.006 INFO:tasks.rados.rados.2.smithi057.stdout:759: seq_num 282 ranges {739574=725279,1968628=721093} 2020-11-16T22:04:38.013 INFO:tasks.rados.rados.2.smithi057.stdout:759: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 739574 to 1464853 tid 1 2020-11-16T22:04:38.021 INFO:tasks.rados.rados.2.smithi057.stdout:759: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1968628 to 2689721 tid 2 2020-11-16T22:04:38.021 INFO:tasks.rados.rados.2.smithi057.stdout:760: delete oid 30 current snap is 95 2020-11-16T22:04:38.021 INFO:tasks.rados.rados.2.smithi057.stdout:757: expect (ObjNum 243 snap 81 seq_num 243) 2020-11-16T22:04:38.114 INFO:tasks.rados.rados.2.smithi057.stdout:758: finishing write tid 1 to smithi05720651-32 2020-11-16T22:04:38.114 INFO:tasks.rados.rados.2.smithi057.stdout:758: finishing write tid 2 to smithi05720651-32 2020-11-16T22:04:38.114 INFO:tasks.rados.rados.2.smithi057.stdout:758: finishing write tid 4 to smithi05720651-32 2020-11-16T22:04:38.115 INFO:tasks.rados.rados.2.smithi057.stdout:758: finishing write tid 5 to smithi05720651-32 2020-11-16T22:04:38.115 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 673 (ObjNum 281 snap 95 seq_num 281) dirty exists 2020-11-16T22:04:38.115 INFO:tasks.rados.rados.2.smithi057.stdout:758: left oid 32 (ObjNum 281 snap 95 seq_num 281) 2020-11-16T22:04:38.115 INFO:tasks.rados.rados.2.smithi057.stdout:757: done (3 left) 2020-11-16T22:04:38.115 INFO:tasks.rados.rados.2.smithi057.stdout:758: done (2 left) 2020-11-16T22:04:38.115 INFO:tasks.rados.rados.2.smithi057.stdout:760: done (1 left) 2020-11-16T22:04:38.115 INFO:tasks.rados.rados.2.smithi057.stdout:761: rollback oid 50 current snap is 95 2020-11-16T22:04:38.116 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 50 to 72 2020-11-16T22:04:38.116 INFO:tasks.rados.rados.2.smithi057.stdout:759: finishing write tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:38.116 INFO:tasks.rados.rados.2.smithi057.stdout:759: finishing write tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:38.116 INFO:tasks.rados.rados.2.smithi057.stdout:759: finishing write tid 4 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:38.116 INFO:tasks.rados.rados.2.smithi057.stdout:759: finishing write tid 5 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:38.116 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 520 (ObjNum 282 snap 95 seq_num 282) dirty exists 2020-11-16T22:04:38.116 INFO:tasks.rados.rados.2.smithi057.stdout:759: left oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 282 snap 95 seq_num 282) 2020-11-16T22:04:38.117 INFO:tasks.rados.rados.2.smithi057.stdout:759: done (1 left) 2020-11-16T22:04:38.117 INFO:tasks.rados.rados.2.smithi057.stdout:762: snap_create 2020-11-16T22:04:38.123 INFO:tasks.rados.rados.2.smithi057.stdout:761: finishing rollback tid 0 to smithi05720651-50 2020-11-16T22:04:38.123 INFO:tasks.rados.rados.2.smithi057.stdout:761: finishing rollback tid 1 to smithi05720651-50 2020-11-16T22:04:38.123 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 562 (ObjNum 1869573999 snap 28527 seq_num 336) dirty dne 2020-11-16T22:04:38.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:37 smithi016 bash[10302]: cluster 2020-11-16T22:04:36.977397+0000 mon.a (mon.0) 892 : cluster [DBG] osdmap e251: 12 total, 12 up, 12 in 2020-11-16T22:04:38.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:37 smithi195 bash[10218]: cluster 2020-11-16T22:04:36.977397+0000 mon.a (mon.0) 892 : cluster [DBG] osdmap e251: 12 total, 12 up, 12 in 2020-11-16T22:04:38.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:37 smithi057 bash[10301]: cluster 2020-11-16T22:04:36.977397+0000 mon.a (mon.0) 892 : cluster [DBG] osdmap e251: 12 total, 12 up, 12 in 2020-11-16T22:04:38.983 INFO:tasks.rados.rados.2.smithi057.stdout:761: done (1 left) 2020-11-16T22:04:38.984 INFO:tasks.rados.rados.2.smithi057.stdout:762: done (0 left) 2020-11-16T22:04:38.984 INFO:tasks.rados.rados.2.smithi057.stdout:763: snap_remove snap 86 2020-11-16T22:04:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:38 smithi016 bash[10302]: cluster 2020-11-16T22:04:37.623336+0000 mgr.x (mgr.24115) 360 : cluster [DBG] pgmap v541: 17 pgs: 17 active+clean; 220 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2020-11-16T22:04:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:38 smithi016 bash[10302]: cluster 2020-11-16T22:04:37.987638+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e252: 12 total, 12 up, 12 in 2020-11-16T22:04:39.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:38 smithi195 bash[10218]: cluster 2020-11-16T22:04:37.623336+0000 mgr.x (mgr.24115) 360 : cluster [DBG] pgmap v541: 17 pgs: 17 active+clean; 220 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2020-11-16T22:04:39.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:38 smithi195 bash[10218]: cluster 2020-11-16T22:04:37.987638+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e252: 12 total, 12 up, 12 in 2020-11-16T22:04:39.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:39 smithi057 bash[10301]: cluster 2020-11-16T22:04:37.623336+0000 mgr.x (mgr.24115) 360 : cluster [DBG] pgmap v541: 17 pgs: 17 active+clean; 220 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2020-11-16T22:04:39.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:39 smithi057 bash[10301]: cluster 2020-11-16T22:04:37.987638+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e252: 12 total, 12 up, 12 in 2020-11-16T22:04:40.009 INFO:tasks.rados.rados.2.smithi057.stdout:763: done (0 left) 2020-11-16T22:04:40.010 INFO:tasks.rados.rados.2.smithi057.stdout:764: read oid 32 snap 72 2020-11-16T22:04:40.010 INFO:tasks.rados.rados.2.smithi057.stdout:764: expect (ObjNum 136 snap 38 seq_num 136) 2020-11-16T22:04:40.010 INFO:tasks.rados.rados.2.smithi057.stdout:765: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:40.010 INFO:tasks.rados.rados.2.smithi057.stdout:765: expect (ObjNum 249 snap 82 seq_num 249) 2020-11-16T22:04:40.010 INFO:tasks.rados.rados.2.smithi057.stdout:766: rollback oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 96 2020-11-16T22:04:40.010 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 90 2020-11-16T22:04:40.011 INFO:tasks.rados.rados.2.smithi057.stdout:767: snap_remove snap 89 2020-11-16T22:04:40.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:40 smithi016 bash[10302]: cluster 2020-11-16T22:04:38.990393+0000 mon.a (mon.0) 894 : cluster [DBG] osdmap e253: 12 total, 12 up, 12 in 2020-11-16T22:04:40.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:40 smithi195 bash[10218]: cluster 2020-11-16T22:04:38.990393+0000 mon.a (mon.0) 894 : cluster [DBG] osdmap e253: 12 total, 12 up, 12 in 2020-11-16T22:04:40.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:40 smithi057 bash[10301]: cluster 2020-11-16T22:04:38.990393+0000 mon.a (mon.0) 894 : cluster [DBG] osdmap e253: 12 total, 12 up, 12 in 2020-11-16T22:04:41.010 INFO:tasks.rados.rados.2.smithi057.stdout:767: done (3 left) 2020-11-16T22:04:41.010 INFO:tasks.rados.rados.2.smithi057.stdout:768: write (excl) oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 96 2020-11-16T22:04:41.010 INFO:tasks.rados.rados.2.smithi057.stdout:768: seq_num 284 ranges {773188=475777,1969239=724762} 2020-11-16T22:04:41.024 INFO:tasks.rados.rados.2.smithi057.stdout:768: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 773188 to 1248965 tid 1 2020-11-16T22:04:41.032 INFO:tasks.rados.rados.2.smithi057.stdout:768: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1969239 to 2694001 tid 2 2020-11-16T22:04:41.033 INFO:tasks.rados.rados.2.smithi057.stdout:769: rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 96 2020-11-16T22:04:41.033 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 83 2020-11-16T22:04:41.033 INFO:tasks.rados.rados.2.smithi057.stdout:765: expect (ObjNum 249 snap 82 seq_num 249) 2020-11-16T22:04:41.126 INFO:tasks.rados.rados.2.smithi057.stdout:764: expect (ObjNum 136 snap 38 seq_num 136) 2020-11-16T22:04:41.199 INFO:tasks.rados.rados.2.smithi057.stdout:766: finishing rollback tid 0 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:41.199 INFO:tasks.rados.rados.2.smithi057.stdout:766: finishing rollback tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:41.199 INFO:tasks.rados.rados.2.smithi057.stdout:766: finishing rollback tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:41.199 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 677 (ObjNum 228 snap 77 seq_num 228) dirty exists 2020-11-16T22:04:41.200 INFO:tasks.rados.rados.2.smithi057.stdout:764: done (4 left) 2020-11-16T22:04:41.200 INFO:tasks.rados.rados.2.smithi057.stdout:765: done (3 left) 2020-11-16T22:04:41.200 INFO:tasks.rados.rados.2.smithi057.stdout:766: done (2 left) 2020-11-16T22:04:41.200 INFO:tasks.rados.rados.2.smithi057.stdout:770: write (excl) oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 96 2020-11-16T22:04:41.200 INFO:tasks.rados.rados.2.smithi057.stdout:770: seq_num 285 ranges {789995=551026,2027721=468420} 2020-11-16T22:04:41.214 INFO:tasks.rados.rados.2.smithi057.stdout:770: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 789995 to 1341021 tid 1 2020-11-16T22:04:41.220 INFO:tasks.rados.rados.2.smithi057.stdout:770: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2027721 to 2496141 tid 2 2020-11-16T22:04:41.221 INFO:tasks.rados.rados.2.smithi057.stdout:771: snap_create 2020-11-16T22:04:41.221 INFO:tasks.rados.rados.2.smithi057.stdout:768: finishing write tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:41.221 INFO:tasks.rados.rados.2.smithi057.stdout:769: finishing rollback tid 0 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:41.221 INFO:tasks.rados.rados.2.smithi057.stdout:769: finishing rollback tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:41.221 INFO:tasks.rados.rados.2.smithi057.stdout:769: finishing rollback tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:41.221 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 574 (ObjNum 144 snap 44 seq_num 144) dirty exists 2020-11-16T22:04:41.221 INFO:tasks.rados.rados.2.smithi057.stdout:768: finishing write tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:41.222 INFO:tasks.rados.rados.2.smithi057.stdout:768: finishing write tid 4 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:41.222 INFO:tasks.rados.rados.2.smithi057.stdout:768: finishing write tid 5 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:41.222 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 692 (ObjNum 284 snap 96 seq_num 284) dirty exists 2020-11-16T22:04:41.222 INFO:tasks.rados.rados.2.smithi057.stdout:768: left oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 284 snap 96 seq_num 284) 2020-11-16T22:04:41.222 INFO:tasks.rados.rados.2.smithi057.stdout:770: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:41.225 INFO:tasks.rados.rados.2.smithi057.stdout:770: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:41.227 INFO:tasks.rados.rados.2.smithi057.stdout:770: finishing write tid 4 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:41.227 INFO:tasks.rados.rados.2.smithi057.stdout:770: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:41.227 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 266 (ObjNum 285 snap 96 seq_num 285) dirty exists 2020-11-16T22:04:41.228 INFO:tasks.rados.rados.2.smithi057.stdout:770: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 285 snap 96 seq_num 285) 2020-11-16T22:04:41.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:41 smithi016 bash[10302]: cluster 2020-11-16T22:04:39.624037+0000 mgr.x (mgr.24115) 361 : cluster [DBG] pgmap v544: 17 pgs: 17 active+clean; 220 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 560 KiB/s wr, 5 op/s 2020-11-16T22:04:41.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:41 smithi016 bash[10302]: cluster 2020-11-16T22:04:40.012177+0000 mon.a (mon.0) 895 : cluster [DBG] osdmap e254: 12 total, 12 up, 12 in 2020-11-16T22:04:41.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:41 smithi195 bash[10218]: cluster 2020-11-16T22:04:39.624037+0000 mgr.x (mgr.24115) 361 : cluster [DBG] pgmap v544: 17 pgs: 17 active+clean; 220 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 560 KiB/s wr, 5 op/s 2020-11-16T22:04:41.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:41 smithi195 bash[10218]: cluster 2020-11-16T22:04:40.012177+0000 mon.a (mon.0) 895 : cluster [DBG] osdmap e254: 12 total, 12 up, 12 in 2020-11-16T22:04:41.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:41 smithi057 bash[10301]: cluster 2020-11-16T22:04:39.624037+0000 mgr.x (mgr.24115) 361 : cluster [DBG] pgmap v544: 17 pgs: 17 active+clean; 220 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 560 KiB/s wr, 5 op/s 2020-11-16T22:04:41.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:41 smithi057 bash[10301]: cluster 2020-11-16T22:04:40.012177+0000 mon.a (mon.0) 895 : cluster [DBG] osdmap e254: 12 total, 12 up, 12 in 2020-11-16T22:04:42.026 INFO:tasks.rados.rados.2.smithi057.stdout:768: done (3 left) 2020-11-16T22:04:42.027 INFO:tasks.rados.rados.2.smithi057.stdout:769: done (2 left) 2020-11-16T22:04:42.027 INFO:tasks.rados.rados.2.smithi057.stdout:770: done (1 left) 2020-11-16T22:04:42.027 INFO:tasks.rados.rados.2.smithi057.stdout:771: done (0 left) 2020-11-16T22:04:42.027 INFO:tasks.rados.rados.2.smithi057.stdout:772: snap_create 2020-11-16T22:04:42.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:42 smithi016 bash[10302]: cluster 2020-11-16T22:04:41.016304+0000 mon.a (mon.0) 896 : cluster [DBG] osdmap e255: 12 total, 12 up, 12 in 2020-11-16T22:04:42.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:42 smithi195 bash[10218]: cluster 2020-11-16T22:04:41.016304+0000 mon.a (mon.0) 896 : cluster [DBG] osdmap e255: 12 total, 12 up, 12 in 2020-11-16T22:04:42.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:42 smithi057 bash[10301]: cluster 2020-11-16T22:04:41.016304+0000 mon.a (mon.0) 896 : cluster [DBG] osdmap e255: 12 total, 12 up, 12 in 2020-11-16T22:04:43.030 INFO:tasks.rados.rados.2.smithi057.stdout:772: done (0 left) 2020-11-16T22:04:43.030 INFO:tasks.rados.rados.2.smithi057.stdout:773: write (excl) oid 16 current snap is 98 2020-11-16T22:04:43.030 INFO:tasks.rados.rados.2.smithi057.stdout:773: seq_num 286 ranges {406802=626275,1686203=728431} 2020-11-16T22:04:43.041 INFO:tasks.rados.rados.2.smithi057.stdout:773: writing smithi05720651-16 from 406802 to 1033077 tid 1 2020-11-16T22:04:43.051 INFO:tasks.rados.rados.2.smithi057.stdout:773: writing smithi05720651-16 from 1686203 to 2414634 tid 2 2020-11-16T22:04:43.051 INFO:tasks.rados.rados.2.smithi057.stdout:774: rollback oid 24 current snap is 98 2020-11-16T22:04:43.051 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 24 to 72 2020-11-16T22:04:43.051 INFO:tasks.rados.rados.2.smithi057.stdout:775: read oid 22 snap -1 2020-11-16T22:04:43.051 INFO:tasks.rados.rados.2.smithi057.stdout:775: expect (ObjNum 130 snap 37 seq_num 130) 2020-11-16T22:04:43.051 INFO:tasks.rados.rados.2.smithi057.stdout:776: snap_remove snap 76 2020-11-16T22:04:43.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:43 smithi016 bash[10302]: cluster 2020-11-16T22:04:41.624782+0000 mgr.x (mgr.24115) 362 : cluster [DBG] pgmap v547: 17 pgs: 17 active+clean; 241 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 3.1 MiB/s wr, 25 op/s 2020-11-16T22:04:43.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:43 smithi016 bash[10302]: cluster 2020-11-16T22:04:42.037316+0000 mon.a (mon.0) 897 : cluster [DBG] osdmap e256: 12 total, 12 up, 12 in 2020-11-16T22:04:43.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:43 smithi195 bash[10218]: cluster 2020-11-16T22:04:41.624782+0000 mgr.x (mgr.24115) 362 : cluster [DBG] pgmap v547: 17 pgs: 17 active+clean; 241 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 3.1 MiB/s wr, 25 op/s 2020-11-16T22:04:43.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:43 smithi195 bash[10218]: cluster 2020-11-16T22:04:42.037316+0000 mon.a (mon.0) 897 : cluster [DBG] osdmap e256: 12 total, 12 up, 12 in 2020-11-16T22:04:43.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:43 smithi057 bash[10301]: cluster 2020-11-16T22:04:41.624782+0000 mgr.x (mgr.24115) 362 : cluster [DBG] pgmap v547: 17 pgs: 17 active+clean; 241 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 3.1 MiB/s wr, 25 op/s 2020-11-16T22:04:43.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:43 smithi057 bash[10301]: cluster 2020-11-16T22:04:42.037316+0000 mon.a (mon.0) 897 : cluster [DBG] osdmap e256: 12 total, 12 up, 12 in 2020-11-16T22:04:44.048 INFO:tasks.rados.rados.2.smithi057.stdout:776: done (3 left) 2020-11-16T22:04:44.048 INFO:tasks.rados.rados.2.smithi057.stdout:777: write (excl) oid 28 current snap is 98 2020-11-16T22:04:44.049 INFO:tasks.rados.rados.2.smithi057.stdout:777: seq_num 287 ranges {423609=701524,1628332=472089,2648987=174622} 2020-11-16T22:04:44.060 INFO:tasks.rados.rados.2.smithi057.stdout:777: writing smithi05720651-28 from 423609 to 1125133 tid 1 2020-11-16T22:04:44.066 INFO:tasks.rados.rados.2.smithi057.stdout:777: writing smithi05720651-28 from 1628332 to 2100421 tid 2 2020-11-16T22:04:44.071 INFO:tasks.rados.rados.2.smithi057.stdout:777: writing smithi05720651-28 from 2648987 to 2823609 tid 3 2020-11-16T22:04:44.071 INFO:tasks.rados.rados.2.smithi057.stdout:778: read oid 36 snap -1 2020-11-16T22:04:44.071 INFO:tasks.rados.rados.2.smithi057.stdout:778: expect (ObjNum 267 snap 86 seq_num 267) 2020-11-16T22:04:44.072 INFO:tasks.rados.rados.2.smithi057.stdout:779: read oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:44.072 INFO:tasks.rados.rados.2.smithi057.stdout:779: expect deleted 2020-11-16T22:04:44.072 INFO:tasks.rados.rados.2.smithi057.stdout:780: delete oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 98 2020-11-16T22:04:44.072 INFO:tasks.rados.rados.2.smithi057.stdout:773: finishing write tid 1 to smithi05720651-16 2020-11-16T22:04:44.072 INFO:tasks.rados.rados.2.smithi057.stdout:774: finishing rollback tid 1 to smithi05720651-24 2020-11-16T22:04:44.072 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 151 (ObjNum 353 snap 0 seq_num 1953066355) dirty dne 2020-11-16T22:04:44.073 INFO:tasks.rados.rados.2.smithi057.stdout:775: expect (ObjNum 130 snap 37 seq_num 130) 2020-11-16T22:04:44.176 INFO:tasks.rados.rados.2.smithi057.stdout:773: finishing write tid 2 to smithi05720651-16 2020-11-16T22:04:44.177 INFO:tasks.rados.rados.2.smithi057.stdout:773: finishing write tid 4 to smithi05720651-16 2020-11-16T22:04:44.177 INFO:tasks.rados.rados.2.smithi057.stdout:773: finishing write tid 5 to smithi05720651-16 2020-11-16T22:04:44.177 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 538 (ObjNum 286 snap 98 seq_num 286) dirty exists 2020-11-16T22:04:44.177 INFO:tasks.rados.rados.2.smithi057.stdout:773: left oid 16 (ObjNum 286 snap 98 seq_num 286) 2020-11-16T22:04:44.177 INFO:tasks.rados.rados.2.smithi057.stdout:777: finishing write tid 1 to smithi05720651-28 2020-11-16T22:04:44.178 INFO:tasks.rados.rados.2.smithi057.stdout:777: finishing write tid 2 to smithi05720651-28 2020-11-16T22:04:44.178 INFO:tasks.rados.rados.2.smithi057.stdout:777: finishing write tid 3 to smithi05720651-28 2020-11-16T22:04:44.178 INFO:tasks.rados.rados.2.smithi057.stdout:777: finishing write tid 5 to smithi05720651-28 2020-11-16T22:04:44.178 INFO:tasks.rados.rados.2.smithi057.stdout:777: finishing write tid 6 to smithi05720651-28 2020-11-16T22:04:44.178 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 439 (ObjNum 287 snap 98 seq_num 287) dirty exists 2020-11-16T22:04:44.183 INFO:tasks.rados.rados.2.smithi057.stdout:777: left oid 28 (ObjNum 287 snap 98 seq_num 287) 2020-11-16T22:04:44.183 INFO:tasks.rados.rados.2.smithi057.stdout:778: expect (ObjNum 267 snap 86 seq_num 267) 2020-11-16T22:04:44.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:44 smithi016 bash[10302]: cluster 2020-11-16T22:04:43.039823+0000 mon.a (mon.0) 898 : cluster [DBG] osdmap e257: 12 total, 12 up, 12 in 2020-11-16T22:04:44.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:44 smithi195 bash[10218]: cluster 2020-11-16T22:04:43.039823+0000 mon.a (mon.0) 898 : cluster [DBG] osdmap e257: 12 total, 12 up, 12 in 2020-11-16T22:04:44.349 INFO:journalctl@ceph.osd.2.smithi195.stdout:Nov 16 22:04:44 smithi195 bash[21024]: debug 2020-11-16T22:04:44.049+0000 7f3c19f37700 -1 osd.2 pg_epoch: 258 pg[2.e( v 257'169 (0'0,257'169] local-lis/les=71/72 n=6 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [2,3] r=0 lpr=71 crt=244'168 lcod 244'168 mlcod 244'168 active+clean+snaptrim trimq=[91~1] ps=[a9~1,ac~1]] removing snap head 2020-11-16T22:04:44.404 INFO:tasks.rados.rados.2.smithi057.stdout:773: done (6 left) 2020-11-16T22:04:44.404 INFO:tasks.rados.rados.2.smithi057.stdout:774: done (5 left) 2020-11-16T22:04:44.404 INFO:tasks.rados.rados.2.smithi057.stdout:775: done (4 left) 2020-11-16T22:04:44.404 INFO:tasks.rados.rados.2.smithi057.stdout:777: done (3 left) 2020-11-16T22:04:44.404 INFO:tasks.rados.rados.2.smithi057.stdout:778: done (2 left) 2020-11-16T22:04:44.405 INFO:tasks.rados.rados.2.smithi057.stdout:779: done (1 left) 2020-11-16T22:04:44.405 INFO:tasks.rados.rados.2.smithi057.stdout:780: done (0 left) 2020-11-16T22:04:44.405 INFO:tasks.rados.rados.2.smithi057.stdout:781: copy_from oid 18 from oid 50 current snap is 98 2020-11-16T22:04:44.405 INFO:tasks.rados.rados.2.smithi057.stdout:782: delete oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 98 2020-11-16T22:04:44.407 INFO:tasks.rados.rados.2.smithi057.stdout:781: finishing copy_from to smithi05720651-18 2020-11-16T22:04:44.407 INFO:tasks.rados.rados.2.smithi057.stdout:781: got expected ENOENT (src dne) 2020-11-16T22:04:44.407 INFO:tasks.rados.rados.2.smithi057.stdout:781: finishing copy_from racing read to smithi05720651-18 2020-11-16T22:04:44.409 INFO:tasks.rados.rados.2.smithi057.stdout:781: done (1 left) 2020-11-16T22:04:44.409 INFO:tasks.rados.rados.2.smithi057.stdout:782: done (0 left) 2020-11-16T22:04:44.409 INFO:tasks.rados.rados.2.smithi057.stdout:783: read oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:44.410 INFO:tasks.rados.rados.2.smithi057.stdout:783: expect (ObjNum 193 snap 64 seq_num 193) 2020-11-16T22:04:44.410 INFO:tasks.rados.rados.2.smithi057.stdout:784: snap_create 2020-11-16T22:04:44.415 INFO:tasks.rados.rados.2.smithi057.stdout:783: expect (ObjNum 193 snap 64 seq_num 193) 2020-11-16T22:04:44.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:44 smithi057 bash[10301]: cluster 2020-11-16T22:04:43.039823+0000 mon.a (mon.0) 898 : cluster [DBG] osdmap e257: 12 total, 12 up, 12 in 2020-11-16T22:04:45.049 INFO:tasks.rados.rados.2.smithi057.stdout:783: done (1 left) 2020-11-16T22:04:45.050 INFO:tasks.rados.rados.2.smithi057.stdout:784: done (0 left) 2020-11-16T22:04:45.050 INFO:tasks.rados.rados.2.smithi057.stdout:785: write oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 99 2020-11-16T22:04:45.050 INFO:tasks.rados.rados.2.smithi057.stdout:785: seq_num 290 ranges {474030=643624,1520131=735769} 2020-11-16T22:04:45.066 INFO:tasks.rados.rados.2.smithi057.stdout:785: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 474030 to 1117654 tid 1 2020-11-16T22:04:45.072 INFO:tasks.rados.rados.2.smithi057.stdout:785: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1520131 to 2255900 tid 2 2020-11-16T22:04:45.072 INFO:tasks.rados.rados.2.smithi057.stdout:786: snap_remove snap 90 2020-11-16T22:04:45.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:45 smithi016 bash[10302]: cluster 2020-11-16T22:04:43.625483+0000 mgr.x (mgr.24115) 363 : cluster [DBG] pgmap v550: 17 pgs: 17 active+clean; 241 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 3.1 MiB/s wr, 25 op/s 2020-11-16T22:04:45.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:45 smithi016 bash[10302]: cluster 2020-11-16T22:04:44.058418+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e258: 12 total, 12 up, 12 in 2020-11-16T22:04:45.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:45 smithi195 bash[10218]: cluster 2020-11-16T22:04:43.625483+0000 mgr.x (mgr.24115) 363 : cluster [DBG] pgmap v550: 17 pgs: 17 active+clean; 241 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 3.1 MiB/s wr, 25 op/s 2020-11-16T22:04:45.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:45 smithi195 bash[10218]: cluster 2020-11-16T22:04:44.058418+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e258: 12 total, 12 up, 12 in 2020-11-16T22:04:45.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:45 smithi057 bash[10301]: cluster 2020-11-16T22:04:43.625483+0000 mgr.x (mgr.24115) 363 : cluster [DBG] pgmap v550: 17 pgs: 17 active+clean; 241 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 3.1 MiB/s wr, 25 op/s 2020-11-16T22:04:45.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:45 smithi057 bash[10301]: cluster 2020-11-16T22:04:44.058418+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e258: 12 total, 12 up, 12 in 2020-11-16T22:04:46.072 INFO:tasks.rados.rados.2.smithi057.stdout:786: done (1 left) 2020-11-16T22:04:46.073 INFO:tasks.rados.rados.2.smithi057.stdout:787: read oid 2 snap -1 2020-11-16T22:04:46.073 INFO:tasks.rados.rados.2.smithi057.stdout:787: expect (ObjNum 192 snap 64 seq_num 192) 2020-11-16T22:04:46.073 INFO:tasks.rados.rados.2.smithi057.stdout:788: delete oid 30 current snap is 99 2020-11-16T22:04:46.073 INFO:tasks.rados.rados.2.smithi057.stdout:785: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:46.073 INFO:tasks.rados.rados.2.smithi057.stdout:785: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:46.074 INFO:tasks.rados.rados.2.smithi057.stdout:785: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:46.074 INFO:tasks.rados.rados.2.smithi057.stdout:785: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:46.074 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 427 (ObjNum 290 snap 99 seq_num 290) dirty exists 2020-11-16T22:04:46.074 INFO:tasks.rados.rados.2.smithi057.stdout:785: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 290 snap 99 seq_num 290) 2020-11-16T22:04:46.081 INFO:tasks.rados.rados.2.smithi057.stdout:785: done (2 left) 2020-11-16T22:04:46.082 INFO:tasks.rados.rados.2.smithi057.stdout:788: done (1 left) 2020-11-16T22:04:46.082 INFO:tasks.rados.rados.2.smithi057.stdout:789: snap_create 2020-11-16T22:04:46.087 INFO:tasks.rados.rados.2.smithi057.stdout:787: expect (ObjNum 192 snap 64 seq_num 192) 2020-11-16T22:04:46.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:46 smithi016 bash[10302]: cluster 2020-11-16T22:04:45.059578+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e259: 12 total, 12 up, 12 in 2020-11-16T22:04:46.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:46 smithi195 bash[10218]: cluster 2020-11-16T22:04:45.059578+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e259: 12 total, 12 up, 12 in 2020-11-16T22:04:46.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:46 smithi057 bash[10301]: cluster 2020-11-16T22:04:45.059578+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e259: 12 total, 12 up, 12 in 2020-11-16T22:04:47.075 INFO:tasks.rados.rados.2.smithi057.stdout:787: done (1 left) 2020-11-16T22:04:47.075 INFO:tasks.rados.rados.2.smithi057.stdout:789: done (0 left) 2020-11-16T22:04:47.076 INFO:tasks.rados.rados.2.smithi057.stdout:790: delete oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 100 2020-11-16T22:04:47.083 INFO:tasks.rados.rados.2.smithi057.stdout:790: done (0 left) 2020-11-16T22:04:47.084 INFO:tasks.rados.rados.2.smithi057.stdout:791: read oid 2 snap -1 2020-11-16T22:04:47.084 INFO:tasks.rados.rados.2.smithi057.stdout:791: expect (ObjNum 192 snap 64 seq_num 192) 2020-11-16T22:04:47.084 INFO:tasks.rados.rados.2.smithi057.stdout:792: snap_remove snap 84 2020-11-16T22:04:47.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:47 smithi016 bash[10302]: cluster 2020-11-16T22:04:45.626176+0000 mgr.x (mgr.24115) 364 : cluster [DBG] pgmap v553: 17 pgs: 17 active+clean; 235 MiB data, 509 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 661 KiB/s wr, 7 op/s 2020-11-16T22:04:47.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:47 smithi016 bash[10302]: cluster 2020-11-16T22:04:46.076146+0000 mon.a (mon.0) 901 : cluster [DBG] osdmap e260: 12 total, 12 up, 12 in 2020-11-16T22:04:47.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:47 smithi195 bash[10218]: cluster 2020-11-16T22:04:45.626176+0000 mgr.x (mgr.24115) 364 : cluster [DBG] pgmap v553: 17 pgs: 17 active+clean; 235 MiB data, 509 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 661 KiB/s wr, 7 op/s 2020-11-16T22:04:47.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:47 smithi195 bash[10218]: cluster 2020-11-16T22:04:46.076146+0000 mon.a (mon.0) 901 : cluster [DBG] osdmap e260: 12 total, 12 up, 12 in 2020-11-16T22:04:47.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:47 smithi057 bash[10301]: cluster 2020-11-16T22:04:45.626176+0000 mgr.x (mgr.24115) 364 : cluster [DBG] pgmap v553: 17 pgs: 17 active+clean; 235 MiB data, 509 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 661 KiB/s wr, 7 op/s 2020-11-16T22:04:47.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:47 smithi057 bash[10301]: cluster 2020-11-16T22:04:46.076146+0000 mon.a (mon.0) 901 : cluster [DBG] osdmap e260: 12 total, 12 up, 12 in 2020-11-16T22:04:48.088 INFO:tasks.rados.rados.2.smithi057.stdout:792: done (1 left) 2020-11-16T22:04:48.089 INFO:tasks.rados.rados.2.smithi057.stdout:793: read oid 28 snap 85 2020-11-16T22:04:48.089 INFO:tasks.rados.rados.2.smithi057.stdout:793: expect (ObjNum 200 snap 67 seq_num 200) 2020-11-16T22:04:48.089 INFO:tasks.rados.rados.2.smithi057.stdout:794: write (excl) oid 8 current snap is 100 2020-11-16T22:04:48.089 INFO:tasks.rados.rados.2.smithi057.stdout:794: seq_num 293 ranges {524451=469371,1579224=483096,2529878=394573} 2020-11-16T22:04:48.100 INFO:tasks.rados.rados.2.smithi057.stdout:794: writing smithi05720651-8 from 524451 to 993822 tid 1 2020-11-16T22:04:48.107 INFO:tasks.rados.rados.2.smithi057.stdout:794: writing smithi05720651-8 from 1579224 to 2062320 tid 2 2020-11-16T22:04:48.112 INFO:tasks.rados.rados.2.smithi057.stdout:794: writing smithi05720651-8 from 2529878 to 2924451 tid 3 2020-11-16T22:04:48.113 INFO:tasks.rados.rados.2.smithi057.stdout:795: snap_remove snap 98 2020-11-16T22:04:48.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:48 smithi016 bash[10302]: cluster 2020-11-16T22:04:47.085281+0000 mon.a (mon.0) 902 : cluster [DBG] osdmap e261: 12 total, 12 up, 12 in 2020-11-16T22:04:48.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:48 smithi195 bash[10218]: cluster 2020-11-16T22:04:47.085281+0000 mon.a (mon.0) 902 : cluster [DBG] osdmap e261: 12 total, 12 up, 12 in 2020-11-16T22:04:48.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:48 smithi057 bash[10301]: cluster 2020-11-16T22:04:47.085281+0000 mon.a (mon.0) 902 : cluster [DBG] osdmap e261: 12 total, 12 up, 12 in 2020-11-16T22:04:49.102 INFO:tasks.rados.rados.2.smithi057.stdout:795: done (3 left) 2020-11-16T22:04:49.103 INFO:tasks.rados.rados.2.smithi057.stdout:796: snap_remove snap 94 2020-11-16T22:04:49.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:49 smithi016 bash[10302]: cluster 2020-11-16T22:04:47.626863+0000 mgr.x (mgr.24115) 365 : cluster [DBG] pgmap v556: 17 pgs: 17 active+clean; 234 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 997 KiB/s wr, 13 op/s 2020-11-16T22:04:49.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:49 smithi016 bash[10302]: cluster 2020-11-16T22:04:48.095459+0000 mon.a (mon.0) 903 : cluster [DBG] osdmap e262: 12 total, 12 up, 12 in 2020-11-16T22:04:49.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:49 smithi195 bash[10218]: cluster 2020-11-16T22:04:47.626863+0000 mgr.x (mgr.24115) 365 : cluster [DBG] pgmap v556: 17 pgs: 17 active+clean; 234 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 997 KiB/s wr, 13 op/s 2020-11-16T22:04:49.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:49 smithi195 bash[10218]: cluster 2020-11-16T22:04:48.095459+0000 mon.a (mon.0) 903 : cluster [DBG] osdmap e262: 12 total, 12 up, 12 in 2020-11-16T22:04:49.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:49 smithi057 bash[10301]: cluster 2020-11-16T22:04:47.626863+0000 mgr.x (mgr.24115) 365 : cluster [DBG] pgmap v556: 17 pgs: 17 active+clean; 234 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 997 KiB/s wr, 13 op/s 2020-11-16T22:04:49.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:49 smithi057 bash[10301]: cluster 2020-11-16T22:04:48.095459+0000 mon.a (mon.0) 903 : cluster [DBG] osdmap e262: 12 total, 12 up, 12 in 2020-11-16T22:04:49.924 INFO:tasks.rados.rados.2.smithi057.stdout:796: done (3 left) 2020-11-16T22:04:49.924 INFO:tasks.rados.rados.2.smithi057.stdout:797: snap_remove snap 83 2020-11-16T22:04:50.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:50 smithi195 bash[10218]: cluster 2020-11-16T22:04:49.104963+0000 mon.a (mon.0) 904 : cluster [DBG] osdmap e263: 12 total, 12 up, 12 in 2020-11-16T22:04:50.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:50 smithi195 bash[10218]: cluster 2020-11-16T22:04:49.924811+0000 mon.a (mon.0) 905 : cluster [DBG] osdmap e264: 12 total, 12 up, 12 in 2020-11-16T22:04:50.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:50 smithi057 bash[10301]: cluster 2020-11-16T22:04:49.104963+0000 mon.a (mon.0) 904 : cluster [DBG] osdmap e263: 12 total, 12 up, 12 in 2020-11-16T22:04:50.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:50 smithi057 bash[10301]: cluster 2020-11-16T22:04:49.924811+0000 mon.a (mon.0) 905 : cluster [DBG] osdmap e264: 12 total, 12 up, 12 in 2020-11-16T22:04:50.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:50 smithi016 bash[10302]: cluster 2020-11-16T22:04:49.104963+0000 mon.a (mon.0) 904 : cluster [DBG] osdmap e263: 12 total, 12 up, 12 in 2020-11-16T22:04:50.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:50 smithi016 bash[10302]: cluster 2020-11-16T22:04:49.924811+0000 mon.a (mon.0) 905 : cluster [DBG] osdmap e264: 12 total, 12 up, 12 in 2020-11-16T22:04:50.936 INFO:tasks.rados.rados.2.smithi057.stdout:797: done (3 left) 2020-11-16T22:04:50.937 INFO:tasks.rados.rados.2.smithi057.stdout:798: snap_remove snap 93 2020-11-16T22:04:51.349 INFO:journalctl@ceph.osd.2.smithi195.stdout:Nov 16 22:04:50 smithi195 bash[21024]: debug 2020-11-16T22:04:50.957+0000 7f3c15f2f700 -1 osd.2 pg_epoch: 265 pg[2.e( v 264'182 (0'0,264'182] local-lis/les=71/72 n=5 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [2,3] r=0 lpr=71 crt=264'182 lcod 263'180 mlcod 263'180 active+clean+snaptrim trimq=[a2~1] ps=[a4~1,ad~1,b1~1,b8~1]] removing snap head 2020-11-16T22:04:51.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:51 smithi195 bash[10218]: cluster 2020-11-16T22:04:49.627628+0000 mgr.x (mgr.24115) 366 : cluster [DBG] pgmap v559: 17 pgs: 17 active+clean; 234 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 337 KiB/s wr, 5 op/s 2020-11-16T22:04:51.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:51 smithi195 bash[10218]: cluster 2020-11-16T22:04:50.945483+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e265: 12 total, 12 up, 12 in 2020-11-16T22:04:51.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:51 smithi057 bash[10301]: cluster 2020-11-16T22:04:49.627628+0000 mgr.x (mgr.24115) 366 : cluster [DBG] pgmap v559: 17 pgs: 17 active+clean; 234 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 337 KiB/s wr, 5 op/s 2020-11-16T22:04:51.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:51 smithi057 bash[10301]: cluster 2020-11-16T22:04:50.945483+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e265: 12 total, 12 up, 12 in 2020-11-16T22:04:51.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:51 smithi016 bash[10302]: cluster 2020-11-16T22:04:49.627628+0000 mgr.x (mgr.24115) 366 : cluster [DBG] pgmap v559: 17 pgs: 17 active+clean; 234 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 337 KiB/s wr, 5 op/s 2020-11-16T22:04:51.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:51 smithi016 bash[10302]: cluster 2020-11-16T22:04:50.945483+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e265: 12 total, 12 up, 12 in 2020-11-16T22:04:51.939 INFO:tasks.rados.rados.2.smithi057.stdout:798: done (3 left) 2020-11-16T22:04:51.939 INFO:tasks.rados.rados.2.smithi057.stdout:799: snap_remove snap 95 2020-11-16T22:04:52.939 INFO:tasks.rados.rados.2.smithi057.stdout:799: done (3 left) 2020-11-16T22:04:52.939 INFO:tasks.rados.rados.2.smithi057.stdout:800: copy_from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 38 current snap is 100 2020-11-16T22:04:52.939 INFO:tasks.rados.rados.2.smithi057.stdout:791: expect (ObjNum 192 snap 64 seq_num 192) 2020-11-16T22:04:53.047 INFO:tasks.rados.rados.2.smithi057.stdout:793: expect (ObjNum 200 snap 67 seq_num 200) 2020-11-16T22:04:53.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:52 smithi057 bash[10301]: cluster 2020-11-16T22:04:51.628414+0000 mgr.x (mgr.24115) 367 : cluster [DBG] pgmap v562: 17 pgs: 17 active+clean; 234 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 329 KiB/s wr, 6 op/s 2020-11-16T22:04:53.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:52 smithi057 bash[10301]: cluster 2020-11-16T22:04:51.947497+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e266: 12 total, 12 up, 12 in 2020-11-16T22:04:53.287 INFO:tasks.rados.rados.2.smithi057.stdout:794: finishing write tid 1 to smithi05720651-8 2020-11-16T22:04:53.288 INFO:tasks.rados.rados.2.smithi057.stdout:794: finishing write tid 2 to smithi05720651-8 2020-11-16T22:04:53.288 INFO:tasks.rados.rados.2.smithi057.stdout:794: finishing write tid 3 to smithi05720651-8 2020-11-16T22:04:53.288 INFO:tasks.rados.rados.2.smithi057.stdout:794: finishing write tid 5 to smithi05720651-8 2020-11-16T22:04:53.288 INFO:tasks.rados.rados.2.smithi057.stdout:794: finishing write tid 6 to smithi05720651-8 2020-11-16T22:04:53.288 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 178 (ObjNum 293 snap 100 seq_num 293) dirty exists 2020-11-16T22:04:53.288 INFO:tasks.rados.rados.2.smithi057.stdout:794: left oid 8 (ObjNum 293 snap 100 seq_num 293) 2020-11-16T22:04:53.288 INFO:tasks.rados.rados.2.smithi057.stdout:800: finishing copy_from to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:53.289 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 238 (ObjNum 271 snap 89 seq_num 271) dirty exists 2020-11-16T22:04:53.289 INFO:tasks.rados.rados.2.smithi057.stdout:800: finishing copy_from racing read to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:53.289 INFO:tasks.rados.rados.2.smithi057.stdout:791: done (3 left) 2020-11-16T22:04:53.289 INFO:tasks.rados.rados.2.smithi057.stdout:793: done (2 left) 2020-11-16T22:04:53.289 INFO:tasks.rados.rados.2.smithi057.stdout:794: done (1 left) 2020-11-16T22:04:53.289 INFO:tasks.rados.rados.2.smithi057.stdout:800: done (0 left) 2020-11-16T22:04:53.289 INFO:tasks.rados.rados.2.smithi057.stdout:801: copy_from oid 22 from oid 2 current snap is 100 2020-11-16T22:04:53.290 INFO:tasks.rados.rados.2.smithi057.stdout:802: write (excl) oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 100 2020-11-16T22:04:53.290 INFO:tasks.rados.rados.2.smithi057.stdout:802: seq_num 294 ranges {541258=544620,1637706=626754,2840948=100310} 2020-11-16T22:04:53.302 INFO:tasks.rados.rados.2.smithi057.stdout:802: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 541258 to 1085878 tid 1 2020-11-16T22:04:53.309 INFO:tasks.rados.rados.2.smithi057.stdout:802: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1637706 to 2264460 tid 2 2020-11-16T22:04:53.314 INFO:tasks.rados.rados.2.smithi057.stdout:802: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2840948 to 2941258 tid 3 2020-11-16T22:04:53.314 INFO:tasks.rados.rados.2.smithi057.stdout:803: copy_from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 100 2020-11-16T22:04:53.314 INFO:tasks.rados.rados.2.smithi057.stdout:801: finishing copy_from to smithi05720651-22 2020-11-16T22:04:53.314 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 423 (ObjNum 192 snap 64 seq_num 192) dirty exists 2020-11-16T22:04:53.314 INFO:tasks.rados.rados.2.smithi057.stdout:801: finishing copy_from racing read to smithi05720651-22 2020-11-16T22:04:53.315 INFO:tasks.rados.rados.2.smithi057.stdout:801: done (2 left) 2020-11-16T22:04:53.315 INFO:tasks.rados.rados.2.smithi057.stdout:804: read oid 20 snap -1 2020-11-16T22:04:53.315 INFO:tasks.rados.rados.2.smithi057.stdout:804: expect (ObjNum 268 snap 87 seq_num 268) 2020-11-16T22:04:53.315 INFO:tasks.rados.rados.2.smithi057.stdout:805: rollback oid 10 current snap is 100 2020-11-16T22:04:53.315 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 10 to 97 2020-11-16T22:04:53.315 INFO:tasks.rados.rados.2.smithi057.stdout:802: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:53.315 INFO:tasks.rados.rados.2.smithi057.stdout:806: write oid 2 current snap is 100 2020-11-16T22:04:53.316 INFO:tasks.rados.rados.2.smithi057.stdout:806: seq_num 295 ranges {558065=619869,1579835=486765,2468371=489694} 2020-11-16T22:04:53.321 INFO:tasks.rados.rados.2.smithi057.stdout:806: writing smithi05720651-2 from 558065 to 1177934 tid 1 2020-11-16T22:04:53.326 INFO:tasks.rados.rados.2.smithi057.stdout:806: writing smithi05720651-2 from 1579835 to 2066600 tid 2 2020-11-16T22:04:53.331 INFO:tasks.rados.rados.2.smithi057.stdout:806: writing smithi05720651-2 from 2468371 to 2958065 tid 3 2020-11-16T22:04:53.331 INFO:tasks.rados.rados.2.smithi057.stdout:807: copy_from oid 40 from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 100 2020-11-16T22:04:53.331 INFO:tasks.rados.rados.2.smithi057.stdout:802: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:53.332 INFO:tasks.rados.rados.2.smithi057.stdout:805: finishing rollback tid 1 to smithi05720651-10 2020-11-16T22:04:53.332 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 343 (ObjNum 49 snap 0 seq_num 1953066355) dirty dne 2020-11-16T22:04:53.332 INFO:tasks.rados.rados.2.smithi057.stdout:802: finishing write tid 3 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:53.332 INFO:tasks.rados.rados.2.smithi057.stdout:802: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:53.332 INFO:tasks.rados.rados.2.smithi057.stdout:802: finishing write tid 6 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:53.332 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 298 (ObjNum 294 snap 100 seq_num 294) dirty exists 2020-11-16T22:04:53.333 INFO:tasks.rados.rados.2.smithi057.stdout:802: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 294 snap 100 seq_num 294) 2020-11-16T22:04:53.333 INFO:tasks.rados.rados.2.smithi057.stdout:804: expect (ObjNum 268 snap 87 seq_num 268) 2020-11-16T22:04:53.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:52 smithi016 bash[10302]: cluster 2020-11-16T22:04:51.628414+0000 mgr.x (mgr.24115) 367 : cluster [DBG] pgmap v562: 17 pgs: 17 active+clean; 234 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 329 KiB/s wr, 6 op/s 2020-11-16T22:04:53.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:52 smithi016 bash[10302]: cluster 2020-11-16T22:04:51.947497+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e266: 12 total, 12 up, 12 in 2020-11-16T22:04:53.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:52 smithi195 bash[10218]: cluster 2020-11-16T22:04:51.628414+0000 mgr.x (mgr.24115) 367 : cluster [DBG] pgmap v562: 17 pgs: 17 active+clean; 234 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 329 KiB/s wr, 6 op/s 2020-11-16T22:04:53.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:52 smithi195 bash[10218]: cluster 2020-11-16T22:04:51.947497+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e266: 12 total, 12 up, 12 in 2020-11-16T22:04:53.413 INFO:tasks.rados.rados.2.smithi057.stdout:806: finishing write tid 1 to smithi05720651-2 2020-11-16T22:04:53.413 INFO:tasks.rados.rados.2.smithi057.stdout:803: finishing copy_from to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:53.413 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 155 (ObjNum 280 snap 94 seq_num 280) dirty exists 2020-11-16T22:04:53.413 INFO:tasks.rados.rados.2.smithi057.stdout:803: finishing copy_from racing read to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:53.413 INFO:tasks.rados.rados.2.smithi057.stdout:802: done (5 left) 2020-11-16T22:04:53.413 INFO:tasks.rados.rados.2.smithi057.stdout:803: done (4 left) 2020-11-16T22:04:53.414 INFO:tasks.rados.rados.2.smithi057.stdout:804: done (3 left) 2020-11-16T22:04:53.414 INFO:tasks.rados.rados.2.smithi057.stdout:805: done (2 left) 2020-11-16T22:04:53.414 INFO:tasks.rados.rados.2.smithi057.stdout:808: snap_create 2020-11-16T22:04:53.414 INFO:tasks.rados.rados.2.smithi057.stdout:806: finishing write tid 2 to smithi05720651-2 2020-11-16T22:04:53.414 INFO:tasks.rados.rados.2.smithi057.stdout:806: finishing write tid 3 to smithi05720651-2 2020-11-16T22:04:53.414 INFO:tasks.rados.rados.2.smithi057.stdout:806: finishing write tid 5 to smithi05720651-2 2020-11-16T22:04:53.414 INFO:tasks.rados.rados.2.smithi057.stdout:806: finishing write tid 6 to smithi05720651-2 2020-11-16T22:04:53.415 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 755 (ObjNum 295 snap 100 seq_num 295) dirty exists 2020-11-16T22:04:53.415 INFO:tasks.rados.rados.2.smithi057.stdout:806: left oid 2 (ObjNum 295 snap 100 seq_num 295) 2020-11-16T22:04:53.415 INFO:tasks.rados.rados.2.smithi057.stdout:807: finishing copy_from to smithi05720651-40 2020-11-16T22:04:53.415 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 259 (ObjNum 220 snap 76 seq_num 220) dirty exists 2020-11-16T22:04:53.415 INFO:tasks.rados.rados.2.smithi057.stdout:807: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:04:53.965 INFO:tasks.rados.rados.2.smithi057.stdout:806: done (2 left) 2020-11-16T22:04:53.965 INFO:tasks.rados.rados.2.smithi057.stdout:807: done (1 left) 2020-11-16T22:04:53.965 INFO:tasks.rados.rados.2.smithi057.stdout:808: done (0 left) 2020-11-16T22:04:53.965 INFO:tasks.rados.rados.2.smithi057.stdout:809: snap_create 2020-11-16T22:04:54.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:53 smithi016 bash[10302]: cluster 2020-11-16T22:04:52.950797+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e267: 12 total, 12 up, 12 in 2020-11-16T22:04:54.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:53 smithi195 bash[10218]: cluster 2020-11-16T22:04:52.950797+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e267: 12 total, 12 up, 12 in 2020-11-16T22:04:54.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:53 smithi057 bash[10301]: cluster 2020-11-16T22:04:52.950797+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e267: 12 total, 12 up, 12 in 2020-11-16T22:04:54.923 INFO:tasks.rados.rados.2.smithi057.stdout:809: done (0 left) 2020-11-16T22:04:54.924 INFO:tasks.rados.rados.2.smithi057.stdout:810: write oid 40 current snap is 102 2020-11-16T22:04:54.924 INFO:tasks.rados.rados.2.smithi057.stdout:810: seq_num 296 ranges {574872=695118,2038317=630423} 2020-11-16T22:04:54.939 INFO:tasks.rados.rados.2.smithi057.stdout:810: writing smithi05720651-40 from 574872 to 1269990 tid 1 2020-11-16T22:04:54.947 INFO:tasks.rados.rados.2.smithi057.stdout:810: writing smithi05720651-40 from 2038317 to 2668740 tid 2 2020-11-16T22:04:54.948 INFO:tasks.rados.rados.2.smithi057.stdout:811: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 91 2020-11-16T22:04:54.948 INFO:tasks.rados.rados.2.smithi057.stdout:811: expect (ObjNum 249 snap 82 seq_num 249) 2020-11-16T22:04:54.948 INFO:tasks.rados.rados.2.smithi057.stdout:812: rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 102 2020-11-16T22:04:54.948 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 88 2020-11-16T22:04:54.948 INFO:tasks.rados.rados.2.smithi057.stdout:813: copy_from oid 30 from oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 102 2020-11-16T22:04:54.948 INFO:tasks.rados.rados.2.smithi057.stdout:814: snap_create 2020-11-16T22:04:54.956 INFO:tasks.rados.rados.2.smithi057.stdout:811: expect (ObjNum 249 snap 82 seq_num 249) 2020-11-16T22:04:55.045 INFO:tasks.rados.rados.2.smithi057.stdout:810: finishing write tid 1 to smithi05720651-40 2020-11-16T22:04:55.046 INFO:tasks.rados.rados.2.smithi057.stdout:813: finishing copy_from to smithi05720651-30 2020-11-16T22:04:55.046 INFO:tasks.rados.rados.2.smithi057.stdout:813: got expected ENOENT (src dne) 2020-11-16T22:04:55.046 INFO:tasks.rados.rados.2.smithi057.stdout:810: finishing write tid 2 to smithi05720651-40 2020-11-16T22:04:55.046 INFO:tasks.rados.rados.2.smithi057.stdout:810: finishing write tid 4 to smithi05720651-40 2020-11-16T22:04:55.046 INFO:tasks.rados.rados.2.smithi057.stdout:812: finishing rollback tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:55.046 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 463 (ObjNum 129 snap 0 seq_num 2932515008) dirty dne 2020-11-16T22:04:55.047 INFO:tasks.rados.rados.2.smithi057.stdout:810: finishing write tid 5 to smithi05720651-40 2020-11-16T22:04:55.047 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 761 (ObjNum 296 snap 102 seq_num 296) dirty exists 2020-11-16T22:04:55.047 INFO:tasks.rados.rados.2.smithi057.stdout:810: left oid 40 (ObjNum 296 snap 102 seq_num 296) 2020-11-16T22:04:55.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:54 smithi016 bash[10302]: cluster 2020-11-16T22:04:53.629165+0000 mgr.x (mgr.24115) 368 : cluster [DBG] pgmap v565: 17 pgs: 17 active+clean; 234 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 329 KiB/s wr, 6 op/s 2020-11-16T22:04:55.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:54 smithi016 bash[10302]: cluster 2020-11-16T22:04:53.968392+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e268: 12 total, 12 up, 12 in 2020-11-16T22:04:55.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:54 smithi016 bash[10302]: cluster 2020-11-16T22:04:54.926510+0000 mon.a (mon.0) 910 : cluster [DBG] osdmap e269: 12 total, 12 up, 12 in 2020-11-16T22:04:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:54 smithi195 bash[10218]: cluster 2020-11-16T22:04:53.629165+0000 mgr.x (mgr.24115) 368 : cluster [DBG] pgmap v565: 17 pgs: 17 active+clean; 234 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 329 KiB/s wr, 6 op/s 2020-11-16T22:04:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:54 smithi195 bash[10218]: cluster 2020-11-16T22:04:53.968392+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e268: 12 total, 12 up, 12 in 2020-11-16T22:04:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:54 smithi195 bash[10218]: cluster 2020-11-16T22:04:54.926510+0000 mon.a (mon.0) 910 : cluster [DBG] osdmap e269: 12 total, 12 up, 12 in 2020-11-16T22:04:55.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:54 smithi057 bash[10301]: cluster 2020-11-16T22:04:53.629165+0000 mgr.x (mgr.24115) 368 : cluster [DBG] pgmap v565: 17 pgs: 17 active+clean; 234 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 329 KiB/s wr, 6 op/s 2020-11-16T22:04:55.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:54 smithi057 bash[10301]: cluster 2020-11-16T22:04:53.968392+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e268: 12 total, 12 up, 12 in 2020-11-16T22:04:55.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:54 smithi057 bash[10301]: cluster 2020-11-16T22:04:54.926510+0000 mon.a (mon.0) 910 : cluster [DBG] osdmap e269: 12 total, 12 up, 12 in 2020-11-16T22:04:55.721 INFO:tasks.rados.rados.2.smithi057.stdout:813: finishing copy_from racing read to smithi05720651-30 2020-11-16T22:04:55.937 INFO:tasks.rados.rados.2.smithi057.stdout:810: done (4 left) 2020-11-16T22:04:55.937 INFO:tasks.rados.rados.2.smithi057.stdout:811: done (3 left) 2020-11-16T22:04:55.937 INFO:tasks.rados.rados.2.smithi057.stdout:812: done (2 left) 2020-11-16T22:04:55.937 INFO:tasks.rados.rados.2.smithi057.stdout:813: done (1 left) 2020-11-16T22:04:55.937 INFO:tasks.rados.rados.2.smithi057.stdout:814: done (0 left) 2020-11-16T22:04:55.938 INFO:tasks.rados.rados.2.smithi057.stdout:815: write (excl) oid 36 current snap is 103 2020-11-16T22:04:55.938 INFO:tasks.rados.rados.2.smithi057.stdout:815: seq_num 297 ranges {591679=486720,1813152=490434} 2020-11-16T22:04:55.948 INFO:tasks.rados.rados.2.smithi057.stdout:815: writing smithi05720651-36 from 591679 to 1078399 tid 1 2020-11-16T22:04:55.956 INFO:tasks.rados.rados.2.smithi057.stdout:815: writing smithi05720651-36 from 1813152 to 2303586 tid 2 2020-11-16T22:04:55.957 INFO:tasks.rados.rados.2.smithi057.stdout:816: delete oid 50 current snap is 103 2020-11-16T22:04:55.959 INFO:tasks.rados.rados.2.smithi057.stdout:815: finishing write tid 1 to smithi05720651-36 2020-11-16T22:04:55.965 INFO:tasks.rados.rados.2.smithi057.stdout:815: finishing write tid 2 to smithi05720651-36 2020-11-16T22:04:55.965 INFO:tasks.rados.rados.2.smithi057.stdout:815: finishing write tid 4 to smithi05720651-36 2020-11-16T22:04:55.966 INFO:tasks.rados.rados.2.smithi057.stdout:815: finishing write tid 5 to smithi05720651-36 2020-11-16T22:04:55.966 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 472 (ObjNum 297 snap 103 seq_num 297) dirty exists 2020-11-16T22:04:55.966 INFO:tasks.rados.rados.2.smithi057.stdout:815: left oid 36 (ObjNum 297 snap 103 seq_num 297) 2020-11-16T22:04:55.968 INFO:tasks.rados.rados.2.smithi057.stdout:815: done (1 left) 2020-11-16T22:04:55.968 INFO:tasks.rados.rados.2.smithi057.stdout:816: done (0 left) 2020-11-16T22:04:55.968 INFO:tasks.rados.rados.2.smithi057.stdout:817: rollback oid 24 current snap is 103 2020-11-16T22:04:55.968 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 24 to 96 2020-11-16T22:04:55.968 INFO:tasks.rados.rados.2.smithi057.stdout:818: read oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:55.968 INFO:tasks.rados.rados.2.smithi057.stdout:818: expect (ObjNum 194 snap 64 seq_num 194) 2020-11-16T22:04:55.968 INFO:tasks.rados.rados.2.smithi057.stdout:819: snap_remove snap 92 2020-11-16T22:04:56.967 INFO:tasks.rados.rados.2.smithi057.stdout:819: done (2 left) 2020-11-16T22:04:56.968 INFO:tasks.rados.rados.2.smithi057.stdout:820: copy_from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 6 current snap is 103 2020-11-16T22:04:56.968 INFO:tasks.rados.rados.2.smithi057.stdout:817: finishing rollback tid 1 to smithi05720651-24 2020-11-16T22:04:56.968 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 0 (ObjNum 337 snap 0 seq_num 1864382772) dirty dne 2020-11-16T22:04:56.968 INFO:tasks.rados.rados.2.smithi057.stdout:818: expect (ObjNum 194 snap 64 seq_num 194) 2020-11-16T22:04:57.160 INFO:tasks.rados.rados.2.smithi057.stdout:820: finishing copy_from to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:57.161 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 541 (ObjNum 264 snap 86 seq_num 264) dirty exists 2020-11-16T22:04:57.161 INFO:tasks.rados.rados.2.smithi057.stdout:820: finishing copy_from racing read to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:57.161 INFO:tasks.rados.rados.2.smithi057.stdout:817: done (2 left) 2020-11-16T22:04:57.161 INFO:tasks.rados.rados.2.smithi057.stdout:818: done (1 left) 2020-11-16T22:04:57.161 INFO:tasks.rados.rados.2.smithi057.stdout:820: done (0 left) 2020-11-16T22:04:57.162 INFO:tasks.rados.rados.2.smithi057.stdout:821: snap_remove snap 99 2020-11-16T22:04:57.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:56 smithi057 bash[10301]: cluster 2020-11-16T22:04:55.629829+0000 mgr.x (mgr.24115) 369 : cluster [DBG] pgmap v568: 17 pgs: 17 active+clean; 233 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 1.4 MiB/s wr, 0 op/s 2020-11-16T22:04:57.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:56 smithi057 bash[10301]: cluster 2020-11-16T22:04:55.943438+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e270: 12 total, 12 up, 12 in 2020-11-16T22:04:57.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:56 smithi016 bash[10302]: cluster 2020-11-16T22:04:55.629829+0000 mgr.x (mgr.24115) 369 : cluster [DBG] pgmap v568: 17 pgs: 17 active+clean; 233 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 1.4 MiB/s wr, 0 op/s 2020-11-16T22:04:57.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:56 smithi016 bash[10302]: cluster 2020-11-16T22:04:55.943438+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e270: 12 total, 12 up, 12 in 2020-11-16T22:04:57.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:56 smithi195 bash[10218]: cluster 2020-11-16T22:04:55.629829+0000 mgr.x (mgr.24115) 369 : cluster [DBG] pgmap v568: 17 pgs: 17 active+clean; 233 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 1.4 MiB/s wr, 0 op/s 2020-11-16T22:04:57.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:56 smithi195 bash[10218]: cluster 2020-11-16T22:04:55.943438+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e270: 12 total, 12 up, 12 in 2020-11-16T22:04:57.977 INFO:tasks.rados.rados.2.smithi057.stdout:821: done (0 left) 2020-11-16T22:04:57.978 INFO:tasks.rados.rados.2.smithi057.stdout:822: write (excl) oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 103 2020-11-16T22:04:57.978 INFO:tasks.rados.rados.2.smithi057.stdout:822: seq_num 299 ranges {625293=637218,1813763=494103,2978063=47230} 2020-11-16T22:04:57.993 INFO:tasks.rados.rados.2.smithi057.stdout:822: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 625293 to 1262511 tid 1 2020-11-16T22:04:57.999 INFO:tasks.rados.rados.2.smithi057.stdout:822: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1813763 to 2307866 tid 2 2020-11-16T22:04:58.003 INFO:tasks.rados.rados.2.smithi057.stdout:822: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2978063 to 3025293 tid 3 2020-11-16T22:04:58.009 INFO:tasks.rados.rados.2.smithi057.stdout:823: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 103 2020-11-16T22:04:58.009 INFO:tasks.rados.rados.2.smithi057.stdout:823: seq_num 300 ranges {642100=712467,1872245=637761} 2020-11-16T22:04:58.011 INFO:tasks.rados.rados.2.smithi057.stdout:823: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 642100 to 1354567 tid 1 2020-11-16T22:04:58.018 INFO:tasks.rados.rados.2.smithi057.stdout:823: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1872245 to 2510006 tid 2 2020-11-16T22:04:58.019 INFO:tasks.rados.rados.2.smithi057.stdout:824: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:04:58.019 INFO:tasks.rados.rados.2.smithi057.stdout:824: expect (ObjNum 280 snap 94 seq_num 280) 2020-11-16T22:04:58.019 INFO:tasks.rados.rados.2.smithi057.stdout:825: rollback oid 22 current snap is 103 2020-11-16T22:04:58.019 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 22 to 102 2020-11-16T22:04:58.019 INFO:tasks.rados.rados.2.smithi057.stdout:822: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:58.020 INFO:tasks.rados.rados.2.smithi057.stdout:822: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:58.020 INFO:tasks.rados.rados.2.smithi057.stdout:822: finishing write tid 3 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:58.020 INFO:tasks.rados.rados.2.smithi057.stdout:822: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:58.020 INFO:tasks.rados.rados.2.smithi057.stdout:822: finishing write tid 6 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:58.020 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 43 (ObjNum 299 snap 103 seq_num 299) dirty exists 2020-11-16T22:04:58.020 INFO:tasks.rados.rados.2.smithi057.stdout:822: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 299 snap 103 seq_num 299) 2020-11-16T22:04:58.020 INFO:tasks.rados.rados.2.smithi057.stdout:822: done (3 left) 2020-11-16T22:04:58.020 INFO:tasks.rados.rados.2.smithi057.stdout:826: delete oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 103 2020-11-16T22:04:58.021 INFO:tasks.rados.rados.2.smithi057.stdout:825: finishing rollback tid 0 to smithi05720651-22 2020-11-16T22:04:58.021 INFO:tasks.rados.rados.2.smithi057.stdout:825: finishing rollback tid 1 to smithi05720651-22 2020-11-16T22:04:58.022 INFO:tasks.rados.rados.2.smithi057.stdout:825: finishing rollback tid 2 to smithi05720651-22 2020-11-16T22:04:58.022 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 426 (ObjNum 192 snap 64 seq_num 192) dirty exists 2020-11-16T22:04:58.028 INFO:tasks.rados.rados.2.smithi057.stdout:823: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:58.031 INFO:tasks.rados.rados.2.smithi057.stdout:823: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:58.031 INFO:tasks.rados.rados.2.smithi057.stdout:823: finishing write tid 4 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:58.032 INFO:tasks.rados.rados.2.smithi057.stdout:823: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:04:58.032 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 779 (ObjNum 300 snap 103 seq_num 300) dirty exists 2020-11-16T22:04:58.032 INFO:tasks.rados.rados.2.smithi057.stdout:823: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 300 snap 103 seq_num 300) 2020-11-16T22:04:58.034 INFO:tasks.rados.rados.2.smithi057.stdout:824: expect (ObjNum 280 snap 94 seq_num 280) 2020-11-16T22:04:58.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:57 smithi016 bash[10302]: cluster 2020-11-16T22:04:56.976762+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e271: 12 total, 12 up, 12 in 2020-11-16T22:04:58.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:57 smithi195 bash[10218]: cluster 2020-11-16T22:04:56.976762+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e271: 12 total, 12 up, 12 in 2020-11-16T22:04:58.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:57 smithi057 bash[10301]: cluster 2020-11-16T22:04:56.976762+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e271: 12 total, 12 up, 12 in 2020-11-16T22:04:58.533 INFO:tasks.rados.rados.2.smithi057.stdout:823: done (3 left) 2020-11-16T22:04:58.533 INFO:tasks.rados.rados.2.smithi057.stdout:824: done (2 left) 2020-11-16T22:04:58.533 INFO:tasks.rados.rados.2.smithi057.stdout:825: done (1 left) 2020-11-16T22:04:58.533 INFO:tasks.rados.rados.2.smithi057.stdout:826: done (0 left) 2020-11-16T22:04:58.533 INFO:tasks.rados.rados.2.smithi057.stdout:827: snap_create 2020-11-16T22:04:58.992 INFO:tasks.rados.rados.2.smithi057.stdout:827: done (0 left) 2020-11-16T22:04:58.992 INFO:tasks.rados.rados.2.smithi057.stdout:828: snap_remove snap 85 2020-11-16T22:04:59.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:58 smithi016 bash[10302]: cluster 2020-11-16T22:04:57.630640+0000 mgr.x (mgr.24115) 370 : cluster [DBG] pgmap v571: 17 pgs: 17 active+clean; 243 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 3.9 MiB/s wr, 11 op/s 2020-11-16T22:04:59.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:58 smithi016 bash[10302]: cluster 2020-11-16T22:04:57.986060+0000 mon.a (mon.0) 913 : cluster [DBG] osdmap e272: 12 total, 12 up, 12 in 2020-11-16T22:04:59.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:58 smithi195 bash[10218]: cluster 2020-11-16T22:04:57.630640+0000 mgr.x (mgr.24115) 370 : cluster [DBG] pgmap v571: 17 pgs: 17 active+clean; 243 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 3.9 MiB/s wr, 11 op/s 2020-11-16T22:04:59.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:58 smithi195 bash[10218]: cluster 2020-11-16T22:04:57.986060+0000 mon.a (mon.0) 913 : cluster [DBG] osdmap e272: 12 total, 12 up, 12 in 2020-11-16T22:04:59.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:58 smithi057 bash[10301]: cluster 2020-11-16T22:04:57.630640+0000 mgr.x (mgr.24115) 370 : cluster [DBG] pgmap v571: 17 pgs: 17 active+clean; 243 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 3.9 MiB/s wr, 11 op/s 2020-11-16T22:04:59.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:04:58 smithi057 bash[10301]: cluster 2020-11-16T22:04:57.986060+0000 mon.a (mon.0) 913 : cluster [DBG] osdmap e272: 12 total, 12 up, 12 in 2020-11-16T22:04:59.926 INFO:tasks.rados.rados.2.smithi057.stdout:828: done (0 left) 2020-11-16T22:04:59.926 INFO:tasks.rados.rados.2.smithi057.stdout:829: write (excl) oid 16 current snap is 104 2020-11-16T22:04:59.926 INFO:tasks.rados.rados.2.smithi057.stdout:829: seq_num 302 ranges {675714=462965,1589209=641430,2943979=131735} 2020-11-16T22:04:59.939 INFO:tasks.rados.rados.2.smithi057.stdout:829: writing smithi05720651-16 from 675714 to 1138679 tid 1 2020-11-16T22:04:59.944 INFO:tasks.rados.rados.2.smithi057.stdout:829: writing smithi05720651-16 from 1589209 to 2230639 tid 2 2020-11-16T22:04:59.949 INFO:tasks.rados.rados.2.smithi057.stdout:829: writing smithi05720651-16 from 2943979 to 3075714 tid 3 2020-11-16T22:04:59.949 INFO:tasks.rados.rados.2.smithi057.stdout:830: copy_from oid 18 from oid 12 current snap is 104 2020-11-16T22:04:59.949 INFO:tasks.rados.rados.2.smithi057.stdout:831: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 91 2020-11-16T22:04:59.950 INFO:tasks.rados.rados.2.smithi057.stdout:831: expect (ObjNum 261 snap 86 seq_num 261) 2020-11-16T22:04:59.950 INFO:tasks.rados.rados.2.smithi057.stdout:832: write oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 104 2020-11-16T22:04:59.950 INFO:tasks.rados.rados.2.smithi057.stdout:832: seq_num 303 ranges {692521=538214,1931338=785088} 2020-11-16T22:04:59.956 INFO:tasks.rados.rados.2.smithi057.stdout:832: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 692521 to 1230735 tid 1 2020-11-16T22:04:59.966 INFO:tasks.rados.rados.2.smithi057.stdout:832: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1931338 to 2716426 tid 2 2020-11-16T22:04:59.966 INFO:tasks.rados.rados.2.smithi057.stdout:833: snap_remove snap 100 2020-11-16T22:05:00.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:59 smithi016 bash[10302]: cluster 2020-11-16T22:04:58.995847+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e273: 12 total, 12 up, 12 in 2020-11-16T22:05:00.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:04:59 smithi016 bash[10302]: cluster 2020-11-16T22:04:59.928200+0000 mon.a (mon.0) 915 : cluster [DBG] osdmap e274: 12 total, 12 up, 12 in 2020-11-16T22:05:00.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:59 smithi195 bash[10218]: cluster 2020-11-16T22:04:58.995847+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e273: 12 total, 12 up, 12 in 2020-11-16T22:05:00.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:04:59 smithi195 bash[10218]: cluster 2020-11-16T22:04:59.928200+0000 mon.a (mon.0) 915 : cluster [DBG] osdmap e274: 12 total, 12 up, 12 in 2020-11-16T22:05:00.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:00 smithi057 bash[10301]: cluster 2020-11-16T22:04:58.995847+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e273: 12 total, 12 up, 12 in 2020-11-16T22:05:00.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:00 smithi057 bash[10301]: cluster 2020-11-16T22:04:59.928200+0000 mon.a (mon.0) 915 : cluster [DBG] osdmap e274: 12 total, 12 up, 12 in 2020-11-16T22:05:00.942 INFO:tasks.rados.rados.2.smithi057.stdout:833: done (4 left) 2020-11-16T22:05:00.942 INFO:tasks.rados.rados.2.smithi057.stdout:834: snap_create 2020-11-16T22:05:00.942 INFO:tasks.rados.rados.2.smithi057.stdout:829: finishing write tid 1 to smithi05720651-16 2020-11-16T22:05:00.943 INFO:tasks.rados.rados.2.smithi057.stdout:829: finishing write tid 2 to smithi05720651-16 2020-11-16T22:05:00.943 INFO:tasks.rados.rados.2.smithi057.stdout:829: finishing write tid 3 to smithi05720651-16 2020-11-16T22:05:00.943 INFO:tasks.rados.rados.2.smithi057.stdout:829: finishing write tid 5 to smithi05720651-16 2020-11-16T22:05:00.943 INFO:tasks.rados.rados.2.smithi057.stdout:829: finishing write tid 6 to smithi05720651-16 2020-11-16T22:05:00.943 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 611 (ObjNum 302 snap 104 seq_num 302) dirty exists 2020-11-16T22:05:00.943 INFO:tasks.rados.rados.2.smithi057.stdout:829: left oid 16 (ObjNum 302 snap 104 seq_num 302) 2020-11-16T22:05:00.943 INFO:tasks.rados.rados.2.smithi057.stdout:831: expect (ObjNum 261 snap 86 seq_num 261) 2020-11-16T22:05:01.021 INFO:tasks.rados.rados.2.smithi057.stdout:832: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:01.022 INFO:tasks.rados.rados.2.smithi057.stdout:830: finishing copy_from to smithi05720651-18 2020-11-16T22:05:01.022 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 303 (ObjNum 279 snap 94 seq_num 279) dirty exists 2020-11-16T22:05:01.022 INFO:tasks.rados.rados.2.smithi057.stdout:830: finishing copy_from racing read to smithi05720651-18 2020-11-16T22:05:01.022 INFO:tasks.rados.rados.2.smithi057.stdout:832: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:01.022 INFO:tasks.rados.rados.2.smithi057.stdout:832: finishing write tid 4 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:01.022 INFO:tasks.rados.rados.2.smithi057.stdout:832: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:01.023 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 635 (ObjNum 303 snap 104 seq_num 303) dirty exists 2020-11-16T22:05:01.023 INFO:tasks.rados.rados.2.smithi057.stdout:832: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 303 snap 104 seq_num 303) 2020-11-16T22:05:01.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:01 smithi016 bash[10302]: cluster 2020-11-16T22:04:59.631375+0000 mgr.x (mgr.24115) 371 : cluster [DBG] pgmap v574: 17 pgs: 17 active+clean; 243 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2020-11-16T22:05:01.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:01 smithi016 bash[10302]: cluster 2020-11-16T22:05:00.946218+0000 mon.a (mon.0) 916 : cluster [DBG] osdmap e275: 12 total, 12 up, 12 in 2020-11-16T22:05:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:01 smithi195 bash[10218]: cluster 2020-11-16T22:04:59.631375+0000 mgr.x (mgr.24115) 371 : cluster [DBG] pgmap v574: 17 pgs: 17 active+clean; 243 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2020-11-16T22:05:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:01 smithi195 bash[10218]: cluster 2020-11-16T22:05:00.946218+0000 mon.a (mon.0) 916 : cluster [DBG] osdmap e275: 12 total, 12 up, 12 in 2020-11-16T22:05:01.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:01 smithi057 bash[10301]: cluster 2020-11-16T22:04:59.631375+0000 mgr.x (mgr.24115) 371 : cluster [DBG] pgmap v574: 17 pgs: 17 active+clean; 243 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2020-11-16T22:05:01.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:01 smithi057 bash[10301]: cluster 2020-11-16T22:05:00.946218+0000 mon.a (mon.0) 916 : cluster [DBG] osdmap e275: 12 total, 12 up, 12 in 2020-11-16T22:05:01.938 INFO:tasks.rados.rados.2.smithi057.stdout:829: done (4 left) 2020-11-16T22:05:01.938 INFO:tasks.rados.rados.2.smithi057.stdout:830: done (3 left) 2020-11-16T22:05:01.938 INFO:tasks.rados.rados.2.smithi057.stdout:831: done (2 left) 2020-11-16T22:05:01.938 INFO:tasks.rados.rados.2.smithi057.stdout:832: done (1 left) 2020-11-16T22:05:01.938 INFO:tasks.rados.rados.2.smithi057.stdout:834: done (0 left) 2020-11-16T22:05:01.939 INFO:tasks.rados.rados.2.smithi057.stdout:835: snap_create 2020-11-16T22:05:02.942 INFO:tasks.rados.rados.2.smithi057.stdout:835: done (0 left) 2020-11-16T22:05:02.942 INFO:tasks.rados.rados.2.smithi057.stdout:836: delete oid 44 current snap is 106 2020-11-16T22:05:02.947 INFO:tasks.rados.rados.2.smithi057.stdout:836: done (0 left) 2020-11-16T22:05:02.947 INFO:tasks.rados.rados.2.smithi057.stdout:837: snap_create 2020-11-16T22:05:03.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:02 smithi057 bash[10301]: cluster 2020-11-16T22:05:01.948613+0000 mon.a (mon.0) 917 : cluster [DBG] osdmap e276: 12 total, 12 up, 12 in 2020-11-16T22:05:03.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:02 smithi057 bash[10301]: audit 2020-11-16T22:05:02.239818+0000 mon.b (mon.1) 288 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:03.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:02 smithi057 bash[10301]: audit 2020-11-16T22:05:02.241232+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:03.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:02 smithi057 bash[10301]: audit 2020-11-16T22:05:02.246414+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:05:03.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:02 smithi057 bash[10301]: audit 2020-11-16T22:05:02.257369+0000 mon.b (mon.1) 289 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:03.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:02 smithi057 bash[10301]: audit 2020-11-16T22:05:02.258832+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:03.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:02 smithi057 bash[10301]: audit 2020-11-16T22:05:02.263974+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:05:03.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:02 smithi016 bash[10302]: cluster 2020-11-16T22:05:01.948613+0000 mon.a (mon.0) 917 : cluster [DBG] osdmap e276: 12 total, 12 up, 12 in 2020-11-16T22:05:03.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:02 smithi016 bash[10302]: audit 2020-11-16T22:05:02.239818+0000 mon.b (mon.1) 288 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:03.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:02 smithi016 bash[10302]: audit 2020-11-16T22:05:02.241232+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:03.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:02 smithi016 bash[10302]: audit 2020-11-16T22:05:02.246414+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:05:03.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:02 smithi016 bash[10302]: audit 2020-11-16T22:05:02.257369+0000 mon.b (mon.1) 289 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:03.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:02 smithi016 bash[10302]: audit 2020-11-16T22:05:02.258832+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:03.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:02 smithi016 bash[10302]: audit 2020-11-16T22:05:02.263974+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:05:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:02 smithi195 bash[10218]: cluster 2020-11-16T22:05:01.948613+0000 mon.a (mon.0) 917 : cluster [DBG] osdmap e276: 12 total, 12 up, 12 in 2020-11-16T22:05:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:02 smithi195 bash[10218]: audit 2020-11-16T22:05:02.239818+0000 mon.b (mon.1) 288 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:02 smithi195 bash[10218]: audit 2020-11-16T22:05:02.241232+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:02 smithi195 bash[10218]: audit 2020-11-16T22:05:02.246414+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:05:03.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:02 smithi195 bash[10218]: audit 2020-11-16T22:05:02.257369+0000 mon.b (mon.1) 289 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:03.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:02 smithi195 bash[10218]: audit 2020-11-16T22:05:02.258832+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:03.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:02 smithi195 bash[10218]: audit 2020-11-16T22:05:02.263974+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:05:03.958 INFO:tasks.rados.rados.2.smithi057.stdout:837: done (0 left) 2020-11-16T22:05:03.958 INFO:tasks.rados.rados.2.smithi057.stdout:838: snap_create 2020-11-16T22:05:04.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:03 smithi016 bash[10302]: cluster 2020-11-16T22:05:02.950761+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e277: 12 total, 12 up, 12 in 2020-11-16T22:05:04.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:03 smithi195 bash[10218]: cluster 2020-11-16T22:05:02.950761+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e277: 12 total, 12 up, 12 in 2020-11-16T22:05:04.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:03 smithi057 bash[10301]: cluster 2020-11-16T22:05:02.950761+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e277: 12 total, 12 up, 12 in 2020-11-16T22:05:04.919 INFO:tasks.rados.rados.2.smithi057.stdout:838: done (0 left) 2020-11-16T22:05:04.920 INFO:tasks.rados.rados.2.smithi057.stdout:839: delete oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 108 2020-11-16T22:05:04.931 INFO:tasks.rados.rados.2.smithi057.stdout:839: done (0 left) 2020-11-16T22:05:04.931 INFO:tasks.rados.rados.2.smithi057.stdout:840: snap_create 2020-11-16T22:05:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:04 smithi016 bash[10302]: cluster 2020-11-16T22:05:03.632848+0000 mgr.x (mgr.24115) 373 : cluster [DBG] pgmap v580: 17 pgs: 17 active+clean; 250 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 2.7 MiB/s wr, 15 op/s 2020-11-16T22:05:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:04 smithi016 bash[10302]: cluster 2020-11-16T22:05:03.968574+0000 mon.a (mon.0) 923 : cluster [DBG] osdmap e278: 12 total, 12 up, 12 in 2020-11-16T22:05:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:04 smithi016 bash[10302]: cluster 2020-11-16T22:05:04.929970+0000 mon.a (mon.0) 924 : cluster [DBG] osdmap e279: 12 total, 12 up, 12 in 2020-11-16T22:05:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:04 smithi195 bash[10218]: cluster 2020-11-16T22:05:03.632848+0000 mgr.x (mgr.24115) 373 : cluster [DBG] pgmap v580: 17 pgs: 17 active+clean; 250 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 2.7 MiB/s wr, 15 op/s 2020-11-16T22:05:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:04 smithi195 bash[10218]: cluster 2020-11-16T22:05:03.968574+0000 mon.a (mon.0) 923 : cluster [DBG] osdmap e278: 12 total, 12 up, 12 in 2020-11-16T22:05:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:04 smithi195 bash[10218]: cluster 2020-11-16T22:05:04.929970+0000 mon.a (mon.0) 924 : cluster [DBG] osdmap e279: 12 total, 12 up, 12 in 2020-11-16T22:05:05.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:04 smithi057 bash[10301]: cluster 2020-11-16T22:05:03.632848+0000 mgr.x (mgr.24115) 373 : cluster [DBG] pgmap v580: 17 pgs: 17 active+clean; 250 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 2.7 MiB/s wr, 15 op/s 2020-11-16T22:05:05.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:04 smithi057 bash[10301]: cluster 2020-11-16T22:05:03.968574+0000 mon.a (mon.0) 923 : cluster [DBG] osdmap e278: 12 total, 12 up, 12 in 2020-11-16T22:05:05.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:04 smithi057 bash[10301]: cluster 2020-11-16T22:05:04.929970+0000 mon.a (mon.0) 924 : cluster [DBG] osdmap e279: 12 total, 12 up, 12 in 2020-11-16T22:05:05.930 INFO:tasks.rados.rados.2.smithi057.stdout:840: done (0 left) 2020-11-16T22:05:05.930 INFO:tasks.rados.rados.2.smithi057.stdout:841: rollback oid 10 current snap is 109 2020-11-16T22:05:05.930 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 10 to 101 2020-11-16T22:05:05.931 INFO:tasks.rados.rados.2.smithi057.stdout:842: write (excl) oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 109 2020-11-16T22:05:05.931 INFO:tasks.rados.rados.2.smithi057.stdout:842: seq_num 306 ranges {742942=480314,1823137=648768} 2020-11-16T22:05:05.942 INFO:tasks.rados.rados.2.smithi057.stdout:842: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 742942 to 1223256 tid 1 2020-11-16T22:05:05.951 INFO:tasks.rados.rados.2.smithi057.stdout:842: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1823137 to 2471905 tid 2 2020-11-16T22:05:05.951 INFO:tasks.rados.rados.2.smithi057.stdout:843: write oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 109 2020-11-16T22:05:05.951 INFO:tasks.rados.rados.2.smithi057.stdout:843: seq_num 307 ranges {759749=555563,1765266=792426,2964741=195008} 2020-11-16T22:05:05.958 INFO:tasks.rados.rados.2.smithi057.stdout:843: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 759749 to 1315312 tid 1 2020-11-16T22:05:05.965 INFO:tasks.rados.rados.2.smithi057.stdout:843: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1765266 to 2557692 tid 2 2020-11-16T22:05:05.969 INFO:tasks.rados.rados.2.smithi057.stdout:843: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2964741 to 3159749 tid 3 2020-11-16T22:05:05.969 INFO:tasks.rados.rados.2.smithi057.stdout:844: copy_from oid 8 from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 109 2020-11-16T22:05:05.969 INFO:tasks.rados.rados.2.smithi057.stdout:841: finishing rollback tid 1 to smithi05720651-10 2020-11-16T22:05:05.969 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 343 (ObjNum 357 snap 0 seq_num 201338848) dirty dne 2020-11-16T22:05:05.969 INFO:tasks.rados.rados.2.smithi057.stdout:842: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:05.970 INFO:tasks.rados.rados.2.smithi057.stdout:842: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:05.970 INFO:tasks.rados.rados.2.smithi057.stdout:842: finishing write tid 4 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:05.970 INFO:tasks.rados.rados.2.smithi057.stdout:842: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:05.970 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 641 (ObjNum 306 snap 109 seq_num 306) dirty exists 2020-11-16T22:05:05.970 INFO:tasks.rados.rados.2.smithi057.stdout:842: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 306 snap 109 seq_num 306) 2020-11-16T22:05:05.970 INFO:tasks.rados.rados.2.smithi057.stdout:841: done (3 left) 2020-11-16T22:05:05.970 INFO:tasks.rados.rados.2.smithi057.stdout:842: done (2 left) 2020-11-16T22:05:05.971 INFO:tasks.rados.rados.2.smithi057.stdout:845: write (excl) oid 22 current snap is 109 2020-11-16T22:05:05.971 INFO:tasks.rados.rados.2.smithi057.stdout:845: seq_num 308 ranges {776556=630812,1823748=652437,3108517=68039} 2020-11-16T22:05:05.977 INFO:tasks.rados.rados.2.smithi057.stdout:845: writing smithi05720651-22 from 776556 to 1407368 tid 1 2020-11-16T22:05:05.988 INFO:tasks.rados.rados.2.smithi057.stdout:845: writing smithi05720651-22 from 1823748 to 2476185 tid 2 2020-11-16T22:05:05.988 INFO:tasks.rados.rados.2.smithi057.stdout:845: writing smithi05720651-22 from 3108517 to 3176556 tid 3 2020-11-16T22:05:05.988 INFO:tasks.rados.rados.2.smithi057.stdout:846: copy_from oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 109 2020-11-16T22:05:05.988 INFO:tasks.rados.rados.2.smithi057.stdout:843: finishing write tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:05.989 INFO:tasks.rados.rados.2.smithi057.stdout:843: finishing write tid 2 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:05.989 INFO:tasks.rados.rados.2.smithi057.stdout:843: finishing write tid 3 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:05.989 INFO:tasks.rados.rados.2.smithi057.stdout:843: finishing write tid 5 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:05.989 INFO:tasks.rados.rados.2.smithi057.stdout:843: finishing write tid 6 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:05.989 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 194 (ObjNum 307 snap 109 seq_num 307) dirty exists 2020-11-16T22:05:05.989 INFO:tasks.rados.rados.2.smithi057.stdout:843: left oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 307 snap 109 seq_num 307) 2020-11-16T22:05:05.989 INFO:tasks.rados.rados.2.smithi057.stdout:845: finishing write tid 1 to smithi05720651-22 2020-11-16T22:05:05.990 INFO:tasks.rados.rados.2.smithi057.stdout:843: done (3 left) 2020-11-16T22:05:05.990 INFO:tasks.rados.rados.2.smithi057.stdout:847: rollback oid 2 current snap is 109 2020-11-16T22:05:05.990 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 2 to 97 2020-11-16T22:05:05.990 INFO:tasks.rados.rados.2.smithi057.stdout:848: read oid 32 snap -1 2020-11-16T22:05:05.990 INFO:tasks.rados.rados.2.smithi057.stdout:848: expect (ObjNum 281 snap 95 seq_num 281) 2020-11-16T22:05:05.990 INFO:tasks.rados.rados.2.smithi057.stdout:849: rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 109 2020-11-16T22:05:05.990 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 97 2020-11-16T22:05:05.991 INFO:tasks.rados.rados.2.smithi057.stdout:850: copy_from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 24 current snap is 109 2020-11-16T22:05:05.991 INFO:tasks.rados.rados.2.smithi057.stdout:851: write (excl) oid 6 current snap is 109 2020-11-16T22:05:05.991 INFO:tasks.rados.rados.2.smithi057.stdout:851: seq_num 309 ranges {793363=706061,2282230=796095} 2020-11-16T22:05:05.996 INFO:tasks.rados.rados.2.smithi057.stdout:851: writing smithi05720651-6 from 793363 to 1499424 tid 1 2020-11-16T22:05:06.006 INFO:tasks.rados.rados.2.smithi057.stdout:851: writing smithi05720651-6 from 2282230 to 3078325 tid 2 2020-11-16T22:05:06.006 INFO:tasks.rados.rados.2.smithi057.stdout:852: snap_create 2020-11-16T22:05:06.006 INFO:tasks.rados.rados.2.smithi057.stdout:845: finishing write tid 2 to smithi05720651-22 2020-11-16T22:05:06.006 INFO:tasks.rados.rados.2.smithi057.stdout:845: finishing write tid 3 to smithi05720651-22 2020-11-16T22:05:06.007 INFO:tasks.rados.rados.2.smithi057.stdout:845: finishing write tid 5 to smithi05720651-22 2020-11-16T22:05:06.007 INFO:tasks.rados.rados.2.smithi057.stdout:844: finishing copy_from to smithi05720651-8 2020-11-16T22:05:06.007 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 635 (ObjNum 303 snap 104 seq_num 303) dirty exists 2020-11-16T22:05:06.007 INFO:tasks.rados.rados.2.smithi057.stdout:844: finishing copy_from racing read to smithi05720651-8 2020-11-16T22:05:06.007 INFO:tasks.rados.rados.2.smithi057.stdout:845: finishing write tid 6 to smithi05720651-22 2020-11-16T22:05:06.007 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 431 (ObjNum 308 snap 109 seq_num 308) dirty exists 2020-11-16T22:05:06.007 INFO:tasks.rados.rados.2.smithi057.stdout:845: left oid 22 (ObjNum 308 snap 109 seq_num 308) 2020-11-16T22:05:06.008 INFO:tasks.rados.rados.2.smithi057.stdout:849: finishing rollback tid 0 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:06.008 INFO:tasks.rados.rados.2.smithi057.stdout:850: finishing copy_from to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:06.008 INFO:tasks.rados.rados.2.smithi057.stdout:850: got expected ENOENT (src dne) 2020-11-16T22:05:06.008 INFO:tasks.rados.rados.2.smithi057.stdout:850: finishing copy_from racing read to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:06.008 INFO:tasks.rados.rados.2.smithi057.stdout:849: finishing rollback tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:06.008 INFO:tasks.rados.rados.2.smithi057.stdout:849: finishing rollback tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:06.008 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 644 (ObjNum 144 snap 44 seq_num 144) dirty exists 2020-11-16T22:05:06.009 INFO:tasks.rados.rados.2.smithi057.stdout:851: finishing write tid 1 to smithi05720651-6 2020-11-16T22:05:06.012 INFO:tasks.rados.rados.2.smithi057.stdout:851: finishing write tid 2 to smithi05720651-6 2020-11-16T22:05:06.012 INFO:tasks.rados.rados.2.smithi057.stdout:848: expect (ObjNum 281 snap 95 seq_num 281) 2020-11-16T22:05:06.143 INFO:tasks.rados.rados.2.smithi057.stdout:847: finishing rollback tid 0 to smithi05720651-2 2020-11-16T22:05:06.143 INFO:tasks.rados.rados.2.smithi057.stdout:847: finishing rollback tid 1 to smithi05720651-2 2020-11-16T22:05:06.143 INFO:tasks.rados.rados.2.smithi057.stdout:847: finishing rollback tid 2 to smithi05720651-2 2020-11-16T22:05:06.143 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 803 (ObjNum 192 snap 64 seq_num 192) dirty exists 2020-11-16T22:05:06.144 INFO:tasks.rados.rados.2.smithi057.stdout:846: finishing copy_from to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:06.144 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 529 (ObjNum 261 snap 86 seq_num 261) dirty exists 2020-11-16T22:05:06.144 INFO:tasks.rados.rados.2.smithi057.stdout:846: finishing copy_from racing read to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:06.144 INFO:tasks.rados.rados.2.smithi057.stdout:851: finishing write tid 4 to smithi05720651-6 2020-11-16T22:05:06.144 INFO:tasks.rados.rados.2.smithi057.stdout:851: finishing write tid 5 to smithi05720651-6 2020-11-16T22:05:06.144 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 648 (ObjNum 309 snap 109 seq_num 309) dirty exists 2020-11-16T22:05:06.145 INFO:tasks.rados.rados.2.smithi057.stdout:851: left oid 6 (ObjNum 309 snap 109 seq_num 309) 2020-11-16T22:05:06.965 INFO:tasks.rados.rados.2.smithi057.stdout:844: done (8 left) 2020-11-16T22:05:06.965 INFO:tasks.rados.rados.2.smithi057.stdout:845: done (7 left) 2020-11-16T22:05:06.965 INFO:tasks.rados.rados.2.smithi057.stdout:846: done (6 left) 2020-11-16T22:05:06.966 INFO:tasks.rados.rados.2.smithi057.stdout:847: done (5 left) 2020-11-16T22:05:06.966 INFO:tasks.rados.rados.2.smithi057.stdout:848: done (4 left) 2020-11-16T22:05:06.966 INFO:tasks.rados.rados.2.smithi057.stdout:849: done (3 left) 2020-11-16T22:05:06.966 INFO:tasks.rados.rados.2.smithi057.stdout:850: done (2 left) 2020-11-16T22:05:06.966 INFO:tasks.rados.rados.2.smithi057.stdout:851: done (1 left) 2020-11-16T22:05:06.966 INFO:tasks.rados.rados.2.smithi057.stdout:852: done (0 left) 2020-11-16T22:05:06.966 INFO:tasks.rados.rados.2.smithi057.stdout:853: rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 110 2020-11-16T22:05:06.967 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 105 2020-11-16T22:05:06.967 INFO:tasks.rados.rados.2.smithi057.stdout:854: write (excl) oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 110 2020-11-16T22:05:06.967 INFO:tasks.rados.rados.2.smithi057.stdout:854: seq_num 310 ranges {410170=781310,1940712=656106,3163363=46807} 2020-11-16T22:05:06.977 INFO:tasks.rados.rados.2.smithi057.stdout:854: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 410170 to 1191480 tid 1 2020-11-16T22:05:06.985 INFO:tasks.rados.rados.2.smithi057.stdout:854: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1940712 to 2596818 tid 2 2020-11-16T22:05:06.989 INFO:tasks.rados.rados.2.smithi057.stdout:854: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3163363 to 3210170 tid 3 2020-11-16T22:05:06.990 INFO:tasks.rados.rados.2.smithi057.stdout:855: copy_from oid 50 from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 110 2020-11-16T22:05:06.990 INFO:tasks.rados.rados.2.smithi057.stdout:853: finishing rollback tid 0 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:06.990 INFO:tasks.rados.rados.2.smithi057.stdout:856: rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 110 2020-11-16T22:05:06.990 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 109 2020-11-16T22:05:06.990 INFO:tasks.rados.rados.2.smithi057.stdout:853: finishing rollback tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:06.990 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 197 (ObjNum 49 snap 0 seq_num 2909626040) dirty dne 2020-11-16T22:05:06.990 INFO:tasks.rados.rados.2.smithi057.stdout:853: done (3 left) 2020-11-16T22:05:06.991 INFO:tasks.rados.rados.2.smithi057.stdout:857: snap_remove snap 102 2020-11-16T22:05:07.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:06 smithi057 bash[10301]: cluster 2020-11-16T22:05:05.939775+0000 mon.a (mon.0) 925 : cluster [DBG] osdmap e280: 12 total, 12 up, 12 in 2020-11-16T22:05:07.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:06 smithi057 bash[10301]: audit 2020-11-16T22:05:05.952136+0000 mon.b (mon.1) 290 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:07.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:06 smithi057 bash[10301]: audit 2020-11-16T22:05:05.953428+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:07.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:06 smithi057 bash[10301]: audit 2020-11-16T22:05:05.958812+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:05:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:06 smithi016 bash[10302]: cluster 2020-11-16T22:05:05.939775+0000 mon.a (mon.0) 925 : cluster [DBG] osdmap e280: 12 total, 12 up, 12 in 2020-11-16T22:05:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:06 smithi016 bash[10302]: audit 2020-11-16T22:05:05.952136+0000 mon.b (mon.1) 290 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:06 smithi016 bash[10302]: audit 2020-11-16T22:05:05.953428+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:07.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:06 smithi016 bash[10302]: audit 2020-11-16T22:05:05.958812+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:05:07.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:06 smithi195 bash[10218]: cluster 2020-11-16T22:05:05.939775+0000 mon.a (mon.0) 925 : cluster [DBG] osdmap e280: 12 total, 12 up, 12 in 2020-11-16T22:05:07.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:06 smithi195 bash[10218]: audit 2020-11-16T22:05:05.952136+0000 mon.b (mon.1) 290 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:07.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:06 smithi195 bash[10218]: audit 2020-11-16T22:05:05.953428+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:05:07.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:06 smithi195 bash[10218]: audit 2020-11-16T22:05:05.958812+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:05:07.983 INFO:tasks.rados.rados.2.smithi057.stdout:857: done (3 left) 2020-11-16T22:05:07.983 INFO:tasks.rados.rados.2.smithi057.stdout:858: read oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:07.983 INFO:tasks.rados.rados.2.smithi057.stdout:858: expect (ObjNum 280 snap 94 seq_num 280) 2020-11-16T22:05:07.983 INFO:tasks.rados.rados.2.smithi057.stdout:859: copy_from oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 110 2020-11-16T22:05:07.984 INFO:tasks.rados.rados.2.smithi057.stdout:854: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:07.984 INFO:tasks.rados.rados.2.smithi057.stdout:856: finishing rollback tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:07.984 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 430 (ObjNum 321 snap 0 seq_num 0) dirty dne 2020-11-16T22:05:07.984 INFO:tasks.rados.rados.2.smithi057.stdout:854: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:07.984 INFO:tasks.rados.rados.2.smithi057.stdout:854: finishing write tid 3 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:07.984 INFO:tasks.rados.rados.2.smithi057.stdout:854: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:07.985 INFO:tasks.rados.rados.2.smithi057.stdout:854: finishing write tid 6 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:07.985 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 653 (ObjNum 310 snap 110 seq_num 310) dirty exists 2020-11-16T22:05:07.985 INFO:tasks.rados.rados.2.smithi057.stdout:854: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 310 snap 110 seq_num 310) 2020-11-16T22:05:07.985 INFO:tasks.rados.rados.2.smithi057.stdout:855: finishing copy_from to smithi05720651-50 2020-11-16T22:05:07.985 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 155 (ObjNum 280 snap 94 seq_num 280) dirty exists 2020-11-16T22:05:07.985 INFO:tasks.rados.rados.2.smithi057.stdout:855: finishing copy_from racing read to smithi05720651-50 2020-11-16T22:05:07.985 INFO:tasks.rados.rados.2.smithi057.stdout:854: done (4 left) 2020-11-16T22:05:07.986 INFO:tasks.rados.rados.2.smithi057.stdout:855: done (3 left) 2020-11-16T22:05:07.986 INFO:tasks.rados.rados.2.smithi057.stdout:856: done (2 left) 2020-11-16T22:05:07.986 INFO:tasks.rados.rados.2.smithi057.stdout:860: read oid 38 snap 107 2020-11-16T22:05:07.986 INFO:tasks.rados.rados.2.smithi057.stdout:860: expect (ObjNum 271 snap 89 seq_num 271) 2020-11-16T22:05:07.986 INFO:tasks.rados.rados.2.smithi057.stdout:861: copy_from oid 46 from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 110 2020-11-16T22:05:07.986 INFO:tasks.rados.rados.2.smithi057.stdout:862: delete oid 14 current snap is 110 2020-11-16T22:05:08.003 INFO:tasks.rados.rados.2.smithi057.stdout:858: expect (ObjNum 280 snap 94 seq_num 280) 2020-11-16T22:05:08.087 INFO:tasks.rados.rados.2.smithi057.stdout:860: expect (ObjNum 271 snap 89 seq_num 271) 2020-11-16T22:05:08.233 INFO:tasks.rados.rados.2.smithi057.stdout:859: finishing copy_from to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:08.234 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 512 (ObjNum 272 snap 91 seq_num 272) dirty exists 2020-11-16T22:05:08.234 INFO:tasks.rados.rados.2.smithi057.stdout:861: finishing copy_from to smithi05720651-46 2020-11-16T22:05:08.234 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 43 (ObjNum 112 snap 34 seq_num 112) dirty exists 2020-11-16T22:05:08.234 INFO:tasks.rados.rados.2.smithi057.stdout:859: finishing copy_from racing read to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:08.234 INFO:tasks.rados.rados.2.smithi057.stdout:861: finishing copy_from racing read to smithi05720651-46 2020-11-16T22:05:08.234 INFO:tasks.rados.rados.2.smithi057.stdout:858: done (4 left) 2020-11-16T22:05:08.235 INFO:tasks.rados.rados.2.smithi057.stdout:859: done (3 left) 2020-11-16T22:05:08.235 INFO:tasks.rados.rados.2.smithi057.stdout:860: done (2 left) 2020-11-16T22:05:08.235 INFO:tasks.rados.rados.2.smithi057.stdout:861: done (1 left) 2020-11-16T22:05:08.235 INFO:tasks.rados.rados.2.smithi057.stdout:862: done (0 left) 2020-11-16T22:05:08.235 INFO:tasks.rados.rados.2.smithi057.stdout:863: write oid 2 current snap is 110 2020-11-16T22:05:08.235 INFO:tasks.rados.rados.2.smithi057.stdout:863: seq_num 312 ranges {443784=648161,1657676=659775,2818209=425575} 2020-11-16T22:05:08.247 INFO:tasks.rados.rados.2.smithi057.stdout:863: writing smithi05720651-2 from 443784 to 1091945 tid 1 2020-11-16T22:05:08.254 INFO:tasks.rados.rados.2.smithi057.stdout:863: writing smithi05720651-2 from 1657676 to 2317451 tid 2 2020-11-16T22:05:08.259 INFO:tasks.rados.rados.2.smithi057.stdout:863: writing smithi05720651-2 from 2818209 to 3243784 tid 3 2020-11-16T22:05:08.259 INFO:tasks.rados.rados.2.smithi057.stdout:864: delete oid 44 current snap is 110 2020-11-16T22:05:08.259 INFO:tasks.rados.rados.2.smithi057.stdout:863: finishing write tid 1 to smithi05720651-2 2020-11-16T22:05:08.261 INFO:tasks.rados.rados.2.smithi057.stdout:863: finishing write tid 2 to smithi05720651-2 2020-11-16T22:05:08.261 INFO:tasks.rados.rados.2.smithi057.stdout:864: done (1 left) 2020-11-16T22:05:08.261 INFO:tasks.rados.rados.2.smithi057.stdout:865: write oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 110 2020-11-16T22:05:08.262 INFO:tasks.rados.rados.2.smithi057.stdout:865: seq_num 314 ranges {477398=798659,1774640=663444,2873055=404343} 2020-11-16T22:05:08.268 INFO:tasks.rados.rados.2.smithi057.stdout:865: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 477398 to 1276057 tid 1 2020-11-16T22:05:08.275 INFO:tasks.rados.rados.2.smithi057.stdout:865: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1774640 to 2438084 tid 2 2020-11-16T22:05:08.280 INFO:tasks.rados.rados.2.smithi057.stdout:865: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2873055 to 3277398 tid 3 2020-11-16T22:05:08.281 INFO:tasks.rados.rados.2.smithi057.stdout:866: read oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:08.281 INFO:tasks.rados.rados.2.smithi057.stdout:866: expect (ObjNum 220 snap 76 seq_num 220) 2020-11-16T22:05:08.281 INFO:tasks.rados.rados.2.smithi057.stdout:867: rollback oid 30 current snap is 110 2020-11-16T22:05:08.281 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 30 to 101 2020-11-16T22:05:08.281 INFO:tasks.rados.rados.2.smithi057.stdout:863: finishing write tid 3 to smithi05720651-2 2020-11-16T22:05:08.281 INFO:tasks.rados.rados.2.smithi057.stdout:868: read oid 34 snap -1 2020-11-16T22:05:08.281 INFO:tasks.rados.rados.2.smithi057.stdout:868: expect (ObjNum 130 snap 37 seq_num 130) 2020-11-16T22:05:08.282 INFO:tasks.rados.rados.2.smithi057.stdout:869: copy_from oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 36 current snap is 110 2020-11-16T22:05:08.282 INFO:tasks.rados.rados.2.smithi057.stdout:863: finishing write tid 5 to smithi05720651-2 2020-11-16T22:05:08.282 INFO:tasks.rados.rados.2.smithi057.stdout:863: finishing write tid 6 to smithi05720651-2 2020-11-16T22:05:08.282 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 818 (ObjNum 312 snap 110 seq_num 312) dirty exists 2020-11-16T22:05:08.282 INFO:tasks.rados.rados.2.smithi057.stdout:863: left oid 2 (ObjNum 312 snap 110 seq_num 312) 2020-11-16T22:05:08.282 INFO:tasks.rados.rados.2.smithi057.stdout:863: done (5 left) 2020-11-16T22:05:08.283 INFO:tasks.rados.rados.2.smithi057.stdout:870: copy_from oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 110 2020-11-16T22:05:08.283 INFO:tasks.rados.rados.2.smithi057.stdout:871: rollback oid 2 current snap is 110 2020-11-16T22:05:08.283 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 2 to 101 2020-11-16T22:05:08.283 INFO:tasks.rados.rados.2.smithi057.stdout:872: write oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 110 2020-11-16T22:05:08.283 INFO:tasks.rados.rados.2.smithi057.stdout:872: seq_num 315 ranges {494205=473908,1433122=407102,2384125=462684} 2020-11-16T22:05:08.286 INFO:tasks.rados.rados.2.smithi057.stdout:872: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 494205 to 968113 tid 1 2020-11-16T22:05:08.292 INFO:tasks.rados.rados.2.smithi057.stdout:872: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1433122 to 1840224 tid 2 2020-11-16T22:05:08.298 INFO:tasks.rados.rados.2.smithi057.stdout:872: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2384125 to 2846809 tid 3 2020-11-16T22:05:08.298 INFO:tasks.rados.rados.2.smithi057.stdout:873: delete oid 38 current snap is 110 2020-11-16T22:05:08.298 INFO:tasks.rados.rados.2.smithi057.stdout:865: finishing write tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:08.298 INFO:tasks.rados.rados.2.smithi057.stdout:865: finishing write tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:08.298 INFO:tasks.rados.rados.2.smithi057.stdout:865: finishing write tid 3 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:08.299 INFO:tasks.rados.rados.2.smithi057.stdout:865: finishing write tid 5 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:08.299 INFO:tasks.rados.rados.2.smithi057.stdout:865: finishing write tid 6 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:08.299 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 663 (ObjNum 314 snap 110 seq_num 314) dirty exists 2020-11-16T22:05:08.299 INFO:tasks.rados.rados.2.smithi057.stdout:865: left oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 314 snap 110 seq_num 314) 2020-11-16T22:05:08.299 INFO:tasks.rados.rados.2.smithi057.stdout:868: expect (ObjNum 130 snap 37 seq_num 130) 2020-11-16T22:05:08.336 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:07 smithi016 bash[10302]: cluster 2020-11-16T22:05:06.975533+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e281: 12 total, 12 up, 12 in 2020-11-16T22:05:08.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:07 smithi195 bash[10218]: cluster 2020-11-16T22:05:06.975533+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e281: 12 total, 12 up, 12 in 2020-11-16T22:05:08.400 INFO:tasks.rados.rados.2.smithi057.stdout:870: finishing copy_from to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:08.400 INFO:tasks.rados.rados.2.smithi057.stdout:870: got expected ENOENT (src dne) 2020-11-16T22:05:08.400 INFO:tasks.rados.rados.2.smithi057.stdout:871: finishing rollback tid 0 to smithi05720651-2 2020-11-16T22:05:08.400 INFO:tasks.rados.rados.2.smithi057.stdout:871: finishing rollback tid 1 to smithi05720651-2 2020-11-16T22:05:08.400 INFO:tasks.rados.rados.2.smithi057.stdout:871: finishing rollback tid 2 to smithi05720651-2 2020-11-16T22:05:08.401 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 821 (ObjNum 295 snap 100 seq_num 295) dirty exists 2020-11-16T22:05:08.401 INFO:tasks.rados.rados.2.smithi057.stdout:870: finishing copy_from racing read to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:08.401 INFO:tasks.rados.rados.2.smithi057.stdout:866: expect (ObjNum 220 snap 76 seq_num 220) 2020-11-16T22:05:08.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:07 smithi057 bash[10301]: cluster 2020-11-16T22:05:06.975533+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e281: 12 total, 12 up, 12 in 2020-11-16T22:05:08.514 INFO:tasks.rados.rados.2.smithi057.stdout:867: finishing rollback tid 1 to smithi05720651-30 2020-11-16T22:05:08.514 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 522 (ObjNum 353 snap 0 seq_num 1953066355) dirty dne 2020-11-16T22:05:08.514 INFO:tasks.rados.rados.2.smithi057.stdout:872: finishing write tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:08.514 INFO:tasks.rados.rados.2.smithi057.stdout:872: finishing write tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:08.515 INFO:tasks.rados.rados.2.smithi057.stdout:872: finishing write tid 3 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:08.515 INFO:tasks.rados.rados.2.smithi057.stdout:872: finishing write tid 5 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:08.515 INFO:tasks.rados.rados.2.smithi057.stdout:872: finishing write tid 6 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:08.515 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 631 (ObjNum 315 snap 110 seq_num 315) dirty exists 2020-11-16T22:05:08.515 INFO:tasks.rados.rados.2.smithi057.stdout:872: left oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 315 snap 110 seq_num 315) 2020-11-16T22:05:08.515 INFO:tasks.rados.rados.2.smithi057.stdout:869: finishing copy_from to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:08.516 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 472 (ObjNum 297 snap 103 seq_num 297) dirty exists 2020-11-16T22:05:08.516 INFO:tasks.rados.rados.2.smithi057.stdout:869: finishing copy_from racing read to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:08.516 INFO:tasks.rados.rados.2.smithi057.stdout:865: done (8 left) 2020-11-16T22:05:08.516 INFO:tasks.rados.rados.2.smithi057.stdout:866: done (7 left) 2020-11-16T22:05:08.516 INFO:tasks.rados.rados.2.smithi057.stdout:867: done (6 left) 2020-11-16T22:05:08.516 INFO:tasks.rados.rados.2.smithi057.stdout:868: done (5 left) 2020-11-16T22:05:08.516 INFO:tasks.rados.rados.2.smithi057.stdout:869: done (4 left) 2020-11-16T22:05:08.517 INFO:tasks.rados.rados.2.smithi057.stdout:870: done (3 left) 2020-11-16T22:05:08.517 INFO:tasks.rados.rados.2.smithi057.stdout:871: done (2 left) 2020-11-16T22:05:08.517 INFO:tasks.rados.rados.2.smithi057.stdout:872: done (1 left) 2020-11-16T22:05:08.517 INFO:tasks.rados.rados.2.smithi057.stdout:873: done (0 left) 2020-11-16T22:05:08.517 INFO:tasks.rados.rados.2.smithi057.stdout:874: snap_remove snap 109 2020-11-16T22:05:08.987 INFO:tasks.rados.rados.2.smithi057.stdout:874: done (0 left) 2020-11-16T22:05:08.987 INFO:tasks.rados.rados.2.smithi057.stdout:875: delete oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 110 2020-11-16T22:05:08.994 INFO:tasks.rados.rados.2.smithi057.stdout:875: done (0 left) 2020-11-16T22:05:08.994 INFO:tasks.rados.rados.2.smithi057.stdout:876: write (excl) oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 110 2020-11-16T22:05:08.994 INFO:tasks.rados.rados.2.smithi057.stdout:876: seq_num 318 ranges {544626=699655,1892215=554429,3150041=194585} 2020-11-16T22:05:09.009 INFO:tasks.rados.rados.2.smithi057.stdout:876: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 544626 to 1244281 tid 1 2020-11-16T22:05:09.017 INFO:tasks.rados.rados.2.smithi057.stdout:876: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1892215 to 2446644 tid 2 2020-11-16T22:05:09.022 INFO:tasks.rados.rados.2.smithi057.stdout:876: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3150041 to 3344626 tid 3 2020-11-16T22:05:09.022 INFO:tasks.rados.rados.2.smithi057.stdout:877: rollback oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 110 2020-11-16T22:05:09.022 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 108 2020-11-16T22:05:09.022 INFO:tasks.rados.rados.2.smithi057.stdout:876: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:09.023 INFO:tasks.rados.rados.2.smithi057.stdout:878: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 110 2020-11-16T22:05:09.023 INFO:tasks.rados.rados.2.smithi057.stdout:878: seq_num 319 ranges {561433=774904,1950697=414440,2777464=583969} 2020-11-16T22:05:09.030 INFO:tasks.rados.rados.2.smithi057.stdout:878: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 561433 to 1336337 tid 1 2020-11-16T22:05:09.035 INFO:tasks.rados.rados.2.smithi057.stdout:878: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1950697 to 2365137 tid 2 2020-11-16T22:05:09.042 INFO:tasks.rados.rados.2.smithi057.stdout:878: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2777464 to 3361433 tid 3 2020-11-16T22:05:09.042 INFO:tasks.rados.rados.2.smithi057.stdout:879: rollback oid 4 current snap is 110 2020-11-16T22:05:09.042 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 4 to 87 2020-11-16T22:05:09.042 INFO:tasks.rados.rados.2.smithi057.stdout:876: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:09.042 INFO:tasks.rados.rados.2.smithi057.stdout:876: finishing write tid 3 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:09.042 INFO:tasks.rados.rados.2.smithi057.stdout:876: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:09.043 INFO:tasks.rados.rados.2.smithi057.stdout:876: finishing write tid 6 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:09.043 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 53 (ObjNum 318 snap 110 seq_num 318) dirty exists 2020-11-16T22:05:09.043 INFO:tasks.rados.rados.2.smithi057.stdout:876: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 318 snap 110 seq_num 318) 2020-11-16T22:05:09.043 INFO:tasks.rados.rados.2.smithi057.stdout:877: finishing rollback tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:09.043 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 781 (ObjNum 129 snap 0 seq_num 0) dirty dne 2020-11-16T22:05:09.043 INFO:tasks.rados.rados.2.smithi057.stdout:876: done (3 left) 2020-11-16T22:05:09.043 INFO:tasks.rados.rados.2.smithi057.stdout:877: done (2 left) 2020-11-16T22:05:09.044 INFO:tasks.rados.rados.2.smithi057.stdout:880: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:09.044 INFO:tasks.rados.rados.2.smithi057.stdout:880: expect (ObjNum 303 snap 104 seq_num 303) 2020-11-16T22:05:09.044 INFO:tasks.rados.rados.2.smithi057.stdout:881: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 106 2020-11-16T22:05:09.044 INFO:tasks.rados.rados.2.smithi057.stdout:881: expect deleted 2020-11-16T22:05:09.044 INFO:tasks.rados.rados.2.smithi057.stdout:882: snap_create 2020-11-16T22:05:09.044 INFO:tasks.rados.rados.2.smithi057.stdout:878: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:09.048 INFO:tasks.rados.rados.2.smithi057.stdout:878: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:09.048 INFO:tasks.rados.rados.2.smithi057.stdout:879: finishing rollback tid 0 to smithi05720651-4 2020-11-16T22:05:09.049 INFO:tasks.rados.rados.2.smithi057.stdout:879: finishing rollback tid 1 to smithi05720651-4 2020-11-16T22:05:09.049 INFO:tasks.rados.rados.2.smithi057.stdout:878: finishing write tid 3 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:09.049 INFO:tasks.rados.rados.2.smithi057.stdout:879: finishing rollback tid 2 to smithi05720651-4 2020-11-16T22:05:09.049 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 273 (ObjNum 242 snap 81 seq_num 242) dirty exists 2020-11-16T22:05:09.058 INFO:tasks.rados.rados.2.smithi057.stdout:880: expect (ObjNum 303 snap 104 seq_num 303) 2020-11-16T22:05:09.159 INFO:tasks.rados.rados.2.smithi057.stdout:878: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:09.160 INFO:tasks.rados.rados.2.smithi057.stdout:878: finishing write tid 6 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:09.160 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 830 (ObjNum 319 snap 110 seq_num 319) dirty exists 2020-11-16T22:05:09.160 INFO:tasks.rados.rados.2.smithi057.stdout:878: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 319 snap 110 seq_num 319) 2020-11-16T22:05:09.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:08 smithi016 bash[10302]: cluster 2020-11-16T22:05:07.634305+0000 mgr.x (mgr.24115) 375 : cluster [DBG] pgmap v586: 17 pgs: 17 active+clean; 254 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 959 KiB/s wr, 5 op/s 2020-11-16T22:05:09.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:08 smithi016 bash[10302]: cluster 2020-11-16T22:05:07.987788+0000 mon.a (mon.0) 929 : cluster [DBG] osdmap e282: 12 total, 12 up, 12 in 2020-11-16T22:05:09.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:08 smithi195 bash[10218]: cluster 2020-11-16T22:05:07.634305+0000 mgr.x (mgr.24115) 375 : cluster [DBG] pgmap v586: 17 pgs: 17 active+clean; 254 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 959 KiB/s wr, 5 op/s 2020-11-16T22:05:09.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:08 smithi195 bash[10218]: cluster 2020-11-16T22:05:07.987788+0000 mon.a (mon.0) 929 : cluster [DBG] osdmap e282: 12 total, 12 up, 12 in 2020-11-16T22:05:09.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:08 smithi057 bash[10301]: cluster 2020-11-16T22:05:07.634305+0000 mgr.x (mgr.24115) 375 : cluster [DBG] pgmap v586: 17 pgs: 17 active+clean; 254 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 959 KiB/s wr, 5 op/s 2020-11-16T22:05:09.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:08 smithi057 bash[10301]: cluster 2020-11-16T22:05:07.987788+0000 mon.a (mon.0) 929 : cluster [DBG] osdmap e282: 12 total, 12 up, 12 in 2020-11-16T22:05:09.922 INFO:tasks.rados.rados.2.smithi057.stdout:878: done (4 left) 2020-11-16T22:05:09.922 INFO:tasks.rados.rados.2.smithi057.stdout:879: done (3 left) 2020-11-16T22:05:09.922 INFO:tasks.rados.rados.2.smithi057.stdout:880: done (2 left) 2020-11-16T22:05:09.923 INFO:tasks.rados.rados.2.smithi057.stdout:881: done (1 left) 2020-11-16T22:05:09.923 INFO:tasks.rados.rados.2.smithi057.stdout:882: done (0 left) 2020-11-16T22:05:09.923 INFO:tasks.rados.rados.2.smithi057.stdout:883: write oid 12 current snap is 111 2020-11-16T22:05:09.923 INFO:tasks.rados.rados.2.smithi057.stdout:883: seq_num 320 ranges {578240=566506,1609179=558098,2804887=551750} 2020-11-16T22:05:09.935 INFO:tasks.rados.rados.2.smithi057.stdout:883: writing smithi05720651-12 from 578240 to 1144746 tid 1 2020-11-16T22:05:09.941 INFO:tasks.rados.rados.2.smithi057.stdout:883: writing smithi05720651-12 from 1609179 to 2167277 tid 2 2020-11-16T22:05:09.948 INFO:tasks.rados.rados.2.smithi057.stdout:883: writing smithi05720651-12 from 2804887 to 3356637 tid 3 2020-11-16T22:05:09.948 INFO:tasks.rados.rados.2.smithi057.stdout:884: copy_from oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 8 current snap is 111 2020-11-16T22:05:09.948 INFO:tasks.rados.rados.2.smithi057.stdout:883: finishing write tid 1 to smithi05720651-12 2020-11-16T22:05:09.949 INFO:tasks.rados.rados.2.smithi057.stdout:885: write (excl) oid 16 current snap is 111 2020-11-16T22:05:09.949 INFO:tasks.rados.rados.2.smithi057.stdout:885: seq_num 321 ranges {595047=641755,1667661=418109,2548663=763022} 2020-11-16T22:05:09.955 INFO:tasks.rados.rados.2.smithi057.stdout:885: writing smithi05720651-16 from 595047 to 1236802 tid 1 2020-11-16T22:05:09.960 INFO:tasks.rados.rados.2.smithi057.stdout:885: writing smithi05720651-16 from 1667661 to 2085770 tid 2 2020-11-16T22:05:09.967 INFO:tasks.rados.rados.2.smithi057.stdout:885: writing smithi05720651-16 from 2548663 to 3311685 tid 3 2020-11-16T22:05:09.967 INFO:tasks.rados.rados.2.smithi057.stdout:886: write (excl) oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 111 2020-11-16T22:05:09.968 INFO:tasks.rados.rados.2.smithi057.stdout:886: seq_num 322 ranges {611854=717004,2126143=561767,3259733=152121} 2020-11-16T22:05:09.975 INFO:tasks.rados.rados.2.smithi057.stdout:886: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 611854 to 1328858 tid 1 2020-11-16T22:05:09.983 INFO:tasks.rados.rados.2.smithi057.stdout:886: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2126143 to 2687910 tid 2 2020-11-16T22:05:09.987 INFO:tasks.rados.rados.2.smithi057.stdout:886: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3259733 to 3411854 tid 3 2020-11-16T22:05:09.988 INFO:tasks.rados.rados.2.smithi057.stdout:887: write oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 111 2020-11-16T22:05:09.988 INFO:tasks.rados.rados.2.smithi057.stdout:887: seq_num 323 ranges {628661=792253,2184625=421778,3403509=25152} 2020-11-16T22:05:09.996 INFO:tasks.rados.rados.2.smithi057.stdout:887: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 628661 to 1420914 tid 1 2020-11-16T22:05:10.003 INFO:tasks.rados.rados.2.smithi057.stdout:887: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2184625 to 2606403 tid 2 2020-11-16T22:05:10.008 INFO:tasks.rados.rados.2.smithi057.stdout:887: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3403509 to 3428661 tid 3 2020-11-16T22:05:10.008 INFO:tasks.rados.rados.2.smithi057.stdout:888: copy_from oid 42 from oid 36 current snap is 111 2020-11-16T22:05:10.009 INFO:tasks.rados.rados.2.smithi057.stdout:883: finishing write tid 2 to smithi05720651-12 2020-11-16T22:05:10.009 INFO:tasks.rados.rados.2.smithi057.stdout:883: finishing write tid 3 to smithi05720651-12 2020-11-16T22:05:10.009 INFO:tasks.rados.rados.2.smithi057.stdout:885: finishing write tid 1 to smithi05720651-16 2020-11-16T22:05:10.009 INFO:tasks.rados.rados.2.smithi057.stdout:885: finishing write tid 2 to smithi05720651-16 2020-11-16T22:05:10.009 INFO:tasks.rados.rados.2.smithi057.stdout:886: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:10.009 INFO:tasks.rados.rados.2.smithi057.stdout:885: finishing write tid 3 to smithi05720651-16 2020-11-16T22:05:10.009 INFO:tasks.rados.rados.2.smithi057.stdout:884: finishing copy_from to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:10.010 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 635 (ObjNum 303 snap 104 seq_num 303) dirty exists 2020-11-16T22:05:10.010 INFO:tasks.rados.rados.2.smithi057.stdout:885: finishing write tid 5 to smithi05720651-16 2020-11-16T22:05:10.010 INFO:tasks.rados.rados.2.smithi057.stdout:884: finishing copy_from racing read to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:10.010 INFO:tasks.rados.rados.2.smithi057.stdout:885: finishing write tid 6 to smithi05720651-16 2020-11-16T22:05:10.010 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 641 (ObjNum 321 snap 111 seq_num 321) dirty exists 2020-11-16T22:05:10.010 INFO:tasks.rados.rados.2.smithi057.stdout:885: left oid 16 (ObjNum 321 snap 111 seq_num 321) 2020-11-16T22:05:10.010 INFO:tasks.rados.rados.2.smithi057.stdout:886: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:10.011 INFO:tasks.rados.rados.2.smithi057.stdout:886: finishing write tid 3 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:10.011 INFO:tasks.rados.rados.2.smithi057.stdout:886: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:10.011 INFO:tasks.rados.rados.2.smithi057.stdout:886: finishing write tid 6 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:10.011 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 302 (ObjNum 322 snap 111 seq_num 322) dirty exists 2020-11-16T22:05:10.011 INFO:tasks.rados.rados.2.smithi057.stdout:886: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 322 snap 111 seq_num 322) 2020-11-16T22:05:10.011 INFO:tasks.rados.rados.2.smithi057.stdout:887: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:10.011 INFO:tasks.rados.rados.2.smithi057.stdout:887: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:10.012 INFO:tasks.rados.rados.2.smithi057.stdout:884: done (5 left) 2020-11-16T22:05:10.012 INFO:tasks.rados.rados.2.smithi057.stdout:885: done (4 left) 2020-11-16T22:05:10.012 INFO:tasks.rados.rados.2.smithi057.stdout:886: done (3 left) 2020-11-16T22:05:10.012 INFO:tasks.rados.rados.2.smithi057.stdout:889: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:10.012 INFO:tasks.rados.rados.2.smithi057.stdout:889: expect (ObjNum 319 snap 110 seq_num 319) 2020-11-16T22:05:10.012 INFO:tasks.rados.rados.2.smithi057.stdout:890: rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 111 2020-11-16T22:05:10.012 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 72 2020-11-16T22:05:10.012 INFO:tasks.rados.rados.2.smithi057.stdout:891: write (excl) oid 28 current snap is 111 2020-11-16T22:05:10.013 INFO:tasks.rados.rados.2.smithi057.stdout:891: seq_num 324 ranges {645468=467502,1726754=565436,2798226=596838} 2020-11-16T22:05:10.020 INFO:tasks.rados.rados.2.smithi057.stdout:891: writing smithi05720651-28 from 645468 to 1112970 tid 1 2020-11-16T22:05:10.021 INFO:tasks.rados.rados.2.smithi057.stdout:891: writing smithi05720651-28 from 1726754 to 2292190 tid 2 2020-11-16T22:05:10.028 INFO:tasks.rados.rados.2.smithi057.stdout:891: writing smithi05720651-28 from 2798226 to 3395064 tid 3 2020-11-16T22:05:10.028 INFO:tasks.rados.rados.2.smithi057.stdout:887: finishing write tid 3 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:10.028 INFO:tasks.rados.rados.2.smithi057.stdout:892: snap_remove snap 108 2020-11-16T22:05:10.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:10 smithi016 bash[10302]: cluster 2020-11-16T22:05:08.998143+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e283: 12 total, 12 up, 12 in 2020-11-16T22:05:10.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:10 smithi016 bash[10302]: cluster 2020-11-16T22:05:09.931637+0000 mon.a (mon.0) 931 : cluster [DBG] osdmap e284: 12 total, 12 up, 12 in 2020-11-16T22:05:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:10 smithi195 bash[10218]: cluster 2020-11-16T22:05:08.998143+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e283: 12 total, 12 up, 12 in 2020-11-16T22:05:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:10 smithi195 bash[10218]: cluster 2020-11-16T22:05:09.931637+0000 mon.a (mon.0) 931 : cluster [DBG] osdmap e284: 12 total, 12 up, 12 in 2020-11-16T22:05:10.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:10 smithi057 bash[10301]: cluster 2020-11-16T22:05:08.998143+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e283: 12 total, 12 up, 12 in 2020-11-16T22:05:10.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:10 smithi057 bash[10301]: cluster 2020-11-16T22:05:09.931637+0000 mon.a (mon.0) 931 : cluster [DBG] osdmap e284: 12 total, 12 up, 12 in 2020-11-16T22:05:11.005 INFO:tasks.rados.rados.2.smithi057.stdout:892: done (6 left) 2020-11-16T22:05:11.006 INFO:tasks.rados.rados.2.smithi057.stdout:893: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:11.006 INFO:tasks.rados.rados.2.smithi057.stdout:893: expect (ObjNum 322 snap 111 seq_num 322) 2020-11-16T22:05:11.006 INFO:tasks.rados.rados.2.smithi057.stdout:894: write oid 44 current snap is 111 2020-11-16T22:05:11.006 INFO:tasks.rados.rados.2.smithi057.stdout:894: seq_num 325 ranges {662275=542751,1785236=425447,2942002=520273} 2020-11-16T22:05:11.017 INFO:tasks.rados.rados.2.smithi057.stdout:894: writing smithi05720651-44 from 662275 to 1205026 tid 1 2020-11-16T22:05:11.024 INFO:tasks.rados.rados.2.smithi057.stdout:894: writing smithi05720651-44 from 1785236 to 2210683 tid 2 2020-11-16T22:05:11.032 INFO:tasks.rados.rados.2.smithi057.stdout:894: writing smithi05720651-44 from 2942002 to 3462275 tid 3 2020-11-16T22:05:11.033 INFO:tasks.rados.rados.2.smithi057.stdout:895: rollback oid 8 current snap is 111 2020-11-16T22:05:11.033 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 8 to 97 2020-11-16T22:05:11.033 INFO:tasks.rados.rados.2.smithi057.stdout:887: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:11.033 INFO:tasks.rados.rados.2.smithi057.stdout:887: finishing write tid 6 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:11.033 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 306 (ObjNum 323 snap 111 seq_num 323) dirty exists 2020-11-16T22:05:11.033 INFO:tasks.rados.rados.2.smithi057.stdout:887: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 323 snap 111 seq_num 323) 2020-11-16T22:05:11.033 INFO:tasks.rados.rados.2.smithi057.stdout:890: finishing rollback tid 0 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:11.034 INFO:tasks.rados.rados.2.smithi057.stdout:887: done (8 left) 2020-11-16T22:05:11.034 INFO:tasks.rados.rados.2.smithi057.stdout:896: rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 111 2020-11-16T22:05:11.034 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 110 2020-11-16T22:05:11.034 INFO:tasks.rados.rados.2.smithi057.stdout:890: finishing rollback tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:11.034 INFO:tasks.rados.rados.2.smithi057.stdout:890: finishing rollback tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:11.034 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 645 (ObjNum 137 snap 39 seq_num 137) dirty exists 2020-11-16T22:05:11.034 INFO:tasks.rados.rados.2.smithi057.stdout:891: finishing write tid 1 to smithi05720651-28 2020-11-16T22:05:11.035 INFO:tasks.rados.rados.2.smithi057.stdout:889: expect (ObjNum 319 snap 110 seq_num 319) 2020-11-16T22:05:11.175 INFO:tasks.rados.rados.2.smithi057.stdout:888: finishing copy_from to smithi05720651-42 2020-11-16T22:05:11.175 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 472 (ObjNum 297 snap 103 seq_num 297) dirty exists 2020-11-16T22:05:11.175 INFO:tasks.rados.rados.2.smithi057.stdout:888: finishing copy_from racing read to smithi05720651-42 2020-11-16T22:05:11.175 INFO:tasks.rados.rados.2.smithi057.stdout:891: finishing write tid 2 to smithi05720651-28 2020-11-16T22:05:11.175 INFO:tasks.rados.rados.2.smithi057.stdout:891: finishing write tid 3 to smithi05720651-28 2020-11-16T22:05:11.176 INFO:tasks.rados.rados.2.smithi057.stdout:891: finishing write tid 5 to smithi05720651-28 2020-11-16T22:05:11.176 INFO:tasks.rados.rados.2.smithi057.stdout:891: finishing write tid 6 to smithi05720651-28 2020-11-16T22:05:11.176 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 545 (ObjNum 324 snap 111 seq_num 324) dirty exists 2020-11-16T22:05:11.176 INFO:tasks.rados.rados.2.smithi057.stdout:891: left oid 28 (ObjNum 324 snap 111 seq_num 324) 2020-11-16T22:05:11.176 INFO:tasks.rados.rados.2.smithi057.stdout:893: expect (ObjNum 322 snap 111 seq_num 322) 2020-11-16T22:05:11.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:11 smithi016 bash[10302]: cluster 2020-11-16T22:05:09.635005+0000 mgr.x (mgr.24115) 376 : cluster [DBG] pgmap v589: 17 pgs: 17 active+clean; 254 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 959 KiB/s wr, 5 op/s 2020-11-16T22:05:11.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:11 smithi195 bash[10218]: cluster 2020-11-16T22:05:09.635005+0000 mgr.x (mgr.24115) 376 : cluster [DBG] pgmap v589: 17 pgs: 17 active+clean; 254 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 959 KiB/s wr, 5 op/s 2020-11-16T22:05:11.367 INFO:tasks.rados.rados.2.smithi057.stdout:883: finishing write tid 5 to smithi05720651-12 2020-11-16T22:05:11.367 INFO:tasks.rados.rados.2.smithi057.stdout:883: finishing write tid 6 to smithi05720651-12 2020-11-16T22:05:11.367 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 435 (ObjNum 320 snap 111 seq_num 320) dirty exists 2020-11-16T22:05:11.367 INFO:tasks.rados.rados.2.smithi057.stdout:883: left oid 12 (ObjNum 320 snap 111 seq_num 320) 2020-11-16T22:05:11.368 INFO:tasks.rados.rados.2.smithi057.stdout:894: finishing write tid 1 to smithi05720651-44 2020-11-16T22:05:11.368 INFO:tasks.rados.rados.2.smithi057.stdout:894: finishing write tid 2 to smithi05720651-44 2020-11-16T22:05:11.368 INFO:tasks.rados.rados.2.smithi057.stdout:894: finishing write tid 3 to smithi05720651-44 2020-11-16T22:05:11.368 INFO:tasks.rados.rados.2.smithi057.stdout:894: finishing write tid 5 to smithi05720651-44 2020-11-16T22:05:11.368 INFO:tasks.rados.rados.2.smithi057.stdout:894: finishing write tid 6 to smithi05720651-44 2020-11-16T22:05:11.368 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 439 (ObjNum 325 snap 111 seq_num 325) dirty exists 2020-11-16T22:05:11.368 INFO:tasks.rados.rados.2.smithi057.stdout:894: left oid 44 (ObjNum 325 snap 111 seq_num 325) 2020-11-16T22:05:11.369 INFO:tasks.rados.rados.2.smithi057.stdout:896: finishing rollback tid 0 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:11.369 INFO:tasks.rados.rados.2.smithi057.stdout:895: finishing rollback tid 0 to smithi05720651-8 2020-11-16T22:05:11.369 INFO:tasks.rados.rados.2.smithi057.stdout:883: done (8 left) 2020-11-16T22:05:11.369 INFO:tasks.rados.rados.2.smithi057.stdout:888: done (7 left) 2020-11-16T22:05:11.369 INFO:tasks.rados.rados.2.smithi057.stdout:889: done (6 left) 2020-11-16T22:05:11.369 INFO:tasks.rados.rados.2.smithi057.stdout:890: done (5 left) 2020-11-16T22:05:11.369 INFO:tasks.rados.rados.2.smithi057.stdout:891: done (4 left) 2020-11-16T22:05:11.369 INFO:tasks.rados.rados.2.smithi057.stdout:893: done (3 left) 2020-11-16T22:05:11.370 INFO:tasks.rados.rados.2.smithi057.stdout:894: done (2 left) 2020-11-16T22:05:11.370 INFO:tasks.rados.rados.2.smithi057.stdout:897: write oid 2 current snap is 111 2020-11-16T22:05:11.370 INFO:tasks.rados.rados.2.smithi057.stdout:897: seq_num 326 ranges {679082=618000,1843718=569105,2853072=626010} 2020-11-16T22:05:11.383 INFO:tasks.rados.rados.2.smithi057.stdout:897: writing smithi05720651-2 from 679082 to 1297082 tid 1 2020-11-16T22:05:11.389 INFO:tasks.rados.rados.2.smithi057.stdout:897: writing smithi05720651-2 from 1843718 to 2412823 tid 2 2020-11-16T22:05:11.396 INFO:tasks.rados.rados.2.smithi057.stdout:897: writing smithi05720651-2 from 2853072 to 3479082 tid 3 2020-11-16T22:05:11.396 INFO:tasks.rados.rados.2.smithi057.stdout:898: read oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:11.396 INFO:tasks.rados.rados.2.smithi057.stdout:898: expect (ObjNum 272 snap 91 seq_num 272) 2020-11-16T22:05:11.396 INFO:tasks.rados.rados.2.smithi057.stdout:899: rollback oid 6 current snap is 111 2020-11-16T22:05:11.396 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 6 to 91 2020-11-16T22:05:11.396 INFO:tasks.rados.rados.2.smithi057.stdout:895: finishing rollback tid 1 to smithi05720651-8 2020-11-16T22:05:11.397 INFO:tasks.rados.rados.2.smithi057.stdout:895: finishing rollback tid 2 to smithi05720651-8 2020-11-16T22:05:11.397 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 638 (ObjNum 206 snap 70 seq_num 206) dirty exists 2020-11-16T22:05:11.397 INFO:tasks.rados.rados.2.smithi057.stdout:896: finishing rollback tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:11.397 INFO:tasks.rados.rados.2.smithi057.stdout:896: finishing rollback tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:11.397 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 649 (ObjNum 220 snap 76 seq_num 220) dirty exists 2020-11-16T22:05:11.397 INFO:tasks.rados.rados.2.smithi057.stdout:895: done (4 left) 2020-11-16T22:05:11.397 INFO:tasks.rados.rados.2.smithi057.stdout:896: done (3 left) 2020-11-16T22:05:11.398 INFO:tasks.rados.rados.2.smithi057.stdout:900: write oid 20 current snap is 111 2020-11-16T22:05:11.398 INFO:tasks.rados.rados.2.smithi057.stdout:900: seq_num 327 ranges {695889=409602,1618553=712763,2996848=499041} 2020-11-16T22:05:11.402 INFO:tasks.rados.rados.2.smithi057.stdout:900: writing smithi05720651-20 from 695889 to 1105491 tid 1 2020-11-16T22:05:11.409 INFO:tasks.rados.rados.2.smithi057.stdout:900: writing smithi05720651-20 from 1618553 to 2331316 tid 2 2020-11-16T22:05:11.416 INFO:tasks.rados.rados.2.smithi057.stdout:900: writing smithi05720651-20 from 2996848 to 3495889 tid 3 2020-11-16T22:05:11.416 INFO:tasks.rados.rados.2.smithi057.stdout:901: rollback oid 48 current snap is 111 2020-11-16T22:05:11.417 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 48 to 88 2020-11-16T22:05:11.417 INFO:tasks.rados.rados.2.smithi057.stdout:897: finishing write tid 1 to smithi05720651-2 2020-11-16T22:05:11.417 INFO:tasks.rados.rados.2.smithi057.stdout:897: finishing write tid 2 to smithi05720651-2 2020-11-16T22:05:11.417 INFO:tasks.rados.rados.2.smithi057.stdout:899: finishing rollback tid 0 to smithi05720651-6 2020-11-16T22:05:11.417 INFO:tasks.rados.rados.2.smithi057.stdout:902: snap_create 2020-11-16T22:05:11.417 INFO:tasks.rados.rados.2.smithi057.stdout:899: finishing rollback tid 1 to smithi05720651-6 2020-11-16T22:05:11.417 INFO:tasks.rados.rados.2.smithi057.stdout:899: finishing rollback tid 2 to smithi05720651-6 2020-11-16T22:05:11.418 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 677 (ObjNum 264 snap 86 seq_num 264) dirty exists 2020-11-16T22:05:11.418 INFO:tasks.rados.rados.2.smithi057.stdout:897: finishing write tid 3 to smithi05720651-2 2020-11-16T22:05:11.418 INFO:tasks.rados.rados.2.smithi057.stdout:897: finishing write tid 5 to smithi05720651-2 2020-11-16T22:05:11.418 INFO:tasks.rados.rados.2.smithi057.stdout:897: finishing write tid 6 to smithi05720651-2 2020-11-16T22:05:11.418 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 839 (ObjNum 326 snap 111 seq_num 326) dirty exists 2020-11-16T22:05:11.418 INFO:tasks.rados.rados.2.smithi057.stdout:897: left oid 2 (ObjNum 326 snap 111 seq_num 326) 2020-11-16T22:05:11.418 INFO:tasks.rados.rados.2.smithi057.stdout:900: finishing write tid 1 to smithi05720651-20 2020-11-16T22:05:11.419 INFO:tasks.rados.rados.2.smithi057.stdout:898: expect (ObjNum 272 snap 91 seq_num 272) 2020-11-16T22:05:11.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:11 smithi057 bash[10301]: cluster 2020-11-16T22:05:09.635005+0000 mgr.x (mgr.24115) 376 : cluster [DBG] pgmap v589: 17 pgs: 17 active+clean; 254 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 959 KiB/s wr, 5 op/s 2020-11-16T22:05:11.587 INFO:tasks.rados.rados.2.smithi057.stdout:900: finishing write tid 2 to smithi05720651-20 2020-11-16T22:05:11.587 INFO:tasks.rados.rados.2.smithi057.stdout:900: finishing write tid 3 to smithi05720651-20 2020-11-16T22:05:11.587 INFO:tasks.rados.rados.2.smithi057.stdout:901: finishing rollback tid 0 to smithi05720651-48 2020-11-16T22:05:11.588 INFO:tasks.rados.rados.2.smithi057.stdout:901: finishing rollback tid 1 to smithi05720651-48 2020-11-16T22:05:11.588 INFO:tasks.rados.rados.2.smithi057.stdout:901: finishing rollback tid 2 to smithi05720651-48 2020-11-16T22:05:11.588 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 203 (ObjNum 144 snap 44 seq_num 144) dirty exists 2020-11-16T22:05:11.794 INFO:tasks.rados.rados.2.smithi057.stdout:900: finishing write tid 5 to smithi05720651-20 2020-11-16T22:05:11.794 INFO:tasks.rados.rados.2.smithi057.stdout:900: finishing write tid 6 to smithi05720651-20 2020-11-16T22:05:11.795 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 277 (ObjNum 327 snap 111 seq_num 327) dirty exists 2020-11-16T22:05:11.795 INFO:tasks.rados.rados.2.smithi057.stdout:900: left oid 20 (ObjNum 327 snap 111 seq_num 327) 2020-11-16T22:05:12.016 INFO:tasks.rados.rados.2.smithi057.stdout:897: done (5 left) 2020-11-16T22:05:12.017 INFO:tasks.rados.rados.2.smithi057.stdout:898: done (4 left) 2020-11-16T22:05:12.017 INFO:tasks.rados.rados.2.smithi057.stdout:899: done (3 left) 2020-11-16T22:05:12.017 INFO:tasks.rados.rados.2.smithi057.stdout:900: done (2 left) 2020-11-16T22:05:12.017 INFO:tasks.rados.rados.2.smithi057.stdout:901: done (1 left) 2020-11-16T22:05:12.017 INFO:tasks.rados.rados.2.smithi057.stdout:902: done (0 left) 2020-11-16T22:05:12.017 INFO:tasks.rados.rados.2.smithi057.stdout:903: snap_create 2020-11-16T22:05:12.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:12 smithi016 bash[10302]: cluster 2020-11-16T22:05:11.015396+0000 mon.a (mon.0) 932 : cluster [DBG] osdmap e285: 12 total, 12 up, 12 in 2020-11-16T22:05:12.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:12 smithi195 bash[10218]: cluster 2020-11-16T22:05:11.015396+0000 mon.a (mon.0) 932 : cluster [DBG] osdmap e285: 12 total, 12 up, 12 in 2020-11-16T22:05:12.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:12 smithi057 bash[10301]: cluster 2020-11-16T22:05:11.015396+0000 mon.a (mon.0) 932 : cluster [DBG] osdmap e285: 12 total, 12 up, 12 in 2020-11-16T22:05:13.019 INFO:tasks.rados.rados.2.smithi057.stdout:903: done (0 left) 2020-11-16T22:05:13.019 INFO:tasks.rados.rados.2.smithi057.stdout:904: write (excl) oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 113 2020-11-16T22:05:13.019 INFO:tasks.rados.rados.2.smithi057.stdout:904: seq_num 328 ranges {712696=484851,1960682=572774,3307918=204778} 2020-11-16T22:05:13.034 INFO:tasks.rados.rados.2.smithi057.stdout:904: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 712696 to 1197547 tid 1 2020-11-16T22:05:13.042 INFO:tasks.rados.rados.2.smithi057.stdout:904: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1960682 to 2533456 tid 2 2020-11-16T22:05:13.048 INFO:tasks.rados.rados.2.smithi057.stdout:904: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3307918 to 3512696 tid 3 2020-11-16T22:05:13.048 INFO:tasks.rados.rados.2.smithi057.stdout:904: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:13.049 INFO:tasks.rados.rados.2.smithi057.stdout:905: read oid 8 snap -1 2020-11-16T22:05:13.049 INFO:tasks.rados.rados.2.smithi057.stdout:905: expect (ObjNum 206 snap 70 seq_num 206) 2020-11-16T22:05:13.049 INFO:tasks.rados.rados.2.smithi057.stdout:906: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 91 2020-11-16T22:05:13.049 INFO:tasks.rados.rados.2.smithi057.stdout:906: expect deleted 2020-11-16T22:05:13.049 INFO:tasks.rados.rados.2.smithi057.stdout:907: write oid 12 current snap is 113 2020-11-16T22:05:13.049 INFO:tasks.rados.rados.2.smithi057.stdout:907: seq_num 329 ranges {729503=560100,2019164=716432,3335341=194162} 2020-11-16T22:05:13.056 INFO:tasks.rados.rados.2.smithi057.stdout:907: writing smithi05720651-12 from 729503 to 1289603 tid 1 2020-11-16T22:05:13.066 INFO:tasks.rados.rados.2.smithi057.stdout:907: writing smithi05720651-12 from 2019164 to 2735596 tid 2 2020-11-16T22:05:13.071 INFO:tasks.rados.rados.2.smithi057.stdout:907: writing smithi05720651-12 from 3335341 to 3529503 tid 3 2020-11-16T22:05:13.071 INFO:tasks.rados.rados.2.smithi057.stdout:908: snap_create 2020-11-16T22:05:13.071 INFO:tasks.rados.rados.2.smithi057.stdout:904: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:13.071 INFO:tasks.rados.rados.2.smithi057.stdout:904: finishing write tid 3 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:13.071 INFO:tasks.rados.rados.2.smithi057.stdout:904: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:13.072 INFO:tasks.rados.rados.2.smithi057.stdout:904: finishing write tid 6 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:13.072 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 639 (ObjNum 328 snap 113 seq_num 328) dirty exists 2020-11-16T22:05:13.072 INFO:tasks.rados.rados.2.smithi057.stdout:904: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 328 snap 113 seq_num 328) 2020-11-16T22:05:13.072 INFO:tasks.rados.rados.2.smithi057.stdout:905: expect (ObjNum 206 snap 70 seq_num 206) 2020-11-16T22:05:13.224 INFO:tasks.rados.rados.2.smithi057.stdout:907: finishing write tid 1 to smithi05720651-12 2020-11-16T22:05:13.225 INFO:tasks.rados.rados.2.smithi057.stdout:907: finishing write tid 2 to smithi05720651-12 2020-11-16T22:05:13.225 INFO:tasks.rados.rados.2.smithi057.stdout:907: finishing write tid 3 to smithi05720651-12 2020-11-16T22:05:13.225 INFO:tasks.rados.rados.2.smithi057.stdout:907: finishing write tid 5 to smithi05720651-12 2020-11-16T22:05:13.225 INFO:tasks.rados.rados.2.smithi057.stdout:907: finishing write tid 6 to smithi05720651-12 2020-11-16T22:05:13.225 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 443 (ObjNum 329 snap 113 seq_num 329) dirty exists 2020-11-16T22:05:13.225 INFO:tasks.rados.rados.2.smithi057.stdout:907: left oid 12 (ObjNum 329 snap 113 seq_num 329) 2020-11-16T22:05:13.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:13 smithi016 bash[10302]: cluster 2020-11-16T22:05:11.635728+0000 mgr.x (mgr.24115) 377 : cluster [DBG] pgmap v592: 17 pgs: 17 active+clean; 295 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 9.8 MiB/s wr, 40 op/s 2020-11-16T22:05:13.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:13 smithi016 bash[10302]: cluster 2020-11-16T22:05:12.025324+0000 mon.a (mon.0) 933 : cluster [DBG] osdmap e286: 12 total, 12 up, 12 in 2020-11-16T22:05:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:13 smithi195 bash[10218]: cluster 2020-11-16T22:05:11.635728+0000 mgr.x (mgr.24115) 377 : cluster [DBG] pgmap v592: 17 pgs: 17 active+clean; 295 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 9.8 MiB/s wr, 40 op/s 2020-11-16T22:05:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:13 smithi195 bash[10218]: cluster 2020-11-16T22:05:12.025324+0000 mon.a (mon.0) 933 : cluster [DBG] osdmap e286: 12 total, 12 up, 12 in 2020-11-16T22:05:13.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:13 smithi057 bash[10301]: cluster 2020-11-16T22:05:11.635728+0000 mgr.x (mgr.24115) 377 : cluster [DBG] pgmap v592: 17 pgs: 17 active+clean; 295 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 9.8 MiB/s wr, 40 op/s 2020-11-16T22:05:13.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:13 smithi057 bash[10301]: cluster 2020-11-16T22:05:12.025324+0000 mon.a (mon.0) 933 : cluster [DBG] osdmap e286: 12 total, 12 up, 12 in 2020-11-16T22:05:14.034 INFO:tasks.rados.rados.2.smithi057.stdout:904: done (4 left) 2020-11-16T22:05:14.035 INFO:tasks.rados.rados.2.smithi057.stdout:905: done (3 left) 2020-11-16T22:05:14.035 INFO:tasks.rados.rados.2.smithi057.stdout:906: done (2 left) 2020-11-16T22:05:14.035 INFO:tasks.rados.rados.2.smithi057.stdout:907: done (1 left) 2020-11-16T22:05:14.035 INFO:tasks.rados.rados.2.smithi057.stdout:908: done (0 left) 2020-11-16T22:05:14.035 INFO:tasks.rados.rados.2.smithi057.stdout:909: write oid 34 current snap is 114 2020-11-16T22:05:14.035 INFO:tasks.rados.rados.2.smithi057.stdout:909: seq_num 330 ranges {746310=635349,2077646=576443,3362764=183546} 2020-11-16T22:05:14.051 INFO:tasks.rados.rados.2.smithi057.stdout:909: writing smithi05720651-34 from 746310 to 1381659 tid 1 2020-11-16T22:05:14.054 INFO:tasks.rados.rados.2.smithi057.stdout:909: writing smithi05720651-34 from 2077646 to 2654089 tid 2 2020-11-16T22:05:14.059 INFO:tasks.rados.rados.2.smithi057.stdout:909: writing smithi05720651-34 from 3362764 to 3546310 tid 3 2020-11-16T22:05:14.059 INFO:tasks.rados.rados.2.smithi057.stdout:910: delete oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 114 2020-11-16T22:05:14.059 INFO:tasks.rados.rados.2.smithi057.stdout:909: finishing write tid 1 to smithi05720651-34 2020-11-16T22:05:14.059 INFO:tasks.rados.rados.2.smithi057.stdout:909: finishing write tid 2 to smithi05720651-34 2020-11-16T22:05:14.063 INFO:tasks.rados.rados.2.smithi057.stdout:909: finishing write tid 3 to smithi05720651-34 2020-11-16T22:05:14.064 INFO:tasks.rados.rados.2.smithi057.stdout:909: finishing write tid 5 to smithi05720651-34 2020-11-16T22:05:14.064 INFO:tasks.rados.rados.2.smithi057.stdout:909: finishing write tid 6 to smithi05720651-34 2020-11-16T22:05:14.064 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 281 (ObjNum 330 snap 114 seq_num 330) dirty exists 2020-11-16T22:05:14.065 INFO:tasks.rados.rados.2.smithi057.stdout:909: left oid 34 (ObjNum 330 snap 114 seq_num 330) 2020-11-16T22:05:14.068 INFO:tasks.rados.rados.2.smithi057.stdout:909: done (1 left) 2020-11-16T22:05:14.068 INFO:tasks.rados.rados.2.smithi057.stdout:910: done (0 left) 2020-11-16T22:05:14.068 INFO:tasks.rados.rados.2.smithi057.stdout:911: copy_from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 114 2020-11-16T22:05:14.068 INFO:tasks.rados.rados.2.smithi057.stdout:912: write (excl) oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 114 2020-11-16T22:05:14.068 INFO:tasks.rados.rados.2.smithi057.stdout:912: seq_num 332 ranges {779924=785847,2078257=580112,3301257=278667} 2020-11-16T22:05:14.077 INFO:tasks.rados.rados.2.smithi057.stdout:912: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 779924 to 1565771 tid 1 2020-11-16T22:05:14.085 INFO:tasks.rados.rados.2.smithi057.stdout:912: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2078257 to 2658369 tid 2 2020-11-16T22:05:14.091 INFO:tasks.rados.rados.2.smithi057.stdout:912: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3301257 to 3579924 tid 3 2020-11-16T22:05:14.091 INFO:tasks.rados.rados.2.smithi057.stdout:913: write oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 114 2020-11-16T22:05:14.091 INFO:tasks.rados.rados.2.smithi057.stdout:913: seq_num 333 ranges {796731=461096,1736739=723770,2928680=668051} 2020-11-16T22:05:14.098 INFO:tasks.rados.rados.2.smithi057.stdout:913: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 796731 to 1257827 tid 1 2020-11-16T22:05:14.105 INFO:tasks.rados.rados.2.smithi057.stdout:913: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1736739 to 2460509 tid 2 2020-11-16T22:05:14.112 INFO:tasks.rados.rados.2.smithi057.stdout:913: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2928680 to 3596731 tid 3 2020-11-16T22:05:14.112 INFO:tasks.rados.rados.2.smithi057.stdout:914: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:14.112 INFO:tasks.rados.rados.2.smithi057.stdout:914: expect (ObjNum 323 snap 111 seq_num 323) 2020-11-16T22:05:14.112 INFO:tasks.rados.rados.2.smithi057.stdout:915: rollback oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 114 2020-11-16T22:05:14.113 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 110 2020-11-16T22:05:14.113 INFO:tasks.rados.rados.2.smithi057.stdout:912: finishing write tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:14.113 INFO:tasks.rados.rados.2.smithi057.stdout:912: finishing write tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:14.113 INFO:tasks.rados.rados.2.smithi057.stdout:912: finishing write tid 3 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:14.113 INFO:tasks.rados.rados.2.smithi057.stdout:912: finishing write tid 5 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:14.113 INFO:tasks.rados.rados.2.smithi057.stdout:912: finishing write tid 6 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:14.113 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 846 (ObjNum 332 snap 114 seq_num 332) dirty exists 2020-11-16T22:05:14.114 INFO:tasks.rados.rados.2.smithi057.stdout:912: left oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 332 snap 114 seq_num 332) 2020-11-16T22:05:14.114 INFO:tasks.rados.rados.2.smithi057.stdout:911: finishing copy_from to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:14.114 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 302 (ObjNum 322 snap 111 seq_num 322) dirty exists 2020-11-16T22:05:14.114 INFO:tasks.rados.rados.2.smithi057.stdout:911: finishing copy_from racing read to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:14.114 INFO:tasks.rados.rados.2.smithi057.stdout:911: done (4 left) 2020-11-16T22:05:14.114 INFO:tasks.rados.rados.2.smithi057.stdout:912: done (3 left) 2020-11-16T22:05:14.114 INFO:tasks.rados.rados.2.smithi057.stdout:916: write oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 114 2020-11-16T22:05:14.115 INFO:tasks.rados.rados.2.smithi057.stdout:916: seq_num 334 ranges {413538=536345,1395221=583781,2556103=658617} 2020-11-16T22:05:14.117 INFO:tasks.rados.rados.2.smithi057.stdout:916: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 413538 to 949883 tid 1 2020-11-16T22:05:14.124 INFO:tasks.rados.rados.2.smithi057.stdout:916: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1395221 to 1979002 tid 2 2020-11-16T22:05:14.130 INFO:tasks.rados.rados.2.smithi057.stdout:916: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2556103 to 3214720 tid 3 2020-11-16T22:05:14.131 INFO:tasks.rados.rados.2.smithi057.stdout:917: snap_remove snap 106 2020-11-16T22:05:14.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:14 smithi016 bash[10302]: cluster 2020-11-16T22:05:13.028669+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e287: 12 total, 12 up, 12 in 2020-11-16T22:05:14.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:14 smithi195 bash[10218]: cluster 2020-11-16T22:05:13.028669+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e287: 12 total, 12 up, 12 in 2020-11-16T22:05:14.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:14 smithi057 bash[10301]: cluster 2020-11-16T22:05:13.028669+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e287: 12 total, 12 up, 12 in 2020-11-16T22:05:14.928 INFO:tasks.rados.rados.2.smithi057.stdout:917: done (4 left) 2020-11-16T22:05:14.928 INFO:tasks.rados.rados.2.smithi057.stdout:918: rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 114 2020-11-16T22:05:14.928 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 105 2020-11-16T22:05:14.928 INFO:tasks.rados.rados.2.smithi057.stdout:913: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:14.928 INFO:tasks.rados.rados.2.smithi057.stdout:913: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:14.929 INFO:tasks.rados.rados.2.smithi057.stdout:913: finishing write tid 3 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:14.929 INFO:tasks.rados.rados.2.smithi057.stdout:913: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:14.929 INFO:tasks.rados.rados.2.smithi057.stdout:913: finishing write tid 6 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:14.929 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 684 (ObjNum 333 snap 114 seq_num 333) dirty exists 2020-11-16T22:05:14.929 INFO:tasks.rados.rados.2.smithi057.stdout:913: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 333 snap 114 seq_num 333) 2020-11-16T22:05:14.929 INFO:tasks.rados.rados.2.smithi057.stdout:914: expect (ObjNum 323 snap 111 seq_num 323) 2020-11-16T22:05:15.043 INFO:tasks.rados.rados.2.smithi057.stdout:915: finishing rollback tid 0 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:15.043 INFO:tasks.rados.rados.2.smithi057.stdout:915: finishing rollback tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:15.043 INFO:tasks.rados.rados.2.smithi057.stdout:915: finishing rollback tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:15.043 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 430 (ObjNum 290 snap 99 seq_num 290) dirty exists 2020-11-16T22:05:15.043 INFO:tasks.rados.rados.2.smithi057.stdout:916: finishing write tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:15.044 INFO:tasks.rados.rados.2.smithi057.stdout:916: finishing write tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:15.044 INFO:tasks.rados.rados.2.smithi057.stdout:913: done (4 left) 2020-11-16T22:05:15.044 INFO:tasks.rados.rados.2.smithi057.stdout:914: done (3 left) 2020-11-16T22:05:15.044 INFO:tasks.rados.rados.2.smithi057.stdout:915: done (2 left) 2020-11-16T22:05:15.044 INFO:tasks.rados.rados.2.smithi057.stdout:919: read oid 16 snap -1 2020-11-16T22:05:15.044 INFO:tasks.rados.rados.2.smithi057.stdout:919: expect (ObjNum 321 snap 111 seq_num 321) 2020-11-16T22:05:15.044 INFO:tasks.rados.rados.2.smithi057.stdout:920: snap_remove snap 111 2020-11-16T22:05:15.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:15 smithi016 bash[10302]: cluster 2020-11-16T22:05:13.636426+0000 mgr.x (mgr.24115) 378 : cluster [DBG] pgmap v595: 17 pgs: 17 active+clean; 294 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 10 MiB/s wr, 45 op/s 2020-11-16T22:05:15.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:15 smithi016 bash[10302]: cluster 2020-11-16T22:05:14.046159+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e288: 12 total, 12 up, 12 in 2020-11-16T22:05:15.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:15 smithi016 bash[10302]: cluster 2020-11-16T22:05:14.933506+0000 mon.a (mon.0) 936 : cluster [DBG] osdmap e289: 12 total, 12 up, 12 in 2020-11-16T22:05:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:15 smithi195 bash[10218]: cluster 2020-11-16T22:05:13.636426+0000 mgr.x (mgr.24115) 378 : cluster [DBG] pgmap v595: 17 pgs: 17 active+clean; 294 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 10 MiB/s wr, 45 op/s 2020-11-16T22:05:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:15 smithi195 bash[10218]: cluster 2020-11-16T22:05:14.046159+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e288: 12 total, 12 up, 12 in 2020-11-16T22:05:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:15 smithi195 bash[10218]: cluster 2020-11-16T22:05:14.933506+0000 mon.a (mon.0) 936 : cluster [DBG] osdmap e289: 12 total, 12 up, 12 in 2020-11-16T22:05:15.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:15 smithi057 bash[10301]: cluster 2020-11-16T22:05:13.636426+0000 mgr.x (mgr.24115) 378 : cluster [DBG] pgmap v595: 17 pgs: 17 active+clean; 294 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 10 MiB/s wr, 45 op/s 2020-11-16T22:05:15.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:15 smithi057 bash[10301]: cluster 2020-11-16T22:05:14.046159+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e288: 12 total, 12 up, 12 in 2020-11-16T22:05:15.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:15 smithi057 bash[10301]: cluster 2020-11-16T22:05:14.933506+0000 mon.a (mon.0) 936 : cluster [DBG] osdmap e289: 12 total, 12 up, 12 in 2020-11-16T22:05:16.047 INFO:tasks.rados.rados.2.smithi057.stdout:920: done (3 left) 2020-11-16T22:05:16.047 INFO:tasks.rados.rados.2.smithi057.stdout:921: copy_from oid 22 from oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 114 2020-11-16T22:05:16.048 INFO:tasks.rados.rados.2.smithi057.stdout:916: finishing write tid 3 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:16.048 INFO:tasks.rados.rados.2.smithi057.stdout:916: finishing write tid 5 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:16.048 INFO:tasks.rados.rados.2.smithi057.stdout:916: finishing write tid 6 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:16.048 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 663 (ObjNum 334 snap 114 seq_num 334) dirty exists 2020-11-16T22:05:16.048 INFO:tasks.rados.rados.2.smithi057.stdout:916: left oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 334 snap 114 seq_num 334) 2020-11-16T22:05:16.048 INFO:tasks.rados.rados.2.smithi057.stdout:918: finishing rollback tid 0 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:16.048 INFO:tasks.rados.rados.2.smithi057.stdout:918: finishing rollback tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:16.049 INFO:tasks.rados.rados.2.smithi057.stdout:918: finishing rollback tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:16.049 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 671 (ObjNum 272 snap 91 seq_num 272) dirty exists 2020-11-16T22:05:16.049 INFO:tasks.rados.rados.2.smithi057.stdout:919: expect (ObjNum 321 snap 111 seq_num 321) 2020-11-16T22:05:16.302 INFO:tasks.rados.rados.2.smithi057.stdout:921: finishing copy_from to smithi05720651-22 2020-11-16T22:05:16.302 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 830 (ObjNum 319 snap 110 seq_num 319) dirty exists 2020-11-16T22:05:16.302 INFO:tasks.rados.rados.2.smithi057.stdout:921: finishing copy_from racing read to smithi05720651-22 2020-11-16T22:05:16.302 INFO:tasks.rados.rados.2.smithi057.stdout:916: done (3 left) 2020-11-16T22:05:16.302 INFO:tasks.rados.rados.2.smithi057.stdout:918: done (2 left) 2020-11-16T22:05:16.303 INFO:tasks.rados.rados.2.smithi057.stdout:919: done (1 left) 2020-11-16T22:05:16.303 INFO:tasks.rados.rados.2.smithi057.stdout:921: done (0 left) 2020-11-16T22:05:16.303 INFO:tasks.rados.rados.2.smithi057.stdout:922: copy_from oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 20 current snap is 114 2020-11-16T22:05:16.303 INFO:tasks.rados.rados.2.smithi057.stdout:923: copy_from oid 18 from oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 114 2020-11-16T22:05:16.303 INFO:tasks.rados.rados.2.smithi057.stdout:924: snap_remove snap 107 2020-11-16T22:05:17.053 INFO:tasks.rados.rados.2.smithi057.stdout:924: done (2 left) 2020-11-16T22:05:17.053 INFO:tasks.rados.rados.2.smithi057.stdout:925: snap_remove snap 105 2020-11-16T22:05:17.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:17 smithi016 bash[10302]: cluster 2020-11-16T22:05:15.636980+0000 mgr.x (mgr.24115) 379 : cluster [DBG] pgmap v598: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 313 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.6 MiB/s wr, 21 op/s 2020-11-16T22:05:17.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:17 smithi016 bash[10302]: cluster 2020-11-16T22:05:16.056712+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e290: 12 total, 12 up, 12 in 2020-11-16T22:05:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:17 smithi195 bash[10218]: cluster 2020-11-16T22:05:15.636980+0000 mgr.x (mgr.24115) 379 : cluster [DBG] pgmap v598: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 313 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.6 MiB/s wr, 21 op/s 2020-11-16T22:05:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:17 smithi195 bash[10218]: cluster 2020-11-16T22:05:16.056712+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e290: 12 total, 12 up, 12 in 2020-11-16T22:05:17.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:17 smithi057 bash[10301]: cluster 2020-11-16T22:05:15.636980+0000 mgr.x (mgr.24115) 379 : cluster [DBG] pgmap v598: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 313 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.6 MiB/s wr, 21 op/s 2020-11-16T22:05:17.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:17 smithi057 bash[10301]: cluster 2020-11-16T22:05:16.056712+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e290: 12 total, 12 up, 12 in 2020-11-16T22:05:18.072 INFO:tasks.rados.rados.2.smithi057.stdout:925: done (2 left) 2020-11-16T22:05:18.073 INFO:tasks.rados.rados.2.smithi057.stdout:926: write (excl) oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 114 2020-11-16T22:05:18.073 INFO:tasks.rados.rados.2.smithi057.stdout:926: seq_num 335 ranges {430345=727947,1570056=727439,2699879=469889} 2020-11-16T22:05:18.084 INFO:tasks.rados.rados.2.smithi057.stdout:926: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 430345 to 1158292 tid 1 2020-11-16T22:05:18.091 INFO:tasks.rados.rados.2.smithi057.stdout:926: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1570056 to 2297495 tid 2 2020-11-16T22:05:18.096 INFO:tasks.rados.rados.2.smithi057.stdout:926: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2699879 to 3169768 tid 3 2020-11-16T22:05:18.097 INFO:tasks.rados.rados.2.smithi057.stdout:927: snap_create 2020-11-16T22:05:18.097 INFO:tasks.rados.rados.2.smithi057.stdout:923: finishing copy_from to smithi05720651-18 2020-11-16T22:05:18.097 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 53 (ObjNum 318 snap 110 seq_num 318) dirty exists 2020-11-16T22:05:18.097 INFO:tasks.rados.rados.2.smithi057.stdout:923: finishing copy_from racing read to smithi05720651-18 2020-11-16T22:05:18.097 INFO:tasks.rados.rados.2.smithi057.stdout:922: finishing copy_from to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:18.097 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 277 (ObjNum 327 snap 111 seq_num 327) dirty exists 2020-11-16T22:05:18.097 INFO:tasks.rados.rados.2.smithi057.stdout:922: finishing copy_from racing read to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:18.098 INFO:tasks.rados.rados.2.smithi057.stdout:926: finishing write tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:18.102 INFO:tasks.rados.rados.2.smithi057.stdout:926: finishing write tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:18.104 INFO:tasks.rados.rados.2.smithi057.stdout:926: finishing write tid 3 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:18.104 INFO:tasks.rados.rados.2.smithi057.stdout:926: finishing write tid 5 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:18.105 INFO:tasks.rados.rados.2.smithi057.stdout:926: finishing write tid 6 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:18.105 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 703 (ObjNum 335 snap 114 seq_num 335) dirty exists 2020-11-16T22:05:18.105 INFO:tasks.rados.rados.2.smithi057.stdout:926: left oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 335 snap 114 seq_num 335) 2020-11-16T22:05:18.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:18 smithi016 bash[10302]: cluster 2020-11-16T22:05:17.059863+0000 mon.a (mon.0) 938 : cluster [DBG] osdmap e291: 12 total, 12 up, 12 in 2020-11-16T22:05:18.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:18 smithi195 bash[10218]: cluster 2020-11-16T22:05:17.059863+0000 mon.a (mon.0) 938 : cluster [DBG] osdmap e291: 12 total, 12 up, 12 in 2020-11-16T22:05:18.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:18 smithi057 bash[10301]: cluster 2020-11-16T22:05:17.059863+0000 mon.a (mon.0) 938 : cluster [DBG] osdmap e291: 12 total, 12 up, 12 in 2020-11-16T22:05:19.077 INFO:tasks.rados.rados.2.smithi057.stdout:922: done (3 left) 2020-11-16T22:05:19.077 INFO:tasks.rados.rados.2.smithi057.stdout:923: done (2 left) 2020-11-16T22:05:19.077 INFO:tasks.rados.rados.2.smithi057.stdout:926: done (1 left) 2020-11-16T22:05:19.077 INFO:tasks.rados.rados.2.smithi057.stdout:927: done (0 left) 2020-11-16T22:05:19.077 INFO:tasks.rados.rados.2.smithi057.stdout:928: write oid 46 current snap is 115 2020-11-16T22:05:19.078 INFO:tasks.rados.rados.2.smithi057.stdout:928: seq_num 336 ranges {447152=403196,1512185=587450,2727302=681161} 2020-11-16T22:05:19.090 INFO:tasks.rados.rados.2.smithi057.stdout:928: writing smithi05720651-46 from 447152 to 850348 tid 1 2020-11-16T22:05:19.099 INFO:tasks.rados.rados.2.smithi057.stdout:928: writing smithi05720651-46 from 1512185 to 2099635 tid 2 2020-11-16T22:05:19.108 INFO:tasks.rados.rados.2.smithi057.stdout:928: writing smithi05720651-46 from 2727302 to 3408463 tid 3 2020-11-16T22:05:19.108 INFO:tasks.rados.rados.2.smithi057.stdout:929: rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 115 2020-11-16T22:05:19.108 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 72 2020-11-16T22:05:19.108 INFO:tasks.rados.rados.2.smithi057.stdout:928: finishing write tid 1 to smithi05720651-46 2020-11-16T22:05:19.108 INFO:tasks.rados.rados.2.smithi057.stdout:928: finishing write tid 2 to smithi05720651-46 2020-11-16T22:05:19.108 INFO:tasks.rados.rados.2.smithi057.stdout:930: rollback oid 28 current snap is 115 2020-11-16T22:05:19.109 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 28 to 113 2020-11-16T22:05:19.109 INFO:tasks.rados.rados.2.smithi057.stdout:931: read oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:19.109 INFO:tasks.rados.rados.2.smithi057.stdout:931: expect (ObjNum 318 snap 110 seq_num 318) 2020-11-16T22:05:19.109 INFO:tasks.rados.rados.2.smithi057.stdout:932: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:19.109 INFO:tasks.rados.rados.2.smithi057.stdout:932: expect deleted 2020-11-16T22:05:19.109 INFO:tasks.rados.rados.2.smithi057.stdout:933: delete oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 115 2020-11-16T22:05:19.114 INFO:tasks.rados.rados.2.smithi057.stdout:928: finishing write tid 3 to smithi05720651-46 2020-11-16T22:05:19.115 INFO:tasks.rados.rados.2.smithi057.stdout:928: finishing write tid 5 to smithi05720651-46 2020-11-16T22:05:19.115 INFO:tasks.rados.rados.2.smithi057.stdout:928: finishing write tid 6 to smithi05720651-46 2020-11-16T22:05:19.116 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 716 (ObjNum 336 snap 115 seq_num 336) dirty exists 2020-11-16T22:05:19.116 INFO:tasks.rados.rados.2.smithi057.stdout:928: left oid 46 (ObjNum 336 snap 115 seq_num 336) 2020-11-16T22:05:19.117 INFO:tasks.rados.rados.2.smithi057.stdout:928: done (5 left) 2020-11-16T22:05:19.117 INFO:tasks.rados.rados.2.smithi057.stdout:932: done (4 left) 2020-11-16T22:05:19.118 INFO:tasks.rados.rados.2.smithi057.stdout:933: done (3 left) 2020-11-16T22:05:19.118 INFO:tasks.rados.rados.2.smithi057.stdout:934: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:19.118 INFO:tasks.rados.rados.2.smithi057.stdout:934: expect deleted 2020-11-16T22:05:19.118 INFO:tasks.rados.rados.2.smithi057.stdout:935: delete oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 115 2020-11-16T22:05:19.121 INFO:tasks.rados.rados.2.smithi057.stdout:930: finishing rollback tid 0 to smithi05720651-28 2020-11-16T22:05:19.121 INFO:tasks.rados.rados.2.smithi057.stdout:930: finishing rollback tid 1 to smithi05720651-28 2020-11-16T22:05:19.121 INFO:tasks.rados.rados.2.smithi057.stdout:930: finishing rollback tid 2 to smithi05720651-28 2020-11-16T22:05:19.122 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 548 (ObjNum 324 snap 111 seq_num 324) dirty exists 2020-11-16T22:05:19.122 INFO:tasks.rados.rados.2.smithi057.stdout:929: finishing rollback tid 0 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:19.122 INFO:tasks.rados.rados.2.smithi057.stdout:929: finishing rollback tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:19.122 INFO:tasks.rados.rados.2.smithi057.stdout:929: finishing rollback tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:19.122 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 716 (ObjNum 125 snap 36 seq_num 125) dirty exists 2020-11-16T22:05:19.123 INFO:tasks.rados.rados.2.smithi057.stdout:929: done (4 left) 2020-11-16T22:05:19.123 INFO:tasks.rados.rados.2.smithi057.stdout:930: done (3 left) 2020-11-16T22:05:19.123 INFO:tasks.rados.rados.2.smithi057.stdout:934: done (2 left) 2020-11-16T22:05:19.124 INFO:tasks.rados.rados.2.smithi057.stdout:935: done (1 left) 2020-11-16T22:05:19.124 INFO:tasks.rados.rados.2.smithi057.stdout:936: rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 115 2020-11-16T22:05:19.124 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 87 2020-11-16T22:05:19.124 INFO:tasks.rados.rados.2.smithi057.stdout:937: read oid 10 snap 101 2020-11-16T22:05:19.124 INFO:tasks.rados.rados.2.smithi057.stdout:937: expect deleted 2020-11-16T22:05:19.124 INFO:tasks.rados.rados.2.smithi057.stdout:938: read oid 46 snap 91 2020-11-16T22:05:19.124 INFO:tasks.rados.rados.2.smithi057.stdout:938: expect (ObjNum 199 snap 67 seq_num 199) 2020-11-16T22:05:19.125 INFO:tasks.rados.rados.2.smithi057.stdout:939: write (excl) oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 115 2020-11-16T22:05:19.125 INFO:tasks.rados.rados.2.smithi057.stdout:939: seq_num 339 ranges {497573=628943,1687631=734777,3093218=604355} 2020-11-16T22:05:19.130 INFO:tasks.rados.rados.2.smithi057.stdout:939: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 497573 to 1126516 tid 1 2020-11-16T22:05:19.139 INFO:tasks.rados.rados.2.smithi057.stdout:939: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1687631 to 2422408 tid 2 2020-11-16T22:05:19.147 INFO:tasks.rados.rados.2.smithi057.stdout:939: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3093218 to 3697573 tid 3 2020-11-16T22:05:19.147 INFO:tasks.rados.rados.2.smithi057.stdout:940: rollback oid 34 current snap is 115 2020-11-16T22:05:19.147 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 34 to 114 2020-11-16T22:05:19.147 INFO:tasks.rados.rados.2.smithi057.stdout:931: expect (ObjNum 318 snap 110 seq_num 318) 2020-11-16T22:05:19.253 INFO:tasks.rados.rados.2.smithi057.stdout:931: done (5 left) 2020-11-16T22:05:19.253 INFO:tasks.rados.rados.2.smithi057.stdout:941: write (excl) oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 115 2020-11-16T22:05:19.254 INFO:tasks.rados.rados.2.smithi057.stdout:941: seq_num 340 ranges {514380=704192,1629760=478435,2604288=442602} 2020-11-16T22:05:19.260 INFO:tasks.rados.rados.2.smithi057.stdout:941: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 514380 to 1218572 tid 1 2020-11-16T22:05:19.265 INFO:tasks.rados.rados.2.smithi057.stdout:941: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1629760 to 2108195 tid 2 2020-11-16T22:05:19.270 INFO:tasks.rados.rados.2.smithi057.stdout:941: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2604288 to 3046890 tid 3 2020-11-16T22:05:19.271 INFO:tasks.rados.rados.2.smithi057.stdout:942: copy_from oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 115 2020-11-16T22:05:19.271 INFO:tasks.rados.rados.2.smithi057.stdout:936: finishing rollback tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:19.271 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 197 (ObjNum 65 snap 0 seq_num 2930942240) dirty dne 2020-11-16T22:05:19.271 INFO:tasks.rados.rados.2.smithi057.stdout:938: expect (ObjNum 199 snap 67 seq_num 199) 2020-11-16T22:05:19.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:19 smithi016 bash[10302]: cluster 2020-11-16T22:05:17.637656+0000 mgr.x (mgr.24115) 380 : cluster [DBG] pgmap v601: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 322 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 5.0 MiB/s wr, 27 op/s 2020-11-16T22:05:19.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:19 smithi016 bash[10302]: cluster 2020-11-16T22:05:18.084441+0000 mon.a (mon.0) 939 : cluster [DBG] osdmap e292: 12 total, 12 up, 12 in 2020-11-16T22:05:19.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:19 smithi195 bash[10218]: cluster 2020-11-16T22:05:17.637656+0000 mgr.x (mgr.24115) 380 : cluster [DBG] pgmap v601: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 322 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 5.0 MiB/s wr, 27 op/s 2020-11-16T22:05:19.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:19 smithi195 bash[10218]: cluster 2020-11-16T22:05:18.084441+0000 mon.a (mon.0) 939 : cluster [DBG] osdmap e292: 12 total, 12 up, 12 in 2020-11-16T22:05:19.412 INFO:tasks.rados.rados.2.smithi057.stdout:939: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:19.413 INFO:tasks.rados.rados.2.smithi057.stdout:940: finishing rollback tid 0 to smithi05720651-34 2020-11-16T22:05:19.413 INFO:tasks.rados.rados.2.smithi057.stdout:939: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:19.413 INFO:tasks.rados.rados.2.smithi057.stdout:939: finishing write tid 3 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:19.413 INFO:tasks.rados.rados.2.smithi057.stdout:940: finishing rollback tid 1 to smithi05720651-34 2020-11-16T22:05:19.413 INFO:tasks.rados.rados.2.smithi057.stdout:940: finishing rollback tid 2 to smithi05720651-34 2020-11-16T22:05:19.414 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 284 (ObjNum 330 snap 114 seq_num 330) dirty exists 2020-11-16T22:05:19.414 INFO:tasks.rados.rados.2.smithi057.stdout:939: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:19.414 INFO:tasks.rados.rados.2.smithi057.stdout:936: done (6 left) 2020-11-16T22:05:19.414 INFO:tasks.rados.rados.2.smithi057.stdout:937: done (5 left) 2020-11-16T22:05:19.414 INFO:tasks.rados.rados.2.smithi057.stdout:938: done (4 left) 2020-11-16T22:05:19.414 INFO:tasks.rados.rados.2.smithi057.stdout:940: done (3 left) 2020-11-16T22:05:19.414 INFO:tasks.rados.rados.2.smithi057.stdout:943: snap_create 2020-11-16T22:05:19.415 INFO:tasks.rados.rados.2.smithi057.stdout:941: finishing write tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:19.415 INFO:tasks.rados.rados.2.smithi057.stdout:941: finishing write tid 2 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:19.415 INFO:tasks.rados.rados.2.smithi057.stdout:941: finishing write tid 3 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:19.415 INFO:tasks.rados.rados.2.smithi057.stdout:941: finishing write tid 5 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:19.415 INFO:tasks.rados.rados.2.smithi057.stdout:941: finishing write tid 6 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:19.415 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 643 (ObjNum 340 snap 115 seq_num 340) dirty exists 2020-11-16T22:05:19.415 INFO:tasks.rados.rados.2.smithi057.stdout:941: left oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 340 snap 115 seq_num 340) 2020-11-16T22:05:19.416 INFO:tasks.rados.rados.2.smithi057.stdout:942: finishing copy_from to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:19.416 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 155 (ObjNum 280 snap 94 seq_num 280) dirty exists 2020-11-16T22:05:19.416 INFO:tasks.rados.rados.2.smithi057.stdout:942: finishing copy_from racing read to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:19.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:19 smithi057 bash[10301]: cluster 2020-11-16T22:05:17.637656+0000 mgr.x (mgr.24115) 380 : cluster [DBG] pgmap v601: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 322 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 5.0 MiB/s wr, 27 op/s 2020-11-16T22:05:19.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:19 smithi057 bash[10301]: cluster 2020-11-16T22:05:18.084441+0000 mon.a (mon.0) 939 : cluster [DBG] osdmap e292: 12 total, 12 up, 12 in 2020-11-16T22:05:19.925 INFO:tasks.rados.rados.2.smithi057.stdout:941: done (3 left) 2020-11-16T22:05:19.926 INFO:tasks.rados.rados.2.smithi057.stdout:942: done (2 left) 2020-11-16T22:05:19.926 INFO:tasks.rados.rados.2.smithi057.stdout:943: done (1 left) 2020-11-16T22:05:19.926 INFO:tasks.rados.rados.2.smithi057.stdout:944: delete oid 32 current snap is 116 2020-11-16T22:05:19.932 INFO:tasks.rados.rados.2.smithi057.stdout:939: finishing write tid 6 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:19.933 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 552 (ObjNum 339 snap 115 seq_num 339) dirty exists 2020-11-16T22:05:19.933 INFO:tasks.rados.rados.2.smithi057.stdout:939: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 339 snap 115 seq_num 339) 2020-11-16T22:05:19.936 INFO:tasks.rados.rados.2.smithi057.stdout:939: done (1 left) 2020-11-16T22:05:19.936 INFO:tasks.rados.rados.2.smithi057.stdout:944: done (0 left) 2020-11-16T22:05:19.936 INFO:tasks.rados.rados.2.smithi057.stdout:945: read oid 26 snap -1 2020-11-16T22:05:19.937 INFO:tasks.rados.rados.2.smithi057.stdout:945: expect (ObjNum 278 snap 94 seq_num 278) 2020-11-16T22:05:19.937 INFO:tasks.rados.rados.2.smithi057.stdout:946: snap_remove snap 88 2020-11-16T22:05:20.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:20 smithi195 bash[10218]: cluster 2020-11-16T22:05:19.086318+0000 mon.a (mon.0) 940 : cluster [DBG] osdmap e293: 12 total, 12 up, 12 in 2020-11-16T22:05:20.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:20 smithi195 bash[10218]: cluster 2020-11-16T22:05:19.935281+0000 mon.a (mon.0) 941 : cluster [DBG] osdmap e294: 12 total, 12 up, 12 in 2020-11-16T22:05:20.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:20 smithi057 bash[10301]: cluster 2020-11-16T22:05:19.086318+0000 mon.a (mon.0) 940 : cluster [DBG] osdmap e293: 12 total, 12 up, 12 in 2020-11-16T22:05:20.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:20 smithi057 bash[10301]: cluster 2020-11-16T22:05:19.935281+0000 mon.a (mon.0) 941 : cluster [DBG] osdmap e294: 12 total, 12 up, 12 in 2020-11-16T22:05:20.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:20 smithi016 bash[10302]: cluster 2020-11-16T22:05:19.086318+0000 mon.a (mon.0) 940 : cluster [DBG] osdmap e293: 12 total, 12 up, 12 in 2020-11-16T22:05:20.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:20 smithi016 bash[10302]: cluster 2020-11-16T22:05:19.935281+0000 mon.a (mon.0) 941 : cluster [DBG] osdmap e294: 12 total, 12 up, 12 in 2020-11-16T22:05:20.944 INFO:tasks.rados.rados.2.smithi057.stdout:946: done (1 left) 2020-11-16T22:05:20.945 INFO:tasks.rados.rados.2.smithi057.stdout:947: write (excl) oid 44 current snap is 116 2020-11-16T22:05:20.945 INFO:tasks.rados.rados.2.smithi057.stdout:947: seq_num 342 ranges {547994=454690,1746724=482104,2659134=465146,3605976=142018} 2020-11-16T22:05:20.948 INFO:tasks.rados.rados.2.smithi057.stdout:947: writing smithi05720651-44 from 547994 to 1002684 tid 1 2020-11-16T22:05:20.955 INFO:tasks.rados.rados.2.smithi057.stdout:947: writing smithi05720651-44 from 1746724 to 2228828 tid 2 2020-11-16T22:05:20.960 INFO:tasks.rados.rados.2.smithi057.stdout:947: writing smithi05720651-44 from 2659134 to 3124280 tid 3 2020-11-16T22:05:20.964 INFO:tasks.rados.rados.2.smithi057.stdout:947: writing smithi05720651-44 from 3605976 to 3747994 tid 4 2020-11-16T22:05:20.964 INFO:tasks.rados.rados.2.smithi057.stdout:948: read oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:20.965 INFO:tasks.rados.rados.2.smithi057.stdout:948: expect deleted 2020-11-16T22:05:20.965 INFO:tasks.rados.rados.2.smithi057.stdout:949: snap_create 2020-11-16T22:05:20.965 INFO:tasks.rados.rados.2.smithi057.stdout:945: expect (ObjNum 278 snap 94 seq_num 278) 2020-11-16T22:05:21.173 INFO:tasks.rados.rados.2.smithi057.stdout:947: finishing write tid 1 to smithi05720651-44 2020-11-16T22:05:21.173 INFO:tasks.rados.rados.2.smithi057.stdout:947: finishing write tid 2 to smithi05720651-44 2020-11-16T22:05:21.173 INFO:tasks.rados.rados.2.smithi057.stdout:947: finishing write tid 3 to smithi05720651-44 2020-11-16T22:05:21.173 INFO:tasks.rados.rados.2.smithi057.stdout:947: finishing write tid 4 to smithi05720651-44 2020-11-16T22:05:21.174 INFO:tasks.rados.rados.2.smithi057.stdout:947: finishing write tid 6 to smithi05720651-44 2020-11-16T22:05:21.174 INFO:tasks.rados.rados.2.smithi057.stdout:947: finishing write tid 7 to smithi05720651-44 2020-11-16T22:05:21.174 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 835 (ObjNum 342 snap 116 seq_num 342) dirty exists 2020-11-16T22:05:21.174 INFO:tasks.rados.rados.2.smithi057.stdout:947: left oid 44 (ObjNum 342 snap 116 seq_num 342) 2020-11-16T22:05:21.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:21 smithi195 bash[10218]: cluster 2020-11-16T22:05:19.638310+0000 mgr.x (mgr.24115) 381 : cluster [DBG] pgmap v604: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 322 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2020-11-16T22:05:21.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:21 smithi195 bash[10218]: cluster 2020-11-16T22:05:20.946051+0000 mon.a (mon.0) 942 : cluster [DBG] osdmap e295: 12 total, 12 up, 12 in 2020-11-16T22:05:21.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:21 smithi057 bash[10301]: cluster 2020-11-16T22:05:19.638310+0000 mgr.x (mgr.24115) 381 : cluster [DBG] pgmap v604: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 322 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2020-11-16T22:05:21.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:21 smithi057 bash[10301]: cluster 2020-11-16T22:05:20.946051+0000 mon.a (mon.0) 942 : cluster [DBG] osdmap e295: 12 total, 12 up, 12 in 2020-11-16T22:05:21.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:21 smithi016 bash[10302]: cluster 2020-11-16T22:05:19.638310+0000 mgr.x (mgr.24115) 381 : cluster [DBG] pgmap v604: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 322 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2020-11-16T22:05:21.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:21 smithi016 bash[10302]: cluster 2020-11-16T22:05:20.946051+0000 mon.a (mon.0) 942 : cluster [DBG] osdmap e295: 12 total, 12 up, 12 in 2020-11-16T22:05:21.940 INFO:tasks.rados.rados.2.smithi057.stdout:945: done (3 left) 2020-11-16T22:05:21.941 INFO:tasks.rados.rados.2.smithi057.stdout:947: done (2 left) 2020-11-16T22:05:21.941 INFO:tasks.rados.rados.2.smithi057.stdout:948: done (1 left) 2020-11-16T22:05:21.941 INFO:tasks.rados.rados.2.smithi057.stdout:949: done (0 left) 2020-11-16T22:05:21.941 INFO:tasks.rados.rados.2.smithi057.stdout:950: rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 117 2020-11-16T22:05:21.941 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 110 2020-11-16T22:05:21.941 INFO:tasks.rados.rados.2.smithi057.stdout:951: snap_remove snap 72 2020-11-16T22:05:22.949 INFO:tasks.rados.rados.2.smithi057.stdout:951: done (1 left) 2020-11-16T22:05:22.950 INFO:tasks.rados.rados.2.smithi057.stdout:952: write oid 50 current snap is 117 2020-11-16T22:05:22.950 INFO:tasks.rados.rados.2.smithi057.stdout:952: seq_num 343 ranges {564801=646292,1921559=742115,3202910=561891} 2020-11-16T22:05:22.963 INFO:tasks.rados.rados.2.smithi057.stdout:952: writing smithi05720651-50 from 564801 to 1211093 tid 1 2020-11-16T22:05:22.972 INFO:tasks.rados.rados.2.smithi057.stdout:952: writing smithi05720651-50 from 1921559 to 2663674 tid 2 2020-11-16T22:05:22.978 INFO:tasks.rados.rados.2.smithi057.stdout:952: writing smithi05720651-50 from 3202910 to 3764801 tid 3 2020-11-16T22:05:22.978 INFO:tasks.rados.rados.2.smithi057.stdout:953: snap_remove snap 113 2020-11-16T22:05:23.196 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:05:23 smithi057 bash[12595]: debug 2020-11-16T22:05:23.160+0000 7f737919c700 -1 osd.8 pg_epoch: 297 pg[2.5( v 297'534 (0'0,297'534] local-lis/les=71/72 n=15 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,0] r=0 lpr=71 crt=297'534 lcod 297'532 mlcod 297'532 active+clean+snaptrim trimq=[87~1] ps=[ab~1,ca~3,d3~1]] removing snap head 2020-11-16T22:05:23.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:22 smithi057 bash[10301]: cluster 2020-11-16T22:05:21.639038+0000 mgr.x (mgr.24115) 382 : cluster [DBG] pgmap v607: 17 pgs: 17 active+clean; 342 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 4.0 MiB/s wr, 16 op/s 2020-11-16T22:05:23.197 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:22 smithi057 bash[10301]: cluster 2020-11-16T22:05:21.948640+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e296: 12 total, 12 up, 12 in 2020-11-16T22:05:23.197 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:05:23 smithi057 bash[19569]: debug 2020-11-16T22:05:23.156+0000 7f5e0d10d700 -1 osd.11 pg_epoch: 297 pg[2.c( v 297'214 (0'0,297'214] local-lis/les=71/72 n=4 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [11,0] r=0 lpr=71 luod=295'212 crt=297'214 lcod 293'210 mlcod 293'210 active+clean+snaptrim trimq=[87~1] ps=[ab~1,ca~3,d3~1]] removing snap head 2020-11-16T22:05:23.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:22 smithi016 bash[10302]: cluster 2020-11-16T22:05:21.639038+0000 mgr.x (mgr.24115) 382 : cluster [DBG] pgmap v607: 17 pgs: 17 active+clean; 342 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 4.0 MiB/s wr, 16 op/s 2020-11-16T22:05:23.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:22 smithi016 bash[10302]: cluster 2020-11-16T22:05:21.948640+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e296: 12 total, 12 up, 12 in 2020-11-16T22:05:23.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:22 smithi195 bash[10218]: cluster 2020-11-16T22:05:21.639038+0000 mgr.x (mgr.24115) 382 : cluster [DBG] pgmap v607: 17 pgs: 17 active+clean; 342 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 4.0 MiB/s wr, 16 op/s 2020-11-16T22:05:23.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:22 smithi195 bash[10218]: cluster 2020-11-16T22:05:21.948640+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e296: 12 total, 12 up, 12 in 2020-11-16T22:05:23.961 INFO:tasks.rados.rados.2.smithi057.stdout:953: done (2 left) 2020-11-16T22:05:23.962 INFO:tasks.rados.rados.2.smithi057.stdout:954: read oid 16 snap -1 2020-11-16T22:05:23.962 INFO:tasks.rados.rados.2.smithi057.stdout:954: expect (ObjNum 321 snap 111 seq_num 321) 2020-11-16T22:05:23.962 INFO:tasks.rados.rados.2.smithi057.stdout:955: write oid 24 current snap is 117 2020-11-16T22:05:23.963 INFO:tasks.rados.rados.2.smithi057.stdout:955: seq_num 344 ranges {581608=721541,1863688=485773,3113980=604043} 2020-11-16T22:05:23.972 INFO:tasks.rados.rados.2.smithi057.stdout:955: writing smithi05720651-24 from 581608 to 1303149 tid 1 2020-11-16T22:05:23.979 INFO:tasks.rados.rados.2.smithi057.stdout:955: writing smithi05720651-24 from 1863688 to 2349461 tid 2 2020-11-16T22:05:23.987 INFO:tasks.rados.rados.2.smithi057.stdout:955: writing smithi05720651-24 from 3113980 to 3718023 tid 3 2020-11-16T22:05:23.988 INFO:tasks.rados.rados.2.smithi057.stdout:956: delete oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 117 2020-11-16T22:05:23.988 INFO:tasks.rados.rados.2.smithi057.stdout:950: finishing rollback tid 0 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:23.988 INFO:tasks.rados.rados.2.smithi057.stdout:950: finishing rollback tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:23.988 INFO:tasks.rados.rados.2.smithi057.stdout:950: finishing rollback tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:23.988 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 732 (ObjNum 282 snap 95 seq_num 282) dirty exists 2020-11-16T22:05:23.988 INFO:tasks.rados.rados.2.smithi057.stdout:952: finishing write tid 1 to smithi05720651-50 2020-11-16T22:05:23.988 INFO:tasks.rados.rados.2.smithi057.stdout:952: finishing write tid 2 to smithi05720651-50 2020-11-16T22:05:23.989 INFO:tasks.rados.rados.2.smithi057.stdout:952: finishing write tid 3 to smithi05720651-50 2020-11-16T22:05:23.989 INFO:tasks.rados.rados.2.smithi057.stdout:952: finishing write tid 5 to smithi05720651-50 2020-11-16T22:05:23.989 INFO:tasks.rados.rados.2.smithi057.stdout:952: finishing write tid 6 to smithi05720651-50 2020-11-16T22:05:23.989 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 731 (ObjNum 343 snap 117 seq_num 343) dirty exists 2020-11-16T22:05:23.989 INFO:tasks.rados.rados.2.smithi057.stdout:952: left oid 50 (ObjNum 343 snap 117 seq_num 343) 2020-11-16T22:05:23.989 INFO:tasks.rados.rados.2.smithi057.stdout:955: finishing write tid 1 to smithi05720651-24 2020-11-16T22:05:23.989 INFO:tasks.rados.rados.2.smithi057.stdout:954: expect (ObjNum 321 snap 111 seq_num 321) 2020-11-16T22:05:24.240 INFO:tasks.rados.rados.2.smithi057.stdout:955: finishing write tid 2 to smithi05720651-24 2020-11-16T22:05:24.240 INFO:tasks.rados.rados.2.smithi057.stdout:955: finishing write tid 3 to smithi05720651-24 2020-11-16T22:05:24.240 INFO:tasks.rados.rados.2.smithi057.stdout:955: finishing write tid 5 to smithi05720651-24 2020-11-16T22:05:24.241 INFO:tasks.rados.rados.2.smithi057.stdout:955: finishing write tid 6 to smithi05720651-24 2020-11-16T22:05:24.241 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 642 (ObjNum 344 snap 117 seq_num 344) dirty exists 2020-11-16T22:05:24.241 INFO:tasks.rados.rados.2.smithi057.stdout:955: left oid 24 (ObjNum 344 snap 117 seq_num 344) 2020-11-16T22:05:24.241 INFO:tasks.rados.rados.2.smithi057.stdout:950: done (4 left) 2020-11-16T22:05:24.241 INFO:tasks.rados.rados.2.smithi057.stdout:952: done (3 left) 2020-11-16T22:05:24.241 INFO:tasks.rados.rados.2.smithi057.stdout:954: done (2 left) 2020-11-16T22:05:24.241 INFO:tasks.rados.rados.2.smithi057.stdout:955: done (1 left) 2020-11-16T22:05:24.242 INFO:tasks.rados.rados.2.smithi057.stdout:956: done (0 left) 2020-11-16T22:05:24.242 INFO:tasks.rados.rados.2.smithi057.stdout:957: read oid 48 snap -1 2020-11-16T22:05:24.242 INFO:tasks.rados.rados.2.smithi057.stdout:957: expect (ObjNum 144 snap 44 seq_num 144) 2020-11-16T22:05:24.242 INFO:tasks.rados.rados.2.smithi057.stdout:958: read oid 12 snap -1 2020-11-16T22:05:24.242 INFO:tasks.rados.rados.2.smithi057.stdout:958: expect (ObjNum 329 snap 113 seq_num 329) 2020-11-16T22:05:24.242 INFO:tasks.rados.rados.2.smithi057.stdout:959: snap_remove snap 97 2020-11-16T22:05:24.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:23 smithi016 bash[10302]: cluster 2020-11-16T22:05:22.958163+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e297: 12 total, 12 up, 12 in 2020-11-16T22:05:24.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:23 smithi195 bash[10218]: cluster 2020-11-16T22:05:22.958163+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e297: 12 total, 12 up, 12 in 2020-11-16T22:05:24.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:23 smithi057 bash[10301]: cluster 2020-11-16T22:05:22.958163+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e297: 12 total, 12 up, 12 in 2020-11-16T22:05:24.931 INFO:tasks.rados.rados.2.smithi057.stdout:959: done (2 left) 2020-11-16T22:05:24.931 INFO:tasks.rados.rados.2.smithi057.stdout:960: copy_from oid 6 from oid 4 current snap is 117 2020-11-16T22:05:24.931 INFO:tasks.rados.rados.2.smithi057.stdout:957: expect (ObjNum 144 snap 44 seq_num 144) 2020-11-16T22:05:25.079 INFO:tasks.rados.rados.2.smithi057.stdout:958: expect (ObjNum 329 snap 113 seq_num 329) 2020-11-16T22:05:25.278 INFO:tasks.rados.rados.2.smithi057.stdout:957: done (2 left) 2020-11-16T22:05:25.279 INFO:tasks.rados.rados.2.smithi057.stdout:958: done (1 left) 2020-11-16T22:05:25.279 INFO:tasks.rados.rados.2.smithi057.stdout:961: copy_from oid 44 from oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 117 2020-11-16T22:05:25.279 INFO:tasks.rados.rados.2.smithi057.stdout:960: finishing copy_from to smithi05720651-6 2020-11-16T22:05:25.279 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 273 (ObjNum 242 snap 81 seq_num 242) dirty exists 2020-11-16T22:05:25.279 INFO:tasks.rados.rados.2.smithi057.stdout:960: finishing copy_from racing read to smithi05720651-6 2020-11-16T22:05:25.280 INFO:tasks.rados.rados.2.smithi057.stdout:960: done (1 left) 2020-11-16T22:05:25.280 INFO:tasks.rados.rados.2.smithi057.stdout:962: read oid 30 snap -1 2020-11-16T22:05:25.280 INFO:tasks.rados.rados.2.smithi057.stdout:962: expect deleted 2020-11-16T22:05:25.280 INFO:tasks.rados.rados.2.smithi057.stdout:963: read oid 16 snap -1 2020-11-16T22:05:25.280 INFO:tasks.rados.rados.2.smithi057.stdout:963: expect (ObjNum 321 snap 111 seq_num 321) 2020-11-16T22:05:25.280 INFO:tasks.rados.rados.2.smithi057.stdout:964: read oid 4 snap 110 2020-11-16T22:05:25.280 INFO:tasks.rados.rados.2.smithi057.stdout:964: expect (ObjNum 242 snap 81 seq_num 242) 2020-11-16T22:05:25.281 INFO:tasks.rados.rados.2.smithi057.stdout:965: write oid 32 current snap is 117 2020-11-16T22:05:25.281 INFO:tasks.rados.rados.2.smithi057.stdout:965: seq_num 346 ranges {615222=472039,1580652=489442,2768826=626587} 2020-11-16T22:05:25.284 INFO:tasks.rados.rados.2.smithi057.stdout:965: writing smithi05720651-32 from 615222 to 1087261 tid 1 2020-11-16T22:05:25.291 INFO:tasks.rados.rados.2.smithi057.stdout:965: writing smithi05720651-32 from 1580652 to 2070094 tid 2 2020-11-16T22:05:25.299 INFO:tasks.rados.rados.2.smithi057.stdout:965: writing smithi05720651-32 from 2768826 to 3395413 tid 3 2020-11-16T22:05:25.299 INFO:tasks.rados.rados.2.smithi057.stdout:966: read oid 8 snap -1 2020-11-16T22:05:25.299 INFO:tasks.rados.rados.2.smithi057.stdout:966: expect (ObjNum 206 snap 70 seq_num 206) 2020-11-16T22:05:25.299 INFO:tasks.rados.rados.2.smithi057.stdout:967: delete oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 117 2020-11-16T22:05:25.300 INFO:tasks.rados.rados.2.smithi057.stdout:964: expect (ObjNum 242 snap 81 seq_num 242) 2020-11-16T22:05:25.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:24 smithi016 bash[10302]: cluster 2020-11-16T22:05:23.639738+0000 mgr.x (mgr.24115) 383 : cluster [DBG] pgmap v610: 17 pgs: 17 active+clean; 342 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 4.0 MiB/s wr, 17 op/s 2020-11-16T22:05:25.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:24 smithi016 bash[10302]: cluster 2020-11-16T22:05:23.969584+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e298: 12 total, 12 up, 12 in 2020-11-16T22:05:25.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:24 smithi016 bash[10302]: cluster 2020-11-16T22:05:24.937799+0000 mon.a (mon.0) 946 : cluster [DBG] osdmap e299: 12 total, 12 up, 12 in 2020-11-16T22:05:25.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:24 smithi195 bash[10218]: cluster 2020-11-16T22:05:23.639738+0000 mgr.x (mgr.24115) 383 : cluster [DBG] pgmap v610: 17 pgs: 17 active+clean; 342 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 4.0 MiB/s wr, 17 op/s 2020-11-16T22:05:25.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:24 smithi195 bash[10218]: cluster 2020-11-16T22:05:23.969584+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e298: 12 total, 12 up, 12 in 2020-11-16T22:05:25.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:24 smithi195 bash[10218]: cluster 2020-11-16T22:05:24.937799+0000 mon.a (mon.0) 946 : cluster [DBG] osdmap e299: 12 total, 12 up, 12 in 2020-11-16T22:05:25.379 INFO:tasks.rados.rados.2.smithi057.stdout:963: expect (ObjNum 321 snap 111 seq_num 321) 2020-11-16T22:05:25.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:24 smithi057 bash[10301]: cluster 2020-11-16T22:05:23.639738+0000 mgr.x (mgr.24115) 383 : cluster [DBG] pgmap v610: 17 pgs: 17 active+clean; 342 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 4.0 MiB/s wr, 17 op/s 2020-11-16T22:05:25.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:24 smithi057 bash[10301]: cluster 2020-11-16T22:05:23.969584+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e298: 12 total, 12 up, 12 in 2020-11-16T22:05:25.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:24 smithi057 bash[10301]: cluster 2020-11-16T22:05:24.937799+0000 mon.a (mon.0) 946 : cluster [DBG] osdmap e299: 12 total, 12 up, 12 in 2020-11-16T22:05:25.619 INFO:tasks.rados.rados.2.smithi057.stdout:965: finishing write tid 1 to smithi05720651-32 2020-11-16T22:05:25.620 INFO:tasks.rados.rados.2.smithi057.stdout:961: finishing copy_from to smithi05720651-44 2020-11-16T22:05:25.620 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 430 (ObjNum 290 snap 99 seq_num 290) dirty exists 2020-11-16T22:05:25.620 INFO:tasks.rados.rados.2.smithi057.stdout:961: finishing copy_from racing read to smithi05720651-44 2020-11-16T22:05:25.620 INFO:tasks.rados.rados.2.smithi057.stdout:965: finishing write tid 2 to smithi05720651-32 2020-11-16T22:05:25.620 INFO:tasks.rados.rados.2.smithi057.stdout:965: finishing write tid 3 to smithi05720651-32 2020-11-16T22:05:25.621 INFO:tasks.rados.rados.2.smithi057.stdout:965: finishing write tid 5 to smithi05720651-32 2020-11-16T22:05:25.621 INFO:tasks.rados.rados.2.smithi057.stdout:961: done (6 left) 2020-11-16T22:05:25.621 INFO:tasks.rados.rados.2.smithi057.stdout:962: done (5 left) 2020-11-16T22:05:25.621 INFO:tasks.rados.rados.2.smithi057.stdout:963: done (4 left) 2020-11-16T22:05:25.621 INFO:tasks.rados.rados.2.smithi057.stdout:964: done (3 left) 2020-11-16T22:05:25.621 INFO:tasks.rados.rados.2.smithi057.stdout:967: done (2 left) 2020-11-16T22:05:25.621 INFO:tasks.rados.rados.2.smithi057.stdout:968: write oid 22 current snap is 117 2020-11-16T22:05:25.621 INFO:tasks.rados.rados.2.smithi057.stdout:968: seq_num 348 ranges {648836=622537,1981263=493111,3107319=741517} 2020-11-16T22:05:25.626 INFO:tasks.rados.rados.2.smithi057.stdout:968: writing smithi05720651-22 from 648836 to 1271373 tid 1 2020-11-16T22:05:25.634 INFO:tasks.rados.rados.2.smithi057.stdout:968: writing smithi05720651-22 from 1981263 to 2474374 tid 2 2020-11-16T22:05:25.642 INFO:tasks.rados.rados.2.smithi057.stdout:968: writing smithi05720651-22 from 3107319 to 3848836 tid 3 2020-11-16T22:05:25.642 INFO:tasks.rados.rados.2.smithi057.stdout:969: write oid 24 current snap is 117 2020-11-16T22:05:25.643 INFO:tasks.rados.rados.2.smithi057.stdout:969: seq_num 349 ranges {665643=697786,2039745=753122,3534742=330901} 2020-11-16T22:05:25.650 INFO:tasks.rados.rados.2.smithi057.stdout:969: writing smithi05720651-24 from 665643 to 1363429 tid 1 2020-11-16T22:05:25.658 INFO:tasks.rados.rados.2.smithi057.stdout:969: writing smithi05720651-24 from 2039745 to 2792867 tid 2 2020-11-16T22:05:25.664 INFO:tasks.rados.rados.2.smithi057.stdout:969: writing smithi05720651-24 from 3534742 to 3865643 tid 3 2020-11-16T22:05:25.664 INFO:tasks.rados.rados.2.smithi057.stdout:970: read oid 44 snap -1 2020-11-16T22:05:25.664 INFO:tasks.rados.rados.2.smithi057.stdout:970: expect (ObjNum 290 snap 99 seq_num 290) 2020-11-16T22:05:25.665 INFO:tasks.rados.rados.2.smithi057.stdout:971: write oid 50 current snap is 117 2020-11-16T22:05:25.665 INFO:tasks.rados.rados.2.smithi057.stdout:971: seq_num 350 ranges {682450=489388,1814580=496780,2878518=788028} 2020-11-16T22:05:25.670 INFO:tasks.rados.rados.2.smithi057.stdout:971: writing smithi05720651-50 from 682450 to 1171838 tid 1 2020-11-16T22:05:25.677 INFO:tasks.rados.rados.2.smithi057.stdout:971: writing smithi05720651-50 from 1814580 to 2311360 tid 2 2020-11-16T22:05:25.684 INFO:tasks.rados.rados.2.smithi057.stdout:971: writing smithi05720651-50 from 2878518 to 3666546 tid 3 2020-11-16T22:05:25.685 INFO:tasks.rados.rados.2.smithi057.stdout:972: delete oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 117 2020-11-16T22:05:25.685 INFO:tasks.rados.rados.2.smithi057.stdout:965: finishing write tid 6 to smithi05720651-32 2020-11-16T22:05:25.685 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 926 (ObjNum 346 snap 117 seq_num 346) dirty exists 2020-11-16T22:05:25.685 INFO:tasks.rados.rados.2.smithi057.stdout:965: left oid 32 (ObjNum 346 snap 117 seq_num 346) 2020-11-16T22:05:25.685 INFO:tasks.rados.rados.2.smithi057.stdout:966: expect (ObjNum 206 snap 70 seq_num 206) 2020-11-16T22:05:25.828 INFO:tasks.rados.rados.2.smithi057.stdout:968: finishing write tid 1 to smithi05720651-22 2020-11-16T22:05:25.828 INFO:tasks.rados.rados.2.smithi057.stdout:968: finishing write tid 2 to smithi05720651-22 2020-11-16T22:05:25.829 INFO:tasks.rados.rados.2.smithi057.stdout:968: finishing write tid 3 to smithi05720651-22 2020-11-16T22:05:25.829 INFO:tasks.rados.rados.2.smithi057.stdout:968: finishing write tid 5 to smithi05720651-22 2020-11-16T22:05:25.829 INFO:tasks.rados.rados.2.smithi057.stdout:968: finishing write tid 6 to smithi05720651-22 2020-11-16T22:05:25.829 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 839 (ObjNum 348 snap 117 seq_num 348) dirty exists 2020-11-16T22:05:25.829 INFO:tasks.rados.rados.2.smithi057.stdout:968: left oid 22 (ObjNum 348 snap 117 seq_num 348) 2020-11-16T22:05:25.829 INFO:tasks.rados.rados.2.smithi057.stdout:969: finishing write tid 1 to smithi05720651-24 2020-11-16T22:05:25.829 INFO:tasks.rados.rados.2.smithi057.stdout:969: finishing write tid 2 to smithi05720651-24 2020-11-16T22:05:25.830 INFO:tasks.rados.rados.2.smithi057.stdout:965: done (6 left) 2020-11-16T22:05:25.830 INFO:tasks.rados.rados.2.smithi057.stdout:966: done (5 left) 2020-11-16T22:05:25.830 INFO:tasks.rados.rados.2.smithi057.stdout:968: done (4 left) 2020-11-16T22:05:25.830 INFO:tasks.rados.rados.2.smithi057.stdout:972: done (3 left) 2020-11-16T22:05:25.830 INFO:tasks.rados.rados.2.smithi057.stdout:973: snap_create 2020-11-16T22:05:25.830 INFO:tasks.rados.rados.2.smithi057.stdout:970: expect (ObjNum 290 snap 99 seq_num 290) 2020-11-16T22:05:25.913 INFO:tasks.rados.rados.2.smithi057.stdout:969: finishing write tid 3 to smithi05720651-24 2020-11-16T22:05:25.913 INFO:tasks.rados.rados.2.smithi057.stdout:969: finishing write tid 5 to smithi05720651-24 2020-11-16T22:05:25.914 INFO:tasks.rados.rados.2.smithi057.stdout:969: finishing write tid 6 to smithi05720651-24 2020-11-16T22:05:25.914 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 646 (ObjNum 349 snap 117 seq_num 349) dirty exists 2020-11-16T22:05:25.914 INFO:tasks.rados.rados.2.smithi057.stdout:969: left oid 24 (ObjNum 349 snap 117 seq_num 349) 2020-11-16T22:05:25.914 INFO:tasks.rados.rados.2.smithi057.stdout:971: finishing write tid 1 to smithi05720651-50 2020-11-16T22:05:25.914 INFO:tasks.rados.rados.2.smithi057.stdout:971: finishing write tid 2 to smithi05720651-50 2020-11-16T22:05:25.914 INFO:tasks.rados.rados.2.smithi057.stdout:971: finishing write tid 3 to smithi05720651-50 2020-11-16T22:05:25.915 INFO:tasks.rados.rados.2.smithi057.stdout:971: finishing write tid 5 to smithi05720651-50 2020-11-16T22:05:25.915 INFO:tasks.rados.rados.2.smithi057.stdout:971: finishing write tid 6 to smithi05720651-50 2020-11-16T22:05:25.915 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 763 (ObjNum 350 snap 117 seq_num 350) dirty exists 2020-11-16T22:05:25.915 INFO:tasks.rados.rados.2.smithi057.stdout:971: left oid 50 (ObjNum 350 snap 117 seq_num 350) 2020-11-16T22:05:25.965 INFO:tasks.rados.rados.2.smithi057.stdout:969: done (3 left) 2020-11-16T22:05:25.966 INFO:tasks.rados.rados.2.smithi057.stdout:970: done (2 left) 2020-11-16T22:05:25.966 INFO:tasks.rados.rados.2.smithi057.stdout:971: done (1 left) 2020-11-16T22:05:25.966 INFO:tasks.rados.rados.2.smithi057.stdout:973: done (0 left) 2020-11-16T22:05:25.966 INFO:tasks.rados.rados.2.smithi057.stdout:974: snap_remove snap 110 2020-11-16T22:05:26.970 INFO:tasks.rados.rados.2.smithi057.stdout:974: done (0 left) 2020-11-16T22:05:26.971 INFO:tasks.rados.rados.2.smithi057.stdout:975: rollback oid 4 current snap is 118 2020-11-16T22:05:26.971 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 4 to 104 2020-11-16T22:05:26.971 INFO:tasks.rados.rados.2.smithi057.stdout:976: read oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 112 2020-11-16T22:05:26.971 INFO:tasks.rados.rados.2.smithi057.stdout:976: expect deleted 2020-11-16T22:05:26.971 INFO:tasks.rados.rados.2.smithi057.stdout:977: delete oid 18 current snap is 118 2020-11-16T22:05:26.980 INFO:tasks.rados.rados.2.smithi057.stdout:976: done (2 left) 2020-11-16T22:05:26.980 INFO:tasks.rados.rados.2.smithi057.stdout:977: done (1 left) 2020-11-16T22:05:26.980 INFO:tasks.rados.rados.2.smithi057.stdout:978: write oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 118 2020-11-16T22:05:26.980 INFO:tasks.rados.rados.2.smithi057.stdout:978: seq_num 353 ranges {732871=715135,1873673=644107,3244434=688437} 2020-11-16T22:05:26.990 INFO:tasks.rados.rados.2.smithi057.stdout:978: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 732871 to 1448006 tid 1 2020-11-16T22:05:26.996 INFO:tasks.rados.rados.2.smithi057.stdout:978: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1873673 to 2517780 tid 2 2020-11-16T22:05:27.004 INFO:tasks.rados.rados.2.smithi057.stdout:978: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3244434 to 3932871 tid 3 2020-11-16T22:05:27.004 INFO:tasks.rados.rados.2.smithi057.stdout:979: rollback oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 118 2020-11-16T22:05:27.004 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 103 2020-11-16T22:05:27.005 INFO:tasks.rados.rados.2.smithi057.stdout:975: finishing rollback tid 0 to smithi05720651-4 2020-11-16T22:05:27.005 INFO:tasks.rados.rados.2.smithi057.stdout:975: finishing rollback tid 1 to smithi05720651-4 2020-11-16T22:05:27.005 INFO:tasks.rados.rados.2.smithi057.stdout:980: delete oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 118 2020-11-16T22:05:27.005 INFO:tasks.rados.rados.2.smithi057.stdout:975: finishing rollback tid 2 to smithi05720651-4 2020-11-16T22:05:27.005 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 287 (ObjNum 242 snap 81 seq_num 242) dirty exists 2020-11-16T22:05:27.005 INFO:tasks.rados.rados.2.smithi057.stdout:978: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:27.006 INFO:tasks.rados.rados.2.smithi057.stdout:978: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:27.007 INFO:tasks.rados.rados.2.smithi057.stdout:975: done (3 left) 2020-11-16T22:05:27.007 INFO:tasks.rados.rados.2.smithi057.stdout:980: done (2 left) 2020-11-16T22:05:27.008 INFO:tasks.rados.rados.2.smithi057.stdout:981: rollback oid 38 current snap is 118 2020-11-16T22:05:27.008 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 38 to 115 2020-11-16T22:05:27.008 INFO:tasks.rados.rados.2.smithi057.stdout:982: write oid 6 current snap is 118 2020-11-16T22:05:27.008 INFO:tasks.rados.rados.2.smithi057.stdout:982: seq_num 355 ranges {766485=465633,1990637=647776,3299280=667205} 2020-11-16T22:05:27.014 INFO:tasks.rados.rados.2.smithi057.stdout:982: writing smithi05720651-6 from 766485 to 1232118 tid 1 2020-11-16T22:05:27.022 INFO:tasks.rados.rados.2.smithi057.stdout:982: writing smithi05720651-6 from 1990637 to 2638413 tid 2 2020-11-16T22:05:27.029 INFO:tasks.rados.rados.2.smithi057.stdout:982: writing smithi05720651-6 from 3299280 to 3966485 tid 3 2020-11-16T22:05:27.030 INFO:tasks.rados.rados.2.smithi057.stdout:983: rollback oid 22 current snap is 118 2020-11-16T22:05:27.030 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 22 to 104 2020-11-16T22:05:27.030 INFO:tasks.rados.rados.2.smithi057.stdout:979: finishing rollback tid 0 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:27.030 INFO:tasks.rados.rados.2.smithi057.stdout:979: finishing rollback tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:27.030 INFO:tasks.rados.rados.2.smithi057.stdout:979: finishing rollback tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:27.030 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 557 (ObjNum 264 snap 86 seq_num 264) dirty exists 2020-11-16T22:05:27.031 INFO:tasks.rados.rados.2.smithi057.stdout:978: finishing write tid 3 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:27.031 INFO:tasks.rados.rados.2.smithi057.stdout:979: done (4 left) 2020-11-16T22:05:27.031 INFO:tasks.rados.rados.2.smithi057.stdout:984: snap_remove snap 91 2020-11-16T22:05:27.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:26 smithi016 bash[10302]: cluster 2020-11-16T22:05:25.640456+0000 mgr.x (mgr.24115) 384 : cluster [DBG] pgmap v613: 17 pgs: 17 active+clean; 313 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2020-11-16T22:05:27.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:26 smithi016 bash[10302]: cluster 2020-11-16T22:05:25.977007+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e300: 12 total, 12 up, 12 in 2020-11-16T22:05:27.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:26 smithi195 bash[10218]: cluster 2020-11-16T22:05:25.640456+0000 mgr.x (mgr.24115) 384 : cluster [DBG] pgmap v613: 17 pgs: 17 active+clean; 313 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2020-11-16T22:05:27.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:26 smithi195 bash[10218]: cluster 2020-11-16T22:05:25.977007+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e300: 12 total, 12 up, 12 in 2020-11-16T22:05:27.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:26 smithi057 bash[10301]: cluster 2020-11-16T22:05:25.640456+0000 mgr.x (mgr.24115) 384 : cluster [DBG] pgmap v613: 17 pgs: 17 active+clean; 313 MiB data, 672 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2020-11-16T22:05:27.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:26 smithi057 bash[10301]: cluster 2020-11-16T22:05:25.977007+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e300: 12 total, 12 up, 12 in 2020-11-16T22:05:27.991 INFO:tasks.rados.rados.2.smithi057.stdout:984: done (4 left) 2020-11-16T22:05:27.991 INFO:tasks.rados.rados.2.smithi057.stdout:985: write (excl) oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 118 2020-11-16T22:05:27.991 INFO:tasks.rados.rados.2.smithi057.stdout:985: seq_num 356 ranges {783292=540882,1932766=507787,3210350=572013} 2020-11-16T22:05:28.004 INFO:tasks.rados.rados.2.smithi057.stdout:985: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 783292 to 1324174 tid 1 2020-11-16T22:05:28.011 INFO:tasks.rados.rados.2.smithi057.stdout:985: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1932766 to 2440553 tid 2 2020-11-16T22:05:28.019 INFO:tasks.rados.rados.2.smithi057.stdout:985: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3210350 to 3782363 tid 3 2020-11-16T22:05:28.019 INFO:tasks.rados.rados.2.smithi057.stdout:986: write (excl) oid 32 current snap is 118 2020-11-16T22:05:28.019 INFO:tasks.rados.rados.2.smithi057.stdout:986: seq_num 357 ranges {400099=616131,1591248=408851} 2020-11-16T22:05:28.025 INFO:tasks.rados.rados.2.smithi057.stdout:986: writing smithi05720651-32 from 400099 to 1016230 tid 1 2020-11-16T22:05:28.031 INFO:tasks.rados.rados.2.smithi057.stdout:986: writing smithi05720651-32 from 1591248 to 2000099 tid 2 2020-11-16T22:05:28.031 INFO:tasks.rados.rados.2.smithi057.stdout:987: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 118 2020-11-16T22:05:28.031 INFO:tasks.rados.rados.2.smithi057.stdout:987: seq_num 358 ranges {416906=407733,1366083=511456} 2020-11-16T22:05:28.036 INFO:tasks.rados.rados.2.smithi057.stdout:987: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 416906 to 824639 tid 1 2020-11-16T22:05:28.043 INFO:tasks.rados.rados.2.smithi057.stdout:987: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1366083 to 1877539 tid 2 2020-11-16T22:05:28.043 INFO:tasks.rados.rados.2.smithi057.stdout:988: write oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 118 2020-11-16T22:05:28.043 INFO:tasks.rados.rados.2.smithi057.stdout:988: seq_num 359 ranges {433713=482982,1424565=609148} 2020-11-16T22:05:28.048 INFO:tasks.rados.rados.2.smithi057.stdout:988: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 433713 to 916695 tid 1 2020-11-16T22:05:28.055 INFO:tasks.rados.rados.2.smithi057.stdout:988: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1424565 to 2033713 tid 2 2020-11-16T22:05:28.055 INFO:tasks.rados.rados.2.smithi057.stdout:989: snap_remove snap 87 2020-11-16T22:05:28.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:27 smithi016 bash[10302]: cluster 2020-11-16T22:05:26.980418+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e301: 12 total, 12 up, 12 in 2020-11-16T22:05:28.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:27 smithi195 bash[10218]: cluster 2020-11-16T22:05:26.980418+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e301: 12 total, 12 up, 12 in 2020-11-16T22:05:28.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:27 smithi057 bash[10301]: cluster 2020-11-16T22:05:26.980418+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e301: 12 total, 12 up, 12 in 2020-11-16T22:05:29.002 INFO:tasks.rados.rados.2.smithi057.stdout:989: done (8 left) 2020-11-16T22:05:29.003 INFO:tasks.rados.rados.2.smithi057.stdout:990: rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 118 2020-11-16T22:05:29.003 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 115 2020-11-16T22:05:29.003 INFO:tasks.rados.rados.2.smithi057.stdout:978: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.003 INFO:tasks.rados.rados.2.smithi057.stdout:978: finishing write tid 6 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.003 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 776 (ObjNum 353 snap 118 seq_num 353) dirty exists 2020-11-16T22:05:29.003 INFO:tasks.rados.rados.2.smithi057.stdout:978: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 353 snap 118 seq_num 353) 2020-11-16T22:05:29.003 INFO:tasks.rados.rados.2.smithi057.stdout:981: finishing rollback tid 1 to smithi05720651-38 2020-11-16T22:05:29.004 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 513 (ObjNum 321 snap 0 seq_num 543519573) dirty dne 2020-11-16T22:05:29.004 INFO:tasks.rados.rados.2.smithi057.stdout:982: finishing write tid 1 to smithi05720651-6 2020-11-16T22:05:29.004 INFO:tasks.rados.rados.2.smithi057.stdout:982: finishing write tid 2 to smithi05720651-6 2020-11-16T22:05:29.004 INFO:tasks.rados.rados.2.smithi057.stdout:983: finishing rollback tid 0 to smithi05720651-22 2020-11-16T22:05:29.004 INFO:tasks.rados.rados.2.smithi057.stdout:983: finishing rollback tid 1 to smithi05720651-22 2020-11-16T22:05:29.004 INFO:tasks.rados.rados.2.smithi057.stdout:982: finishing write tid 3 to smithi05720651-6 2020-11-16T22:05:29.004 INFO:tasks.rados.rados.2.smithi057.stdout:982: finishing write tid 5 to smithi05720651-6 2020-11-16T22:05:29.005 INFO:tasks.rados.rados.2.smithi057.stdout:983: finishing rollback tid 2 to smithi05720651-22 2020-11-16T22:05:29.005 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 842 (ObjNum 192 snap 64 seq_num 192) dirty exists 2020-11-16T22:05:29.005 INFO:tasks.rados.rados.2.smithi057.stdout:982: finishing write tid 6 to smithi05720651-6 2020-11-16T22:05:29.005 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 783 (ObjNum 355 snap 118 seq_num 355) dirty exists 2020-11-16T22:05:29.005 INFO:tasks.rados.rados.2.smithi057.stdout:982: left oid 6 (ObjNum 355 snap 118 seq_num 355) 2020-11-16T22:05:29.005 INFO:tasks.rados.rados.2.smithi057.stdout:985: finishing write tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.005 INFO:tasks.rados.rados.2.smithi057.stdout:985: finishing write tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.006 INFO:tasks.rados.rados.2.smithi057.stdout:985: finishing write tid 3 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.006 INFO:tasks.rados.rados.2.smithi057.stdout:985: finishing write tid 5 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.006 INFO:tasks.rados.rados.2.smithi057.stdout:978: done (8 left) 2020-11-16T22:05:29.006 INFO:tasks.rados.rados.2.smithi057.stdout:981: done (7 left) 2020-11-16T22:05:29.006 INFO:tasks.rados.rados.2.smithi057.stdout:982: done (6 left) 2020-11-16T22:05:29.006 INFO:tasks.rados.rados.2.smithi057.stdout:983: done (5 left) 2020-11-16T22:05:29.006 INFO:tasks.rados.rados.2.smithi057.stdout:991: rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 118 2020-11-16T22:05:29.007 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 103 2020-11-16T22:05:29.007 INFO:tasks.rados.rados.2.smithi057.stdout:985: finishing write tid 6 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.007 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 785 (ObjNum 356 snap 118 seq_num 356) dirty exists 2020-11-16T22:05:29.007 INFO:tasks.rados.rados.2.smithi057.stdout:985: left oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 356 snap 118 seq_num 356) 2020-11-16T22:05:29.007 INFO:tasks.rados.rados.2.smithi057.stdout:986: finishing write tid 1 to smithi05720651-32 2020-11-16T22:05:29.007 INFO:tasks.rados.rados.2.smithi057.stdout:986: finishing write tid 2 to smithi05720651-32 2020-11-16T22:05:29.007 INFO:tasks.rados.rados.2.smithi057.stdout:985: done (5 left) 2020-11-16T22:05:29.008 INFO:tasks.rados.rados.2.smithi057.stdout:992: snap_create 2020-11-16T22:05:29.008 INFO:tasks.rados.rados.2.smithi057.stdout:986: finishing write tid 4 to smithi05720651-32 2020-11-16T22:05:29.008 INFO:tasks.rados.rados.2.smithi057.stdout:986: finishing write tid 5 to smithi05720651-32 2020-11-16T22:05:29.008 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 936 (ObjNum 357 snap 118 seq_num 357) dirty exists 2020-11-16T22:05:29.008 INFO:tasks.rados.rados.2.smithi057.stdout:986: left oid 32 (ObjNum 357 snap 118 seq_num 357) 2020-11-16T22:05:29.008 INFO:tasks.rados.rados.2.smithi057.stdout:987: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.008 INFO:tasks.rados.rados.2.smithi057.stdout:987: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.009 INFO:tasks.rados.rados.2.smithi057.stdout:987: finishing write tid 4 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.009 INFO:tasks.rados.rados.2.smithi057.stdout:987: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.009 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 948 (ObjNum 358 snap 118 seq_num 358) dirty exists 2020-11-16T22:05:29.009 INFO:tasks.rados.rados.2.smithi057.stdout:987: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 358 snap 118 seq_num 358) 2020-11-16T22:05:29.009 INFO:tasks.rados.rados.2.smithi057.stdout:988: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.009 INFO:tasks.rados.rados.2.smithi057.stdout:988: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.009 INFO:tasks.rados.rados.2.smithi057.stdout:988: finishing write tid 4 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.010 INFO:tasks.rados.rados.2.smithi057.stdout:988: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.010 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 957 (ObjNum 359 snap 118 seq_num 359) dirty exists 2020-11-16T22:05:29.010 INFO:tasks.rados.rados.2.smithi057.stdout:988: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 359 snap 118 seq_num 359) 2020-11-16T22:05:29.010 INFO:tasks.rados.rados.2.smithi057.stdout:990: finishing rollback tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.011 INFO:tasks.rados.rados.2.smithi057.stdout:991: finishing rollback tid 0 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.011 INFO:tasks.rados.rados.2.smithi057.stdout:990: finishing rollback tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.011 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 649 (ObjNum 297 snap 103 seq_num 297) dirty exists 2020-11-16T22:05:29.011 INFO:tasks.rados.rados.2.smithi057.stdout:991: finishing rollback tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.014 INFO:tasks.rados.rados.2.smithi057.stdout:991: finishing rollback tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:29.014 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 797 (ObjNum 144 snap 44 seq_num 144) dirty exists 2020-11-16T22:05:29.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:28 smithi016 bash[10302]: cluster 2020-11-16T22:05:27.641143+0000 mgr.x (mgr.24115) 385 : cluster [DBG] pgmap v616: 17 pgs: 17 active+clean; 283 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2020-11-16T22:05:29.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:28 smithi016 bash[10302]: cluster 2020-11-16T22:05:27.999164+0000 mon.a (mon.0) 949 : cluster [DBG] osdmap e302: 12 total, 12 up, 12 in 2020-11-16T22:05:29.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:28 smithi195 bash[10218]: cluster 2020-11-16T22:05:27.641143+0000 mgr.x (mgr.24115) 385 : cluster [DBG] pgmap v616: 17 pgs: 17 active+clean; 283 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2020-11-16T22:05:29.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:28 smithi195 bash[10218]: cluster 2020-11-16T22:05:27.999164+0000 mon.a (mon.0) 949 : cluster [DBG] osdmap e302: 12 total, 12 up, 12 in 2020-11-16T22:05:29.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:29 smithi057 bash[10301]: cluster 2020-11-16T22:05:27.641143+0000 mgr.x (mgr.24115) 385 : cluster [DBG] pgmap v616: 17 pgs: 17 active+clean; 283 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2020-11-16T22:05:29.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:29 smithi057 bash[10301]: cluster 2020-11-16T22:05:27.999164+0000 mon.a (mon.0) 949 : cluster [DBG] osdmap e302: 12 total, 12 up, 12 in 2020-11-16T22:05:29.837 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:05:29 smithi016 bash[19825]: debug 2020-11-16T22:05:29.472+0000 7f0e12c1a700 -1 osd.7 pg_epoch: 303 pg[2.8( v 303'795 (0'0,303'795] local-lis/les=71/72 n=22 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [7,9] r=0 lpr=71 luod=303'793 crt=303'795 lcod 303'791 mlcod 303'791 active+clean+snaptrim trimq=[aa~1] ps=[87~1,ab~1,ae~1,b6~1,d1~1,d5~1]] removing snap head 2020-11-16T22:05:29.932 INFO:tasks.rados.rados.2.smithi057.stdout:986: done (5 left) 2020-11-16T22:05:29.932 INFO:tasks.rados.rados.2.smithi057.stdout:987: done (4 left) 2020-11-16T22:05:29.932 INFO:tasks.rados.rados.2.smithi057.stdout:988: done (3 left) 2020-11-16T22:05:29.932 INFO:tasks.rados.rados.2.smithi057.stdout:990: done (2 left) 2020-11-16T22:05:29.933 INFO:tasks.rados.rados.2.smithi057.stdout:991: done (1 left) 2020-11-16T22:05:29.933 INFO:tasks.rados.rados.2.smithi057.stdout:992: done (0 left) 2020-11-16T22:05:29.933 INFO:tasks.rados.rados.2.smithi057.stdout:993: rollback oid 20 current snap is 119 2020-11-16T22:05:29.933 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 20 to 114 2020-11-16T22:05:29.933 INFO:tasks.rados.rados.2.smithi057.stdout:994: read oid 32 snap -1 2020-11-16T22:05:29.933 INFO:tasks.rados.rados.2.smithi057.stdout:994: expect (ObjNum 357 snap 118 seq_num 357) 2020-11-16T22:05:29.933 INFO:tasks.rados.rados.2.smithi057.stdout:995: copy_from oid 26 from oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 119 2020-11-16T22:05:29.934 INFO:tasks.rados.rados.2.smithi057.stdout:996: delete oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 119 2020-11-16T22:05:29.943 INFO:tasks.rados.rados.2.smithi057.stdout:994: expect (ObjNum 357 snap 118 seq_num 357) 2020-11-16T22:05:29.945 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:05:29 smithi057 bash[12595]: debug 2020-11-16T22:05:29.472+0000 7f737d1a4700 -1 osd.8 pg_epoch: 303 pg[2.5( v 303'571 (0'0,303'571] local-lis/les=71/72 n=12 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,0] r=0 lpr=71 luod=303'569 crt=303'571 lcod 303'567 mlcod 303'567 active+clean+snaptrim trimq=[aa~1] ps=[87~1,ab~1,ae~1,b6~1,d1~1,d5~1]] removing snap head 2020-11-16T22:05:30.034 INFO:tasks.rados.rados.2.smithi057.stdout:995: finishing copy_from to smithi05720651-26 2020-11-16T22:05:30.034 INFO:tasks.rados.rados.2.smithi057.stdout:995: got expected ENOENT (src dne) 2020-11-16T22:05:30.034 INFO:tasks.rados.rados.2.smithi057.stdout:995: finishing copy_from racing read to smithi05720651-26 2020-11-16T22:05:30.034 INFO:tasks.rados.rados.2.smithi057.stdout:993: finishing rollback tid 0 to smithi05720651-20 2020-11-16T22:05:30.034 INFO:tasks.rados.rados.2.smithi057.stdout:993: finishing rollback tid 1 to smithi05720651-20 2020-11-16T22:05:30.035 INFO:tasks.rados.rados.2.smithi057.stdout:993: finishing rollback tid 2 to smithi05720651-20 2020-11-16T22:05:30.035 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 299 (ObjNum 327 snap 111 seq_num 327) dirty exists 2020-11-16T22:05:30.035 INFO:tasks.rados.rados.2.smithi057.stdout:993: done (3 left) 2020-11-16T22:05:30.035 INFO:tasks.rados.rados.2.smithi057.stdout:994: done (2 left) 2020-11-16T22:05:30.035 INFO:tasks.rados.rados.2.smithi057.stdout:995: done (1 left) 2020-11-16T22:05:30.035 INFO:tasks.rados.rados.2.smithi057.stdout:996: done (0 left) 2020-11-16T22:05:30.035 INFO:tasks.rados.rados.2.smithi057.stdout:997: read oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:30.036 INFO:tasks.rados.rados.2.smithi057.stdout:997: expect deleted 2020-11-16T22:05:30.036 INFO:tasks.rados.rados.2.smithi057.stdout:998: snap_remove snap 115 2020-11-16T22:05:30.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:30 smithi016 bash[10302]: cluster 2020-11-16T22:05:29.008176+0000 mon.a (mon.0) 950 : cluster [DBG] osdmap e303: 12 total, 12 up, 12 in 2020-11-16T22:05:30.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:30 smithi016 bash[10302]: audit 2020-11-16T22:05:29.729624+0000 mon.b (mon.1) 291 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:05:30.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:30 smithi016 bash[10302]: audit 2020-11-16T22:05:29.731116+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:05:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:30 smithi016 bash[10302]: audit 2020-11-16T22:05:29.741191+0000 mon.b (mon.1) 292 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:05:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:30 smithi016 bash[10302]: audit 2020-11-16T22:05:29.742550+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:05:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:30 smithi016 bash[10302]: cluster 2020-11-16T22:05:29.938649+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e304: 12 total, 12 up, 12 in 2020-11-16T22:05:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:30 smithi195 bash[10218]: cluster 2020-11-16T22:05:29.008176+0000 mon.a (mon.0) 950 : cluster [DBG] osdmap e303: 12 total, 12 up, 12 in 2020-11-16T22:05:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:30 smithi195 bash[10218]: audit 2020-11-16T22:05:29.729624+0000 mon.b (mon.1) 291 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:05:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:30 smithi195 bash[10218]: audit 2020-11-16T22:05:29.731116+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:05:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:30 smithi195 bash[10218]: audit 2020-11-16T22:05:29.741191+0000 mon.b (mon.1) 292 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:05:30.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:30 smithi195 bash[10218]: audit 2020-11-16T22:05:29.742550+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:05:30.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:30 smithi195 bash[10218]: cluster 2020-11-16T22:05:29.938649+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e304: 12 total, 12 up, 12 in 2020-11-16T22:05:30.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:30 smithi057 bash[10301]: cluster 2020-11-16T22:05:29.008176+0000 mon.a (mon.0) 950 : cluster [DBG] osdmap e303: 12 total, 12 up, 12 in 2020-11-16T22:05:30.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:30 smithi057 bash[10301]: audit 2020-11-16T22:05:29.729624+0000 mon.b (mon.1) 291 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:05:30.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:30 smithi057 bash[10301]: audit 2020-11-16T22:05:29.731116+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:05:30.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:30 smithi057 bash[10301]: audit 2020-11-16T22:05:29.741191+0000 mon.b (mon.1) 292 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:05:30.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:30 smithi057 bash[10301]: audit 2020-11-16T22:05:29.742550+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:05:30.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:30 smithi057 bash[10301]: cluster 2020-11-16T22:05:29.938649+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e304: 12 total, 12 up, 12 in 2020-11-16T22:05:31.013 INFO:tasks.rados.rados.2.smithi057.stdout:998: done (1 left) 2020-11-16T22:05:31.014 INFO:tasks.rados.rados.2.smithi057.stdout:999: read oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:31.014 INFO:tasks.rados.rados.2.smithi057.stdout:999: expect (ObjNum 322 snap 111 seq_num 322) 2020-11-16T22:05:31.014 INFO:tasks.rados.rados.2.smithi057.stdout:1000: rollback oid 30 current snap is 119 2020-11-16T22:05:31.014 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 30 to 117 2020-11-16T22:05:31.014 INFO:tasks.rados.rados.2.smithi057.stdout:997: done (2 left) 2020-11-16T22:05:31.015 INFO:tasks.rados.rados.2.smithi057.stdout:1001: snap_create 2020-11-16T22:05:31.029 INFO:tasks.rados.rados.2.smithi057.stdout:999: expect (ObjNum 322 snap 111 seq_num 322) 2020-11-16T22:05:31.229 INFO:tasks.rados.rados.2.smithi057.stdout:1000: finishing rollback tid 1 to smithi05720651-30 2020-11-16T22:05:31.230 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 0 (ObjNum 69 snap 0 seq_num 0) dirty dne 2020-11-16T22:05:31.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:31 smithi016 bash[10302]: cluster 2020-11-16T22:05:29.641877+0000 mgr.x (mgr.24115) 386 : cluster [DBG] pgmap v619: 17 pgs: 17 active+clean; 283 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 388 KiB/s wr, 6 op/s 2020-11-16T22:05:31.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:31 smithi195 bash[10218]: cluster 2020-11-16T22:05:29.641877+0000 mgr.x (mgr.24115) 386 : cluster [DBG] pgmap v619: 17 pgs: 17 active+clean; 283 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 388 KiB/s wr, 6 op/s 2020-11-16T22:05:31.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:31 smithi057 bash[10301]: cluster 2020-11-16T22:05:29.641877+0000 mgr.x (mgr.24115) 386 : cluster [DBG] pgmap v619: 17 pgs: 17 active+clean; 283 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 388 KiB/s wr, 6 op/s 2020-11-16T22:05:32.031 INFO:tasks.rados.rados.2.smithi057.stdout:999: done (2 left) 2020-11-16T22:05:32.031 INFO:tasks.rados.rados.2.smithi057.stdout:1000: done (1 left) 2020-11-16T22:05:32.032 INFO:tasks.rados.rados.2.smithi057.stdout:1001: done (0 left) 2020-11-16T22:05:32.032 INFO:tasks.rados.rados.2.smithi057.stdout:1002: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:32.032 INFO:tasks.rados.rados.2.smithi057.stdout:1002: expect (ObjNum 297 snap 103 seq_num 297) 2020-11-16T22:05:32.032 INFO:tasks.rados.rados.2.smithi057.stdout:1003: copy_from oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 32 current snap is 120 2020-11-16T22:05:32.032 INFO:tasks.rados.rados.2.smithi057.stdout:1004: rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 120 2020-11-16T22:05:32.032 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 101 2020-11-16T22:05:32.033 INFO:tasks.rados.rados.2.smithi057.stdout:1005: read oid 40 snap 118 2020-11-16T22:05:32.033 INFO:tasks.rados.rados.2.smithi057.stdout:1005: expect (ObjNum 296 snap 102 seq_num 296) 2020-11-16T22:05:32.033 INFO:tasks.rados.rados.2.smithi057.stdout:1006: copy_from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 14 current snap is 120 2020-11-16T22:05:32.033 INFO:tasks.rados.rados.2.smithi057.stdout:1007: delete oid 34 current snap is 120 2020-11-16T22:05:32.037 INFO:tasks.rados.rados.2.smithi057.stdout:1004: finishing rollback tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:32.038 INFO:tasks.rados.rados.2.smithi057.stdout:1004: finishing rollback tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:32.038 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 807 (ObjNum 272 snap 91 seq_num 272) dirty exists 2020-11-16T22:05:32.039 INFO:tasks.rados.rados.2.smithi057.stdout:1004: done (5 left) 2020-11-16T22:05:32.039 INFO:tasks.rados.rados.2.smithi057.stdout:1007: done (4 left) 2020-11-16T22:05:32.039 INFO:tasks.rados.rados.2.smithi057.stdout:1008: delete oid 4 current snap is 120 2020-11-16T22:05:32.044 INFO:tasks.rados.rados.2.smithi057.stdout:1008: done (4 left) 2020-11-16T22:05:32.045 INFO:tasks.rados.rados.2.smithi057.stdout:1009: write oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 120 2020-11-16T22:05:32.045 INFO:tasks.rados.rados.2.smithi057.stdout:1009: seq_num 363 ranges {500941=783978,1942140=158801} 2020-11-16T22:05:32.057 INFO:tasks.rados.rados.2.smithi057.stdout:1009: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 500941 to 1284919 tid 1 2020-11-16T22:05:32.062 INFO:tasks.rados.rados.2.smithi057.stdout:1009: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1942140 to 2100941 tid 2 2020-11-16T22:05:32.062 INFO:tasks.rados.rados.2.smithi057.stdout:1010: snap_remove snap 104 2020-11-16T22:05:32.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:32 smithi016 bash[10302]: cluster 2020-11-16T22:05:31.020235+0000 mon.a (mon.0) 954 : cluster [DBG] osdmap e305: 12 total, 12 up, 12 in 2020-11-16T22:05:32.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:32 smithi195 bash[10218]: cluster 2020-11-16T22:05:31.020235+0000 mon.a (mon.0) 954 : cluster [DBG] osdmap e305: 12 total, 12 up, 12 in 2020-11-16T22:05:32.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:32 smithi057 bash[10301]: cluster 2020-11-16T22:05:31.020235+0000 mon.a (mon.0) 954 : cluster [DBG] osdmap e305: 12 total, 12 up, 12 in 2020-11-16T22:05:33.034 INFO:tasks.rados.rados.2.smithi057.stdout:1010: done (5 left) 2020-11-16T22:05:33.035 INFO:tasks.rados.rados.2.smithi057.stdout:1011: read oid 30 snap -1 2020-11-16T22:05:33.035 INFO:tasks.rados.rados.2.smithi057.stdout:1011: expect deleted 2020-11-16T22:05:33.035 INFO:tasks.rados.rados.2.smithi057.stdout:1012: write (excl) oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 120 2020-11-16T22:05:33.035 INFO:tasks.rados.rados.2.smithi057.stdout:1012: seq_num 364 ranges {517748=459227,1600622=406110} 2020-11-16T22:05:33.047 INFO:tasks.rados.rados.2.smithi057.stdout:1012: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 517748 to 976975 tid 1 2020-11-16T22:05:33.054 INFO:tasks.rados.rados.2.smithi057.stdout:1012: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1600622 to 2006732 tid 2 2020-11-16T22:05:33.054 INFO:tasks.rados.rados.2.smithi057.stdout:1013: snap_create 2020-11-16T22:05:33.054 INFO:tasks.rados.rados.2.smithi057.stdout:1006: finishing copy_from to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:33.054 INFO:tasks.rados.rados.2.smithi057.stdout:1006: got expected ENOENT (src dne) 2020-11-16T22:05:33.055 INFO:tasks.rados.rados.2.smithi057.stdout:1006: finishing copy_from racing read to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:33.055 INFO:tasks.rados.rados.2.smithi057.stdout:1002: expect (ObjNum 297 snap 103 seq_num 297) 2020-11-16T22:05:33.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:33 smithi016 bash[10302]: cluster 2020-11-16T22:05:31.642584+0000 mgr.x (mgr.24115) 387 : cluster [DBG] pgmap v622: 17 pgs: 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 14 active+clean; 272 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 4.0 MiB/s wr, 23 op/s 2020-11-16T22:05:33.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:33 smithi016 bash[10302]: cluster 2020-11-16T22:05:32.039878+0000 mon.a (mon.0) 955 : cluster [DBG] osdmap e306: 12 total, 12 up, 12 in 2020-11-16T22:05:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:33 smithi195 bash[10218]: cluster 2020-11-16T22:05:31.642584+0000 mgr.x (mgr.24115) 387 : cluster [DBG] pgmap v622: 17 pgs: 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 14 active+clean; 272 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 4.0 MiB/s wr, 23 op/s 2020-11-16T22:05:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:33 smithi195 bash[10218]: cluster 2020-11-16T22:05:32.039878+0000 mon.a (mon.0) 955 : cluster [DBG] osdmap e306: 12 total, 12 up, 12 in 2020-11-16T22:05:33.351 INFO:tasks.rados.rados.2.smithi057.stdout:1005: expect (ObjNum 296 snap 102 seq_num 296) 2020-11-16T22:05:33.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:33 smithi057 bash[10301]: cluster 2020-11-16T22:05:31.642584+0000 mgr.x (mgr.24115) 387 : cluster [DBG] pgmap v622: 17 pgs: 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 14 active+clean; 272 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 4.0 MiB/s wr, 23 op/s 2020-11-16T22:05:33.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:33 smithi057 bash[10301]: cluster 2020-11-16T22:05:32.039878+0000 mon.a (mon.0) 955 : cluster [DBG] osdmap e306: 12 total, 12 up, 12 in 2020-11-16T22:05:33.471 INFO:tasks.rados.rados.2.smithi057.stdout:1003: finishing copy_from to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:33.471 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 936 (ObjNum 357 snap 118 seq_num 357) dirty exists 2020-11-16T22:05:33.471 INFO:tasks.rados.rados.2.smithi057.stdout:1003: finishing copy_from racing read to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:33.471 INFO:tasks.rados.rados.2.smithi057.stdout:1009: finishing write tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:33.471 INFO:tasks.rados.rados.2.smithi057.stdout:1009: finishing write tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:33.471 INFO:tasks.rados.rados.2.smithi057.stdout:1009: finishing write tid 4 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:33.472 INFO:tasks.rados.rados.2.smithi057.stdout:1009: finishing write tid 5 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:33.472 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 578 (ObjNum 363 snap 120 seq_num 363) dirty exists 2020-11-16T22:05:33.472 INFO:tasks.rados.rados.2.smithi057.stdout:1009: left oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 363 snap 120 seq_num 363) 2020-11-16T22:05:33.472 INFO:tasks.rados.rados.2.smithi057.stdout:1012: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:33.472 INFO:tasks.rados.rados.2.smithi057.stdout:1012: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:33.472 INFO:tasks.rados.rados.2.smithi057.stdout:1012: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:33.472 INFO:tasks.rados.rados.2.smithi057.stdout:1012: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:33.473 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 434 (ObjNum 364 snap 120 seq_num 364) dirty exists 2020-11-16T22:05:33.473 INFO:tasks.rados.rados.2.smithi057.stdout:1012: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 364 snap 120 seq_num 364) 2020-11-16T22:05:34.052 INFO:tasks.rados.rados.2.smithi057.stdout:1002: done (7 left) 2020-11-16T22:05:34.052 INFO:tasks.rados.rados.2.smithi057.stdout:1003: done (6 left) 2020-11-16T22:05:34.053 INFO:tasks.rados.rados.2.smithi057.stdout:1005: done (5 left) 2020-11-16T22:05:34.053 INFO:tasks.rados.rados.2.smithi057.stdout:1006: done (4 left) 2020-11-16T22:05:34.053 INFO:tasks.rados.rados.2.smithi057.stdout:1009: done (3 left) 2020-11-16T22:05:34.053 INFO:tasks.rados.rados.2.smithi057.stdout:1011: done (2 left) 2020-11-16T22:05:34.053 INFO:tasks.rados.rados.2.smithi057.stdout:1012: done (1 left) 2020-11-16T22:05:34.053 INFO:tasks.rados.rados.2.smithi057.stdout:1013: done (0 left) 2020-11-16T22:05:34.054 INFO:tasks.rados.rados.2.smithi057.stdout:1014: read oid 30 snap -1 2020-11-16T22:05:34.054 INFO:tasks.rados.rados.2.smithi057.stdout:1014: expect deleted 2020-11-16T22:05:34.054 INFO:tasks.rados.rados.2.smithi057.stdout:1015: rollback oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 121 2020-11-16T22:05:34.054 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 120 2020-11-16T22:05:34.054 INFO:tasks.rados.rados.2.smithi057.stdout:1016: snap_remove snap 116 2020-11-16T22:05:34.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:34 smithi016 bash[10302]: cluster 2020-11-16T22:05:33.043460+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e307: 12 total, 12 up, 12 in 2020-11-16T22:05:34.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:34 smithi195 bash[10218]: cluster 2020-11-16T22:05:33.043460+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e307: 12 total, 12 up, 12 in 2020-11-16T22:05:34.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:34 smithi057 bash[10301]: cluster 2020-11-16T22:05:33.043460+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e307: 12 total, 12 up, 12 in 2020-11-16T22:05:34.932 INFO:tasks.rados.rados.2.smithi057.stdout:1016: done (2 left) 2020-11-16T22:05:34.932 INFO:tasks.rados.rados.2.smithi057.stdout:1017: write oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 121 2020-11-16T22:05:34.933 INFO:tasks.rados.rados.2.smithi057.stdout:1017: seq_num 365 ranges {534555=650829,1659104=475451} 2020-11-16T22:05:34.944 INFO:tasks.rados.rados.2.smithi057.stdout:1017: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 534555 to 1185384 tid 1 2020-11-16T22:05:34.949 INFO:tasks.rados.rados.2.smithi057.stdout:1017: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1659104 to 2134555 tid 2 2020-11-16T22:05:34.950 INFO:tasks.rados.rados.2.smithi057.stdout:1018: write (excl) oid 50 current snap is 121 2020-11-16T22:05:34.950 INFO:tasks.rados.rados.2.smithi057.stdout:1018: seq_num 366 ranges {551362=726078,1717586=409779} 2020-11-16T22:05:34.958 INFO:tasks.rados.rados.2.smithi057.stdout:1018: writing smithi05720651-50 from 551362 to 1277440 tid 1 2020-11-16T22:05:34.963 INFO:tasks.rados.rados.2.smithi057.stdout:1018: writing smithi05720651-50 from 1717586 to 2127365 tid 2 2020-11-16T22:05:34.964 INFO:tasks.rados.rados.2.smithi057.stdout:1019: copy_from oid 40 from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 121 2020-11-16T22:05:34.964 INFO:tasks.rados.rados.2.smithi057.stdout:1015: finishing rollback tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:34.964 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 679 (ObjNum 33 snap 0 seq_num 2932477648) dirty dne 2020-11-16T22:05:34.964 INFO:tasks.rados.rados.2.smithi057.stdout:1017: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:34.964 INFO:tasks.rados.rados.2.smithi057.stdout:1017: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:34.964 INFO:tasks.rados.rados.2.smithi057.stdout:1017: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:34.965 INFO:tasks.rados.rados.2.smithi057.stdout:1014: done (4 left) 2020-11-16T22:05:34.965 INFO:tasks.rados.rados.2.smithi057.stdout:1015: done (3 left) 2020-11-16T22:05:34.965 INFO:tasks.rados.rados.2.smithi057.stdout:1020: write (excl) oid 14 current snap is 121 2020-11-16T22:05:34.965 INFO:tasks.rados.rados.2.smithi057.stdout:1020: seq_num 367 ranges {568169=401327,1376068=669790} 2020-11-16T22:05:34.969 INFO:tasks.rados.rados.2.smithi057.stdout:1020: writing smithi05720651-14 from 568169 to 969496 tid 1 2020-11-16T22:05:34.975 INFO:tasks.rados.rados.2.smithi057.stdout:1020: writing smithi05720651-14 from 1376068 to 2045858 tid 2 2020-11-16T22:05:34.975 INFO:tasks.rados.rados.2.smithi057.stdout:1021: write (excl) oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 121 2020-11-16T22:05:34.976 INFO:tasks.rados.rados.2.smithi057.stdout:1021: seq_num 368 ranges {584976=476576,1834550=350426} 2020-11-16T22:05:34.981 INFO:tasks.rados.rados.2.smithi057.stdout:1021: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 584976 to 1061552 tid 1 2020-11-16T22:05:34.988 INFO:tasks.rados.rados.2.smithi057.stdout:1021: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1834550 to 2184976 tid 2 2020-11-16T22:05:34.988 INFO:tasks.rados.rados.2.smithi057.stdout:1022: snap_remove snap 103 2020-11-16T22:05:35.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:35 smithi016 bash[10302]: cluster 2020-11-16T22:05:33.643328+0000 mgr.x (mgr.24115) 388 : cluster [DBG] pgmap v625: 17 pgs: 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 14 active+clean; 272 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 4.0 MiB/s wr, 25 op/s 2020-11-16T22:05:35.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:35 smithi016 bash[10302]: cluster 2020-11-16T22:05:34.061620+0000 mon.a (mon.0) 957 : cluster [DBG] osdmap e308: 12 total, 12 up, 12 in 2020-11-16T22:05:35.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:35 smithi016 bash[10302]: cluster 2020-11-16T22:05:34.941203+0000 mon.a (mon.0) 958 : cluster [DBG] osdmap e309: 12 total, 12 up, 12 in 2020-11-16T22:05:35.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:35 smithi195 bash[10218]: cluster 2020-11-16T22:05:33.643328+0000 mgr.x (mgr.24115) 388 : cluster [DBG] pgmap v625: 17 pgs: 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 14 active+clean; 272 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 4.0 MiB/s wr, 25 op/s 2020-11-16T22:05:35.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:35 smithi195 bash[10218]: cluster 2020-11-16T22:05:34.061620+0000 mon.a (mon.0) 957 : cluster [DBG] osdmap e308: 12 total, 12 up, 12 in 2020-11-16T22:05:35.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:35 smithi195 bash[10218]: cluster 2020-11-16T22:05:34.941203+0000 mon.a (mon.0) 958 : cluster [DBG] osdmap e309: 12 total, 12 up, 12 in 2020-11-16T22:05:35.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:35 smithi057 bash[10301]: cluster 2020-11-16T22:05:33.643328+0000 mgr.x (mgr.24115) 388 : cluster [DBG] pgmap v625: 17 pgs: 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 14 active+clean; 272 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 4.0 MiB/s wr, 25 op/s 2020-11-16T22:05:35.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:35 smithi057 bash[10301]: cluster 2020-11-16T22:05:34.061620+0000 mon.a (mon.0) 957 : cluster [DBG] osdmap e308: 12 total, 12 up, 12 in 2020-11-16T22:05:35.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:35 smithi057 bash[10301]: cluster 2020-11-16T22:05:34.941203+0000 mon.a (mon.0) 958 : cluster [DBG] osdmap e309: 12 total, 12 up, 12 in 2020-11-16T22:05:35.944 INFO:tasks.rados.rados.2.smithi057.stdout:1022: done (5 left) 2020-11-16T22:05:35.945 INFO:tasks.rados.rados.2.smithi057.stdout:1023: delete oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 121 2020-11-16T22:05:35.945 INFO:tasks.rados.rados.2.smithi057.stdout:1017: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:35.945 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 437 (ObjNum 365 snap 121 seq_num 365) dirty exists 2020-11-16T22:05:35.945 INFO:tasks.rados.rados.2.smithi057.stdout:1017: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 365 snap 121 seq_num 365) 2020-11-16T22:05:35.945 INFO:tasks.rados.rados.2.smithi057.stdout:1018: finishing write tid 1 to smithi05720651-50 2020-11-16T22:05:35.946 INFO:tasks.rados.rados.2.smithi057.stdout:1018: finishing write tid 2 to smithi05720651-50 2020-11-16T22:05:35.946 INFO:tasks.rados.rados.2.smithi057.stdout:1018: finishing write tid 4 to smithi05720651-50 2020-11-16T22:05:35.946 INFO:tasks.rados.rados.2.smithi057.stdout:1018: finishing write tid 5 to smithi05720651-50 2020-11-16T22:05:35.946 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 830 (ObjNum 366 snap 121 seq_num 366) dirty exists 2020-11-16T22:05:35.946 INFO:tasks.rados.rados.2.smithi057.stdout:1018: left oid 50 (ObjNum 366 snap 121 seq_num 366) 2020-11-16T22:05:35.946 INFO:tasks.rados.rados.2.smithi057.stdout:1020: finishing write tid 1 to smithi05720651-14 2020-11-16T22:05:35.947 INFO:tasks.rados.rados.2.smithi057.stdout:1019: finishing copy_from to smithi05720651-40 2020-11-16T22:05:35.947 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 529 (ObjNum 261 snap 86 seq_num 261) dirty exists 2020-11-16T22:05:35.947 INFO:tasks.rados.rados.2.smithi057.stdout:1019: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:05:35.947 INFO:tasks.rados.rados.2.smithi057.stdout:1020: finishing write tid 2 to smithi05720651-14 2020-11-16T22:05:35.947 INFO:tasks.rados.rados.2.smithi057.stdout:1020: finishing write tid 4 to smithi05720651-14 2020-11-16T22:05:35.947 INFO:tasks.rados.rados.2.smithi057.stdout:1020: finishing write tid 5 to smithi05720651-14 2020-11-16T22:05:35.947 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 996 (ObjNum 367 snap 121 seq_num 367) dirty exists 2020-11-16T22:05:35.947 INFO:tasks.rados.rados.2.smithi057.stdout:1020: left oid 14 (ObjNum 367 snap 121 seq_num 367) 2020-11-16T22:05:35.948 INFO:tasks.rados.rados.2.smithi057.stdout:1021: finishing write tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:35.948 INFO:tasks.rados.rados.2.smithi057.stdout:1021: finishing write tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:35.948 INFO:tasks.rados.rados.2.smithi057.stdout:1021: finishing write tid 4 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:35.948 INFO:tasks.rados.rados.2.smithi057.stdout:1021: finishing write tid 5 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:35.948 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 588 (ObjNum 368 snap 121 seq_num 368) dirty exists 2020-11-16T22:05:35.948 INFO:tasks.rados.rados.2.smithi057.stdout:1021: left oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 368 snap 121 seq_num 368) 2020-11-16T22:05:35.955 INFO:tasks.rados.rados.2.smithi057.stdout:1017: done (5 left) 2020-11-16T22:05:35.955 INFO:tasks.rados.rados.2.smithi057.stdout:1018: done (4 left) 2020-11-16T22:05:35.955 INFO:tasks.rados.rados.2.smithi057.stdout:1019: done (3 left) 2020-11-16T22:05:35.955 INFO:tasks.rados.rados.2.smithi057.stdout:1020: done (2 left) 2020-11-16T22:05:35.955 INFO:tasks.rados.rados.2.smithi057.stdout:1021: done (1 left) 2020-11-16T22:05:35.956 INFO:tasks.rados.rados.2.smithi057.stdout:1023: done (0 left) 2020-11-16T22:05:35.956 INFO:tasks.rados.rados.2.smithi057.stdout:1024: copy_from oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 38 current snap is 121 2020-11-16T22:05:35.956 INFO:tasks.rados.rados.2.smithi057.stdout:1025: rollback oid 24 current snap is 121 2020-11-16T22:05:35.956 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 24 to 114 2020-11-16T22:05:35.956 INFO:tasks.rados.rados.2.smithi057.stdout:1026: copy_from oid 10 from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 121 2020-11-16T22:05:35.956 INFO:tasks.rados.rados.2.smithi057.stdout:1027: read oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:35.956 INFO:tasks.rados.rados.2.smithi057.stdout:1027: expect deleted 2020-11-16T22:05:35.957 INFO:tasks.rados.rados.2.smithi057.stdout:1028: snap_create 2020-11-16T22:05:35.959 INFO:tasks.rados.rados.2.smithi057.stdout:1025: finishing rollback tid 0 to smithi05720651-24 2020-11-16T22:05:35.959 INFO:tasks.rados.rados.2.smithi057.stdout:1025: finishing rollback tid 1 to smithi05720651-24 2020-11-16T22:05:35.959 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 651 (ObjNum 129 snap 0 seq_num 2932322304) dirty dne 2020-11-16T22:05:35.968 INFO:tasks.rados.rados.2.smithi057.stdout:1024: finishing copy_from to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:35.968 INFO:tasks.rados.rados.2.smithi057.stdout:1024: got expected ENOENT (src dne) 2020-11-16T22:05:35.968 INFO:tasks.rados.rados.2.smithi057.stdout:1024: finishing copy_from racing read to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:35.984 INFO:tasks.rados.rados.2.smithi057.stdout:1026: finishing copy_from to smithi05720651-10 2020-11-16T22:05:35.984 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 43 (ObjNum 112 snap 34 seq_num 112) dirty exists 2020-11-16T22:05:35.984 INFO:tasks.rados.rados.2.smithi057.stdout:1026: finishing copy_from racing read to smithi05720651-10 2020-11-16T22:05:36.947 INFO:tasks.rados.rados.2.smithi057.stdout:1024: done (4 left) 2020-11-16T22:05:36.947 INFO:tasks.rados.rados.2.smithi057.stdout:1025: done (3 left) 2020-11-16T22:05:36.948 INFO:tasks.rados.rados.2.smithi057.stdout:1026: done (2 left) 2020-11-16T22:05:36.948 INFO:tasks.rados.rados.2.smithi057.stdout:1027: done (1 left) 2020-11-16T22:05:36.948 INFO:tasks.rados.rados.2.smithi057.stdout:1028: done (0 left) 2020-11-16T22:05:36.948 INFO:tasks.rados.rados.2.smithi057.stdout:1029: read oid 12 snap -1 2020-11-16T22:05:36.948 INFO:tasks.rados.rados.2.smithi057.stdout:1029: expect (ObjNum 329 snap 113 seq_num 329) 2020-11-16T22:05:36.948 INFO:tasks.rados.rados.2.smithi057.stdout:1030: snap_create 2020-11-16T22:05:36.964 INFO:tasks.rados.rados.2.smithi057.stdout:1029: expect (ObjNum 329 snap 113 seq_num 329) 2020-11-16T22:05:37.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:36 smithi016 bash[10302]: cluster 2020-11-16T22:05:35.644063+0000 mgr.x (mgr.24115) 389 : cluster [DBG] pgmap v628: 17 pgs: 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 14 active+clean; 276 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 508 KiB/s wr, 9 op/s 2020-11-16T22:05:37.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:36 smithi016 bash[10302]: cluster 2020-11-16T22:05:35.951772+0000 mon.a (mon.0) 959 : cluster [DBG] osdmap e310: 12 total, 12 up, 12 in 2020-11-16T22:05:37.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:36 smithi195 bash[10218]: cluster 2020-11-16T22:05:35.644063+0000 mgr.x (mgr.24115) 389 : cluster [DBG] pgmap v628: 17 pgs: 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 14 active+clean; 276 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 508 KiB/s wr, 9 op/s 2020-11-16T22:05:37.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:36 smithi195 bash[10218]: cluster 2020-11-16T22:05:35.951772+0000 mon.a (mon.0) 959 : cluster [DBG] osdmap e310: 12 total, 12 up, 12 in 2020-11-16T22:05:37.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:36 smithi057 bash[10301]: cluster 2020-11-16T22:05:35.644063+0000 mgr.x (mgr.24115) 389 : cluster [DBG] pgmap v628: 17 pgs: 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait, 14 active+clean; 276 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 508 KiB/s wr, 9 op/s 2020-11-16T22:05:37.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:36 smithi057 bash[10301]: cluster 2020-11-16T22:05:35.951772+0000 mon.a (mon.0) 959 : cluster [DBG] osdmap e310: 12 total, 12 up, 12 in 2020-11-16T22:05:37.967 INFO:tasks.rados.rados.2.smithi057.stdout:1029: done (1 left) 2020-11-16T22:05:37.968 INFO:tasks.rados.rados.2.smithi057.stdout:1030: done (0 left) 2020-11-16T22:05:37.968 INFO:tasks.rados.rados.2.smithi057.stdout:1031: delete oid 2 current snap is 123 2020-11-16T22:05:37.975 INFO:tasks.rados.rados.2.smithi057.stdout:1031: done (0 left) 2020-11-16T22:05:37.975 INFO:tasks.rados.rados.2.smithi057.stdout:1032: rollback oid 6 current snap is 123 2020-11-16T22:05:37.975 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 6 to 112 2020-11-16T22:05:37.976 INFO:tasks.rados.rados.2.smithi057.stdout:1033: read oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:37.976 INFO:tasks.rados.rados.2.smithi057.stdout:1033: expect deleted 2020-11-16T22:05:37.976 INFO:tasks.rados.rados.2.smithi057.stdout:1034: copy_from oid 18 from oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 123 2020-11-16T22:05:37.976 INFO:tasks.rados.rados.2.smithi057.stdout:1035: rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 123 2020-11-16T22:05:37.976 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 120 2020-11-16T22:05:37.976 INFO:tasks.rados.rados.2.smithi057.stdout:1036: write (excl) oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 123 2020-11-16T22:05:37.976 INFO:tasks.rados.rados.2.smithi057.stdout:1036: seq_num 371 ranges {635397=702323,1893643=341754} 2020-11-16T22:05:37.991 INFO:tasks.rados.rados.2.smithi057.stdout:1036: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 635397 to 1337720 tid 1 2020-11-16T22:05:37.997 INFO:tasks.rados.rados.2.smithi057.stdout:1036: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1893643 to 2235397 tid 2 2020-11-16T22:05:37.997 INFO:tasks.rados.rados.2.smithi057.stdout:1037: write (excl) oid 14 current snap is 123 2020-11-16T22:05:37.997 INFO:tasks.rados.rados.2.smithi057.stdout:1037: seq_num 372 ranges {652204=777572,1952125=300079} 2020-11-16T22:05:38.005 INFO:tasks.rados.rados.2.smithi057.stdout:1037: writing smithi05720651-14 from 652204 to 1429776 tid 1 2020-11-16T22:05:38.010 INFO:tasks.rados.rados.2.smithi057.stdout:1037: writing smithi05720651-14 from 1952125 to 2252204 tid 2 2020-11-16T22:05:38.010 INFO:tasks.rados.rados.2.smithi057.stdout:1038: read oid 38 snap -1 2020-11-16T22:05:38.010 INFO:tasks.rados.rados.2.smithi057.stdout:1038: expect deleted 2020-11-16T22:05:38.010 INFO:tasks.rados.rados.2.smithi057.stdout:1039: write oid 24 current snap is 123 2020-11-16T22:05:38.010 INFO:tasks.rados.rados.2.smithi057.stdout:1039: seq_num 373 ranges {669011=569174,2010607=258404} 2020-11-16T22:05:38.017 INFO:tasks.rados.rados.2.smithi057.stdout:1039: writing smithi05720651-24 from 669011 to 1238185 tid 1 2020-11-16T22:05:38.023 INFO:tasks.rados.rados.2.smithi057.stdout:1039: writing smithi05720651-24 from 2010607 to 2269011 tid 2 2020-11-16T22:05:38.023 INFO:tasks.rados.rados.2.smithi057.stdout:1040: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:38.023 INFO:tasks.rados.rados.2.smithi057.stdout:1040: expect (ObjNum 358 snap 118 seq_num 358) 2020-11-16T22:05:38.023 INFO:tasks.rados.rados.2.smithi057.stdout:1041: write oid 50 current snap is 123 2020-11-16T22:05:38.023 INFO:tasks.rados.rados.2.smithi057.stdout:1041: seq_num 374 ranges {685818=644423,2069089=216729} 2020-11-16T22:05:38.031 INFO:tasks.rados.rados.2.smithi057.stdout:1041: writing smithi05720651-50 from 685818 to 1330241 tid 1 2020-11-16T22:05:38.037 INFO:tasks.rados.rados.2.smithi057.stdout:1041: writing smithi05720651-50 from 2069089 to 2285818 tid 2 2020-11-16T22:05:38.037 INFO:tasks.rados.rados.2.smithi057.stdout:1042: write (excl) oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 123 2020-11-16T22:05:38.037 INFO:tasks.rados.rados.2.smithi057.stdout:1042: seq_num 375 ranges {702625=719672,2127571=175054} 2020-11-16T22:05:38.045 INFO:tasks.rados.rados.2.smithi057.stdout:1042: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 702625 to 1422297 tid 1 2020-11-16T22:05:38.050 INFO:tasks.rados.rados.2.smithi057.stdout:1042: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2127571 to 2302625 tid 2 2020-11-16T22:05:38.051 INFO:tasks.rados.rados.2.smithi057.stdout:1043: snap_create 2020-11-16T22:05:38.051 INFO:tasks.rados.rados.2.smithi057.stdout:1035: finishing rollback tid 0 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:38.051 INFO:tasks.rados.rados.2.smithi057.stdout:1035: finishing rollback tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:38.051 INFO:tasks.rados.rados.2.smithi057.stdout:1035: finishing rollback tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:38.051 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 839 (ObjNum 334 snap 114 seq_num 334) dirty exists 2020-11-16T22:05:38.051 INFO:tasks.rados.rados.2.smithi057.stdout:1032: finishing rollback tid 0 to smithi05720651-6 2020-11-16T22:05:38.051 INFO:tasks.rados.rados.2.smithi057.stdout:1032: finishing rollback tid 1 to smithi05720651-6 2020-11-16T22:05:38.052 INFO:tasks.rados.rados.2.smithi057.stdout:1032: finishing rollback tid 2 to smithi05720651-6 2020-11-16T22:05:38.052 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 850 (ObjNum 264 snap 86 seq_num 264) dirty exists 2020-11-16T22:05:38.052 INFO:tasks.rados.rados.2.smithi057.stdout:1036: finishing write tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:38.052 INFO:tasks.rados.rados.2.smithi057.stdout:1034: finishing copy_from to smithi05720651-18 2020-11-16T22:05:38.052 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 684 (ObjNum 333 snap 114 seq_num 333) dirty exists 2020-11-16T22:05:38.052 INFO:tasks.rados.rados.2.smithi057.stdout:1034: finishing copy_from racing read to smithi05720651-18 2020-11-16T22:05:38.052 INFO:tasks.rados.rados.2.smithi057.stdout:1036: finishing write tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:38.053 INFO:tasks.rados.rados.2.smithi057.stdout:1036: finishing write tid 4 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:38.053 INFO:tasks.rados.rados.2.smithi057.stdout:1036: finishing write tid 5 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:38.053 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 853 (ObjNum 371 snap 123 seq_num 371) dirty exists 2020-11-16T22:05:38.053 INFO:tasks.rados.rados.2.smithi057.stdout:1036: left oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 371 snap 123 seq_num 371) 2020-11-16T22:05:38.053 INFO:tasks.rados.rados.2.smithi057.stdout:1037: finishing write tid 1 to smithi05720651-14 2020-11-16T22:05:38.053 INFO:tasks.rados.rados.2.smithi057.stdout:1037: finishing write tid 2 to smithi05720651-14 2020-11-16T22:05:38.053 INFO:tasks.rados.rados.2.smithi057.stdout:1037: finishing write tid 4 to smithi05720651-14 2020-11-16T22:05:38.054 INFO:tasks.rados.rados.2.smithi057.stdout:1037: finishing write tid 5 to smithi05720651-14 2020-11-16T22:05:38.054 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 1014 (ObjNum 372 snap 123 seq_num 372) dirty exists 2020-11-16T22:05:38.054 INFO:tasks.rados.rados.2.smithi057.stdout:1037: left oid 14 (ObjNum 372 snap 123 seq_num 372) 2020-11-16T22:05:38.054 INFO:tasks.rados.rados.2.smithi057.stdout:1039: finishing write tid 1 to smithi05720651-24 2020-11-16T22:05:38.054 INFO:tasks.rados.rados.2.smithi057.stdout:1039: finishing write tid 2 to smithi05720651-24 2020-11-16T22:05:38.054 INFO:tasks.rados.rados.2.smithi057.stdout:1039: finishing write tid 4 to smithi05720651-24 2020-11-16T22:05:38.054 INFO:tasks.rados.rados.2.smithi057.stdout:1039: finishing write tid 5 to smithi05720651-24 2020-11-16T22:05:38.055 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 654 (ObjNum 373 snap 123 seq_num 373) dirty exists 2020-11-16T22:05:38.055 INFO:tasks.rados.rados.2.smithi057.stdout:1039: left oid 24 (ObjNum 373 snap 123 seq_num 373) 2020-11-16T22:05:38.055 INFO:tasks.rados.rados.2.smithi057.stdout:1040: expect (ObjNum 358 snap 118 seq_num 358) 2020-11-16T22:05:38.171 INFO:tasks.rados.rados.2.smithi057.stdout:1041: finishing write tid 1 to smithi05720651-50 2020-11-16T22:05:38.171 INFO:tasks.rados.rados.2.smithi057.stdout:1041: finishing write tid 2 to smithi05720651-50 2020-11-16T22:05:38.171 INFO:tasks.rados.rados.2.smithi057.stdout:1041: finishing write tid 4 to smithi05720651-50 2020-11-16T22:05:38.171 INFO:tasks.rados.rados.2.smithi057.stdout:1041: finishing write tid 5 to smithi05720651-50 2020-11-16T22:05:38.171 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 857 (ObjNum 374 snap 123 seq_num 374) dirty exists 2020-11-16T22:05:38.172 INFO:tasks.rados.rados.2.smithi057.stdout:1041: left oid 50 (ObjNum 374 snap 123 seq_num 374) 2020-11-16T22:05:38.172 INFO:tasks.rados.rados.2.smithi057.stdout:1042: finishing write tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:38.172 INFO:tasks.rados.rados.2.smithi057.stdout:1042: finishing write tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:38.172 INFO:tasks.rados.rados.2.smithi057.stdout:1042: finishing write tid 4 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:38.172 INFO:tasks.rados.rados.2.smithi057.stdout:1042: finishing write tid 5 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:38.172 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 597 (ObjNum 375 snap 123 seq_num 375) dirty exists 2020-11-16T22:05:38.173 INFO:tasks.rados.rados.2.smithi057.stdout:1042: left oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 375 snap 123 seq_num 375) 2020-11-16T22:05:38.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:37 smithi016 bash[10302]: cluster 2020-11-16T22:05:36.954580+0000 mon.a (mon.0) 960 : cluster [DBG] osdmap e311: 12 total, 12 up, 12 in 2020-11-16T22:05:38.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:37 smithi195 bash[10218]: cluster 2020-11-16T22:05:36.954580+0000 mon.a (mon.0) 960 : cluster [DBG] osdmap e311: 12 total, 12 up, 12 in 2020-11-16T22:05:38.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:37 smithi057 bash[10301]: cluster 2020-11-16T22:05:36.954580+0000 mon.a (mon.0) 960 : cluster [DBG] osdmap e311: 12 total, 12 up, 12 in 2020-11-16T22:05:38.977 INFO:tasks.rados.rados.2.smithi057.stdout:1032: done (11 left) 2020-11-16T22:05:38.977 INFO:tasks.rados.rados.2.smithi057.stdout:1033: done (10 left) 2020-11-16T22:05:38.978 INFO:tasks.rados.rados.2.smithi057.stdout:1034: done (9 left) 2020-11-16T22:05:38.978 INFO:tasks.rados.rados.2.smithi057.stdout:1035: done (8 left) 2020-11-16T22:05:38.978 INFO:tasks.rados.rados.2.smithi057.stdout:1036: done (7 left) 2020-11-16T22:05:38.978 INFO:tasks.rados.rados.2.smithi057.stdout:1037: done (6 left) 2020-11-16T22:05:38.978 INFO:tasks.rados.rados.2.smithi057.stdout:1038: done (5 left) 2020-11-16T22:05:38.978 INFO:tasks.rados.rados.2.smithi057.stdout:1039: done (4 left) 2020-11-16T22:05:38.978 INFO:tasks.rados.rados.2.smithi057.stdout:1040: done (3 left) 2020-11-16T22:05:38.979 INFO:tasks.rados.rados.2.smithi057.stdout:1041: done (2 left) 2020-11-16T22:05:38.979 INFO:tasks.rados.rados.2.smithi057.stdout:1042: done (1 left) 2020-11-16T22:05:38.979 INFO:tasks.rados.rados.2.smithi057.stdout:1043: done (0 left) 2020-11-16T22:05:38.979 INFO:tasks.rados.rados.2.smithi057.stdout:1044: write (excl) oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 124 2020-11-16T22:05:38.979 INFO:tasks.rados.rados.2.smithi057.stdout:1044: seq_num 376 ranges {719432=794921,2186053=133379} 2020-11-16T22:05:38.990 INFO:tasks.rados.rados.2.smithi057.stdout:1044: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 719432 to 1514353 tid 1 2020-11-16T22:05:38.995 INFO:tasks.rados.rados.2.smithi057.stdout:1044: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2186053 to 2319432 tid 2 2020-11-16T22:05:38.995 INFO:tasks.rados.rados.2.smithi057.stdout:1045: delete oid 40 current snap is 124 2020-11-16T22:05:39.004 INFO:tasks.rados.rados.2.smithi057.stdout:1044: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:39.006 INFO:tasks.rados.rados.2.smithi057.stdout:1045: done (1 left) 2020-11-16T22:05:39.006 INFO:tasks.rados.rados.2.smithi057.stdout:1046: write oid 38 current snap is 124 2020-11-16T22:05:39.007 INFO:tasks.rados.rados.2.smithi057.stdout:1046: seq_num 378 ranges {753046=545419,1786664=431793} 2020-11-16T22:05:39.018 INFO:tasks.rados.rados.2.smithi057.stdout:1046: writing smithi05720651-38 from 753046 to 1298465 tid 1 2020-11-16T22:05:39.024 INFO:tasks.rados.rados.2.smithi057.stdout:1046: writing smithi05720651-38 from 1786664 to 2218457 tid 2 2020-11-16T22:05:39.024 INFO:tasks.rados.rados.2.smithi057.stdout:1047: snap_remove snap 119 2020-11-16T22:05:39.025 INFO:tasks.rados.rados.2.smithi057.stdout:1044: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:38 smithi016 bash[10302]: cluster 2020-11-16T22:05:37.644743+0000 mgr.x (mgr.24115) 390 : cluster [DBG] pgmap v631: 17 pgs: 17 active+clean; 283 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2020-11-16T22:05:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:38 smithi016 bash[10302]: cluster 2020-11-16T22:05:37.978610+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e312: 12 total, 12 up, 12 in 2020-11-16T22:05:39.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:38 smithi195 bash[10218]: cluster 2020-11-16T22:05:37.644743+0000 mgr.x (mgr.24115) 390 : cluster [DBG] pgmap v631: 17 pgs: 17 active+clean; 283 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2020-11-16T22:05:39.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:38 smithi195 bash[10218]: cluster 2020-11-16T22:05:37.978610+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e312: 12 total, 12 up, 12 in 2020-11-16T22:05:39.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:38 smithi057 bash[10301]: cluster 2020-11-16T22:05:37.644743+0000 mgr.x (mgr.24115) 390 : cluster [DBG] pgmap v631: 17 pgs: 17 active+clean; 283 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.3 MiB/s wr, 15 op/s 2020-11-16T22:05:39.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:38 smithi057 bash[10301]: cluster 2020-11-16T22:05:37.978610+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e312: 12 total, 12 up, 12 in 2020-11-16T22:05:39.933 INFO:tasks.rados.rados.2.smithi057.stdout:1047: done (2 left) 2020-11-16T22:05:39.933 INFO:tasks.rados.rados.2.smithi057.stdout:1048: snap_create 2020-11-16T22:05:39.933 INFO:tasks.rados.rados.2.smithi057.stdout:1044: finishing write tid 4 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:39.933 INFO:tasks.rados.rados.2.smithi057.stdout:1044: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:39.934 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 861 (ObjNum 376 snap 124 seq_num 376) dirty exists 2020-11-16T22:05:39.934 INFO:tasks.rados.rados.2.smithi057.stdout:1044: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 376 snap 124 seq_num 376) 2020-11-16T22:05:39.934 INFO:tasks.rados.rados.2.smithi057.stdout:1046: finishing write tid 1 to smithi05720651-38 2020-11-16T22:05:39.934 INFO:tasks.rados.rados.2.smithi057.stdout:1046: finishing write tid 2 to smithi05720651-38 2020-11-16T22:05:39.934 INFO:tasks.rados.rados.2.smithi057.stdout:1046: finishing write tid 4 to smithi05720651-38 2020-11-16T22:05:39.934 INFO:tasks.rados.rados.2.smithi057.stdout:1046: finishing write tid 5 to smithi05720651-38 2020-11-16T22:05:39.934 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 647 (ObjNum 378 snap 124 seq_num 378) dirty exists 2020-11-16T22:05:39.935 INFO:tasks.rados.rados.2.smithi057.stdout:1046: left oid 38 (ObjNum 378 snap 124 seq_num 378) 2020-11-16T22:05:40.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:39 smithi016 bash[10302]: cluster 2020-11-16T22:05:38.987407+0000 mon.a (mon.0) 962 : cluster [DBG] osdmap e313: 12 total, 12 up, 12 in 2020-11-16T22:05:40.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:39 smithi016 bash[10302]: cluster 2020-11-16T22:05:39.942611+0000 mon.a (mon.0) 963 : cluster [DBG] osdmap e314: 12 total, 12 up, 12 in 2020-11-16T22:05:40.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:39 smithi195 bash[10218]: cluster 2020-11-16T22:05:38.987407+0000 mon.a (mon.0) 962 : cluster [DBG] osdmap e313: 12 total, 12 up, 12 in 2020-11-16T22:05:40.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:39 smithi195 bash[10218]: cluster 2020-11-16T22:05:39.942611+0000 mon.a (mon.0) 963 : cluster [DBG] osdmap e314: 12 total, 12 up, 12 in 2020-11-16T22:05:40.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:39 smithi057 bash[10301]: cluster 2020-11-16T22:05:38.987407+0000 mon.a (mon.0) 962 : cluster [DBG] osdmap e313: 12 total, 12 up, 12 in 2020-11-16T22:05:40.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:39 smithi057 bash[10301]: cluster 2020-11-16T22:05:39.942611+0000 mon.a (mon.0) 963 : cluster [DBG] osdmap e314: 12 total, 12 up, 12 in 2020-11-16T22:05:40.943 INFO:tasks.rados.rados.2.smithi057.stdout:1044: done (2 left) 2020-11-16T22:05:40.943 INFO:tasks.rados.rados.2.smithi057.stdout:1046: done (1 left) 2020-11-16T22:05:40.944 INFO:tasks.rados.rados.2.smithi057.stdout:1048: done (0 left) 2020-11-16T22:05:40.944 INFO:tasks.rados.rados.2.smithi057.stdout:1049: snap_create 2020-11-16T22:05:41.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:40 smithi016 bash[10302]: cluster 2020-11-16T22:05:39.645541+0000 mgr.x (mgr.24115) 391 : cluster [DBG] pgmap v634: 17 pgs: 17 active+clean; 283 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.8 MiB/s wr, 7 op/s 2020-11-16T22:05:41.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:40 smithi016 bash[10302]: cluster 2020-11-16T22:05:40.952940+0000 mon.a (mon.0) 964 : cluster [DBG] osdmap e315: 12 total, 12 up, 12 in 2020-11-16T22:05:41.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:40 smithi195 bash[10218]: cluster 2020-11-16T22:05:39.645541+0000 mgr.x (mgr.24115) 391 : cluster [DBG] pgmap v634: 17 pgs: 17 active+clean; 283 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.8 MiB/s wr, 7 op/s 2020-11-16T22:05:41.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:40 smithi195 bash[10218]: cluster 2020-11-16T22:05:40.952940+0000 mon.a (mon.0) 964 : cluster [DBG] osdmap e315: 12 total, 12 up, 12 in 2020-11-16T22:05:41.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:40 smithi057 bash[10301]: cluster 2020-11-16T22:05:39.645541+0000 mgr.x (mgr.24115) 391 : cluster [DBG] pgmap v634: 17 pgs: 17 active+clean; 283 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.8 MiB/s wr, 7 op/s 2020-11-16T22:05:41.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:40 smithi057 bash[10301]: cluster 2020-11-16T22:05:40.952940+0000 mon.a (mon.0) 964 : cluster [DBG] osdmap e315: 12 total, 12 up, 12 in 2020-11-16T22:05:41.946 INFO:tasks.rados.rados.2.smithi057.stdout:1049: done (0 left) 2020-11-16T22:05:41.947 INFO:tasks.rados.rados.2.smithi057.stdout:1050: read oid 6 snap -1 2020-11-16T22:05:41.947 INFO:tasks.rados.rados.2.smithi057.stdout:1050: expect (ObjNum 264 snap 86 seq_num 264) 2020-11-16T22:05:41.947 INFO:tasks.rados.rados.2.smithi057.stdout:1051: copy_from oid 26 from oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 126 2020-11-16T22:05:41.947 INFO:tasks.rados.rados.2.smithi057.stdout:1052: write oid 14 current snap is 126 2020-11-16T22:05:41.948 INFO:tasks.rados.rados.2.smithi057.stdout:1052: seq_num 379 ranges {769853=620668,1845146=524707} 2020-11-16T22:05:41.961 INFO:tasks.rados.rados.2.smithi057.stdout:1052: writing smithi05720651-14 from 769853 to 1390521 tid 1 2020-11-16T22:05:41.968 INFO:tasks.rados.rados.2.smithi057.stdout:1052: writing smithi05720651-14 from 1845146 to 2369853 tid 2 2020-11-16T22:05:41.968 INFO:tasks.rados.rados.2.smithi057.stdout:1053: delete oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 126 2020-11-16T22:05:41.969 INFO:tasks.rados.rados.2.smithi057.stdout:1050: expect (ObjNum 264 snap 86 seq_num 264) 2020-11-16T22:05:42.113 INFO:tasks.rados.rados.2.smithi057.stdout:1051: finishing copy_from to smithi05720651-26 2020-11-16T22:05:42.114 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 861 (ObjNum 376 snap 124 seq_num 376) dirty exists 2020-11-16T22:05:42.114 INFO:tasks.rados.rados.2.smithi057.stdout:1051: finishing copy_from racing read to smithi05720651-26 2020-11-16T22:05:42.114 INFO:tasks.rados.rados.2.smithi057.stdout:1052: finishing write tid 1 to smithi05720651-14 2020-11-16T22:05:42.114 INFO:tasks.rados.rados.2.smithi057.stdout:1052: finishing write tid 2 to smithi05720651-14 2020-11-16T22:05:42.115 INFO:tasks.rados.rados.2.smithi057.stdout:1052: finishing write tid 4 to smithi05720651-14 2020-11-16T22:05:42.115 INFO:tasks.rados.rados.2.smithi057.stdout:1052: finishing write tid 5 to smithi05720651-14 2020-11-16T22:05:42.115 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 1028 (ObjNum 379 snap 126 seq_num 379) dirty exists 2020-11-16T22:05:42.115 INFO:tasks.rados.rados.2.smithi057.stdout:1052: left oid 14 (ObjNum 379 snap 126 seq_num 379) 2020-11-16T22:05:42.115 INFO:tasks.rados.rados.2.smithi057.stdout:1050: done (3 left) 2020-11-16T22:05:42.115 INFO:tasks.rados.rados.2.smithi057.stdout:1051: done (2 left) 2020-11-16T22:05:42.115 INFO:tasks.rados.rados.2.smithi057.stdout:1052: done (1 left) 2020-11-16T22:05:42.116 INFO:tasks.rados.rados.2.smithi057.stdout:1053: done (0 left) 2020-11-16T22:05:42.116 INFO:tasks.rados.rados.2.smithi057.stdout:1054: snap_remove snap 112 2020-11-16T22:05:42.993 INFO:tasks.rados.rados.2.smithi057.stdout:1054: done (0 left) 2020-11-16T22:05:42.993 INFO:tasks.rados.rados.2.smithi057.stdout:1055: read oid 26 snap -1 2020-11-16T22:05:42.994 INFO:tasks.rados.rados.2.smithi057.stdout:1055: expect (ObjNum 376 snap 124 seq_num 376) 2020-11-16T22:05:42.994 INFO:tasks.rados.rados.2.smithi057.stdout:1056: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 114 2020-11-16T22:05:42.994 INFO:tasks.rados.rados.2.smithi057.stdout:1056: expect (ObjNum 322 snap 111 seq_num 322) 2020-11-16T22:05:42.994 INFO:tasks.rados.rados.2.smithi057.stdout:1057: read oid 18 snap 96 2020-11-16T22:05:42.994 INFO:tasks.rados.rados.2.smithi057.stdout:1057: expect (ObjNum 243 snap 81 seq_num 243) 2020-11-16T22:05:42.994 INFO:tasks.rados.rados.2.smithi057.stdout:1058: write (excl) oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 126 2020-11-16T22:05:42.995 INFO:tasks.rados.rados.2.smithi057.stdout:1058: seq_num 381 ranges {403467=487519,1562110=579120} 2020-11-16T22:05:43.004 INFO:tasks.rados.rados.2.smithi057.stdout:1058: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 403467 to 890986 tid 1 2020-11-16T22:05:43.013 INFO:tasks.rados.rados.2.smithi057.stdout:1058: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1562110 to 2141230 tid 2 2020-11-16T22:05:43.013 INFO:tasks.rados.rados.2.smithi057.stdout:1059: snap_remove snap 124 2020-11-16T22:05:43.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:42 smithi057 bash[10301]: cluster 2020-11-16T22:05:41.646225+0000 mgr.x (mgr.24115) 392 : cluster [DBG] pgmap v637: 17 pgs: 17 active+clean; 300 MiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 3.6 MiB/s wr, 19 op/s 2020-11-16T22:05:43.196 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:42 smithi057 bash[10301]: cluster 2020-11-16T22:05:41.955385+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e316: 12 total, 12 up, 12 in 2020-11-16T22:05:43.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:42 smithi016 bash[10302]: cluster 2020-11-16T22:05:41.646225+0000 mgr.x (mgr.24115) 392 : cluster [DBG] pgmap v637: 17 pgs: 17 active+clean; 300 MiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 3.6 MiB/s wr, 19 op/s 2020-11-16T22:05:43.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:42 smithi016 bash[10302]: cluster 2020-11-16T22:05:41.955385+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e316: 12 total, 12 up, 12 in 2020-11-16T22:05:43.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:42 smithi195 bash[10218]: cluster 2020-11-16T22:05:41.646225+0000 mgr.x (mgr.24115) 392 : cluster [DBG] pgmap v637: 17 pgs: 17 active+clean; 300 MiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 3.6 MiB/s wr, 19 op/s 2020-11-16T22:05:43.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:42 smithi195 bash[10218]: cluster 2020-11-16T22:05:41.955385+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e316: 12 total, 12 up, 12 in 2020-11-16T22:05:44.009 INFO:tasks.rados.rados.2.smithi057.stdout:1059: done (4 left) 2020-11-16T22:05:44.009 INFO:tasks.rados.rados.2.smithi057.stdout:1060: snap_create 2020-11-16T22:05:44.009 INFO:tasks.rados.rados.2.smithi057.stdout:1056: expect (ObjNum 322 snap 111 seq_num 322) 2020-11-16T22:05:44.205 INFO:tasks.rados.rados.2.smithi057.stdout:1057: expect (ObjNum 243 snap 81 seq_num 243) 2020-11-16T22:05:44.287 INFO:tasks.rados.rados.2.smithi057.stdout:1055: expect (ObjNum 376 snap 124 seq_num 376) 2020-11-16T22:05:44.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:44 smithi016 bash[10302]: cluster 2020-11-16T22:05:43.003239+0000 mon.a (mon.0) 966 : cluster [DBG] osdmap e317: 12 total, 12 up, 12 in 2020-11-16T22:05:44.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:44 smithi195 bash[10218]: cluster 2020-11-16T22:05:43.003239+0000 mon.a (mon.0) 966 : cluster [DBG] osdmap e317: 12 total, 12 up, 12 in 2020-11-16T22:05:44.381 INFO:tasks.rados.rados.2.smithi057.stdout:1058: finishing write tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:44.382 INFO:tasks.rados.rados.2.smithi057.stdout:1058: finishing write tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:44.382 INFO:tasks.rados.rados.2.smithi057.stdout:1058: finishing write tid 4 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:44.382 INFO:tasks.rados.rados.2.smithi057.stdout:1058: finishing write tid 5 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:44.382 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 849 (ObjNum 381 snap 126 seq_num 381) dirty exists 2020-11-16T22:05:44.382 INFO:tasks.rados.rados.2.smithi057.stdout:1058: left oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 381 snap 126 seq_num 381) 2020-11-16T22:05:44.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:44 smithi057 bash[10301]: cluster 2020-11-16T22:05:43.003239+0000 mon.a (mon.0) 966 : cluster [DBG] osdmap e317: 12 total, 12 up, 12 in 2020-11-16T22:05:44.941 INFO:tasks.rados.rados.2.smithi057.stdout:1055: done (4 left) 2020-11-16T22:05:44.941 INFO:tasks.rados.rados.2.smithi057.stdout:1056: done (3 left) 2020-11-16T22:05:44.941 INFO:tasks.rados.rados.2.smithi057.stdout:1057: done (2 left) 2020-11-16T22:05:44.941 INFO:tasks.rados.rados.2.smithi057.stdout:1058: done (1 left) 2020-11-16T22:05:44.941 INFO:tasks.rados.rados.2.smithi057.stdout:1060: done (0 left) 2020-11-16T22:05:44.942 INFO:tasks.rados.rados.2.smithi057.stdout:1061: delete oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 127 2020-11-16T22:05:45.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:45 smithi016 bash[10302]: cluster 2020-11-16T22:05:43.646860+0000 mgr.x (mgr.24115) 393 : cluster [DBG] pgmap v640: 17 pgs: 17 active+clean; 300 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 3.6 MiB/s wr, 19 op/s 2020-11-16T22:05:45.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:45 smithi016 bash[10302]: cluster 2020-11-16T22:05:44.012948+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e318: 12 total, 12 up, 12 in 2020-11-16T22:05:45.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:45 smithi016 bash[10302]: cluster 2020-11-16T22:05:44.944331+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e319: 12 total, 12 up, 12 in 2020-11-16T22:05:45.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:45 smithi195 bash[10218]: cluster 2020-11-16T22:05:43.646860+0000 mgr.x (mgr.24115) 393 : cluster [DBG] pgmap v640: 17 pgs: 17 active+clean; 300 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 3.6 MiB/s wr, 19 op/s 2020-11-16T22:05:45.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:45 smithi195 bash[10218]: cluster 2020-11-16T22:05:44.012948+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e318: 12 total, 12 up, 12 in 2020-11-16T22:05:45.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:45 smithi195 bash[10218]: cluster 2020-11-16T22:05:44.944331+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e319: 12 total, 12 up, 12 in 2020-11-16T22:05:45.395 INFO:tasks.rados.rados.2.smithi057.stdout:1061: done (0 left) 2020-11-16T22:05:45.396 INFO:tasks.rados.rados.2.smithi057.stdout:1062: read oid 48 snap -1 2020-11-16T22:05:45.396 INFO:tasks.rados.rados.2.smithi057.stdout:1062: expect (ObjNum 144 snap 44 seq_num 144) 2020-11-16T22:05:45.396 INFO:tasks.rados.rados.2.smithi057.stdout:1063: write (excl) oid 4 current snap is 127 2020-11-16T22:05:45.396 INFO:tasks.rados.rados.2.smithi057.stdout:1063: seq_num 383 ranges {437081=638017,1679074=582789} 2020-11-16T22:05:45.413 INFO:tasks.rados.rados.2.smithi057.stdout:1063: writing smithi05720651-4 from 437081 to 1075098 tid 1 2020-11-16T22:05:45.420 INFO:tasks.rados.rados.2.smithi057.stdout:1063: writing smithi05720651-4 from 1679074 to 2261863 tid 2 2020-11-16T22:05:45.420 INFO:tasks.rados.rados.2.smithi057.stdout:1064: copy_from oid 26 from oid 6 current snap is 127 2020-11-16T22:05:45.420 INFO:tasks.rados.rados.2.smithi057.stdout:1062: expect (ObjNum 144 snap 44 seq_num 144) 2020-11-16T22:05:45.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:45 smithi057 bash[10301]: cluster 2020-11-16T22:05:43.646860+0000 mgr.x (mgr.24115) 393 : cluster [DBG] pgmap v640: 17 pgs: 17 active+clean; 300 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 3.6 MiB/s wr, 19 op/s 2020-11-16T22:05:45.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:45 smithi057 bash[10301]: cluster 2020-11-16T22:05:44.012948+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e318: 12 total, 12 up, 12 in 2020-11-16T22:05:45.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:45 smithi057 bash[10301]: cluster 2020-11-16T22:05:44.944331+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e319: 12 total, 12 up, 12 in 2020-11-16T22:05:45.577 INFO:tasks.rados.rados.2.smithi057.stdout:1063: finishing write tid 1 to smithi05720651-4 2020-11-16T22:05:45.577 INFO:tasks.rados.rados.2.smithi057.stdout:1063: finishing write tid 2 to smithi05720651-4 2020-11-16T22:05:45.577 INFO:tasks.rados.rados.2.smithi057.stdout:1063: finishing write tid 4 to smithi05720651-4 2020-11-16T22:05:45.577 INFO:tasks.rados.rados.2.smithi057.stdout:1063: finishing write tid 5 to smithi05720651-4 2020-11-16T22:05:45.578 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 338 (ObjNum 383 snap 127 seq_num 383) dirty exists 2020-11-16T22:05:45.578 INFO:tasks.rados.rados.2.smithi057.stdout:1063: left oid 4 (ObjNum 383 snap 127 seq_num 383) 2020-11-16T22:05:45.578 INFO:tasks.rados.rados.2.smithi057.stdout:1064: finishing copy_from to smithi05720651-26 2020-11-16T22:05:45.578 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 850 (ObjNum 264 snap 86 seq_num 264) dirty exists 2020-11-16T22:05:45.578 INFO:tasks.rados.rados.2.smithi057.stdout:1064: finishing copy_from racing read to smithi05720651-26 2020-11-16T22:05:45.578 INFO:tasks.rados.rados.2.smithi057.stdout:1062: done (2 left) 2020-11-16T22:05:45.579 INFO:tasks.rados.rados.2.smithi057.stdout:1063: done (1 left) 2020-11-16T22:05:45.579 INFO:tasks.rados.rados.2.smithi057.stdout:1064: done (0 left) 2020-11-16T22:05:45.579 INFO:tasks.rados.rados.2.smithi057.stdout:1065: delete oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 127 2020-11-16T22:05:45.582 INFO:tasks.rados.rados.2.smithi057.stdout:1065: done (0 left) 2020-11-16T22:05:45.582 INFO:tasks.rados.rados.2.smithi057.stdout:1066: rollback oid 42 current snap is 127 2020-11-16T22:05:45.582 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 42 to 101 2020-11-16T22:05:45.582 INFO:tasks.rados.rados.2.smithi057.stdout:1067: snap_create 2020-11-16T22:05:45.589 INFO:tasks.rados.rados.2.smithi057.stdout:1066: finishing rollback tid 0 to smithi05720651-42 2020-11-16T22:05:45.589 INFO:tasks.rados.rados.2.smithi057.stdout:1066: finishing rollback tid 1 to smithi05720651-42 2020-11-16T22:05:45.590 INFO:tasks.rados.rados.2.smithi057.stdout:1066: finishing rollback tid 2 to smithi05720651-42 2020-11-16T22:05:45.590 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 476 (ObjNum 220 snap 76 seq_num 220) dirty exists 2020-11-16T22:05:46.014 INFO:tasks.rados.rados.2.smithi057.stdout:1066: done (1 left) 2020-11-16T22:05:46.014 INFO:tasks.rados.rados.2.smithi057.stdout:1067: done (0 left) 2020-11-16T22:05:46.014 INFO:tasks.rados.rados.2.smithi057.stdout:1068: delete oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 128 2020-11-16T22:05:46.021 INFO:tasks.rados.rados.2.smithi057.stdout:1068: done (0 left) 2020-11-16T22:05:46.021 INFO:tasks.rados.rados.2.smithi057.stdout:1069: snap_remove snap 126 2020-11-16T22:05:47.021 INFO:tasks.rados.rados.2.smithi057.stdout:1069: done (0 left) 2020-11-16T22:05:47.022 INFO:tasks.rados.rados.2.smithi057.stdout:1070: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:47.022 INFO:tasks.rados.rados.2.smithi057.stdout:1070: expect (ObjNum 322 snap 111 seq_num 322) 2020-11-16T22:05:47.022 INFO:tasks.rados.rados.2.smithi057.stdout:1071: rollback oid 50 current snap is 128 2020-11-16T22:05:47.023 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 50 to 101 2020-11-16T22:05:47.023 INFO:tasks.rados.rados.2.smithi057.stdout:1072: copy_from oid 8 from oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 128 2020-11-16T22:05:47.023 INFO:tasks.rados.rados.2.smithi057.stdout:1073: rollback oid 36 current snap is 128 2020-11-16T22:05:47.023 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 36 to 121 2020-11-16T22:05:47.023 INFO:tasks.rados.rados.2.smithi057.stdout:1074: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:47.023 INFO:tasks.rados.rados.2.smithi057.stdout:1074: expect deleted 2020-11-16T22:05:47.024 INFO:tasks.rados.rados.2.smithi057.stdout:1075: delete oid 4 current snap is 128 2020-11-16T22:05:47.032 INFO:tasks.rados.rados.2.smithi057.stdout:1070: expect (ObjNum 322 snap 111 seq_num 322) 2020-11-16T22:05:47.225 INFO:tasks.rados.rados.2.smithi057.stdout:1073: finishing rollback tid 0 to smithi05720651-36 2020-11-16T22:05:47.225 INFO:tasks.rados.rados.2.smithi057.stdout:1073: finishing rollback tid 1 to smithi05720651-36 2020-11-16T22:05:47.226 INFO:tasks.rados.rados.2.smithi057.stdout:1073: finishing rollback tid 2 to smithi05720651-36 2020-11-16T22:05:47.226 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 605 (ObjNum 297 snap 103 seq_num 297) dirty exists 2020-11-16T22:05:47.226 INFO:tasks.rados.rados.2.smithi057.stdout:1071: finishing rollback tid 0 to smithi05720651-50 2020-11-16T22:05:47.226 INFO:tasks.rados.rados.2.smithi057.stdout:1072: finishing copy_from to smithi05720651-8 2020-11-16T22:05:47.226 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 853 (ObjNum 371 snap 123 seq_num 371) dirty exists 2020-11-16T22:05:47.226 INFO:tasks.rados.rados.2.smithi057.stdout:1072: finishing copy_from racing read to smithi05720651-8 2020-11-16T22:05:47.227 INFO:tasks.rados.rados.2.smithi057.stdout:1071: finishing rollback tid 1 to smithi05720651-50 2020-11-16T22:05:47.227 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 885 (ObjNum 481 snap 0 seq_num 2932552240) dirty dne 2020-11-16T22:05:47.227 INFO:tasks.rados.rados.2.smithi057.stdout:1070: done (5 left) 2020-11-16T22:05:47.227 INFO:tasks.rados.rados.2.smithi057.stdout:1071: done (4 left) 2020-11-16T22:05:47.227 INFO:tasks.rados.rados.2.smithi057.stdout:1072: done (3 left) 2020-11-16T22:05:47.227 INFO:tasks.rados.rados.2.smithi057.stdout:1073: done (2 left) 2020-11-16T22:05:47.227 INFO:tasks.rados.rados.2.smithi057.stdout:1074: done (1 left) 2020-11-16T22:05:47.228 INFO:tasks.rados.rados.2.smithi057.stdout:1075: done (0 left) 2020-11-16T22:05:47.228 INFO:tasks.rados.rados.2.smithi057.stdout:1076: write (excl) oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 128 2020-11-16T22:05:47.228 INFO:tasks.rados.rados.2.smithi057.stdout:1076: seq_num 387 ranges {504309=539013,1796649=590127} 2020-11-16T22:05:47.240 INFO:tasks.rados.rados.2.smithi057.stdout:1076: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 504309 to 1043322 tid 1 2020-11-16T22:05:47.249 INFO:tasks.rados.rados.2.smithi057.stdout:1076: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1796649 to 2386776 tid 2 2020-11-16T22:05:47.249 INFO:tasks.rados.rados.2.smithi057.stdout:1077: snap_create 2020-11-16T22:05:47.249 INFO:tasks.rados.rados.2.smithi057.stdout:1076: finishing write tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:47.255 INFO:tasks.rados.rados.2.smithi057.stdout:1076: finishing write tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:47.255 INFO:tasks.rados.rados.2.smithi057.stdout:1076: finishing write tid 4 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:47.255 INFO:tasks.rados.rados.2.smithi057.stdout:1076: finishing write tid 5 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:47.256 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 609 (ObjNum 387 snap 128 seq_num 387) dirty exists 2020-11-16T22:05:47.256 INFO:tasks.rados.rados.2.smithi057.stdout:1076: left oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 387 snap 128 seq_num 387) 2020-11-16T22:05:47.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:47 smithi016 bash[10302]: cluster 2020-11-16T22:05:45.647577+0000 mgr.x (mgr.24115) 394 : cluster [DBG] pgmap v643: 17 pgs: 17 active+clean; 297 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 261 KiB/s wr, 4 op/s 2020-11-16T22:05:47.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:47 smithi016 bash[10302]: cluster 2020-11-16T22:05:46.022635+0000 mon.a (mon.0) 969 : cluster [DBG] osdmap e320: 12 total, 12 up, 12 in 2020-11-16T22:05:47.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:47 smithi195 bash[10218]: cluster 2020-11-16T22:05:45.647577+0000 mgr.x (mgr.24115) 394 : cluster [DBG] pgmap v643: 17 pgs: 17 active+clean; 297 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 261 KiB/s wr, 4 op/s 2020-11-16T22:05:47.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:47 smithi195 bash[10218]: cluster 2020-11-16T22:05:46.022635+0000 mon.a (mon.0) 969 : cluster [DBG] osdmap e320: 12 total, 12 up, 12 in 2020-11-16T22:05:47.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:47 smithi057 bash[10301]: cluster 2020-11-16T22:05:45.647577+0000 mgr.x (mgr.24115) 394 : cluster [DBG] pgmap v643: 17 pgs: 17 active+clean; 297 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 261 KiB/s wr, 4 op/s 2020-11-16T22:05:47.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:47 smithi057 bash[10301]: cluster 2020-11-16T22:05:46.022635+0000 mon.a (mon.0) 969 : cluster [DBG] osdmap e320: 12 total, 12 up, 12 in 2020-11-16T22:05:48.033 INFO:tasks.rados.rados.2.smithi057.stdout:1076: done (1 left) 2020-11-16T22:05:48.033 INFO:tasks.rados.rados.2.smithi057.stdout:1077: done (0 left) 2020-11-16T22:05:48.033 INFO:tasks.rados.rados.2.smithi057.stdout:1078: snap_remove snap 120 2020-11-16T22:05:48.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:48 smithi016 bash[10302]: cluster 2020-11-16T22:05:47.033089+0000 mon.a (mon.0) 970 : cluster [DBG] osdmap e321: 12 total, 12 up, 12 in 2020-11-16T22:05:48.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:48 smithi195 bash[10218]: cluster 2020-11-16T22:05:47.033089+0000 mon.a (mon.0) 970 : cluster [DBG] osdmap e321: 12 total, 12 up, 12 in 2020-11-16T22:05:48.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:48 smithi057 bash[10301]: cluster 2020-11-16T22:05:47.033089+0000 mon.a (mon.0) 970 : cluster [DBG] osdmap e321: 12 total, 12 up, 12 in 2020-11-16T22:05:49.035 INFO:tasks.rados.rados.2.smithi057.stdout:1078: done (0 left) 2020-11-16T22:05:49.035 INFO:tasks.rados.rados.2.smithi057.stdout:1079: write (excl) oid 2 current snap is 129 2020-11-16T22:05:49.036 INFO:tasks.rados.rados.2.smithi057.stdout:1079: seq_num 388 ranges {521116=730615,1971484=549632} 2020-11-16T22:05:49.050 INFO:tasks.rados.rados.2.smithi057.stdout:1079: writing smithi05720651-2 from 521116 to 1251731 tid 1 2020-11-16T22:05:49.057 INFO:tasks.rados.rados.2.smithi057.stdout:1079: writing smithi05720651-2 from 1971484 to 2521116 tid 2 2020-11-16T22:05:49.057 INFO:tasks.rados.rados.2.smithi057.stdout:1080: delete oid 6 current snap is 129 2020-11-16T22:05:49.061 INFO:tasks.rados.rados.2.smithi057.stdout:1079: finishing write tid 1 to smithi05720651-2 2020-11-16T22:05:49.064 INFO:tasks.rados.rados.2.smithi057.stdout:1080: done (1 left) 2020-11-16T22:05:49.065 INFO:tasks.rados.rados.2.smithi057.stdout:1081: write (excl) oid 18 current snap is 129 2020-11-16T22:05:49.065 INFO:tasks.rados.rados.2.smithi057.stdout:1081: seq_num 390 ranges {554730=481113,1572095=737454} 2020-11-16T22:05:49.070 INFO:tasks.rados.rados.2.smithi057.stdout:1081: writing smithi05720651-18 from 554730 to 1035843 tid 1 2020-11-16T22:05:49.079 INFO:tasks.rados.rados.2.smithi057.stdout:1081: writing smithi05720651-18 from 1572095 to 2309549 tid 2 2020-11-16T22:05:49.079 INFO:tasks.rados.rados.2.smithi057.stdout:1082: rollback oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 129 2020-11-16T22:05:49.079 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 123 2020-11-16T22:05:49.079 INFO:tasks.rados.rados.2.smithi057.stdout:1079: finishing write tid 2 to smithi05720651-2 2020-11-16T22:05:49.080 INFO:tasks.rados.rados.2.smithi057.stdout:1079: finishing write tid 4 to smithi05720651-2 2020-11-16T22:05:49.080 INFO:tasks.rados.rados.2.smithi057.stdout:1079: finishing write tid 5 to smithi05720651-2 2020-11-16T22:05:49.080 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 1053 (ObjNum 388 snap 129 seq_num 388) dirty exists 2020-11-16T22:05:49.080 INFO:tasks.rados.rados.2.smithi057.stdout:1079: left oid 2 (ObjNum 388 snap 129 seq_num 388) 2020-11-16T22:05:49.080 INFO:tasks.rados.rados.2.smithi057.stdout:1081: finishing write tid 1 to smithi05720651-18 2020-11-16T22:05:49.080 INFO:tasks.rados.rados.2.smithi057.stdout:1079: done (2 left) 2020-11-16T22:05:49.080 INFO:tasks.rados.rados.2.smithi057.stdout:1083: copy_from oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 129 2020-11-16T22:05:49.081 INFO:tasks.rados.rados.2.smithi057.stdout:1084: write (excl) oid 6 current snap is 129 2020-11-16T22:05:49.081 INFO:tasks.rados.rados.2.smithi057.stdout:1084: seq_num 391 ranges {571537=556362,1630577=597465} 2020-11-16T22:05:49.086 INFO:tasks.rados.rados.2.smithi057.stdout:1084: writing smithi05720651-6 from 571537 to 1127899 tid 1 2020-11-16T22:05:49.092 INFO:tasks.rados.rados.2.smithi057.stdout:1084: writing smithi05720651-6 from 1630577 to 2228042 tid 2 2020-11-16T22:05:49.092 INFO:tasks.rados.rados.2.smithi057.stdout:1085: read oid 14 snap 121 2020-11-16T22:05:49.092 INFO:tasks.rados.rados.2.smithi057.stdout:1085: expect (ObjNum 367 snap 121 seq_num 367) 2020-11-16T22:05:49.093 INFO:tasks.rados.rados.2.smithi057.stdout:1086: write (excl) oid 24 current snap is 129 2020-11-16T22:05:49.093 INFO:tasks.rados.rados.2.smithi057.stdout:1086: seq_num 392 ranges {588344=631611,1689059=741123} 2020-11-16T22:05:49.100 INFO:tasks.rados.rados.2.smithi057.stdout:1086: writing smithi05720651-24 from 588344 to 1219955 tid 1 2020-11-16T22:05:49.107 INFO:tasks.rados.rados.2.smithi057.stdout:1086: writing smithi05720651-24 from 1689059 to 2430182 tid 2 2020-11-16T22:05:49.107 INFO:tasks.rados.rados.2.smithi057.stdout:1087: snap_create 2020-11-16T22:05:49.107 INFO:tasks.rados.rados.2.smithi057.stdout:1083: finishing copy_from to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:49.107 INFO:tasks.rados.rados.2.smithi057.stdout:1083: got expected ENOENT (src dne) 2020-11-16T22:05:49.107 INFO:tasks.rados.rados.2.smithi057.stdout:1083: finishing copy_from racing read to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:49.108 INFO:tasks.rados.rados.2.smithi057.stdout:1082: finishing rollback tid 0 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:49.108 INFO:tasks.rados.rados.2.smithi057.stdout:1082: finishing rollback tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:49.108 INFO:tasks.rados.rados.2.smithi057.stdout:1082: finishing rollback tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:49.108 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 310 (ObjNum 322 snap 111 seq_num 322) dirty exists 2020-11-16T22:05:49.108 INFO:tasks.rados.rados.2.smithi057.stdout:1081: finishing write tid 2 to smithi05720651-18 2020-11-16T22:05:49.108 INFO:tasks.rados.rados.2.smithi057.stdout:1081: finishing write tid 4 to smithi05720651-18 2020-11-16T22:05:49.109 INFO:tasks.rados.rados.2.smithi057.stdout:1081: finishing write tid 5 to smithi05720651-18 2020-11-16T22:05:49.109 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 687 (ObjNum 390 snap 129 seq_num 390) dirty exists 2020-11-16T22:05:49.109 INFO:tasks.rados.rados.2.smithi057.stdout:1081: left oid 18 (ObjNum 390 snap 129 seq_num 390) 2020-11-16T22:05:49.109 INFO:tasks.rados.rados.2.smithi057.stdout:1085: expect (ObjNum 367 snap 121 seq_num 367) 2020-11-16T22:05:49.181 INFO:tasks.rados.rados.2.smithi057.stdout:1086: finishing write tid 1 to smithi05720651-24 2020-11-16T22:05:49.181 INFO:tasks.rados.rados.2.smithi057.stdout:1086: finishing write tid 2 to smithi05720651-24 2020-11-16T22:05:49.181 INFO:tasks.rados.rados.2.smithi057.stdout:1086: finishing write tid 4 to smithi05720651-24 2020-11-16T22:05:49.182 INFO:tasks.rados.rados.2.smithi057.stdout:1086: finishing write tid 5 to smithi05720651-24 2020-11-16T22:05:49.182 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 856 (ObjNum 392 snap 129 seq_num 392) dirty exists 2020-11-16T22:05:49.182 INFO:tasks.rados.rados.2.smithi057.stdout:1086: left oid 24 (ObjNum 392 snap 129 seq_num 392) 2020-11-16T22:05:49.219 INFO:tasks.rados.rados.2.smithi057.stdout:1084: finishing write tid 1 to smithi05720651-6 2020-11-16T22:05:49.225 INFO:tasks.rados.rados.2.smithi057.stdout:1084: finishing write tid 2 to smithi05720651-6 2020-11-16T22:05:49.226 INFO:tasks.rados.rados.2.smithi057.stdout:1084: finishing write tid 4 to smithi05720651-6 2020-11-16T22:05:49.226 INFO:tasks.rados.rados.2.smithi057.stdout:1084: finishing write tid 5 to smithi05720651-6 2020-11-16T22:05:49.227 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 898 (ObjNum 391 snap 129 seq_num 391) dirty exists 2020-11-16T22:05:49.227 INFO:tasks.rados.rados.2.smithi057.stdout:1084: left oid 6 (ObjNum 391 snap 129 seq_num 391) 2020-11-16T22:05:49.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:49 smithi016 bash[10302]: cluster 2020-11-16T22:05:47.648268+0000 mgr.x (mgr.24115) 395 : cluster [DBG] pgmap v646: 17 pgs: 17 active+clean; 305 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2020-11-16T22:05:49.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:49 smithi016 bash[10302]: cluster 2020-11-16T22:05:48.042285+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e322: 12 total, 12 up, 12 in 2020-11-16T22:05:49.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:49 smithi195 bash[10218]: cluster 2020-11-16T22:05:47.648268+0000 mgr.x (mgr.24115) 395 : cluster [DBG] pgmap v646: 17 pgs: 17 active+clean; 305 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2020-11-16T22:05:49.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:49 smithi195 bash[10218]: cluster 2020-11-16T22:05:48.042285+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e322: 12 total, 12 up, 12 in 2020-11-16T22:05:49.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:49 smithi057 bash[10301]: cluster 2020-11-16T22:05:47.648268+0000 mgr.x (mgr.24115) 395 : cluster [DBG] pgmap v646: 17 pgs: 17 active+clean; 305 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.0 MiB/s wr, 17 op/s 2020-11-16T22:05:49.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:49 smithi057 bash[10301]: cluster 2020-11-16T22:05:48.042285+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e322: 12 total, 12 up, 12 in 2020-11-16T22:05:49.937 INFO:tasks.rados.rados.2.smithi057.stdout:1081: done (6 left) 2020-11-16T22:05:49.938 INFO:tasks.rados.rados.2.smithi057.stdout:1082: done (5 left) 2020-11-16T22:05:49.938 INFO:tasks.rados.rados.2.smithi057.stdout:1083: done (4 left) 2020-11-16T22:05:49.938 INFO:tasks.rados.rados.2.smithi057.stdout:1084: done (3 left) 2020-11-16T22:05:49.938 INFO:tasks.rados.rados.2.smithi057.stdout:1085: done (2 left) 2020-11-16T22:05:49.938 INFO:tasks.rados.rados.2.smithi057.stdout:1086: done (1 left) 2020-11-16T22:05:49.939 INFO:tasks.rados.rados.2.smithi057.stdout:1087: done (0 left) 2020-11-16T22:05:49.939 INFO:tasks.rados.rados.2.smithi057.stdout:1088: snap_create 2020-11-16T22:05:50.339 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:50 smithi016 bash[10302]: cluster 2020-11-16T22:05:49.044614+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e323: 12 total, 12 up, 12 in 2020-11-16T22:05:50.339 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:50 smithi016 bash[10302]: cluster 2020-11-16T22:05:49.946010+0000 mon.a (mon.0) 973 : cluster [DBG] osdmap e324: 12 total, 12 up, 12 in 2020-11-16T22:05:50.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:50 smithi195 bash[10218]: cluster 2020-11-16T22:05:49.044614+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e323: 12 total, 12 up, 12 in 2020-11-16T22:05:50.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:50 smithi195 bash[10218]: cluster 2020-11-16T22:05:49.946010+0000 mon.a (mon.0) 973 : cluster [DBG] osdmap e324: 12 total, 12 up, 12 in 2020-11-16T22:05:50.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:50 smithi057 bash[10301]: cluster 2020-11-16T22:05:49.044614+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e323: 12 total, 12 up, 12 in 2020-11-16T22:05:50.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:50 smithi057 bash[10301]: cluster 2020-11-16T22:05:49.946010+0000 mon.a (mon.0) 973 : cluster [DBG] osdmap e324: 12 total, 12 up, 12 in 2020-11-16T22:05:50.948 INFO:tasks.rados.rados.2.smithi057.stdout:1088: done (0 left) 2020-11-16T22:05:50.948 INFO:tasks.rados.rados.2.smithi057.stdout:1089: copy_from oid 32 from oid 28 current snap is 131 2020-11-16T22:05:50.948 INFO:tasks.rados.rados.2.smithi057.stdout:1090: read oid 30 snap -1 2020-11-16T22:05:50.948 INFO:tasks.rados.rados.2.smithi057.stdout:1090: expect deleted 2020-11-16T22:05:50.948 INFO:tasks.rados.rados.2.smithi057.stdout:1091: write (excl) oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 131 2020-11-16T22:05:50.949 INFO:tasks.rados.rados.2.smithi057.stdout:1091: seq_num 393 ranges {605151=706860,2031188=573963} 2020-11-16T22:05:50.959 INFO:tasks.rados.rados.2.smithi057.stdout:1091: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 605151 to 1312011 tid 1 2020-11-16T22:05:50.967 INFO:tasks.rados.rados.2.smithi057.stdout:1091: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2031188 to 2605151 tid 2 2020-11-16T22:05:50.968 INFO:tasks.rados.rados.2.smithi057.stdout:1092: rollback oid 10 current snap is 131 2020-11-16T22:05:50.968 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 10 to 130 2020-11-16T22:05:50.968 INFO:tasks.rados.rados.2.smithi057.stdout:1091: finishing write tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:50.968 INFO:tasks.rados.rados.2.smithi057.stdout:1090: done (3 left) 2020-11-16T22:05:50.968 INFO:tasks.rados.rados.2.smithi057.stdout:1093: rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 131 2020-11-16T22:05:50.968 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 96 2020-11-16T22:05:50.969 INFO:tasks.rados.rados.2.smithi057.stdout:1094: write (excl) oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 131 2020-11-16T22:05:50.969 INFO:tasks.rados.rados.2.smithi057.stdout:1094: seq_num 394 ranges {621958=782109,2089670=532288} 2020-11-16T22:05:50.976 INFO:tasks.rados.rados.2.smithi057.stdout:1094: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 621958 to 1404067 tid 1 2020-11-16T22:05:50.983 INFO:tasks.rados.rados.2.smithi057.stdout:1094: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2089670 to 2621958 tid 2 2020-11-16T22:05:50.983 INFO:tasks.rados.rados.2.smithi057.stdout:1095: write oid 14 current snap is 131 2020-11-16T22:05:50.983 INFO:tasks.rados.rados.2.smithi057.stdout:1095: seq_num 395 ranges {638765=457358,1748152=604803} 2020-11-16T22:05:50.989 INFO:tasks.rados.rados.2.smithi057.stdout:1095: writing smithi05720651-14 from 638765 to 1096123 tid 1 2020-11-16T22:05:50.996 INFO:tasks.rados.rados.2.smithi057.stdout:1095: writing smithi05720651-14 from 1748152 to 2352955 tid 2 2020-11-16T22:05:50.997 INFO:tasks.rados.rados.2.smithi057.stdout:1096: snap_remove snap 122 2020-11-16T22:05:51.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:51 smithi016 bash[10302]: cluster 2020-11-16T22:05:49.648942+0000 mgr.x (mgr.24115) 396 : cluster [DBG] pgmap v649: 17 pgs: 17 active+clean; 305 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2020-11-16T22:05:51.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:51 smithi016 bash[10302]: cluster 2020-11-16T22:05:50.958319+0000 mon.a (mon.0) 974 : cluster [DBG] osdmap e325: 12 total, 12 up, 12 in 2020-11-16T22:05:51.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:51 smithi195 bash[10218]: cluster 2020-11-16T22:05:49.648942+0000 mgr.x (mgr.24115) 396 : cluster [DBG] pgmap v649: 17 pgs: 17 active+clean; 305 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2020-11-16T22:05:51.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:51 smithi195 bash[10218]: cluster 2020-11-16T22:05:50.958319+0000 mon.a (mon.0) 974 : cluster [DBG] osdmap e325: 12 total, 12 up, 12 in 2020-11-16T22:05:51.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:51 smithi057 bash[10301]: cluster 2020-11-16T22:05:49.648942+0000 mgr.x (mgr.24115) 396 : cluster [DBG] pgmap v649: 17 pgs: 17 active+clean; 305 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2020-11-16T22:05:51.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:51 smithi057 bash[10301]: cluster 2020-11-16T22:05:50.958319+0000 mon.a (mon.0) 974 : cluster [DBG] osdmap e325: 12 total, 12 up, 12 in 2020-11-16T22:05:51.954 INFO:tasks.rados.rados.2.smithi057.stdout:1096: done (6 left) 2020-11-16T22:05:51.954 INFO:tasks.rados.rados.2.smithi057.stdout:1097: read oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 96 2020-11-16T22:05:51.955 INFO:tasks.rados.rados.2.smithi057.stdout:1097: expect deleted 2020-11-16T22:05:51.955 INFO:tasks.rados.rados.2.smithi057.stdout:1098: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:51.955 INFO:tasks.rados.rados.2.smithi057.stdout:1098: expect deleted 2020-11-16T22:05:51.955 INFO:tasks.rados.rados.2.smithi057.stdout:1099: copy_from oid 20 from oid 2 current snap is 131 2020-11-16T22:05:51.955 INFO:tasks.rados.rados.2.smithi057.stdout:1091: finishing write tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:51.955 INFO:tasks.rados.rados.2.smithi057.stdout:1091: finishing write tid 4 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:51.955 INFO:tasks.rados.rados.2.smithi057.stdout:1091: finishing write tid 5 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:51.956 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 868 (ObjNum 393 snap 131 seq_num 393) dirty exists 2020-11-16T22:05:51.956 INFO:tasks.rados.rados.2.smithi057.stdout:1091: left oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 393 snap 131 seq_num 393) 2020-11-16T22:05:51.956 INFO:tasks.rados.rados.2.smithi057.stdout:1092: finishing rollback tid 0 to smithi05720651-10 2020-11-16T22:05:51.956 INFO:tasks.rados.rados.2.smithi057.stdout:1092: finishing rollback tid 1 to smithi05720651-10 2020-11-16T22:05:51.956 INFO:tasks.rados.rados.2.smithi057.stdout:1092: finishing rollback tid 2 to smithi05720651-10 2020-11-16T22:05:51.956 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 617 (ObjNum 112 snap 34 seq_num 112) dirty exists 2020-11-16T22:05:51.956 INFO:tasks.rados.rados.2.smithi057.stdout:1093: finishing rollback tid 0 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:51.957 INFO:tasks.rados.rados.2.smithi057.stdout:1093: finishing rollback tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:51.957 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 620 (ObjNum 385 snap 0 seq_num 2932754784) dirty dne 2020-11-16T22:05:51.957 INFO:tasks.rados.rados.2.smithi057.stdout:1089: finishing copy_from to smithi05720651-32 2020-11-16T22:05:51.957 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 548 (ObjNum 324 snap 111 seq_num 324) dirty exists 2020-11-16T22:05:51.957 INFO:tasks.rados.rados.2.smithi057.stdout:1089: finishing copy_from racing read to smithi05720651-32 2020-11-16T22:05:51.957 INFO:tasks.rados.rados.2.smithi057.stdout:1094: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:51.958 INFO:tasks.rados.rados.2.smithi057.stdout:1094: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:51.958 INFO:tasks.rados.rados.2.smithi057.stdout:1094: finishing write tid 4 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:51.958 INFO:tasks.rados.rados.2.smithi057.stdout:1094: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:51.958 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 313 (ObjNum 394 snap 131 seq_num 394) dirty exists 2020-11-16T22:05:51.958 INFO:tasks.rados.rados.2.smithi057.stdout:1094: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 394 snap 131 seq_num 394) 2020-11-16T22:05:51.958 INFO:tasks.rados.rados.2.smithi057.stdout:1095: finishing write tid 1 to smithi05720651-14 2020-11-16T22:05:51.958 INFO:tasks.rados.rados.2.smithi057.stdout:1095: finishing write tid 2 to smithi05720651-14 2020-11-16T22:05:51.959 INFO:tasks.rados.rados.2.smithi057.stdout:1095: finishing write tid 4 to smithi05720651-14 2020-11-16T22:05:51.959 INFO:tasks.rados.rados.2.smithi057.stdout:1095: finishing write tid 5 to smithi05720651-14 2020-11-16T22:05:51.959 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 1063 (ObjNum 395 snap 131 seq_num 395) dirty exists 2020-11-16T22:05:51.959 INFO:tasks.rados.rados.2.smithi057.stdout:1095: left oid 14 (ObjNum 395 snap 131 seq_num 395) 2020-11-16T22:05:51.959 INFO:tasks.rados.rados.2.smithi057.stdout:1089: done (8 left) 2020-11-16T22:05:51.959 INFO:tasks.rados.rados.2.smithi057.stdout:1091: done (7 left) 2020-11-16T22:05:51.960 INFO:tasks.rados.rados.2.smithi057.stdout:1092: done (6 left) 2020-11-16T22:05:51.960 INFO:tasks.rados.rados.2.smithi057.stdout:1093: done (5 left) 2020-11-16T22:05:51.960 INFO:tasks.rados.rados.2.smithi057.stdout:1094: done (4 left) 2020-11-16T22:05:51.960 INFO:tasks.rados.rados.2.smithi057.stdout:1095: done (3 left) 2020-11-16T22:05:51.960 INFO:tasks.rados.rados.2.smithi057.stdout:1100: read oid 36 snap -1 2020-11-16T22:05:51.960 INFO:tasks.rados.rados.2.smithi057.stdout:1100: expect (ObjNum 297 snap 103 seq_num 297) 2020-11-16T22:05:51.961 INFO:tasks.rados.rados.2.smithi057.stdout:1101: copy_from oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 131 2020-11-16T22:05:51.961 INFO:tasks.rados.rados.2.smithi057.stdout:1102: snap_create 2020-11-16T22:05:51.968 INFO:tasks.rados.rados.2.smithi057.stdout:1100: expect (ObjNum 297 snap 103 seq_num 297) 2020-11-16T22:05:52.259 INFO:tasks.rados.rados.2.smithi057.stdout:1101: finishing copy_from to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:52.259 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 936 (ObjNum 357 snap 118 seq_num 357) dirty exists 2020-11-16T22:05:52.259 INFO:tasks.rados.rados.2.smithi057.stdout:1101: finishing copy_from racing read to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:52.260 INFO:tasks.rados.rados.2.smithi057.stdout:1099: finishing copy_from to smithi05720651-20 2020-11-16T22:05:52.260 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1053 (ObjNum 388 snap 129 seq_num 388) dirty exists 2020-11-16T22:05:52.260 INFO:tasks.rados.rados.2.smithi057.stdout:1099: finishing copy_from racing read to smithi05720651-20 2020-11-16T22:05:52.952 INFO:tasks.rados.rados.2.smithi057.stdout:1097: done (5 left) 2020-11-16T22:05:52.953 INFO:tasks.rados.rados.2.smithi057.stdout:1098: done (4 left) 2020-11-16T22:05:52.953 INFO:tasks.rados.rados.2.smithi057.stdout:1099: done (3 left) 2020-11-16T22:05:52.953 INFO:tasks.rados.rados.2.smithi057.stdout:1100: done (2 left) 2020-11-16T22:05:52.953 INFO:tasks.rados.rados.2.smithi057.stdout:1101: done (1 left) 2020-11-16T22:05:52.953 INFO:tasks.rados.rados.2.smithi057.stdout:1102: done (0 left) 2020-11-16T22:05:52.954 INFO:tasks.rados.rados.2.smithi057.stdout:1103: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 132 2020-11-16T22:05:52.954 INFO:tasks.rados.rados.2.smithi057.stdout:1103: seq_num 396 ranges {655572=648960,1922987=732585} 2020-11-16T22:05:52.966 INFO:tasks.rados.rados.2.smithi057.stdout:1103: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 655572 to 1304532 tid 1 2020-11-16T22:05:52.975 INFO:tasks.rados.rados.2.smithi057.stdout:1103: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1922987 to 2655572 tid 2 2020-11-16T22:05:52.976 INFO:tasks.rados.rados.2.smithi057.stdout:1104: rollback oid 36 current snap is 132 2020-11-16T22:05:52.976 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 36 to 114 2020-11-16T22:05:52.976 INFO:tasks.rados.rados.2.smithi057.stdout:1105: rollback oid 50 current snap is 132 2020-11-16T22:05:52.976 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 50 to 131 2020-11-16T22:05:52.976 INFO:tasks.rados.rados.2.smithi057.stdout:1106: delete oid 12 current snap is 132 2020-11-16T22:05:52.982 INFO:tasks.rados.rados.2.smithi057.stdout:1106: done (3 left) 2020-11-16T22:05:52.982 INFO:tasks.rados.rados.2.smithi057.stdout:1107: snap_remove snap 129 2020-11-16T22:05:53.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:52 smithi016 bash[10302]: cluster 2020-11-16T22:05:51.649658+0000 mgr.x (mgr.24115) 397 : cluster [DBG] pgmap v652: 17 pgs: 17 active+clean; 318 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 3.4 MiB/s wr, 17 op/s 2020-11-16T22:05:53.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:52 smithi016 bash[10302]: cluster 2020-11-16T22:05:51.960102+0000 mon.a (mon.0) 975 : cluster [DBG] osdmap e326: 12 total, 12 up, 12 in 2020-11-16T22:05:53.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:52 smithi195 bash[10218]: cluster 2020-11-16T22:05:51.649658+0000 mgr.x (mgr.24115) 397 : cluster [DBG] pgmap v652: 17 pgs: 17 active+clean; 318 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 3.4 MiB/s wr, 17 op/s 2020-11-16T22:05:53.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:52 smithi195 bash[10218]: cluster 2020-11-16T22:05:51.960102+0000 mon.a (mon.0) 975 : cluster [DBG] osdmap e326: 12 total, 12 up, 12 in 2020-11-16T22:05:53.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:52 smithi057 bash[10301]: cluster 2020-11-16T22:05:51.649658+0000 mgr.x (mgr.24115) 397 : cluster [DBG] pgmap v652: 17 pgs: 17 active+clean; 318 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 3.4 MiB/s wr, 17 op/s 2020-11-16T22:05:53.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:52 smithi057 bash[10301]: cluster 2020-11-16T22:05:51.960102+0000 mon.a (mon.0) 975 : cluster [DBG] osdmap e326: 12 total, 12 up, 12 in 2020-11-16T22:05:53.971 INFO:tasks.rados.rados.2.smithi057.stdout:1107: done (3 left) 2020-11-16T22:05:53.971 INFO:tasks.rados.rados.2.smithi057.stdout:1108: snap_remove snap 101 2020-11-16T22:05:54.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:53 smithi016 bash[10302]: cluster 2020-11-16T22:05:52.962376+0000 mon.a (mon.0) 976 : cluster [DBG] osdmap e327: 12 total, 12 up, 12 in 2020-11-16T22:05:54.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:53 smithi195 bash[10218]: cluster 2020-11-16T22:05:52.962376+0000 mon.a (mon.0) 976 : cluster [DBG] osdmap e327: 12 total, 12 up, 12 in 2020-11-16T22:05:54.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:53 smithi057 bash[10301]: cluster 2020-11-16T22:05:52.962376+0000 mon.a (mon.0) 976 : cluster [DBG] osdmap e327: 12 total, 12 up, 12 in 2020-11-16T22:05:54.940 INFO:tasks.rados.rados.2.smithi057.stdout:1108: done (3 left) 2020-11-16T22:05:54.941 INFO:tasks.rados.rados.2.smithi057.stdout:1109: copy_from oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 6 current snap is 132 2020-11-16T22:05:54.941 INFO:tasks.rados.rados.2.smithi057.stdout:1105: finishing rollback tid 1 to smithi05720651-50 2020-11-16T22:05:54.941 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 885 (ObjNum 241 snap 0 seq_num 8710) dirty dne 2020-11-16T22:05:54.941 INFO:tasks.rados.rados.2.smithi057.stdout:1103: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:54.941 INFO:tasks.rados.rados.2.smithi057.stdout:1103: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:54.942 INFO:tasks.rados.rados.2.smithi057.stdout:1104: finishing rollback tid 0 to smithi05720651-36 2020-11-16T22:05:54.942 INFO:tasks.rados.rados.2.smithi057.stdout:1104: finishing rollback tid 1 to smithi05720651-36 2020-11-16T22:05:54.942 INFO:tasks.rados.rados.2.smithi057.stdout:1103: finishing write tid 4 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:54.942 INFO:tasks.rados.rados.2.smithi057.stdout:1104: finishing rollback tid 2 to smithi05720651-36 2020-11-16T22:05:54.942 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 630 (ObjNum 297 snap 103 seq_num 297) dirty exists 2020-11-16T22:05:54.942 INFO:tasks.rados.rados.2.smithi057.stdout:1103: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:54.942 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1077 (ObjNum 396 snap 132 seq_num 396) dirty exists 2020-11-16T22:05:54.943 INFO:tasks.rados.rados.2.smithi057.stdout:1103: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 396 snap 132 seq_num 396) 2020-11-16T22:05:54.943 INFO:tasks.rados.rados.2.smithi057.stdout:1103: done (3 left) 2020-11-16T22:05:54.943 INFO:tasks.rados.rados.2.smithi057.stdout:1104: done (2 left) 2020-11-16T22:05:54.943 INFO:tasks.rados.rados.2.smithi057.stdout:1105: done (1 left) 2020-11-16T22:05:54.943 INFO:tasks.rados.rados.2.smithi057.stdout:1110: delete oid 22 current snap is 132 2020-11-16T22:05:54.948 INFO:tasks.rados.rados.2.smithi057.stdout:1110: done (1 left) 2020-11-16T22:05:54.948 INFO:tasks.rados.rados.2.smithi057.stdout:1111: read oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:54.949 INFO:tasks.rados.rados.2.smithi057.stdout:1111: expect (ObjNum 393 snap 131 seq_num 393) 2020-11-16T22:05:54.949 INFO:tasks.rados.rados.2.smithi057.stdout:1112: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:05:54.949 INFO:tasks.rados.rados.2.smithi057.stdout:1112: expect (ObjNum 396 snap 132 seq_num 396) 2020-11-16T22:05:54.949 INFO:tasks.rados.rados.2.smithi057.stdout:1113: rollback oid 22 current snap is 132 2020-11-16T22:05:54.949 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 22 to 96 2020-11-16T22:05:54.949 INFO:tasks.rados.rados.2.smithi057.stdout:1114: snap_create 2020-11-16T22:05:54.951 INFO:tasks.rados.rados.2.smithi057.stdout:1113: finishing rollback tid 1 to smithi05720651-22 2020-11-16T22:05:54.952 INFO:tasks.rados.rados.2.smithi057.stdout:1113: finishing rollback tid 2 to smithi05720651-22 2020-11-16T22:05:54.952 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 846 (ObjNum 130 snap 37 seq_num 130) dirty exists 2020-11-16T22:05:54.960 INFO:tasks.rados.rados.2.smithi057.stdout:1111: expect (ObjNum 393 snap 131 seq_num 393) 2020-11-16T22:05:55.041 INFO:tasks.rados.rados.2.smithi057.stdout:1109: finishing copy_from to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:55.041 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 898 (ObjNum 391 snap 129 seq_num 391) dirty exists 2020-11-16T22:05:55.041 INFO:tasks.rados.rados.2.smithi057.stdout:1109: finishing copy_from racing read to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:55.099 INFO:tasks.rados.rados.2.smithi057.stdout:1112: expect (ObjNum 396 snap 132 seq_num 396) 2020-11-16T22:05:55.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:54 smithi016 bash[10302]: cluster 2020-11-16T22:05:53.650362+0000 mgr.x (mgr.24115) 398 : cluster [DBG] pgmap v655: 17 pgs: 17 active+clean; 320 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.0 MiB/s wr, 18 op/s 2020-11-16T22:05:55.538 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:54 smithi016 bash[10302]: cluster 2020-11-16T22:05:53.979868+0000 mon.a (mon.0) 977 : cluster [DBG] osdmap e328: 12 total, 12 up, 12 in 2020-11-16T22:05:55.742 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:54 smithi016 bash[10302]: cluster 2020-11-16T22:05:54.949140+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e329: 12 total, 12 up, 12 in 2020-11-16T22:05:55.946 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:54 smithi057 bash[10301]: cluster 2020-11-16T22:05:53.650362+0000 mgr.x (mgr.24115) 398 : cluster [DBG] pgmap v655: 17 pgs: 17 active+clean; 320 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.0 MiB/s wr, 18 op/s 2020-11-16T22:05:56.354 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:54 smithi057 bash[10301]: cluster 2020-11-16T22:05:53.979868+0000 mon.a (mon.0) 977 : cluster [DBG] osdmap e328: 12 total, 12 up, 12 in 2020-11-16T22:05:56.558 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:54 smithi057 bash[10301]: cluster 2020-11-16T22:05:54.949140+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e329: 12 total, 12 up, 12 in 2020-11-16T22:05:56.558 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:54 smithi195 bash[10218]: cluster 2020-11-16T22:05:53.650362+0000 mgr.x (mgr.24115) 398 : cluster [DBG] pgmap v655: 17 pgs: 17 active+clean; 320 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.0 MiB/s wr, 18 op/s 2020-11-16T22:05:56.762 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:54 smithi195 bash[10218]: cluster 2020-11-16T22:05:53.979868+0000 mon.a (mon.0) 977 : cluster [DBG] osdmap e328: 12 total, 12 up, 12 in 2020-11-16T22:05:56.966 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:54 smithi195 bash[10218]: cluster 2020-11-16T22:05:54.949140+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e329: 12 total, 12 up, 12 in 2020-11-16T22:05:57.171 INFO:tasks.rados.rados.2.smithi057.stdout:1109: done (4 left) 2020-11-16T22:05:57.374 INFO:tasks.rados.rados.2.smithi057.stdout:1111: done (3 left) 2020-11-16T22:05:57.374 INFO:tasks.rados.rados.2.smithi057.stdout:1112: done (2 left) 2020-11-16T22:05:57.578 INFO:tasks.rados.rados.2.smithi057.stdout:1113: done (1 left) 2020-11-16T22:05:57.782 INFO:tasks.rados.rados.2.smithi057.stdout:1114: done (0 left) 2020-11-16T22:05:57.986 INFO:tasks.rados.rados.2.smithi057.stdout:1115: rollback oid 26 current snap is 133 2020-11-16T22:05:58.190 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 26 to 123 2020-11-16T22:05:58.190 INFO:tasks.rados.rados.2.smithi057.stdout:1116: snap_remove snap 118 2020-11-16T22:05:58.394 INFO:tasks.rados.rados.2.smithi057.stdout:1116: done (1 left) 2020-11-16T22:05:58.598 INFO:tasks.rados.rados.2.smithi057.stdout:1117: copy_from oid 16 from oid 4 current snap is 133 2020-11-16T22:05:58.802 INFO:tasks.rados.rados.2.smithi057.stdout:1115: finishing rollback tid 0 to smithi05720651-26 2020-11-16T22:05:59.006 INFO:tasks.rados.rados.2.smithi057.stdout:1115: finishing rollback tid 1 to smithi05720651-26 2020-11-16T22:05:59.006 INFO:tasks.rados.rados.2.smithi057.stdout:1115: finishing rollback tid 2 to smithi05720651-26 2020-11-16T22:05:59.006 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 1103 (ObjNum 278 snap 94 seq_num 278) dirty exists 2020-11-16T22:05:59.007 INFO:tasks.rados.rados.2.smithi057.stdout:1115: done (1 left) 2020-11-16T22:05:59.007 INFO:tasks.rados.rados.2.smithi057.stdout:1118: rollback oid 2 current snap is 133 2020-11-16T22:05:59.007 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 2 to 117 2020-11-16T22:05:59.007 INFO:tasks.rados.rados.2.smithi057.stdout:1119: write (excl) oid 28 current snap is 133 2020-11-16T22:05:59.007 INFO:tasks.rados.rados.2.smithi057.stdout:1119: seq_num 399 ranges {705993=474707,1582080=612141} 2020-11-16T22:05:59.007 INFO:tasks.rados.rados.2.smithi057.stdout:1119: writing smithi05720651-28 from 705993 to 1180700 tid 1 2020-11-16T22:05:59.007 INFO:tasks.rados.rados.2.smithi057.stdout:1119: writing smithi05720651-28 from 1582080 to 2194221 tid 2 2020-11-16T22:05:59.008 INFO:tasks.rados.rados.2.smithi057.stdout:1120: write (excl) oid 50 current snap is 133 2020-11-16T22:05:59.008 INFO:tasks.rados.rados.2.smithi057.stdout:1120: seq_num 400 ranges {722800=549956,2040562=682238} 2020-11-16T22:05:59.008 INFO:tasks.rados.rados.2.smithi057.stdout:1120: writing smithi05720651-50 from 722800 to 1272756 tid 1 2020-11-16T22:05:59.008 INFO:tasks.rados.rados.2.smithi057.stdout:1120: writing smithi05720651-50 from 2040562 to 2722800 tid 2 2020-11-16T22:05:59.008 INFO:tasks.rados.rados.2.smithi057.stdout:1121: write (excl) oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 133 2020-11-16T22:05:59.008 INFO:tasks.rados.rados.2.smithi057.stdout:1121: seq_num 401 ranges {739607=625205,1982691=499457} 2020-11-16T22:05:59.008 INFO:tasks.rados.rados.2.smithi057.stdout:1121: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 739607 to 1364812 tid 1 2020-11-16T22:05:59.009 INFO:tasks.rados.rados.2.smithi057.stdout:1121: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1982691 to 2482148 tid 2 2020-11-16T22:05:59.009 INFO:tasks.rados.rados.2.smithi057.stdout:1122: copy_from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 30 current snap is 133 2020-11-16T22:05:59.009 INFO:tasks.rados.rados.2.smithi057.stdout:1117: finishing copy_from to smithi05720651-16 2020-11-16T22:05:59.009 INFO:tasks.rados.rados.2.smithi057.stdout:1117: got expected ENOENT (src dne) 2020-11-16T22:05:59.009 INFO:tasks.rados.rados.2.smithi057.stdout:1117: finishing copy_from racing read to smithi05720651-16 2020-11-16T22:05:59.009 INFO:tasks.rados.rados.2.smithi057.stdout:1118: finishing rollback tid 0 to smithi05720651-2 2020-11-16T22:05:59.009 INFO:tasks.rados.rados.2.smithi057.stdout:1118: finishing rollback tid 1 to smithi05720651-2 2020-11-16T22:05:59.010 INFO:tasks.rados.rados.2.smithi057.stdout:1118: finishing rollback tid 2 to smithi05720651-2 2020-11-16T22:05:59.010 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 1107 (ObjNum 326 snap 111 seq_num 326) dirty exists 2020-11-16T22:05:59.010 INFO:tasks.rados.rados.2.smithi057.stdout:1117: done (5 left) 2020-11-16T22:05:59.010 INFO:tasks.rados.rados.2.smithi057.stdout:1118: done (4 left) 2020-11-16T22:05:59.010 INFO:tasks.rados.rados.2.smithi057.stdout:1123: snap_remove snap 128 2020-11-16T22:05:59.012 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:56 smithi195 bash[10218]: cluster 2020-11-16T22:05:55.651057+0000 mgr.x (mgr.24115) 399 : cluster [DBG] pgmap v658: 17 pgs: 17 active+clean; 321 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 1.5 MiB/s wr, 8 op/s 2020-11-16T22:05:59.013 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:56 smithi195 bash[10218]: cluster 2020-11-16T22:05:55.960231+0000 mon.a (mon.0) 979 : cluster [DBG] osdmap e330: 12 total, 12 up, 12 in 2020-11-16T22:05:59.013 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:57 smithi195 bash[10218]: cluster 2020-11-16T22:05:56.969380+0000 mon.a (mon.0) 980 : cluster [DBG] osdmap e331: 12 total, 12 up, 12 in 2020-11-16T22:05:59.013 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:56 smithi016 bash[10302]: cluster 2020-11-16T22:05:55.651057+0000 mgr.x (mgr.24115) 399 : cluster [DBG] pgmap v658: 17 pgs: 17 active+clean; 321 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 1.5 MiB/s wr, 8 op/s 2020-11-16T22:05:59.013 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:56 smithi016 bash[10302]: cluster 2020-11-16T22:05:55.960231+0000 mon.a (mon.0) 979 : cluster [DBG] osdmap e330: 12 total, 12 up, 12 in 2020-11-16T22:05:59.214 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:57 smithi016 bash[10302]: cluster 2020-11-16T22:05:56.969380+0000 mon.a (mon.0) 980 : cluster [DBG] osdmap e331: 12 total, 12 up, 12 in 2020-11-16T22:05:59.214 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:56 smithi057 bash[10301]: cluster 2020-11-16T22:05:55.651057+0000 mgr.x (mgr.24115) 399 : cluster [DBG] pgmap v658: 17 pgs: 17 active+clean; 321 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 1.5 MiB/s wr, 8 op/s 2020-11-16T22:05:59.214 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:56 smithi057 bash[10301]: cluster 2020-11-16T22:05:55.960231+0000 mon.a (mon.0) 979 : cluster [DBG] osdmap e330: 12 total, 12 up, 12 in 2020-11-16T22:05:59.215 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:57 smithi057 bash[10301]: cluster 2020-11-16T22:05:56.969380+0000 mon.a (mon.0) 980 : cluster [DBG] osdmap e331: 12 total, 12 up, 12 in 2020-11-16T22:05:59.215 INFO:tasks.rados.rados.2.smithi057.stdout:1123: done (4 left) 2020-11-16T22:05:59.215 INFO:tasks.rados.rados.2.smithi057.stdout:1124: snap_remove snap 117 2020-11-16T22:05:59.215 INFO:tasks.rados.rados.2.smithi057.stdout:1124: done (4 left) 2020-11-16T22:05:59.215 INFO:tasks.rados.rados.2.smithi057.stdout:1125: rollback oid 22 current snap is 133 2020-11-16T22:05:59.215 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 22 to 130 2020-11-16T22:05:59.216 INFO:tasks.rados.rados.2.smithi057.stdout:1119: finishing write tid 1 to smithi05720651-28 2020-11-16T22:05:59.216 INFO:tasks.rados.rados.2.smithi057.stdout:1119: finishing write tid 2 to smithi05720651-28 2020-11-16T22:05:59.216 INFO:tasks.rados.rados.2.smithi057.stdout:1120: finishing write tid 1 to smithi05720651-50 2020-11-16T22:05:59.216 INFO:tasks.rados.rados.2.smithi057.stdout:1120: finishing write tid 2 to smithi05720651-50 2020-11-16T22:05:59.216 INFO:tasks.rados.rados.2.smithi057.stdout:1120: finishing write tid 4 to smithi05720651-50 2020-11-16T22:05:59.216 INFO:tasks.rados.rados.2.smithi057.stdout:1120: finishing write tid 5 to smithi05720651-50 2020-11-16T22:05:59.216 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 921 (ObjNum 400 snap 133 seq_num 400) dirty exists 2020-11-16T22:05:59.217 INFO:tasks.rados.rados.2.smithi057.stdout:1120: left oid 50 (ObjNum 400 snap 133 seq_num 400) 2020-11-16T22:05:59.217 INFO:tasks.rados.rados.2.smithi057.stdout:1121: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:59.217 INFO:tasks.rados.rados.2.smithi057.stdout:1121: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:59.217 INFO:tasks.rados.rados.2.smithi057.stdout:1121: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:59.217 INFO:tasks.rados.rados.2.smithi057.stdout:1121: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:59.418 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 690 (ObjNum 401 snap 133 seq_num 401) dirty exists 2020-11-16T22:05:59.418 INFO:tasks.rados.rados.2.smithi057.stdout:1121: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 401 snap 133 seq_num 401) 2020-11-16T22:05:59.418 INFO:tasks.rados.rados.2.smithi057.stdout:1122: finishing copy_from to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:59.419 INFO:tasks.rados.rados.2.smithi057.stdout:1122: got expected ENOENT (src dne) 2020-11-16T22:05:59.419 INFO:tasks.rados.rados.2.smithi057.stdout:1122: finishing copy_from racing read to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:05:59.419 INFO:tasks.rados.rados.2.smithi057.stdout:1119: finishing write tid 4 to smithi05720651-28 2020-11-16T22:05:59.420 INFO:tasks.rados.rados.2.smithi057.stdout:1119: finishing write tid 5 to smithi05720651-28 2020-11-16T22:05:59.420 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 648 (ObjNum 399 snap 133 seq_num 399) dirty exists 2020-11-16T22:05:59.420 INFO:tasks.rados.rados.2.smithi057.stdout:1119: left oid 28 (ObjNum 399 snap 133 seq_num 399) 2020-11-16T22:05:59.420 INFO:tasks.rados.rados.2.smithi057.stdout:1119: done (4 left) 2020-11-16T22:05:59.421 INFO:tasks.rados.rados.2.smithi057.stdout:1120: done (3 left) 2020-11-16T22:05:59.421 INFO:tasks.rados.rados.2.smithi057.stdout:1121: done (2 left) 2020-11-16T22:05:59.421 INFO:tasks.rados.rados.2.smithi057.stdout:1122: done (1 left) 2020-11-16T22:05:59.421 INFO:tasks.rados.rados.2.smithi057.stdout:1126: write oid 48 current snap is 133 2020-11-16T22:05:59.422 INFO:tasks.rados.rados.2.smithi057.stdout:1126: seq_num 402 ranges {756414=700454,2041173=715241} 2020-11-16T22:05:59.422 INFO:tasks.rados.rados.2.smithi057.stdout:1126: writing smithi05720651-48 from 756414 to 1456868 tid 1 2020-11-16T22:05:59.422 INFO:tasks.rados.rados.2.smithi057.stdout:1126: writing smithi05720651-48 from 2041173 to 2756414 tid 2 2020-11-16T22:05:59.422 INFO:tasks.rados.rados.2.smithi057.stdout:1127: snap_create 2020-11-16T22:05:59.423 INFO:tasks.rados.rados.2.smithi057.stdout:1125: finishing rollback tid 0 to smithi05720651-22 2020-11-16T22:05:59.423 INFO:tasks.rados.rados.2.smithi057.stdout:1125: finishing rollback tid 1 to smithi05720651-22 2020-11-16T22:05:59.423 INFO:tasks.rados.rados.2.smithi057.stdout:1125: finishing rollback tid 2 to smithi05720651-22 2020-11-16T22:05:59.423 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 849 (ObjNum 192 snap 64 seq_num 192) dirty exists 2020-11-16T22:05:59.424 INFO:tasks.rados.rados.2.smithi057.stdout:1126: finishing write tid 1 to smithi05720651-48 2020-11-16T22:05:59.424 INFO:tasks.rados.rados.2.smithi057.stdout:1126: finishing write tid 2 to smithi05720651-48 2020-11-16T22:05:59.424 INFO:tasks.rados.rados.2.smithi057.stdout:1126: finishing write tid 4 to smithi05720651-48 2020-11-16T22:05:59.424 INFO:tasks.rados.rados.2.smithi057.stdout:1126: finishing write tid 5 to smithi05720651-48 2020-11-16T22:05:59.626 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 234 (ObjNum 402 snap 133 seq_num 402) dirty exists 2020-11-16T22:05:59.626 INFO:tasks.rados.rados.2.smithi057.stdout:1126: left oid 48 (ObjNum 402 snap 133 seq_num 402) 2020-11-16T22:05:59.627 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:58 smithi195 bash[10218]: cluster 2020-11-16T22:05:57.651735+0000 mgr.x (mgr.24115) 400 : cluster [DBG] pgmap v661: 17 pgs: 17 active+clean; 323 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2020-11-16T22:05:59.627 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:58 smithi195 bash[10218]: cluster 2020-11-16T22:05:57.979507+0000 mon.a (mon.0) 981 : cluster [DBG] osdmap e332: 12 total, 12 up, 12 in 2020-11-16T22:05:59.628 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:58 smithi016 bash[10302]: cluster 2020-11-16T22:05:57.651735+0000 mgr.x (mgr.24115) 400 : cluster [DBG] pgmap v661: 17 pgs: 17 active+clean; 323 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2020-11-16T22:05:59.628 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:58 smithi016 bash[10302]: cluster 2020-11-16T22:05:57.979507+0000 mon.a (mon.0) 981 : cluster [DBG] osdmap e332: 12 total, 12 up, 12 in 2020-11-16T22:05:59.628 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:58 smithi057 bash[10301]: cluster 2020-11-16T22:05:57.651735+0000 mgr.x (mgr.24115) 400 : cluster [DBG] pgmap v661: 17 pgs: 17 active+clean; 323 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 1.7 MiB/s wr, 12 op/s 2020-11-16T22:05:59.628 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:05:58 smithi057 bash[10301]: cluster 2020-11-16T22:05:57.979507+0000 mon.a (mon.0) 981 : cluster [DBG] osdmap e332: 12 total, 12 up, 12 in 2020-11-16T22:05:59.943 INFO:tasks.rados.rados.2.smithi057.stdout:1125: done (2 left) 2020-11-16T22:05:59.943 INFO:tasks.rados.rados.2.smithi057.stdout:1126: done (1 left) 2020-11-16T22:05:59.943 INFO:tasks.rados.rados.2.smithi057.stdout:1127: done (0 left) 2020-11-16T22:05:59.944 INFO:tasks.rados.rados.2.smithi057.stdout:1128: snap_create 2020-11-16T22:06:00.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:59 smithi016 bash[10302]: cluster 2020-11-16T22:05:58.981799+0000 mon.a (mon.0) 982 : cluster [DBG] osdmap e333: 12 total, 12 up, 12 in 2020-11-16T22:06:00.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:05:59 smithi016 bash[10302]: cluster 2020-11-16T22:05:59.950036+0000 mon.a (mon.0) 983 : cluster [DBG] osdmap e334: 12 total, 12 up, 12 in 2020-11-16T22:06:00.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:59 smithi195 bash[10218]: cluster 2020-11-16T22:05:58.981799+0000 mon.a (mon.0) 982 : cluster [DBG] osdmap e333: 12 total, 12 up, 12 in 2020-11-16T22:06:00.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:05:59 smithi195 bash[10218]: cluster 2020-11-16T22:05:59.950036+0000 mon.a (mon.0) 983 : cluster [DBG] osdmap e334: 12 total, 12 up, 12 in 2020-11-16T22:06:00.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:00 smithi057 bash[10301]: cluster 2020-11-16T22:05:58.981799+0000 mon.a (mon.0) 982 : cluster [DBG] osdmap e333: 12 total, 12 up, 12 in 2020-11-16T22:06:00.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:00 smithi057 bash[10301]: cluster 2020-11-16T22:05:59.950036+0000 mon.a (mon.0) 983 : cluster [DBG] osdmap e334: 12 total, 12 up, 12 in 2020-11-16T22:06:00.954 INFO:tasks.rados.rados.2.smithi057.stdout:1128: done (0 left) 2020-11-16T22:06:00.954 INFO:tasks.rados.rados.2.smithi057.stdout:1129: copy_from oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 36 current snap is 135 2020-11-16T22:06:00.954 INFO:tasks.rados.rados.2.smithi057.stdout:1130: snap_create 2020-11-16T22:06:00.981 INFO:tasks.rados.rados.2.smithi057.stdout:1129: finishing copy_from to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:00.981 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 630 (ObjNum 297 snap 103 seq_num 297) dirty exists 2020-11-16T22:06:00.982 INFO:tasks.rados.rados.2.smithi057.stdout:1129: finishing copy_from racing read to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:01.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:01 smithi016 bash[10302]: cluster 2020-11-16T22:05:59.652424+0000 mgr.x (mgr.24115) 401 : cluster [DBG] pgmap v664: 17 pgs: 17 active+clean; 323 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 826 KiB/s wr, 4 op/s 2020-11-16T22:06:01.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:01 smithi016 bash[10302]: cluster 2020-11-16T22:06:00.963470+0000 mon.a (mon.0) 984 : cluster [DBG] osdmap e335: 12 total, 12 up, 12 in 2020-11-16T22:06:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:01 smithi195 bash[10218]: cluster 2020-11-16T22:05:59.652424+0000 mgr.x (mgr.24115) 401 : cluster [DBG] pgmap v664: 17 pgs: 17 active+clean; 323 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 826 KiB/s wr, 4 op/s 2020-11-16T22:06:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:01 smithi195 bash[10218]: cluster 2020-11-16T22:06:00.963470+0000 mon.a (mon.0) 984 : cluster [DBG] osdmap e335: 12 total, 12 up, 12 in 2020-11-16T22:06:01.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:01 smithi057 bash[10301]: cluster 2020-11-16T22:05:59.652424+0000 mgr.x (mgr.24115) 401 : cluster [DBG] pgmap v664: 17 pgs: 17 active+clean; 323 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 826 KiB/s wr, 4 op/s 2020-11-16T22:06:01.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:01 smithi057 bash[10301]: cluster 2020-11-16T22:06:00.963470+0000 mon.a (mon.0) 984 : cluster [DBG] osdmap e335: 12 total, 12 up, 12 in 2020-11-16T22:06:01.954 INFO:tasks.rados.rados.2.smithi057.stdout:1129: done (1 left) 2020-11-16T22:06:01.955 INFO:tasks.rados.rados.2.smithi057.stdout:1130: done (0 left) 2020-11-16T22:06:01.955 INFO:tasks.rados.rados.2.smithi057.stdout:1131: snap_remove snap 96 2020-11-16T22:06:02.959 INFO:tasks.rados.rados.2.smithi057.stdout:1131: done (0 left) 2020-11-16T22:06:02.959 INFO:tasks.rados.rados.2.smithi057.stdout:1132: delete oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 136 2020-11-16T22:06:02.967 INFO:tasks.rados.rados.2.smithi057.stdout:1132: done (0 left) 2020-11-16T22:06:02.967 INFO:tasks.rados.rados.2.smithi057.stdout:1133: copy_from oid 36 from oid 48 current snap is 136 2020-11-16T22:06:02.967 INFO:tasks.rados.rados.2.smithi057.stdout:1134: write oid 26 current snap is 136 2020-11-16T22:06:02.967 INFO:tasks.rados.rados.2.smithi057.stdout:1134: seq_num 404 ranges {790028=567305,1874490=763137} 2020-11-16T22:06:02.978 INFO:tasks.rados.rados.2.smithi057.stdout:1134: writing smithi05720651-26 from 790028 to 1357333 tid 1 2020-11-16T22:06:02.986 INFO:tasks.rados.rados.2.smithi057.stdout:1134: writing smithi05720651-26 from 1874490 to 2637627 tid 2 2020-11-16T22:06:02.986 INFO:tasks.rados.rados.2.smithi057.stdout:1134: finishing write tid 1 to smithi05720651-26 2020-11-16T22:06:02.986 INFO:tasks.rados.rados.2.smithi057.stdout:1135: rollback oid 46 current snap is 136 2020-11-16T22:06:02.986 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 46 to 125 2020-11-16T22:06:02.987 INFO:tasks.rados.rados.2.smithi057.stdout:1136: rollback oid 6 current snap is 136 2020-11-16T22:06:02.987 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 6 to 132 2020-11-16T22:06:02.987 INFO:tasks.rados.rados.2.smithi057.stdout:1137: delete oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 136 2020-11-16T22:06:02.988 INFO:tasks.rados.rados.2.smithi057.stdout:1133: finishing copy_from to smithi05720651-36 2020-11-16T22:06:02.988 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 234 (ObjNum 402 snap 133 seq_num 402) dirty exists 2020-11-16T22:06:02.988 INFO:tasks.rados.rados.2.smithi057.stdout:1133: finishing copy_from racing read to smithi05720651-36 2020-11-16T22:06:02.992 INFO:tasks.rados.rados.2.smithi057.stdout:1134: finishing write tid 2 to smithi05720651-26 2020-11-16T22:06:02.993 INFO:tasks.rados.rados.2.smithi057.stdout:1135: finishing rollback tid 0 to smithi05720651-46 2020-11-16T22:06:02.993 INFO:tasks.rados.rados.2.smithi057.stdout:1135: finishing rollback tid 1 to smithi05720651-46 2020-11-16T22:06:02.993 INFO:tasks.rados.rados.2.smithi057.stdout:1135: finishing rollback tid 2 to smithi05720651-46 2020-11-16T22:06:02.993 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 910 (ObjNum 336 snap 115 seq_num 336) dirty exists 2020-11-16T22:06:02.995 INFO:tasks.rados.rados.2.smithi057.stdout:1136: finishing rollback tid 0 to smithi05720651-6 2020-11-16T22:06:02.995 INFO:tasks.rados.rados.2.smithi057.stdout:1136: finishing rollback tid 1 to smithi05720651-6 2020-11-16T22:06:02.998 INFO:tasks.rados.rados.2.smithi057.stdout:1134: finishing write tid 4 to smithi05720651-26 2020-11-16T22:06:02.998 INFO:tasks.rados.rados.2.smithi057.stdout:1134: finishing write tid 5 to smithi05720651-26 2020-11-16T22:06:02.999 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 1159 (ObjNum 404 snap 136 seq_num 404) dirty exists 2020-11-16T22:06:02.999 INFO:tasks.rados.rados.2.smithi057.stdout:1134: left oid 26 (ObjNum 404 snap 136 seq_num 404) 2020-11-16T22:06:02.999 INFO:tasks.rados.rados.2.smithi057.stdout:1136: finishing rollback tid 2 to smithi05720651-6 2020-11-16T22:06:02.999 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 937 (ObjNum 391 snap 129 seq_num 391) dirty exists 2020-11-16T22:06:03.000 INFO:tasks.rados.rados.2.smithi057.stdout:1133: done (4 left) 2020-11-16T22:06:03.000 INFO:tasks.rados.rados.2.smithi057.stdout:1134: done (3 left) 2020-11-16T22:06:03.001 INFO:tasks.rados.rados.2.smithi057.stdout:1135: done (2 left) 2020-11-16T22:06:03.001 INFO:tasks.rados.rados.2.smithi057.stdout:1136: done (1 left) 2020-11-16T22:06:03.001 INFO:tasks.rados.rados.2.smithi057.stdout:1137: done (0 left) 2020-11-16T22:06:03.001 INFO:tasks.rados.rados.2.smithi057.stdout:1138: rollback oid 22 current snap is 136 2020-11-16T22:06:03.001 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 22 to 135 2020-11-16T22:06:03.001 INFO:tasks.rados.rados.2.smithi057.stdout:1139: write oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 136 2020-11-16T22:06:03.002 INFO:tasks.rados.rados.2.smithi057.stdout:1139: seq_num 406 ranges {423642=717803,1875101=766806} 2020-11-16T22:06:03.009 INFO:tasks.rados.rados.2.smithi057.stdout:1139: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 423642 to 1141445 tid 1 2020-11-16T22:06:03.020 INFO:tasks.rados.rados.2.smithi057.stdout:1139: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1875101 to 2641907 tid 2 2020-11-16T22:06:03.021 INFO:tasks.rados.rados.2.smithi057.stdout:1140: write (excl) oid 18 current snap is 136 2020-11-16T22:06:03.021 INFO:tasks.rados.rados.2.smithi057.stdout:1140: seq_num 407 ranges {440449=793052,1933583=510464} 2020-11-16T22:06:03.028 INFO:tasks.rados.rados.2.smithi057.stdout:1140: writing smithi05720651-18 from 440449 to 1233501 tid 1 2020-11-16T22:06:03.035 INFO:tasks.rados.rados.2.smithi057.stdout:1140: writing smithi05720651-18 from 1933583 to 2444047 tid 2 2020-11-16T22:06:03.035 INFO:tasks.rados.rados.2.smithi057.stdout:1141: rollback oid 48 current snap is 136 2020-11-16T22:06:03.035 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 48 to 132 2020-11-16T22:06:03.036 INFO:tasks.rados.rados.2.smithi057.stdout:1138: finishing rollback tid 0 to smithi05720651-22 2020-11-16T22:06:03.036 INFO:tasks.rados.rados.2.smithi057.stdout:1138: finishing rollback tid 1 to smithi05720651-22 2020-11-16T22:06:03.036 INFO:tasks.rados.rados.2.smithi057.stdout:1142: read oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:03.036 INFO:tasks.rados.rados.2.smithi057.stdout:1142: expect (ObjNum 334 snap 114 seq_num 334) 2020-11-16T22:06:03.036 INFO:tasks.rados.rados.2.smithi057.stdout:1143: snap_create 2020-11-16T22:06:03.036 INFO:tasks.rados.rados.2.smithi057.stdout:1139: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:03.036 INFO:tasks.rados.rados.2.smithi057.stdout:1139: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:03.037 INFO:tasks.rados.rados.2.smithi057.stdout:1140: finishing write tid 1 to smithi05720651-18 2020-11-16T22:06:03.039 INFO:tasks.rados.rados.2.smithi057.stdout:1141: finishing rollback tid 0 to smithi05720651-48 2020-11-16T22:06:03.040 INFO:tasks.rados.rados.2.smithi057.stdout:1141: finishing rollback tid 1 to smithi05720651-48 2020-11-16T22:06:03.041 INFO:tasks.rados.rados.2.smithi057.stdout:1141: finishing rollback tid 2 to smithi05720651-48 2020-11-16T22:06:03.041 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 240 (ObjNum 144 snap 44 seq_num 144) dirty exists 2020-11-16T22:06:03.043 INFO:tasks.rados.rados.2.smithi057.stdout:1140: finishing write tid 2 to smithi05720651-18 2020-11-16T22:06:03.043 INFO:tasks.rados.rados.2.smithi057.stdout:1140: finishing write tid 4 to smithi05720651-18 2020-11-16T22:06:03.043 INFO:tasks.rados.rados.2.smithi057.stdout:1140: finishing write tid 5 to smithi05720651-18 2020-11-16T22:06:03.043 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 693 (ObjNum 407 snap 136 seq_num 407) dirty exists 2020-11-16T22:06:03.043 INFO:tasks.rados.rados.2.smithi057.stdout:1140: left oid 18 (ObjNum 407 snap 136 seq_num 407) 2020-11-16T22:06:03.049 INFO:tasks.rados.rados.2.smithi057.stdout:1142: expect (ObjNum 334 snap 114 seq_num 334) 2020-11-16T22:06:03.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:02 smithi016 bash[10302]: cluster 2020-11-16T22:06:01.653208+0000 mgr.x (mgr.24115) 402 : cluster [DBG] pgmap v667: 17 pgs: 17 active+clean; 315 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 841 KiB/s wr, 6 op/s 2020-11-16T22:06:03.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:02 smithi016 bash[10302]: cluster 2020-11-16T22:06:01.965475+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e336: 12 total, 12 up, 12 in 2020-11-16T22:06:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:02 smithi195 bash[10218]: cluster 2020-11-16T22:06:01.653208+0000 mgr.x (mgr.24115) 402 : cluster [DBG] pgmap v667: 17 pgs: 17 active+clean; 315 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 841 KiB/s wr, 6 op/s 2020-11-16T22:06:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:02 smithi195 bash[10218]: cluster 2020-11-16T22:06:01.965475+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e336: 12 total, 12 up, 12 in 2020-11-16T22:06:03.421 INFO:tasks.rados.rados.2.smithi057.stdout:1138: finishing rollback tid 2 to smithi05720651-22 2020-11-16T22:06:03.421 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 852 (ObjNum 192 snap 64 seq_num 192) dirty exists 2020-11-16T22:06:03.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:02 smithi057 bash[10301]: cluster 2020-11-16T22:06:01.653208+0000 mgr.x (mgr.24115) 402 : cluster [DBG] pgmap v667: 17 pgs: 17 active+clean; 315 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 841 KiB/s wr, 6 op/s 2020-11-16T22:06:03.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:02 smithi057 bash[10301]: cluster 2020-11-16T22:06:01.965475+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e336: 12 total, 12 up, 12 in 2020-11-16T22:06:03.616 INFO:tasks.rados.rados.2.smithi057.stdout:1139: finishing write tid 4 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:03.617 INFO:tasks.rados.rados.2.smithi057.stdout:1139: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:03.617 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 951 (ObjNum 406 snap 136 seq_num 406) dirty exists 2020-11-16T22:06:03.617 INFO:tasks.rados.rados.2.smithi057.stdout:1139: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 406 snap 136 seq_num 406) 2020-11-16T22:06:03.979 INFO:tasks.rados.rados.2.smithi057.stdout:1138: done (5 left) 2020-11-16T22:06:03.979 INFO:tasks.rados.rados.2.smithi057.stdout:1139: done (4 left) 2020-11-16T22:06:03.980 INFO:tasks.rados.rados.2.smithi057.stdout:1140: done (3 left) 2020-11-16T22:06:03.980 INFO:tasks.rados.rados.2.smithi057.stdout:1141: done (2 left) 2020-11-16T22:06:03.980 INFO:tasks.rados.rados.2.smithi057.stdout:1142: done (1 left) 2020-11-16T22:06:03.980 INFO:tasks.rados.rados.2.smithi057.stdout:1143: done (0 left) 2020-11-16T22:06:03.980 INFO:tasks.rados.rados.2.smithi057.stdout:1144: read oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:03.980 INFO:tasks.rados.rados.2.smithi057.stdout:1144: expect deleted 2020-11-16T22:06:03.980 INFO:tasks.rados.rados.2.smithi057.stdout:1145: write (excl) oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 137 2020-11-16T22:06:03.981 INFO:tasks.rados.rados.2.smithi057.stdout:1145: seq_num 408 ranges {457256=468301,1592065=770475,2854581=2675} 2020-11-16T22:06:03.990 INFO:tasks.rados.rados.2.smithi057.stdout:1145: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 457256 to 925557 tid 1 2020-11-16T22:06:03.999 INFO:tasks.rados.rados.2.smithi057.stdout:1145: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1592065 to 2362540 tid 2 2020-11-16T22:06:04.002 INFO:tasks.rados.rados.2.smithi057.stdout:1145: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2854581 to 2857256 tid 3 2020-11-16T22:06:04.002 INFO:tasks.rados.rados.2.smithi057.stdout:1146: copy_from oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 30 current snap is 137 2020-11-16T22:06:04.002 INFO:tasks.rados.rados.2.smithi057.stdout:1144: done (2 left) 2020-11-16T22:06:04.002 INFO:tasks.rados.rados.2.smithi057.stdout:1147: copy_from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 34 current snap is 137 2020-11-16T22:06:04.002 INFO:tasks.rados.rados.2.smithi057.stdout:1148: write oid 36 current snap is 137 2020-11-16T22:06:04.003 INFO:tasks.rados.rados.2.smithi057.stdout:1148: seq_num 409 ranges {474063=543550,1650547=514133,2765651=108412} 2020-11-16T22:06:04.007 INFO:tasks.rados.rados.2.smithi057.stdout:1148: writing smithi05720651-36 from 474063 to 1017613 tid 1 2020-11-16T22:06:04.014 INFO:tasks.rados.rados.2.smithi057.stdout:1148: writing smithi05720651-36 from 1650547 to 2164680 tid 2 2020-11-16T22:06:04.018 INFO:tasks.rados.rados.2.smithi057.stdout:1148: writing smithi05720651-36 from 2765651 to 2874063 tid 3 2020-11-16T22:06:04.019 INFO:tasks.rados.rados.2.smithi057.stdout:1149: snap_create 2020-11-16T22:06:04.019 INFO:tasks.rados.rados.2.smithi057.stdout:1145: finishing write tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:04.019 INFO:tasks.rados.rados.2.smithi057.stdout:1147: finishing copy_from to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:04.019 INFO:tasks.rados.rados.2.smithi057.stdout:1147: got expected ENOENT (src dne) 2020-11-16T22:06:04.019 INFO:tasks.rados.rados.2.smithi057.stdout:1146: finishing copy_from to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:04.019 INFO:tasks.rados.rados.2.smithi057.stdout:1146: got expected ENOENT (src dne) 2020-11-16T22:06:04.019 INFO:tasks.rados.rados.2.smithi057.stdout:1146: finishing copy_from racing read to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:04.020 INFO:tasks.rados.rados.2.smithi057.stdout:1147: finishing copy_from racing read to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:04.020 INFO:tasks.rados.rados.2.smithi057.stdout:1145: finishing write tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:04.020 INFO:tasks.rados.rados.2.smithi057.stdout:1145: finishing write tid 3 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:04.020 INFO:tasks.rados.rados.2.smithi057.stdout:1145: finishing write tid 5 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:04.020 INFO:tasks.rados.rados.2.smithi057.stdout:1145: finishing write tid 6 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:04.020 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1164 (ObjNum 408 snap 137 seq_num 408) dirty exists 2020-11-16T22:06:04.020 INFO:tasks.rados.rados.2.smithi057.stdout:1145: left oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 408 snap 137 seq_num 408) 2020-11-16T22:06:04.021 INFO:tasks.rados.rados.2.smithi057.stdout:1148: finishing write tid 1 to smithi05720651-36 2020-11-16T22:06:04.021 INFO:tasks.rados.rados.2.smithi057.stdout:1148: finishing write tid 2 to smithi05720651-36 2020-11-16T22:06:04.023 INFO:tasks.rados.rados.2.smithi057.stdout:1148: finishing write tid 3 to smithi05720651-36 2020-11-16T22:06:04.023 INFO:tasks.rados.rados.2.smithi057.stdout:1148: finishing write tid 5 to smithi05720651-36 2020-11-16T22:06:04.024 INFO:tasks.rados.rados.2.smithi057.stdout:1148: finishing write tid 6 to smithi05720651-36 2020-11-16T22:06:04.024 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 675 (ObjNum 409 snap 137 seq_num 409) dirty exists 2020-11-16T22:06:04.024 INFO:tasks.rados.rados.2.smithi057.stdout:1148: left oid 36 (ObjNum 409 snap 137 seq_num 409) 2020-11-16T22:06:04.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:03 smithi016 bash[10302]: cluster 2020-11-16T22:06:02.968485+0000 mon.a (mon.0) 986 : cluster [DBG] osdmap e337: 12 total, 12 up, 12 in 2020-11-16T22:06:04.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:03 smithi195 bash[10218]: cluster 2020-11-16T22:06:02.968485+0000 mon.a (mon.0) 986 : cluster [DBG] osdmap e337: 12 total, 12 up, 12 in 2020-11-16T22:06:04.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:03 smithi057 bash[10301]: cluster 2020-11-16T22:06:02.968485+0000 mon.a (mon.0) 986 : cluster [DBG] osdmap e337: 12 total, 12 up, 12 in 2020-11-16T22:06:04.943 INFO:tasks.rados.rados.2.smithi057.stdout:1145: done (4 left) 2020-11-16T22:06:04.944 INFO:tasks.rados.rados.2.smithi057.stdout:1146: done (3 left) 2020-11-16T22:06:04.944 INFO:tasks.rados.rados.2.smithi057.stdout:1147: done (2 left) 2020-11-16T22:06:04.944 INFO:tasks.rados.rados.2.smithi057.stdout:1148: done (1 left) 2020-11-16T22:06:04.944 INFO:tasks.rados.rados.2.smithi057.stdout:1149: done (0 left) 2020-11-16T22:06:04.944 INFO:tasks.rados.rados.2.smithi057.stdout:1150: write (excl) oid 48 current snap is 138 2020-11-16T22:06:04.945 INFO:tasks.rados.rados.2.smithi057.stdout:1150: seq_num 410 ranges {490870=618799,1592676=774144,2793074=97796} 2020-11-16T22:06:04.953 INFO:tasks.rados.rados.2.smithi057.stdout:1150: writing smithi05720651-48 from 490870 to 1109669 tid 1 2020-11-16T22:06:04.962 INFO:tasks.rados.rados.2.smithi057.stdout:1150: writing smithi05720651-48 from 1592676 to 2366820 tid 2 2020-11-16T22:06:04.965 INFO:tasks.rados.rados.2.smithi057.stdout:1150: writing smithi05720651-48 from 2793074 to 2890870 tid 3 2020-11-16T22:06:04.965 INFO:tasks.rados.rados.2.smithi057.stdout:1151: read oid 22 snap -1 2020-11-16T22:06:04.965 INFO:tasks.rados.rados.2.smithi057.stdout:1151: expect (ObjNum 192 snap 64 seq_num 192) 2020-11-16T22:06:04.966 INFO:tasks.rados.rados.2.smithi057.stdout:1150: finishing write tid 1 to smithi05720651-48 2020-11-16T22:06:04.966 INFO:tasks.rados.rados.2.smithi057.stdout:1152: read oid 26 snap -1 2020-11-16T22:06:04.966 INFO:tasks.rados.rados.2.smithi057.stdout:1152: expect (ObjNum 404 snap 136 seq_num 404) 2020-11-16T22:06:04.967 INFO:tasks.rados.rados.2.smithi057.stdout:1153: write oid 46 current snap is 138 2020-11-16T22:06:04.967 INFO:tasks.rados.rados.2.smithi057.stdout:1153: seq_num 411 ranges {507677=410401,1367511=517802,2420497=487180} 2020-11-16T22:06:04.971 INFO:tasks.rados.rados.2.smithi057.stdout:1153: writing smithi05720651-46 from 507677 to 918078 tid 1 2020-11-16T22:06:04.978 INFO:tasks.rados.rados.2.smithi057.stdout:1153: writing smithi05720651-46 from 1367511 to 1885313 tid 2 2020-11-16T22:06:04.985 INFO:tasks.rados.rados.2.smithi057.stdout:1153: writing smithi05720651-46 from 2420497 to 2907677 tid 3 2020-11-16T22:06:04.985 INFO:tasks.rados.rados.2.smithi057.stdout:1154: read oid 28 snap -1 2020-11-16T22:06:04.985 INFO:tasks.rados.rados.2.smithi057.stdout:1154: expect (ObjNum 399 snap 133 seq_num 399) 2020-11-16T22:06:04.986 INFO:tasks.rados.rados.2.smithi057.stdout:1155: snap_create 2020-11-16T22:06:04.986 INFO:tasks.rados.rados.2.smithi057.stdout:1150: finishing write tid 2 to smithi05720651-48 2020-11-16T22:06:04.986 INFO:tasks.rados.rados.2.smithi057.stdout:1150: finishing write tid 3 to smithi05720651-48 2020-11-16T22:06:04.986 INFO:tasks.rados.rados.2.smithi057.stdout:1150: finishing write tid 5 to smithi05720651-48 2020-11-16T22:06:04.986 INFO:tasks.rados.rados.2.smithi057.stdout:1150: finishing write tid 6 to smithi05720651-48 2020-11-16T22:06:04.986 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 245 (ObjNum 410 snap 138 seq_num 410) dirty exists 2020-11-16T22:06:04.987 INFO:tasks.rados.rados.2.smithi057.stdout:1150: left oid 48 (ObjNum 410 snap 138 seq_num 410) 2020-11-16T22:06:04.987 INFO:tasks.rados.rados.2.smithi057.stdout:1151: expect (ObjNum 192 snap 64 seq_num 192) 2020-11-16T22:06:05.087 INFO:tasks.rados.rados.2.smithi057.stdout:1152: expect (ObjNum 404 snap 136 seq_num 404) 2020-11-16T22:06:05.303 INFO:tasks.rados.rados.2.smithi057.stdout:1153: finishing write tid 1 to smithi05720651-46 2020-11-16T22:06:05.303 INFO:tasks.rados.rados.2.smithi057.stdout:1153: finishing write tid 2 to smithi05720651-46 2020-11-16T22:06:05.303 INFO:tasks.rados.rados.2.smithi057.stdout:1153: finishing write tid 3 to smithi05720651-46 2020-11-16T22:06:05.303 INFO:tasks.rados.rados.2.smithi057.stdout:1153: finishing write tid 5 to smithi05720651-46 2020-11-16T22:06:05.304 INFO:tasks.rados.rados.2.smithi057.stdout:1154: expect (ObjNum 399 snap 133 seq_num 399) 2020-11-16T22:06:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:04 smithi016 bash[10302]: cluster 2020-11-16T22:06:03.653861+0000 mgr.x (mgr.24115) 403 : cluster [DBG] pgmap v670: 17 pgs: 17 active+clean; 317 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.2 MiB/s wr, 7 op/s 2020-11-16T22:06:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:04 smithi016 bash[10302]: cluster 2020-11-16T22:06:03.986208+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e338: 12 total, 12 up, 12 in 2020-11-16T22:06:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:04 smithi016 bash[10302]: cluster 2020-11-16T22:06:04.952448+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e339: 12 total, 12 up, 12 in 2020-11-16T22:06:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:04 smithi195 bash[10218]: cluster 2020-11-16T22:06:03.653861+0000 mgr.x (mgr.24115) 403 : cluster [DBG] pgmap v670: 17 pgs: 17 active+clean; 317 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.2 MiB/s wr, 7 op/s 2020-11-16T22:06:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:04 smithi195 bash[10218]: cluster 2020-11-16T22:06:03.986208+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e338: 12 total, 12 up, 12 in 2020-11-16T22:06:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:04 smithi195 bash[10218]: cluster 2020-11-16T22:06:04.952448+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e339: 12 total, 12 up, 12 in 2020-11-16T22:06:05.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:04 smithi057 bash[10301]: cluster 2020-11-16T22:06:03.653861+0000 mgr.x (mgr.24115) 403 : cluster [DBG] pgmap v670: 17 pgs: 17 active+clean; 317 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.2 MiB/s wr, 7 op/s 2020-11-16T22:06:05.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:04 smithi057 bash[10301]: cluster 2020-11-16T22:06:03.986208+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e338: 12 total, 12 up, 12 in 2020-11-16T22:06:05.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:04 smithi057 bash[10301]: cluster 2020-11-16T22:06:04.952448+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e339: 12 total, 12 up, 12 in 2020-11-16T22:06:05.659 INFO:tasks.rados.rados.2.smithi057.stdout:1153: finishing write tid 6 to smithi05720651-46 2020-11-16T22:06:05.659 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 915 (ObjNum 411 snap 138 seq_num 411) dirty exists 2020-11-16T22:06:05.659 INFO:tasks.rados.rados.2.smithi057.stdout:1153: left oid 46 (ObjNum 411 snap 138 seq_num 411) 2020-11-16T22:06:06.003 INFO:tasks.rados.rados.2.smithi057.stdout:1150: done (5 left) 2020-11-16T22:06:06.004 INFO:tasks.rados.rados.2.smithi057.stdout:1151: done (4 left) 2020-11-16T22:06:06.004 INFO:tasks.rados.rados.2.smithi057.stdout:1152: done (3 left) 2020-11-16T22:06:06.004 INFO:tasks.rados.rados.2.smithi057.stdout:1153: done (2 left) 2020-11-16T22:06:06.004 INFO:tasks.rados.rados.2.smithi057.stdout:1154: done (1 left) 2020-11-16T22:06:06.004 INFO:tasks.rados.rados.2.smithi057.stdout:1155: done (0 left) 2020-11-16T22:06:06.005 INFO:tasks.rados.rados.2.smithi057.stdout:1156: copy_from oid 50 from oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 139 2020-11-16T22:06:06.005 INFO:tasks.rados.rados.2.smithi057.stdout:1157: snap_remove snap 131 2020-11-16T22:06:07.011 INFO:tasks.rados.rados.2.smithi057.stdout:1157: done (1 left) 2020-11-16T22:06:07.012 INFO:tasks.rados.rados.2.smithi057.stdout:1158: read oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:07.012 INFO:tasks.rados.rados.2.smithi057.stdout:1158: expect (ObjNum 264 snap 86 seq_num 264) 2020-11-16T22:06:07.012 INFO:tasks.rados.rados.2.smithi057.stdout:1159: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:07.012 INFO:tasks.rados.rados.2.smithi057.stdout:1159: expect deleted 2020-11-16T22:06:07.012 INFO:tasks.rados.rados.2.smithi057.stdout:1160: rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 139 2020-11-16T22:06:07.012 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 114 2020-11-16T22:06:07.013 INFO:tasks.rados.rados.2.smithi057.stdout:1156: finishing copy_from to smithi05720651-50 2020-11-16T22:06:07.013 INFO:tasks.rados.rados.2.smithi057.stdout:1156: got expected ENOENT (src dne) 2020-11-16T22:06:07.013 INFO:tasks.rados.rados.2.smithi057.stdout:1156: finishing copy_from racing read to smithi05720651-50 2020-11-16T22:06:07.013 INFO:tasks.rados.rados.2.smithi057.stdout:1156: done (3 left) 2020-11-16T22:06:07.013 INFO:tasks.rados.rados.2.smithi057.stdout:1161: write oid 10 current snap is 139 2020-11-16T22:06:07.013 INFO:tasks.rados.rados.2.smithi057.stdout:1161: seq_num 412 ranges {524484=485650,1425993=661460,2847920=76564} 2020-11-16T22:06:07.023 INFO:tasks.rados.rados.2.smithi057.stdout:1161: writing smithi05720651-10 from 524484 to 1010134 tid 1 2020-11-16T22:06:07.030 INFO:tasks.rados.rados.2.smithi057.stdout:1161: writing smithi05720651-10 from 1425993 to 2087453 tid 2 2020-11-16T22:06:07.035 INFO:tasks.rados.rados.2.smithi057.stdout:1161: writing smithi05720651-10 from 2847920 to 2924484 tid 3 2020-11-16T22:06:07.035 INFO:tasks.rados.rados.2.smithi057.stdout:1162: snap_create 2020-11-16T22:06:07.035 INFO:tasks.rados.rados.2.smithi057.stdout:1160: finishing rollback tid 0 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:07.035 INFO:tasks.rados.rados.2.smithi057.stdout:1160: finishing rollback tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:07.035 INFO:tasks.rados.rados.2.smithi057.stdout:1160: finishing rollback tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:07.036 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 919 (ObjNum 327 snap 111 seq_num 327) dirty exists 2020-11-16T22:06:07.036 INFO:tasks.rados.rados.2.smithi057.stdout:1158: expect (ObjNum 264 snap 86 seq_num 264) 2020-11-16T22:06:07.171 INFO:tasks.rados.rados.2.smithi057.stdout:1161: finishing write tid 1 to smithi05720651-10 2020-11-16T22:06:07.171 INFO:tasks.rados.rados.2.smithi057.stdout:1161: finishing write tid 2 to smithi05720651-10 2020-11-16T22:06:07.171 INFO:tasks.rados.rados.2.smithi057.stdout:1161: finishing write tid 3 to smithi05720651-10 2020-11-16T22:06:07.269 INFO:tasks.rados.rados.2.smithi057.stdout:1161: finishing write tid 5 to smithi05720651-10 2020-11-16T22:06:07.269 INFO:tasks.rados.rados.2.smithi057.stdout:1161: finishing write tid 6 to smithi05720651-10 2020-11-16T22:06:07.269 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 684 (ObjNum 412 snap 139 seq_num 412) dirty exists 2020-11-16T22:06:07.270 INFO:tasks.rados.rados.2.smithi057.stdout:1161: left oid 10 (ObjNum 412 snap 139 seq_num 412) 2020-11-16T22:06:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:07 smithi016 bash[10302]: cluster 2020-11-16T22:06:05.654543+0000 mgr.x (mgr.24115) 404 : cluster [DBG] pgmap v673: 17 pgs: 17 active+clean; 292 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 10 op/s 2020-11-16T22:06:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:07 smithi016 bash[10302]: cluster 2020-11-16T22:06:06.010306+0000 mon.a (mon.0) 989 : cluster [DBG] osdmap e340: 12 total, 12 up, 12 in 2020-11-16T22:06:07.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:07 smithi195 bash[10218]: cluster 2020-11-16T22:06:05.654543+0000 mgr.x (mgr.24115) 404 : cluster [DBG] pgmap v673: 17 pgs: 17 active+clean; 292 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 10 op/s 2020-11-16T22:06:07.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:07 smithi195 bash[10218]: cluster 2020-11-16T22:06:06.010306+0000 mon.a (mon.0) 989 : cluster [DBG] osdmap e340: 12 total, 12 up, 12 in 2020-11-16T22:06:07.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:07 smithi057 bash[10301]: cluster 2020-11-16T22:06:05.654543+0000 mgr.x (mgr.24115) 404 : cluster [DBG] pgmap v673: 17 pgs: 17 active+clean; 292 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 10 op/s 2020-11-16T22:06:07.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:07 smithi057 bash[10301]: cluster 2020-11-16T22:06:06.010306+0000 mon.a (mon.0) 989 : cluster [DBG] osdmap e340: 12 total, 12 up, 12 in 2020-11-16T22:06:08.019 INFO:tasks.rados.rados.2.smithi057.stdout:1158: done (4 left) 2020-11-16T22:06:08.020 INFO:tasks.rados.rados.2.smithi057.stdout:1159: done (3 left) 2020-11-16T22:06:08.020 INFO:tasks.rados.rados.2.smithi057.stdout:1160: done (2 left) 2020-11-16T22:06:08.020 INFO:tasks.rados.rados.2.smithi057.stdout:1161: done (1 left) 2020-11-16T22:06:08.020 INFO:tasks.rados.rados.2.smithi057.stdout:1162: done (0 left) 2020-11-16T22:06:08.020 INFO:tasks.rados.rados.2.smithi057.stdout:1163: write oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 140 2020-11-16T22:06:08.021 INFO:tasks.rados.rados.2.smithi057.stdout:1163: seq_num 413 ranges {541291=560899,1884475=521471} 2020-11-16T22:06:08.031 INFO:tasks.rados.rados.2.smithi057.stdout:1163: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 541291 to 1102190 tid 1 2020-11-16T22:06:08.040 INFO:tasks.rados.rados.2.smithi057.stdout:1163: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1884475 to 2405946 tid 2 2020-11-16T22:06:08.040 INFO:tasks.rados.rados.2.smithi057.stdout:1164: delete oid 36 current snap is 140 2020-11-16T22:06:08.040 INFO:tasks.rados.rados.2.smithi057.stdout:1163: finishing write tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:08.045 INFO:tasks.rados.rados.2.smithi057.stdout:1164: done (1 left) 2020-11-16T22:06:08.045 INFO:tasks.rados.rados.2.smithi057.stdout:1165: write oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 140 2020-11-16T22:06:08.045 INFO:tasks.rados.rados.2.smithi057.stdout:1165: seq_num 415 ranges {574905=711397,1885086=525140,2930189=44716} 2020-11-16T22:06:08.052 INFO:tasks.rados.rados.2.smithi057.stdout:1165: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 574905 to 1286302 tid 1 2020-11-16T22:06:08.060 INFO:tasks.rados.rados.2.smithi057.stdout:1165: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1885086 to 2410226 tid 2 2020-11-16T22:06:08.064 INFO:tasks.rados.rados.2.smithi057.stdout:1165: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2930189 to 2974905 tid 3 2020-11-16T22:06:08.064 INFO:tasks.rados.rados.2.smithi057.stdout:1166: rollback oid 10 current snap is 140 2020-11-16T22:06:08.064 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 10 to 127 2020-11-16T22:06:08.064 INFO:tasks.rados.rados.2.smithi057.stdout:1163: finishing write tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:08.064 INFO:tasks.rados.rados.2.smithi057.stdout:1167: write (excl) oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 140 2020-11-16T22:06:08.065 INFO:tasks.rados.rados.2.smithi057.stdout:1167: seq_num 416 ranges {591712=786646,1943568=668798} 2020-11-16T22:06:08.072 INFO:tasks.rados.rados.2.smithi057.stdout:1167: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 591712 to 1378358 tid 1 2020-11-16T22:06:08.079 INFO:tasks.rados.rados.2.smithi057.stdout:1167: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1943568 to 2612366 tid 2 2020-11-16T22:06:08.079 INFO:tasks.rados.rados.2.smithi057.stdout:1168: read oid 8 snap -1 2020-11-16T22:06:08.080 INFO:tasks.rados.rados.2.smithi057.stdout:1168: expect (ObjNum 371 snap 123 seq_num 371) 2020-11-16T22:06:08.080 INFO:tasks.rados.rados.2.smithi057.stdout:1169: rollback oid 4 current snap is 140 2020-11-16T22:06:08.080 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 4 to 134 2020-11-16T22:06:08.080 INFO:tasks.rados.rados.2.smithi057.stdout:1165: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:08.080 INFO:tasks.rados.rados.2.smithi057.stdout:1170: copy_from oid 28 from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 140 2020-11-16T22:06:08.080 INFO:tasks.rados.rados.2.smithi057.stdout:1165: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:08.081 INFO:tasks.rados.rados.2.smithi057.stdout:1165: finishing write tid 3 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:08.081 INFO:tasks.rados.rados.2.smithi057.stdout:1165: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:08.081 INFO:tasks.rados.rados.2.smithi057.stdout:1165: finishing write tid 6 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:08.081 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 960 (ObjNum 415 snap 140 seq_num 415) dirty exists 2020-11-16T22:06:08.081 INFO:tasks.rados.rados.2.smithi057.stdout:1165: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 415 snap 140 seq_num 415) 2020-11-16T22:06:08.081 INFO:tasks.rados.rados.2.smithi057.stdout:1166: finishing rollback tid 0 to smithi05720651-10 2020-11-16T22:06:08.081 INFO:tasks.rados.rados.2.smithi057.stdout:1166: finishing rollback tid 1 to smithi05720651-10 2020-11-16T22:06:08.082 INFO:tasks.rados.rados.2.smithi057.stdout:1166: finishing rollback tid 2 to smithi05720651-10 2020-11-16T22:06:08.082 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 690 (ObjNum 112 snap 34 seq_num 112) dirty exists 2020-11-16T22:06:08.082 INFO:tasks.rados.rados.2.smithi057.stdout:1165: done (6 left) 2020-11-16T22:06:08.082 INFO:tasks.rados.rados.2.smithi057.stdout:1166: done (5 left) 2020-11-16T22:06:08.082 INFO:tasks.rados.rados.2.smithi057.stdout:1171: snap_remove snap 137 2020-11-16T22:06:08.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:08 smithi016 bash[10302]: cluster 2020-11-16T22:06:07.021683+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e341: 12 total, 12 up, 12 in 2020-11-16T22:06:08.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:08 smithi195 bash[10218]: cluster 2020-11-16T22:06:07.021683+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e341: 12 total, 12 up, 12 in 2020-11-16T22:06:08.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:08 smithi057 bash[10301]: cluster 2020-11-16T22:06:07.021683+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e341: 12 total, 12 up, 12 in 2020-11-16T22:06:09.030 INFO:tasks.rados.rados.2.smithi057.stdout:1171: done (5 left) 2020-11-16T22:06:09.030 INFO:tasks.rados.rados.2.smithi057.stdout:1172: write oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 140 2020-11-16T22:06:09.031 INFO:tasks.rados.rados.2.smithi057.stdout:1172: seq_num 417 ranges {608519=461895,1602050=528809,2585035=423484} 2020-11-16T22:06:09.041 INFO:tasks.rados.rados.2.smithi057.stdout:1172: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 608519 to 1070414 tid 1 2020-11-16T22:06:09.048 INFO:tasks.rados.rados.2.smithi057.stdout:1172: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1602050 to 2130859 tid 2 2020-11-16T22:06:09.054 INFO:tasks.rados.rados.2.smithi057.stdout:1172: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2585035 to 3008519 tid 3 2020-11-16T22:06:09.054 INFO:tasks.rados.rados.2.smithi057.stdout:1173: read oid 16 snap -1 2020-11-16T22:06:09.054 INFO:tasks.rados.rados.2.smithi057.stdout:1173: expect (ObjNum 321 snap 111 seq_num 321) 2020-11-16T22:06:09.055 INFO:tasks.rados.rados.2.smithi057.stdout:1174: delete oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 140 2020-11-16T22:06:09.055 INFO:tasks.rados.rados.2.smithi057.stdout:1167: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:09.055 INFO:tasks.rados.rados.2.smithi057.stdout:1169: finishing rollback tid 1 to smithi05720651-4 2020-11-16T22:06:09.055 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 340 (ObjNum 33 snap 0 seq_num 1131374913) dirty dne 2020-11-16T22:06:09.055 INFO:tasks.rados.rados.2.smithi057.stdout:1167: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:09.055 INFO:tasks.rados.rados.2.smithi057.stdout:1167: finishing write tid 4 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:09.055 INFO:tasks.rados.rados.2.smithi057.stdout:1167: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:09.056 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 964 (ObjNum 416 snap 140 seq_num 416) dirty exists 2020-11-16T22:06:09.056 INFO:tasks.rados.rados.2.smithi057.stdout:1167: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 416 snap 140 seq_num 416) 2020-11-16T22:06:09.056 INFO:tasks.rados.rados.2.smithi057.stdout:1168: expect (ObjNum 371 snap 123 seq_num 371) 2020-11-16T22:06:09.132 INFO:tasks.rados.rados.2.smithi057.stdout:1170: finishing copy_from to smithi05720651-28 2020-11-16T22:06:09.132 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 302 (ObjNum 322 snap 111 seq_num 322) dirty exists 2020-11-16T22:06:09.132 INFO:tasks.rados.rados.2.smithi057.stdout:1170: finishing copy_from racing read to smithi05720651-28 2020-11-16T22:06:09.132 INFO:tasks.rados.rados.2.smithi057.stdout:1163: finishing write tid 4 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:09.132 INFO:tasks.rados.rados.2.smithi057.stdout:1163: finishing write tid 5 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:09.132 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 927 (ObjNum 413 snap 140 seq_num 413) dirty exists 2020-11-16T22:06:09.133 INFO:tasks.rados.rados.2.smithi057.stdout:1163: left oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 413 snap 140 seq_num 413) 2020-11-16T22:06:09.133 INFO:tasks.rados.rados.2.smithi057.stdout:1172: finishing write tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:09.133 INFO:tasks.rados.rados.2.smithi057.stdout:1163: done (7 left) 2020-11-16T22:06:09.133 INFO:tasks.rados.rados.2.smithi057.stdout:1167: done (6 left) 2020-11-16T22:06:09.133 INFO:tasks.rados.rados.2.smithi057.stdout:1168: done (5 left) 2020-11-16T22:06:09.133 INFO:tasks.rados.rados.2.smithi057.stdout:1169: done (4 left) 2020-11-16T22:06:09.133 INFO:tasks.rados.rados.2.smithi057.stdout:1170: done (3 left) 2020-11-16T22:06:09.133 INFO:tasks.rados.rados.2.smithi057.stdout:1174: done (2 left) 2020-11-16T22:06:09.134 INFO:tasks.rados.rados.2.smithi057.stdout:1175: snap_create 2020-11-16T22:06:09.134 INFO:tasks.rados.rados.2.smithi057.stdout:1172: finishing write tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:09.134 INFO:tasks.rados.rados.2.smithi057.stdout:1172: finishing write tid 3 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:09.134 INFO:tasks.rados.rados.2.smithi057.stdout:1172: finishing write tid 5 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:09.134 INFO:tasks.rados.rados.2.smithi057.stdout:1172: finishing write tid 6 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:09.134 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 160 (ObjNum 417 snap 140 seq_num 417) dirty exists 2020-11-16T22:06:09.134 INFO:tasks.rados.rados.2.smithi057.stdout:1172: left oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 417 snap 140 seq_num 417) 2020-11-16T22:06:09.135 INFO:tasks.rados.rados.2.smithi057.stdout:1173: expect (ObjNum 321 snap 111 seq_num 321) 2020-11-16T22:06:09.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:09 smithi016 bash[10302]: cluster 2020-11-16T22:06:07.655332+0000 mgr.x (mgr.24115) 405 : cluster [DBG] pgmap v676: 17 pgs: 17 active+clean; 262 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.6 MiB/s wr, 18 op/s 2020-11-16T22:06:09.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:09 smithi016 bash[10302]: cluster 2020-11-16T22:06:08.029487+0000 mon.a (mon.0) 991 : cluster [DBG] osdmap e342: 12 total, 12 up, 12 in 2020-11-16T22:06:09.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:09 smithi195 bash[10218]: cluster 2020-11-16T22:06:07.655332+0000 mgr.x (mgr.24115) 405 : cluster [DBG] pgmap v676: 17 pgs: 17 active+clean; 262 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.6 MiB/s wr, 18 op/s 2020-11-16T22:06:09.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:09 smithi195 bash[10218]: cluster 2020-11-16T22:06:08.029487+0000 mon.a (mon.0) 991 : cluster [DBG] osdmap e342: 12 total, 12 up, 12 in 2020-11-16T22:06:09.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:09 smithi057 bash[10301]: cluster 2020-11-16T22:06:07.655332+0000 mgr.x (mgr.24115) 405 : cluster [DBG] pgmap v676: 17 pgs: 17 active+clean; 262 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.6 MiB/s wr, 18 op/s 2020-11-16T22:06:09.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:09 smithi057 bash[10301]: cluster 2020-11-16T22:06:08.029487+0000 mon.a (mon.0) 991 : cluster [DBG] osdmap e342: 12 total, 12 up, 12 in 2020-11-16T22:06:09.942 INFO:tasks.rados.rados.2.smithi057.stdout:1172: done (2 left) 2020-11-16T22:06:09.942 INFO:tasks.rados.rados.2.smithi057.stdout:1173: done (1 left) 2020-11-16T22:06:09.943 INFO:tasks.rados.rados.2.smithi057.stdout:1175: done (0 left) 2020-11-16T22:06:09.943 INFO:tasks.rados.rados.2.smithi057.stdout:1176: copy_from oid 42 from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 141 2020-11-16T22:06:09.943 INFO:tasks.rados.rados.2.smithi057.stdout:1177: snap_remove snap 139 2020-11-16T22:06:10.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:10 smithi016 bash[10302]: cluster 2020-11-16T22:06:09.039553+0000 mon.a (mon.0) 992 : cluster [DBG] osdmap e343: 12 total, 12 up, 12 in 2020-11-16T22:06:10.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:10 smithi016 bash[10302]: cluster 2020-11-16T22:06:09.952867+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e344: 12 total, 12 up, 12 in 2020-11-16T22:06:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:10 smithi195 bash[10218]: cluster 2020-11-16T22:06:09.039553+0000 mon.a (mon.0) 992 : cluster [DBG] osdmap e343: 12 total, 12 up, 12 in 2020-11-16T22:06:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:10 smithi195 bash[10218]: cluster 2020-11-16T22:06:09.952867+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e344: 12 total, 12 up, 12 in 2020-11-16T22:06:10.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:10 smithi057 bash[10301]: cluster 2020-11-16T22:06:09.039553+0000 mon.a (mon.0) 992 : cluster [DBG] osdmap e343: 12 total, 12 up, 12 in 2020-11-16T22:06:10.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:10 smithi057 bash[10301]: cluster 2020-11-16T22:06:09.952867+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e344: 12 total, 12 up, 12 in 2020-11-16T22:06:10.957 INFO:tasks.rados.rados.2.smithi057.stdout:1177: done (1 left) 2020-11-16T22:06:10.957 INFO:tasks.rados.rados.2.smithi057.stdout:1178: read oid 36 snap 127 2020-11-16T22:06:10.957 INFO:tasks.rados.rados.2.smithi057.stdout:1178: expect (ObjNum 297 snap 103 seq_num 297) 2020-11-16T22:06:10.958 INFO:tasks.rados.rados.2.smithi057.stdout:1179: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:10.958 INFO:tasks.rados.rados.2.smithi057.stdout:1179: expect (ObjNum 401 snap 133 seq_num 401) 2020-11-16T22:06:10.958 INFO:tasks.rados.rados.2.smithi057.stdout:1180: copy_from oid 20 from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 141 2020-11-16T22:06:10.958 INFO:tasks.rados.rados.2.smithi057.stdout:1176: finishing copy_from to smithi05720651-42 2020-11-16T22:06:10.958 INFO:tasks.rados.rados.2.smithi057.stdout:1176: got expected ENOENT (src dne) 2020-11-16T22:06:10.958 INFO:tasks.rados.rados.2.smithi057.stdout:1176: finishing copy_from racing read to smithi05720651-42 2020-11-16T22:06:10.959 INFO:tasks.rados.rados.2.smithi057.stdout:1176: done (3 left) 2020-11-16T22:06:10.959 INFO:tasks.rados.rados.2.smithi057.stdout:1181: snap_remove snap 130 2020-11-16T22:06:11.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:11 smithi016 bash[10302]: cluster 2020-11-16T22:06:09.656009+0000 mgr.x (mgr.24115) 406 : cluster [DBG] pgmap v679: 17 pgs: 17 active+clean; 262 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2020-11-16T22:06:11.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:11 smithi016 bash[10302]: cluster 2020-11-16T22:06:10.961996+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e345: 12 total, 12 up, 12 in 2020-11-16T22:06:11.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:11 smithi195 bash[10218]: cluster 2020-11-16T22:06:09.656009+0000 mgr.x (mgr.24115) 406 : cluster [DBG] pgmap v679: 17 pgs: 17 active+clean; 262 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2020-11-16T22:06:11.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:11 smithi195 bash[10218]: cluster 2020-11-16T22:06:10.961996+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e345: 12 total, 12 up, 12 in 2020-11-16T22:06:11.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:11 smithi057 bash[10301]: cluster 2020-11-16T22:06:09.656009+0000 mgr.x (mgr.24115) 406 : cluster [DBG] pgmap v679: 17 pgs: 17 active+clean; 262 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2020-11-16T22:06:11.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:11 smithi057 bash[10301]: cluster 2020-11-16T22:06:10.961996+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e345: 12 total, 12 up, 12 in 2020-11-16T22:06:11.961 INFO:tasks.rados.rados.2.smithi057.stdout:1181: done (3 left) 2020-11-16T22:06:11.961 INFO:tasks.rados.rados.2.smithi057.stdout:1182: rollback oid 40 current snap is 141 2020-11-16T22:06:11.961 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 40 to 136 2020-11-16T22:06:11.961 INFO:tasks.rados.rados.2.smithi057.stdout:1183: read oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:11.961 INFO:tasks.rados.rados.2.smithi057.stdout:1183: expect (ObjNum 359 snap 118 seq_num 359) 2020-11-16T22:06:11.962 INFO:tasks.rados.rados.2.smithi057.stdout:1184: write oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 141 2020-11-16T22:06:11.962 INFO:tasks.rados.rados.2.smithi057.stdout:1184: seq_num 419 ranges {642133=728746,2119014=532478} 2020-11-16T22:06:11.970 INFO:tasks.rados.rados.2.smithi057.stdout:1184: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 642133 to 1370879 tid 1 2020-11-16T22:06:11.978 INFO:tasks.rados.rados.2.smithi057.stdout:1184: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2119014 to 2651492 tid 2 2020-11-16T22:06:11.978 INFO:tasks.rados.rados.2.smithi057.stdout:1185: snap_remove snap 133 2020-11-16T22:06:12.965 INFO:tasks.rados.rados.2.smithi057.stdout:1185: done (6 left) 2020-11-16T22:06:12.966 INFO:tasks.rados.rados.2.smithi057.stdout:1186: write (excl) oid 42 current snap is 141 2020-11-16T22:06:12.966 INFO:tasks.rados.rados.2.smithi057.stdout:1186: seq_num 420 ranges {658940=403995,1777496=676136,2950951=107989} 2020-11-16T22:06:12.975 INFO:tasks.rados.rados.2.smithi057.stdout:1186: writing smithi05720651-42 from 658940 to 1062935 tid 1 2020-11-16T22:06:12.988 INFO:tasks.rados.rados.2.smithi057.stdout:1186: writing smithi05720651-42 from 1777496 to 2453632 tid 2 2020-11-16T22:06:12.989 INFO:tasks.rados.rados.2.smithi057.stdout:1186: writing smithi05720651-42 from 2950951 to 3058940 tid 3 2020-11-16T22:06:12.989 INFO:tasks.rados.rados.2.smithi057.stdout:1187: copy_from oid 24 from oid 26 current snap is 141 2020-11-16T22:06:12.989 INFO:tasks.rados.rados.2.smithi057.stdout:1178: expect (ObjNum 297 snap 103 seq_num 297) 2020-11-16T22:06:13.282 INFO:tasks.rados.rados.2.smithi057.stdout:1180: finishing copy_from to smithi05720651-20 2020-11-16T22:06:13.282 INFO:tasks.rados.rados.2.smithi057.stdout:1180: got expected ENOENT (src dne) 2020-11-16T22:06:13.282 INFO:tasks.rados.rados.2.smithi057.stdout:1180: finishing copy_from racing read to smithi05720651-20 2020-11-16T22:06:13.282 INFO:tasks.rados.rados.2.smithi057.stdout:1179: expect (ObjNum 401 snap 133 seq_num 401) 2020-11-16T22:06:13.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:12 smithi016 bash[10302]: cluster 2020-11-16T22:06:11.656804+0000 mgr.x (mgr.24115) 407 : cluster [DBG] pgmap v682: 17 pgs: 17 active+clean; 277 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.4 MiB/s wr, 22 op/s 2020-11-16T22:06:13.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:12 smithi016 bash[10302]: cluster 2020-11-16T22:06:11.965141+0000 mon.a (mon.0) 995 : cluster [DBG] osdmap e346: 12 total, 12 up, 12 in 2020-11-16T22:06:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:12 smithi195 bash[10218]: cluster 2020-11-16T22:06:11.656804+0000 mgr.x (mgr.24115) 407 : cluster [DBG] pgmap v682: 17 pgs: 17 active+clean; 277 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.4 MiB/s wr, 22 op/s 2020-11-16T22:06:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:12 smithi195 bash[10218]: cluster 2020-11-16T22:06:11.965141+0000 mon.a (mon.0) 995 : cluster [DBG] osdmap e346: 12 total, 12 up, 12 in 2020-11-16T22:06:13.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:12 smithi057 bash[10301]: cluster 2020-11-16T22:06:11.656804+0000 mgr.x (mgr.24115) 407 : cluster [DBG] pgmap v682: 17 pgs: 17 active+clean; 277 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.4 MiB/s wr, 22 op/s 2020-11-16T22:06:13.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:12 smithi057 bash[10301]: cluster 2020-11-16T22:06:11.965141+0000 mon.a (mon.0) 995 : cluster [DBG] osdmap e346: 12 total, 12 up, 12 in 2020-11-16T22:06:13.450 INFO:tasks.rados.rados.2.smithi057.stdout:1178: done (7 left) 2020-11-16T22:06:13.450 INFO:tasks.rados.rados.2.smithi057.stdout:1179: done (6 left) 2020-11-16T22:06:13.450 INFO:tasks.rados.rados.2.smithi057.stdout:1180: done (5 left) 2020-11-16T22:06:13.450 INFO:tasks.rados.rados.2.smithi057.stdout:1188: copy_from oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 36 current snap is 141 2020-11-16T22:06:13.450 INFO:tasks.rados.rados.2.smithi057.stdout:1182: finishing rollback tid 1 to smithi05720651-40 2020-11-16T22:06:13.451 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 1016 (ObjNum 129 snap 0 seq_num 0) dirty dne 2020-11-16T22:06:13.451 INFO:tasks.rados.rados.2.smithi057.stdout:1183: expect (ObjNum 359 snap 118 seq_num 359) 2020-11-16T22:06:13.508 INFO:tasks.rados.rados.2.smithi057.stdout:1184: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:13.508 INFO:tasks.rados.rados.2.smithi057.stdout:1184: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:13.508 INFO:tasks.rados.rados.2.smithi057.stdout:1184: finishing write tid 4 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:13.508 INFO:tasks.rados.rados.2.smithi057.stdout:1184: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:13.509 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 716 (ObjNum 419 snap 141 seq_num 419) dirty exists 2020-11-16T22:06:13.509 INFO:tasks.rados.rados.2.smithi057.stdout:1184: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 419 snap 141 seq_num 419) 2020-11-16T22:06:13.509 INFO:tasks.rados.rados.2.smithi057.stdout:1186: finishing write tid 1 to smithi05720651-42 2020-11-16T22:06:13.509 INFO:tasks.rados.rados.2.smithi057.stdout:1182: done (5 left) 2020-11-16T22:06:13.509 INFO:tasks.rados.rados.2.smithi057.stdout:1183: done (4 left) 2020-11-16T22:06:13.509 INFO:tasks.rados.rados.2.smithi057.stdout:1184: done (3 left) 2020-11-16T22:06:13.509 INFO:tasks.rados.rados.2.smithi057.stdout:1189: snap_create 2020-11-16T22:06:13.510 INFO:tasks.rados.rados.2.smithi057.stdout:1186: finishing write tid 2 to smithi05720651-42 2020-11-16T22:06:13.510 INFO:tasks.rados.rados.2.smithi057.stdout:1186: finishing write tid 3 to smithi05720651-42 2020-11-16T22:06:13.510 INFO:tasks.rados.rados.2.smithi057.stdout:1186: finishing write tid 5 to smithi05720651-42 2020-11-16T22:06:13.510 INFO:tasks.rados.rados.2.smithi057.stdout:1186: finishing write tid 6 to smithi05720651-42 2020-11-16T22:06:13.510 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 480 (ObjNum 420 snap 141 seq_num 420) dirty exists 2020-11-16T22:06:13.510 INFO:tasks.rados.rados.2.smithi057.stdout:1186: left oid 42 (ObjNum 420 snap 141 seq_num 420) 2020-11-16T22:06:13.510 INFO:tasks.rados.rados.2.smithi057.stdout:1187: finishing copy_from to smithi05720651-24 2020-11-16T22:06:13.511 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 1159 (ObjNum 404 snap 136 seq_num 404) dirty exists 2020-11-16T22:06:13.511 INFO:tasks.rados.rados.2.smithi057.stdout:1187: finishing copy_from racing read to smithi05720651-24 2020-11-16T22:06:13.511 INFO:tasks.rados.rados.2.smithi057.stdout:1188: finishing copy_from to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:13.511 INFO:tasks.rados.rados.2.smithi057.stdout:1188: got expected ENOENT (src dne) 2020-11-16T22:06:13.511 INFO:tasks.rados.rados.2.smithi057.stdout:1188: finishing copy_from racing read to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:13.976 INFO:tasks.rados.rados.2.smithi057.stdout:1186: done (3 left) 2020-11-16T22:06:13.977 INFO:tasks.rados.rados.2.smithi057.stdout:1187: done (2 left) 2020-11-16T22:06:13.977 INFO:tasks.rados.rados.2.smithi057.stdout:1188: done (1 left) 2020-11-16T22:06:13.977 INFO:tasks.rados.rados.2.smithi057.stdout:1189: done (0 left) 2020-11-16T22:06:13.977 INFO:tasks.rados.rados.2.smithi057.stdout:1190: snap_create 2020-11-16T22:06:14.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:13 smithi016 bash[10302]: cluster 2020-11-16T22:06:12.977303+0000 mon.a (mon.0) 996 : cluster [DBG] osdmap e347: 12 total, 12 up, 12 in 2020-11-16T22:06:14.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:13 smithi195 bash[10218]: cluster 2020-11-16T22:06:12.977303+0000 mon.a (mon.0) 996 : cluster [DBG] osdmap e347: 12 total, 12 up, 12 in 2020-11-16T22:06:14.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:13 smithi057 bash[10301]: cluster 2020-11-16T22:06:12.977303+0000 mon.a (mon.0) 996 : cluster [DBG] osdmap e347: 12 total, 12 up, 12 in 2020-11-16T22:06:14.945 INFO:tasks.rados.rados.2.smithi057.stdout:1190: done (0 left) 2020-11-16T22:06:14.945 INFO:tasks.rados.rados.2.smithi057.stdout:1191: snap_remove snap 135 2020-11-16T22:06:15.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:14 smithi016 bash[10302]: cluster 2020-11-16T22:06:13.657510+0000 mgr.x (mgr.24115) 408 : cluster [DBG] pgmap v685: 17 pgs: 17 active+clean; 277 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.4 MiB/s wr, 22 op/s 2020-11-16T22:06:15.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:14 smithi016 bash[10302]: cluster 2020-11-16T22:06:13.985752+0000 mon.a (mon.0) 997 : cluster [DBG] osdmap e348: 12 total, 12 up, 12 in 2020-11-16T22:06:15.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:14 smithi016 bash[10302]: cluster 2020-11-16T22:06:14.955296+0000 mon.a (mon.0) 998 : cluster [DBG] osdmap e349: 12 total, 12 up, 12 in 2020-11-16T22:06:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:14 smithi195 bash[10218]: cluster 2020-11-16T22:06:13.657510+0000 mgr.x (mgr.24115) 408 : cluster [DBG] pgmap v685: 17 pgs: 17 active+clean; 277 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.4 MiB/s wr, 22 op/s 2020-11-16T22:06:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:14 smithi195 bash[10218]: cluster 2020-11-16T22:06:13.985752+0000 mon.a (mon.0) 997 : cluster [DBG] osdmap e348: 12 total, 12 up, 12 in 2020-11-16T22:06:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:14 smithi195 bash[10218]: cluster 2020-11-16T22:06:14.955296+0000 mon.a (mon.0) 998 : cluster [DBG] osdmap e349: 12 total, 12 up, 12 in 2020-11-16T22:06:15.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:14 smithi057 bash[10301]: cluster 2020-11-16T22:06:13.657510+0000 mgr.x (mgr.24115) 408 : cluster [DBG] pgmap v685: 17 pgs: 17 active+clean; 277 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.4 MiB/s wr, 22 op/s 2020-11-16T22:06:15.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:14 smithi057 bash[10301]: cluster 2020-11-16T22:06:13.985752+0000 mon.a (mon.0) 997 : cluster [DBG] osdmap e348: 12 total, 12 up, 12 in 2020-11-16T22:06:15.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:14 smithi057 bash[10301]: cluster 2020-11-16T22:06:14.955296+0000 mon.a (mon.0) 998 : cluster [DBG] osdmap e349: 12 total, 12 up, 12 in 2020-11-16T22:06:15.957 INFO:tasks.rados.rados.2.smithi057.stdout:1191: done (0 left) 2020-11-16T22:06:15.957 INFO:tasks.rados.rados.2.smithi057.stdout:1192: write (excl) oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 143 2020-11-16T22:06:15.957 INFO:tasks.rados.rados.2.smithi057.stdout:1192: seq_num 421 ranges {675747=479244,1835978=536147} 2020-11-16T22:06:15.970 INFO:tasks.rados.rados.2.smithi057.stdout:1192: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 675747 to 1154991 tid 1 2020-11-16T22:06:15.977 INFO:tasks.rados.rados.2.smithi057.stdout:1192: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1835978 to 2372125 tid 2 2020-11-16T22:06:15.978 INFO:tasks.rados.rados.2.smithi057.stdout:1193: snap_remove snap 123 2020-11-16T22:06:16.983 INFO:tasks.rados.rados.2.smithi057.stdout:1193: done (1 left) 2020-11-16T22:06:16.984 INFO:tasks.rados.rados.2.smithi057.stdout:1194: read oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:16.984 INFO:tasks.rados.rados.2.smithi057.stdout:1194: expect deleted 2020-11-16T22:06:16.984 INFO:tasks.rados.rados.2.smithi057.stdout:1195: delete oid 24 current snap is 143 2020-11-16T22:06:16.984 INFO:tasks.rados.rados.2.smithi057.stdout:1192: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:16.984 INFO:tasks.rados.rados.2.smithi057.stdout:1192: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:16.984 INFO:tasks.rados.rados.2.smithi057.stdout:1192: finishing write tid 4 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:16.985 INFO:tasks.rados.rados.2.smithi057.stdout:1192: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:16.985 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 940 (ObjNum 421 snap 143 seq_num 421) dirty exists 2020-11-16T22:06:16.985 INFO:tasks.rados.rados.2.smithi057.stdout:1192: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 421 snap 143 seq_num 421) 2020-11-16T22:06:16.992 INFO:tasks.rados.rados.2.smithi057.stdout:1192: done (2 left) 2020-11-16T22:06:16.992 INFO:tasks.rados.rados.2.smithi057.stdout:1194: done (1 left) 2020-11-16T22:06:16.993 INFO:tasks.rados.rados.2.smithi057.stdout:1195: done (0 left) 2020-11-16T22:06:16.993 INFO:tasks.rados.rados.2.smithi057.stdout:1196: copy_from oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 143 2020-11-16T22:06:16.993 INFO:tasks.rados.rados.2.smithi057.stdout:1197: delete oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 143 2020-11-16T22:06:16.995 INFO:tasks.rados.rados.2.smithi057.stdout:1197: done (1 left) 2020-11-16T22:06:16.995 INFO:tasks.rados.rados.2.smithi057.stdout:1198: write (excl) oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 143 2020-11-16T22:06:16.996 INFO:tasks.rados.rados.2.smithi057.stdout:1198: seq_num 424 ranges {726168=704991,1895071=683474} 2020-11-16T22:06:17.012 INFO:tasks.rados.rados.2.smithi057.stdout:1198: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 726168 to 1431159 tid 1 2020-11-16T22:06:17.019 INFO:tasks.rados.rados.2.smithi057.stdout:1198: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1895071 to 2578545 tid 2 2020-11-16T22:06:17.019 INFO:tasks.rados.rados.2.smithi057.stdout:1199: rollback oid 22 current snap is 143 2020-11-16T22:06:17.019 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 22 to 134 2020-11-16T22:06:17.019 INFO:tasks.rados.rados.2.smithi057.stdout:1198: finishing write tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:17.019 INFO:tasks.rados.rados.2.smithi057.stdout:1200: read oid 30 snap -1 2020-11-16T22:06:17.019 INFO:tasks.rados.rados.2.smithi057.stdout:1200: expect deleted 2020-11-16T22:06:17.020 INFO:tasks.rados.rados.2.smithi057.stdout:1201: write oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 143 2020-11-16T22:06:17.020 INFO:tasks.rados.rados.2.smithi057.stdout:1201: seq_num 425 ranges {742975=780240,1953553=427132,2971713=171262} 2020-11-16T22:06:17.027 INFO:tasks.rados.rados.2.smithi057.stdout:1201: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 742975 to 1523215 tid 1 2020-11-16T22:06:17.032 INFO:tasks.rados.rados.2.smithi057.stdout:1201: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1953553 to 2380685 tid 2 2020-11-16T22:06:17.037 INFO:tasks.rados.rados.2.smithi057.stdout:1201: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2971713 to 3142975 tid 3 2020-11-16T22:06:17.037 INFO:tasks.rados.rados.2.smithi057.stdout:1202: delete oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 143 2020-11-16T22:06:17.037 INFO:tasks.rados.rados.2.smithi057.stdout:1196: finishing copy_from to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:17.038 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1077 (ObjNum 396 snap 132 seq_num 396) dirty exists 2020-11-16T22:06:17.038 INFO:tasks.rados.rados.2.smithi057.stdout:1196: finishing copy_from racing read to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:17.038 INFO:tasks.rados.rados.2.smithi057.stdout:1198: finishing write tid 2 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:17.038 INFO:tasks.rados.rados.2.smithi057.stdout:1198: finishing write tid 4 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:17.038 INFO:tasks.rados.rados.2.smithi057.stdout:1198: finishing write tid 5 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:17.038 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 260 (ObjNum 424 snap 143 seq_num 424) dirty exists 2020-11-16T22:06:17.039 INFO:tasks.rados.rados.2.smithi057.stdout:1198: left oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 424 snap 143 seq_num 424) 2020-11-16T22:06:17.039 INFO:tasks.rados.rados.2.smithi057.stdout:1199: finishing rollback tid 0 to smithi05720651-22 2020-11-16T22:06:17.039 INFO:tasks.rados.rados.2.smithi057.stdout:1199: finishing rollback tid 1 to smithi05720651-22 2020-11-16T22:06:17.039 INFO:tasks.rados.rados.2.smithi057.stdout:1199: finishing rollback tid 2 to smithi05720651-22 2020-11-16T22:06:17.039 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 855 (ObjNum 192 snap 64 seq_num 192) dirty exists 2020-11-16T22:06:17.039 INFO:tasks.rados.rados.2.smithi057.stdout:1201: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:17.040 INFO:tasks.rados.rados.2.smithi057.stdout:1201: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:17.040 INFO:tasks.rados.rados.2.smithi057.stdout:1196: done (5 left) 2020-11-16T22:06:17.040 INFO:tasks.rados.rados.2.smithi057.stdout:1198: done (4 left) 2020-11-16T22:06:17.041 INFO:tasks.rados.rados.2.smithi057.stdout:1199: done (3 left) 2020-11-16T22:06:17.041 INFO:tasks.rados.rados.2.smithi057.stdout:1200: done (2 left) 2020-11-16T22:06:17.041 INFO:tasks.rados.rados.2.smithi057.stdout:1202: done (1 left) 2020-11-16T22:06:17.041 INFO:tasks.rados.rados.2.smithi057.stdout:1203: write (excl) oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 143 2020-11-16T22:06:17.041 INFO:tasks.rados.rados.2.smithi057.stdout:1203: seq_num 427 ranges {776589=647091,2070517=430801,3026559=150030} 2020-11-16T22:06:17.048 INFO:tasks.rados.rados.2.smithi057.stdout:1203: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 776589 to 1423680 tid 1 2020-11-16T22:06:17.054 INFO:tasks.rados.rados.2.smithi057.stdout:1203: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2070517 to 2501318 tid 2 2020-11-16T22:06:17.059 INFO:tasks.rados.rados.2.smithi057.stdout:1203: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3026559 to 3176589 tid 3 2020-11-16T22:06:17.059 INFO:tasks.rados.rados.2.smithi057.stdout:1201: finishing write tid 3 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:17.060 INFO:tasks.rados.rados.2.smithi057.stdout:1204: read oid 46 snap 127 2020-11-16T22:06:17.060 INFO:tasks.rados.rados.2.smithi057.stdout:1204: expect (ObjNum 336 snap 115 seq_num 336) 2020-11-16T22:06:17.060 INFO:tasks.rados.rados.2.smithi057.stdout:1205: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:17.060 INFO:tasks.rados.rados.2.smithi057.stdout:1205: expect (ObjNum 401 snap 133 seq_num 401) 2020-11-16T22:06:17.060 INFO:tasks.rados.rados.2.smithi057.stdout:1206: copy_from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 143 2020-11-16T22:06:17.060 INFO:tasks.rados.rados.2.smithi057.stdout:1201: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:17.061 INFO:tasks.rados.rados.2.smithi057.stdout:1201: finishing write tid 6 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:17.061 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1008 (ObjNum 425 snap 143 seq_num 425) dirty exists 2020-11-16T22:06:17.061 INFO:tasks.rados.rados.2.smithi057.stdout:1201: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 425 snap 143 seq_num 425) 2020-11-16T22:06:17.061 INFO:tasks.rados.rados.2.smithi057.stdout:1201: done (4 left) 2020-11-16T22:06:17.061 INFO:tasks.rados.rados.2.smithi057.stdout:1207: copy_from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 8 current snap is 143 2020-11-16T22:06:17.061 INFO:tasks.rados.rados.2.smithi057.stdout:1208: read oid 10 snap -1 2020-11-16T22:06:17.061 INFO:tasks.rados.rados.2.smithi057.stdout:1208: expect (ObjNum 112 snap 34 seq_num 112) 2020-11-16T22:06:17.062 INFO:tasks.rados.rados.2.smithi057.stdout:1209: delete oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 143 2020-11-16T22:06:17.071 INFO:tasks.rados.rados.2.smithi057.stdout:1208: expect (ObjNum 112 snap 34 seq_num 112) 2020-11-16T22:06:17.196 INFO:tasks.rados.rados.2.smithi057.stdout:1205: expect (ObjNum 401 snap 133 seq_num 401) 2020-11-16T22:06:17.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:16 smithi016 bash[10302]: cluster 2020-11-16T22:06:15.658209+0000 mgr.x (mgr.24115) 409 : cluster [DBG] pgmap v688: 17 pgs: 17 active+clean; 279 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 989 KiB/s wr, 4 op/s 2020-11-16T22:06:17.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:16 smithi016 bash[10302]: cluster 2020-11-16T22:06:15.966523+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e350: 12 total, 12 up, 12 in 2020-11-16T22:06:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:16 smithi195 bash[10218]: cluster 2020-11-16T22:06:15.658209+0000 mgr.x (mgr.24115) 409 : cluster [DBG] pgmap v688: 17 pgs: 17 active+clean; 279 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 989 KiB/s wr, 4 op/s 2020-11-16T22:06:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:16 smithi195 bash[10218]: cluster 2020-11-16T22:06:15.966523+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e350: 12 total, 12 up, 12 in 2020-11-16T22:06:17.370 INFO:tasks.rados.rados.2.smithi057.stdout:1204: expect (ObjNum 336 snap 115 seq_num 336) 2020-11-16T22:06:17.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:16 smithi057 bash[10301]: cluster 2020-11-16T22:06:15.658209+0000 mgr.x (mgr.24115) 409 : cluster [DBG] pgmap v688: 17 pgs: 17 active+clean; 279 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 989 KiB/s wr, 4 op/s 2020-11-16T22:06:17.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:16 smithi057 bash[10301]: cluster 2020-11-16T22:06:15.966523+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e350: 12 total, 12 up, 12 in 2020-11-16T22:06:17.511 INFO:tasks.rados.rados.2.smithi057.stdout:1207: finishing copy_from to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:17.511 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 853 (ObjNum 371 snap 123 seq_num 371) dirty exists 2020-11-16T22:06:17.512 INFO:tasks.rados.rados.2.smithi057.stdout:1206: finishing copy_from to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:17.512 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 960 (ObjNum 415 snap 140 seq_num 415) dirty exists 2020-11-16T22:06:17.512 INFO:tasks.rados.rados.2.smithi057.stdout:1207: finishing copy_from racing read to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:17.512 INFO:tasks.rados.rados.2.smithi057.stdout:1204: done (6 left) 2020-11-16T22:06:17.512 INFO:tasks.rados.rados.2.smithi057.stdout:1205: done (5 left) 2020-11-16T22:06:17.512 INFO:tasks.rados.rados.2.smithi057.stdout:1207: done (4 left) 2020-11-16T22:06:17.512 INFO:tasks.rados.rados.2.smithi057.stdout:1208: done (3 left) 2020-11-16T22:06:17.513 INFO:tasks.rados.rados.2.smithi057.stdout:1209: done (2 left) 2020-11-16T22:06:17.513 INFO:tasks.rados.rados.2.smithi057.stdout:1210: snap_remove snap 138 2020-11-16T22:06:17.993 INFO:tasks.rados.rados.2.smithi057.stdout:1210: done (2 left) 2020-11-16T22:06:17.993 INFO:tasks.rados.rados.2.smithi057.stdout:1211: snap_remove snap 127 2020-11-16T22:06:18.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:17 smithi016 bash[10302]: cluster 2020-11-16T22:06:16.992549+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e351: 12 total, 12 up, 12 in 2020-11-16T22:06:18.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:17 smithi195 bash[10218]: cluster 2020-11-16T22:06:16.992549+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e351: 12 total, 12 up, 12 in 2020-11-16T22:06:18.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:18 smithi057 bash[10301]: cluster 2020-11-16T22:06:16.992549+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e351: 12 total, 12 up, 12 in 2020-11-16T22:06:19.006 INFO:tasks.rados.rados.2.smithi057.stdout:1211: done (2 left) 2020-11-16T22:06:19.006 INFO:tasks.rados.rados.2.smithi057.stdout:1212: snap_create 2020-11-16T22:06:19.006 INFO:tasks.rados.rados.2.smithi057.stdout:1206: finishing copy_from racing read to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:19.006 INFO:tasks.rados.rados.2.smithi057.stdout:1203: finishing write tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:19.007 INFO:tasks.rados.rados.2.smithi057.stdout:1203: finishing write tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:19.007 INFO:tasks.rados.rados.2.smithi057.stdout:1203: finishing write tid 3 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:19.007 INFO:tasks.rados.rados.2.smithi057.stdout:1203: finishing write tid 5 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:19.007 INFO:tasks.rados.rados.2.smithi057.stdout:1203: finishing write tid 6 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:19.007 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1164 (ObjNum 427 snap 143 seq_num 427) dirty exists 2020-11-16T22:06:19.007 INFO:tasks.rados.rados.2.smithi057.stdout:1203: left oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 427 snap 143 seq_num 427) 2020-11-16T22:06:19.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:19 smithi016 bash[10302]: cluster 2020-11-16T22:06:17.658918+0000 mgr.x (mgr.24115) 410 : cluster [DBG] pgmap v691: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 285 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2020-11-16T22:06:19.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:19 smithi016 bash[10302]: cluster 2020-11-16T22:06:18.001246+0000 mon.a (mon.0) 1001 : cluster [DBG] osdmap e352: 12 total, 12 up, 12 in 2020-11-16T22:06:19.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:19 smithi195 bash[10218]: cluster 2020-11-16T22:06:17.658918+0000 mgr.x (mgr.24115) 410 : cluster [DBG] pgmap v691: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 285 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2020-11-16T22:06:19.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:19 smithi195 bash[10218]: cluster 2020-11-16T22:06:18.001246+0000 mon.a (mon.0) 1001 : cluster [DBG] osdmap e352: 12 total, 12 up, 12 in 2020-11-16T22:06:19.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:19 smithi057 bash[10301]: cluster 2020-11-16T22:06:17.658918+0000 mgr.x (mgr.24115) 410 : cluster [DBG] pgmap v691: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 285 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 10 op/s 2020-11-16T22:06:19.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:19 smithi057 bash[10301]: cluster 2020-11-16T22:06:18.001246+0000 mon.a (mon.0) 1001 : cluster [DBG] osdmap e352: 12 total, 12 up, 12 in 2020-11-16T22:06:19.950 INFO:tasks.rados.rados.2.smithi057.stdout:1203: done (2 left) 2020-11-16T22:06:19.951 INFO:tasks.rados.rados.2.smithi057.stdout:1206: done (1 left) 2020-11-16T22:06:19.951 INFO:tasks.rados.rados.2.smithi057.stdout:1212: done (0 left) 2020-11-16T22:06:19.951 INFO:tasks.rados.rados.2.smithi057.stdout:1213: rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 144 2020-11-16T22:06:19.951 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 114 2020-11-16T22:06:19.951 INFO:tasks.rados.rados.2.smithi057.stdout:1214: write (excl) oid 6 current snap is 144 2020-11-16T22:06:19.951 INFO:tasks.rados.rados.2.smithi057.stdout:1214: seq_num 429 ranges {410203=797589,1787481=434470,2681405=528798} 2020-11-16T22:06:19.963 INFO:tasks.rados.rados.2.smithi057.stdout:1214: writing smithi05720651-6 from 410203 to 1207792 tid 1 2020-11-16T22:06:19.969 INFO:tasks.rados.rados.2.smithi057.stdout:1214: writing smithi05720651-6 from 1787481 to 2221951 tid 2 2020-11-16T22:06:19.975 INFO:tasks.rados.rados.2.smithi057.stdout:1214: writing smithi05720651-6 from 2681405 to 3210203 tid 3 2020-11-16T22:06:19.976 INFO:tasks.rados.rados.2.smithi057.stdout:1215: rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 144 2020-11-16T22:06:19.976 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 142 2020-11-16T22:06:19.976 INFO:tasks.rados.rados.2.smithi057.stdout:1213: finishing rollback tid 0 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:19.976 INFO:tasks.rados.rados.2.smithi057.stdout:1213: finishing rollback tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:19.976 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 265 (ObjNum 33 snap 0 seq_num 2930971648) dirty dne 2020-11-16T22:06:19.976 INFO:tasks.rados.rados.2.smithi057.stdout:1213: done (2 left) 2020-11-16T22:06:19.976 INFO:tasks.rados.rados.2.smithi057.stdout:1216: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:19.977 INFO:tasks.rados.rados.2.smithi057.stdout:1216: expect (ObjNum 425 snap 143 seq_num 425) 2020-11-16T22:06:19.977 INFO:tasks.rados.rados.2.smithi057.stdout:1217: rollback oid 30 current snap is 144 2020-11-16T22:06:19.977 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 30 to 142 2020-11-16T22:06:19.977 INFO:tasks.rados.rados.2.smithi057.stdout:1218: write oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 144 2020-11-16T22:06:19.977 INFO:tasks.rados.rados.2.smithi057.stdout:1218: seq_num 430 ranges {427010=472838,1329610=694481,2708828=518182} 2020-11-16T22:06:19.980 INFO:tasks.rados.rados.2.smithi057.stdout:1218: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 427010 to 899848 tid 1 2020-11-16T22:06:19.987 INFO:tasks.rados.rados.2.smithi057.stdout:1218: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1329610 to 2024091 tid 2 2020-11-16T22:06:19.994 INFO:tasks.rados.rados.2.smithi057.stdout:1218: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2708828 to 3227010 tid 3 2020-11-16T22:06:19.994 INFO:tasks.rados.rados.2.smithi057.stdout:1219: snap_create 2020-11-16T22:06:19.994 INFO:tasks.rados.rados.2.smithi057.stdout:1217: finishing rollback tid 1 to smithi05720651-30 2020-11-16T22:06:19.995 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 0 (ObjNum 337 snap 0 seq_num 0) dirty dne 2020-11-16T22:06:19.995 INFO:tasks.rados.rados.2.smithi057.stdout:1215: finishing rollback tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:19.995 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 156 (ObjNum 321 snap 0 seq_num 1864381234) dirty dne 2020-11-16T22:06:19.995 INFO:tasks.rados.rados.2.smithi057.stdout:1214: finishing write tid 1 to smithi05720651-6 2020-11-16T22:06:19.995 INFO:tasks.rados.rados.2.smithi057.stdout:1216: expect (ObjNum 425 snap 143 seq_num 425) 2020-11-16T22:06:20.095 INFO:tasks.rados.rados.2.smithi057.stdout:1214: finishing write tid 2 to smithi05720651-6 2020-11-16T22:06:20.095 INFO:tasks.rados.rados.2.smithi057.stdout:1214: finishing write tid 3 to smithi05720651-6 2020-11-16T22:06:20.095 INFO:tasks.rados.rados.2.smithi057.stdout:1214: finishing write tid 5 to smithi05720651-6 2020-11-16T22:06:20.095 INFO:tasks.rados.rados.2.smithi057.stdout:1214: finishing write tid 6 to smithi05720651-6 2020-11-16T22:06:20.096 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 1036 (ObjNum 429 snap 144 seq_num 429) dirty exists 2020-11-16T22:06:20.096 INFO:tasks.rados.rados.2.smithi057.stdout:1214: left oid 6 (ObjNum 429 snap 144 seq_num 429) 2020-11-16T22:06:20.096 INFO:tasks.rados.rados.2.smithi057.stdout:1218: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:20.096 INFO:tasks.rados.rados.2.smithi057.stdout:1218: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:20.096 INFO:tasks.rados.rados.2.smithi057.stdout:1218: finishing write tid 3 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:20.144 INFO:tasks.rados.rados.2.smithi057.stdout:1218: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:20.144 INFO:tasks.rados.rados.2.smithi057.stdout:1218: finishing write tid 6 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:20.144 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1220 (ObjNum 430 snap 144 seq_num 430) dirty exists 2020-11-16T22:06:20.145 INFO:tasks.rados.rados.2.smithi057.stdout:1218: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 430 snap 144 seq_num 430) 2020-11-16T22:06:20.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:20 smithi016 bash[10302]: cluster 2020-11-16T22:06:19.011791+0000 mon.a (mon.0) 1002 : cluster [DBG] osdmap e353: 12 total, 12 up, 12 in 2020-11-16T22:06:20.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:20 smithi016 bash[10302]: cluster 2020-11-16T22:06:19.956886+0000 mon.a (mon.0) 1003 : cluster [DBG] osdmap e354: 12 total, 12 up, 12 in 2020-11-16T22:06:20.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:20 smithi195 bash[10218]: cluster 2020-11-16T22:06:19.011791+0000 mon.a (mon.0) 1002 : cluster [DBG] osdmap e353: 12 total, 12 up, 12 in 2020-11-16T22:06:20.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:20 smithi195 bash[10218]: cluster 2020-11-16T22:06:19.956886+0000 mon.a (mon.0) 1003 : cluster [DBG] osdmap e354: 12 total, 12 up, 12 in 2020-11-16T22:06:20.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:20 smithi057 bash[10301]: cluster 2020-11-16T22:06:19.011791+0000 mon.a (mon.0) 1002 : cluster [DBG] osdmap e353: 12 total, 12 up, 12 in 2020-11-16T22:06:20.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:20 smithi057 bash[10301]: cluster 2020-11-16T22:06:19.956886+0000 mon.a (mon.0) 1003 : cluster [DBG] osdmap e354: 12 total, 12 up, 12 in 2020-11-16T22:06:20.961 INFO:tasks.rados.rados.2.smithi057.stdout:1214: done (5 left) 2020-11-16T22:06:20.961 INFO:tasks.rados.rados.2.smithi057.stdout:1215: done (4 left) 2020-11-16T22:06:20.962 INFO:tasks.rados.rados.2.smithi057.stdout:1216: done (3 left) 2020-11-16T22:06:20.962 INFO:tasks.rados.rados.2.smithi057.stdout:1217: done (2 left) 2020-11-16T22:06:20.962 INFO:tasks.rados.rados.2.smithi057.stdout:1218: done (1 left) 2020-11-16T22:06:20.962 INFO:tasks.rados.rados.2.smithi057.stdout:1219: done (0 left) 2020-11-16T22:06:20.962 INFO:tasks.rados.rados.2.smithi057.stdout:1220: delete oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 145 2020-11-16T22:06:20.968 INFO:tasks.rados.rados.2.smithi057.stdout:1220: done (0 left) 2020-11-16T22:06:20.968 INFO:tasks.rados.rados.2.smithi057.stdout:1221: read oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:20.968 INFO:tasks.rados.rados.2.smithi057.stdout:1221: expect (ObjNum 413 snap 140 seq_num 413) 2020-11-16T22:06:20.968 INFO:tasks.rados.rados.2.smithi057.stdout:1222: write oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 145 2020-11-16T22:06:20.968 INFO:tasks.rados.rados.2.smithi057.stdout:1222: seq_num 432 ranges {460624=623336,1846574=698150,3163674=96950} 2020-11-16T22:06:20.985 INFO:tasks.rados.rados.2.smithi057.stdout:1222: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 460624 to 1083960 tid 1 2020-11-16T22:06:20.993 INFO:tasks.rados.rados.2.smithi057.stdout:1222: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1846574 to 2544724 tid 2 2020-11-16T22:06:20.997 INFO:tasks.rados.rados.2.smithi057.stdout:1222: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3163674 to 3260624 tid 3 2020-11-16T22:06:20.997 INFO:tasks.rados.rados.2.smithi057.stdout:1223: delete oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 145 2020-11-16T22:06:20.998 INFO:tasks.rados.rados.2.smithi057.stdout:1221: expect (ObjNum 413 snap 140 seq_num 413) 2020-11-16T22:06:21.154 INFO:tasks.rados.rados.2.smithi057.stdout:1222: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:21.154 INFO:tasks.rados.rados.2.smithi057.stdout:1222: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:21.154 INFO:tasks.rados.rados.2.smithi057.stdout:1222: finishing write tid 3 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:21.154 INFO:tasks.rados.rados.2.smithi057.stdout:1221: done (2 left) 2020-11-16T22:06:21.154 INFO:tasks.rados.rados.2.smithi057.stdout:1223: done (1 left) 2020-11-16T22:06:21.155 INFO:tasks.rados.rados.2.smithi057.stdout:1224: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:21.155 INFO:tasks.rados.rados.2.smithi057.stdout:1224: expect deleted 2020-11-16T22:06:21.155 INFO:tasks.rados.rados.2.smithi057.stdout:1225: delete oid 30 current snap is 145 2020-11-16T22:06:21.155 INFO:tasks.rados.rados.2.smithi057.stdout:1222: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:21.155 INFO:tasks.rados.rados.2.smithi057.stdout:1222: finishing write tid 6 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:21.155 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1225 (ObjNum 432 snap 145 seq_num 432) dirty exists 2020-11-16T22:06:21.155 INFO:tasks.rados.rados.2.smithi057.stdout:1222: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 432 snap 145 seq_num 432) 2020-11-16T22:06:21.158 INFO:tasks.rados.rados.2.smithi057.stdout:1222: done (2 left) 2020-11-16T22:06:21.159 INFO:tasks.rados.rados.2.smithi057.stdout:1224: done (1 left) 2020-11-16T22:06:21.159 INFO:tasks.rados.rados.2.smithi057.stdout:1225: done (0 left) 2020-11-16T22:06:21.159 INFO:tasks.rados.rados.2.smithi057.stdout:1226: rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 145 2020-11-16T22:06:21.159 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 142 2020-11-16T22:06:21.159 INFO:tasks.rados.rados.2.smithi057.stdout:1227: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:21.159 INFO:tasks.rados.rados.2.smithi057.stdout:1227: expect (ObjNum 401 snap 133 seq_num 401) 2020-11-16T22:06:21.160 INFO:tasks.rados.rados.2.smithi057.stdout:1228: read oid 6 snap 140 2020-11-16T22:06:21.160 INFO:tasks.rados.rados.2.smithi057.stdout:1228: expect (ObjNum 391 snap 129 seq_num 391) 2020-11-16T22:06:21.160 INFO:tasks.rados.rados.2.smithi057.stdout:1229: write (excl) oid 34 current snap is 145 2020-11-16T22:06:21.160 INFO:tasks.rados.rados.2.smithi057.stdout:1229: seq_num 435 ranges {511045=565436,1622020=445477,2729590=556855} 2020-11-16T22:06:21.167 INFO:tasks.rados.rados.2.smithi057.stdout:1229: writing smithi05720651-34 from 511045 to 1076481 tid 1 2020-11-16T22:06:21.174 INFO:tasks.rados.rados.2.smithi057.stdout:1229: writing smithi05720651-34 from 1622020 to 2067497 tid 2 2020-11-16T22:06:21.182 INFO:tasks.rados.rados.2.smithi057.stdout:1229: writing smithi05720651-34 from 2729590 to 3286445 tid 3 2020-11-16T22:06:21.182 INFO:tasks.rados.rados.2.smithi057.stdout:1230: write oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 145 2020-11-16T22:06:21.182 INFO:tasks.rados.rados.2.smithi057.stdout:1230: seq_num 436 ranges {527852=640685,1680502=589135,2757013=570839} 2020-11-16T22:06:21.188 INFO:tasks.rados.rados.2.smithi057.stdout:1230: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 527852 to 1168537 tid 1 2020-11-16T22:06:21.194 INFO:tasks.rados.rados.2.smithi057.stdout:1230: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1680502 to 2269637 tid 2 2020-11-16T22:06:21.200 INFO:tasks.rados.rados.2.smithi057.stdout:1230: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2757013 to 3327852 tid 3 2020-11-16T22:06:21.201 INFO:tasks.rados.rados.2.smithi057.stdout:1231: snap_create 2020-11-16T22:06:21.201 INFO:tasks.rados.rados.2.smithi057.stdout:1227: expect (ObjNum 401 snap 133 seq_num 401) 2020-11-16T22:06:21.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:21 smithi016 bash[10302]: cluster 2020-11-16T22:06:19.659595+0000 mgr.x (mgr.24115) 411 : cluster [DBG] pgmap v694: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 285 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 878 KiB/s wr, 6 op/s 2020-11-16T22:06:21.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:21 smithi016 bash[10302]: cluster 2020-11-16T22:06:20.970378+0000 mon.a (mon.0) 1004 : cluster [DBG] osdmap e355: 12 total, 12 up, 12 in 2020-11-16T22:06:21.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:21 smithi195 bash[10218]: cluster 2020-11-16T22:06:19.659595+0000 mgr.x (mgr.24115) 411 : cluster [DBG] pgmap v694: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 285 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 878 KiB/s wr, 6 op/s 2020-11-16T22:06:21.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:21 smithi195 bash[10218]: cluster 2020-11-16T22:06:20.970378+0000 mon.a (mon.0) 1004 : cluster [DBG] osdmap e355: 12 total, 12 up, 12 in 2020-11-16T22:06:21.383 INFO:tasks.rados.rados.2.smithi057.stdout:1226: finishing rollback tid 0 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:21.384 INFO:tasks.rados.rados.2.smithi057.stdout:1226: finishing rollback tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:21.384 INFO:tasks.rados.rados.2.smithi057.stdout:1229: finishing write tid 1 to smithi05720651-34 2020-11-16T22:06:21.384 INFO:tasks.rados.rados.2.smithi057.stdout:1229: finishing write tid 2 to smithi05720651-34 2020-11-16T22:06:21.384 INFO:tasks.rados.rados.2.smithi057.stdout:1226: finishing rollback tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:21.384 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1040 (ObjNum 415 snap 140 seq_num 415) dirty exists 2020-11-16T22:06:21.384 INFO:tasks.rados.rados.2.smithi057.stdout:1228: expect (ObjNum 391 snap 129 seq_num 391) 2020-11-16T22:06:21.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:21 smithi057 bash[10301]: cluster 2020-11-16T22:06:19.659595+0000 mgr.x (mgr.24115) 411 : cluster [DBG] pgmap v694: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 285 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 878 KiB/s wr, 6 op/s 2020-11-16T22:06:21.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:21 smithi057 bash[10301]: cluster 2020-11-16T22:06:20.970378+0000 mon.a (mon.0) 1004 : cluster [DBG] osdmap e355: 12 total, 12 up, 12 in 2020-11-16T22:06:21.463 INFO:tasks.rados.rados.2.smithi057.stdout:1229: finishing write tid 3 to smithi05720651-34 2020-11-16T22:06:21.463 INFO:tasks.rados.rados.2.smithi057.stdout:1229: finishing write tid 5 to smithi05720651-34 2020-11-16T22:06:21.463 INFO:tasks.rados.rados.2.smithi057.stdout:1229: finishing write tid 6 to smithi05720651-34 2020-11-16T22:06:21.463 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 1057 (ObjNum 435 snap 145 seq_num 435) dirty exists 2020-11-16T22:06:21.464 INFO:tasks.rados.rados.2.smithi057.stdout:1229: left oid 34 (ObjNum 435 snap 145 seq_num 435) 2020-11-16T22:06:21.464 INFO:tasks.rados.rados.2.smithi057.stdout:1230: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:21.464 INFO:tasks.rados.rados.2.smithi057.stdout:1230: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:21.464 INFO:tasks.rados.rados.2.smithi057.stdout:1230: finishing write tid 3 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:21.464 INFO:tasks.rados.rados.2.smithi057.stdout:1230: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:21.464 INFO:tasks.rados.rados.2.smithi057.stdout:1230: finishing write tid 6 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:21.464 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 484 (ObjNum 436 snap 145 seq_num 436) dirty exists 2020-11-16T22:06:21.465 INFO:tasks.rados.rados.2.smithi057.stdout:1230: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 436 snap 145 seq_num 436) 2020-11-16T22:06:22.019 INFO:tasks.rados.rados.2.smithi057.stdout:1226: done (5 left) 2020-11-16T22:06:22.020 INFO:tasks.rados.rados.2.smithi057.stdout:1227: done (4 left) 2020-11-16T22:06:22.020 INFO:tasks.rados.rados.2.smithi057.stdout:1228: done (3 left) 2020-11-16T22:06:22.020 INFO:tasks.rados.rados.2.smithi057.stdout:1229: done (2 left) 2020-11-16T22:06:22.020 INFO:tasks.rados.rados.2.smithi057.stdout:1230: done (1 left) 2020-11-16T22:06:22.020 INFO:tasks.rados.rados.2.smithi057.stdout:1231: done (0 left) 2020-11-16T22:06:22.020 INFO:tasks.rados.rados.2.smithi057.stdout:1232: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:22.021 INFO:tasks.rados.rados.2.smithi057.stdout:1232: expect (ObjNum 408 snap 137 seq_num 408) 2020-11-16T22:06:22.021 INFO:tasks.rados.rados.2.smithi057.stdout:1233: snap_remove snap 140 2020-11-16T22:06:23.031 INFO:tasks.rados.rados.2.smithi057.stdout:1233: done (1 left) 2020-11-16T22:06:23.031 INFO:tasks.rados.rados.2.smithi057.stdout:1234: delete oid 50 current snap is 146 2020-11-16T22:06:23.031 INFO:tasks.rados.rados.2.smithi057.stdout:1232: expect (ObjNum 408 snap 137 seq_num 408) 2020-11-16T22:06:23.190 INFO:tasks.rados.rados.2.smithi057.stdout:1232: done (1 left) 2020-11-16T22:06:23.191 INFO:tasks.rados.rados.2.smithi057.stdout:1234: done (0 left) 2020-11-16T22:06:23.191 INFO:tasks.rados.rados.2.smithi057.stdout:1235: snap_create 2020-11-16T22:06:23.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:23 smithi016 bash[10302]: cluster 2020-11-16T22:06:21.660334+0000 mgr.x (mgr.24115) 412 : cluster [DBG] pgmap v697: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 303 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.1 MiB/s wr, 22 op/s 2020-11-16T22:06:23.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:23 smithi016 bash[10302]: cluster 2020-11-16T22:06:22.028709+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e356: 12 total, 12 up, 12 in 2020-11-16T22:06:23.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:23 smithi195 bash[10218]: cluster 2020-11-16T22:06:21.660334+0000 mgr.x (mgr.24115) 412 : cluster [DBG] pgmap v697: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 303 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.1 MiB/s wr, 22 op/s 2020-11-16T22:06:23.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:23 smithi195 bash[10218]: cluster 2020-11-16T22:06:22.028709+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e356: 12 total, 12 up, 12 in 2020-11-16T22:06:23.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:23 smithi057 bash[10301]: cluster 2020-11-16T22:06:21.660334+0000 mgr.x (mgr.24115) 412 : cluster [DBG] pgmap v697: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 303 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.1 MiB/s wr, 22 op/s 2020-11-16T22:06:23.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:23 smithi057 bash[10301]: cluster 2020-11-16T22:06:22.028709+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e356: 12 total, 12 up, 12 in 2020-11-16T22:06:24.038 INFO:tasks.rados.rados.2.smithi057.stdout:1235: done (0 left) 2020-11-16T22:06:24.039 INFO:tasks.rados.rados.2.smithi057.stdout:1236: read oid 26 snap 125 2020-11-16T22:06:24.039 INFO:tasks.rados.rados.2.smithi057.stdout:1236: expect (ObjNum 278 snap 94 seq_num 278) 2020-11-16T22:06:24.039 INFO:tasks.rados.rados.2.smithi057.stdout:1237: rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 147 2020-11-16T22:06:24.039 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 132 2020-11-16T22:06:24.039 INFO:tasks.rados.rados.2.smithi057.stdout:1238: rollback oid 36 current snap is 147 2020-11-16T22:06:24.039 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 36 to 134 2020-11-16T22:06:24.040 INFO:tasks.rados.rados.2.smithi057.stdout:1239: snap_remove snap 114 2020-11-16T22:06:24.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:24 smithi016 bash[10302]: cluster 2020-11-16T22:06:23.038858+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e357: 12 total, 12 up, 12 in 2020-11-16T22:06:24.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:24 smithi195 bash[10218]: cluster 2020-11-16T22:06:23.038858+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e357: 12 total, 12 up, 12 in 2020-11-16T22:06:24.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:24 smithi057 bash[10301]: cluster 2020-11-16T22:06:23.038858+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e357: 12 total, 12 up, 12 in 2020-11-16T22:06:24.948 INFO:tasks.rados.rados.2.smithi057.stdout:1239: done (3 left) 2020-11-16T22:06:24.948 INFO:tasks.rados.rados.2.smithi057.stdout:1240: write (excl) oid 12 current snap is 147 2020-11-16T22:06:24.949 INFO:tasks.rados.rados.2.smithi057.stdout:1240: seq_num 438 ranges {561466=791183,2081113=592804,3095506=265960} 2020-11-16T22:06:24.956 INFO:tasks.rados.rados.2.smithi057.stdout:1240: writing smithi05720651-12 from 561466 to 1352649 tid 1 2020-11-16T22:06:24.964 INFO:tasks.rados.rados.2.smithi057.stdout:1240: writing smithi05720651-12 from 2081113 to 2673917 tid 2 2020-11-16T22:06:24.969 INFO:tasks.rados.rados.2.smithi057.stdout:1240: writing smithi05720651-12 from 3095506 to 3361466 tid 3 2020-11-16T22:06:24.969 INFO:tasks.rados.rados.2.smithi057.stdout:1241: snap_remove snap 143 2020-11-16T22:06:25.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:25 smithi016 bash[10302]: cluster 2020-11-16T22:06:23.661005+0000 mgr.x (mgr.24115) 413 : cluster [DBG] pgmap v700: 17 pgs: 17 active+clean; 304 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.5 MiB/s wr, 24 op/s 2020-11-16T22:06:25.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:25 smithi016 bash[10302]: cluster 2020-11-16T22:06:24.048150+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e358: 12 total, 12 up, 12 in 2020-11-16T22:06:25.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:25 smithi016 bash[10302]: cluster 2020-11-16T22:06:24.958890+0000 mon.a (mon.0) 1008 : cluster [DBG] osdmap e359: 12 total, 12 up, 12 in 2020-11-16T22:06:25.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:25 smithi195 bash[10218]: cluster 2020-11-16T22:06:23.661005+0000 mgr.x (mgr.24115) 413 : cluster [DBG] pgmap v700: 17 pgs: 17 active+clean; 304 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.5 MiB/s wr, 24 op/s 2020-11-16T22:06:25.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:25 smithi195 bash[10218]: cluster 2020-11-16T22:06:24.048150+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e358: 12 total, 12 up, 12 in 2020-11-16T22:06:25.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:25 smithi195 bash[10218]: cluster 2020-11-16T22:06:24.958890+0000 mon.a (mon.0) 1008 : cluster [DBG] osdmap e359: 12 total, 12 up, 12 in 2020-11-16T22:06:25.446 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:06:24 smithi057 bash[12595]: debug 2020-11-16T22:06:24.971+0000 7f737819a700 -1 osd.8 pg_epoch: 359 pg[2.f( v 337'79 (0'0,337'79] local-lis/les=71/72 n=2 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,9] r=0 lpr=71 crt=337'79 lcod 333'77 mlcod 333'77 active+clean+snaptrim trimq=[da~1] ps=[10d~1]] removing snap head 2020-11-16T22:06:25.446 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:06:24 smithi057 bash[19569]: debug 2020-11-16T22:06:24.975+0000 7f5e12117700 -1 osd.11 pg_epoch: 359 pg[2.a( v 359'385 (0'0,359'385] local-lis/les=71/72 n=6 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [11,3] r=0 lpr=71 luod=355'383 crt=359'385 lcod 355'382 mlcod 355'382 active+clean+snaptrim trimq=[da~1] ps=[10d~1]] removing snap head 2020-11-16T22:06:25.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:25 smithi057 bash[10301]: cluster 2020-11-16T22:06:23.661005+0000 mgr.x (mgr.24115) 413 : cluster [DBG] pgmap v700: 17 pgs: 17 active+clean; 304 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.5 MiB/s wr, 24 op/s 2020-11-16T22:06:25.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:25 smithi057 bash[10301]: cluster 2020-11-16T22:06:24.048150+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e358: 12 total, 12 up, 12 in 2020-11-16T22:06:25.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:25 smithi057 bash[10301]: cluster 2020-11-16T22:06:24.958890+0000 mon.a (mon.0) 1008 : cluster [DBG] osdmap e359: 12 total, 12 up, 12 in 2020-11-16T22:06:25.849 INFO:journalctl@ceph.osd.2.smithi195.stdout:Nov 16 22:06:25 smithi195 bash[21024]: debug 2020-11-16T22:06:25.447+0000 7f3c18734700 -1 osd.2 pg_epoch: 359 pg[2.1( v 359'142 (0'0,359'142] local-lis/les=71/72 n=4 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [2,3] r=0 lpr=71 luod=354'140 crt=359'142 lcod 353'139 mlcod 353'139 active+clean+snaptrim trimq=[da~1] ps=[10d~1]] removing snap head 2020-11-16T22:06:25.961 INFO:tasks.rados.rados.2.smithi057.stdout:1241: done (4 left) 2020-11-16T22:06:25.962 INFO:tasks.rados.rados.2.smithi057.stdout:1242: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:25.962 INFO:tasks.rados.rados.2.smithi057.stdout:1242: expect (ObjNum 425 snap 143 seq_num 425) 2020-11-16T22:06:25.962 INFO:tasks.rados.rados.2.smithi057.stdout:1243: rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 147 2020-11-16T22:06:25.962 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 136 2020-11-16T22:06:25.963 INFO:tasks.rados.rados.2.smithi057.stdout:1238: finishing rollback tid 1 to smithi05720651-36 2020-11-16T22:06:25.963 INFO:tasks.rados.rados.2.smithi057.stdout:1238: finishing rollback tid 2 to smithi05720651-36 2020-11-16T22:06:25.963 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 855 (ObjNum 297 snap 103 seq_num 297) dirty exists 2020-11-16T22:06:25.963 INFO:tasks.rados.rados.2.smithi057.stdout:1237: finishing rollback tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:25.963 INFO:tasks.rados.rados.2.smithi057.stdout:1238: done (5 left) 2020-11-16T22:06:25.963 INFO:tasks.rados.rados.2.smithi057.stdout:1244: snap_remove snap 141 2020-11-16T22:06:26.446 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:06:25 smithi057 bash[19569]: debug 2020-11-16T22:06:25.975+0000 7f5e0d10d700 -1 osd.11 pg_epoch: 360 pg[2.c( v 360'268 (0'0,360'268] local-lis/les=71/72 n=6 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [11,0] r=0 lpr=71 luod=359'267 crt=359'267 lcod 354'265 mlcod 354'265 active+clean+snaptrim trimq=[117~1] ps=[da~1,10d~1]] removing snap head 2020-11-16T22:06:26.975 INFO:tasks.rados.rados.2.smithi057.stdout:1244: done (5 left) 2020-11-16T22:06:26.975 INFO:tasks.rados.rados.2.smithi057.stdout:1245: snap_create 2020-11-16T22:06:26.975 INFO:tasks.rados.rados.2.smithi057.stdout:1237: finishing rollback tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:26.976 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 943 (ObjNum 357 snap 118 seq_num 357) dirty exists 2020-11-16T22:06:26.976 INFO:tasks.rados.rados.2.smithi057.stdout:1236: expect (ObjNum 278 snap 94 seq_num 278) 2020-11-16T22:06:27.184 INFO:tasks.rados.rados.2.smithi057.stdout:1240: finishing write tid 1 to smithi05720651-12 2020-11-16T22:06:27.184 INFO:tasks.rados.rados.2.smithi057.stdout:1240: finishing write tid 2 to smithi05720651-12 2020-11-16T22:06:27.184 INFO:tasks.rados.rados.2.smithi057.stdout:1240: finishing write tid 3 to smithi05720651-12 2020-11-16T22:06:27.184 INFO:tasks.rados.rados.2.smithi057.stdout:1240: finishing write tid 5 to smithi05720651-12 2020-11-16T22:06:27.185 INFO:tasks.rados.rados.2.smithi057.stdout:1240: finishing write tid 6 to smithi05720651-12 2020-11-16T22:06:27.185 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 859 (ObjNum 438 snap 147 seq_num 438) dirty exists 2020-11-16T22:06:27.185 INFO:tasks.rados.rados.2.smithi057.stdout:1240: left oid 12 (ObjNum 438 snap 147 seq_num 438) 2020-11-16T22:06:27.185 INFO:tasks.rados.rados.2.smithi057.stdout:1242: expect (ObjNum 425 snap 143 seq_num 425) 2020-11-16T22:06:27.277 INFO:tasks.rados.rados.2.smithi057.stdout:1243: finishing rollback tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:27.277 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 265 (ObjNum 385 snap 0 seq_num 2932834320) dirty dne 2020-11-16T22:06:27.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:26 smithi016 bash[10302]: cluster 2020-11-16T22:06:25.661678+0000 mgr.x (mgr.24115) 414 : cluster [DBG] pgmap v703: 17 pgs: 17 active+clean; 289 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 383 KiB/s wr, 8 op/s 2020-11-16T22:06:27.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:26 smithi016 bash[10302]: cluster 2020-11-16T22:06:25.968398+0000 mon.a (mon.0) 1009 : cluster [DBG] osdmap e360: 12 total, 12 up, 12 in 2020-11-16T22:06:27.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:26 smithi195 bash[10218]: cluster 2020-11-16T22:06:25.661678+0000 mgr.x (mgr.24115) 414 : cluster [DBG] pgmap v703: 17 pgs: 17 active+clean; 289 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 383 KiB/s wr, 8 op/s 2020-11-16T22:06:27.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:26 smithi195 bash[10218]: cluster 2020-11-16T22:06:25.968398+0000 mon.a (mon.0) 1009 : cluster [DBG] osdmap e360: 12 total, 12 up, 12 in 2020-11-16T22:06:27.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:26 smithi057 bash[10301]: cluster 2020-11-16T22:06:25.661678+0000 mgr.x (mgr.24115) 414 : cluster [DBG] pgmap v703: 17 pgs: 17 active+clean; 289 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 383 KiB/s wr, 8 op/s 2020-11-16T22:06:27.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:26 smithi057 bash[10301]: cluster 2020-11-16T22:06:25.968398+0000 mon.a (mon.0) 1009 : cluster [DBG] osdmap e360: 12 total, 12 up, 12 in 2020-11-16T22:06:27.993 INFO:tasks.rados.rados.2.smithi057.stdout:1236: done (5 left) 2020-11-16T22:06:27.993 INFO:tasks.rados.rados.2.smithi057.stdout:1237: done (4 left) 2020-11-16T22:06:27.993 INFO:tasks.rados.rados.2.smithi057.stdout:1240: done (3 left) 2020-11-16T22:06:27.993 INFO:tasks.rados.rados.2.smithi057.stdout:1242: done (2 left) 2020-11-16T22:06:27.993 INFO:tasks.rados.rados.2.smithi057.stdout:1243: done (1 left) 2020-11-16T22:06:27.994 INFO:tasks.rados.rados.2.smithi057.stdout:1245: done (0 left) 2020-11-16T22:06:27.994 INFO:tasks.rados.rados.2.smithi057.stdout:1246: rollback oid 26 current snap is 148 2020-11-16T22:06:27.994 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 26 to 132 2020-11-16T22:06:27.994 INFO:tasks.rados.rados.2.smithi057.stdout:1247: snap_remove snap 146 2020-11-16T22:06:28.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:27 smithi016 bash[10302]: cluster 2020-11-16T22:06:26.979760+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e361: 12 total, 12 up, 12 in 2020-11-16T22:06:28.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:27 smithi195 bash[10218]: cluster 2020-11-16T22:06:26.979760+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e361: 12 total, 12 up, 12 in 2020-11-16T22:06:28.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:28 smithi057 bash[10301]: cluster 2020-11-16T22:06:26.979760+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e361: 12 total, 12 up, 12 in 2020-11-16T22:06:28.983 INFO:tasks.rados.rados.2.smithi057.stdout:1247: done (1 left) 2020-11-16T22:06:28.983 INFO:tasks.rados.rados.2.smithi057.stdout:1248: write oid 22 current snap is 148 2020-11-16T22:06:28.983 INFO:tasks.rados.rados.2.smithi057.stdout:1248: seq_num 439 ranges {578273=466432,1739595=452815,2722929=655344} 2020-11-16T22:06:28.994 INFO:tasks.rados.rados.2.smithi057.stdout:1248: writing smithi05720651-22 from 578273 to 1044705 tid 1 2020-11-16T22:06:29.002 INFO:tasks.rados.rados.2.smithi057.stdout:1248: writing smithi05720651-22 from 1739595 to 2192410 tid 2 2020-11-16T22:06:29.010 INFO:tasks.rados.rados.2.smithi057.stdout:1248: writing smithi05720651-22 from 2722929 to 3378273 tid 3 2020-11-16T22:06:29.010 INFO:tasks.rados.rados.2.smithi057.stdout:1249: copy_from oid 38 from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 148 2020-11-16T22:06:29.010 INFO:tasks.rados.rados.2.smithi057.stdout:1246: finishing rollback tid 0 to smithi05720651-26 2020-11-16T22:06:29.010 INFO:tasks.rados.rados.2.smithi057.stdout:1246: finishing rollback tid 1 to smithi05720651-26 2020-11-16T22:06:29.010 INFO:tasks.rados.rados.2.smithi057.stdout:1246: finishing rollback tid 2 to smithi05720651-26 2020-11-16T22:06:29.010 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 1247 (ObjNum 264 snap 86 seq_num 264) dirty exists 2020-11-16T22:06:29.011 INFO:tasks.rados.rados.2.smithi057.stdout:1248: finishing write tid 1 to smithi05720651-22 2020-11-16T22:06:29.011 INFO:tasks.rados.rados.2.smithi057.stdout:1248: finishing write tid 2 to smithi05720651-22 2020-11-16T22:06:29.011 INFO:tasks.rados.rados.2.smithi057.stdout:1246: done (2 left) 2020-11-16T22:06:29.011 INFO:tasks.rados.rados.2.smithi057.stdout:1250: copy_from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 44 current snap is 148 2020-11-16T22:06:29.011 INFO:tasks.rados.rados.2.smithi057.stdout:1251: copy_from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 148 2020-11-16T22:06:29.011 INFO:tasks.rados.rados.2.smithi057.stdout:1252: write (excl) oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 148 2020-11-16T22:06:29.011 INFO:tasks.rados.rados.2.smithi057.stdout:1252: seq_num 440 ranges {595080=541681,1798077=596473,3150352=244728} 2020-11-16T22:06:29.016 INFO:tasks.rados.rados.2.smithi057.stdout:1252: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 595080 to 1136761 tid 1 2020-11-16T22:06:29.024 INFO:tasks.rados.rados.2.smithi057.stdout:1252: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1798077 to 2394550 tid 2 2020-11-16T22:06:29.031 INFO:tasks.rados.rados.2.smithi057.stdout:1252: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3150352 to 3395080 tid 3 2020-11-16T22:06:29.031 INFO:tasks.rados.rados.2.smithi057.stdout:1253: copy_from oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 50 current snap is 148 2020-11-16T22:06:29.031 INFO:tasks.rados.rados.2.smithi057.stdout:1248: finishing write tid 3 to smithi05720651-22 2020-11-16T22:06:29.031 INFO:tasks.rados.rados.2.smithi057.stdout:1254: write (excl) oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 148 2020-11-16T22:06:29.032 INFO:tasks.rados.rados.2.smithi057.stdout:1254: seq_num 441 ranges {611887=733283,1972912=456484,2894128=517759} 2020-11-16T22:06:29.039 INFO:tasks.rados.rados.2.smithi057.stdout:1254: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 611887 to 1345170 tid 1 2020-11-16T22:06:29.045 INFO:tasks.rados.rados.2.smithi057.stdout:1254: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1972912 to 2429396 tid 2 2020-11-16T22:06:29.051 INFO:tasks.rados.rados.2.smithi057.stdout:1254: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2894128 to 3411887 tid 3 2020-11-16T22:06:29.052 INFO:tasks.rados.rados.2.smithi057.stdout:1255: read oid 34 snap -1 2020-11-16T22:06:29.052 INFO:tasks.rados.rados.2.smithi057.stdout:1255: expect (ObjNum 435 snap 145 seq_num 435) 2020-11-16T22:06:29.052 INFO:tasks.rados.rados.2.smithi057.stdout:1256: copy_from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 48 current snap is 148 2020-11-16T22:06:29.052 INFO:tasks.rados.rados.2.smithi057.stdout:1248: finishing write tid 5 to smithi05720651-22 2020-11-16T22:06:29.052 INFO:tasks.rados.rados.2.smithi057.stdout:1248: finishing write tid 6 to smithi05720651-22 2020-11-16T22:06:29.052 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 863 (ObjNum 439 snap 148 seq_num 439) dirty exists 2020-11-16T22:06:29.053 INFO:tasks.rados.rados.2.smithi057.stdout:1248: left oid 22 (ObjNum 439 snap 148 seq_num 439) 2020-11-16T22:06:29.053 INFO:tasks.rados.rados.2.smithi057.stdout:1252: finishing write tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.053 INFO:tasks.rados.rados.2.smithi057.stdout:1251: finishing copy_from to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.053 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 964 (ObjNum 416 snap 140 seq_num 416) dirty exists 2020-11-16T22:06:29.053 INFO:tasks.rados.rados.2.smithi057.stdout:1248: done (8 left) 2020-11-16T22:06:29.053 INFO:tasks.rados.rados.2.smithi057.stdout:1257: snap_create 2020-11-16T22:06:29.053 INFO:tasks.rados.rados.2.smithi057.stdout:1251: finishing copy_from racing read to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.054 INFO:tasks.rados.rados.2.smithi057.stdout:1249: finishing copy_from to smithi05720651-38 2020-11-16T22:06:29.054 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 853 (ObjNum 371 snap 123 seq_num 371) dirty exists 2020-11-16T22:06:29.054 INFO:tasks.rados.rados.2.smithi057.stdout:1249: finishing copy_from racing read to smithi05720651-38 2020-11-16T22:06:29.054 INFO:tasks.rados.rados.2.smithi057.stdout:1253: finishing copy_from to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.054 INFO:tasks.rados.rados.2.smithi057.stdout:1253: got expected ENOENT (src dne) 2020-11-16T22:06:29.054 INFO:tasks.rados.rados.2.smithi057.stdout:1253: finishing copy_from racing read to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.054 INFO:tasks.rados.rados.2.smithi057.stdout:1250: finishing copy_from to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.055 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 430 (ObjNum 290 snap 99 seq_num 290) dirty exists 2020-11-16T22:06:29.055 INFO:tasks.rados.rados.2.smithi057.stdout:1250: finishing copy_from racing read to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.055 INFO:tasks.rados.rados.2.smithi057.stdout:1252: finishing write tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.055 INFO:tasks.rados.rados.2.smithi057.stdout:1252: finishing write tid 3 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.055 INFO:tasks.rados.rados.2.smithi057.stdout:1252: finishing write tid 5 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.055 INFO:tasks.rados.rados.2.smithi057.stdout:1252: finishing write tid 6 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.055 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 990 (ObjNum 440 snap 148 seq_num 440) dirty exists 2020-11-16T22:06:29.056 INFO:tasks.rados.rados.2.smithi057.stdout:1252: left oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 440 snap 148 seq_num 440) 2020-11-16T22:06:29.056 INFO:tasks.rados.rados.2.smithi057.stdout:1254: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.056 INFO:tasks.rados.rados.2.smithi057.stdout:1254: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.056 INFO:tasks.rados.rados.2.smithi057.stdout:1254: finishing write tid 3 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.057 INFO:tasks.rados.rados.2.smithi057.stdout:1255: expect (ObjNum 435 snap 145 seq_num 435) 2020-11-16T22:06:29.159 INFO:tasks.rados.rados.2.smithi057.stdout:1254: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.159 INFO:tasks.rados.rados.2.smithi057.stdout:1254: finishing write tid 6 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.160 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1081 (ObjNum 441 snap 148 seq_num 441) dirty exists 2020-11-16T22:06:29.160 INFO:tasks.rados.rados.2.smithi057.stdout:1254: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 441 snap 148 seq_num 441) 2020-11-16T22:06:29.160 INFO:tasks.rados.rados.2.smithi057.stdout:1256: finishing copy_from to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.160 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 245 (ObjNum 410 snap 138 seq_num 410) dirty exists 2020-11-16T22:06:29.160 INFO:tasks.rados.rados.2.smithi057.stdout:1256: finishing copy_from racing read to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:29.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:29 smithi016 bash[10302]: cluster 2020-11-16T22:06:27.662370+0000 mgr.x (mgr.24115) 415 : cluster [DBG] pgmap v706: 17 pgs: 17 active+clean; 256 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 0 B/s wr, 10 op/s 2020-11-16T22:06:29.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:29 smithi016 bash[10302]: cluster 2020-11-16T22:06:27.989419+0000 mon.a (mon.0) 1011 : cluster [DBG] osdmap e362: 12 total, 12 up, 12 in 2020-11-16T22:06:29.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:29 smithi195 bash[10218]: cluster 2020-11-16T22:06:27.662370+0000 mgr.x (mgr.24115) 415 : cluster [DBG] pgmap v706: 17 pgs: 17 active+clean; 256 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 0 B/s wr, 10 op/s 2020-11-16T22:06:29.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:29 smithi195 bash[10218]: cluster 2020-11-16T22:06:27.989419+0000 mon.a (mon.0) 1011 : cluster [DBG] osdmap e362: 12 total, 12 up, 12 in 2020-11-16T22:06:29.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:29 smithi057 bash[10301]: cluster 2020-11-16T22:06:27.662370+0000 mgr.x (mgr.24115) 415 : cluster [DBG] pgmap v706: 17 pgs: 17 active+clean; 256 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 0 B/s wr, 10 op/s 2020-11-16T22:06:29.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:29 smithi057 bash[10301]: cluster 2020-11-16T22:06:27.989419+0000 mon.a (mon.0) 1011 : cluster [DBG] osdmap e362: 12 total, 12 up, 12 in 2020-11-16T22:06:29.954 INFO:tasks.rados.rados.2.smithi057.stdout:1249: done (8 left) 2020-11-16T22:06:29.954 INFO:tasks.rados.rados.2.smithi057.stdout:1250: done (7 left) 2020-11-16T22:06:29.954 INFO:tasks.rados.rados.2.smithi057.stdout:1251: done (6 left) 2020-11-16T22:06:29.955 INFO:tasks.rados.rados.2.smithi057.stdout:1252: done (5 left) 2020-11-16T22:06:29.955 INFO:tasks.rados.rados.2.smithi057.stdout:1253: done (4 left) 2020-11-16T22:06:29.955 INFO:tasks.rados.rados.2.smithi057.stdout:1254: done (3 left) 2020-11-16T22:06:29.955 INFO:tasks.rados.rados.2.smithi057.stdout:1255: done (2 left) 2020-11-16T22:06:29.955 INFO:tasks.rados.rados.2.smithi057.stdout:1256: done (1 left) 2020-11-16T22:06:29.955 INFO:tasks.rados.rados.2.smithi057.stdout:1257: done (0 left) 2020-11-16T22:06:29.955 INFO:tasks.rados.rados.2.smithi057.stdout:1258: delete oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 149 2020-11-16T22:06:29.964 INFO:tasks.rados.rados.2.smithi057.stdout:1258: done (0 left) 2020-11-16T22:06:29.964 INFO:tasks.rados.rados.2.smithi057.stdout:1259: snap_create 2020-11-16T22:06:30.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:30 smithi016 bash[10302]: cluster 2020-11-16T22:06:28.992768+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e363: 12 total, 12 up, 12 in 2020-11-16T22:06:30.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:30 smithi016 bash[10302]: audit 2020-11-16T22:06:29.732785+0000 mon.b (mon.1) 293 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:06:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:30 smithi016 bash[10302]: audit 2020-11-16T22:06:29.734224+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:06:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:30 smithi016 bash[10302]: audit 2020-11-16T22:06:29.745653+0000 mon.b (mon.1) 294 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:06:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:30 smithi016 bash[10302]: audit 2020-11-16T22:06:29.747008+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:06:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:30 smithi016 bash[10302]: cluster 2020-11-16T22:06:29.960481+0000 mon.a (mon.0) 1015 : cluster [DBG] osdmap e364: 12 total, 12 up, 12 in 2020-11-16T22:06:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:30 smithi195 bash[10218]: cluster 2020-11-16T22:06:28.992768+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e363: 12 total, 12 up, 12 in 2020-11-16T22:06:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:30 smithi195 bash[10218]: audit 2020-11-16T22:06:29.732785+0000 mon.b (mon.1) 293 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:06:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:30 smithi195 bash[10218]: audit 2020-11-16T22:06:29.734224+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:06:30.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:30 smithi195 bash[10218]: audit 2020-11-16T22:06:29.745653+0000 mon.b (mon.1) 294 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:06:30.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:30 smithi195 bash[10218]: audit 2020-11-16T22:06:29.747008+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:06:30.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:30 smithi195 bash[10218]: cluster 2020-11-16T22:06:29.960481+0000 mon.a (mon.0) 1015 : cluster [DBG] osdmap e364: 12 total, 12 up, 12 in 2020-11-16T22:06:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:30 smithi057 bash[10301]: cluster 2020-11-16T22:06:28.992768+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e363: 12 total, 12 up, 12 in 2020-11-16T22:06:30.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:30 smithi057 bash[10301]: audit 2020-11-16T22:06:29.732785+0000 mon.b (mon.1) 293 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:06:30.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:30 smithi057 bash[10301]: audit 2020-11-16T22:06:29.734224+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:06:30.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:30 smithi057 bash[10301]: audit 2020-11-16T22:06:29.745653+0000 mon.b (mon.1) 294 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:06:30.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:30 smithi057 bash[10301]: audit 2020-11-16T22:06:29.747008+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:06:30.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:30 smithi057 bash[10301]: cluster 2020-11-16T22:06:29.960481+0000 mon.a (mon.0) 1015 : cluster [DBG] osdmap e364: 12 total, 12 up, 12 in 2020-11-16T22:06:30.966 INFO:tasks.rados.rados.2.smithi057.stdout:1259: done (0 left) 2020-11-16T22:06:30.966 INFO:tasks.rados.rados.2.smithi057.stdout:1260: write (excl) oid 50 current snap is 150 2020-11-16T22:06:30.966 INFO:tasks.rados.rados.2.smithi057.stdout:1260: seq_num 443 ranges {645501=483781,1573523=460153,2548974=763384} 2020-11-16T22:06:30.979 INFO:tasks.rados.rados.2.smithi057.stdout:1260: writing smithi05720651-50 from 645501 to 1129282 tid 1 2020-11-16T22:06:30.984 INFO:tasks.rados.rados.2.smithi057.stdout:1260: writing smithi05720651-50 from 1573523 to 2033676 tid 2 2020-11-16T22:06:30.991 INFO:tasks.rados.rados.2.smithi057.stdout:1260: writing smithi05720651-50 from 2548974 to 3312358 tid 3 2020-11-16T22:06:30.992 INFO:tasks.rados.rados.2.smithi057.stdout:1261: read oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 142 2020-11-16T22:06:30.992 INFO:tasks.rados.rados.2.smithi057.stdout:1261: expect (ObjNum 371 snap 123 seq_num 371) 2020-11-16T22:06:30.992 INFO:tasks.rados.rados.2.smithi057.stdout:1262: copy_from oid 26 from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 150 2020-11-16T22:06:30.992 INFO:tasks.rados.rados.2.smithi057.stdout:1260: finishing write tid 1 to smithi05720651-50 2020-11-16T22:06:30.992 INFO:tasks.rados.rados.2.smithi057.stdout:1263: delete oid 24 current snap is 150 2020-11-16T22:06:30.997 INFO:tasks.rados.rados.2.smithi057.stdout:1263: done (3 left) 2020-11-16T22:06:30.997 INFO:tasks.rados.rados.2.smithi057.stdout:1264: snap_remove snap 132 2020-11-16T22:06:31.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:31 smithi016 bash[10302]: cluster 2020-11-16T22:06:29.663068+0000 mgr.x (mgr.24115) 416 : cluster [DBG] pgmap v709: 17 pgs: 17 active+clean; 256 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 0 B/s wr, 4 op/s 2020-11-16T22:06:31.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:31 smithi016 bash[10302]: cluster 2020-11-16T22:06:30.974000+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e365: 12 total, 12 up, 12 in 2020-11-16T22:06:31.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:31 smithi195 bash[10218]: cluster 2020-11-16T22:06:29.663068+0000 mgr.x (mgr.24115) 416 : cluster [DBG] pgmap v709: 17 pgs: 17 active+clean; 256 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 0 B/s wr, 4 op/s 2020-11-16T22:06:31.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:31 smithi195 bash[10218]: cluster 2020-11-16T22:06:30.974000+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e365: 12 total, 12 up, 12 in 2020-11-16T22:06:31.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:31 smithi057 bash[10301]: cluster 2020-11-16T22:06:29.663068+0000 mgr.x (mgr.24115) 416 : cluster [DBG] pgmap v709: 17 pgs: 17 active+clean; 256 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 0 B/s wr, 4 op/s 2020-11-16T22:06:31.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:31 smithi057 bash[10301]: cluster 2020-11-16T22:06:30.974000+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e365: 12 total, 12 up, 12 in 2020-11-16T22:06:31.966 INFO:tasks.rados.rados.2.smithi057.stdout:1264: done (3 left) 2020-11-16T22:06:31.967 INFO:tasks.rados.rados.2.smithi057.stdout:1265: copy_from oid 6 from oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 150 2020-11-16T22:06:31.967 INFO:tasks.rados.rados.2.smithi057.stdout:1262: finishing copy_from to smithi05720651-26 2020-11-16T22:06:31.967 INFO:tasks.rados.rados.2.smithi057.stdout:1262: got expected ENOENT (src dne) 2020-11-16T22:06:31.967 INFO:tasks.rados.rados.2.smithi057.stdout:1260: finishing write tid 2 to smithi05720651-50 2020-11-16T22:06:31.967 INFO:tasks.rados.rados.2.smithi057.stdout:1262: finishing copy_from racing read to smithi05720651-26 2020-11-16T22:06:31.968 INFO:tasks.rados.rados.2.smithi057.stdout:1260: finishing write tid 3 to smithi05720651-50 2020-11-16T22:06:31.968 INFO:tasks.rados.rados.2.smithi057.stdout:1260: finishing write tid 5 to smithi05720651-50 2020-11-16T22:06:31.968 INFO:tasks.rados.rados.2.smithi057.stdout:1260: finishing write tid 6 to smithi05720651-50 2020-11-16T22:06:31.968 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 1082 (ObjNum 443 snap 150 seq_num 443) dirty exists 2020-11-16T22:06:31.968 INFO:tasks.rados.rados.2.smithi057.stdout:1260: left oid 50 (ObjNum 443 snap 150 seq_num 443) 2020-11-16T22:06:31.968 INFO:tasks.rados.rados.2.smithi057.stdout:1261: expect (ObjNum 371 snap 123 seq_num 371) 2020-11-16T22:06:32.040 INFO:tasks.rados.rados.2.smithi057.stdout:1260: done (3 left) 2020-11-16T22:06:32.041 INFO:tasks.rados.rados.2.smithi057.stdout:1261: done (2 left) 2020-11-16T22:06:32.041 INFO:tasks.rados.rados.2.smithi057.stdout:1262: done (1 left) 2020-11-16T22:06:32.041 INFO:tasks.rados.rados.2.smithi057.stdout:1266: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:32.041 INFO:tasks.rados.rados.2.smithi057.stdout:1266: expect (ObjNum 425 snap 143 seq_num 425) 2020-11-16T22:06:32.041 INFO:tasks.rados.rados.2.smithi057.stdout:1267: write oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 150 2020-11-16T22:06:32.041 INFO:tasks.rados.rados.2.smithi057.stdout:1267: seq_num 445 ranges {679115=634279,2090487=463822,3003820=475295} 2020-11-16T22:06:32.049 INFO:tasks.rados.rados.2.smithi057.stdout:1267: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 679115 to 1313394 tid 1 2020-11-16T22:06:32.058 INFO:tasks.rados.rados.2.smithi057.stdout:1267: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2090487 to 2554309 tid 2 2020-11-16T22:06:32.063 INFO:tasks.rados.rados.2.smithi057.stdout:1267: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3003820 to 3479115 tid 3 2020-11-16T22:06:32.064 INFO:tasks.rados.rados.2.smithi057.stdout:1268: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:32.064 INFO:tasks.rados.rados.2.smithi057.stdout:1268: expect (ObjNum 401 snap 133 seq_num 401) 2020-11-16T22:06:32.064 INFO:tasks.rados.rados.2.smithi057.stdout:1269: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:32.064 INFO:tasks.rados.rados.2.smithi057.stdout:1269: expect deleted 2020-11-16T22:06:32.064 INFO:tasks.rados.rados.2.smithi057.stdout:1270: snap_remove snap 134 2020-11-16T22:06:33.019 INFO:tasks.rados.rados.2.smithi057.stdout:1270: done (5 left) 2020-11-16T22:06:33.019 INFO:tasks.rados.rados.2.smithi057.stdout:1271: delete oid 16 current snap is 150 2020-11-16T22:06:33.019 INFO:tasks.rados.rados.2.smithi057.stdout:1265: finishing copy_from to smithi05720651-6 2020-11-16T22:06:33.019 INFO:tasks.rados.rados.2.smithi057.stdout:1265: got expected ENOENT (src dne) 2020-11-16T22:06:33.019 INFO:tasks.rados.rados.2.smithi057.stdout:1265: finishing copy_from racing read to smithi05720651-6 2020-11-16T22:06:33.020 INFO:tasks.rados.rados.2.smithi057.stdout:1266: expect (ObjNum 425 snap 143 seq_num 425) 2020-11-16T22:06:33.125 INFO:tasks.rados.rados.2.smithi057.stdout:1267: finishing write tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:33.125 INFO:tasks.rados.rados.2.smithi057.stdout:1267: finishing write tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:33.125 INFO:tasks.rados.rados.2.smithi057.stdout:1267: finishing write tid 3 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:33.125 INFO:tasks.rados.rados.2.smithi057.stdout:1267: finishing write tid 5 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:33.125 INFO:tasks.rados.rados.2.smithi057.stdout:1267: finishing write tid 6 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:33.125 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 999 (ObjNum 445 snap 150 seq_num 445) dirty exists 2020-11-16T22:06:33.126 INFO:tasks.rados.rados.2.smithi057.stdout:1267: left oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 445 snap 150 seq_num 445) 2020-11-16T22:06:33.126 INFO:tasks.rados.rados.2.smithi057.stdout:1268: expect (ObjNum 401 snap 133 seq_num 401) 2020-11-16T22:06:33.297 INFO:tasks.rados.rados.2.smithi057.stdout:1265: done (5 left) 2020-11-16T22:06:33.297 INFO:tasks.rados.rados.2.smithi057.stdout:1266: done (4 left) 2020-11-16T22:06:33.297 INFO:tasks.rados.rados.2.smithi057.stdout:1267: done (3 left) 2020-11-16T22:06:33.298 INFO:tasks.rados.rados.2.smithi057.stdout:1268: done (2 left) 2020-11-16T22:06:33.298 INFO:tasks.rados.rados.2.smithi057.stdout:1269: done (1 left) 2020-11-16T22:06:33.298 INFO:tasks.rados.rados.2.smithi057.stdout:1271: done (0 left) 2020-11-16T22:06:33.298 INFO:tasks.rados.rados.2.smithi057.stdout:1272: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:33.298 INFO:tasks.rados.rados.2.smithi057.stdout:1272: expect deleted 2020-11-16T22:06:33.298 INFO:tasks.rados.rados.2.smithi057.stdout:1273: write oid 20 current snap is 150 2020-11-16T22:06:33.298 INFO:tasks.rados.rados.2.smithi057.stdout:1273: seq_num 447 ranges {712729=784777,2091098=467491,3342313=170416} 2020-11-16T22:06:33.315 INFO:tasks.rados.rados.2.smithi057.stdout:1273: writing smithi05720651-20 from 712729 to 1497506 tid 1 2020-11-16T22:06:33.321 INFO:tasks.rados.rados.2.smithi057.stdout:1273: writing smithi05720651-20 from 2091098 to 2558589 tid 2 2020-11-16T22:06:33.327 INFO:tasks.rados.rados.2.smithi057.stdout:1273: writing smithi05720651-20 from 3342313 to 3512729 tid 3 2020-11-16T22:06:33.328 INFO:tasks.rados.rados.2.smithi057.stdout:1274: rollback oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 150 2020-11-16T22:06:33.328 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 125 2020-11-16T22:06:33.328 INFO:tasks.rados.rados.2.smithi057.stdout:1273: finishing write tid 1 to smithi05720651-20 2020-11-16T22:06:33.328 INFO:tasks.rados.rados.2.smithi057.stdout:1273: finishing write tid 2 to smithi05720651-20 2020-11-16T22:06:33.328 INFO:tasks.rados.rados.2.smithi057.stdout:1272: done (2 left) 2020-11-16T22:06:33.328 INFO:tasks.rados.rados.2.smithi057.stdout:1275: read oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:33.329 INFO:tasks.rados.rados.2.smithi057.stdout:1275: expect (ObjNum 410 snap 138 seq_num 410) 2020-11-16T22:06:33.329 INFO:tasks.rados.rados.2.smithi057.stdout:1276: snap_remove snap 148 2020-11-16T22:06:33.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:32 smithi016 bash[10302]: cluster 2020-11-16T22:06:31.663759+0000 mgr.x (mgr.24115) 417 : cluster [DBG] pgmap v712: 17 pgs: 17 active+clean; 261 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2020-11-16T22:06:33.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:32 smithi016 bash[10302]: cluster 2020-11-16T22:06:31.976365+0000 mon.a (mon.0) 1017 : cluster [DBG] osdmap e366: 12 total, 12 up, 12 in 2020-11-16T22:06:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:32 smithi195 bash[10218]: cluster 2020-11-16T22:06:31.663759+0000 mgr.x (mgr.24115) 417 : cluster [DBG] pgmap v712: 17 pgs: 17 active+clean; 261 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2020-11-16T22:06:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:32 smithi195 bash[10218]: cluster 2020-11-16T22:06:31.976365+0000 mon.a (mon.0) 1017 : cluster [DBG] osdmap e366: 12 total, 12 up, 12 in 2020-11-16T22:06:33.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:32 smithi057 bash[10301]: cluster 2020-11-16T22:06:31.663759+0000 mgr.x (mgr.24115) 417 : cluster [DBG] pgmap v712: 17 pgs: 17 active+clean; 261 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 4.1 MiB/s wr, 11 op/s 2020-11-16T22:06:33.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:32 smithi057 bash[10301]: cluster 2020-11-16T22:06:31.976365+0000 mon.a (mon.0) 1017 : cluster [DBG] osdmap e366: 12 total, 12 up, 12 in 2020-11-16T22:06:34.029 INFO:tasks.rados.rados.2.smithi057.stdout:1276: done (3 left) 2020-11-16T22:06:34.029 INFO:tasks.rados.rados.2.smithi057.stdout:1277: snap_remove snap 142 2020-11-16T22:06:34.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:34 smithi016 bash[10302]: cluster 2020-11-16T22:06:33.029605+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e367: 12 total, 12 up, 12 in 2020-11-16T22:06:34.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:34 smithi195 bash[10218]: cluster 2020-11-16T22:06:33.029605+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e367: 12 total, 12 up, 12 in 2020-11-16T22:06:34.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:34 smithi057 bash[10301]: cluster 2020-11-16T22:06:33.029605+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e367: 12 total, 12 up, 12 in 2020-11-16T22:06:34.952 INFO:tasks.rados.rados.2.smithi057.stdout:1277: done (3 left) 2020-11-16T22:06:34.952 INFO:tasks.rados.rados.2.smithi057.stdout:1278: read oid 8 snap 144 2020-11-16T22:06:34.953 INFO:tasks.rados.rados.2.smithi057.stdout:1278: expect (ObjNum 371 snap 123 seq_num 371) 2020-11-16T22:06:34.953 INFO:tasks.rados.rados.2.smithi057.stdout:1279: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:34.953 INFO:tasks.rados.rados.2.smithi057.stdout:1279: expect (ObjNum 415 snap 140 seq_num 415) 2020-11-16T22:06:34.953 INFO:tasks.rados.rados.2.smithi057.stdout:1280: rollback oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 150 2020-11-16T22:06:34.953 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 149 2020-11-16T22:06:34.953 INFO:tasks.rados.rados.2.smithi057.stdout:1274: finishing rollback tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:34.953 INFO:tasks.rados.rados.2.smithi057.stdout:1273: finishing write tid 3 to smithi05720651-20 2020-11-16T22:06:34.954 INFO:tasks.rados.rados.2.smithi057.stdout:1273: finishing write tid 5 to smithi05720651-20 2020-11-16T22:06:34.954 INFO:tasks.rados.rados.2.smithi057.stdout:1273: finishing write tid 6 to smithi05720651-20 2020-11-16T22:06:34.954 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1061 (ObjNum 447 snap 150 seq_num 447) dirty exists 2020-11-16T22:06:34.954 INFO:tasks.rados.rados.2.smithi057.stdout:1273: left oid 20 (ObjNum 447 snap 150 seq_num 447) 2020-11-16T22:06:34.954 INFO:tasks.rados.rados.2.smithi057.stdout:1275: expect (ObjNum 410 snap 138 seq_num 410) 2020-11-16T22:06:35.167 INFO:tasks.rados.rados.2.smithi057.stdout:1274: finishing rollback tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:35.167 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 945 (ObjNum 322 snap 111 seq_num 322) dirty exists 2020-11-16T22:06:35.167 INFO:tasks.rados.rados.2.smithi057.stdout:1278: expect (ObjNum 371 snap 123 seq_num 371) 2020-11-16T22:06:35.235 INFO:tasks.rados.rados.2.smithi057.stdout:1280: finishing rollback tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:35.235 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 856 (ObjNum 321 snap 0 seq_num 1) dirty dne 2020-11-16T22:06:35.235 INFO:tasks.rados.rados.2.smithi057.stdout:1279: expect (ObjNum 415 snap 140 seq_num 415) 2020-11-16T22:06:35.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:35 smithi016 bash[10302]: cluster 2020-11-16T22:06:33.664439+0000 mgr.x (mgr.24115) 418 : cluster [DBG] pgmap v715: 17 pgs: 17 active+clean; 261 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 13 op/s 2020-11-16T22:06:35.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:35 smithi016 bash[10302]: cluster 2020-11-16T22:06:34.038468+0000 mon.a (mon.0) 1019 : cluster [DBG] osdmap e368: 12 total, 12 up, 12 in 2020-11-16T22:06:35.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:35 smithi016 bash[10302]: cluster 2020-11-16T22:06:34.962772+0000 mon.a (mon.0) 1020 : cluster [DBG] osdmap e369: 12 total, 12 up, 12 in 2020-11-16T22:06:35.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:35 smithi195 bash[10218]: cluster 2020-11-16T22:06:33.664439+0000 mgr.x (mgr.24115) 418 : cluster [DBG] pgmap v715: 17 pgs: 17 active+clean; 261 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 13 op/s 2020-11-16T22:06:35.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:35 smithi195 bash[10218]: cluster 2020-11-16T22:06:34.038468+0000 mon.a (mon.0) 1019 : cluster [DBG] osdmap e368: 12 total, 12 up, 12 in 2020-11-16T22:06:35.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:35 smithi195 bash[10218]: cluster 2020-11-16T22:06:34.962772+0000 mon.a (mon.0) 1020 : cluster [DBG] osdmap e369: 12 total, 12 up, 12 in 2020-11-16T22:06:35.406 INFO:tasks.rados.rados.2.smithi057.stdout:1273: done (5 left) 2020-11-16T22:06:35.406 INFO:tasks.rados.rados.2.smithi057.stdout:1274: done (4 left) 2020-11-16T22:06:35.406 INFO:tasks.rados.rados.2.smithi057.stdout:1275: done (3 left) 2020-11-16T22:06:35.407 INFO:tasks.rados.rados.2.smithi057.stdout:1278: done (2 left) 2020-11-16T22:06:35.407 INFO:tasks.rados.rados.2.smithi057.stdout:1279: done (1 left) 2020-11-16T22:06:35.407 INFO:tasks.rados.rados.2.smithi057.stdout:1280: done (0 left) 2020-11-16T22:06:35.407 INFO:tasks.rados.rados.2.smithi057.stdout:1281: copy_from oid 12 from oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 150 2020-11-16T22:06:35.407 INFO:tasks.rados.rados.2.smithi057.stdout:1282: snap_remove snap 149 2020-11-16T22:06:35.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:35 smithi057 bash[10301]: cluster 2020-11-16T22:06:33.664439+0000 mgr.x (mgr.24115) 418 : cluster [DBG] pgmap v715: 17 pgs: 17 active+clean; 261 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 13 op/s 2020-11-16T22:06:35.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:35 smithi057 bash[10301]: cluster 2020-11-16T22:06:34.038468+0000 mon.a (mon.0) 1019 : cluster [DBG] osdmap e368: 12 total, 12 up, 12 in 2020-11-16T22:06:35.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:35 smithi057 bash[10301]: cluster 2020-11-16T22:06:34.962772+0000 mon.a (mon.0) 1020 : cluster [DBG] osdmap e369: 12 total, 12 up, 12 in 2020-11-16T22:06:36.041 INFO:tasks.rados.rados.2.smithi057.stdout:1282: done (1 left) 2020-11-16T22:06:36.041 INFO:tasks.rados.rados.2.smithi057.stdout:1283: read oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:36.041 INFO:tasks.rados.rados.2.smithi057.stdout:1283: expect (ObjNum 440 snap 148 seq_num 440) 2020-11-16T22:06:36.041 INFO:tasks.rados.rados.2.smithi057.stdout:1284: write oid 38 current snap is 150 2020-11-16T22:06:36.041 INFO:tasks.rados.rados.2.smithi057.stdout:1284: seq_num 448 ranges {729536=460026,1749580=611149,2853383=452450} 2020-11-16T22:06:36.052 INFO:tasks.rados.rados.2.smithi057.stdout:1284: writing smithi05720651-38 from 729536 to 1189562 tid 1 2020-11-16T22:06:36.060 INFO:tasks.rados.rados.2.smithi057.stdout:1284: writing smithi05720651-38 from 1749580 to 2360729 tid 2 2020-11-16T22:06:36.066 INFO:tasks.rados.rados.2.smithi057.stdout:1284: writing smithi05720651-38 from 2853383 to 3305833 tid 3 2020-11-16T22:06:36.066 INFO:tasks.rados.rados.2.smithi057.stdout:1285: read oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:36.066 INFO:tasks.rados.rados.2.smithi057.stdout:1285: expect (ObjNum 416 snap 140 seq_num 416) 2020-11-16T22:06:36.066 INFO:tasks.rados.rados.2.smithi057.stdout:1286: rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 150 2020-11-16T22:06:36.066 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 147 2020-11-16T22:06:36.067 INFO:tasks.rados.rados.2.smithi057.stdout:1281: finishing copy_from to smithi05720651-12 2020-11-16T22:06:36.067 INFO:tasks.rados.rados.2.smithi057.stdout:1281: got expected ENOENT (src dne) 2020-11-16T22:06:36.067 INFO:tasks.rados.rados.2.smithi057.stdout:1281: finishing copy_from racing read to smithi05720651-12 2020-11-16T22:06:36.067 INFO:tasks.rados.rados.2.smithi057.stdout:1283: expect (ObjNum 440 snap 148 seq_num 440) 2020-11-16T22:06:36.212 INFO:tasks.rados.rados.2.smithi057.stdout:1284: finishing write tid 1 to smithi05720651-38 2020-11-16T22:06:36.212 INFO:tasks.rados.rados.2.smithi057.stdout:1284: finishing write tid 2 to smithi05720651-38 2020-11-16T22:06:36.212 INFO:tasks.rados.rados.2.smithi057.stdout:1281: done (4 left) 2020-11-16T22:06:36.213 INFO:tasks.rados.rados.2.smithi057.stdout:1283: done (3 left) 2020-11-16T22:06:36.213 INFO:tasks.rados.rados.2.smithi057.stdout:1287: snap_remove snap 125 2020-11-16T22:06:37.042 INFO:tasks.rados.rados.2.smithi057.stdout:1287: done (3 left) 2020-11-16T22:06:37.042 INFO:tasks.rados.rados.2.smithi057.stdout:1288: snap_remove snap 136 2020-11-16T22:06:37.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:37 smithi016 bash[10302]: cluster 2020-11-16T22:06:35.665171+0000 mgr.x (mgr.24115) 419 : cluster [DBG] pgmap v718: 17 pgs: 17 active+clean; 261 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 801 KiB/s wr, 14 op/s 2020-11-16T22:06:37.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:37 smithi016 bash[10302]: cluster 2020-11-16T22:06:36.049549+0000 mon.a (mon.0) 1021 : cluster [DBG] osdmap e370: 12 total, 12 up, 12 in 2020-11-16T22:06:37.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:37 smithi195 bash[10218]: cluster 2020-11-16T22:06:35.665171+0000 mgr.x (mgr.24115) 419 : cluster [DBG] pgmap v718: 17 pgs: 17 active+clean; 261 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 801 KiB/s wr, 14 op/s 2020-11-16T22:06:37.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:37 smithi195 bash[10218]: cluster 2020-11-16T22:06:36.049549+0000 mon.a (mon.0) 1021 : cluster [DBG] osdmap e370: 12 total, 12 up, 12 in 2020-11-16T22:06:37.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:37 smithi057 bash[10301]: cluster 2020-11-16T22:06:35.665171+0000 mgr.x (mgr.24115) 419 : cluster [DBG] pgmap v718: 17 pgs: 17 active+clean; 261 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 801 KiB/s wr, 14 op/s 2020-11-16T22:06:37.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:37 smithi057 bash[10301]: cluster 2020-11-16T22:06:36.049549+0000 mon.a (mon.0) 1021 : cluster [DBG] osdmap e370: 12 total, 12 up, 12 in 2020-11-16T22:06:38.064 INFO:tasks.rados.rados.2.smithi057.stdout:1288: done (3 left) 2020-11-16T22:06:38.065 INFO:tasks.rados.rados.2.smithi057.stdout:1289: read oid 12 snap -1 2020-11-16T22:06:38.065 INFO:tasks.rados.rados.2.smithi057.stdout:1289: expect (ObjNum 438 snap 147 seq_num 438) 2020-11-16T22:06:38.065 INFO:tasks.rados.rados.2.smithi057.stdout:1290: delete oid 46 current snap is 150 2020-11-16T22:06:38.065 INFO:tasks.rados.rados.2.smithi057.stdout:1284: finishing write tid 3 to smithi05720651-38 2020-11-16T22:06:38.065 INFO:tasks.rados.rados.2.smithi057.stdout:1284: finishing write tid 5 to smithi05720651-38 2020-11-16T22:06:38.065 INFO:tasks.rados.rados.2.smithi057.stdout:1284: finishing write tid 6 to smithi05720651-38 2020-11-16T22:06:38.066 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 1085 (ObjNum 448 snap 150 seq_num 448) dirty exists 2020-11-16T22:06:38.066 INFO:tasks.rados.rados.2.smithi057.stdout:1284: left oid 38 (ObjNum 448 snap 150 seq_num 448) 2020-11-16T22:06:38.066 INFO:tasks.rados.rados.2.smithi057.stdout:1286: finishing rollback tid 0 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:38.066 INFO:tasks.rados.rados.2.smithi057.stdout:1285: expect (ObjNum 416 snap 140 seq_num 416) 2020-11-16T22:06:38.281 INFO:tasks.rados.rados.2.smithi057.stdout:1286: finishing rollback tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:38.281 INFO:tasks.rados.rados.2.smithi057.stdout:1286: finishing rollback tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:38.281 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 967 (ObjNum 436 snap 145 seq_num 436) dirty exists 2020-11-16T22:06:38.282 INFO:tasks.rados.rados.2.smithi057.stdout:1289: expect (ObjNum 438 snap 147 seq_num 438) 2020-11-16T22:06:38.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:38 smithi016 bash[10302]: cluster 2020-11-16T22:06:37.053545+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e371: 12 total, 12 up, 12 in 2020-11-16T22:06:38.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:38 smithi195 bash[10218]: cluster 2020-11-16T22:06:37.053545+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e371: 12 total, 12 up, 12 in 2020-11-16T22:06:38.380 INFO:tasks.rados.rados.2.smithi057.stdout:1284: done (4 left) 2020-11-16T22:06:38.380 INFO:tasks.rados.rados.2.smithi057.stdout:1285: done (3 left) 2020-11-16T22:06:38.380 INFO:tasks.rados.rados.2.smithi057.stdout:1286: done (2 left) 2020-11-16T22:06:38.380 INFO:tasks.rados.rados.2.smithi057.stdout:1289: done (1 left) 2020-11-16T22:06:38.380 INFO:tasks.rados.rados.2.smithi057.stdout:1290: done (0 left) 2020-11-16T22:06:38.380 INFO:tasks.rados.rados.2.smithi057.stdout:1291: read oid 10 snap -1 2020-11-16T22:06:38.381 INFO:tasks.rados.rados.2.smithi057.stdout:1291: expect (ObjNum 112 snap 34 seq_num 112) 2020-11-16T22:06:38.381 INFO:tasks.rados.rados.2.smithi057.stdout:1292: snap_remove snap 145 2020-11-16T22:06:38.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:38 smithi057 bash[10301]: cluster 2020-11-16T22:06:37.053545+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e371: 12 total, 12 up, 12 in 2020-11-16T22:06:39.070 INFO:tasks.rados.rados.2.smithi057.stdout:1292: done (1 left) 2020-11-16T22:06:39.070 INFO:tasks.rados.rados.2.smithi057.stdout:1293: copy_from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 40 current snap is 150 2020-11-16T22:06:39.070 INFO:tasks.rados.rados.2.smithi057.stdout:1291: expect (ObjNum 112 snap 34 seq_num 112) 2020-11-16T22:06:39.197 INFO:tasks.rados.rados.2.smithi057.stdout:1293: finishing copy_from to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:39.198 INFO:tasks.rados.rados.2.smithi057.stdout:1293: got expected ENOENT (src dne) 2020-11-16T22:06:39.198 INFO:tasks.rados.rados.2.smithi057.stdout:1293: finishing copy_from racing read to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:39.198 INFO:tasks.rados.rados.2.smithi057.stdout:1291: done (1 left) 2020-11-16T22:06:39.198 INFO:tasks.rados.rados.2.smithi057.stdout:1293: done (0 left) 2020-11-16T22:06:39.198 INFO:tasks.rados.rados.2.smithi057.stdout:1294: write (excl) oid 32 current snap is 150 2020-11-16T22:06:39.198 INFO:tasks.rados.rados.2.smithi057.stdout:1294: seq_num 450 ranges {763150=726877,1982897=614818,3024582=474994} 2020-11-16T22:06:39.215 INFO:tasks.rados.rados.2.smithi057.stdout:1294: writing smithi05720651-32 from 763150 to 1490027 tid 1 2020-11-16T22:06:39.221 INFO:tasks.rados.rados.2.smithi057.stdout:1294: writing smithi05720651-32 from 1982897 to 2597715 tid 2 2020-11-16T22:06:39.226 INFO:tasks.rados.rados.2.smithi057.stdout:1294: writing smithi05720651-32 from 3024582 to 3499576 tid 3 2020-11-16T22:06:39.227 INFO:tasks.rados.rados.2.smithi057.stdout:1295: snap_create 2020-11-16T22:06:39.227 INFO:tasks.rados.rados.2.smithi057.stdout:1294: finishing write tid 1 to smithi05720651-32 2020-11-16T22:06:39.232 INFO:tasks.rados.rados.2.smithi057.stdout:1294: finishing write tid 2 to smithi05720651-32 2020-11-16T22:06:39.233 INFO:tasks.rados.rados.2.smithi057.stdout:1294: finishing write tid 3 to smithi05720651-32 2020-11-16T22:06:39.233 INFO:tasks.rados.rados.2.smithi057.stdout:1294: finishing write tid 5 to smithi05720651-32 2020-11-16T22:06:39.234 INFO:tasks.rados.rados.2.smithi057.stdout:1294: finishing write tid 6 to smithi05720651-32 2020-11-16T22:06:39.234 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 1290 (ObjNum 450 snap 150 seq_num 450) dirty exists 2020-11-16T22:06:39.234 INFO:tasks.rados.rados.2.smithi057.stdout:1294: left oid 32 (ObjNum 450 snap 150 seq_num 450) 2020-11-16T22:06:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:39 smithi016 bash[10302]: cluster 2020-11-16T22:06:37.665836+0000 mgr.x (mgr.24115) 420 : cluster [DBG] pgmap v721: 17 pgs: 17 active+clean; 258 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2020-11-16T22:06:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:39 smithi016 bash[10302]: cluster 2020-11-16T22:06:38.069956+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e372: 12 total, 12 up, 12 in 2020-11-16T22:06:39.337 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 22:06:39 smithi016 bash[15120]: debug 2020-11-16T22:06:39.299+0000 7f8fc6db9700 -1 osd.5 pg_epoch: 373 pg[2.3( v 373'1138 (0'0,373'1138] local-lis/les=71/72 n=16 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [5,2] r=0 lpr=71 luod=373'1136 crt=373'1138 lcod 373'1134 mlcod 373'1134 active+clean+snaptrim trimq=[107~1,119~1] ps=[f1~1,ff~1,104~1,112~1,121~2]] removing snap head 2020-11-16T22:06:39.349 INFO:journalctl@ceph.osd.2.smithi195.stdout:Nov 16 22:06:39 smithi195 bash[21024]: debug 2020-11-16T22:06:39.291+0000 7f3c19f37700 -1 osd.2 pg_epoch: 373 pg[2.e( v 371'332 (0'0,371'332] local-lis/les=71/72 n=6 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [2,3] r=0 lpr=71 crt=371'332 lcod 371'330 mlcod 371'330 active+clean+snaptrim trimq=[107~1,119~1] ps=[f1~1,ff~1,104~1,112~1,121~2]] removing snap head 2020-11-16T22:06:39.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:39 smithi195 bash[10218]: cluster 2020-11-16T22:06:37.665836+0000 mgr.x (mgr.24115) 420 : cluster [DBG] pgmap v721: 17 pgs: 17 active+clean; 258 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2020-11-16T22:06:39.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:39 smithi195 bash[10218]: cluster 2020-11-16T22:06:38.069956+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e372: 12 total, 12 up, 12 in 2020-11-16T22:06:39.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:39 smithi057 bash[10301]: cluster 2020-11-16T22:06:37.665836+0000 mgr.x (mgr.24115) 420 : cluster [DBG] pgmap v721: 17 pgs: 17 active+clean; 258 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2020-11-16T22:06:39.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:39 smithi057 bash[10301]: cluster 2020-11-16T22:06:38.069956+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e372: 12 total, 12 up, 12 in 2020-11-16T22:06:39.954 INFO:tasks.rados.rados.2.smithi057.stdout:1294: done (1 left) 2020-11-16T22:06:39.955 INFO:tasks.rados.rados.2.smithi057.stdout:1295: done (0 left) 2020-11-16T22:06:39.955 INFO:tasks.rados.rados.2.smithi057.stdout:1296: delete oid 38 current snap is 151 2020-11-16T22:06:40.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:40 smithi016 bash[10302]: cluster 2020-11-16T22:06:39.080147+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e373: 12 total, 12 up, 12 in 2020-11-16T22:06:40.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:40 smithi016 bash[10302]: cluster 2020-11-16T22:06:39.964417+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e374: 12 total, 12 up, 12 in 2020-11-16T22:06:40.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:40 smithi195 bash[10218]: cluster 2020-11-16T22:06:39.080147+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e373: 12 total, 12 up, 12 in 2020-11-16T22:06:40.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:40 smithi195 bash[10218]: cluster 2020-11-16T22:06:39.964417+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e374: 12 total, 12 up, 12 in 2020-11-16T22:06:40.389 INFO:tasks.rados.rados.2.smithi057.stdout:1296: done (0 left) 2020-11-16T22:06:40.389 INFO:tasks.rados.rados.2.smithi057.stdout:1297: delete oid 26 current snap is 151 2020-11-16T22:06:40.398 INFO:tasks.rados.rados.2.smithi057.stdout:1297: done (0 left) 2020-11-16T22:06:40.398 INFO:tasks.rados.rados.2.smithi057.stdout:1298: copy_from oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 151 2020-11-16T22:06:40.398 INFO:tasks.rados.rados.2.smithi057.stdout:1299: read oid 6 snap 121 2020-11-16T22:06:40.399 INFO:tasks.rados.rados.2.smithi057.stdout:1299: expect (ObjNum 355 snap 118 seq_num 355) 2020-11-16T22:06:40.399 INFO:tasks.rados.rados.2.smithi057.stdout:1300: rollback oid 42 current snap is 151 2020-11-16T22:06:40.399 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 42 to 150 2020-11-16T22:06:40.399 INFO:tasks.rados.rados.2.smithi057.stdout:1301: copy_from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 151 2020-11-16T22:06:40.399 INFO:tasks.rados.rados.2.smithi057.stdout:1302: snap_remove snap 147 2020-11-16T22:06:40.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:40 smithi057 bash[10301]: cluster 2020-11-16T22:06:39.080147+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e373: 12 total, 12 up, 12 in 2020-11-16T22:06:40.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:40 smithi057 bash[10301]: cluster 2020-11-16T22:06:39.964417+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e374: 12 total, 12 up, 12 in 2020-11-16T22:06:41.081 INFO:tasks.rados.rados.2.smithi057.stdout:1302: done (4 left) 2020-11-16T22:06:41.081 INFO:tasks.rados.rados.2.smithi057.stdout:1303: snap_remove snap 144 2020-11-16T22:06:41.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:41 smithi016 bash[10302]: cluster 2020-11-16T22:06:39.666558+0000 mgr.x (mgr.24115) 421 : cluster [DBG] pgmap v724: 17 pgs: 17 active+clean; 258 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 348 KiB/s wr, 3 op/s 2020-11-16T22:06:41.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:41 smithi195 bash[10218]: cluster 2020-11-16T22:06:39.666558+0000 mgr.x (mgr.24115) 421 : cluster [DBG] pgmap v724: 17 pgs: 17 active+clean; 258 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 348 KiB/s wr, 3 op/s 2020-11-16T22:06:41.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:41 smithi057 bash[10301]: cluster 2020-11-16T22:06:39.666558+0000 mgr.x (mgr.24115) 421 : cluster [DBG] pgmap v724: 17 pgs: 17 active+clean; 258 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 348 KiB/s wr, 3 op/s 2020-11-16T22:06:42.098 INFO:tasks.rados.rados.2.smithi057.stdout:1303: done (4 left) 2020-11-16T22:06:42.099 INFO:tasks.rados.rados.2.smithi057.stdout:1304: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:42.099 INFO:tasks.rados.rados.2.smithi057.stdout:1304: expect (ObjNum 322 snap 111 seq_num 322) 2020-11-16T22:06:42.099 INFO:tasks.rados.rados.2.smithi057.stdout:1305: write oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 151 2020-11-16T22:06:42.099 INFO:tasks.rados.rados.2.smithi057.stdout:1305: seq_num 453 ranges {413571=552624,1641990=762145,2990498=425163} 2020-11-16T22:06:42.110 INFO:tasks.rados.rados.2.smithi057.stdout:1305: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 413571 to 966195 tid 1 2020-11-16T22:06:42.119 INFO:tasks.rados.rados.2.smithi057.stdout:1305: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1641990 to 2404135 tid 2 2020-11-16T22:06:42.125 INFO:tasks.rados.rados.2.smithi057.stdout:1305: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2990498 to 3415661 tid 3 2020-11-16T22:06:42.125 INFO:tasks.rados.rados.2.smithi057.stdout:1306: copy_from oid 50 from oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 151 2020-11-16T22:06:42.125 INFO:tasks.rados.rados.2.smithi057.stdout:1300: finishing rollback tid 0 to smithi05720651-42 2020-11-16T22:06:42.125 INFO:tasks.rados.rados.2.smithi057.stdout:1307: delete oid 18 current snap is 151 2020-11-16T22:06:42.126 INFO:tasks.rados.rados.2.smithi057.stdout:1300: finishing rollback tid 1 to smithi05720651-42 2020-11-16T22:06:42.126 INFO:tasks.rados.rados.2.smithi057.stdout:1300: finishing rollback tid 2 to smithi05720651-42 2020-11-16T22:06:42.126 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 970 (ObjNum 420 snap 141 seq_num 420) dirty exists 2020-11-16T22:06:42.126 INFO:tasks.rados.rados.2.smithi057.stdout:1299: expect (ObjNum 355 snap 118 seq_num 355) 2020-11-16T22:06:42.287 INFO:tasks.rados.rados.2.smithi057.stdout:1301: finishing copy_from to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:42.288 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1077 (ObjNum 396 snap 132 seq_num 396) dirty exists 2020-11-16T22:06:42.288 INFO:tasks.rados.rados.2.smithi057.stdout:1301: finishing copy_from racing read to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:42.288 INFO:tasks.rados.rados.2.smithi057.stdout:1298: finishing copy_from to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:42.288 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 960 (ObjNum 415 snap 140 seq_num 415) dirty exists 2020-11-16T22:06:42.288 INFO:tasks.rados.rados.2.smithi057.stdout:1298: finishing copy_from racing read to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:42.289 INFO:tasks.rados.rados.2.smithi057.stdout:1304: expect (ObjNum 322 snap 111 seq_num 322) 2020-11-16T22:06:42.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:42 smithi016 bash[10302]: cluster 2020-11-16T22:06:41.091730+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e375: 12 total, 12 up, 12 in 2020-11-16T22:06:42.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:42 smithi195 bash[10218]: cluster 2020-11-16T22:06:41.091730+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e375: 12 total, 12 up, 12 in 2020-11-16T22:06:42.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:42 smithi057 bash[10301]: cluster 2020-11-16T22:06:41.091730+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e375: 12 total, 12 up, 12 in 2020-11-16T22:06:42.479 INFO:tasks.rados.rados.2.smithi057.stdout:1305: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:42.479 INFO:tasks.rados.rados.2.smithi057.stdout:1305: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:42.480 INFO:tasks.rados.rados.2.smithi057.stdout:1305: finishing write tid 3 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:42.480 INFO:tasks.rados.rados.2.smithi057.stdout:1306: finishing copy_from to smithi05720651-50 2020-11-16T22:06:42.480 INFO:tasks.rados.rados.2.smithi057.stdout:1306: got expected ENOENT (src dne) 2020-11-16T22:06:42.480 INFO:tasks.rados.rados.2.smithi057.stdout:1306: finishing copy_from racing read to smithi05720651-50 2020-11-16T22:06:42.480 INFO:tasks.rados.rados.2.smithi057.stdout:1298: done (7 left) 2020-11-16T22:06:42.480 INFO:tasks.rados.rados.2.smithi057.stdout:1299: done (6 left) 2020-11-16T22:06:42.481 INFO:tasks.rados.rados.2.smithi057.stdout:1300: done (5 left) 2020-11-16T22:06:42.481 INFO:tasks.rados.rados.2.smithi057.stdout:1301: done (4 left) 2020-11-16T22:06:42.481 INFO:tasks.rados.rados.2.smithi057.stdout:1304: done (3 left) 2020-11-16T22:06:42.481 INFO:tasks.rados.rados.2.smithi057.stdout:1306: done (2 left) 2020-11-16T22:06:42.481 INFO:tasks.rados.rados.2.smithi057.stdout:1307: done (1 left) 2020-11-16T22:06:42.482 INFO:tasks.rados.rados.2.smithi057.stdout:1308: rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 151 2020-11-16T22:06:42.482 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 150 2020-11-16T22:06:42.482 INFO:tasks.rados.rados.2.smithi057.stdout:1309: snap_create 2020-11-16T22:06:42.482 INFO:tasks.rados.rados.2.smithi057.stdout:1308: finishing rollback tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:42.483 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 129 snap 0 seq_num 2930028416) dirty dne 2020-11-16T22:06:42.677 INFO:tasks.rados.rados.2.smithi057.stdout:1305: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:42.678 INFO:tasks.rados.rados.2.smithi057.stdout:1305: finishing write tid 6 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:42.678 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 85 (ObjNum 453 snap 151 seq_num 453) dirty exists 2020-11-16T22:06:42.678 INFO:tasks.rados.rados.2.smithi057.stdout:1305: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 453 snap 151 seq_num 453) 2020-11-16T22:06:43.101 INFO:tasks.rados.rados.2.smithi057.stdout:1305: done (2 left) 2020-11-16T22:06:43.102 INFO:tasks.rados.rados.2.smithi057.stdout:1308: done (1 left) 2020-11-16T22:06:43.102 INFO:tasks.rados.rados.2.smithi057.stdout:1309: done (0 left) 2020-11-16T22:06:43.102 INFO:tasks.rados.rados.2.smithi057.stdout:1310: snap_remove snap 121 2020-11-16T22:06:43.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:43 smithi057 bash[10301]: cluster 2020-11-16T22:06:41.667354+0000 mgr.x (mgr.24115) 422 : cluster [DBG] pgmap v727: 17 pgs: 17 active+clean; 225 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 816 KiB/s wr, 18 op/s 2020-11-16T22:06:43.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:43 smithi057 bash[10301]: cluster 2020-11-16T22:06:42.109008+0000 mon.a (mon.0) 1027 : cluster [DBG] osdmap e376: 12 total, 12 up, 12 in 2020-11-16T22:06:43.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:43 smithi016 bash[10302]: cluster 2020-11-16T22:06:41.667354+0000 mgr.x (mgr.24115) 422 : cluster [DBG] pgmap v727: 17 pgs: 17 active+clean; 225 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 816 KiB/s wr, 18 op/s 2020-11-16T22:06:43.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:43 smithi016 bash[10302]: cluster 2020-11-16T22:06:42.109008+0000 mon.a (mon.0) 1027 : cluster [DBG] osdmap e376: 12 total, 12 up, 12 in 2020-11-16T22:06:43.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:43 smithi195 bash[10218]: cluster 2020-11-16T22:06:41.667354+0000 mgr.x (mgr.24115) 422 : cluster [DBG] pgmap v727: 17 pgs: 17 active+clean; 225 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 816 KiB/s wr, 18 op/s 2020-11-16T22:06:43.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:43 smithi195 bash[10218]: cluster 2020-11-16T22:06:42.109008+0000 mon.a (mon.0) 1027 : cluster [DBG] osdmap e376: 12 total, 12 up, 12 in 2020-11-16T22:06:44.121 INFO:tasks.rados.rados.2.smithi057.stdout:1310: done (0 left) 2020-11-16T22:06:44.121 INFO:tasks.rados.rados.2.smithi057.stdout:1311: read oid 6 snap -1 2020-11-16T22:06:44.121 INFO:tasks.rados.rados.2.smithi057.stdout:1311: expect (ObjNum 429 snap 144 seq_num 429) 2020-11-16T22:06:44.121 INFO:tasks.rados.rados.2.smithi057.stdout:1312: read oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:44.122 INFO:tasks.rados.rados.2.smithi057.stdout:1312: expect (ObjNum 416 snap 140 seq_num 416) 2020-11-16T22:06:44.122 INFO:tasks.rados.rados.2.smithi057.stdout:1313: write (excl) oid 20 current snap is 152 2020-11-16T22:06:44.122 INFO:tasks.rados.rados.2.smithi057.stdout:1313: seq_num 455 ranges {447185=703122,1642601=765814,2928991=447707} 2020-11-16T22:06:44.132 INFO:tasks.rados.rados.2.smithi057.stdout:1313: writing smithi05720651-20 from 447185 to 1150307 tid 1 2020-11-16T22:06:44.142 INFO:tasks.rados.rados.2.smithi057.stdout:1313: writing smithi05720651-20 from 1642601 to 2408415 tid 2 2020-11-16T22:06:44.148 INFO:tasks.rados.rados.2.smithi057.stdout:1313: writing smithi05720651-20 from 2928991 to 3376698 tid 3 2020-11-16T22:06:44.148 INFO:tasks.rados.rados.2.smithi057.stdout:1314: snap_create 2020-11-16T22:06:44.149 INFO:tasks.rados.rados.2.smithi057.stdout:1311: expect (ObjNum 429 snap 144 seq_num 429) 2020-11-16T22:06:44.287 INFO:tasks.rados.rados.2.smithi057.stdout:1313: finishing write tid 1 to smithi05720651-20 2020-11-16T22:06:44.287 INFO:tasks.rados.rados.2.smithi057.stdout:1312: expect (ObjNum 416 snap 140 seq_num 416) 2020-11-16T22:06:44.389 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:44 smithi057 bash[10301]: cluster 2020-11-16T22:06:43.110827+0000 mon.a (mon.0) 1028 : cluster [DBG] osdmap e377: 12 total, 12 up, 12 in 2020-11-16T22:06:44.396 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:44 smithi016 bash[10302]: cluster 2020-11-16T22:06:43.110827+0000 mon.a (mon.0) 1028 : cluster [DBG] osdmap e377: 12 total, 12 up, 12 in 2020-11-16T22:06:44.500 INFO:tasks.rados.rados.2.smithi057.stdout:1313: finishing write tid 2 to smithi05720651-20 2020-11-16T22:06:44.501 INFO:tasks.rados.rados.2.smithi057.stdout:1313: finishing write tid 3 to smithi05720651-20 2020-11-16T22:06:44.501 INFO:tasks.rados.rados.2.smithi057.stdout:1313: finishing write tid 5 to smithi05720651-20 2020-11-16T22:06:44.501 INFO:tasks.rados.rados.2.smithi057.stdout:1313: finishing write tid 6 to smithi05720651-20 2020-11-16T22:06:44.501 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1065 (ObjNum 455 snap 152 seq_num 455) dirty exists 2020-11-16T22:06:44.501 INFO:tasks.rados.rados.2.smithi057.stdout:1313: left oid 20 (ObjNum 455 snap 152 seq_num 455) 2020-11-16T22:06:44.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:44 smithi195 bash[10218]: cluster 2020-11-16T22:06:43.110827+0000 mon.a (mon.0) 1028 : cluster [DBG] osdmap e377: 12 total, 12 up, 12 in 2020-11-16T22:06:44.695 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:06:44 smithi057 bash[12595]: debug 2020-11-16T22:06:44.399+0000 7f737919c700 -1 osd.8 pg_epoch: 378 pg[2.5( v 378'824 (0'0,378'824] local-lis/les=71/72 n=9 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,0] r=0 lpr=71 luod=376'822 crt=378'824 lcod 375'820 mlcod 375'820 active+clean+snaptrim trimq=[ec~1] ps=[f1~1,107~1,112~1,118~2,11f~1,122~1]] removing snap head 2020-11-16T22:06:44.696 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:06:44 smithi057 bash[12595]: debug 2020-11-16T22:06:44.407+0000 7f737d1a4700 -1 osd.8 pg_epoch: 378 pg[2.5( v 378'830 (0'0,378'830] local-lis/les=71/72 n=5 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,0] r=0 lpr=71 crt=378'830 lcod 378'828 mlcod 378'828 active+clean+snaptrim trimq=[ec~1] ps=[f1~1,107~1,112~1,118~2,11f~1,122~1]] removing snap head 2020-11-16T22:06:44.837 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:06:44 smithi016 bash[19825]: debug 2020-11-16T22:06:44.402+0000 7f0e16c22700 -1 osd.7 pg_epoch: 378 pg[2.8( v 378'1079 (0'0,378'1079] local-lis/les=71/72 n=8 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [7,9] r=0 lpr=71 luod=378'1077 crt=378'1079 lcod 378'1075 mlcod 378'1075 active+clean+snaptrim trimq=[ec~1] ps=[f1~1,107~1,112~1,118~2,11f~1,122~1]] removing snap head 2020-11-16T22:06:44.837 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:06:44 smithi016 bash[19825]: debug 2020-11-16T22:06:44.406+0000 7f0e12c1a700 -1 osd.7 pg_epoch: 378 pg[2.8( v 378'1081 (0'0,378'1081] local-lis/les=71/72 n=6 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [7,9] r=0 lpr=71 crt=378'1081 lcod 378'1079 mlcod 378'1079 active+clean+snaptrim trimq=[ec~1] ps=[f1~1,107~1,112~1,118~2,11f~1,122~1]] removing snap head 2020-11-16T22:06:44.960 INFO:tasks.rados.rados.2.smithi057.stdout:1311: done (3 left) 2020-11-16T22:06:44.960 INFO:tasks.rados.rados.2.smithi057.stdout:1312: done (2 left) 2020-11-16T22:06:44.960 INFO:tasks.rados.rados.2.smithi057.stdout:1313: done (1 left) 2020-11-16T22:06:44.960 INFO:tasks.rados.rados.2.smithi057.stdout:1314: done (0 left) 2020-11-16T22:06:44.961 INFO:tasks.rados.rados.2.smithi057.stdout:1315: write oid 50 current snap is 153 2020-11-16T22:06:44.961 INFO:tasks.rados.rados.2.smithi057.stdout:1315: seq_num 456 ranges {463992=778371,1701083=625825,2956414=658979} 2020-11-16T22:06:44.972 INFO:tasks.rados.rados.2.smithi057.stdout:1315: writing smithi05720651-50 from 463992 to 1242363 tid 1 2020-11-16T22:06:44.978 INFO:tasks.rados.rados.2.smithi057.stdout:1315: writing smithi05720651-50 from 1701083 to 2326908 tid 2 2020-11-16T22:06:44.985 INFO:tasks.rados.rados.2.smithi057.stdout:1315: writing smithi05720651-50 from 2956414 to 3615393 tid 3 2020-11-16T22:06:44.986 INFO:tasks.rados.rados.2.smithi057.stdout:1316: delete oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 153 2020-11-16T22:06:44.991 INFO:tasks.rados.rados.2.smithi057.stdout:1315: finishing write tid 1 to smithi05720651-50 2020-11-16T22:06:44.991 INFO:tasks.rados.rados.2.smithi057.stdout:1315: finishing write tid 2 to smithi05720651-50 2020-11-16T22:06:44.993 INFO:tasks.rados.rados.2.smithi057.stdout:1315: finishing write tid 3 to smithi05720651-50 2020-11-16T22:06:44.994 INFO:tasks.rados.rados.2.smithi057.stdout:1315: finishing write tid 5 to smithi05720651-50 2020-11-16T22:06:44.994 INFO:tasks.rados.rados.2.smithi057.stdout:1316: done (1 left) 2020-11-16T22:06:44.994 INFO:tasks.rados.rados.2.smithi057.stdout:1317: delete oid 18 current snap is 153 2020-11-16T22:06:44.994 INFO:tasks.rados.rados.2.smithi057.stdout:1315: finishing write tid 6 to smithi05720651-50 2020-11-16T22:06:44.994 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 1165 (ObjNum 456 snap 153 seq_num 456) dirty exists 2020-11-16T22:06:44.995 INFO:tasks.rados.rados.2.smithi057.stdout:1315: left oid 50 (ObjNum 456 snap 153 seq_num 456) 2020-11-16T22:06:44.999 INFO:tasks.rados.rados.2.smithi057.stdout:1315: done (1 left) 2020-11-16T22:06:45.000 INFO:tasks.rados.rados.2.smithi057.stdout:1317: done (0 left) 2020-11-16T22:06:45.000 INFO:tasks.rados.rados.2.smithi057.stdout:1318: delete oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 153 2020-11-16T22:06:45.004 INFO:tasks.rados.rados.2.smithi057.stdout:1318: done (0 left) 2020-11-16T22:06:45.005 INFO:tasks.rados.rados.2.smithi057.stdout:1319: write (excl) oid 12 current snap is 153 2020-11-16T22:06:45.005 INFO:tasks.rados.rados.2.smithi057.stdout:1319: seq_num 460 ranges {531220=795720,1935011=516810,3066106=420420} 2020-11-16T22:06:45.016 INFO:tasks.rados.rados.2.smithi057.stdout:1319: writing smithi05720651-12 from 531220 to 1326940 tid 1 2020-11-16T22:06:45.023 INFO:tasks.rados.rados.2.smithi057.stdout:1319: writing smithi05720651-12 from 1935011 to 2451821 tid 2 2020-11-16T22:06:45.029 INFO:tasks.rados.rados.2.smithi057.stdout:1319: writing smithi05720651-12 from 3066106 to 3486526 tid 3 2020-11-16T22:06:45.030 INFO:tasks.rados.rados.2.smithi057.stdout:1320: read oid 32 snap -1 2020-11-16T22:06:45.030 INFO:tasks.rados.rados.2.smithi057.stdout:1320: expect (ObjNum 450 snap 150 seq_num 450) 2020-11-16T22:06:45.030 INFO:tasks.rados.rados.2.smithi057.stdout:1321: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:45.030 INFO:tasks.rados.rados.2.smithi057.stdout:1321: expect (ObjNum 408 snap 137 seq_num 408) 2020-11-16T22:06:45.030 INFO:tasks.rados.rados.2.smithi057.stdout:1322: write oid 38 current snap is 153 2020-11-16T22:06:45.030 INFO:tasks.rados.rados.2.smithi057.stdout:1322: seq_num 461 ranges {548027=470969,1593493=776821,3093529=631692} 2020-11-16T22:06:45.035 INFO:tasks.rados.rados.2.smithi057.stdout:1322: writing smithi05720651-38 from 548027 to 1018996 tid 1 2020-11-16T22:06:45.043 INFO:tasks.rados.rados.2.smithi057.stdout:1322: writing smithi05720651-38 from 1593493 to 2370314 tid 2 2020-11-16T22:06:45.051 INFO:tasks.rados.rados.2.smithi057.stdout:1322: writing smithi05720651-38 from 3093529 to 3725221 tid 3 2020-11-16T22:06:45.051 INFO:tasks.rados.rados.2.smithi057.stdout:1323: rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 153 2020-11-16T22:06:45.051 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 151 2020-11-16T22:06:45.052 INFO:tasks.rados.rados.2.smithi057.stdout:1319: finishing write tid 1 to smithi05720651-12 2020-11-16T22:06:45.052 INFO:tasks.rados.rados.2.smithi057.stdout:1324: snap_create 2020-11-16T22:06:45.052 INFO:tasks.rados.rados.2.smithi057.stdout:1319: finishing write tid 2 to smithi05720651-12 2020-11-16T22:06:45.052 INFO:tasks.rados.rados.2.smithi057.stdout:1319: finishing write tid 3 to smithi05720651-12 2020-11-16T22:06:45.052 INFO:tasks.rados.rados.2.smithi057.stdout:1319: finishing write tid 5 to smithi05720651-12 2020-11-16T22:06:45.052 INFO:tasks.rados.rados.2.smithi057.stdout:1319: finishing write tid 6 to smithi05720651-12 2020-11-16T22:06:45.052 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 867 (ObjNum 460 snap 153 seq_num 460) dirty exists 2020-11-16T22:06:45.053 INFO:tasks.rados.rados.2.smithi057.stdout:1319: left oid 12 (ObjNum 460 snap 153 seq_num 460) 2020-11-16T22:06:45.053 INFO:tasks.rados.rados.2.smithi057.stdout:1320: expect (ObjNum 450 snap 150 seq_num 450) 2020-11-16T22:06:45.099 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:06:44 smithi195 bash[18679]: debug 2020-11-16T22:06:44.611+0000 7f994960b700 -1 osd.1 pg_epoch: 378 pg[2.9( v 378'1306 (0'0,378'1306] local-lis/les=71/72 n=15 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,7] r=0 lpr=71 crt=378'1306 lcod 378'1304 mlcod 378'1304 active+clean+snaptrim trimq=[ec~1] ps=[f1~1,107~1,112~1,118~2,11f~1,122~1]] removing snap head 2020-11-16T22:06:45.341 INFO:tasks.rados.rados.2.smithi057.stdout:1322: finishing write tid 1 to smithi05720651-38 2020-11-16T22:06:45.341 INFO:tasks.rados.rados.2.smithi057.stdout:1322: finishing write tid 2 to smithi05720651-38 2020-11-16T22:06:45.341 INFO:tasks.rados.rados.2.smithi057.stdout:1321: expect (ObjNum 408 snap 137 seq_num 408) 2020-11-16T22:06:45.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:45 smithi057 bash[10301]: cluster 2020-11-16T22:06:43.668001+0000 mgr.x (mgr.24115) 423 : cluster [DBG] pgmap v730: 17 pgs: 17 active+clean; 224 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 816 KiB/s wr, 18 op/s 2020-11-16T22:06:45.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:45 smithi057 bash[10301]: cluster 2020-11-16T22:06:44.129579+0000 mon.a (mon.0) 1029 : cluster [DBG] osdmap e378: 12 total, 12 up, 12 in 2020-11-16T22:06:45.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:45 smithi057 bash[10301]: cluster 2020-11-16T22:06:44.966316+0000 mon.a (mon.0) 1030 : cluster [DBG] osdmap e379: 12 total, 12 up, 12 in 2020-11-16T22:06:45.491 INFO:tasks.rados.rados.2.smithi057.stdout:1323: finishing rollback tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:45.491 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 497 snap 0 seq_num 2932741872) dirty dne 2020-11-16T22:06:45.491 INFO:tasks.rados.rados.2.smithi057.stdout:1322: finishing write tid 3 to smithi05720651-38 2020-11-16T22:06:45.491 INFO:tasks.rados.rados.2.smithi057.stdout:1322: finishing write tid 5 to smithi05720651-38 2020-11-16T22:06:45.491 INFO:tasks.rados.rados.2.smithi057.stdout:1322: finishing write tid 6 to smithi05720651-38 2020-11-16T22:06:45.492 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 1090 (ObjNum 461 snap 153 seq_num 461) dirty exists 2020-11-16T22:06:45.492 INFO:tasks.rados.rados.2.smithi057.stdout:1322: left oid 38 (ObjNum 461 snap 153 seq_num 461) 2020-11-16T22:06:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:45 smithi016 bash[10302]: cluster 2020-11-16T22:06:43.668001+0000 mgr.x (mgr.24115) 423 : cluster [DBG] pgmap v730: 17 pgs: 17 active+clean; 224 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 816 KiB/s wr, 18 op/s 2020-11-16T22:06:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:45 smithi016 bash[10302]: cluster 2020-11-16T22:06:44.129579+0000 mon.a (mon.0) 1029 : cluster [DBG] osdmap e378: 12 total, 12 up, 12 in 2020-11-16T22:06:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:45 smithi016 bash[10302]: cluster 2020-11-16T22:06:44.966316+0000 mon.a (mon.0) 1030 : cluster [DBG] osdmap e379: 12 total, 12 up, 12 in 2020-11-16T22:06:45.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:45 smithi195 bash[10218]: cluster 2020-11-16T22:06:43.668001+0000 mgr.x (mgr.24115) 423 : cluster [DBG] pgmap v730: 17 pgs: 17 active+clean; 224 MiB data, 603 MiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 816 KiB/s wr, 18 op/s 2020-11-16T22:06:45.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:45 smithi195 bash[10218]: cluster 2020-11-16T22:06:44.129579+0000 mon.a (mon.0) 1029 : cluster [DBG] osdmap e378: 12 total, 12 up, 12 in 2020-11-16T22:06:45.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:45 smithi195 bash[10218]: cluster 2020-11-16T22:06:44.966316+0000 mon.a (mon.0) 1030 : cluster [DBG] osdmap e379: 12 total, 12 up, 12 in 2020-11-16T22:06:45.968 INFO:tasks.rados.rados.2.smithi057.stdout:1319: done (5 left) 2020-11-16T22:06:45.969 INFO:tasks.rados.rados.2.smithi057.stdout:1320: done (4 left) 2020-11-16T22:06:45.969 INFO:tasks.rados.rados.2.smithi057.stdout:1321: done (3 left) 2020-11-16T22:06:45.969 INFO:tasks.rados.rados.2.smithi057.stdout:1322: done (2 left) 2020-11-16T22:06:45.969 INFO:tasks.rados.rados.2.smithi057.stdout:1323: done (1 left) 2020-11-16T22:06:45.969 INFO:tasks.rados.rados.2.smithi057.stdout:1324: done (0 left) 2020-11-16T22:06:45.970 INFO:tasks.rados.rados.2.smithi057.stdout:1325: read oid 32 snap 153 2020-11-16T22:06:45.970 INFO:tasks.rados.rados.2.smithi057.stdout:1325: expect (ObjNum 450 snap 150 seq_num 450) 2020-11-16T22:06:45.970 INFO:tasks.rados.rados.2.smithi057.stdout:1326: write (excl) oid 12 current snap is 154 2020-11-16T22:06:45.970 INFO:tasks.rados.rados.2.smithi057.stdout:1326: seq_num 462 ranges {564834=546218,1651975=520479,2720952=559317} 2020-11-16T22:06:45.980 INFO:tasks.rados.rados.2.smithi057.stdout:1326: writing smithi05720651-12 from 564834 to 1111052 tid 1 2020-11-16T22:06:45.988 INFO:tasks.rados.rados.2.smithi057.stdout:1326: writing smithi05720651-12 from 1651975 to 2172454 tid 2 2020-11-16T22:06:45.994 INFO:tasks.rados.rados.2.smithi057.stdout:1326: writing smithi05720651-12 from 2720952 to 3280269 tid 3 2020-11-16T22:06:45.995 INFO:tasks.rados.rados.2.smithi057.stdout:1327: rollback oid 14 current snap is 154 2020-11-16T22:06:45.995 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 14 to 153 2020-11-16T22:06:45.995 INFO:tasks.rados.rados.2.smithi057.stdout:1326: finishing write tid 1 to smithi05720651-12 2020-11-16T22:06:45.995 INFO:tasks.rados.rados.2.smithi057.stdout:1326: finishing write tid 2 to smithi05720651-12 2020-11-16T22:06:45.995 INFO:tasks.rados.rados.2.smithi057.stdout:1328: write oid 28 current snap is 154 2020-11-16T22:06:45.995 INFO:tasks.rados.rados.2.smithi057.stdout:1328: seq_num 463 ranges {581641=621467,1994104=780490,3432022=349619} 2020-11-16T22:06:46.001 INFO:tasks.rados.rados.2.smithi057.stdout:1328: writing smithi05720651-28 from 581641 to 1203108 tid 1 2020-11-16T22:06:46.010 INFO:tasks.rados.rados.2.smithi057.stdout:1328: writing smithi05720651-28 from 1994104 to 2774594 tid 2 2020-11-16T22:06:46.016 INFO:tasks.rados.rados.2.smithi057.stdout:1328: writing smithi05720651-28 from 3432022 to 3781641 tid 3 2020-11-16T22:06:46.016 INFO:tasks.rados.rados.2.smithi057.stdout:1329: rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 154 2020-11-16T22:06:46.017 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 150 2020-11-16T22:06:46.017 INFO:tasks.rados.rados.2.smithi057.stdout:1326: finishing write tid 3 to smithi05720651-12 2020-11-16T22:06:46.017 INFO:tasks.rados.rados.2.smithi057.stdout:1326: finishing write tid 5 to smithi05720651-12 2020-11-16T22:06:46.017 INFO:tasks.rados.rados.2.smithi057.stdout:1326: finishing write tid 6 to smithi05720651-12 2020-11-16T22:06:46.017 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 871 (ObjNum 462 snap 154 seq_num 462) dirty exists 2020-11-16T22:06:46.017 INFO:tasks.rados.rados.2.smithi057.stdout:1326: left oid 12 (ObjNum 462 snap 154 seq_num 462) 2020-11-16T22:06:46.018 INFO:tasks.rados.rados.2.smithi057.stdout:1325: expect (ObjNum 450 snap 150 seq_num 450) 2020-11-16T22:06:46.304 INFO:tasks.rados.rados.2.smithi057.stdout:1327: finishing rollback tid 0 to smithi05720651-14 2020-11-16T22:06:46.304 INFO:tasks.rados.rados.2.smithi057.stdout:1327: finishing rollback tid 1 to smithi05720651-14 2020-11-16T22:06:46.304 INFO:tasks.rados.rados.2.smithi057.stdout:1328: finishing write tid 1 to smithi05720651-28 2020-11-16T22:06:46.304 INFO:tasks.rados.rados.2.smithi057.stdout:1325: done (4 left) 2020-11-16T22:06:46.304 INFO:tasks.rados.rados.2.smithi057.stdout:1326: done (3 left) 2020-11-16T22:06:46.304 INFO:tasks.rados.rados.2.smithi057.stdout:1330: rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 154 2020-11-16T22:06:46.305 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 150 2020-11-16T22:06:46.305 INFO:tasks.rados.rados.2.smithi057.stdout:1328: finishing write tid 2 to smithi05720651-28 2020-11-16T22:06:46.305 INFO:tasks.rados.rados.2.smithi057.stdout:1328: finishing write tid 3 to smithi05720651-28 2020-11-16T22:06:46.305 INFO:tasks.rados.rados.2.smithi057.stdout:1328: finishing write tid 5 to smithi05720651-28 2020-11-16T22:06:46.305 INFO:tasks.rados.rados.2.smithi057.stdout:1328: finishing write tid 6 to smithi05720651-28 2020-11-16T22:06:46.305 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 860 (ObjNum 463 snap 154 seq_num 463) dirty exists 2020-11-16T22:06:46.306 INFO:tasks.rados.rados.2.smithi057.stdout:1328: left oid 28 (ObjNum 463 snap 154 seq_num 463) 2020-11-16T22:06:46.306 INFO:tasks.rados.rados.2.smithi057.stdout:1329: finishing rollback tid 0 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:46.306 INFO:tasks.rados.rados.2.smithi057.stdout:1329: finishing rollback tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:46.306 INFO:tasks.rados.rados.2.smithi057.stdout:1329: finishing rollback tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:46.306 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1169 (ObjNum 416 snap 140 seq_num 416) dirty exists 2020-11-16T22:06:46.306 INFO:tasks.rados.rados.2.smithi057.stdout:1328: done (3 left) 2020-11-16T22:06:46.306 INFO:tasks.rados.rados.2.smithi057.stdout:1329: done (2 left) 2020-11-16T22:06:46.307 INFO:tasks.rados.rados.2.smithi057.stdout:1331: write oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 154 2020-11-16T22:06:46.307 INFO:tasks.rados.rados.2.smithi057.stdout:1331: seq_num 464 ranges {598448=413069,1768939=524148,2775798=581861,3781488=16960} 2020-11-16T22:06:46.309 INFO:tasks.rados.rados.2.smithi057.stdout:1331: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 598448 to 1011517 tid 1 2020-11-16T22:06:46.316 INFO:tasks.rados.rados.2.smithi057.stdout:1331: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1768939 to 2293087 tid 2 2020-11-16T22:06:46.322 INFO:tasks.rados.rados.2.smithi057.stdout:1331: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2775798 to 3357659 tid 3 2020-11-16T22:06:46.324 INFO:tasks.rados.rados.2.smithi057.stdout:1331: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3781488 to 3798448 tid 4 2020-11-16T22:06:46.324 INFO:tasks.rados.rados.2.smithi057.stdout:1332: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 154 2020-11-16T22:06:46.325 INFO:tasks.rados.rados.2.smithi057.stdout:1332: seq_num 465 ranges {615255=488318,1827421=784159,3203221=612034} 2020-11-16T22:06:46.330 INFO:tasks.rados.rados.2.smithi057.stdout:1332: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 615255 to 1103573 tid 1 2020-11-16T22:06:46.339 INFO:tasks.rados.rados.2.smithi057.stdout:1332: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1827421 to 2611580 tid 2 2020-11-16T22:06:46.348 INFO:tasks.rados.rados.2.smithi057.stdout:1332: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3203221 to 3815255 tid 3 2020-11-16T22:06:46.349 INFO:tasks.rados.rados.2.smithi057.stdout:1330: finishing rollback tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:46.349 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 129 snap 0 seq_num 2932537616) dirty dne 2020-11-16T22:06:46.349 INFO:tasks.rados.rados.2.smithi057.stdout:1331: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:46.349 INFO:tasks.rados.rados.2.smithi057.stdout:1331: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:46.349 INFO:tasks.rados.rados.2.smithi057.stdout:1333: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:46.349 INFO:tasks.rados.rados.2.smithi057.stdout:1333: expect deleted 2020-11-16T22:06:46.349 INFO:tasks.rados.rados.2.smithi057.stdout:1330: done (4 left) 2020-11-16T22:06:46.350 INFO:tasks.rados.rados.2.smithi057.stdout:1334: write oid 22 current snap is 154 2020-11-16T22:06:46.350 INFO:tasks.rados.rados.2.smithi057.stdout:1334: seq_num 466 ranges {632062=563567,1885903=527817,2830644=720758} 2020-11-16T22:06:46.352 INFO:tasks.rados.rados.2.smithi057.stdout:1334: writing smithi05720651-22 from 632062 to 1195629 tid 1 2020-11-16T22:06:46.359 INFO:tasks.rados.rados.2.smithi057.stdout:1334: writing smithi05720651-22 from 1885903 to 2413720 tid 2 2020-11-16T22:06:46.365 INFO:tasks.rados.rados.2.smithi057.stdout:1334: writing smithi05720651-22 from 2830644 to 3551402 tid 3 2020-11-16T22:06:46.366 INFO:tasks.rados.rados.2.smithi057.stdout:1335: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:46.366 INFO:tasks.rados.rados.2.smithi057.stdout:1335: expect deleted 2020-11-16T22:06:46.366 INFO:tasks.rados.rados.2.smithi057.stdout:1336: snap_create 2020-11-16T22:06:46.366 INFO:tasks.rados.rados.2.smithi057.stdout:1331: finishing write tid 3 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:46.366 INFO:tasks.rados.rados.2.smithi057.stdout:1331: finishing write tid 4 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:46.367 INFO:tasks.rados.rados.2.smithi057.stdout:1331: finishing write tid 6 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:46.367 INFO:tasks.rados.rados.2.smithi057.stdout:1331: finishing write tid 7 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:46.367 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1174 (ObjNum 464 snap 154 seq_num 464) dirty exists 2020-11-16T22:06:46.367 INFO:tasks.rados.rados.2.smithi057.stdout:1331: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 464 snap 154 seq_num 464) 2020-11-16T22:06:46.367 INFO:tasks.rados.rados.2.smithi057.stdout:1327: finishing rollback tid 2 to smithi05720651-14 2020-11-16T22:06:46.367 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 1322 (ObjNum 395 snap 131 seq_num 395) dirty exists 2020-11-16T22:06:46.367 INFO:tasks.rados.rados.2.smithi057.stdout:1332: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:46.367 INFO:tasks.rados.rados.2.smithi057.stdout:1332: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:46.368 INFO:tasks.rados.rados.2.smithi057.stdout:1332: finishing write tid 3 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:46.368 INFO:tasks.rados.rados.2.smithi057.stdout:1334: finishing write tid 1 to smithi05720651-22 2020-11-16T22:06:46.368 INFO:tasks.rados.rados.2.smithi057.stdout:1334: finishing write tid 2 to smithi05720651-22 2020-11-16T22:06:46.372 INFO:tasks.rados.rados.2.smithi057.stdout:1334: finishing write tid 3 to smithi05720651-22 2020-11-16T22:06:46.413 INFO:tasks.rados.rados.2.smithi057.stdout:1332: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:46.715 INFO:tasks.rados.rados.2.smithi057.stdout:1332: finishing write tid 6 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:46.716 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1327 (ObjNum 465 snap 154 seq_num 465) dirty exists 2020-11-16T22:06:46.716 INFO:tasks.rados.rados.2.smithi057.stdout:1332: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 465 snap 154 seq_num 465) 2020-11-16T22:06:46.814 INFO:tasks.rados.rados.2.smithi057.stdout:1334: finishing write tid 5 to smithi05720651-22 2020-11-16T22:06:46.815 INFO:tasks.rados.rados.2.smithi057.stdout:1334: finishing write tid 6 to smithi05720651-22 2020-11-16T22:06:46.815 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 875 (ObjNum 466 snap 154 seq_num 466) dirty exists 2020-11-16T22:06:46.815 INFO:tasks.rados.rados.2.smithi057.stdout:1334: left oid 22 (ObjNum 466 snap 154 seq_num 466) 2020-11-16T22:06:47.127 INFO:tasks.rados.rados.2.smithi057.stdout:1327: done (6 left) 2020-11-16T22:06:47.127 INFO:tasks.rados.rados.2.smithi057.stdout:1331: done (5 left) 2020-11-16T22:06:47.128 INFO:tasks.rados.rados.2.smithi057.stdout:1332: done (4 left) 2020-11-16T22:06:47.128 INFO:tasks.rados.rados.2.smithi057.stdout:1333: done (3 left) 2020-11-16T22:06:47.128 INFO:tasks.rados.rados.2.smithi057.stdout:1334: done (2 left) 2020-11-16T22:06:47.128 INFO:tasks.rados.rados.2.smithi057.stdout:1335: done (1 left) 2020-11-16T22:06:47.128 INFO:tasks.rados.rados.2.smithi057.stdout:1336: done (0 left) 2020-11-16T22:06:47.128 INFO:tasks.rados.rados.2.smithi057.stdout:1337: rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 155 2020-11-16T22:06:47.128 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 154 2020-11-16T22:06:47.129 INFO:tasks.rados.rados.2.smithi057.stdout:1338: read oid 26 snap -1 2020-11-16T22:06:47.129 INFO:tasks.rados.rados.2.smithi057.stdout:1338: expect deleted 2020-11-16T22:06:47.129 INFO:tasks.rados.rados.2.smithi057.stdout:1339: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:47.129 INFO:tasks.rados.rados.2.smithi057.stdout:1339: expect (ObjNum 415 snap 140 seq_num 415) 2020-11-16T22:06:47.129 INFO:tasks.rados.rados.2.smithi057.stdout:1340: rollback oid 20 current snap is 155 2020-11-16T22:06:47.129 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 20 to 151 2020-11-16T22:06:47.129 INFO:tasks.rados.rados.2.smithi057.stdout:1341: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:47.130 INFO:tasks.rados.rados.2.smithi057.stdout:1341: expect (ObjNum 415 snap 140 seq_num 415) 2020-11-16T22:06:47.130 INFO:tasks.rados.rados.2.smithi057.stdout:1342: copy_from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 10 current snap is 155 2020-11-16T22:06:47.130 INFO:tasks.rados.rados.2.smithi057.stdout:1343: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 151 2020-11-16T22:06:47.130 INFO:tasks.rados.rados.2.smithi057.stdout:1343: expect (ObjNum 340 snap 115 seq_num 340) 2020-11-16T22:06:47.130 INFO:tasks.rados.rados.2.smithi057.stdout:1344: read oid 12 snap 150 2020-11-16T22:06:47.130 INFO:tasks.rados.rados.2.smithi057.stdout:1344: expect (ObjNum 438 snap 147 seq_num 438) 2020-11-16T22:06:47.130 INFO:tasks.rados.rados.2.smithi057.stdout:1345: copy_from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 155 2020-11-16T22:06:47.131 INFO:tasks.rados.rados.2.smithi057.stdout:1346: snap_remove snap 152 2020-11-16T22:06:47.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:46 smithi016 bash[10302]: cluster 2020-11-16T22:06:45.668715+0000 mgr.x (mgr.24115) 424 : cluster [DBG] pgmap v733: 17 pgs: 17 active+clean; 162 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 2.2 MiB/s wr, 8 op/s 2020-11-16T22:06:47.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:46 smithi016 bash[10302]: cluster 2020-11-16T22:06:45.980165+0000 mon.a (mon.0) 1031 : cluster [DBG] osdmap e380: 12 total, 12 up, 12 in 2020-11-16T22:06:47.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:46 smithi195 bash[10218]: cluster 2020-11-16T22:06:45.668715+0000 mgr.x (mgr.24115) 424 : cluster [DBG] pgmap v733: 17 pgs: 17 active+clean; 162 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 2.2 MiB/s wr, 8 op/s 2020-11-16T22:06:47.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:46 smithi195 bash[10218]: cluster 2020-11-16T22:06:45.980165+0000 mon.a (mon.0) 1031 : cluster [DBG] osdmap e380: 12 total, 12 up, 12 in 2020-11-16T22:06:47.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:46 smithi057 bash[10301]: cluster 2020-11-16T22:06:45.668715+0000 mgr.x (mgr.24115) 424 : cluster [DBG] pgmap v733: 17 pgs: 17 active+clean; 162 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 2.2 MiB/s wr, 8 op/s 2020-11-16T22:06:47.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:46 smithi057 bash[10301]: cluster 2020-11-16T22:06:45.980165+0000 mon.a (mon.0) 1031 : cluster [DBG] osdmap e380: 12 total, 12 up, 12 in 2020-11-16T22:06:48.136 INFO:tasks.rados.rados.2.smithi057.stdout:1346: done (9 left) 2020-11-16T22:06:48.137 INFO:tasks.rados.rados.2.smithi057.stdout:1347: delete oid 38 current snap is 155 2020-11-16T22:06:48.137 INFO:tasks.rados.rados.2.smithi057.stdout:1340: finishing rollback tid 0 to smithi05720651-20 2020-11-16T22:06:48.137 INFO:tasks.rados.rados.2.smithi057.stdout:1340: finishing rollback tid 1 to smithi05720651-20 2020-11-16T22:06:48.137 INFO:tasks.rados.rados.2.smithi057.stdout:1340: finishing rollback tid 2 to smithi05720651-20 2020-11-16T22:06:48.137 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1068 (ObjNum 447 snap 150 seq_num 447) dirty exists 2020-11-16T22:06:48.137 INFO:tasks.rados.rados.2.smithi057.stdout:1344: expect (ObjNum 438 snap 147 seq_num 438) 2020-11-16T22:06:48.243 INFO:tasks.rados.rados.2.smithi057.stdout:1339: expect (ObjNum 415 snap 140 seq_num 415) 2020-11-16T22:06:48.418 INFO:tasks.rados.rados.2.smithi057.stdout:1342: finishing copy_from to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:48.419 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 690 (ObjNum 112 snap 34 seq_num 112) dirty exists 2020-11-16T22:06:48.419 INFO:tasks.rados.rados.2.smithi057.stdout:1342: finishing copy_from racing read to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:48.419 INFO:tasks.rados.rados.2.smithi057.stdout:1345: finishing copy_from to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:48.419 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1225 (ObjNum 432 snap 145 seq_num 432) dirty exists 2020-11-16T22:06:48.419 INFO:tasks.rados.rados.2.smithi057.stdout:1345: finishing copy_from racing read to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:48.420 INFO:tasks.rados.rados.2.smithi057.stdout:1343: expect (ObjNum 340 snap 115 seq_num 340) 2020-11-16T22:06:48.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:48 smithi057 bash[10301]: cluster 2020-11-16T22:06:47.136863+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e381: 12 total, 12 up, 12 in 2020-11-16T22:06:48.574 INFO:tasks.rados.rados.2.smithi057.stdout:1337: finishing rollback tid 0 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:48.574 INFO:tasks.rados.rados.2.smithi057.stdout:1337: finishing rollback tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:48.575 INFO:tasks.rados.rados.2.smithi057.stdout:1337: finishing rollback tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:48.575 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1093 (ObjNum 441 snap 148 seq_num 441) dirty exists 2020-11-16T22:06:48.575 INFO:tasks.rados.rados.2.smithi057.stdout:1341: expect (ObjNum 415 snap 140 seq_num 415) 2020-11-16T22:06:48.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:48 smithi016 bash[10302]: cluster 2020-11-16T22:06:47.136863+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e381: 12 total, 12 up, 12 in 2020-11-16T22:06:48.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:48 smithi195 bash[10218]: cluster 2020-11-16T22:06:47.136863+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e381: 12 total, 12 up, 12 in 2020-11-16T22:06:48.746 INFO:tasks.rados.rados.2.smithi057.stdout:1337: done (9 left) 2020-11-16T22:06:48.746 INFO:tasks.rados.rados.2.smithi057.stdout:1338: done (8 left) 2020-11-16T22:06:48.746 INFO:tasks.rados.rados.2.smithi057.stdout:1339: done (7 left) 2020-11-16T22:06:48.746 INFO:tasks.rados.rados.2.smithi057.stdout:1340: done (6 left) 2020-11-16T22:06:48.746 INFO:tasks.rados.rados.2.smithi057.stdout:1341: done (5 left) 2020-11-16T22:06:48.746 INFO:tasks.rados.rados.2.smithi057.stdout:1342: done (4 left) 2020-11-16T22:06:48.747 INFO:tasks.rados.rados.2.smithi057.stdout:1343: done (3 left) 2020-11-16T22:06:48.747 INFO:tasks.rados.rados.2.smithi057.stdout:1344: done (2 left) 2020-11-16T22:06:48.747 INFO:tasks.rados.rados.2.smithi057.stdout:1345: done (1 left) 2020-11-16T22:06:48.747 INFO:tasks.rados.rados.2.smithi057.stdout:1347: done (0 left) 2020-11-16T22:06:48.747 INFO:tasks.rados.rados.2.smithi057.stdout:1348: snap_remove snap 154 2020-11-16T22:06:49.139 INFO:tasks.rados.rados.2.smithi057.stdout:1348: done (0 left) 2020-11-16T22:06:49.139 INFO:tasks.rados.rados.2.smithi057.stdout:1349: snap_remove snap 150 2020-11-16T22:06:49.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:49 smithi057 bash[10301]: cluster 2020-11-16T22:06:47.669607+0000 mgr.x (mgr.24115) 425 : cluster [DBG] pgmap v736: 17 pgs: 17 active+clean; 134 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.6 MiB/s wr, 23 op/s 2020-11-16T22:06:49.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:49 smithi057 bash[10301]: cluster 2020-11-16T22:06:48.148331+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e382: 12 total, 12 up, 12 in 2020-11-16T22:06:49.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:49 smithi016 bash[10302]: cluster 2020-11-16T22:06:47.669607+0000 mgr.x (mgr.24115) 425 : cluster [DBG] pgmap v736: 17 pgs: 17 active+clean; 134 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.6 MiB/s wr, 23 op/s 2020-11-16T22:06:49.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:49 smithi016 bash[10302]: cluster 2020-11-16T22:06:48.148331+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e382: 12 total, 12 up, 12 in 2020-11-16T22:06:49.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:49 smithi195 bash[10218]: cluster 2020-11-16T22:06:47.669607+0000 mgr.x (mgr.24115) 425 : cluster [DBG] pgmap v736: 17 pgs: 17 active+clean; 134 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.6 MiB/s wr, 23 op/s 2020-11-16T22:06:49.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:49 smithi195 bash[10218]: cluster 2020-11-16T22:06:48.148331+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e382: 12 total, 12 up, 12 in 2020-11-16T22:06:49.958 INFO:tasks.rados.rados.2.smithi057.stdout:1349: done (0 left) 2020-11-16T22:06:49.958 INFO:tasks.rados.rados.2.smithi057.stdout:1350: snap_create 2020-11-16T22:06:50.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:50 smithi057 bash[10301]: cluster 2020-11-16T22:06:49.149571+0000 mon.a (mon.0) 1034 : cluster [DBG] osdmap e383: 12 total, 12 up, 12 in 2020-11-16T22:06:50.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:50 smithi057 bash[10301]: cluster 2020-11-16T22:06:49.968669+0000 mon.a (mon.0) 1035 : cluster [DBG] osdmap e384: 12 total, 12 up, 12 in 2020-11-16T22:06:50.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:50 smithi016 bash[10302]: cluster 2020-11-16T22:06:49.149571+0000 mon.a (mon.0) 1034 : cluster [DBG] osdmap e383: 12 total, 12 up, 12 in 2020-11-16T22:06:50.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:50 smithi016 bash[10302]: cluster 2020-11-16T22:06:49.968669+0000 mon.a (mon.0) 1035 : cluster [DBG] osdmap e384: 12 total, 12 up, 12 in 2020-11-16T22:06:50.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:50 smithi195 bash[10218]: cluster 2020-11-16T22:06:49.149571+0000 mon.a (mon.0) 1034 : cluster [DBG] osdmap e383: 12 total, 12 up, 12 in 2020-11-16T22:06:50.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:50 smithi195 bash[10218]: cluster 2020-11-16T22:06:49.968669+0000 mon.a (mon.0) 1035 : cluster [DBG] osdmap e384: 12 total, 12 up, 12 in 2020-11-16T22:06:50.599 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:06:50 smithi195 bash[18679]: debug 2020-11-16T22:06:50.363+0000 7f9942dfe700 -1 osd.1 pg_epoch: 384 pg[2.6( v 379'298 (0'0,379'298] local-lis/les=71/72 n=3 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,8] r=0 lpr=71 crt=378'297 lcod 378'297 mlcod 378'297 active+clean+snaptrim trimq=[12b~1] ps=[130~1,132~1]] removing snap head 2020-11-16T22:06:50.600 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:06:50 smithi195 bash[18679]: debug 2020-11-16T22:06:50.371+0000 7f9945603700 -1 osd.1 pg_epoch: 384 pg[2.9( v 384'1335 (0'0,384'1335] local-lis/les=71/72 n=10 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,7] r=0 lpr=71 crt=384'1335 lcod 384'1333 mlcod 384'1333 active+clean+snaptrim trimq=[12b~1] ps=[130~1,132~1]] removing snap head 2020-11-16T22:06:50.973 INFO:tasks.rados.rados.2.smithi057.stdout:1350: done (0 left) 2020-11-16T22:06:50.973 INFO:tasks.rados.rados.2.smithi057.stdout:1351: copy_from oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 156 2020-11-16T22:06:50.973 INFO:tasks.rados.rados.2.smithi057.stdout:1352: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:50.973 INFO:tasks.rados.rados.2.smithi057.stdout:1352: expect (ObjNum 415 snap 140 seq_num 415) 2020-11-16T22:06:50.973 INFO:tasks.rados.rados.2.smithi057.stdout:1353: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:50.974 INFO:tasks.rados.rados.2.smithi057.stdout:1353: expect (ObjNum 415 snap 140 seq_num 415) 2020-11-16T22:06:50.974 INFO:tasks.rados.rados.2.smithi057.stdout:1354: read oid 42 snap -1 2020-11-16T22:06:50.974 INFO:tasks.rados.rados.2.smithi057.stdout:1354: expect (ObjNum 420 snap 141 seq_num 420) 2020-11-16T22:06:50.974 INFO:tasks.rados.rados.2.smithi057.stdout:1355: copy_from oid 16 from oid 30 current snap is 156 2020-11-16T22:06:50.974 INFO:tasks.rados.rados.2.smithi057.stdout:1356: copy_from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 32 current snap is 156 2020-11-16T22:06:50.974 INFO:tasks.rados.rados.2.smithi057.stdout:1357: delete oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 156 2020-11-16T22:06:50.986 INFO:tasks.rados.rados.2.smithi057.stdout:1357: done (6 left) 2020-11-16T22:06:50.986 INFO:tasks.rados.rados.2.smithi057.stdout:1358: snap_create 2020-11-16T22:06:50.986 INFO:tasks.rados.rados.2.smithi057.stdout:1355: finishing copy_from to smithi05720651-16 2020-11-16T22:06:50.987 INFO:tasks.rados.rados.2.smithi057.stdout:1355: got expected ENOENT (src dne) 2020-11-16T22:06:50.987 INFO:tasks.rados.rados.2.smithi057.stdout:1355: finishing copy_from racing read to smithi05720651-16 2020-11-16T22:06:50.993 INFO:tasks.rados.rados.2.smithi057.stdout:1353: expect (ObjNum 415 snap 140 seq_num 415) 2020-11-16T22:06:51.178 INFO:tasks.rados.rados.2.smithi057.stdout:1352: expect (ObjNum 415 snap 140 seq_num 415) 2020-11-16T22:06:51.354 INFO:tasks.rados.rados.2.smithi057.stdout:1356: finishing copy_from to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:51.355 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1290 (ObjNum 450 snap 150 seq_num 450) dirty exists 2020-11-16T22:06:51.355 INFO:tasks.rados.rados.2.smithi057.stdout:1356: finishing copy_from racing read to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:51.355 INFO:tasks.rados.rados.2.smithi057.stdout:1351: finishing copy_from to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:51.355 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 999 (ObjNum 445 snap 150 seq_num 445) dirty exists 2020-11-16T22:06:51.355 INFO:tasks.rados.rados.2.smithi057.stdout:1351: finishing copy_from racing read to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:51.356 INFO:tasks.rados.rados.2.smithi057.stdout:1354: expect (ObjNum 420 snap 141 seq_num 420) 2020-11-16T22:06:51.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:51 smithi057 bash[10301]: cluster 2020-11-16T22:06:49.670350+0000 mgr.x (mgr.24115) 426 : cluster [DBG] pgmap v739: 17 pgs: 17 active+clean; 134 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2020-11-16T22:06:51.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:51 smithi057 bash[10301]: cluster 2020-11-16T22:06:50.978496+0000 mon.a (mon.0) 1036 : cluster [DBG] osdmap e385: 12 total, 12 up, 12 in 2020-11-16T22:06:51.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:51 smithi016 bash[10302]: cluster 2020-11-16T22:06:49.670350+0000 mgr.x (mgr.24115) 426 : cluster [DBG] pgmap v739: 17 pgs: 17 active+clean; 134 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2020-11-16T22:06:51.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:51 smithi016 bash[10302]: cluster 2020-11-16T22:06:50.978496+0000 mon.a (mon.0) 1036 : cluster [DBG] osdmap e385: 12 total, 12 up, 12 in 2020-11-16T22:06:51.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:51 smithi195 bash[10218]: cluster 2020-11-16T22:06:49.670350+0000 mgr.x (mgr.24115) 426 : cluster [DBG] pgmap v739: 17 pgs: 17 active+clean; 134 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2020-11-16T22:06:51.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:51 smithi195 bash[10218]: cluster 2020-11-16T22:06:50.978496+0000 mon.a (mon.0) 1036 : cluster [DBG] osdmap e385: 12 total, 12 up, 12 in 2020-11-16T22:06:51.971 INFO:tasks.rados.rados.2.smithi057.stdout:1351: done (6 left) 2020-11-16T22:06:51.972 INFO:tasks.rados.rados.2.smithi057.stdout:1352: done (5 left) 2020-11-16T22:06:51.972 INFO:tasks.rados.rados.2.smithi057.stdout:1353: done (4 left) 2020-11-16T22:06:51.972 INFO:tasks.rados.rados.2.smithi057.stdout:1354: done (3 left) 2020-11-16T22:06:51.972 INFO:tasks.rados.rados.2.smithi057.stdout:1355: done (2 left) 2020-11-16T22:06:51.972 INFO:tasks.rados.rados.2.smithi057.stdout:1356: done (1 left) 2020-11-16T22:06:51.972 INFO:tasks.rados.rados.2.smithi057.stdout:1358: done (0 left) 2020-11-16T22:06:51.972 INFO:tasks.rados.rados.2.smithi057.stdout:1359: read oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 151 2020-11-16T22:06:51.973 INFO:tasks.rados.rados.2.smithi057.stdout:1359: expect (ObjNum 440 snap 148 seq_num 440) 2020-11-16T22:06:51.973 INFO:tasks.rados.rados.2.smithi057.stdout:1360: snap_remove snap 155 2020-11-16T22:06:52.980 INFO:tasks.rados.rados.2.smithi057.stdout:1360: done (1 left) 2020-11-16T22:06:52.980 INFO:tasks.rados.rados.2.smithi057.stdout:1361: copy_from oid 38 from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 157 2020-11-16T22:06:52.980 INFO:tasks.rados.rados.2.smithi057.stdout:1359: expect (ObjNum 440 snap 148 seq_num 440) 2020-11-16T22:06:53.128 INFO:tasks.rados.rados.2.smithi057.stdout:1359: done (1 left) 2020-11-16T22:06:53.128 INFO:tasks.rados.rados.2.smithi057.stdout:1362: snap_create 2020-11-16T22:06:53.128 INFO:tasks.rados.rados.2.smithi057.stdout:1361: finishing copy_from to smithi05720651-38 2020-11-16T22:06:53.129 INFO:tasks.rados.rados.2.smithi057.stdout:1361: got expected ENOENT (src dne) 2020-11-16T22:06:53.129 INFO:tasks.rados.rados.2.smithi057.stdout:1361: finishing copy_from racing read to smithi05720651-38 2020-11-16T22:06:53.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:52 smithi016 bash[10302]: cluster 2020-11-16T22:06:51.671042+0000 mgr.x (mgr.24115) 427 : cluster [DBG] pgmap v742: 17 pgs: 17 active+clean; 145 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 4.6 MiB/s wr, 22 op/s 2020-11-16T22:06:53.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:52 smithi016 bash[10302]: cluster 2020-11-16T22:06:51.980871+0000 mon.a (mon.0) 1037 : cluster [DBG] osdmap e386: 12 total, 12 up, 12 in 2020-11-16T22:06:53.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:52 smithi195 bash[10218]: cluster 2020-11-16T22:06:51.671042+0000 mgr.x (mgr.24115) 427 : cluster [DBG] pgmap v742: 17 pgs: 17 active+clean; 145 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 4.6 MiB/s wr, 22 op/s 2020-11-16T22:06:53.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:52 smithi195 bash[10218]: cluster 2020-11-16T22:06:51.980871+0000 mon.a (mon.0) 1037 : cluster [DBG] osdmap e386: 12 total, 12 up, 12 in 2020-11-16T22:06:53.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:52 smithi057 bash[10301]: cluster 2020-11-16T22:06:51.671042+0000 mgr.x (mgr.24115) 427 : cluster [DBG] pgmap v742: 17 pgs: 17 active+clean; 145 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 4.6 MiB/s wr, 22 op/s 2020-11-16T22:06:53.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:52 smithi057 bash[10301]: cluster 2020-11-16T22:06:51.980871+0000 mon.a (mon.0) 1037 : cluster [DBG] osdmap e386: 12 total, 12 up, 12 in 2020-11-16T22:06:53.989 INFO:tasks.rados.rados.2.smithi057.stdout:1361: done (1 left) 2020-11-16T22:06:53.989 INFO:tasks.rados.rados.2.smithi057.stdout:1362: done (0 left) 2020-11-16T22:06:53.989 INFO:tasks.rados.rados.2.smithi057.stdout:1363: read oid 38 snap -1 2020-11-16T22:06:53.990 INFO:tasks.rados.rados.2.smithi057.stdout:1363: expect deleted 2020-11-16T22:06:53.990 INFO:tasks.rados.rados.2.smithi057.stdout:1364: write oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 158 2020-11-16T22:06:53.990 INFO:tasks.rados.rados.2.smithi057.stdout:1364: seq_num 469 ranges {682483=789314,1944996=791497,3196560=554574} 2020-11-16T22:06:54.001 INFO:tasks.rados.rados.2.smithi057.stdout:1364: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 682483 to 1471797 tid 1 2020-11-16T22:06:54.008 INFO:tasks.rados.rados.2.smithi057.stdout:1364: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1944996 to 2736493 tid 2 2020-11-16T22:06:54.014 INFO:tasks.rados.rados.2.smithi057.stdout:1364: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3196560 to 3751134 tid 3 2020-11-16T22:06:54.014 INFO:tasks.rados.rados.2.smithi057.stdout:1365: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:54.014 INFO:tasks.rados.rados.2.smithi057.stdout:1365: expect (ObjNum 322 snap 111 seq_num 322) 2020-11-16T22:06:54.014 INFO:tasks.rados.rados.2.smithi057.stdout:1366: snap_create 2020-11-16T22:06:54.015 INFO:tasks.rados.rados.2.smithi057.stdout:1364: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:54.019 INFO:tasks.rados.rados.2.smithi057.stdout:1364: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:54.020 INFO:tasks.rados.rados.2.smithi057.stdout:1364: finishing write tid 3 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:54.020 INFO:tasks.rados.rados.2.smithi057.stdout:1364: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:54.020 INFO:tasks.rados.rados.2.smithi057.stdout:1364: finishing write tid 6 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:54.020 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 974 (ObjNum 469 snap 158 seq_num 469) dirty exists 2020-11-16T22:06:54.020 INFO:tasks.rados.rados.2.smithi057.stdout:1364: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 469 snap 158 seq_num 469) 2020-11-16T22:06:54.022 INFO:tasks.rados.rados.2.smithi057.stdout:1365: expect (ObjNum 322 snap 111 seq_num 322) 2020-11-16T22:06:54.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:53 smithi016 bash[10302]: cluster 2020-11-16T22:06:52.990529+0000 mon.a (mon.0) 1038 : cluster [DBG] osdmap e387: 12 total, 12 up, 12 in 2020-11-16T22:06:54.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:53 smithi195 bash[10218]: cluster 2020-11-16T22:06:52.990529+0000 mon.a (mon.0) 1038 : cluster [DBG] osdmap e387: 12 total, 12 up, 12 in 2020-11-16T22:06:54.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:54 smithi057 bash[10301]: cluster 2020-11-16T22:06:52.990529+0000 mon.a (mon.0) 1038 : cluster [DBG] osdmap e387: 12 total, 12 up, 12 in 2020-11-16T22:06:54.961 INFO:tasks.rados.rados.2.smithi057.stdout:1363: done (3 left) 2020-11-16T22:06:54.961 INFO:tasks.rados.rados.2.smithi057.stdout:1364: done (2 left) 2020-11-16T22:06:54.962 INFO:tasks.rados.rados.2.smithi057.stdout:1365: done (1 left) 2020-11-16T22:06:54.962 INFO:tasks.rados.rados.2.smithi057.stdout:1366: done (0 left) 2020-11-16T22:06:54.962 INFO:tasks.rados.rados.2.smithi057.stdout:1367: read oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:06:54.962 INFO:tasks.rados.rados.2.smithi057.stdout:1367: expect (ObjNum 441 snap 148 seq_num 441) 2020-11-16T22:06:54.962 INFO:tasks.rados.rados.2.smithi057.stdout:1368: copy_from oid 38 from oid 4 current snap is 159 2020-11-16T22:06:54.962 INFO:tasks.rados.rados.2.smithi057.stdout:1369: read oid 36 snap -1 2020-11-16T22:06:54.963 INFO:tasks.rados.rados.2.smithi057.stdout:1369: expect (ObjNum 297 snap 103 seq_num 297) 2020-11-16T22:06:54.963 INFO:tasks.rados.rados.2.smithi057.stdout:1370: snap_create 2020-11-16T22:06:54.977 INFO:tasks.rados.rados.2.smithi057.stdout:1369: expect (ObjNum 297 snap 103 seq_num 297) 2020-11-16T22:06:55.277 INFO:tasks.rados.rados.2.smithi057.stdout:1367: expect (ObjNum 441 snap 148 seq_num 441) 2020-11-16T22:06:55.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:54 smithi016 bash[10302]: cluster 2020-11-16T22:06:53.671719+0000 mgr.x (mgr.24115) 428 : cluster [DBG] pgmap v745: 17 pgs: 17 active+clean; 145 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 4.6 MiB/s wr, 22 op/s 2020-11-16T22:06:55.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:54 smithi016 bash[10302]: cluster 2020-11-16T22:06:53.999539+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e388: 12 total, 12 up, 12 in 2020-11-16T22:06:55.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:55 smithi016 bash[10302]: cluster 2020-11-16T22:06:54.970728+0000 mon.a (mon.0) 1040 : cluster [DBG] osdmap e389: 12 total, 12 up, 12 in 2020-11-16T22:06:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:54 smithi195 bash[10218]: cluster 2020-11-16T22:06:53.671719+0000 mgr.x (mgr.24115) 428 : cluster [DBG] pgmap v745: 17 pgs: 17 active+clean; 145 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 4.6 MiB/s wr, 22 op/s 2020-11-16T22:06:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:54 smithi195 bash[10218]: cluster 2020-11-16T22:06:53.999539+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e388: 12 total, 12 up, 12 in 2020-11-16T22:06:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:54 smithi195 bash[10218]: cluster 2020-11-16T22:06:54.970728+0000 mon.a (mon.0) 1040 : cluster [DBG] osdmap e389: 12 total, 12 up, 12 in 2020-11-16T22:06:55.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:55 smithi057 bash[10301]: cluster 2020-11-16T22:06:53.671719+0000 mgr.x (mgr.24115) 428 : cluster [DBG] pgmap v745: 17 pgs: 17 active+clean; 145 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 4.6 MiB/s wr, 22 op/s 2020-11-16T22:06:55.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:55 smithi057 bash[10301]: cluster 2020-11-16T22:06:53.999539+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e388: 12 total, 12 up, 12 in 2020-11-16T22:06:55.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:55 smithi057 bash[10301]: cluster 2020-11-16T22:06:54.970728+0000 mon.a (mon.0) 1040 : cluster [DBG] osdmap e389: 12 total, 12 up, 12 in 2020-11-16T22:06:55.460 INFO:tasks.rados.rados.2.smithi057.stdout:1368: finishing copy_from to smithi05720651-38 2020-11-16T22:06:55.460 INFO:tasks.rados.rados.2.smithi057.stdout:1368: got expected ENOENT (src dne) 2020-11-16T22:06:55.460 INFO:tasks.rados.rados.2.smithi057.stdout:1368: finishing copy_from racing read to smithi05720651-38 2020-11-16T22:06:55.971 INFO:tasks.rados.rados.2.smithi057.stdout:1367: done (3 left) 2020-11-16T22:06:55.971 INFO:tasks.rados.rados.2.smithi057.stdout:1368: done (2 left) 2020-11-16T22:06:55.971 INFO:tasks.rados.rados.2.smithi057.stdout:1369: done (1 left) 2020-11-16T22:06:55.971 INFO:tasks.rados.rados.2.smithi057.stdout:1370: done (0 left) 2020-11-16T22:06:55.971 INFO:tasks.rados.rados.2.smithi057.stdout:1371: write oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 160 2020-11-16T22:06:55.971 INFO:tasks.rados.rados.2.smithi057.stdout:1371: seq_num 470 ranges {699290=464563,1603478=535155,2823983=765846} 2020-11-16T22:06:55.983 INFO:tasks.rados.rados.2.smithi057.stdout:1371: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 699290 to 1163853 tid 1 2020-11-16T22:06:55.990 INFO:tasks.rados.rados.2.smithi057.stdout:1371: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1603478 to 2138633 tid 2 2020-11-16T22:06:55.999 INFO:tasks.rados.rados.2.smithi057.stdout:1371: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2823983 to 3589829 tid 3 2020-11-16T22:06:56.000 INFO:tasks.rados.rados.2.smithi057.stdout:1372: snap_remove snap 159 2020-11-16T22:06:56.997 INFO:tasks.rados.rados.2.smithi057.stdout:1372: done (1 left) 2020-11-16T22:06:56.997 INFO:tasks.rados.rados.2.smithi057.stdout:1373: copy_from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 160 2020-11-16T22:06:56.997 INFO:tasks.rados.rados.2.smithi057.stdout:1371: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:56.997 INFO:tasks.rados.rados.2.smithi057.stdout:1371: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:56.998 INFO:tasks.rados.rados.2.smithi057.stdout:1371: finishing write tid 3 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:56.998 INFO:tasks.rados.rados.2.smithi057.stdout:1371: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:56.998 INFO:tasks.rados.rados.2.smithi057.stdout:1371: finishing write tid 6 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:56.998 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 949 (ObjNum 470 snap 160 seq_num 470) dirty exists 2020-11-16T22:06:56.998 INFO:tasks.rados.rados.2.smithi057.stdout:1371: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 470 snap 160 seq_num 470) 2020-11-16T22:06:56.998 INFO:tasks.rados.rados.2.smithi057.stdout:1371: done (1 left) 2020-11-16T22:06:56.998 INFO:tasks.rados.rados.2.smithi057.stdout:1374: copy_from oid 24 from oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 160 2020-11-16T22:06:56.999 INFO:tasks.rados.rados.2.smithi057.stdout:1375: rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 160 2020-11-16T22:06:56.999 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 158 2020-11-16T22:06:56.999 INFO:tasks.rados.rados.2.smithi057.stdout:1376: write (excl) oid 28 current snap is 160 2020-11-16T22:06:56.999 INFO:tasks.rados.rados.2.smithi057.stdout:1376: seq_num 471 ranges {716097=539812,1945607=795166,3535053=381044} 2020-11-16T22:06:57.010 INFO:tasks.rados.rados.2.smithi057.stdout:1376: writing smithi05720651-28 from 716097 to 1255909 tid 1 2020-11-16T22:06:57.019 INFO:tasks.rados.rados.2.smithi057.stdout:1376: writing smithi05720651-28 from 1945607 to 2740773 tid 2 2020-11-16T22:06:57.026 INFO:tasks.rados.rados.2.smithi057.stdout:1376: writing smithi05720651-28 from 3535053 to 3916097 tid 3 2020-11-16T22:06:57.026 INFO:tasks.rados.rados.2.smithi057.stdout:1377: read oid 48 snap -1 2020-11-16T22:06:57.026 INFO:tasks.rados.rados.2.smithi057.stdout:1377: expect (ObjNum 410 snap 138 seq_num 410) 2020-11-16T22:06:57.027 INFO:tasks.rados.rados.2.smithi057.stdout:1378: write (excl) oid 38 current snap is 160 2020-11-16T22:06:57.027 INFO:tasks.rados.rados.2.smithi057.stdout:1378: seq_num 472 ranges {732904=731414,2120442=538824,3278829=504743} 2020-11-16T22:06:57.034 INFO:tasks.rados.rados.2.smithi057.stdout:1378: writing smithi05720651-38 from 732904 to 1464318 tid 1 2020-11-16T22:06:57.042 INFO:tasks.rados.rados.2.smithi057.stdout:1378: writing smithi05720651-38 from 2120442 to 2659266 tid 2 2020-11-16T22:06:57.048 INFO:tasks.rados.rados.2.smithi057.stdout:1378: writing smithi05720651-38 from 3278829 to 3783572 tid 3 2020-11-16T22:06:57.049 INFO:tasks.rados.rados.2.smithi057.stdout:1379: snap_create 2020-11-16T22:06:57.049 INFO:tasks.rados.rados.2.smithi057.stdout:1373: finishing copy_from to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:57.049 INFO:tasks.rados.rados.2.smithi057.stdout:1373: got expected ENOENT (src dne) 2020-11-16T22:06:57.049 INFO:tasks.rados.rados.2.smithi057.stdout:1373: finishing copy_from racing read to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:57.049 INFO:tasks.rados.rados.2.smithi057.stdout:1375: finishing rollback tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:57.049 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1091 (ObjNum 385 snap 0 seq_num 2932381168) dirty dne 2020-11-16T22:06:57.050 INFO:tasks.rados.rados.2.smithi057.stdout:1376: finishing write tid 1 to smithi05720651-28 2020-11-16T22:06:57.050 INFO:tasks.rados.rados.2.smithi057.stdout:1376: finishing write tid 2 to smithi05720651-28 2020-11-16T22:06:57.050 INFO:tasks.rados.rados.2.smithi057.stdout:1376: finishing write tid 3 to smithi05720651-28 2020-11-16T22:06:57.050 INFO:tasks.rados.rados.2.smithi057.stdout:1376: finishing write tid 5 to smithi05720651-28 2020-11-16T22:06:57.050 INFO:tasks.rados.rados.2.smithi057.stdout:1376: finishing write tid 6 to smithi05720651-28 2020-11-16T22:06:57.050 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 864 (ObjNum 471 snap 160 seq_num 471) dirty exists 2020-11-16T22:06:57.050 INFO:tasks.rados.rados.2.smithi057.stdout:1376: left oid 28 (ObjNum 471 snap 160 seq_num 471) 2020-11-16T22:06:57.051 INFO:tasks.rados.rados.2.smithi057.stdout:1377: expect (ObjNum 410 snap 138 seq_num 410) 2020-11-16T22:06:57.256 INFO:tasks.rados.rados.2.smithi057.stdout:1378: finishing write tid 1 to smithi05720651-38 2020-11-16T22:06:57.256 INFO:tasks.rados.rados.2.smithi057.stdout:1378: finishing write tid 2 to smithi05720651-38 2020-11-16T22:06:57.256 INFO:tasks.rados.rados.2.smithi057.stdout:1378: finishing write tid 3 to smithi05720651-38 2020-11-16T22:06:57.256 INFO:tasks.rados.rados.2.smithi057.stdout:1378: finishing write tid 5 to smithi05720651-38 2020-11-16T22:06:57.257 INFO:tasks.rados.rados.2.smithi057.stdout:1378: finishing write tid 6 to smithi05720651-38 2020-11-16T22:06:57.257 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 1098 (ObjNum 472 snap 160 seq_num 472) dirty exists 2020-11-16T22:06:57.257 INFO:tasks.rados.rados.2.smithi057.stdout:1378: left oid 38 (ObjNum 472 snap 160 seq_num 472) 2020-11-16T22:06:57.257 INFO:tasks.rados.rados.2.smithi057.stdout:1374: finishing copy_from to smithi05720651-24 2020-11-16T22:06:57.257 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 999 (ObjNum 445 snap 150 seq_num 445) dirty exists 2020-11-16T22:06:57.257 INFO:tasks.rados.rados.2.smithi057.stdout:1374: finishing copy_from racing read to smithi05720651-24 2020-11-16T22:06:57.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:56 smithi016 bash[10302]: cluster 2020-11-16T22:06:55.672428+0000 mgr.x (mgr.24115) 429 : cluster [DBG] pgmap v748: 17 pgs: 17 active+clean; 139 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 870 KiB/s wr, 7 op/s 2020-11-16T22:06:57.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:56 smithi016 bash[10302]: cluster 2020-11-16T22:06:55.980584+0000 mon.a (mon.0) 1041 : cluster [DBG] osdmap e390: 12 total, 12 up, 12 in 2020-11-16T22:06:57.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:56 smithi195 bash[10218]: cluster 2020-11-16T22:06:55.672428+0000 mgr.x (mgr.24115) 429 : cluster [DBG] pgmap v748: 17 pgs: 17 active+clean; 139 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 870 KiB/s wr, 7 op/s 2020-11-16T22:06:57.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:56 smithi195 bash[10218]: cluster 2020-11-16T22:06:55.980584+0000 mon.a (mon.0) 1041 : cluster [DBG] osdmap e390: 12 total, 12 up, 12 in 2020-11-16T22:06:57.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:56 smithi057 bash[10301]: cluster 2020-11-16T22:06:55.672428+0000 mgr.x (mgr.24115) 429 : cluster [DBG] pgmap v748: 17 pgs: 17 active+clean; 139 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 870 KiB/s wr, 7 op/s 2020-11-16T22:06:57.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:56 smithi057 bash[10301]: cluster 2020-11-16T22:06:55.980584+0000 mon.a (mon.0) 1041 : cluster [DBG] osdmap e390: 12 total, 12 up, 12 in 2020-11-16T22:06:58.010 INFO:tasks.rados.rados.2.smithi057.stdout:1373: done (6 left) 2020-11-16T22:06:58.011 INFO:tasks.rados.rados.2.smithi057.stdout:1374: done (5 left) 2020-11-16T22:06:58.011 INFO:tasks.rados.rados.2.smithi057.stdout:1375: done (4 left) 2020-11-16T22:06:58.011 INFO:tasks.rados.rados.2.smithi057.stdout:1376: done (3 left) 2020-11-16T22:06:58.011 INFO:tasks.rados.rados.2.smithi057.stdout:1377: done (2 left) 2020-11-16T22:06:58.011 INFO:tasks.rados.rados.2.smithi057.stdout:1378: done (1 left) 2020-11-16T22:06:58.011 INFO:tasks.rados.rados.2.smithi057.stdout:1379: done (0 left) 2020-11-16T22:06:58.011 INFO:tasks.rados.rados.2.smithi057.stdout:1380: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 160 2020-11-16T22:06:58.012 INFO:tasks.rados.rados.2.smithi057.stdout:1380: expect (ObjNum 470 snap 160 seq_num 470) 2020-11-16T22:06:58.012 INFO:tasks.rados.rados.2.smithi057.stdout:1381: snap_create 2020-11-16T22:06:58.021 INFO:tasks.rados.rados.2.smithi057.stdout:1380: expect (ObjNum 470 snap 160 seq_num 470) 2020-11-16T22:06:58.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:58 smithi016 bash[10302]: cluster 2020-11-16T22:06:57.006688+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e391: 12 total, 12 up, 12 in 2020-11-16T22:06:58.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:58 smithi195 bash[10218]: cluster 2020-11-16T22:06:57.006688+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e391: 12 total, 12 up, 12 in 2020-11-16T22:06:58.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:58 smithi057 bash[10301]: cluster 2020-11-16T22:06:57.006688+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e391: 12 total, 12 up, 12 in 2020-11-16T22:06:59.009 INFO:tasks.rados.rados.2.smithi057.stdout:1380: done (1 left) 2020-11-16T22:06:59.009 INFO:tasks.rados.rados.2.smithi057.stdout:1381: done (0 left) 2020-11-16T22:06:59.010 INFO:tasks.rados.rados.2.smithi057.stdout:1382: rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 162 2020-11-16T22:06:59.010 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 153 2020-11-16T22:06:59.010 INFO:tasks.rados.rados.2.smithi057.stdout:1383: read oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 161 2020-11-16T22:06:59.010 INFO:tasks.rados.rados.2.smithi057.stdout:1383: expect (ObjNum 327 snap 111 seq_num 327) 2020-11-16T22:06:59.010 INFO:tasks.rados.rados.2.smithi057.stdout:1384: snap_create 2020-11-16T22:06:59.015 INFO:tasks.rados.rados.2.smithi057.stdout:1382: finishing rollback tid 0 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:59.015 INFO:tasks.rados.rados.2.smithi057.stdout:1382: finishing rollback tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:59.016 INFO:tasks.rados.rados.2.smithi057.stdout:1382: finishing rollback tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:06:59.016 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 952 (ObjNum 357 snap 118 seq_num 357) dirty exists 2020-11-16T22:06:59.028 INFO:tasks.rados.rados.2.smithi057.stdout:1383: expect (ObjNum 327 snap 111 seq_num 327) 2020-11-16T22:06:59.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:59 smithi016 bash[10302]: cluster 2020-11-16T22:06:57.673223+0000 mgr.x (mgr.24115) 430 : cluster [DBG] pgmap v751: 17 pgs: 17 active+clean; 143 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2020-11-16T22:06:59.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:06:59 smithi016 bash[10302]: cluster 2020-11-16T22:06:58.016739+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e392: 12 total, 12 up, 12 in 2020-11-16T22:06:59.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:59 smithi195 bash[10218]: cluster 2020-11-16T22:06:57.673223+0000 mgr.x (mgr.24115) 430 : cluster [DBG] pgmap v751: 17 pgs: 17 active+clean; 143 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2020-11-16T22:06:59.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:06:59 smithi195 bash[10218]: cluster 2020-11-16T22:06:58.016739+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e392: 12 total, 12 up, 12 in 2020-11-16T22:06:59.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:59 smithi057 bash[10301]: cluster 2020-11-16T22:06:57.673223+0000 mgr.x (mgr.24115) 430 : cluster [DBG] pgmap v751: 17 pgs: 17 active+clean; 143 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 1.8 MiB/s wr, 15 op/s 2020-11-16T22:06:59.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:06:59 smithi057 bash[10301]: cluster 2020-11-16T22:06:58.016739+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e392: 12 total, 12 up, 12 in 2020-11-16T22:06:59.965 INFO:tasks.rados.rados.2.smithi057.stdout:1382: done (2 left) 2020-11-16T22:06:59.965 INFO:tasks.rados.rados.2.smithi057.stdout:1383: done (1 left) 2020-11-16T22:06:59.966 INFO:tasks.rados.rados.2.smithi057.stdout:1384: done (0 left) 2020-11-16T22:06:59.966 INFO:tasks.rados.rados.2.smithi057.stdout:1385: write oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 163 2020-11-16T22:06:59.966 INFO:tasks.rados.rados.2.smithi057.stdout:1385: seq_num 473 ranges {749711=406663,1778924=682482,3189899=716015} 2020-11-16T22:06:59.981 INFO:tasks.rados.rados.2.smithi057.stdout:1385: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 749711 to 1156374 tid 1 2020-11-16T22:06:59.988 INFO:tasks.rados.rados.2.smithi057.stdout:1385: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1778924 to 2461406 tid 2 2020-11-16T22:06:59.997 INFO:tasks.rados.rados.2.smithi057.stdout:1385: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3189899 to 3905914 tid 3 2020-11-16T22:06:59.997 INFO:tasks.rados.rados.2.smithi057.stdout:1386: snap_create 2020-11-16T22:06:59.997 INFO:tasks.rados.rados.2.smithi057.stdout:1385: finishing write tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:00.001 INFO:tasks.rados.rados.2.smithi057.stdout:1385: finishing write tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:00.008 INFO:tasks.rados.rados.2.smithi057.stdout:1385: finishing write tid 3 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:00.008 INFO:tasks.rados.rados.2.smithi057.stdout:1385: finishing write tid 5 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:00.009 INFO:tasks.rados.rados.2.smithi057.stdout:1385: finishing write tid 6 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:00.009 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1168 (ObjNum 473 snap 163 seq_num 473) dirty exists 2020-11-16T22:07:00.009 INFO:tasks.rados.rados.2.smithi057.stdout:1385: left oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 473 snap 163 seq_num 473) 2020-11-16T22:07:00.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:00 smithi016 bash[10302]: cluster 2020-11-16T22:06:59.019035+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e393: 12 total, 12 up, 12 in 2020-11-16T22:07:00.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:00 smithi016 bash[10302]: cluster 2020-11-16T22:06:59.971958+0000 mon.a (mon.0) 1045 : cluster [DBG] osdmap e394: 12 total, 12 up, 12 in 2020-11-16T22:07:00.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:00 smithi195 bash[10218]: cluster 2020-11-16T22:06:59.019035+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e393: 12 total, 12 up, 12 in 2020-11-16T22:07:00.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:00 smithi195 bash[10218]: cluster 2020-11-16T22:06:59.971958+0000 mon.a (mon.0) 1045 : cluster [DBG] osdmap e394: 12 total, 12 up, 12 in 2020-11-16T22:07:00.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:00 smithi057 bash[10301]: cluster 2020-11-16T22:06:59.019035+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e393: 12 total, 12 up, 12 in 2020-11-16T22:07:00.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:00 smithi057 bash[10301]: cluster 2020-11-16T22:06:59.971958+0000 mon.a (mon.0) 1045 : cluster [DBG] osdmap e394: 12 total, 12 up, 12 in 2020-11-16T22:07:00.977 INFO:tasks.rados.rados.2.smithi057.stdout:1385: done (1 left) 2020-11-16T22:07:00.977 INFO:tasks.rados.rados.2.smithi057.stdout:1386: done (0 left) 2020-11-16T22:07:00.977 INFO:tasks.rados.rados.2.smithi057.stdout:1387: read oid 24 snap 157 2020-11-16T22:07:00.977 INFO:tasks.rados.rados.2.smithi057.stdout:1387: expect deleted 2020-11-16T22:07:00.978 INFO:tasks.rados.rados.2.smithi057.stdout:1388: snap_remove snap 151 2020-11-16T22:07:01.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:01 smithi016 bash[10302]: cluster 2020-11-16T22:06:59.673931+0000 mgr.x (mgr.24115) 431 : cluster [DBG] pgmap v754: 17 pgs: 17 active+clean; 143 MiB data, 508 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 952 KiB/s wr, 8 op/s 2020-11-16T22:07:01.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:01 smithi016 bash[10302]: cluster 2020-11-16T22:07:00.986127+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e395: 12 total, 12 up, 12 in 2020-11-16T22:07:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:01 smithi195 bash[10218]: cluster 2020-11-16T22:06:59.673931+0000 mgr.x (mgr.24115) 431 : cluster [DBG] pgmap v754: 17 pgs: 17 active+clean; 143 MiB data, 508 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 952 KiB/s wr, 8 op/s 2020-11-16T22:07:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:01 smithi195 bash[10218]: cluster 2020-11-16T22:07:00.986127+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e395: 12 total, 12 up, 12 in 2020-11-16T22:07:01.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:01 smithi057 bash[10301]: cluster 2020-11-16T22:06:59.673931+0000 mgr.x (mgr.24115) 431 : cluster [DBG] pgmap v754: 17 pgs: 17 active+clean; 143 MiB data, 508 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 952 KiB/s wr, 8 op/s 2020-11-16T22:07:01.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:01 smithi057 bash[10301]: cluster 2020-11-16T22:07:00.986127+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e395: 12 total, 12 up, 12 in 2020-11-16T22:07:01.978 INFO:tasks.rados.rados.2.smithi057.stdout:1388: done (1 left) 2020-11-16T22:07:01.979 INFO:tasks.rados.rados.2.smithi057.stdout:1389: copy_from oid 36 from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 164 2020-11-16T22:07:01.979 INFO:tasks.rados.rados.2.smithi057.stdout:1387: done (1 left) 2020-11-16T22:07:01.979 INFO:tasks.rados.rados.2.smithi057.stdout:1390: read oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:01.979 INFO:tasks.rados.rados.2.smithi057.stdout:1390: expect deleted 2020-11-16T22:07:01.980 INFO:tasks.rados.rados.2.smithi057.stdout:1391: snap_create 2020-11-16T22:07:02.006 INFO:tasks.rados.rados.2.smithi057.stdout:1389: finishing copy_from to smithi05720651-36 2020-11-16T22:07:02.006 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 1290 (ObjNum 450 snap 150 seq_num 450) dirty exists 2020-11-16T22:07:02.006 INFO:tasks.rados.rados.2.smithi057.stdout:1389: finishing copy_from racing read to smithi05720651-36 2020-11-16T22:07:02.337 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:07:01 smithi016 bash[19825]: debug 2020-11-16T22:07:01.990+0000 7f0e16c22700 -1 osd.7 pg_epoch: 396 pg[2.8( v 396'1096 (0'0,396'1096] local-lis/les=71/72 n=6 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [7,9] r=0 lpr=71 luod=391'1094 crt=396'1096 lcod 387'1093 mlcod 387'1093 active+clean+snaptrim trimq=[12e~1] ps=[13b~1]] removing snap head 2020-11-16T22:07:02.445 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:07:02 smithi057 bash[12595]: debug 2020-11-16T22:07:01.999+0000 7f737819a700 -1 osd.8 pg_epoch: 396 pg[2.f( v 382'89 (0'0,382'89] local-lis/les=71/72 n=2 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,9] r=0 lpr=71 crt=382'89 lcod 379'87 mlcod 379'87 active+clean+snaptrim trimq=[12e~1] ps=[13b~1]] removing snap head 2020-11-16T22:07:02.980 INFO:tasks.rados.rados.2.smithi057.stdout:1389: done (2 left) 2020-11-16T22:07:02.980 INFO:tasks.rados.rados.2.smithi057.stdout:1390: done (1 left) 2020-11-16T22:07:02.981 INFO:tasks.rados.rados.2.smithi057.stdout:1391: done (0 left) 2020-11-16T22:07:02.981 INFO:tasks.rados.rados.2.smithi057.stdout:1392: copy_from oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 165 2020-11-16T22:07:02.981 INFO:tasks.rados.rados.2.smithi057.stdout:1393: write oid 2 current snap is 165 2020-11-16T22:07:02.981 INFO:tasks.rados.rados.2.smithi057.stdout:1393: seq_num 474 ranges {766518=481912,1837406=542493,2933675=527287,3876584=89934} 2020-11-16T22:07:02.995 INFO:tasks.rados.rados.2.smithi057.stdout:1393: writing smithi05720651-2 from 766518 to 1248430 tid 1 2020-11-16T22:07:03.002 INFO:tasks.rados.rados.2.smithi057.stdout:1393: writing smithi05720651-2 from 1837406 to 2379899 tid 2 2020-11-16T22:07:03.008 INFO:tasks.rados.rados.2.smithi057.stdout:1393: writing smithi05720651-2 from 2933675 to 3460962 tid 3 2020-11-16T22:07:03.011 INFO:tasks.rados.rados.2.smithi057.stdout:1393: writing smithi05720651-2 from 3876584 to 3966518 tid 4 2020-11-16T22:07:03.011 INFO:tasks.rados.rados.2.smithi057.stdout:1394: rollback oid 48 current snap is 165 2020-11-16T22:07:03.012 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 48 to 156 2020-11-16T22:07:03.012 INFO:tasks.rados.rados.2.smithi057.stdout:1395: snap_create 2020-11-16T22:07:03.013 INFO:tasks.rados.rados.2.smithi057.stdout:1393: finishing write tid 1 to smithi05720651-2 2020-11-16T22:07:03.016 INFO:tasks.rados.rados.2.smithi057.stdout:1393: finishing write tid 2 to smithi05720651-2 2020-11-16T22:07:03.016 INFO:tasks.rados.rados.2.smithi057.stdout:1392: finishing copy_from to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:03.017 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 974 (ObjNum 469 snap 158 seq_num 469) dirty exists 2020-11-16T22:07:03.017 INFO:tasks.rados.rados.2.smithi057.stdout:1393: finishing write tid 3 to smithi05720651-2 2020-11-16T22:07:03.017 INFO:tasks.rados.rados.2.smithi057.stdout:1392: finishing copy_from racing read to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:03.017 INFO:tasks.rados.rados.2.smithi057.stdout:1394: finishing rollback tid 0 to smithi05720651-48 2020-11-16T22:07:03.018 INFO:tasks.rados.rados.2.smithi057.stdout:1394: finishing rollback tid 1 to smithi05720651-48 2020-11-16T22:07:03.018 INFO:tasks.rados.rados.2.smithi057.stdout:1393: finishing write tid 4 to smithi05720651-2 2020-11-16T22:07:03.121 INFO:tasks.rados.rados.2.smithi057.stdout:1393: finishing write tid 6 to smithi05720651-2 2020-11-16T22:07:03.122 INFO:tasks.rados.rados.2.smithi057.stdout:1393: finishing write tid 7 to smithi05720651-2 2020-11-16T22:07:03.122 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 1347 (ObjNum 474 snap 165 seq_num 474) dirty exists 2020-11-16T22:07:03.122 INFO:tasks.rados.rados.2.smithi057.stdout:1393: left oid 2 (ObjNum 474 snap 165 seq_num 474) 2020-11-16T22:07:03.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:02 smithi016 bash[10302]: cluster 2020-11-16T22:07:01.674761+0000 mgr.x (mgr.24115) 432 : cluster [DBG] pgmap v757: 17 pgs: 17 active+clean; 152 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2020-11-16T22:07:03.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:02 smithi016 bash[10302]: cluster 2020-11-16T22:07:01.988270+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e396: 12 total, 12 up, 12 in 2020-11-16T22:07:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:02 smithi195 bash[10218]: cluster 2020-11-16T22:07:01.674761+0000 mgr.x (mgr.24115) 432 : cluster [DBG] pgmap v757: 17 pgs: 17 active+clean; 152 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2020-11-16T22:07:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:02 smithi195 bash[10218]: cluster 2020-11-16T22:07:01.988270+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e396: 12 total, 12 up, 12 in 2020-11-16T22:07:03.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:02 smithi057 bash[10301]: cluster 2020-11-16T22:07:01.674761+0000 mgr.x (mgr.24115) 432 : cluster [DBG] pgmap v757: 17 pgs: 17 active+clean; 152 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2020-11-16T22:07:03.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:02 smithi057 bash[10301]: cluster 2020-11-16T22:07:01.988270+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e396: 12 total, 12 up, 12 in 2020-11-16T22:07:03.873 INFO:tasks.rados.rados.2.smithi057.stdout:1394: finishing rollback tid 2 to smithi05720651-48 2020-11-16T22:07:03.874 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 977 (ObjNum 410 snap 138 seq_num 410) dirty exists 2020-11-16T22:07:03.996 INFO:tasks.rados.rados.2.smithi057.stdout:1392: done (3 left) 2020-11-16T22:07:03.996 INFO:tasks.rados.rados.2.smithi057.stdout:1393: done (2 left) 2020-11-16T22:07:03.997 INFO:tasks.rados.rados.2.smithi057.stdout:1394: done (1 left) 2020-11-16T22:07:03.997 INFO:tasks.rados.rados.2.smithi057.stdout:1395: done (0 left) 2020-11-16T22:07:03.997 INFO:tasks.rados.rados.2.smithi057.stdout:1396: snap_remove snap 165 2020-11-16T22:07:04.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:04 smithi016 bash[10302]: cluster 2020-11-16T22:07:02.990545+0000 mon.a (mon.0) 1048 : cluster [DBG] osdmap e397: 12 total, 12 up, 12 in 2020-11-16T22:07:04.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:04 smithi195 bash[10218]: cluster 2020-11-16T22:07:02.990545+0000 mon.a (mon.0) 1048 : cluster [DBG] osdmap e397: 12 total, 12 up, 12 in 2020-11-16T22:07:04.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:04 smithi057 bash[10301]: cluster 2020-11-16T22:07:02.990545+0000 mon.a (mon.0) 1048 : cluster [DBG] osdmap e397: 12 total, 12 up, 12 in 2020-11-16T22:07:04.965 INFO:tasks.rados.rados.2.smithi057.stdout:1396: done (0 left) 2020-11-16T22:07:04.966 INFO:tasks.rados.rados.2.smithi057.stdout:1397: write (excl) oid 48 current snap is 166 2020-11-16T22:07:04.966 INFO:tasks.rados.rados.2.smithi057.stdout:1397: seq_num 475 ranges {783325=557161,1779535=686151,3244745=454912} 2020-11-16T22:07:04.979 INFO:tasks.rados.rados.2.smithi057.stdout:1397: writing smithi05720651-48 from 783325 to 1340486 tid 1 2020-11-16T22:07:04.986 INFO:tasks.rados.rados.2.smithi057.stdout:1397: writing smithi05720651-48 from 1779535 to 2465686 tid 2 2020-11-16T22:07:04.993 INFO:tasks.rados.rados.2.smithi057.stdout:1397: writing smithi05720651-48 from 3244745 to 3699657 tid 3 2020-11-16T22:07:04.994 INFO:tasks.rados.rados.2.smithi057.stdout:1398: write oid 30 current snap is 166 2020-11-16T22:07:04.994 INFO:tasks.rados.rados.2.smithi057.stdout:1398: seq_num 476 ranges {400132=632410,1438017=546162} 2020-11-16T22:07:04.999 INFO:tasks.rados.rados.2.smithi057.stdout:1398: writing smithi05720651-30 from 400132 to 1032542 tid 1 2020-11-16T22:07:05.005 INFO:tasks.rados.rados.2.smithi057.stdout:1398: writing smithi05720651-30 from 1438017 to 1984179 tid 2 2020-11-16T22:07:05.006 INFO:tasks.rados.rados.2.smithi057.stdout:1399: snap_create 2020-11-16T22:07:05.006 INFO:tasks.rados.rados.2.smithi057.stdout:1397: finishing write tid 1 to smithi05720651-48 2020-11-16T22:07:05.006 INFO:tasks.rados.rados.2.smithi057.stdout:1397: finishing write tid 2 to smithi05720651-48 2020-11-16T22:07:05.006 INFO:tasks.rados.rados.2.smithi057.stdout:1397: finishing write tid 3 to smithi05720651-48 2020-11-16T22:07:05.006 INFO:tasks.rados.rados.2.smithi057.stdout:1397: finishing write tid 5 to smithi05720651-48 2020-11-16T22:07:05.006 INFO:tasks.rados.rados.2.smithi057.stdout:1397: finishing write tid 6 to smithi05720651-48 2020-11-16T22:07:05.006 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 981 (ObjNum 475 snap 166 seq_num 475) dirty exists 2020-11-16T22:07:05.007 INFO:tasks.rados.rados.2.smithi057.stdout:1397: left oid 48 (ObjNum 475 snap 166 seq_num 475) 2020-11-16T22:07:05.013 INFO:tasks.rados.rados.2.smithi057.stdout:1398: finishing write tid 1 to smithi05720651-30 2020-11-16T22:07:05.013 INFO:tasks.rados.rados.2.smithi057.stdout:1398: finishing write tid 2 to smithi05720651-30 2020-11-16T22:07:05.014 INFO:tasks.rados.rados.2.smithi057.stdout:1398: finishing write tid 4 to smithi05720651-30 2020-11-16T22:07:05.014 INFO:tasks.rados.rados.2.smithi057.stdout:1398: finishing write tid 5 to smithi05720651-30 2020-11-16T22:07:05.014 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 1101 (ObjNum 476 snap 166 seq_num 476) dirty exists 2020-11-16T22:07:05.015 INFO:tasks.rados.rados.2.smithi057.stdout:1398: left oid 30 (ObjNum 476 snap 166 seq_num 476) 2020-11-16T22:07:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:05 smithi016 bash[10302]: cluster 2020-11-16T22:07:03.675481+0000 mgr.x (mgr.24115) 433 : cluster [DBG] pgmap v760: 17 pgs: 17 active+clean; 150 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2020-11-16T22:07:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:05 smithi016 bash[10302]: cluster 2020-11-16T22:07:04.007254+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e398: 12 total, 12 up, 12 in 2020-11-16T22:07:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:05 smithi016 bash[10302]: cluster 2020-11-16T22:07:04.975801+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e399: 12 total, 12 up, 12 in 2020-11-16T22:07:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:05 smithi195 bash[10218]: cluster 2020-11-16T22:07:03.675481+0000 mgr.x (mgr.24115) 433 : cluster [DBG] pgmap v760: 17 pgs: 17 active+clean; 150 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2020-11-16T22:07:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:05 smithi195 bash[10218]: cluster 2020-11-16T22:07:04.007254+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e398: 12 total, 12 up, 12 in 2020-11-16T22:07:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:05 smithi195 bash[10218]: cluster 2020-11-16T22:07:04.975801+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e399: 12 total, 12 up, 12 in 2020-11-16T22:07:05.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:05 smithi057 bash[10301]: cluster 2020-11-16T22:07:03.675481+0000 mgr.x (mgr.24115) 433 : cluster [DBG] pgmap v760: 17 pgs: 17 active+clean; 150 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.7 MiB/s wr, 11 op/s 2020-11-16T22:07:05.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:05 smithi057 bash[10301]: cluster 2020-11-16T22:07:04.007254+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e398: 12 total, 12 up, 12 in 2020-11-16T22:07:05.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:05 smithi057 bash[10301]: cluster 2020-11-16T22:07:04.975801+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e399: 12 total, 12 up, 12 in 2020-11-16T22:07:06.008 INFO:tasks.rados.rados.2.smithi057.stdout:1397: done (2 left) 2020-11-16T22:07:06.008 INFO:tasks.rados.rados.2.smithi057.stdout:1398: done (1 left) 2020-11-16T22:07:06.008 INFO:tasks.rados.rados.2.smithi057.stdout:1399: done (0 left) 2020-11-16T22:07:06.008 INFO:tasks.rados.rados.2.smithi057.stdout:1400: write (excl) oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 167 2020-11-16T22:07:06.009 INFO:tasks.rados.rados.2.smithi057.stdout:1400: seq_num 477 ranges {416939=707659,1896499=120440} 2020-11-16T22:07:06.018 INFO:tasks.rados.rados.2.smithi057.stdout:1400: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 416939 to 1124598 tid 1 2020-11-16T22:07:06.024 INFO:tasks.rados.rados.2.smithi057.stdout:1400: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1896499 to 2016939 tid 2 2020-11-16T22:07:06.024 INFO:tasks.rados.rados.2.smithi057.stdout:1401: copy_from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 167 2020-11-16T22:07:06.024 INFO:tasks.rados.rados.2.smithi057.stdout:1402: rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 167 2020-11-16T22:07:06.024 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 157 2020-11-16T22:07:06.024 INFO:tasks.rados.rados.2.smithi057.stdout:1403: snap_create 2020-11-16T22:07:06.026 INFO:tasks.rados.rados.2.smithi057.stdout:1400: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:06.030 INFO:tasks.rados.rados.2.smithi057.stdout:1400: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:06.031 INFO:tasks.rados.rados.2.smithi057.stdout:1400: finishing write tid 4 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:06.032 INFO:tasks.rados.rados.2.smithi057.stdout:1400: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:06.032 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 955 (ObjNum 477 snap 167 seq_num 477) dirty exists 2020-11-16T22:07:06.032 INFO:tasks.rados.rados.2.smithi057.stdout:1400: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 477 snap 167 seq_num 477) 2020-11-16T22:07:06.033 INFO:tasks.rados.rados.2.smithi057.stdout:1402: finishing rollback tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:06.033 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1091 (ObjNum 385 snap 0 seq_num 2931900096) dirty dne 2020-11-16T22:07:06.049 INFO:tasks.rados.rados.2.smithi057.stdout:1401: finishing copy_from to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:06.049 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 919 (ObjNum 327 snap 111 seq_num 327) dirty exists 2020-11-16T22:07:06.049 INFO:tasks.rados.rados.2.smithi057.stdout:1401: finishing copy_from racing read to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:07.010 INFO:tasks.rados.rados.2.smithi057.stdout:1400: done (3 left) 2020-11-16T22:07:07.010 INFO:tasks.rados.rados.2.smithi057.stdout:1401: done (2 left) 2020-11-16T22:07:07.010 INFO:tasks.rados.rados.2.smithi057.stdout:1402: done (1 left) 2020-11-16T22:07:07.011 INFO:tasks.rados.rados.2.smithi057.stdout:1403: done (0 left) 2020-11-16T22:07:07.011 INFO:tasks.rados.rados.2.smithi057.stdout:1404: delete oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 168 2020-11-16T22:07:07.021 INFO:tasks.rados.rados.2.smithi057.stdout:1404: done (0 left) 2020-11-16T22:07:07.021 INFO:tasks.rados.rados.2.smithi057.stdout:1405: write (excl) oid 4 current snap is 168 2020-11-16T22:07:07.022 INFO:tasks.rados.rados.2.smithi057.stdout:1405: seq_num 479 ranges {450553=574510,1613463=437090} 2020-11-16T22:07:07.037 INFO:tasks.rados.rados.2.smithi057.stdout:1405: writing smithi05720651-4 from 450553 to 1025063 tid 1 2020-11-16T22:07:07.043 INFO:tasks.rados.rados.2.smithi057.stdout:1405: writing smithi05720651-4 from 1613463 to 2050553 tid 2 2020-11-16T22:07:07.043 INFO:tasks.rados.rados.2.smithi057.stdout:1406: copy_from oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 26 current snap is 168 2020-11-16T22:07:07.043 INFO:tasks.rados.rados.2.smithi057.stdout:1407: snap_remove snap 160 2020-11-16T22:07:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:07 smithi016 bash[10302]: cluster 2020-11-16T22:07:05.676186+0000 mgr.x (mgr.24115) 434 : cluster [DBG] pgmap v763: 17 pgs: 17 active+clean; 147 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.6 MiB/s wr, 3 op/s 2020-11-16T22:07:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:07 smithi016 bash[10302]: cluster 2020-11-16T22:07:06.017625+0000 mon.a (mon.0) 1051 : cluster [DBG] osdmap e400: 12 total, 12 up, 12 in 2020-11-16T22:07:07.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:07 smithi195 bash[10218]: cluster 2020-11-16T22:07:05.676186+0000 mgr.x (mgr.24115) 434 : cluster [DBG] pgmap v763: 17 pgs: 17 active+clean; 147 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.6 MiB/s wr, 3 op/s 2020-11-16T22:07:07.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:07 smithi195 bash[10218]: cluster 2020-11-16T22:07:06.017625+0000 mon.a (mon.0) 1051 : cluster [DBG] osdmap e400: 12 total, 12 up, 12 in 2020-11-16T22:07:07.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:07 smithi057 bash[10301]: cluster 2020-11-16T22:07:05.676186+0000 mgr.x (mgr.24115) 434 : cluster [DBG] pgmap v763: 17 pgs: 17 active+clean; 147 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.6 MiB/s wr, 3 op/s 2020-11-16T22:07:07.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:07 smithi057 bash[10301]: cluster 2020-11-16T22:07:06.017625+0000 mon.a (mon.0) 1051 : cluster [DBG] osdmap e400: 12 total, 12 up, 12 in 2020-11-16T22:07:08.030 INFO:tasks.rados.rados.2.smithi057.stdout:1407: done (2 left) 2020-11-16T22:07:08.031 INFO:tasks.rados.rados.2.smithi057.stdout:1408: delete oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 168 2020-11-16T22:07:08.234 INFO:tasks.rados.rados.2.smithi057.stdout:1405: finishing write tid 1 to smithi05720651-4 2020-11-16T22:07:08.234 INFO:tasks.rados.rados.2.smithi057.stdout:1406: finishing copy_from to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:08.234 INFO:tasks.rados.rados.2.smithi057.stdout:1406: got expected ENOENT (src dne) 2020-11-16T22:07:08.234 INFO:tasks.rados.rados.2.smithi057.stdout:1405: finishing write tid 2 to smithi05720651-4 2020-11-16T22:07:08.235 INFO:tasks.rados.rados.2.smithi057.stdout:1406: finishing copy_from racing read to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:08.235 INFO:tasks.rados.rados.2.smithi057.stdout:1405: finishing write tid 4 to smithi05720651-4 2020-11-16T22:07:08.235 INFO:tasks.rados.rados.2.smithi057.stdout:1405: finishing write tid 5 to smithi05720651-4 2020-11-16T22:07:08.235 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 1071 (ObjNum 479 snap 168 seq_num 479) dirty exists 2020-11-16T22:07:08.235 INFO:tasks.rados.rados.2.smithi057.stdout:1405: left oid 4 (ObjNum 479 snap 168 seq_num 479) 2020-11-16T22:07:08.237 INFO:tasks.rados.rados.2.smithi057.stdout:1405: done (2 left) 2020-11-16T22:07:08.237 INFO:tasks.rados.rados.2.smithi057.stdout:1406: done (1 left) 2020-11-16T22:07:08.237 INFO:tasks.rados.rados.2.smithi057.stdout:1408: done (0 left) 2020-11-16T22:07:08.238 INFO:tasks.rados.rados.2.smithi057.stdout:1409: write oid 10 current snap is 168 2020-11-16T22:07:08.238 INFO:tasks.rados.rados.2.smithi057.stdout:1409: seq_num 481 ranges {484167=725008,1730427=353740} 2020-11-16T22:07:08.238 INFO:tasks.rados.rados.2.smithi057.stdout:1409: writing smithi05720651-10 from 484167 to 1209175 tid 1 2020-11-16T22:07:08.238 INFO:tasks.rados.rados.2.smithi057.stdout:1409: writing smithi05720651-10 from 1730427 to 2084167 tid 2 2020-11-16T22:07:08.238 INFO:tasks.rados.rados.2.smithi057.stdout:1410: write (excl) oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 168 2020-11-16T22:07:08.446 INFO:tasks.rados.rados.2.smithi057.stdout:1410: seq_num 482 ranges {500974=400257,1388909=557169} 2020-11-16T22:07:08.446 INFO:tasks.rados.rados.2.smithi057.stdout:1410: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 500974 to 901231 tid 1 2020-11-16T22:07:08.446 INFO:tasks.rados.rados.2.smithi057.stdout:1410: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1388909 to 1946078 tid 2 2020-11-16T22:07:08.447 INFO:tasks.rados.rados.2.smithi057.stdout:1411: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:08.447 INFO:tasks.rados.rados.2.smithi057.stdout:1411: expect (ObjNum 327 snap 111 seq_num 327) 2020-11-16T22:07:08.447 INFO:tasks.rados.rados.2.smithi057.stdout:1412: write oid 40 current snap is 168 2020-11-16T22:07:08.447 INFO:tasks.rados.rados.2.smithi057.stdout:1412: seq_num 483 ranges {517781=475506,1731038=386743} 2020-11-16T22:07:08.447 INFO:tasks.rados.rados.2.smithi057.stdout:1412: writing smithi05720651-40 from 517781 to 993287 tid 1 2020-11-16T22:07:08.447 INFO:tasks.rados.rados.2.smithi057.stdout:1412: writing smithi05720651-40 from 1731038 to 2117781 tid 2 2020-11-16T22:07:08.447 INFO:tasks.rados.rados.2.smithi057.stdout:1413: rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 168 2020-11-16T22:07:08.448 INFO:tasks.rados.rados.2.smithi057.stdout:1409: finishing write tid 1 to smithi05720651-10 2020-11-16T22:07:08.448 INFO:tasks.rados.rados.2.smithi057.stdout:1409: finishing write tid 2 to smithi05720651-10 2020-11-16T22:07:08.448 INFO:tasks.rados.rados.2.smithi057.stdout:1409: finishing write tid 4 to smithi05720651-10 2020-11-16T22:07:08.448 INFO:tasks.rados.rados.2.smithi057.stdout:1410: finishing write tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:08.448 INFO:tasks.rados.rados.2.smithi057.stdout:1410: finishing write tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:08.448 INFO:tasks.rados.rados.2.smithi057.stdout:1410: finishing write tid 4 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:08.448 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 156 2020-11-16T22:07:08.449 INFO:tasks.rados.rados.2.smithi057.stdout:1410: finishing write tid 5 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:08.449 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1105 (ObjNum 482 snap 168 seq_num 482) dirty exists 2020-11-16T22:07:08.449 INFO:tasks.rados.rados.2.smithi057.stdout:1410: left oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 482 snap 168 seq_num 482) 2020-11-16T22:07:08.449 INFO:tasks.rados.rados.2.smithi057.stdout:1410: done (4 left) 2020-11-16T22:07:08.449 INFO:tasks.rados.rados.2.smithi057.stdout:1414: read oid 20 snap -1 2020-11-16T22:07:08.449 INFO:tasks.rados.rados.2.smithi057.stdout:1414: expect (ObjNum 447 snap 150 seq_num 447) 2020-11-16T22:07:08.449 INFO:tasks.rados.rados.2.smithi057.stdout:1415: read oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 161 2020-11-16T22:07:08.449 INFO:tasks.rados.rados.2.smithi057.stdout:1415: expect (ObjNum 432 snap 145 seq_num 432) 2020-11-16T22:07:08.450 INFO:tasks.rados.rados.2.smithi057.stdout:1416: snap_remove snap 167 2020-11-16T22:07:08.451 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:08 smithi195 bash[10218]: cluster 2020-11-16T22:07:07.020366+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e401: 12 total, 12 up, 12 in 2020-11-16T22:07:08.451 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:08 smithi016 bash[10302]: cluster 2020-11-16T22:07:07.020366+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e401: 12 total, 12 up, 12 in 2020-11-16T22:07:08.451 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:08 smithi057 bash[10301]: cluster 2020-11-16T22:07:07.020366+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e401: 12 total, 12 up, 12 in 2020-11-16T22:07:09.039 INFO:tasks.rados.rados.2.smithi057.stdout:1416: done (6 left) 2020-11-16T22:07:09.039 INFO:tasks.rados.rados.2.smithi057.stdout:1417: write oid 4 current snap is 168 2020-11-16T22:07:09.039 INFO:tasks.rados.rados.2.smithi057.stdout:1417: seq_num 484 ranges {534588=550755,1789520=345068} 2020-11-16T22:07:09.049 INFO:tasks.rados.rados.2.smithi057.stdout:1417: writing smithi05720651-4 from 534588 to 1085343 tid 1 2020-11-16T22:07:09.055 INFO:tasks.rados.rados.2.smithi057.stdout:1417: writing smithi05720651-4 from 1789520 to 2134588 tid 2 2020-11-16T22:07:09.055 INFO:tasks.rados.rados.2.smithi057.stdout:1418: write oid 46 current snap is 168 2020-11-16T22:07:09.056 INFO:tasks.rados.rados.2.smithi057.stdout:1418: seq_num 485 ranges {551395=626004,1848002=303393} 2020-11-16T22:07:09.062 INFO:tasks.rados.rados.2.smithi057.stdout:1418: writing smithi05720651-46 from 551395 to 1177399 tid 1 2020-11-16T22:07:09.068 INFO:tasks.rados.rados.2.smithi057.stdout:1418: writing smithi05720651-46 from 1848002 to 2151395 tid 2 2020-11-16T22:07:09.068 INFO:tasks.rados.rados.2.smithi057.stdout:1419: read oid 24 snap -1 2020-11-16T22:07:09.068 INFO:tasks.rados.rados.2.smithi057.stdout:1419: expect (ObjNum 445 snap 150 seq_num 445) 2020-11-16T22:07:09.068 INFO:tasks.rados.rados.2.smithi057.stdout:1420: delete oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 168 2020-11-16T22:07:09.068 INFO:tasks.rados.rados.2.smithi057.stdout:1411: expect (ObjNum 327 snap 111 seq_num 327) 2020-11-16T22:07:09.216 INFO:tasks.rados.rados.2.smithi057.stdout:1412: finishing write tid 1 to smithi05720651-40 2020-11-16T22:07:09.216 INFO:tasks.rados.rados.2.smithi057.stdout:1412: finishing write tid 2 to smithi05720651-40 2020-11-16T22:07:09.217 INFO:tasks.rados.rados.2.smithi057.stdout:1411: done (9 left) 2020-11-16T22:07:09.217 INFO:tasks.rados.rados.2.smithi057.stdout:1420: done (8 left) 2020-11-16T22:07:09.217 INFO:tasks.rados.rados.2.smithi057.stdout:1421: snap_create 2020-11-16T22:07:09.217 INFO:tasks.rados.rados.2.smithi057.stdout:1414: expect (ObjNum 447 snap 150 seq_num 447) 2020-11-16T22:07:09.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:09 smithi016 bash[10302]: cluster 2020-11-16T22:07:07.676872+0000 mgr.x (mgr.24115) 435 : cluster [DBG] pgmap v766: 17 pgs: 17 active+clean; 158 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2020-11-16T22:07:09.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:09 smithi016 bash[10302]: cluster 2020-11-16T22:07:08.038203+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e402: 12 total, 12 up, 12 in 2020-11-16T22:07:09.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:09 smithi195 bash[10218]: cluster 2020-11-16T22:07:07.676872+0000 mgr.x (mgr.24115) 435 : cluster [DBG] pgmap v766: 17 pgs: 17 active+clean; 158 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2020-11-16T22:07:09.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:09 smithi195 bash[10218]: cluster 2020-11-16T22:07:08.038203+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e402: 12 total, 12 up, 12 in 2020-11-16T22:07:09.365 INFO:tasks.rados.rados.2.smithi057.stdout:1415: expect (ObjNum 432 snap 145 seq_num 432) 2020-11-16T22:07:09.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:09 smithi057 bash[10301]: cluster 2020-11-16T22:07:07.676872+0000 mgr.x (mgr.24115) 435 : cluster [DBG] pgmap v766: 17 pgs: 17 active+clean; 158 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2020-11-16T22:07:09.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:09 smithi057 bash[10301]: cluster 2020-11-16T22:07:08.038203+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e402: 12 total, 12 up, 12 in 2020-11-16T22:07:09.545 INFO:tasks.rados.rados.2.smithi057.stdout:1412: finishing write tid 4 to smithi05720651-40 2020-11-16T22:07:09.545 INFO:tasks.rados.rados.2.smithi057.stdout:1412: finishing write tid 5 to smithi05720651-40 2020-11-16T22:07:09.545 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 1350 (ObjNum 483 snap 168 seq_num 483) dirty exists 2020-11-16T22:07:09.545 INFO:tasks.rados.rados.2.smithi057.stdout:1412: left oid 40 (ObjNum 483 snap 168 seq_num 483) 2020-11-16T22:07:09.545 INFO:tasks.rados.rados.2.smithi057.stdout:1413: finishing rollback tid 0 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:09.546 INFO:tasks.rados.rados.2.smithi057.stdout:1413: finishing rollback tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:09.546 INFO:tasks.rados.rados.2.smithi057.stdout:1413: finishing rollback tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:09.546 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 977 (ObjNum 436 snap 145 seq_num 436) dirty exists 2020-11-16T22:07:09.546 INFO:tasks.rados.rados.2.smithi057.stdout:1409: finishing write tid 5 to smithi05720651-10 2020-11-16T22:07:09.546 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 1293 (ObjNum 481 snap 168 seq_num 481) dirty exists 2020-11-16T22:07:09.546 INFO:tasks.rados.rados.2.smithi057.stdout:1409: left oid 10 (ObjNum 481 snap 168 seq_num 481) 2020-11-16T22:07:09.547 INFO:tasks.rados.rados.2.smithi057.stdout:1417: finishing write tid 1 to smithi05720651-4 2020-11-16T22:07:09.547 INFO:tasks.rados.rados.2.smithi057.stdout:1417: finishing write tid 2 to smithi05720651-4 2020-11-16T22:07:09.547 INFO:tasks.rados.rados.2.smithi057.stdout:1417: finishing write tid 4 to smithi05720651-4 2020-11-16T22:07:09.547 INFO:tasks.rados.rados.2.smithi057.stdout:1417: finishing write tid 5 to smithi05720651-4 2020-11-16T22:07:09.547 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 1074 (ObjNum 484 snap 168 seq_num 484) dirty exists 2020-11-16T22:07:09.547 INFO:tasks.rados.rados.2.smithi057.stdout:1417: left oid 4 (ObjNum 484 snap 168 seq_num 484) 2020-11-16T22:07:09.547 INFO:tasks.rados.rados.2.smithi057.stdout:1418: finishing write tid 1 to smithi05720651-46 2020-11-16T22:07:09.547 INFO:tasks.rados.rados.2.smithi057.stdout:1418: finishing write tid 2 to smithi05720651-46 2020-11-16T22:07:09.548 INFO:tasks.rados.rados.2.smithi057.stdout:1418: finishing write tid 4 to smithi05720651-46 2020-11-16T22:07:09.548 INFO:tasks.rados.rados.2.smithi057.stdout:1418: finishing write tid 5 to smithi05720651-46 2020-11-16T22:07:09.548 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 1108 (ObjNum 485 snap 168 seq_num 485) dirty exists 2020-11-16T22:07:09.548 INFO:tasks.rados.rados.2.smithi057.stdout:1418: left oid 46 (ObjNum 485 snap 168 seq_num 485) 2020-11-16T22:07:09.548 INFO:tasks.rados.rados.2.smithi057.stdout:1419: expect (ObjNum 445 snap 150 seq_num 445) 2020-11-16T22:07:09.968 INFO:tasks.rados.rados.2.smithi057.stdout:1409: done (8 left) 2020-11-16T22:07:09.969 INFO:tasks.rados.rados.2.smithi057.stdout:1412: done (7 left) 2020-11-16T22:07:09.969 INFO:tasks.rados.rados.2.smithi057.stdout:1413: done (6 left) 2020-11-16T22:07:09.969 INFO:tasks.rados.rados.2.smithi057.stdout:1414: done (5 left) 2020-11-16T22:07:09.969 INFO:tasks.rados.rados.2.smithi057.stdout:1415: done (4 left) 2020-11-16T22:07:09.969 INFO:tasks.rados.rados.2.smithi057.stdout:1417: done (3 left) 2020-11-16T22:07:09.969 INFO:tasks.rados.rados.2.smithi057.stdout:1418: done (2 left) 2020-11-16T22:07:09.970 INFO:tasks.rados.rados.2.smithi057.stdout:1419: done (1 left) 2020-11-16T22:07:09.970 INFO:tasks.rados.rados.2.smithi057.stdout:1421: done (0 left) 2020-11-16T22:07:09.970 INFO:tasks.rados.rados.2.smithi057.stdout:1422: rollback oid 44 current snap is 169 2020-11-16T22:07:09.971 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 44 to 156 2020-11-16T22:07:09.971 INFO:tasks.rados.rados.2.smithi057.stdout:1423: copy_from oid 2 from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 169 2020-11-16T22:07:09.971 INFO:tasks.rados.rados.2.smithi057.stdout:1424: snap_remove snap 157 2020-11-16T22:07:10.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:10 smithi016 bash[10302]: cluster 2020-11-16T22:07:09.047659+0000 mon.a (mon.0) 1054 : cluster [DBG] osdmap e403: 12 total, 12 up, 12 in 2020-11-16T22:07:10.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:10 smithi016 bash[10302]: cluster 2020-11-16T22:07:09.977529+0000 mon.a (mon.0) 1055 : cluster [DBG] osdmap e404: 12 total, 12 up, 12 in 2020-11-16T22:07:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:10 smithi195 bash[10218]: cluster 2020-11-16T22:07:09.047659+0000 mon.a (mon.0) 1054 : cluster [DBG] osdmap e403: 12 total, 12 up, 12 in 2020-11-16T22:07:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:10 smithi195 bash[10218]: cluster 2020-11-16T22:07:09.977529+0000 mon.a (mon.0) 1055 : cluster [DBG] osdmap e404: 12 total, 12 up, 12 in 2020-11-16T22:07:10.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:10 smithi057 bash[10301]: cluster 2020-11-16T22:07:09.047659+0000 mon.a (mon.0) 1054 : cluster [DBG] osdmap e403: 12 total, 12 up, 12 in 2020-11-16T22:07:10.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:10 smithi057 bash[10301]: cluster 2020-11-16T22:07:09.977529+0000 mon.a (mon.0) 1055 : cluster [DBG] osdmap e404: 12 total, 12 up, 12 in 2020-11-16T22:07:10.981 INFO:tasks.rados.rados.2.smithi057.stdout:1424: done (2 left) 2020-11-16T22:07:10.981 INFO:tasks.rados.rados.2.smithi057.stdout:1425: copy_from oid 48 from oid 36 current snap is 169 2020-11-16T22:07:10.981 INFO:tasks.rados.rados.2.smithi057.stdout:1422: finishing rollback tid 0 to smithi05720651-44 2020-11-16T22:07:10.981 INFO:tasks.rados.rados.2.smithi057.stdout:1422: finishing rollback tid 1 to smithi05720651-44 2020-11-16T22:07:10.981 INFO:tasks.rados.rados.2.smithi057.stdout:1422: finishing rollback tid 2 to smithi05720651-44 2020-11-16T22:07:10.982 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 878 (ObjNum 290 snap 99 seq_num 290) dirty exists 2020-11-16T22:07:10.982 INFO:tasks.rados.rados.2.smithi057.stdout:1423: finishing copy_from to smithi05720651-2 2020-11-16T22:07:10.982 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 1105 (ObjNum 482 snap 168 seq_num 482) dirty exists 2020-11-16T22:07:10.982 INFO:tasks.rados.rados.2.smithi057.stdout:1423: finishing copy_from racing read to smithi05720651-2 2020-11-16T22:07:10.982 INFO:tasks.rados.rados.2.smithi057.stdout:1422: done (2 left) 2020-11-16T22:07:10.982 INFO:tasks.rados.rados.2.smithi057.stdout:1423: done (1 left) 2020-11-16T22:07:10.982 INFO:tasks.rados.rados.2.smithi057.stdout:1426: copy_from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 169 2020-11-16T22:07:10.983 INFO:tasks.rados.rados.2.smithi057.stdout:1427: read oid 8 snap 161 2020-11-16T22:07:10.983 INFO:tasks.rados.rados.2.smithi057.stdout:1427: expect (ObjNum 371 snap 123 seq_num 371) 2020-11-16T22:07:10.983 INFO:tasks.rados.rados.2.smithi057.stdout:1428: snap_create 2020-11-16T22:07:10.991 INFO:tasks.rados.rados.2.smithi057.stdout:1427: expect (ObjNum 371 snap 123 seq_num 371) 2020-11-16T22:07:11.062 INFO:tasks.rados.rados.2.smithi057.stdout:1426: finishing copy_from to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:11.062 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1105 (ObjNum 482 snap 168 seq_num 482) dirty exists 2020-11-16T22:07:11.062 INFO:tasks.rados.rados.2.smithi057.stdout:1426: finishing copy_from racing read to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:11.062 INFO:tasks.rados.rados.2.smithi057.stdout:1425: finishing copy_from to smithi05720651-48 2020-11-16T22:07:11.062 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 1290 (ObjNum 450 snap 150 seq_num 450) dirty exists 2020-11-16T22:07:11.063 INFO:tasks.rados.rados.2.smithi057.stdout:1425: finishing copy_from racing read to smithi05720651-48 2020-11-16T22:07:11.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:11 smithi016 bash[10302]: cluster 2020-11-16T22:07:09.677571+0000 mgr.x (mgr.24115) 436 : cluster [DBG] pgmap v769: 17 pgs: 17 active+clean; 158 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.2 MiB/s wr, 7 op/s 2020-11-16T22:07:11.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:11 smithi016 bash[10302]: cluster 2020-11-16T22:07:10.988000+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e405: 12 total, 12 up, 12 in 2020-11-16T22:07:11.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:11 smithi195 bash[10218]: cluster 2020-11-16T22:07:09.677571+0000 mgr.x (mgr.24115) 436 : cluster [DBG] pgmap v769: 17 pgs: 17 active+clean; 158 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.2 MiB/s wr, 7 op/s 2020-11-16T22:07:11.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:11 smithi195 bash[10218]: cluster 2020-11-16T22:07:10.988000+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e405: 12 total, 12 up, 12 in 2020-11-16T22:07:11.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:11 smithi057 bash[10301]: cluster 2020-11-16T22:07:09.677571+0000 mgr.x (mgr.24115) 436 : cluster [DBG] pgmap v769: 17 pgs: 17 active+clean; 158 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.2 MiB/s wr, 7 op/s 2020-11-16T22:07:11.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:11 smithi057 bash[10301]: cluster 2020-11-16T22:07:10.988000+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e405: 12 total, 12 up, 12 in 2020-11-16T22:07:11.980 INFO:tasks.rados.rados.2.smithi057.stdout:1425: done (3 left) 2020-11-16T22:07:11.980 INFO:tasks.rados.rados.2.smithi057.stdout:1426: done (2 left) 2020-11-16T22:07:11.981 INFO:tasks.rados.rados.2.smithi057.stdout:1427: done (1 left) 2020-11-16T22:07:11.981 INFO:tasks.rados.rados.2.smithi057.stdout:1428: done (0 left) 2020-11-16T22:07:11.981 INFO:tasks.rados.rados.2.smithi057.stdout:1429: snap_remove snap 169 2020-11-16T22:07:12.984 INFO:tasks.rados.rados.2.smithi057.stdout:1429: done (0 left) 2020-11-16T22:07:12.984 INFO:tasks.rados.rados.2.smithi057.stdout:1430: write oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 170 2020-11-16T22:07:12.985 INFO:tasks.rados.rados.2.smithi057.stdout:1430: seq_num 487 ranges {585009=492855,1564966=620043} 2020-11-16T22:07:12.996 INFO:tasks.rados.rados.2.smithi057.stdout:1430: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 585009 to 1077864 tid 1 2020-11-16T22:07:13.003 INFO:tasks.rados.rados.2.smithi057.stdout:1430: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1564966 to 2185009 tid 2 2020-11-16T22:07:13.004 INFO:tasks.rados.rados.2.smithi057.stdout:1431: snap_remove snap 161 2020-11-16T22:07:13.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:12 smithi016 bash[10302]: cluster 2020-11-16T22:07:11.678278+0000 mgr.x (mgr.24115) 437 : cluster [DBG] pgmap v772: 17 pgs: 17 active+clean; 172 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2020-11-16T22:07:13.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:12 smithi016 bash[10302]: cluster 2020-11-16T22:07:11.990594+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e406: 12 total, 12 up, 12 in 2020-11-16T22:07:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:12 smithi195 bash[10218]: cluster 2020-11-16T22:07:11.678278+0000 mgr.x (mgr.24115) 437 : cluster [DBG] pgmap v772: 17 pgs: 17 active+clean; 172 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2020-11-16T22:07:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:12 smithi195 bash[10218]: cluster 2020-11-16T22:07:11.990594+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e406: 12 total, 12 up, 12 in 2020-11-16T22:07:13.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:13 smithi057 bash[10301]: cluster 2020-11-16T22:07:11.678278+0000 mgr.x (mgr.24115) 437 : cluster [DBG] pgmap v772: 17 pgs: 17 active+clean; 172 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2020-11-16T22:07:13.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:13 smithi057 bash[10301]: cluster 2020-11-16T22:07:11.990594+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e406: 12 total, 12 up, 12 in 2020-11-16T22:07:14.000 INFO:tasks.rados.rados.2.smithi057.stdout:1431: done (1 left) 2020-11-16T22:07:14.001 INFO:tasks.rados.rados.2.smithi057.stdout:1432: read oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:14.001 INFO:tasks.rados.rados.2.smithi057.stdout:1432: expect deleted 2020-11-16T22:07:14.001 INFO:tasks.rados.rados.2.smithi057.stdout:1433: snap_remove snap 158 2020-11-16T22:07:14.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:14 smithi016 bash[10302]: cluster 2020-11-16T22:07:12.993257+0000 mon.a (mon.0) 1058 : cluster [DBG] osdmap e407: 12 total, 12 up, 12 in 2020-11-16T22:07:14.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:14 smithi195 bash[10218]: cluster 2020-11-16T22:07:12.993257+0000 mon.a (mon.0) 1058 : cluster [DBG] osdmap e407: 12 total, 12 up, 12 in 2020-11-16T22:07:14.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:14 smithi057 bash[10301]: cluster 2020-11-16T22:07:12.993257+0000 mon.a (mon.0) 1058 : cluster [DBG] osdmap e407: 12 total, 12 up, 12 in 2020-11-16T22:07:14.969 INFO:tasks.rados.rados.2.smithi057.stdout:1433: done (2 left) 2020-11-16T22:07:14.969 INFO:tasks.rados.rados.2.smithi057.stdout:1434: snap_remove snap 168 2020-11-16T22:07:15.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:15 smithi016 bash[10302]: cluster 2020-11-16T22:07:13.678984+0000 mgr.x (mgr.24115) 438 : cluster [DBG] pgmap v775: 17 pgs: 17 active+clean; 175 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.3 MiB/s wr, 16 op/s 2020-11-16T22:07:15.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:15 smithi016 bash[10302]: cluster 2020-11-16T22:07:14.011657+0000 mon.a (mon.0) 1059 : cluster [DBG] osdmap e408: 12 total, 12 up, 12 in 2020-11-16T22:07:15.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:15 smithi016 bash[10302]: cluster 2020-11-16T22:07:14.979600+0000 mon.a (mon.0) 1060 : cluster [DBG] osdmap e409: 12 total, 12 up, 12 in 2020-11-16T22:07:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:15 smithi195 bash[10218]: cluster 2020-11-16T22:07:13.678984+0000 mgr.x (mgr.24115) 438 : cluster [DBG] pgmap v775: 17 pgs: 17 active+clean; 175 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.3 MiB/s wr, 16 op/s 2020-11-16T22:07:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:15 smithi195 bash[10218]: cluster 2020-11-16T22:07:14.011657+0000 mon.a (mon.0) 1059 : cluster [DBG] osdmap e408: 12 total, 12 up, 12 in 2020-11-16T22:07:15.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:15 smithi195 bash[10218]: cluster 2020-11-16T22:07:14.979600+0000 mon.a (mon.0) 1060 : cluster [DBG] osdmap e409: 12 total, 12 up, 12 in 2020-11-16T22:07:15.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:15 smithi057 bash[10301]: cluster 2020-11-16T22:07:13.678984+0000 mgr.x (mgr.24115) 438 : cluster [DBG] pgmap v775: 17 pgs: 17 active+clean; 175 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 3.3 MiB/s wr, 16 op/s 2020-11-16T22:07:15.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:15 smithi057 bash[10301]: cluster 2020-11-16T22:07:14.011657+0000 mon.a (mon.0) 1059 : cluster [DBG] osdmap e408: 12 total, 12 up, 12 in 2020-11-16T22:07:15.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:15 smithi057 bash[10301]: cluster 2020-11-16T22:07:14.979600+0000 mon.a (mon.0) 1060 : cluster [DBG] osdmap e409: 12 total, 12 up, 12 in 2020-11-16T22:07:15.979 INFO:tasks.rados.rados.2.smithi057.stdout:1434: done (2 left) 2020-11-16T22:07:15.980 INFO:tasks.rados.rados.2.smithi057.stdout:1435: snap_create 2020-11-16T22:07:15.980 INFO:tasks.rados.rados.2.smithi057.stdout:1430: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:15.980 INFO:tasks.rados.rados.2.smithi057.stdout:1430: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:15.980 INFO:tasks.rados.rados.2.smithi057.stdout:1430: finishing write tid 4 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:15.980 INFO:tasks.rados.rados.2.smithi057.stdout:1430: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:15.981 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1197 (ObjNum 487 snap 170 seq_num 487) dirty exists 2020-11-16T22:07:15.981 INFO:tasks.rados.rados.2.smithi057.stdout:1430: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 487 snap 170 seq_num 487) 2020-11-16T22:07:16.990 INFO:tasks.rados.rados.2.smithi057.stdout:1430: done (2 left) 2020-11-16T22:07:16.991 INFO:tasks.rados.rados.2.smithi057.stdout:1432: done (1 left) 2020-11-16T22:07:16.991 INFO:tasks.rados.rados.2.smithi057.stdout:1435: done (0 left) 2020-11-16T22:07:16.991 INFO:tasks.rados.rados.2.smithi057.stdout:1436: read oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 163 2020-11-16T22:07:16.991 INFO:tasks.rados.rados.2.smithi057.stdout:1436: expect (ObjNum 432 snap 145 seq_num 432) 2020-11-16T22:07:16.991 INFO:tasks.rados.rados.2.smithi057.stdout:1437: delete oid 28 current snap is 171 2020-11-16T22:07:16.999 INFO:tasks.rados.rados.2.smithi057.stdout:1437: done (1 left) 2020-11-16T22:07:16.999 INFO:tasks.rados.rados.2.smithi057.stdout:1438: read oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 170 2020-11-16T22:07:16.999 INFO:tasks.rados.rados.2.smithi057.stdout:1438: expect (ObjNum 445 snap 150 seq_num 445) 2020-11-16T22:07:16.999 INFO:tasks.rados.rados.2.smithi057.stdout:1439: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:17.000 INFO:tasks.rados.rados.2.smithi057.stdout:1439: expect (ObjNum 415 snap 140 seq_num 415) 2020-11-16T22:07:17.000 INFO:tasks.rados.rados.2.smithi057.stdout:1440: read oid 46 snap -1 2020-11-16T22:07:17.000 INFO:tasks.rados.rados.2.smithi057.stdout:1440: expect (ObjNum 485 snap 168 seq_num 485) 2020-11-16T22:07:17.000 INFO:tasks.rados.rados.2.smithi057.stdout:1441: snap_create 2020-11-16T22:07:17.002 INFO:tasks.rados.rados.2.smithi057.stdout:1436: expect (ObjNum 432 snap 145 seq_num 432) 2020-11-16T22:07:17.194 INFO:tasks.rados.rados.2.smithi057.stdout:1439: expect (ObjNum 415 snap 140 seq_num 415) 2020-11-16T22:07:17.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:16 smithi016 bash[10302]: cluster 2020-11-16T22:07:15.679694+0000 mgr.x (mgr.24115) 439 : cluster [DBG] pgmap v778: 17 pgs: 17 active+clean; 179 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 1.8 MiB/s wr, 8 op/s 2020-11-16T22:07:17.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:16 smithi016 bash[10302]: cluster 2020-11-16T22:07:15.990866+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e410: 12 total, 12 up, 12 in 2020-11-16T22:07:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:16 smithi195 bash[10218]: cluster 2020-11-16T22:07:15.679694+0000 mgr.x (mgr.24115) 439 : cluster [DBG] pgmap v778: 17 pgs: 17 active+clean; 179 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 1.8 MiB/s wr, 8 op/s 2020-11-16T22:07:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:16 smithi195 bash[10218]: cluster 2020-11-16T22:07:15.990866+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e410: 12 total, 12 up, 12 in 2020-11-16T22:07:17.368 INFO:tasks.rados.rados.2.smithi057.stdout:1438: expect (ObjNum 445 snap 150 seq_num 445) 2020-11-16T22:07:17.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:16 smithi057 bash[10301]: cluster 2020-11-16T22:07:15.679694+0000 mgr.x (mgr.24115) 439 : cluster [DBG] pgmap v778: 17 pgs: 17 active+clean; 179 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 1.8 MiB/s wr, 8 op/s 2020-11-16T22:07:17.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:16 smithi057 bash[10301]: cluster 2020-11-16T22:07:15.990866+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e410: 12 total, 12 up, 12 in 2020-11-16T22:07:17.509 INFO:tasks.rados.rados.2.smithi057.stdout:1440: expect (ObjNum 485 snap 168 seq_num 485) 2020-11-16T22:07:17.998 INFO:tasks.rados.rados.2.smithi057.stdout:1436: done (4 left) 2020-11-16T22:07:17.998 INFO:tasks.rados.rados.2.smithi057.stdout:1438: done (3 left) 2020-11-16T22:07:17.999 INFO:tasks.rados.rados.2.smithi057.stdout:1439: done (2 left) 2020-11-16T22:07:17.999 INFO:tasks.rados.rados.2.smithi057.stdout:1440: done (1 left) 2020-11-16T22:07:17.999 INFO:tasks.rados.rados.2.smithi057.stdout:1441: done (0 left) 2020-11-16T22:07:17.999 INFO:tasks.rados.rados.2.smithi057.stdout:1442: snap_remove snap 166 2020-11-16T22:07:18.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:18 smithi016 bash[10302]: cluster 2020-11-16T22:07:16.999066+0000 mon.a (mon.0) 1062 : cluster [DBG] osdmap e411: 12 total, 12 up, 12 in 2020-11-16T22:07:18.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:18 smithi195 bash[10218]: cluster 2020-11-16T22:07:16.999066+0000 mon.a (mon.0) 1062 : cluster [DBG] osdmap e411: 12 total, 12 up, 12 in 2020-11-16T22:07:18.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:18 smithi057 bash[10301]: cluster 2020-11-16T22:07:16.999066+0000 mon.a (mon.0) 1062 : cluster [DBG] osdmap e411: 12 total, 12 up, 12 in 2020-11-16T22:07:19.007 INFO:tasks.rados.rados.2.smithi057.stdout:1442: done (0 left) 2020-11-16T22:07:19.008 INFO:tasks.rados.rados.2.smithi057.stdout:1443: write oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 172 2020-11-16T22:07:19.008 INFO:tasks.rados.rados.2.smithi057.stdout:1443: seq_num 489 ranges {618623=643353,1681930=536693} 2020-11-16T22:07:19.013 INFO:tasks.rados.rados.2.smithi057.stdout:1443: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 618623 to 1261976 tid 1 2020-11-16T22:07:19.019 INFO:tasks.rados.rados.2.smithi057.stdout:1443: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1681930 to 2218623 tid 2 2020-11-16T22:07:19.019 INFO:tasks.rados.rados.2.smithi057.stdout:1444: write oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 172 2020-11-16T22:07:19.019 INFO:tasks.rados.rados.2.smithi057.stdout:1444: seq_num 490 ranges {635430=718602,2140412=95018} 2020-11-16T22:07:19.027 INFO:tasks.rados.rados.2.smithi057.stdout:1444: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 635430 to 1354032 tid 1 2020-11-16T22:07:19.032 INFO:tasks.rados.rados.2.smithi057.stdout:1444: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2140412 to 2235430 tid 2 2020-11-16T22:07:19.032 INFO:tasks.rados.rados.2.smithi057.stdout:1445: snap_create 2020-11-16T22:07:19.032 INFO:tasks.rados.rados.2.smithi057.stdout:1443: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:19.032 INFO:tasks.rados.rados.2.smithi057.stdout:1443: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:19.033 INFO:tasks.rados.rados.2.smithi057.stdout:1443: finishing write tid 4 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:19.033 INFO:tasks.rados.rados.2.smithi057.stdout:1443: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:19.033 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1215 (ObjNum 489 snap 172 seq_num 489) dirty exists 2020-11-16T22:07:19.033 INFO:tasks.rados.rados.2.smithi057.stdout:1443: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 489 snap 172 seq_num 489) 2020-11-16T22:07:19.037 INFO:tasks.rados.rados.2.smithi057.stdout:1444: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:19.037 INFO:tasks.rados.rados.2.smithi057.stdout:1444: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:19.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:19 smithi016 bash[10302]: cluster 2020-11-16T22:07:17.680385+0000 mgr.x (mgr.24115) 440 : cluster [DBG] pgmap v781: 17 pgs: 17 active+clean; 179 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 785 KiB/s wr, 4 op/s 2020-11-16T22:07:19.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:19 smithi016 bash[10302]: cluster 2020-11-16T22:07:18.008561+0000 mon.a (mon.0) 1063 : cluster [DBG] osdmap e412: 12 total, 12 up, 12 in 2020-11-16T22:07:19.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:19 smithi195 bash[10218]: cluster 2020-11-16T22:07:17.680385+0000 mgr.x (mgr.24115) 440 : cluster [DBG] pgmap v781: 17 pgs: 17 active+clean; 179 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 785 KiB/s wr, 4 op/s 2020-11-16T22:07:19.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:19 smithi195 bash[10218]: cluster 2020-11-16T22:07:18.008561+0000 mon.a (mon.0) 1063 : cluster [DBG] osdmap e412: 12 total, 12 up, 12 in 2020-11-16T22:07:19.421 INFO:tasks.rados.rados.2.smithi057.stdout:1444: finishing write tid 4 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:19.422 INFO:tasks.rados.rados.2.smithi057.stdout:1444: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:19.422 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 958 (ObjNum 490 snap 172 seq_num 490) dirty exists 2020-11-16T22:07:19.422 INFO:tasks.rados.rados.2.smithi057.stdout:1444: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 490 snap 172 seq_num 490) 2020-11-16T22:07:19.445 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:07:19 smithi057 bash[19569]: debug 2020-11-16T22:07:19.015+0000 7f5e11115700 -1 osd.11 pg_epoch: 413 pg[2.c( v 413'305 (0'0,413'305] local-lis/les=71/72 n=4 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [11,0] r=0 lpr=71 luod=410'303 crt=413'305 lcod 409'301 mlcod 409'301 active+clean+snaptrim trimq=[145~1] ps=[139~2,13e~1,149~1,14b~1]] removing snap head 2020-11-16T22:07:19.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:19 smithi057 bash[10301]: cluster 2020-11-16T22:07:17.680385+0000 mgr.x (mgr.24115) 440 : cluster [DBG] pgmap v781: 17 pgs: 17 active+clean; 179 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 785 KiB/s wr, 4 op/s 2020-11-16T22:07:19.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:19 smithi057 bash[10301]: cluster 2020-11-16T22:07:18.008561+0000 mon.a (mon.0) 1063 : cluster [DBG] osdmap e412: 12 total, 12 up, 12 in 2020-11-16T22:07:19.971 INFO:tasks.rados.rados.2.smithi057.stdout:1443: done (2 left) 2020-11-16T22:07:19.972 INFO:tasks.rados.rados.2.smithi057.stdout:1444: done (1 left) 2020-11-16T22:07:19.972 INFO:tasks.rados.rados.2.smithi057.stdout:1445: done (0 left) 2020-11-16T22:07:19.972 INFO:tasks.rados.rados.2.smithi057.stdout:1446: copy_from oid 16 from oid 24 current snap is 173 2020-11-16T22:07:19.972 INFO:tasks.rados.rados.2.smithi057.stdout:1447: copy_from oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 26 current snap is 173 2020-11-16T22:07:19.972 INFO:tasks.rados.rados.2.smithi057.stdout:1448: snap_create 2020-11-16T22:07:19.980 INFO:tasks.rados.rados.2.smithi057.stdout:1447: finishing copy_from to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:19.980 INFO:tasks.rados.rados.2.smithi057.stdout:1447: got expected ENOENT (src dne) 2020-11-16T22:07:19.980 INFO:tasks.rados.rados.2.smithi057.stdout:1447: finishing copy_from racing read to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:19.994 INFO:tasks.rados.rados.2.smithi057.stdout:1446: finishing copy_from to smithi05720651-16 2020-11-16T22:07:19.994 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 999 (ObjNum 445 snap 150 seq_num 445) dirty exists 2020-11-16T22:07:19.994 INFO:tasks.rados.rados.2.smithi057.stdout:1446: finishing copy_from racing read to smithi05720651-16 2020-11-16T22:07:20.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:20 smithi016 bash[10302]: cluster 2020-11-16T22:07:19.010803+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e413: 12 total, 12 up, 12 in 2020-11-16T22:07:20.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:20 smithi016 bash[10302]: cluster 2020-11-16T22:07:19.982045+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e414: 12 total, 12 up, 12 in 2020-11-16T22:07:20.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:20 smithi195 bash[10218]: cluster 2020-11-16T22:07:19.010803+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e413: 12 total, 12 up, 12 in 2020-11-16T22:07:20.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:20 smithi195 bash[10218]: cluster 2020-11-16T22:07:19.982045+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e414: 12 total, 12 up, 12 in 2020-11-16T22:07:20.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:20 smithi057 bash[10301]: cluster 2020-11-16T22:07:19.010803+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e413: 12 total, 12 up, 12 in 2020-11-16T22:07:20.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:20 smithi057 bash[10301]: cluster 2020-11-16T22:07:19.982045+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e414: 12 total, 12 up, 12 in 2020-11-16T22:07:20.981 INFO:tasks.rados.rados.2.smithi057.stdout:1446: done (2 left) 2020-11-16T22:07:20.982 INFO:tasks.rados.rados.2.smithi057.stdout:1447: done (1 left) 2020-11-16T22:07:20.982 INFO:tasks.rados.rados.2.smithi057.stdout:1448: done (0 left) 2020-11-16T22:07:20.982 INFO:tasks.rados.rados.2.smithi057.stdout:1449: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:20.982 INFO:tasks.rados.rados.2.smithi057.stdout:1449: expect (ObjNum 450 snap 150 seq_num 450) 2020-11-16T22:07:20.982 INFO:tasks.rados.rados.2.smithi057.stdout:1450: snap_remove snap 171 2020-11-16T22:07:21.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:21 smithi016 bash[10302]: cluster 2020-11-16T22:07:19.681075+0000 mgr.x (mgr.24115) 441 : cluster [DBG] pgmap v784: 17 pgs: 17 active+clean; 179 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:07:21.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:21 smithi016 bash[10302]: cluster 2020-11-16T22:07:20.992507+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e415: 12 total, 12 up, 12 in 2020-11-16T22:07:21.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:21 smithi195 bash[10218]: cluster 2020-11-16T22:07:19.681075+0000 mgr.x (mgr.24115) 441 : cluster [DBG] pgmap v784: 17 pgs: 17 active+clean; 179 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:07:21.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:21 smithi195 bash[10218]: cluster 2020-11-16T22:07:20.992507+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e415: 12 total, 12 up, 12 in 2020-11-16T22:07:21.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:21 smithi057 bash[10301]: cluster 2020-11-16T22:07:19.681075+0000 mgr.x (mgr.24115) 441 : cluster [DBG] pgmap v784: 17 pgs: 17 active+clean; 179 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:07:21.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:21 smithi057 bash[10301]: cluster 2020-11-16T22:07:20.992507+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e415: 12 total, 12 up, 12 in 2020-11-16T22:07:21.989 INFO:tasks.rados.rados.2.smithi057.stdout:1450: done (1 left) 2020-11-16T22:07:21.989 INFO:tasks.rados.rados.2.smithi057.stdout:1451: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:21.989 INFO:tasks.rados.rados.2.smithi057.stdout:1451: expect (ObjNum 408 snap 137 seq_num 408) 2020-11-16T22:07:21.989 INFO:tasks.rados.rados.2.smithi057.stdout:1452: copy_from oid 42 from oid 46 current snap is 174 2020-11-16T22:07:21.990 INFO:tasks.rados.rados.2.smithi057.stdout:1449: expect (ObjNum 450 snap 150 seq_num 450) 2020-11-16T22:07:22.280 INFO:tasks.rados.rados.2.smithi057.stdout:1451: expect (ObjNum 408 snap 137 seq_num 408) 2020-11-16T22:07:22.428 INFO:tasks.rados.rados.2.smithi057.stdout:1452: finishing copy_from to smithi05720651-42 2020-11-16T22:07:22.428 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 1108 (ObjNum 485 snap 168 seq_num 485) dirty exists 2020-11-16T22:07:22.428 INFO:tasks.rados.rados.2.smithi057.stdout:1452: finishing copy_from racing read to smithi05720651-42 2020-11-16T22:07:22.428 INFO:tasks.rados.rados.2.smithi057.stdout:1449: done (2 left) 2020-11-16T22:07:22.428 INFO:tasks.rados.rados.2.smithi057.stdout:1451: done (1 left) 2020-11-16T22:07:22.428 INFO:tasks.rados.rados.2.smithi057.stdout:1452: done (0 left) 2020-11-16T22:07:22.429 INFO:tasks.rados.rados.2.smithi057.stdout:1453: delete oid 4 current snap is 174 2020-11-16T22:07:22.432 INFO:tasks.rados.rados.2.smithi057.stdout:1453: done (0 left) 2020-11-16T22:07:22.433 INFO:tasks.rados.rados.2.smithi057.stdout:1454: rollback oid 26 current snap is 174 2020-11-16T22:07:22.433 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 26 to 153 2020-11-16T22:07:22.433 INFO:tasks.rados.rados.2.smithi057.stdout:1455: rollback oid 6 current snap is 174 2020-11-16T22:07:22.433 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 6 to 172 2020-11-16T22:07:22.433 INFO:tasks.rados.rados.2.smithi057.stdout:1456: rollback oid 48 current snap is 174 2020-11-16T22:07:22.433 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 48 to 156 2020-11-16T22:07:22.434 INFO:tasks.rados.rados.2.smithi057.stdout:1457: snap_create 2020-11-16T22:07:22.434 INFO:tasks.rados.rados.2.smithi057.stdout:1454: finishing rollback tid 1 to smithi05720651-26 2020-11-16T22:07:22.434 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 0 (ObjNum 129 snap 0 seq_num 2932455520) dirty dne 2020-11-16T22:07:22.437 INFO:tasks.rados.rados.2.smithi057.stdout:1456: finishing rollback tid 0 to smithi05720651-48 2020-11-16T22:07:22.438 INFO:tasks.rados.rados.2.smithi057.stdout:1456: finishing rollback tid 1 to smithi05720651-48 2020-11-16T22:07:22.439 INFO:tasks.rados.rados.2.smithi057.stdout:1456: finishing rollback tid 2 to smithi05720651-48 2020-11-16T22:07:22.439 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 1293 (ObjNum 410 snap 138 seq_num 410) dirty exists 2020-11-16T22:07:22.440 INFO:tasks.rados.rados.2.smithi057.stdout:1455: finishing rollback tid 0 to smithi05720651-6 2020-11-16T22:07:22.440 INFO:tasks.rados.rados.2.smithi057.stdout:1455: finishing rollback tid 1 to smithi05720651-6 2020-11-16T22:07:22.441 INFO:tasks.rados.rados.2.smithi057.stdout:1455: finishing rollback tid 2 to smithi05720651-6 2020-11-16T22:07:22.442 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 1221 (ObjNum 429 snap 144 seq_num 429) dirty exists 2020-11-16T22:07:23.036 INFO:tasks.rados.rados.2.smithi057.stdout:1454: done (3 left) 2020-11-16T22:07:23.036 INFO:tasks.rados.rados.2.smithi057.stdout:1455: done (2 left) 2020-11-16T22:07:23.037 INFO:tasks.rados.rados.2.smithi057.stdout:1456: done (1 left) 2020-11-16T22:07:23.037 INFO:tasks.rados.rados.2.smithi057.stdout:1457: done (0 left) 2020-11-16T22:07:23.037 INFO:tasks.rados.rados.2.smithi057.stdout:1458: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 173 2020-11-16T22:07:23.037 INFO:tasks.rados.rados.2.smithi057.stdout:1458: expect (ObjNum 408 snap 137 seq_num 408) 2020-11-16T22:07:23.037 INFO:tasks.rados.rados.2.smithi057.stdout:1459: snap_remove snap 164 2020-11-16T22:07:23.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:22 smithi016 bash[10302]: cluster 2020-11-16T22:07:21.681843+0000 mgr.x (mgr.24115) 442 : cluster [DBG] pgmap v787: 17 pgs: 17 active+clean; 182 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2020-11-16T22:07:23.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:22 smithi016 bash[10302]: cluster 2020-11-16T22:07:21.996396+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e416: 12 total, 12 up, 12 in 2020-11-16T22:07:23.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:22 smithi195 bash[10218]: cluster 2020-11-16T22:07:21.681843+0000 mgr.x (mgr.24115) 442 : cluster [DBG] pgmap v787: 17 pgs: 17 active+clean; 182 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2020-11-16T22:07:23.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:22 smithi195 bash[10218]: cluster 2020-11-16T22:07:21.996396+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e416: 12 total, 12 up, 12 in 2020-11-16T22:07:23.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:22 smithi057 bash[10301]: cluster 2020-11-16T22:07:21.681843+0000 mgr.x (mgr.24115) 442 : cluster [DBG] pgmap v787: 17 pgs: 17 active+clean; 182 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.3 MiB/s wr, 11 op/s 2020-11-16T22:07:23.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:22 smithi057 bash[10301]: cluster 2020-11-16T22:07:21.996396+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e416: 12 total, 12 up, 12 in 2020-11-16T22:07:24.047 INFO:tasks.rados.rados.2.smithi057.stdout:1459: done (1 left) 2020-11-16T22:07:24.047 INFO:tasks.rados.rados.2.smithi057.stdout:1460: copy_from oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 16 current snap is 175 2020-11-16T22:07:24.047 INFO:tasks.rados.rados.2.smithi057.stdout:1458: expect (ObjNum 408 snap 137 seq_num 408) 2020-11-16T22:07:24.207 INFO:tasks.rados.rados.2.smithi057.stdout:1460: finishing copy_from to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:24.207 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 999 (ObjNum 445 snap 150 seq_num 445) dirty exists 2020-11-16T22:07:24.207 INFO:tasks.rados.rados.2.smithi057.stdout:1460: finishing copy_from racing read to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:24.208 INFO:tasks.rados.rados.2.smithi057.stdout:1458: done (1 left) 2020-11-16T22:07:24.208 INFO:tasks.rados.rados.2.smithi057.stdout:1460: done (0 left) 2020-11-16T22:07:24.208 INFO:tasks.rados.rados.2.smithi057.stdout:1461: snap_remove snap 174 2020-11-16T22:07:24.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:24 smithi016 bash[10302]: cluster 2020-11-16T22:07:23.046685+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e417: 12 total, 12 up, 12 in 2020-11-16T22:07:24.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:24 smithi195 bash[10218]: cluster 2020-11-16T22:07:23.046685+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e417: 12 total, 12 up, 12 in 2020-11-16T22:07:24.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:24 smithi057 bash[10301]: cluster 2020-11-16T22:07:23.046685+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e417: 12 total, 12 up, 12 in 2020-11-16T22:07:24.975 INFO:tasks.rados.rados.2.smithi057.stdout:1461: done (0 left) 2020-11-16T22:07:24.976 INFO:tasks.rados.rados.2.smithi057.stdout:1462: snap_create 2020-11-16T22:07:25.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:25 smithi016 bash[10302]: cluster 2020-11-16T22:07:23.682581+0000 mgr.x (mgr.24115) 443 : cluster [DBG] pgmap v790: 17 pgs: 17 active+clean; 179 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2020-11-16T22:07:25.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:25 smithi016 bash[10302]: cluster 2020-11-16T22:07:24.056845+0000 mon.a (mon.0) 1069 : cluster [DBG] osdmap e418: 12 total, 12 up, 12 in 2020-11-16T22:07:25.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:25 smithi016 bash[10302]: cluster 2020-11-16T22:07:24.983511+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e419: 12 total, 12 up, 12 in 2020-11-16T22:07:25.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:25 smithi195 bash[10218]: cluster 2020-11-16T22:07:23.682581+0000 mgr.x (mgr.24115) 443 : cluster [DBG] pgmap v790: 17 pgs: 17 active+clean; 179 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2020-11-16T22:07:25.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:25 smithi195 bash[10218]: cluster 2020-11-16T22:07:24.056845+0000 mon.a (mon.0) 1069 : cluster [DBG] osdmap e418: 12 total, 12 up, 12 in 2020-11-16T22:07:25.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:25 smithi195 bash[10218]: cluster 2020-11-16T22:07:24.983511+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e419: 12 total, 12 up, 12 in 2020-11-16T22:07:25.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:25 smithi057 bash[10301]: cluster 2020-11-16T22:07:23.682581+0000 mgr.x (mgr.24115) 443 : cluster [DBG] pgmap v790: 17 pgs: 17 active+clean; 179 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.3 MiB/s wr, 12 op/s 2020-11-16T22:07:25.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:25 smithi057 bash[10301]: cluster 2020-11-16T22:07:24.056845+0000 mon.a (mon.0) 1069 : cluster [DBG] osdmap e418: 12 total, 12 up, 12 in 2020-11-16T22:07:25.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:25 smithi057 bash[10301]: cluster 2020-11-16T22:07:24.983511+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e419: 12 total, 12 up, 12 in 2020-11-16T22:07:25.984 INFO:tasks.rados.rados.2.smithi057.stdout:1462: done (0 left) 2020-11-16T22:07:25.985 INFO:tasks.rados.rados.2.smithi057.stdout:1463: read oid 48 snap -1 2020-11-16T22:07:25.985 INFO:tasks.rados.rados.2.smithi057.stdout:1463: expect (ObjNum 410 snap 138 seq_num 410) 2020-11-16T22:07:25.985 INFO:tasks.rados.rados.2.smithi057.stdout:1464: delete oid 14 current snap is 176 2020-11-16T22:07:25.993 INFO:tasks.rados.rados.2.smithi057.stdout:1464: done (1 left) 2020-11-16T22:07:25.993 INFO:tasks.rados.rados.2.smithi057.stdout:1465: read oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 173 2020-11-16T22:07:25.994 INFO:tasks.rados.rados.2.smithi057.stdout:1465: expect (ObjNum 441 snap 148 seq_num 441) 2020-11-16T22:07:25.994 INFO:tasks.rados.rados.2.smithi057.stdout:1466: copy_from oid 16 from oid 2 current snap is 176 2020-11-16T22:07:25.994 INFO:tasks.rados.rados.2.smithi057.stdout:1467: rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 176 2020-11-16T22:07:25.995 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 163 2020-11-16T22:07:25.995 INFO:tasks.rados.rados.2.smithi057.stdout:1468: delete oid 32 current snap is 176 2020-11-16T22:07:25.995 INFO:tasks.rados.rados.2.smithi057.stdout:1463: expect (ObjNum 410 snap 138 seq_num 410) 2020-11-16T22:07:26.209 INFO:tasks.rados.rados.2.smithi057.stdout:1467: finishing rollback tid 0 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:26.210 INFO:tasks.rados.rados.2.smithi057.stdout:1467: finishing rollback tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:26.210 INFO:tasks.rados.rados.2.smithi057.stdout:1467: finishing rollback tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:26.210 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1111 (ObjNum 469 snap 158 seq_num 469) dirty exists 2020-11-16T22:07:26.210 INFO:tasks.rados.rados.2.smithi057.stdout:1465: expect (ObjNum 441 snap 148 seq_num 441) 2020-11-16T22:07:26.394 INFO:tasks.rados.rados.2.smithi057.stdout:1466: finishing copy_from to smithi05720651-16 2020-11-16T22:07:26.394 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 1105 (ObjNum 482 snap 168 seq_num 482) dirty exists 2020-11-16T22:07:26.394 INFO:tasks.rados.rados.2.smithi057.stdout:1466: finishing copy_from racing read to smithi05720651-16 2020-11-16T22:07:26.394 INFO:tasks.rados.rados.2.smithi057.stdout:1463: done (4 left) 2020-11-16T22:07:26.394 INFO:tasks.rados.rados.2.smithi057.stdout:1465: done (3 left) 2020-11-16T22:07:26.395 INFO:tasks.rados.rados.2.smithi057.stdout:1466: done (2 left) 2020-11-16T22:07:26.395 INFO:tasks.rados.rados.2.smithi057.stdout:1467: done (1 left) 2020-11-16T22:07:26.395 INFO:tasks.rados.rados.2.smithi057.stdout:1468: done (0 left) 2020-11-16T22:07:26.395 INFO:tasks.rados.rados.2.smithi057.stdout:1469: delete oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 176 2020-11-16T22:07:26.399 INFO:tasks.rados.rados.2.smithi057.stdout:1469: done (0 left) 2020-11-16T22:07:26.400 INFO:tasks.rados.rados.2.smithi057.stdout:1470: snap_remove snap 163 2020-11-16T22:07:27.053 INFO:tasks.rados.rados.2.smithi057.stdout:1470: done (0 left) 2020-11-16T22:07:27.053 INFO:tasks.rados.rados.2.smithi057.stdout:1471: write (excl) oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 176 2020-11-16T22:07:27.053 INFO:tasks.rados.rados.2.smithi057.stdout:1471: seq_num 495 ranges {719465=411200,1632822=686643} 2020-11-16T22:07:27.064 INFO:tasks.rados.rados.2.smithi057.stdout:1471: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 719465 to 1130665 tid 1 2020-11-16T22:07:27.072 INFO:tasks.rados.rados.2.smithi057.stdout:1471: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1632822 to 2319465 tid 2 2020-11-16T22:07:27.072 INFO:tasks.rados.rados.2.smithi057.stdout:1472: rollback oid 16 current snap is 176 2020-11-16T22:07:27.072 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 16 to 162 2020-11-16T22:07:27.072 INFO:tasks.rados.rados.2.smithi057.stdout:1473: snap_remove snap 153 2020-11-16T22:07:27.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:26 smithi016 bash[10302]: cluster 2020-11-16T22:07:25.683315+0000 mgr.x (mgr.24115) 444 : cluster [DBG] pgmap v793: 17 pgs: 17 active+clean; 182 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 849 KiB/s wr, 3 op/s 2020-11-16T22:07:27.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:26 smithi016 bash[10302]: cluster 2020-11-16T22:07:25.995366+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e420: 12 total, 12 up, 12 in 2020-11-16T22:07:27.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:26 smithi195 bash[10218]: cluster 2020-11-16T22:07:25.683315+0000 mgr.x (mgr.24115) 444 : cluster [DBG] pgmap v793: 17 pgs: 17 active+clean; 182 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 849 KiB/s wr, 3 op/s 2020-11-16T22:07:27.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:26 smithi195 bash[10218]: cluster 2020-11-16T22:07:25.995366+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e420: 12 total, 12 up, 12 in 2020-11-16T22:07:27.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:26 smithi057 bash[10301]: cluster 2020-11-16T22:07:25.683315+0000 mgr.x (mgr.24115) 444 : cluster [DBG] pgmap v793: 17 pgs: 17 active+clean; 182 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 849 KiB/s wr, 3 op/s 2020-11-16T22:07:27.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:26 smithi057 bash[10301]: cluster 2020-11-16T22:07:25.995366+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e420: 12 total, 12 up, 12 in 2020-11-16T22:07:28.064 INFO:tasks.rados.rados.2.smithi057.stdout:1473: done (2 left) 2020-11-16T22:07:28.064 INFO:tasks.rados.rados.2.smithi057.stdout:1474: snap_create 2020-11-16T22:07:28.064 INFO:tasks.rados.rados.2.smithi057.stdout:1471: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:28.064 INFO:tasks.rados.rados.2.smithi057.stdout:1472: finishing rollback tid 0 to smithi05720651-16 2020-11-16T22:07:28.064 INFO:tasks.rados.rados.2.smithi057.stdout:1472: finishing rollback tid 1 to smithi05720651-16 2020-11-16T22:07:28.065 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 1114 (ObjNum 33 snap 0 seq_num 2932643232) dirty dne 2020-11-16T22:07:28.065 INFO:tasks.rados.rados.2.smithi057.stdout:1471: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:28.065 INFO:tasks.rados.rados.2.smithi057.stdout:1471: finishing write tid 4 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:28.065 INFO:tasks.rados.rados.2.smithi057.stdout:1471: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:28.065 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1239 (ObjNum 495 snap 176 seq_num 495) dirty exists 2020-11-16T22:07:28.065 INFO:tasks.rados.rados.2.smithi057.stdout:1471: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 495 snap 176 seq_num 495) 2020-11-16T22:07:28.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:28 smithi016 bash[10302]: cluster 2020-11-16T22:07:27.064494+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e421: 12 total, 12 up, 12 in 2020-11-16T22:07:28.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:28 smithi195 bash[10218]: cluster 2020-11-16T22:07:27.064494+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e421: 12 total, 12 up, 12 in 2020-11-16T22:07:28.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:28 smithi057 bash[10301]: cluster 2020-11-16T22:07:27.064494+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e421: 12 total, 12 up, 12 in 2020-11-16T22:07:29.065 INFO:tasks.rados.rados.2.smithi057.stdout:1471: done (2 left) 2020-11-16T22:07:29.065 INFO:tasks.rados.rados.2.smithi057.stdout:1472: done (1 left) 2020-11-16T22:07:29.065 INFO:tasks.rados.rados.2.smithi057.stdout:1474: done (0 left) 2020-11-16T22:07:29.066 INFO:tasks.rados.rados.2.smithi057.stdout:1475: write oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 177 2020-11-16T22:07:29.066 INFO:tasks.rados.rados.2.smithi057.stdout:1475: seq_num 496 ranges {736272=486449,1974951=361321} 2020-11-16T22:07:29.079 INFO:tasks.rados.rados.2.smithi057.stdout:1475: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 736272 to 1222721 tid 1 2020-11-16T22:07:29.085 INFO:tasks.rados.rados.2.smithi057.stdout:1475: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1974951 to 2336272 tid 2 2020-11-16T22:07:29.086 INFO:tasks.rados.rados.2.smithi057.stdout:1476: snap_remove snap 175 2020-11-16T22:07:29.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:29 smithi016 bash[10302]: cluster 2020-11-16T22:07:27.684023+0000 mgr.x (mgr.24115) 445 : cluster [DBG] pgmap v796: 17 pgs: 17 active+clean; 186 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2020-11-16T22:07:29.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:29 smithi016 bash[10302]: cluster 2020-11-16T22:07:28.072751+0000 mon.a (mon.0) 1073 : cluster [DBG] osdmap e422: 12 total, 12 up, 12 in 2020-11-16T22:07:29.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:29 smithi195 bash[10218]: cluster 2020-11-16T22:07:27.684023+0000 mgr.x (mgr.24115) 445 : cluster [DBG] pgmap v796: 17 pgs: 17 active+clean; 186 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2020-11-16T22:07:29.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:29 smithi195 bash[10218]: cluster 2020-11-16T22:07:28.072751+0000 mon.a (mon.0) 1073 : cluster [DBG] osdmap e422: 12 total, 12 up, 12 in 2020-11-16T22:07:29.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:29 smithi057 bash[10301]: cluster 2020-11-16T22:07:27.684023+0000 mgr.x (mgr.24115) 445 : cluster [DBG] pgmap v796: 17 pgs: 17 active+clean; 186 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2020-11-16T22:07:29.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:29 smithi057 bash[10301]: cluster 2020-11-16T22:07:28.072751+0000 mon.a (mon.0) 1073 : cluster [DBG] osdmap e422: 12 total, 12 up, 12 in 2020-11-16T22:07:29.975 INFO:tasks.rados.rados.2.smithi057.stdout:1476: done (1 left) 2020-11-16T22:07:29.975 INFO:tasks.rados.rados.2.smithi057.stdout:1477: copy_from oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 16 current snap is 177 2020-11-16T22:07:29.976 INFO:tasks.rados.rados.2.smithi057.stdout:1475: finishing write tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:29.976 INFO:tasks.rados.rados.2.smithi057.stdout:1475: finishing write tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:29.976 INFO:tasks.rados.rados.2.smithi057.stdout:1475: finishing write tid 4 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:29.976 INFO:tasks.rados.rados.2.smithi057.stdout:1475: finishing write tid 5 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:29.976 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1297 (ObjNum 496 snap 177 seq_num 496) dirty exists 2020-11-16T22:07:29.976 INFO:tasks.rados.rados.2.smithi057.stdout:1475: left oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 496 snap 177 seq_num 496) 2020-11-16T22:07:29.976 INFO:tasks.rados.rados.2.smithi057.stdout:1475: done (1 left) 2020-11-16T22:07:29.977 INFO:tasks.rados.rados.2.smithi057.stdout:1478: copy_from oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 177 2020-11-16T22:07:29.977 INFO:tasks.rados.rados.2.smithi057.stdout:1479: write (excl) oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 177 2020-11-16T22:07:29.977 INFO:tasks.rados.rados.2.smithi057.stdout:1479: seq_num 497 ranges {753079=561698,2033433=319646} 2020-11-16T22:07:29.991 INFO:tasks.rados.rados.2.smithi057.stdout:1479: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 753079 to 1314777 tid 1 2020-11-16T22:07:29.997 INFO:tasks.rados.rados.2.smithi057.stdout:1479: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2033433 to 2353079 tid 2 2020-11-16T22:07:29.997 INFO:tasks.rados.rados.2.smithi057.stdout:1480: snap_remove snap 162 2020-11-16T22:07:30.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:30 smithi016 bash[10302]: cluster 2020-11-16T22:07:29.075455+0000 mon.a (mon.0) 1074 : cluster [DBG] osdmap e423: 12 total, 12 up, 12 in 2020-11-16T22:07:30.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:30 smithi016 bash[10302]: audit 2020-11-16T22:07:29.740254+0000 mon.b (mon.1) 295 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:07:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:30 smithi016 bash[10302]: audit 2020-11-16T22:07:29.742168+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:07:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:30 smithi016 bash[10302]: audit 2020-11-16T22:07:29.748946+0000 mon.b (mon.1) 296 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:07:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:30 smithi016 bash[10302]: audit 2020-11-16T22:07:29.750439+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:07:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:30 smithi016 bash[10302]: cluster 2020-11-16T22:07:29.984944+0000 mon.a (mon.0) 1077 : cluster [DBG] osdmap e424: 12 total, 12 up, 12 in 2020-11-16T22:07:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:30 smithi195 bash[10218]: cluster 2020-11-16T22:07:29.075455+0000 mon.a (mon.0) 1074 : cluster [DBG] osdmap e423: 12 total, 12 up, 12 in 2020-11-16T22:07:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:30 smithi195 bash[10218]: audit 2020-11-16T22:07:29.740254+0000 mon.b (mon.1) 295 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:07:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:30 smithi195 bash[10218]: audit 2020-11-16T22:07:29.742168+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:07:30.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:30 smithi195 bash[10218]: audit 2020-11-16T22:07:29.748946+0000 mon.b (mon.1) 296 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:07:30.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:30 smithi195 bash[10218]: audit 2020-11-16T22:07:29.750439+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:07:30.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:30 smithi195 bash[10218]: cluster 2020-11-16T22:07:29.984944+0000 mon.a (mon.0) 1077 : cluster [DBG] osdmap e424: 12 total, 12 up, 12 in 2020-11-16T22:07:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:30 smithi057 bash[10301]: cluster 2020-11-16T22:07:29.075455+0000 mon.a (mon.0) 1074 : cluster [DBG] osdmap e423: 12 total, 12 up, 12 in 2020-11-16T22:07:30.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:30 smithi057 bash[10301]: audit 2020-11-16T22:07:29.740254+0000 mon.b (mon.1) 295 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:07:30.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:30 smithi057 bash[10301]: audit 2020-11-16T22:07:29.742168+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:07:30.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:30 smithi057 bash[10301]: audit 2020-11-16T22:07:29.748946+0000 mon.b (mon.1) 296 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:07:30.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:30 smithi057 bash[10301]: audit 2020-11-16T22:07:29.750439+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:07:30.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:30 smithi057 bash[10301]: cluster 2020-11-16T22:07:29.984944+0000 mon.a (mon.0) 1077 : cluster [DBG] osdmap e424: 12 total, 12 up, 12 in 2020-11-16T22:07:30.995 INFO:tasks.rados.rados.2.smithi057.stdout:1480: done (3 left) 2020-11-16T22:07:30.995 INFO:tasks.rados.rados.2.smithi057.stdout:1481: delete oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 177 2020-11-16T22:07:30.995 INFO:tasks.rados.rados.2.smithi057.stdout:1477: finishing copy_from to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:30.995 INFO:tasks.rados.rados.2.smithi057.stdout:1477: got expected ENOENT (src dne) 2020-11-16T22:07:30.996 INFO:tasks.rados.rados.2.smithi057.stdout:1477: finishing copy_from racing read to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:30.996 INFO:tasks.rados.rados.2.smithi057.stdout:1478: finishing copy_from to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:30.996 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1225 (ObjNum 432 snap 145 seq_num 432) dirty exists 2020-11-16T22:07:30.996 INFO:tasks.rados.rados.2.smithi057.stdout:1478: finishing copy_from racing read to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:30.996 INFO:tasks.rados.rados.2.smithi057.stdout:1479: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:30.996 INFO:tasks.rados.rados.2.smithi057.stdout:1479: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:30.996 INFO:tasks.rados.rados.2.smithi057.stdout:1479: finishing write tid 4 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:30.997 INFO:tasks.rados.rados.2.smithi057.stdout:1479: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:30.997 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1102 (ObjNum 497 snap 177 seq_num 497) dirty exists 2020-11-16T22:07:30.997 INFO:tasks.rados.rados.2.smithi057.stdout:1479: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 497 snap 177 seq_num 497) 2020-11-16T22:07:31.003 INFO:tasks.rados.rados.2.smithi057.stdout:1477: done (3 left) 2020-11-16T22:07:31.003 INFO:tasks.rados.rados.2.smithi057.stdout:1478: done (2 left) 2020-11-16T22:07:31.003 INFO:tasks.rados.rados.2.smithi057.stdout:1479: done (1 left) 2020-11-16T22:07:31.004 INFO:tasks.rados.rados.2.smithi057.stdout:1481: done (0 left) 2020-11-16T22:07:31.004 INFO:tasks.rados.rados.2.smithi057.stdout:1482: write oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 177 2020-11-16T22:07:31.004 INFO:tasks.rados.rados.2.smithi057.stdout:1482: seq_num 499 ranges {786693=712196,2150397=236296} 2020-11-16T22:07:31.014 INFO:tasks.rados.rados.2.smithi057.stdout:1482: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 786693 to 1498889 tid 1 2020-11-16T22:07:31.020 INFO:tasks.rados.rados.2.smithi057.stdout:1482: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2150397 to 2386693 tid 2 2020-11-16T22:07:31.020 INFO:tasks.rados.rados.2.smithi057.stdout:1483: copy_from oid 14 from oid 42 current snap is 177 2020-11-16T22:07:31.020 INFO:tasks.rados.rados.2.smithi057.stdout:1484: write oid 50 current snap is 177 2020-11-16T22:07:31.020 INFO:tasks.rados.rados.2.smithi057.stdout:1484: seq_num 500 ranges {403500=787445,1692526=473837} 2020-11-16T22:07:31.026 INFO:tasks.rados.rados.2.smithi057.stdout:1484: writing smithi05720651-50 from 403500 to 1190945 tid 1 2020-11-16T22:07:31.032 INFO:tasks.rados.rados.2.smithi057.stdout:1484: writing smithi05720651-50 from 1692526 to 2166363 tid 2 2020-11-16T22:07:31.032 INFO:tasks.rados.rados.2.smithi057.stdout:1485: snap_remove snap 170 2020-11-16T22:07:31.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:31 smithi016 bash[10302]: cluster 2020-11-16T22:07:29.684715+0000 mgr.x (mgr.24115) 446 : cluster [DBG] pgmap v799: 17 pgs: 17 active+clean; 186 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 525 KiB/s wr, 7 op/s 2020-11-16T22:07:31.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:31 smithi016 bash[10302]: cluster 2020-11-16T22:07:31.004186+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e425: 12 total, 12 up, 12 in 2020-11-16T22:07:31.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:31 smithi195 bash[10218]: cluster 2020-11-16T22:07:29.684715+0000 mgr.x (mgr.24115) 446 : cluster [DBG] pgmap v799: 17 pgs: 17 active+clean; 186 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 525 KiB/s wr, 7 op/s 2020-11-16T22:07:31.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:31 smithi195 bash[10218]: cluster 2020-11-16T22:07:31.004186+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e425: 12 total, 12 up, 12 in 2020-11-16T22:07:31.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:31 smithi057 bash[10301]: cluster 2020-11-16T22:07:29.684715+0000 mgr.x (mgr.24115) 446 : cluster [DBG] pgmap v799: 17 pgs: 17 active+clean; 186 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 525 KiB/s wr, 7 op/s 2020-11-16T22:07:31.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:31 smithi057 bash[10301]: cluster 2020-11-16T22:07:31.004186+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e425: 12 total, 12 up, 12 in 2020-11-16T22:07:31.997 INFO:tasks.rados.rados.2.smithi057.stdout:1485: done (3 left) 2020-11-16T22:07:31.998 INFO:tasks.rados.rados.2.smithi057.stdout:1486: copy_from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 177 2020-11-16T22:07:31.998 INFO:tasks.rados.rados.2.smithi057.stdout:1482: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:31.998 INFO:tasks.rados.rados.2.smithi057.stdout:1483: finishing copy_from to smithi05720651-14 2020-11-16T22:07:31.998 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 1108 (ObjNum 485 snap 168 seq_num 485) dirty exists 2020-11-16T22:07:31.998 INFO:tasks.rados.rados.2.smithi057.stdout:1483: finishing copy_from racing read to smithi05720651-14 2020-11-16T22:07:31.999 INFO:tasks.rados.rados.2.smithi057.stdout:1482: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:31.999 INFO:tasks.rados.rados.2.smithi057.stdout:1482: finishing write tid 4 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:31.999 INFO:tasks.rados.rados.2.smithi057.stdout:1482: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:31.999 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1257 (ObjNum 499 snap 177 seq_num 499) dirty exists 2020-11-16T22:07:31.999 INFO:tasks.rados.rados.2.smithi057.stdout:1482: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 499 snap 177 seq_num 499) 2020-11-16T22:07:31.999 INFO:tasks.rados.rados.2.smithi057.stdout:1484: finishing write tid 1 to smithi05720651-50 2020-11-16T22:07:31.999 INFO:tasks.rados.rados.2.smithi057.stdout:1484: finishing write tid 2 to smithi05720651-50 2020-11-16T22:07:32.000 INFO:tasks.rados.rados.2.smithi057.stdout:1484: finishing write tid 4 to smithi05720651-50 2020-11-16T22:07:32.000 INFO:tasks.rados.rados.2.smithi057.stdout:1484: finishing write tid 5 to smithi05720651-50 2020-11-16T22:07:32.000 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 1261 (ObjNum 500 snap 177 seq_num 500) dirty exists 2020-11-16T22:07:32.000 INFO:tasks.rados.rados.2.smithi057.stdout:1484: left oid 50 (ObjNum 500 snap 177 seq_num 500) 2020-11-16T22:07:32.000 INFO:tasks.rados.rados.2.smithi057.stdout:1482: done (3 left) 2020-11-16T22:07:32.000 INFO:tasks.rados.rados.2.smithi057.stdout:1483: done (2 left) 2020-11-16T22:07:32.000 INFO:tasks.rados.rados.2.smithi057.stdout:1484: done (1 left) 2020-11-16T22:07:32.001 INFO:tasks.rados.rados.2.smithi057.stdout:1487: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:32.001 INFO:tasks.rados.rados.2.smithi057.stdout:1487: expect deleted 2020-11-16T22:07:32.001 INFO:tasks.rados.rados.2.smithi057.stdout:1488: snap_remove snap 176 2020-11-16T22:07:33.005 INFO:tasks.rados.rados.2.smithi057.stdout:1488: done (2 left) 2020-11-16T22:07:33.006 INFO:tasks.rados.rados.2.smithi057.stdout:1489: write (excl) oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 177 2020-11-16T22:07:33.210 INFO:tasks.rados.rados.2.smithi057.stdout:1489: seq_num 501 ranges {420307=462694,1351008=617495} 2020-11-16T22:07:33.211 INFO:tasks.rados.rados.2.smithi057.stdout:1489: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 420307 to 883001 tid 1 2020-11-16T22:07:33.211 INFO:tasks.rados.rados.2.smithi057.stdout:1489: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1351008 to 1968503 tid 2 2020-11-16T22:07:33.211 INFO:tasks.rados.rados.2.smithi057.stdout:1490: rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 177 2020-11-16T22:07:33.212 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 156 2020-11-16T22:07:33.212 INFO:tasks.rados.rados.2.smithi057.stdout:1486: finishing copy_from to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:33.212 INFO:tasks.rados.rados.2.smithi057.stdout:1486: got expected ENOENT (src dne) 2020-11-16T22:07:33.212 INFO:tasks.rados.rados.2.smithi057.stdout:1486: finishing copy_from racing read to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:33.212 INFO:tasks.rados.rados.2.smithi057.stdout:1486: done (3 left) 2020-11-16T22:07:33.212 INFO:tasks.rados.rados.2.smithi057.stdout:1487: done (2 left) 2020-11-16T22:07:33.213 INFO:tasks.rados.rados.2.smithi057.stdout:1491: snap_remove snap 173 2020-11-16T22:07:33.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:33 smithi016 bash[10302]: cluster 2020-11-16T22:07:31.685382+0000 mgr.x (mgr.24115) 447 : cluster [DBG] pgmap v802: 17 pgs: 17 active+clean; 172 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 8 op/s 2020-11-16T22:07:33.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:33 smithi016 bash[10302]: cluster 2020-11-16T22:07:32.006174+0000 mon.a (mon.0) 1079 : cluster [DBG] osdmap e426: 12 total, 12 up, 12 in 2020-11-16T22:07:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:33 smithi195 bash[10218]: cluster 2020-11-16T22:07:31.685382+0000 mgr.x (mgr.24115) 447 : cluster [DBG] pgmap v802: 17 pgs: 17 active+clean; 172 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 8 op/s 2020-11-16T22:07:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:33 smithi195 bash[10218]: cluster 2020-11-16T22:07:32.006174+0000 mon.a (mon.0) 1079 : cluster [DBG] osdmap e426: 12 total, 12 up, 12 in 2020-11-16T22:07:33.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:33 smithi057 bash[10301]: cluster 2020-11-16T22:07:31.685382+0000 mgr.x (mgr.24115) 447 : cluster [DBG] pgmap v802: 17 pgs: 17 active+clean; 172 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 8 op/s 2020-11-16T22:07:33.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:33 smithi057 bash[10301]: cluster 2020-11-16T22:07:32.006174+0000 mon.a (mon.0) 1079 : cluster [DBG] osdmap e426: 12 total, 12 up, 12 in 2020-11-16T22:07:34.017 INFO:tasks.rados.rados.2.smithi057.stdout:1491: done (2 left) 2020-11-16T22:07:34.018 INFO:tasks.rados.rados.2.smithi057.stdout:1492: write (excl) oid 14 current snap is 177 2020-11-16T22:07:34.018 INFO:tasks.rados.rados.2.smithi057.stdout:1492: seq_num 502 ranges {437114=654296,1525843=477506} 2020-11-16T22:07:34.030 INFO:tasks.rados.rados.2.smithi057.stdout:1492: writing smithi05720651-14 from 437114 to 1091410 tid 1 2020-11-16T22:07:34.035 INFO:tasks.rados.rados.2.smithi057.stdout:1492: writing smithi05720651-14 from 1525843 to 2003349 tid 2 2020-11-16T22:07:34.035 INFO:tasks.rados.rados.2.smithi057.stdout:1493: write oid 8 current snap is 177 2020-11-16T22:07:34.036 INFO:tasks.rados.rados.2.smithi057.stdout:1493: seq_num 503 ranges {453921=729545,1584325=621164} 2020-11-16T22:07:34.042 INFO:tasks.rados.rados.2.smithi057.stdout:1493: writing smithi05720651-8 from 453921 to 1183466 tid 1 2020-11-16T22:07:34.048 INFO:tasks.rados.rados.2.smithi057.stdout:1493: writing smithi05720651-8 from 1584325 to 2205489 tid 2 2020-11-16T22:07:34.049 INFO:tasks.rados.rados.2.smithi057.stdout:1494: write oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 177 2020-11-16T22:07:34.049 INFO:tasks.rados.rados.2.smithi057.stdout:1494: seq_num 504 ranges {470728=404794,1526454=481175} 2020-11-16T22:07:34.053 INFO:tasks.rados.rados.2.smithi057.stdout:1494: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 470728 to 875522 tid 1 2020-11-16T22:07:34.060 INFO:tasks.rados.rados.2.smithi057.stdout:1494: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1526454 to 2007629 tid 2 2020-11-16T22:07:34.060 INFO:tasks.rados.rados.2.smithi057.stdout:1495: rollback oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 177 2020-11-16T22:07:34.060 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 172 2020-11-16T22:07:34.061 INFO:tasks.rados.rados.2.smithi057.stdout:1489: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.061 INFO:tasks.rados.rados.2.smithi057.stdout:1490: finishing rollback tid 0 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.061 INFO:tasks.rados.rados.2.smithi057.stdout:1490: finishing rollback tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.061 INFO:tasks.rados.rados.2.smithi057.stdout:1490: finishing rollback tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.061 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1274 (ObjNum 464 snap 154 seq_num 464) dirty exists 2020-11-16T22:07:34.061 INFO:tasks.rados.rados.2.smithi057.stdout:1490: done (5 left) 2020-11-16T22:07:34.062 INFO:tasks.rados.rados.2.smithi057.stdout:1496: read oid 34 snap -1 2020-11-16T22:07:34.062 INFO:tasks.rados.rados.2.smithi057.stdout:1496: expect (ObjNum 435 snap 145 seq_num 435) 2020-11-16T22:07:34.062 INFO:tasks.rados.rados.2.smithi057.stdout:1497: write (excl) oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 177 2020-11-16T22:07:34.062 INFO:tasks.rados.rados.2.smithi057.stdout:1497: seq_num 505 ranges {487535=480043,1584936=624833} 2020-11-16T22:07:34.065 INFO:tasks.rados.rados.2.smithi057.stdout:1497: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 487535 to 967578 tid 1 2020-11-16T22:07:34.073 INFO:tasks.rados.rados.2.smithi057.stdout:1497: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1584936 to 2209769 tid 2 2020-11-16T22:07:34.073 INFO:tasks.rados.rados.2.smithi057.stdout:1498: read oid 6 snap 172 2020-11-16T22:07:34.073 INFO:tasks.rados.rados.2.smithi057.stdout:1498: expect (ObjNum 429 snap 144 seq_num 429) 2020-11-16T22:07:34.073 INFO:tasks.rados.rados.2.smithi057.stdout:1499: write oid 30 current snap is 177 2020-11-16T22:07:34.074 INFO:tasks.rados.rados.2.smithi057.stdout:1499: seq_num 506 ranges {504342=555292,1643418=484844} 2020-11-16T22:07:34.079 INFO:tasks.rados.rados.2.smithi057.stdout:1499: writing smithi05720651-30 from 504342 to 1059634 tid 1 2020-11-16T22:07:34.085 INFO:tasks.rados.rados.2.smithi057.stdout:1499: writing smithi05720651-30 from 1643418 to 2128262 tid 2 2020-11-16T22:07:34.086 INFO:tasks.rados.rados.2.smithi057.stdout:1500: delete oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 177 2020-11-16T22:07:34.086 INFO:tasks.rados.rados.2.smithi057.stdout:1489: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.086 INFO:tasks.rados.rados.2.smithi057.stdout:1489: finishing write tid 4 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.086 INFO:tasks.rados.rados.2.smithi057.stdout:1489: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.086 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1403 (ObjNum 501 snap 177 seq_num 501) dirty exists 2020-11-16T22:07:34.086 INFO:tasks.rados.rados.2.smithi057.stdout:1489: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 501 snap 177 seq_num 501) 2020-11-16T22:07:34.087 INFO:tasks.rados.rados.2.smithi057.stdout:1492: finishing write tid 1 to smithi05720651-14 2020-11-16T22:07:34.087 INFO:tasks.rados.rados.2.smithi057.stdout:1492: finishing write tid 2 to smithi05720651-14 2020-11-16T22:07:34.087 INFO:tasks.rados.rados.2.smithi057.stdout:1492: finishing write tid 4 to smithi05720651-14 2020-11-16T22:07:34.087 INFO:tasks.rados.rados.2.smithi057.stdout:1492: finishing write tid 5 to smithi05720651-14 2020-11-16T22:07:34.087 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 1406 (ObjNum 502 snap 177 seq_num 502) dirty exists 2020-11-16T22:07:34.087 INFO:tasks.rados.rados.2.smithi057.stdout:1492: left oid 14 (ObjNum 502 snap 177 seq_num 502) 2020-11-16T22:07:34.087 INFO:tasks.rados.rados.2.smithi057.stdout:1493: finishing write tid 1 to smithi05720651-8 2020-11-16T22:07:34.088 INFO:tasks.rados.rados.2.smithi057.stdout:1493: finishing write tid 2 to smithi05720651-8 2020-11-16T22:07:34.088 INFO:tasks.rados.rados.2.smithi057.stdout:1493: finishing write tid 4 to smithi05720651-8 2020-11-16T22:07:34.088 INFO:tasks.rados.rados.2.smithi057.stdout:1493: finishing write tid 5 to smithi05720651-8 2020-11-16T22:07:34.088 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 1171 (ObjNum 503 snap 177 seq_num 503) dirty exists 2020-11-16T22:07:34.088 INFO:tasks.rados.rados.2.smithi057.stdout:1493: left oid 8 (ObjNum 503 snap 177 seq_num 503) 2020-11-16T22:07:34.088 INFO:tasks.rados.rados.2.smithi057.stdout:1494: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.088 INFO:tasks.rados.rados.2.smithi057.stdout:1494: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.089 INFO:tasks.rados.rados.2.smithi057.stdout:1496: expect (ObjNum 435 snap 145 seq_num 435) 2020-11-16T22:07:34.192 INFO:tasks.rados.rados.2.smithi057.stdout:1497: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.193 INFO:tasks.rados.rados.2.smithi057.stdout:1494: finishing write tid 4 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.193 INFO:tasks.rados.rados.2.smithi057.stdout:1494: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.394 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1286 (ObjNum 504 snap 177 seq_num 504) dirty exists 2020-11-16T22:07:34.394 INFO:tasks.rados.rados.2.smithi057.stdout:1494: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 504 snap 177 seq_num 504) 2020-11-16T22:07:34.394 INFO:tasks.rados.rados.2.smithi057.stdout:1495: finishing rollback tid 0 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.395 INFO:tasks.rados.rados.2.smithi057.stdout:1495: finishing rollback tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.395 INFO:tasks.rados.rados.2.smithi057.stdout:1497: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.395 INFO:tasks.rados.rados.2.smithi057.stdout:1497: finishing write tid 4 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.395 INFO:tasks.rados.rados.2.smithi057.stdout:1497: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.395 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1416 (ObjNum 505 snap 177 seq_num 505) dirty exists 2020-11-16T22:07:34.396 INFO:tasks.rados.rados.2.smithi057.stdout:1497: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 505 snap 177 seq_num 505) 2020-11-16T22:07:34.396 INFO:tasks.rados.rados.2.smithi057.stdout:1495: finishing rollback tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:34.598 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1290 (ObjNum 415 snap 140 seq_num 415) dirty exists 2020-11-16T22:07:34.598 INFO:tasks.rados.rados.2.smithi057.stdout:1499: finishing write tid 1 to smithi05720651-30 2020-11-16T22:07:34.598 INFO:tasks.rados.rados.2.smithi057.stdout:1499: finishing write tid 2 to smithi05720651-30 2020-11-16T22:07:34.599 INFO:tasks.rados.rados.2.smithi057.stdout:1499: finishing write tid 4 to smithi05720651-30 2020-11-16T22:07:34.599 INFO:tasks.rados.rados.2.smithi057.stdout:1499: finishing write tid 5 to smithi05720651-30 2020-11-16T22:07:34.599 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 1124 (ObjNum 506 snap 177 seq_num 506) dirty exists 2020-11-16T22:07:34.599 INFO:tasks.rados.rados.2.smithi057.stdout:1499: left oid 30 (ObjNum 506 snap 177 seq_num 506) 2020-11-16T22:07:34.599 INFO:tasks.rados.rados.2.smithi057.stdout:1489: done (9 left) 2020-11-16T22:07:34.599 INFO:tasks.rados.rados.2.smithi057.stdout:1492: done (8 left) 2020-11-16T22:07:34.599 INFO:tasks.rados.rados.2.smithi057.stdout:1493: done (7 left) 2020-11-16T22:07:34.600 INFO:tasks.rados.rados.2.smithi057.stdout:1494: done (6 left) 2020-11-16T22:07:34.600 INFO:tasks.rados.rados.2.smithi057.stdout:1495: done (5 left) 2020-11-16T22:07:34.600 INFO:tasks.rados.rados.2.smithi057.stdout:1496: done (4 left) 2020-11-16T22:07:34.600 INFO:tasks.rados.rados.2.smithi057.stdout:1497: done (3 left) 2020-11-16T22:07:34.600 INFO:tasks.rados.rados.2.smithi057.stdout:1499: done (2 left) 2020-11-16T22:07:34.600 INFO:tasks.rados.rados.2.smithi057.stdout:1500: done (1 left) 2020-11-16T22:07:34.600 INFO:tasks.rados.rados.2.smithi057.stdout:1501: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:34.601 INFO:tasks.rados.rados.2.smithi057.stdout:1501: expect (ObjNum 501 snap 177 seq_num 501) 2020-11-16T22:07:34.601 INFO:tasks.rados.rados.2.smithi057.stdout:1502: delete oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 177 2020-11-16T22:07:34.602 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:34 smithi195 bash[10218]: cluster 2020-11-16T22:07:33.015937+0000 mon.a (mon.0) 1080 : cluster [DBG] osdmap e427: 12 total, 12 up, 12 in 2020-11-16T22:07:34.602 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:34 smithi016 bash[10302]: cluster 2020-11-16T22:07:33.015937+0000 mon.a (mon.0) 1080 : cluster [DBG] osdmap e427: 12 total, 12 up, 12 in 2020-11-16T22:07:34.602 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:07:34 smithi016 bash[19825]: debug 2020-11-16T22:07:34.046+0000 7f0e16c22700 -1 osd.7 pg_epoch: 428 pg[2.8( v 424'1118 (0'0,424'1118] local-lis/les=71/72 n=8 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [7,9] r=0 lpr=71 crt=424'1118 lcod 422'1116 mlcod 422'1116 active+clean+snaptrim trimq=[154~1] ps=[131~1,13f~2,150~1,156~1,159~1,15c~1]] removing snap head 2020-11-16T22:07:34.603 INFO:tasks.rados.rados.2.smithi057.stdout:1502: done (2 left) 2020-11-16T22:07:34.603 INFO:tasks.rados.rados.2.smithi057.stdout:1503: snap_create 2020-11-16T22:07:34.603 INFO:tasks.rados.rados.2.smithi057.stdout:1501: expect (ObjNum 501 snap 177 seq_num 501) 2020-11-16T22:07:34.806 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:34 smithi057 bash[10301]: cluster 2020-11-16T22:07:33.015937+0000 mon.a (mon.0) 1080 : cluster [DBG] osdmap e427: 12 total, 12 up, 12 in 2020-11-16T22:07:34.884 INFO:tasks.rados.rados.2.smithi057.stdout:1498: expect (ObjNum 429 snap 144 seq_num 429) 2020-11-16T22:07:35.028 INFO:tasks.rados.rados.2.smithi057.stdout:1498: done (2 left) 2020-11-16T22:07:35.028 INFO:tasks.rados.rados.2.smithi057.stdout:1501: done (1 left) 2020-11-16T22:07:35.029 INFO:tasks.rados.rados.2.smithi057.stdout:1503: done (0 left) 2020-11-16T22:07:35.029 INFO:tasks.rados.rados.2.smithi057.stdout:1504: snap_remove snap 177 2020-11-16T22:07:35.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:35 smithi016 bash[10302]: cluster 2020-11-16T22:07:33.686086+0000 mgr.x (mgr.24115) 448 : cluster [DBG] pgmap v805: 17 pgs: 17 active+clean; 170 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 8 op/s 2020-11-16T22:07:35.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:35 smithi016 bash[10302]: cluster 2020-11-16T22:07:34.027045+0000 mon.a (mon.0) 1081 : cluster [DBG] osdmap e428: 12 total, 12 up, 12 in 2020-11-16T22:07:35.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:35 smithi016 bash[10302]: cluster 2020-11-16T22:07:34.987542+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e429: 12 total, 12 up, 12 in 2020-11-16T22:07:35.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:35 smithi195 bash[10218]: cluster 2020-11-16T22:07:33.686086+0000 mgr.x (mgr.24115) 448 : cluster [DBG] pgmap v805: 17 pgs: 17 active+clean; 170 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 8 op/s 2020-11-16T22:07:35.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:35 smithi195 bash[10218]: cluster 2020-11-16T22:07:34.027045+0000 mon.a (mon.0) 1081 : cluster [DBG] osdmap e428: 12 total, 12 up, 12 in 2020-11-16T22:07:35.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:35 smithi195 bash[10218]: cluster 2020-11-16T22:07:34.987542+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e429: 12 total, 12 up, 12 in 2020-11-16T22:07:35.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:35 smithi057 bash[10301]: cluster 2020-11-16T22:07:33.686086+0000 mgr.x (mgr.24115) 448 : cluster [DBG] pgmap v805: 17 pgs: 17 active+clean; 170 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 8 op/s 2020-11-16T22:07:35.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:35 smithi057 bash[10301]: cluster 2020-11-16T22:07:34.027045+0000 mon.a (mon.0) 1081 : cluster [DBG] osdmap e428: 12 total, 12 up, 12 in 2020-11-16T22:07:35.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:35 smithi057 bash[10301]: cluster 2020-11-16T22:07:34.987542+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e429: 12 total, 12 up, 12 in 2020-11-16T22:07:36.036 INFO:tasks.rados.rados.2.smithi057.stdout:1504: done (0 left) 2020-11-16T22:07:36.037 INFO:tasks.rados.rados.2.smithi057.stdout:1505: snap_create 2020-11-16T22:07:37.040 INFO:tasks.rados.rados.2.smithi057.stdout:1505: done (0 left) 2020-11-16T22:07:37.040 INFO:tasks.rados.rados.2.smithi057.stdout:1506: snap_remove snap 178 2020-11-16T22:07:37.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:37 smithi016 bash[10302]: cluster 2020-11-16T22:07:35.686847+0000 mgr.x (mgr.24115) 449 : cluster [DBG] pgmap v808: 17 pgs: 17 active+clean; 172 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2020-11-16T22:07:37.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:37 smithi016 bash[10302]: cluster 2020-11-16T22:07:36.046549+0000 mon.a (mon.0) 1083 : cluster [DBG] osdmap e430: 12 total, 12 up, 12 in 2020-11-16T22:07:37.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:37 smithi195 bash[10218]: cluster 2020-11-16T22:07:35.686847+0000 mgr.x (mgr.24115) 449 : cluster [DBG] pgmap v808: 17 pgs: 17 active+clean; 172 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2020-11-16T22:07:37.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:37 smithi195 bash[10218]: cluster 2020-11-16T22:07:36.046549+0000 mon.a (mon.0) 1083 : cluster [DBG] osdmap e430: 12 total, 12 up, 12 in 2020-11-16T22:07:37.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:37 smithi057 bash[10301]: cluster 2020-11-16T22:07:35.686847+0000 mgr.x (mgr.24115) 449 : cluster [DBG] pgmap v808: 17 pgs: 17 active+clean; 172 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2020-11-16T22:07:37.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:37 smithi057 bash[10301]: cluster 2020-11-16T22:07:36.046549+0000 mon.a (mon.0) 1083 : cluster [DBG] osdmap e430: 12 total, 12 up, 12 in 2020-11-16T22:07:38.058 INFO:tasks.rados.rados.2.smithi057.stdout:1506: done (0 left) 2020-11-16T22:07:38.058 INFO:tasks.rados.rados.2.smithi057.stdout:1507: delete oid 10 current snap is 179 2020-11-16T22:07:38.066 INFO:tasks.rados.rados.2.smithi057.stdout:1507: done (0 left) 2020-11-16T22:07:38.066 INFO:tasks.rados.rados.2.smithi057.stdout:1508: snap_remove snap 172 2020-11-16T22:07:38.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:38 smithi016 bash[10302]: cluster 2020-11-16T22:07:37.049427+0000 mon.a (mon.0) 1084 : cluster [DBG] osdmap e431: 12 total, 12 up, 12 in 2020-11-16T22:07:38.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:38 smithi195 bash[10218]: cluster 2020-11-16T22:07:37.049427+0000 mon.a (mon.0) 1084 : cluster [DBG] osdmap e431: 12 total, 12 up, 12 in 2020-11-16T22:07:38.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:38 smithi057 bash[10301]: cluster 2020-11-16T22:07:37.049427+0000 mon.a (mon.0) 1084 : cluster [DBG] osdmap e431: 12 total, 12 up, 12 in 2020-11-16T22:07:39.060 INFO:tasks.rados.rados.2.smithi057.stdout:1508: done (0 left) 2020-11-16T22:07:39.060 INFO:tasks.rados.rados.2.smithi057.stdout:1509: delete oid 38 current snap is 179 2020-11-16T22:07:39.066 INFO:tasks.rados.rados.2.smithi057.stdout:1509: done (0 left) 2020-11-16T22:07:39.067 INFO:tasks.rados.rados.2.smithi057.stdout:1510: read oid 48 snap 156 2020-11-16T22:07:39.067 INFO:tasks.rados.rados.2.smithi057.stdout:1510: expect (ObjNum 410 snap 138 seq_num 410) 2020-11-16T22:07:39.067 INFO:tasks.rados.rados.2.smithi057.stdout:1511: write oid 42 current snap is 179 2020-11-16T22:07:39.067 INFO:tasks.rados.rados.2.smithi057.stdout:1511: seq_num 511 ranges {588377=647890,1935828=635840} 2020-11-16T22:07:39.076 INFO:tasks.rados.rados.2.smithi057.stdout:1511: writing smithi05720651-42 from 588377 to 1236267 tid 1 2020-11-16T22:07:39.084 INFO:tasks.rados.rados.2.smithi057.stdout:1511: writing smithi05720651-42 from 1935828 to 2571668 tid 2 2020-11-16T22:07:39.084 INFO:tasks.rados.rados.2.smithi057.stdout:1512: write (excl) oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 179 2020-11-16T22:07:39.085 INFO:tasks.rados.rados.2.smithi057.stdout:1512: seq_num 512 ranges {605184=723139,1877957=727227} 2020-11-16T22:07:39.092 INFO:tasks.rados.rados.2.smithi057.stdout:1512: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 605184 to 1328323 tid 1 2020-11-16T22:07:39.099 INFO:tasks.rados.rados.2.smithi057.stdout:1512: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1877957 to 2605184 tid 2 2020-11-16T22:07:39.099 INFO:tasks.rados.rados.2.smithi057.stdout:1513: snap_create 2020-11-16T22:07:39.099 INFO:tasks.rados.rados.2.smithi057.stdout:1510: expect (ObjNum 410 snap 138 seq_num 410) 2020-11-16T22:07:39.310 INFO:tasks.rados.rados.2.smithi057.stdout:1511: finishing write tid 1 to smithi05720651-42 2020-11-16T22:07:39.310 INFO:tasks.rados.rados.2.smithi057.stdout:1511: finishing write tid 2 to smithi05720651-42 2020-11-16T22:07:39.310 INFO:tasks.rados.rados.2.smithi057.stdout:1511: finishing write tid 4 to smithi05720651-42 2020-11-16T22:07:39.310 INFO:tasks.rados.rados.2.smithi057.stdout:1511: finishing write tid 5 to smithi05720651-42 2020-11-16T22:07:39.311 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 1114 (ObjNum 511 snap 179 seq_num 511) dirty exists 2020-11-16T22:07:39.311 INFO:tasks.rados.rados.2.smithi057.stdout:1511: left oid 42 (ObjNum 511 snap 179 seq_num 511) 2020-11-16T22:07:39.311 INFO:tasks.rados.rados.2.smithi057.stdout:1512: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:39.311 INFO:tasks.rados.rados.2.smithi057.stdout:1512: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:39.311 INFO:tasks.rados.rados.2.smithi057.stdout:1512: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:39.311 INFO:tasks.rados.rados.2.smithi057.stdout:1512: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:39.312 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1228 (ObjNum 512 snap 179 seq_num 512) dirty exists 2020-11-16T22:07:39.312 INFO:tasks.rados.rados.2.smithi057.stdout:1512: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 512 snap 179 seq_num 512) 2020-11-16T22:07:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:39 smithi016 bash[10302]: cluster 2020-11-16T22:07:37.687591+0000 mgr.x (mgr.24115) 450 : cluster [DBG] pgmap v811: 17 pgs: 17 active+clean; 174 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 2.1 MiB/s wr, 18 op/s 2020-11-16T22:07:39.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:39 smithi016 bash[10302]: cluster 2020-11-16T22:07:38.067263+0000 mon.a (mon.0) 1085 : cluster [DBG] osdmap e432: 12 total, 12 up, 12 in 2020-11-16T22:07:39.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:39 smithi195 bash[10218]: cluster 2020-11-16T22:07:37.687591+0000 mgr.x (mgr.24115) 450 : cluster [DBG] pgmap v811: 17 pgs: 17 active+clean; 174 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 2.1 MiB/s wr, 18 op/s 2020-11-16T22:07:39.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:39 smithi195 bash[10218]: cluster 2020-11-16T22:07:38.067263+0000 mon.a (mon.0) 1085 : cluster [DBG] osdmap e432: 12 total, 12 up, 12 in 2020-11-16T22:07:39.445 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:07:39 smithi057 bash[19569]: debug 2020-11-16T22:07:39.082+0000 7f5e12117700 -1 osd.11 pg_epoch: 433 pg[2.a( v 428'443 (0'0,428'443] local-lis/les=71/72 n=4 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [11,3] r=0 lpr=71 crt=428'443 lcod 426'441 mlcod 426'441 active+clean+snaptrim trimq=[153~1] ps=[13f~1,150~1,154~1,159~1,15c~1,162~1,164~1]] removing snap head 2020-11-16T22:07:39.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:39 smithi057 bash[10301]: cluster 2020-11-16T22:07:37.687591+0000 mgr.x (mgr.24115) 450 : cluster [DBG] pgmap v811: 17 pgs: 17 active+clean; 174 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 2.1 MiB/s wr, 18 op/s 2020-11-16T22:07:39.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:39 smithi057 bash[10301]: cluster 2020-11-16T22:07:38.067263+0000 mon.a (mon.0) 1085 : cluster [DBG] osdmap e432: 12 total, 12 up, 12 in 2020-11-16T22:07:39.983 INFO:tasks.rados.rados.2.smithi057.stdout:1510: done (3 left) 2020-11-16T22:07:39.983 INFO:tasks.rados.rados.2.smithi057.stdout:1511: done (2 left) 2020-11-16T22:07:39.983 INFO:tasks.rados.rados.2.smithi057.stdout:1512: done (1 left) 2020-11-16T22:07:39.983 INFO:tasks.rados.rados.2.smithi057.stdout:1513: done (0 left) 2020-11-16T22:07:39.984 INFO:tasks.rados.rados.2.smithi057.stdout:1514: snap_remove snap 156 2020-11-16T22:07:40.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:40 smithi016 bash[10302]: cluster 2020-11-16T22:07:39.071303+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e433: 12 total, 12 up, 12 in 2020-11-16T22:07:40.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:40 smithi016 bash[10302]: cluster 2020-11-16T22:07:39.988711+0000 mon.a (mon.0) 1087 : cluster [DBG] osdmap e434: 12 total, 12 up, 12 in 2020-11-16T22:07:40.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:40 smithi195 bash[10218]: cluster 2020-11-16T22:07:39.071303+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e433: 12 total, 12 up, 12 in 2020-11-16T22:07:40.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:40 smithi195 bash[10218]: cluster 2020-11-16T22:07:39.988711+0000 mon.a (mon.0) 1087 : cluster [DBG] osdmap e434: 12 total, 12 up, 12 in 2020-11-16T22:07:40.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:40 smithi057 bash[10301]: cluster 2020-11-16T22:07:39.071303+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e433: 12 total, 12 up, 12 in 2020-11-16T22:07:40.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:40 smithi057 bash[10301]: cluster 2020-11-16T22:07:39.988711+0000 mon.a (mon.0) 1087 : cluster [DBG] osdmap e434: 12 total, 12 up, 12 in 2020-11-16T22:07:40.995 INFO:tasks.rados.rados.2.smithi057.stdout:1514: done (0 left) 2020-11-16T22:07:40.996 INFO:tasks.rados.rados.2.smithi057.stdout:1515: snap_create 2020-11-16T22:07:41.337 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:07:41 smithi016 bash[19825]: debug 2020-11-16T22:07:41.273+0000 7f0e16c22700 -1 osd.7 pg_epoch: 435 pg[2.8( v 433'1130 (0'0,433'1130] local-lis/les=71/72 n=7 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [7,9] r=0 lpr=71 crt=433'1130 lcod 433'1128 mlcod 433'1128 active+clean+snaptrim trimq=[137~1] ps=[153~1,162~1,164~1]] removing snap head 2020-11-16T22:07:41.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:41 smithi016 bash[10302]: cluster 2020-11-16T22:07:39.688283+0000 mgr.x (mgr.24115) 451 : cluster [DBG] pgmap v814: 17 pgs: 17 active+clean; 174 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 810 KiB/s wr, 9 op/s 2020-11-16T22:07:41.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:41 smithi016 bash[10302]: cluster 2020-11-16T22:07:41.003084+0000 mon.a (mon.0) 1088 : cluster [DBG] osdmap e435: 12 total, 12 up, 12 in 2020-11-16T22:07:41.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:41 smithi195 bash[10218]: cluster 2020-11-16T22:07:39.688283+0000 mgr.x (mgr.24115) 451 : cluster [DBG] pgmap v814: 17 pgs: 17 active+clean; 174 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 810 KiB/s wr, 9 op/s 2020-11-16T22:07:41.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:41 smithi195 bash[10218]: cluster 2020-11-16T22:07:41.003084+0000 mon.a (mon.0) 1088 : cluster [DBG] osdmap e435: 12 total, 12 up, 12 in 2020-11-16T22:07:41.349 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:07:41 smithi195 bash[18679]: debug 2020-11-16T22:07:41.282+0000 7f9945603700 -1 osd.1 pg_epoch: 435 pg[2.9( v 435'1434 (0'0,435'1434] local-lis/les=71/72 n=10 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,7] r=0 lpr=71 luod=435'1432 crt=435'1434 lcod 435'1430 mlcod 435'1430 active+clean+snaptrim trimq=[137~1] ps=[153~1,162~1,164~1]] removing snap head 2020-11-16T22:07:41.350 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:07:41 smithi195 bash[18679]: debug 2020-11-16T22:07:41.286+0000 7f994960b700 -1 osd.1 pg_epoch: 435 pg[2.9( v 435'1438 (0'0,435'1438] local-lis/les=71/72 n=7 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,7] r=0 lpr=71 luod=435'1436 crt=435'1438 lcod 435'1434 mlcod 435'1434 active+clean+snaptrim trimq=[137~1] ps=[153~1,162~1,164~1]] removing snap head 2020-11-16T22:07:41.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:41 smithi057 bash[10301]: cluster 2020-11-16T22:07:39.688283+0000 mgr.x (mgr.24115) 451 : cluster [DBG] pgmap v814: 17 pgs: 17 active+clean; 174 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 810 KiB/s wr, 9 op/s 2020-11-16T22:07:41.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:41 smithi057 bash[10301]: cluster 2020-11-16T22:07:41.003084+0000 mon.a (mon.0) 1088 : cluster [DBG] osdmap e435: 12 total, 12 up, 12 in 2020-11-16T22:07:41.446 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:07:41 smithi057 bash[12595]: debug 2020-11-16T22:07:41.278+0000 7f737d1a4700 -1 osd.8 pg_epoch: 435 pg[2.5( v 433'913 (0'0,433'913] local-lis/les=71/72 n=7 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,0] r=0 lpr=71 crt=433'913 lcod 432'911 mlcod 432'911 active+clean+snaptrim trimq=[137~1] ps=[153~1,162~1,164~1]] removing snap head 2020-11-16T22:07:41.446 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:07:41 smithi057 bash[12595]: debug 2020-11-16T22:07:41.282+0000 7f737d1a4700 -1 osd.8 pg_epoch: 435 pg[2.5( v 435'917 (0'0,435'917] local-lis/les=71/72 n=4 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,0] r=0 lpr=71 crt=435'917 lcod 435'915 mlcod 435'915 active+clean+snaptrim trimq=[137~1] ps=[153~1,162~1,164~1]] removing snap head 2020-11-16T22:07:41.995 INFO:tasks.rados.rados.2.smithi057.stdout:1515: done (0 left) 2020-11-16T22:07:41.995 INFO:tasks.rados.rados.2.smithi057.stdout:1516: read oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:41.995 INFO:tasks.rados.rados.2.smithi057.stdout:1516: expect (ObjNum 327 snap 111 seq_num 327) 2020-11-16T22:07:41.996 INFO:tasks.rados.rados.2.smithi057.stdout:1517: snap_create 2020-11-16T22:07:42.011 INFO:tasks.rados.rados.2.smithi057.stdout:1516: expect (ObjNum 327 snap 111 seq_num 327) 2020-11-16T22:07:43.012 INFO:tasks.rados.rados.2.smithi057.stdout:1516: done (1 left) 2020-11-16T22:07:43.012 INFO:tasks.rados.rados.2.smithi057.stdout:1517: done (0 left) 2020-11-16T22:07:43.013 INFO:tasks.rados.rados.2.smithi057.stdout:1518: rollback oid 28 current snap is 182 2020-11-16T22:07:43.013 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 28 to 180 2020-11-16T22:07:43.013 INFO:tasks.rados.rados.2.smithi057.stdout:1519: write (excl) oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 182 2020-11-16T22:07:43.013 INFO:tasks.rados.rados.2.smithi057.stdout:1519: seq_num 513 ranges {621991=798388,1936439=639509} 2020-11-16T22:07:43.025 INFO:tasks.rados.rados.2.smithi057.stdout:1519: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 621991 to 1420379 tid 1 2020-11-16T22:07:43.032 INFO:tasks.rados.rados.2.smithi057.stdout:1519: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1936439 to 2575948 tid 2 2020-11-16T22:07:43.032 INFO:tasks.rados.rados.2.smithi057.stdout:1520: write oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 182 2020-11-16T22:07:43.032 INFO:tasks.rados.rados.2.smithi057.stdout:1520: seq_num 514 ranges {638798=473637,1594921=783167} 2020-11-16T22:07:43.038 INFO:tasks.rados.rados.2.smithi057.stdout:1520: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 638798 to 1112435 tid 1 2020-11-16T22:07:43.045 INFO:tasks.rados.rados.2.smithi057.stdout:1520: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1594921 to 2378088 tid 2 2020-11-16T22:07:43.046 INFO:tasks.rados.rados.2.smithi057.stdout:1521: read oid 50 snap 181 2020-11-16T22:07:43.046 INFO:tasks.rados.rados.2.smithi057.stdout:1521: expect (ObjNum 500 snap 177 seq_num 500) 2020-11-16T22:07:43.046 INFO:tasks.rados.rados.2.smithi057.stdout:1522: read oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:43.046 INFO:tasks.rados.rados.2.smithi057.stdout:1522: expect (ObjNum 497 snap 177 seq_num 497) 2020-11-16T22:07:43.046 INFO:tasks.rados.rados.2.smithi057.stdout:1523: delete oid 2 current snap is 182 2020-11-16T22:07:43.047 INFO:tasks.rados.rados.2.smithi057.stdout:1518: finishing rollback tid 1 to smithi05720651-28 2020-11-16T22:07:43.047 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 0 (ObjNum 385 snap 0 seq_num 2932397664) dirty dne 2020-11-16T22:07:43.047 INFO:tasks.rados.rados.2.smithi057.stdout:1519: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:43.047 INFO:tasks.rados.rados.2.smithi057.stdout:1519: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:43.047 INFO:tasks.rados.rados.2.smithi057.stdout:1519: finishing write tid 4 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:43.047 INFO:tasks.rados.rados.2.smithi057.stdout:1519: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:43.048 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1444 (ObjNum 513 snap 182 seq_num 513) dirty exists 2020-11-16T22:07:43.048 INFO:tasks.rados.rados.2.smithi057.stdout:1519: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 513 snap 182 seq_num 513) 2020-11-16T22:07:43.049 INFO:tasks.rados.rados.2.smithi057.stdout:1520: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:43.051 INFO:tasks.rados.rados.2.smithi057.stdout:1518: done (5 left) 2020-11-16T22:07:43.051 INFO:tasks.rados.rados.2.smithi057.stdout:1519: done (4 left) 2020-11-16T22:07:43.051 INFO:tasks.rados.rados.2.smithi057.stdout:1523: done (3 left) 2020-11-16T22:07:43.051 INFO:tasks.rados.rados.2.smithi057.stdout:1524: rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 182 2020-11-16T22:07:43.051 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 181 2020-11-16T22:07:43.052 INFO:tasks.rados.rados.2.smithi057.stdout:1525: rollback oid 18 current snap is 182 2020-11-16T22:07:43.052 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 18 to 179 2020-11-16T22:07:43.052 INFO:tasks.rados.rados.2.smithi057.stdout:1526: snap_remove snap 180 2020-11-16T22:07:43.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:43 smithi016 bash[10302]: cluster 2020-11-16T22:07:41.689028+0000 mgr.x (mgr.24115) 452 : cluster [DBG] pgmap v817: 17 pgs: 17 active+clean; 136 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 668 KiB/s wr, 3 op/s 2020-11-16T22:07:43.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:43 smithi016 bash[10302]: cluster 2020-11-16T22:07:42.006197+0000 mon.a (mon.0) 1089 : cluster [DBG] osdmap e436: 12 total, 12 up, 12 in 2020-11-16T22:07:43.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:43 smithi195 bash[10218]: cluster 2020-11-16T22:07:41.689028+0000 mgr.x (mgr.24115) 452 : cluster [DBG] pgmap v817: 17 pgs: 17 active+clean; 136 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 668 KiB/s wr, 3 op/s 2020-11-16T22:07:43.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:43 smithi195 bash[10218]: cluster 2020-11-16T22:07:42.006197+0000 mon.a (mon.0) 1089 : cluster [DBG] osdmap e436: 12 total, 12 up, 12 in 2020-11-16T22:07:43.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:43 smithi057 bash[10301]: cluster 2020-11-16T22:07:41.689028+0000 mgr.x (mgr.24115) 452 : cluster [DBG] pgmap v817: 17 pgs: 17 active+clean; 136 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 668 KiB/s wr, 3 op/s 2020-11-16T22:07:43.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:43 smithi057 bash[10301]: cluster 2020-11-16T22:07:42.006197+0000 mon.a (mon.0) 1089 : cluster [DBG] osdmap e436: 12 total, 12 up, 12 in 2020-11-16T22:07:44.015 INFO:tasks.rados.rados.2.smithi057.stdout:1526: done (5 left) 2020-11-16T22:07:44.016 INFO:tasks.rados.rados.2.smithi057.stdout:1527: rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 182 2020-11-16T22:07:44.016 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 179 2020-11-16T22:07:44.016 INFO:tasks.rados.rados.2.smithi057.stdout:1525: finishing rollback tid 1 to smithi05720651-18 2020-11-16T22:07:44.016 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 0 (ObjNum 49 snap 0 seq_num 2932551840) dirty dne 2020-11-16T22:07:44.017 INFO:tasks.rados.rados.2.smithi057.stdout:1522: expect (ObjNum 497 snap 177 seq_num 497) 2020-11-16T22:07:44.098 INFO:tasks.rados.rados.2.smithi057.stdout:1520: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:44.098 INFO:tasks.rados.rados.2.smithi057.stdout:1520: finishing write tid 4 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:44.098 INFO:tasks.rados.rados.2.smithi057.stdout:1520: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:44.099 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1322 (ObjNum 514 snap 182 seq_num 514) dirty exists 2020-11-16T22:07:44.099 INFO:tasks.rados.rados.2.smithi057.stdout:1520: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 514 snap 182 seq_num 514) 2020-11-16T22:07:44.099 INFO:tasks.rados.rados.2.smithi057.stdout:1521: expect (ObjNum 500 snap 177 seq_num 500) 2020-11-16T22:07:44.234 INFO:tasks.rados.rados.2.smithi057.stdout:1524: finishing rollback tid 0 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:44.234 INFO:tasks.rados.rados.2.smithi057.stdout:1524: finishing rollback tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:44.235 INFO:tasks.rados.rados.2.smithi057.stdout:1524: finishing rollback tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:44.235 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1326 (ObjNum 504 snap 177 seq_num 504) dirty exists 2020-11-16T22:07:44.235 INFO:tasks.rados.rados.2.smithi057.stdout:1527: finishing rollback tid 0 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:44.235 INFO:tasks.rados.rados.2.smithi057.stdout:1527: finishing rollback tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:44.235 INFO:tasks.rados.rados.2.smithi057.stdout:1527: finishing rollback tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:44.236 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1330 (ObjNum 464 snap 154 seq_num 464) dirty exists 2020-11-16T22:07:44.438 INFO:tasks.rados.rados.2.smithi057.stdout:1520: done (5 left) 2020-11-16T22:07:44.438 INFO:tasks.rados.rados.2.smithi057.stdout:1521: done (4 left) 2020-11-16T22:07:44.438 INFO:tasks.rados.rados.2.smithi057.stdout:1522: done (3 left) 2020-11-16T22:07:44.439 INFO:tasks.rados.rados.2.smithi057.stdout:1524: done (2 left) 2020-11-16T22:07:44.439 INFO:tasks.rados.rados.2.smithi057.stdout:1525: done (1 left) 2020-11-16T22:07:44.439 INFO:tasks.rados.rados.2.smithi057.stdout:1527: done (0 left) 2020-11-16T22:07:44.439 INFO:tasks.rados.rados.2.smithi057.stdout:1528: write (excl) oid 36 current snap is 182 2020-11-16T22:07:44.439 INFO:tasks.rados.rados.2.smithi057.stdout:1528: seq_num 516 ranges {672412=624135,1995532=676880} 2020-11-16T22:07:44.441 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:44 smithi195 bash[10218]: cluster 2020-11-16T22:07:43.016351+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e437: 12 total, 12 up, 12 in 2020-11-16T22:07:44.441 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:44 smithi016 bash[10302]: cluster 2020-11-16T22:07:43.016351+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e437: 12 total, 12 up, 12 in 2020-11-16T22:07:44.441 INFO:tasks.rados.rados.2.smithi057.stdout:1528: writing smithi05720651-36 from 672412 to 1296547 tid 1 2020-11-16T22:07:44.441 INFO:tasks.rados.rados.2.smithi057.stdout:1528: writing smithi05720651-36 from 1995532 to 2672412 tid 2 2020-11-16T22:07:44.442 INFO:tasks.rados.rados.2.smithi057.stdout:1529: read oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:44.442 INFO:tasks.rados.rados.2.smithi057.stdout:1529: expect (ObjNum 432 snap 145 seq_num 432) 2020-11-16T22:07:44.442 INFO:tasks.rados.rados.2.smithi057.stdout:1530: read oid 32 snap -1 2020-11-16T22:07:44.442 INFO:tasks.rados.rados.2.smithi057.stdout:1530: expect deleted 2020-11-16T22:07:44.442 INFO:tasks.rados.rados.2.smithi057.stdout:1531: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 179 2020-11-16T22:07:44.442 INFO:tasks.rados.rados.2.smithi057.stdout:1531: expect (ObjNum 499 snap 177 seq_num 499) 2020-11-16T22:07:44.443 INFO:tasks.rados.rados.2.smithi057.stdout:1532: write oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 182 2020-11-16T22:07:44.443 INFO:tasks.rados.rados.2.smithi057.stdout:1532: seq_num 517 ranges {689219=415737,1770367=646847} 2020-11-16T22:07:44.443 INFO:tasks.rados.rados.2.smithi057.stdout:1532: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 689219 to 1104956 tid 1 2020-11-16T22:07:44.443 INFO:tasks.rados.rados.2.smithi057.stdout:1532: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1770367 to 2417214 tid 2 2020-11-16T22:07:44.646 INFO:tasks.rados.rados.2.smithi057.stdout:1533: rollback oid 6 current snap is 182 2020-11-16T22:07:44.646 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 6 to 181 2020-11-16T22:07:44.646 INFO:tasks.rados.rados.2.smithi057.stdout:1528: finishing write tid 1 to smithi05720651-36 2020-11-16T22:07:44.647 INFO:tasks.rados.rados.2.smithi057.stdout:1528: finishing write tid 2 to smithi05720651-36 2020-11-16T22:07:44.647 INFO:tasks.rados.rados.2.smithi057.stdout:1528: finishing write tid 4 to smithi05720651-36 2020-11-16T22:07:44.647 INFO:tasks.rados.rados.2.smithi057.stdout:1528: finishing write tid 5 to smithi05720651-36 2020-11-16T22:07:44.647 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 1301 (ObjNum 516 snap 182 seq_num 516) dirty exists 2020-11-16T22:07:44.647 INFO:tasks.rados.rados.2.smithi057.stdout:1528: left oid 36 (ObjNum 516 snap 182 seq_num 516) 2020-11-16T22:07:44.647 INFO:tasks.rados.rados.2.smithi057.stdout:1531: expect (ObjNum 499 snap 177 seq_num 499) 2020-11-16T22:07:44.647 INFO:tasks.rados.rados.2.smithi057.stdout:1528: done (5 left) 2020-11-16T22:07:44.648 INFO:tasks.rados.rados.2.smithi057.stdout:1530: done (4 left) 2020-11-16T22:07:44.648 INFO:tasks.rados.rados.2.smithi057.stdout:1531: done (3 left) 2020-11-16T22:07:44.648 INFO:tasks.rados.rados.2.smithi057.stdout:1534: snap_create 2020-11-16T22:07:44.648 INFO:tasks.rados.rados.2.smithi057.stdout:1529: expect (ObjNum 432 snap 145 seq_num 432) 2020-11-16T22:07:44.649 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:44 smithi057 bash[10301]: cluster 2020-11-16T22:07:43.016351+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e437: 12 total, 12 up, 12 in 2020-11-16T22:07:44.649 INFO:tasks.rados.rados.2.smithi057.stdout:1532: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:44.649 INFO:tasks.rados.rados.2.smithi057.stdout:1532: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:44.649 INFO:tasks.rados.rados.2.smithi057.stdout:1532: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:44.650 INFO:tasks.rados.rados.2.smithi057.stdout:1533: finishing rollback tid 0 to smithi05720651-6 2020-11-16T22:07:44.650 INFO:tasks.rados.rados.2.smithi057.stdout:1533: finishing rollback tid 1 to smithi05720651-6 2020-11-16T22:07:44.650 INFO:tasks.rados.rados.2.smithi057.stdout:1532: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:44.650 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1231 (ObjNum 517 snap 182 seq_num 517) dirty exists 2020-11-16T22:07:44.854 INFO:tasks.rados.rados.2.smithi057.stdout:1532: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 517 snap 182 seq_num 517) 2020-11-16T22:07:44.854 INFO:tasks.rados.rados.2.smithi057.stdout:1533: finishing rollback tid 2 to smithi05720651-6 2020-11-16T22:07:44.854 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 1338 (ObjNum 429 snap 144 seq_num 429) dirty exists 2020-11-16T22:07:44.981 INFO:tasks.rados.rados.2.smithi057.stdout:1529: done (3 left) 2020-11-16T22:07:44.981 INFO:tasks.rados.rados.2.smithi057.stdout:1532: done (2 left) 2020-11-16T22:07:44.981 INFO:tasks.rados.rados.2.smithi057.stdout:1533: done (1 left) 2020-11-16T22:07:44.982 INFO:tasks.rados.rados.2.smithi057.stdout:1534: done (0 left) 2020-11-16T22:07:44.982 INFO:tasks.rados.rados.2.smithi057.stdout:1535: write oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 183 2020-11-16T22:07:44.982 INFO:tasks.rados.rados.2.smithi057.stdout:1535: seq_num 518 ranges {706026=490986,1828849=790505} 2020-11-16T22:07:44.992 INFO:tasks.rados.rados.2.smithi057.stdout:1535: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 706026 to 1197012 tid 1 2020-11-16T22:07:45.001 INFO:tasks.rados.rados.2.smithi057.stdout:1535: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1828849 to 2619354 tid 2 2020-11-16T22:07:45.001 INFO:tasks.rados.rados.2.smithi057.stdout:1536: read oid 20 snap -1 2020-11-16T22:07:45.001 INFO:tasks.rados.rados.2.smithi057.stdout:1536: expect (ObjNum 447 snap 150 seq_num 447) 2020-11-16T22:07:45.001 INFO:tasks.rados.rados.2.smithi057.stdout:1537: delete oid 36 current snap is 183 2020-11-16T22:07:45.001 INFO:tasks.rados.rados.2.smithi057.stdout:1535: finishing write tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:45.010 INFO:tasks.rados.rados.2.smithi057.stdout:1536: expect (ObjNum 447 snap 150 seq_num 447) 2020-11-16T22:07:45.163 INFO:tasks.rados.rados.2.smithi057.stdout:1535: finishing write tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:45.163 INFO:tasks.rados.rados.2.smithi057.stdout:1535: finishing write tid 4 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:45.366 INFO:tasks.rados.rados.2.smithi057.stdout:1535: finishing write tid 5 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:45.366 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1136 (ObjNum 518 snap 183 seq_num 518) dirty exists 2020-11-16T22:07:45.366 INFO:tasks.rados.rados.2.smithi057.stdout:1535: left oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 518 snap 183 seq_num 518) 2020-11-16T22:07:45.367 INFO:tasks.rados.rados.2.smithi057.stdout:1535: done (2 left) 2020-11-16T22:07:45.367 INFO:tasks.rados.rados.2.smithi057.stdout:1536: done (1 left) 2020-11-16T22:07:45.367 INFO:tasks.rados.rados.2.smithi057.stdout:1537: done (0 left) 2020-11-16T22:07:45.367 INFO:tasks.rados.rados.2.smithi057.stdout:1538: snap_remove snap 179 2020-11-16T22:07:45.368 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:45 smithi195 bash[10218]: cluster 2020-11-16T22:07:43.689727+0000 mgr.x (mgr.24115) 453 : cluster [DBG] pgmap v820: 17 pgs: 17 active+clean; 128 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 668 KiB/s wr, 5 op/s 2020-11-16T22:07:45.368 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:45 smithi195 bash[10218]: cluster 2020-11-16T22:07:44.027132+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e438: 12 total, 12 up, 12 in 2020-11-16T22:07:45.368 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:45 smithi195 bash[10218]: cluster 2020-11-16T22:07:44.991384+0000 mon.a (mon.0) 1092 : cluster [DBG] osdmap e439: 12 total, 12 up, 12 in 2020-11-16T22:07:45.369 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:45 smithi016 bash[10302]: cluster 2020-11-16T22:07:43.689727+0000 mgr.x (mgr.24115) 453 : cluster [DBG] pgmap v820: 17 pgs: 17 active+clean; 128 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 668 KiB/s wr, 5 op/s 2020-11-16T22:07:45.369 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:45 smithi016 bash[10302]: cluster 2020-11-16T22:07:44.027132+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e438: 12 total, 12 up, 12 in 2020-11-16T22:07:45.369 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:45 smithi016 bash[10302]: cluster 2020-11-16T22:07:44.991384+0000 mon.a (mon.0) 1092 : cluster [DBG] osdmap e439: 12 total, 12 up, 12 in 2020-11-16T22:07:45.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:45 smithi057 bash[10301]: cluster 2020-11-16T22:07:43.689727+0000 mgr.x (mgr.24115) 453 : cluster [DBG] pgmap v820: 17 pgs: 17 active+clean; 128 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 668 KiB/s wr, 5 op/s 2020-11-16T22:07:45.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:45 smithi057 bash[10301]: cluster 2020-11-16T22:07:44.027132+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e438: 12 total, 12 up, 12 in 2020-11-16T22:07:45.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:45 smithi057 bash[10301]: cluster 2020-11-16T22:07:44.991384+0000 mon.a (mon.0) 1092 : cluster [DBG] osdmap e439: 12 total, 12 up, 12 in 2020-11-16T22:07:46.028 INFO:tasks.rados.rados.2.smithi057.stdout:1538: done (0 left) 2020-11-16T22:07:46.029 INFO:tasks.rados.rados.2.smithi057.stdout:1539: snap_create 2020-11-16T22:07:47.029 INFO:tasks.rados.rados.2.smithi057.stdout:1539: done (0 left) 2020-11-16T22:07:47.030 INFO:tasks.rados.rados.2.smithi057.stdout:1540: snap_create 2020-11-16T22:07:47.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:47 smithi016 bash[10302]: cluster 2020-11-16T22:07:45.690438+0000 mgr.x (mgr.24115) 454 : cluster [DBG] pgmap v823: 17 pgs: 17 active+clean; 106 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 938 KiB/s wr, 16 op/s 2020-11-16T22:07:47.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:47 smithi016 bash[10302]: cluster 2020-11-16T22:07:46.037372+0000 mon.a (mon.0) 1093 : cluster [DBG] osdmap e440: 12 total, 12 up, 12 in 2020-11-16T22:07:47.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:47 smithi195 bash[10218]: cluster 2020-11-16T22:07:45.690438+0000 mgr.x (mgr.24115) 454 : cluster [DBG] pgmap v823: 17 pgs: 17 active+clean; 106 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 938 KiB/s wr, 16 op/s 2020-11-16T22:07:47.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:47 smithi195 bash[10218]: cluster 2020-11-16T22:07:46.037372+0000 mon.a (mon.0) 1093 : cluster [DBG] osdmap e440: 12 total, 12 up, 12 in 2020-11-16T22:07:47.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:47 smithi057 bash[10301]: cluster 2020-11-16T22:07:45.690438+0000 mgr.x (mgr.24115) 454 : cluster [DBG] pgmap v823: 17 pgs: 17 active+clean; 106 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 938 KiB/s wr, 16 op/s 2020-11-16T22:07:47.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:47 smithi057 bash[10301]: cluster 2020-11-16T22:07:46.037372+0000 mon.a (mon.0) 1093 : cluster [DBG] osdmap e440: 12 total, 12 up, 12 in 2020-11-16T22:07:48.048 INFO:tasks.rados.rados.2.smithi057.stdout:1540: done (0 left) 2020-11-16T22:07:48.048 INFO:tasks.rados.rados.2.smithi057.stdout:1541: read oid 28 snap 184 2020-11-16T22:07:48.048 INFO:tasks.rados.rados.2.smithi057.stdout:1541: expect deleted 2020-11-16T22:07:48.048 INFO:tasks.rados.rados.2.smithi057.stdout:1542: read oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:48.048 INFO:tasks.rados.rados.2.smithi057.stdout:1542: expect (ObjNum 464 snap 154 seq_num 464) 2020-11-16T22:07:48.049 INFO:tasks.rados.rados.2.smithi057.stdout:1543: copy_from oid 40 from oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 185 2020-11-16T22:07:48.049 INFO:tasks.rados.rados.2.smithi057.stdout:1544: copy_from oid 2 from oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 185 2020-11-16T22:07:48.049 INFO:tasks.rados.rados.2.smithi057.stdout:1545: read oid 30 snap -1 2020-11-16T22:07:48.049 INFO:tasks.rados.rados.2.smithi057.stdout:1545: expect (ObjNum 506 snap 177 seq_num 506) 2020-11-16T22:07:48.049 INFO:tasks.rados.rados.2.smithi057.stdout:1546: snap_create 2020-11-16T22:07:48.059 INFO:tasks.rados.rados.2.smithi057.stdout:1545: expect (ObjNum 506 snap 177 seq_num 506) 2020-11-16T22:07:48.175 INFO:tasks.rados.rados.2.smithi057.stdout:1542: expect (ObjNum 464 snap 154 seq_num 464) 2020-11-16T22:07:48.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:48 smithi016 bash[10302]: cluster 2020-11-16T22:07:47.040937+0000 mon.a (mon.0) 1094 : cluster [DBG] osdmap e441: 12 total, 12 up, 12 in 2020-11-16T22:07:48.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:48 smithi195 bash[10218]: cluster 2020-11-16T22:07:47.040937+0000 mon.a (mon.0) 1094 : cluster [DBG] osdmap e441: 12 total, 12 up, 12 in 2020-11-16T22:07:48.442 INFO:tasks.rados.rados.2.smithi057.stdout:1543: finishing copy_from to smithi05720651-40 2020-11-16T22:07:48.443 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 1168 (ObjNum 473 snap 163 seq_num 473) dirty exists 2020-11-16T22:07:48.443 INFO:tasks.rados.rados.2.smithi057.stdout:1543: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:07:48.443 INFO:tasks.rados.rados.2.smithi057.stdout:1544: finishing copy_from to smithi05720651-2 2020-11-16T22:07:48.443 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 1297 (ObjNum 496 snap 177 seq_num 496) dirty exists 2020-11-16T22:07:48.443 INFO:tasks.rados.rados.2.smithi057.stdout:1544: finishing copy_from racing read to smithi05720651-2 2020-11-16T22:07:48.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:48 smithi057 bash[10301]: cluster 2020-11-16T22:07:47.040937+0000 mon.a (mon.0) 1094 : cluster [DBG] osdmap e441: 12 total, 12 up, 12 in 2020-11-16T22:07:49.050 INFO:tasks.rados.rados.2.smithi057.stdout:1541: done (5 left) 2020-11-16T22:07:49.051 INFO:tasks.rados.rados.2.smithi057.stdout:1542: done (4 left) 2020-11-16T22:07:49.051 INFO:tasks.rados.rados.2.smithi057.stdout:1543: done (3 left) 2020-11-16T22:07:49.051 INFO:tasks.rados.rados.2.smithi057.stdout:1544: done (2 left) 2020-11-16T22:07:49.051 INFO:tasks.rados.rados.2.smithi057.stdout:1545: done (1 left) 2020-11-16T22:07:49.052 INFO:tasks.rados.rados.2.smithi057.stdout:1546: done (0 left) 2020-11-16T22:07:49.052 INFO:tasks.rados.rados.2.smithi057.stdout:1547: delete oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 186 2020-11-16T22:07:49.063 INFO:tasks.rados.rados.2.smithi057.stdout:1547: done (0 left) 2020-11-16T22:07:49.064 INFO:tasks.rados.rados.2.smithi057.stdout:1548: read oid 2 snap 185 2020-11-16T22:07:49.064 INFO:tasks.rados.rados.2.smithi057.stdout:1548: expect (ObjNum 496 snap 177 seq_num 496) 2020-11-16T22:07:49.064 INFO:tasks.rados.rados.2.smithi057.stdout:1549: read oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:49.064 INFO:tasks.rados.rados.2.smithi057.stdout:1549: expect (ObjNum 432 snap 145 seq_num 432) 2020-11-16T22:07:49.064 INFO:tasks.rados.rados.2.smithi057.stdout:1550: snap_create 2020-11-16T22:07:49.079 INFO:tasks.rados.rados.2.smithi057.stdout:1549: expect (ObjNum 432 snap 145 seq_num 432) 2020-11-16T22:07:49.265 INFO:tasks.rados.rados.2.smithi057.stdout:1548: expect (ObjNum 496 snap 177 seq_num 496) 2020-11-16T22:07:49.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:49 smithi016 bash[10302]: cluster 2020-11-16T22:07:47.691200+0000 mgr.x (mgr.24115) 455 : cluster [DBG] pgmap v826: 17 pgs: 17 active+clean; 105 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 1.5 MiB/s wr, 21 op/s 2020-11-16T22:07:49.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:49 smithi016 bash[10302]: cluster 2020-11-16T22:07:48.057433+0000 mon.a (mon.0) 1095 : cluster [DBG] osdmap e442: 12 total, 12 up, 12 in 2020-11-16T22:07:49.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:49 smithi195 bash[10218]: cluster 2020-11-16T22:07:47.691200+0000 mgr.x (mgr.24115) 455 : cluster [DBG] pgmap v826: 17 pgs: 17 active+clean; 105 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 1.5 MiB/s wr, 21 op/s 2020-11-16T22:07:49.550 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:49 smithi195 bash[10218]: cluster 2020-11-16T22:07:48.057433+0000 mon.a (mon.0) 1095 : cluster [DBG] osdmap e442: 12 total, 12 up, 12 in 2020-11-16T22:07:49.551 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:49 smithi057 bash[10301]: cluster 2020-11-16T22:07:47.691200+0000 mgr.x (mgr.24115) 455 : cluster [DBG] pgmap v826: 17 pgs: 17 active+clean; 105 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 1.5 MiB/s wr, 21 op/s 2020-11-16T22:07:49.551 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:49 smithi057 bash[10301]: cluster 2020-11-16T22:07:48.057433+0000 mon.a (mon.0) 1095 : cluster [DBG] osdmap e442: 12 total, 12 up, 12 in 2020-11-16T22:07:49.983 INFO:tasks.rados.rados.2.smithi057.stdout:1548: done (2 left) 2020-11-16T22:07:49.983 INFO:tasks.rados.rados.2.smithi057.stdout:1549: done (1 left) 2020-11-16T22:07:49.984 INFO:tasks.rados.rados.2.smithi057.stdout:1550: done (0 left) 2020-11-16T22:07:49.984 INFO:tasks.rados.rados.2.smithi057.stdout:1551: rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 187 2020-11-16T22:07:49.984 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 183 2020-11-16T22:07:49.984 INFO:tasks.rados.rados.2.smithi057.stdout:1552: rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 187 2020-11-16T22:07:49.984 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 184 2020-11-16T22:07:49.984 INFO:tasks.rados.rados.2.smithi057.stdout:1553: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:49.985 INFO:tasks.rados.rados.2.smithi057.stdout:1553: expect (ObjNum 473 snap 163 seq_num 473) 2020-11-16T22:07:49.985 INFO:tasks.rados.rados.2.smithi057.stdout:1554: snap_remove snap 186 2020-11-16T22:07:50.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:50 smithi016 bash[10302]: cluster 2020-11-16T22:07:49.059812+0000 mon.a (mon.0) 1096 : cluster [DBG] osdmap e443: 12 total, 12 up, 12 in 2020-11-16T22:07:50.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:50 smithi016 bash[10302]: cluster 2020-11-16T22:07:49.992425+0000 mon.a (mon.0) 1097 : cluster [DBG] osdmap e444: 12 total, 12 up, 12 in 2020-11-16T22:07:50.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:50 smithi195 bash[10218]: cluster 2020-11-16T22:07:49.059812+0000 mon.a (mon.0) 1096 : cluster [DBG] osdmap e443: 12 total, 12 up, 12 in 2020-11-16T22:07:50.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:50 smithi195 bash[10218]: cluster 2020-11-16T22:07:49.992425+0000 mon.a (mon.0) 1097 : cluster [DBG] osdmap e444: 12 total, 12 up, 12 in 2020-11-16T22:07:50.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:50 smithi057 bash[10301]: cluster 2020-11-16T22:07:49.059812+0000 mon.a (mon.0) 1096 : cluster [DBG] osdmap e443: 12 total, 12 up, 12 in 2020-11-16T22:07:50.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:50 smithi057 bash[10301]: cluster 2020-11-16T22:07:49.992425+0000 mon.a (mon.0) 1097 : cluster [DBG] osdmap e444: 12 total, 12 up, 12 in 2020-11-16T22:07:50.993 INFO:tasks.rados.rados.2.smithi057.stdout:1554: done (3 left) 2020-11-16T22:07:50.993 INFO:tasks.rados.rados.2.smithi057.stdout:1555: delete oid 20 current snap is 187 2020-11-16T22:07:50.993 INFO:tasks.rados.rados.2.smithi057.stdout:1552: finishing rollback tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:50.993 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 385 snap 0 seq_num 2932754784) dirty dne 2020-11-16T22:07:50.994 INFO:tasks.rados.rados.2.smithi057.stdout:1551: finishing rollback tid 0 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:50.994 INFO:tasks.rados.rados.2.smithi057.stdout:1551: finishing rollback tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:50.994 INFO:tasks.rados.rados.2.smithi057.stdout:1551: finishing rollback tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:50.994 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1351 (ObjNum 499 snap 177 seq_num 499) dirty exists 2020-11-16T22:07:50.994 INFO:tasks.rados.rados.2.smithi057.stdout:1553: expect (ObjNum 473 snap 163 seq_num 473) 2020-11-16T22:07:51.264 INFO:tasks.rados.rados.2.smithi057.stdout:1551: done (3 left) 2020-11-16T22:07:51.264 INFO:tasks.rados.rados.2.smithi057.stdout:1552: done (2 left) 2020-11-16T22:07:51.264 INFO:tasks.rados.rados.2.smithi057.stdout:1553: done (1 left) 2020-11-16T22:07:51.264 INFO:tasks.rados.rados.2.smithi057.stdout:1555: done (0 left) 2020-11-16T22:07:51.264 INFO:tasks.rados.rados.2.smithi057.stdout:1556: snap_create 2020-11-16T22:07:51.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:51 smithi016 bash[10302]: cluster 2020-11-16T22:07:49.691953+0000 mgr.x (mgr.24115) 456 : cluster [DBG] pgmap v829: 17 pgs: 17 active+clean; 105 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 611 KiB/s wr, 7 op/s 2020-11-16T22:07:51.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:51 smithi016 bash[10302]: cluster 2020-11-16T22:07:51.002706+0000 mon.a (mon.0) 1098 : cluster [DBG] osdmap e445: 12 total, 12 up, 12 in 2020-11-16T22:07:51.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:51 smithi195 bash[10218]: cluster 2020-11-16T22:07:49.691953+0000 mgr.x (mgr.24115) 456 : cluster [DBG] pgmap v829: 17 pgs: 17 active+clean; 105 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 611 KiB/s wr, 7 op/s 2020-11-16T22:07:51.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:51 smithi195 bash[10218]: cluster 2020-11-16T22:07:51.002706+0000 mon.a (mon.0) 1098 : cluster [DBG] osdmap e445: 12 total, 12 up, 12 in 2020-11-16T22:07:51.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:51 smithi057 bash[10301]: cluster 2020-11-16T22:07:49.691953+0000 mgr.x (mgr.24115) 456 : cluster [DBG] pgmap v829: 17 pgs: 17 active+clean; 105 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 611 KiB/s wr, 7 op/s 2020-11-16T22:07:51.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:51 smithi057 bash[10301]: cluster 2020-11-16T22:07:51.002706+0000 mon.a (mon.0) 1098 : cluster [DBG] osdmap e445: 12 total, 12 up, 12 in 2020-11-16T22:07:52.075 INFO:tasks.rados.rados.2.smithi057.stdout:1556: done (0 left) 2020-11-16T22:07:52.075 INFO:tasks.rados.rados.2.smithi057.stdout:1557: write (excl) oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 188 2020-11-16T22:07:52.076 INFO:tasks.rados.rados.2.smithi057.stdout:1557: seq_num 522 ranges {773254=791982,2346424=426830} 2020-11-16T22:07:52.088 INFO:tasks.rados.rados.2.smithi057.stdout:1557: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 773254 to 1565236 tid 1 2020-11-16T22:07:52.096 INFO:tasks.rados.rados.2.smithi057.stdout:1557: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2346424 to 2773254 tid 2 2020-11-16T22:07:52.096 INFO:tasks.rados.rados.2.smithi057.stdout:1558: rollback oid 4 current snap is 188 2020-11-16T22:07:52.096 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 4 to 187 2020-11-16T22:07:52.097 INFO:tasks.rados.rados.2.smithi057.stdout:1559: write (excl) oid 6 current snap is 188 2020-11-16T22:07:52.097 INFO:tasks.rados.rados.2.smithi057.stdout:1559: seq_num 523 ranges {790061=467231,2004906=541501} 2020-11-16T22:07:52.103 INFO:tasks.rados.rados.2.smithi057.stdout:1559: writing smithi05720651-6 from 790061 to 1257292 tid 1 2020-11-16T22:07:52.111 INFO:tasks.rados.rados.2.smithi057.stdout:1559: writing smithi05720651-6 from 2004906 to 2546407 tid 2 2020-11-16T22:07:52.111 INFO:tasks.rados.rados.2.smithi057.stdout:1560: rollback oid 40 current snap is 188 2020-11-16T22:07:52.111 INFO:tasks.rados.rados.2.smithi057.stdout:1558: finishing rollback tid 1 to smithi05720651-4 2020-11-16T22:07:52.111 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 0 (ObjNum 321 snap 0 seq_num 1864380723) dirty dne 2020-11-16T22:07:52.111 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 40 to 183 2020-11-16T22:07:52.112 INFO:tasks.rados.rados.2.smithi057.stdout:1557: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:52.112 INFO:tasks.rados.rados.2.smithi057.stdout:1557: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:52.112 INFO:tasks.rados.rados.2.smithi057.stdout:1557: finishing write tid 4 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:52.112 INFO:tasks.rados.rados.2.smithi057.stdout:1557: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:52.112 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1357 (ObjNum 522 snap 188 seq_num 522) dirty exists 2020-11-16T22:07:52.112 INFO:tasks.rados.rados.2.smithi057.stdout:1557: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 522 snap 188 seq_num 522) 2020-11-16T22:07:52.112 INFO:tasks.rados.rados.2.smithi057.stdout:1557: done (3 left) 2020-11-16T22:07:52.113 INFO:tasks.rados.rados.2.smithi057.stdout:1558: done (2 left) 2020-11-16T22:07:52.113 INFO:tasks.rados.rados.2.smithi057.stdout:1561: write oid 22 current snap is 188 2020-11-16T22:07:52.113 INFO:tasks.rados.rados.2.smithi057.stdout:1561: seq_num 524 ranges {406868=542480,1547035=401512,2690354=116514} 2020-11-16T22:07:52.116 INFO:tasks.rados.rados.2.smithi057.stdout:1561: writing smithi05720651-22 from 406868 to 949348 tid 1 2020-11-16T22:07:52.122 INFO:tasks.rados.rados.2.smithi057.stdout:1561: writing smithi05720651-22 from 1547035 to 1948547 tid 2 2020-11-16T22:07:52.127 INFO:tasks.rados.rados.2.smithi057.stdout:1561: writing smithi05720651-22 from 2690354 to 2806868 tid 3 2020-11-16T22:07:52.127 INFO:tasks.rados.rados.2.smithi057.stdout:1562: write oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 188 2020-11-16T22:07:52.127 INFO:tasks.rados.rados.2.smithi057.stdout:1562: seq_num 525 ranges {423675=734082,1721870=545170,2717777=105898} 2020-11-16T22:07:52.134 INFO:tasks.rados.rados.2.smithi057.stdout:1562: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 423675 to 1157757 tid 1 2020-11-16T22:07:52.140 INFO:tasks.rados.rados.2.smithi057.stdout:1562: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1721870 to 2267040 tid 2 2020-11-16T22:07:52.143 INFO:tasks.rados.rados.2.smithi057.stdout:1562: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2717777 to 2823675 tid 3 2020-11-16T22:07:52.144 INFO:tasks.rados.rados.2.smithi057.stdout:1563: write (excl) oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 188 2020-11-16T22:07:52.144 INFO:tasks.rados.rados.2.smithi057.stdout:1563: seq_num 526 ranges {440482=409331,1380352=405181,2461553=378929} 2020-11-16T22:07:52.148 INFO:tasks.rados.rados.2.smithi057.stdout:1563: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 440482 to 849813 tid 1 2020-11-16T22:07:52.153 INFO:tasks.rados.rados.2.smithi057.stdout:1563: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1380352 to 1785533 tid 2 2020-11-16T22:07:52.160 INFO:tasks.rados.rados.2.smithi057.stdout:1563: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2461553 to 2840482 tid 3 2020-11-16T22:07:52.160 INFO:tasks.rados.rados.2.smithi057.stdout:1564: read oid 38 snap -1 2020-11-16T22:07:52.161 INFO:tasks.rados.rados.2.smithi057.stdout:1564: expect deleted 2020-11-16T22:07:52.161 INFO:tasks.rados.rados.2.smithi057.stdout:1565: copy_from oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 188 2020-11-16T22:07:52.161 INFO:tasks.rados.rados.2.smithi057.stdout:1559: finishing write tid 1 to smithi05720651-6 2020-11-16T22:07:52.161 INFO:tasks.rados.rados.2.smithi057.stdout:1559: finishing write tid 2 to smithi05720651-6 2020-11-16T22:07:52.161 INFO:tasks.rados.rados.2.smithi057.stdout:1559: finishing write tid 4 to smithi05720651-6 2020-11-16T22:07:52.161 INFO:tasks.rados.rados.2.smithi057.stdout:1559: finishing write tid 5 to smithi05720651-6 2020-11-16T22:07:52.161 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 1361 (ObjNum 523 snap 188 seq_num 523) dirty exists 2020-11-16T22:07:52.162 INFO:tasks.rados.rados.2.smithi057.stdout:1559: left oid 6 (ObjNum 523 snap 188 seq_num 523) 2020-11-16T22:07:52.162 INFO:tasks.rados.rados.2.smithi057.stdout:1560: finishing rollback tid 0 to smithi05720651-40 2020-11-16T22:07:52.162 INFO:tasks.rados.rados.2.smithi057.stdout:1561: finishing write tid 1 to smithi05720651-22 2020-11-16T22:07:52.162 INFO:tasks.rados.rados.2.smithi057.stdout:1561: finishing write tid 2 to smithi05720651-22 2020-11-16T22:07:52.162 INFO:tasks.rados.rados.2.smithi057.stdout:1561: finishing write tid 3 to smithi05720651-22 2020-11-16T22:07:52.162 INFO:tasks.rados.rados.2.smithi057.stdout:1561: finishing write tid 5 to smithi05720651-22 2020-11-16T22:07:52.162 INFO:tasks.rados.rados.2.smithi057.stdout:1561: finishing write tid 6 to smithi05720651-22 2020-11-16T22:07:52.163 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 882 (ObjNum 524 snap 188 seq_num 524) dirty exists 2020-11-16T22:07:52.163 INFO:tasks.rados.rados.2.smithi057.stdout:1561: left oid 22 (ObjNum 524 snap 188 seq_num 524) 2020-11-16T22:07:52.163 INFO:tasks.rados.rados.2.smithi057.stdout:1562: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:52.163 INFO:tasks.rados.rados.2.smithi057.stdout:1562: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:52.163 INFO:tasks.rados.rados.2.smithi057.stdout:1562: finishing write tid 3 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:52.163 INFO:tasks.rados.rados.2.smithi057.stdout:1562: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:52.164 INFO:tasks.rados.rados.2.smithi057.stdout:1562: finishing write tid 6 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:52.164 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 962 (ObjNum 525 snap 188 seq_num 525) dirty exists 2020-11-16T22:07:52.164 INFO:tasks.rados.rados.2.smithi057.stdout:1562: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 525 snap 188 seq_num 525) 2020-11-16T22:07:52.366 INFO:tasks.rados.rados.2.smithi057.stdout:1563: finishing write tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:52.366 INFO:tasks.rados.rados.2.smithi057.stdout:1563: finishing write tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:52.366 INFO:tasks.rados.rados.2.smithi057.stdout:1559: done (6 left) 2020-11-16T22:07:52.367 INFO:tasks.rados.rados.2.smithi057.stdout:1561: done (5 left) 2020-11-16T22:07:52.367 INFO:tasks.rados.rados.2.smithi057.stdout:1562: done (4 left) 2020-11-16T22:07:52.367 INFO:tasks.rados.rados.2.smithi057.stdout:1566: rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 188 2020-11-16T22:07:52.367 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 187 2020-11-16T22:07:52.367 INFO:tasks.rados.rados.2.smithi057.stdout:1567: copy_from oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 14 current snap is 188 2020-11-16T22:07:52.367 INFO:tasks.rados.rados.2.smithi057.stdout:1568: snap_remove snap 182 2020-11-16T22:07:53.090 INFO:tasks.rados.rados.2.smithi057.stdout:1568: done (6 left) 2020-11-16T22:07:53.091 INFO:tasks.rados.rados.2.smithi057.stdout:1569: read oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:53.091 INFO:tasks.rados.rados.2.smithi057.stdout:1569: expect (ObjNum 469 snap 158 seq_num 469) 2020-11-16T22:07:53.091 INFO:tasks.rados.rados.2.smithi057.stdout:1570: read oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:53.091 INFO:tasks.rados.rados.2.smithi057.stdout:1570: expect (ObjNum 327 snap 111 seq_num 327) 2020-11-16T22:07:53.091 INFO:tasks.rados.rados.2.smithi057.stdout:1571: rollback oid 48 current snap is 188 2020-11-16T22:07:53.091 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 48 to 181 2020-11-16T22:07:53.092 INFO:tasks.rados.rados.2.smithi057.stdout:1566: finishing rollback tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:53.092 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 81 snap 0 seq_num 1) dirty dne 2020-11-16T22:07:53.092 INFO:tasks.rados.rados.2.smithi057.stdout:1563: finishing write tid 3 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:53.092 INFO:tasks.rados.rados.2.smithi057.stdout:1563: finishing write tid 5 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:53.092 INFO:tasks.rados.rados.2.smithi057.stdout:1563: finishing write tid 6 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:53.092 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1175 (ObjNum 526 snap 188 seq_num 526) dirty exists 2020-11-16T22:07:53.092 INFO:tasks.rados.rados.2.smithi057.stdout:1563: left oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 526 snap 188 seq_num 526) 2020-11-16T22:07:53.093 INFO:tasks.rados.rados.2.smithi057.stdout:1565: finishing copy_from to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:53.093 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1444 (ObjNum 513 snap 182 seq_num 513) dirty exists 2020-11-16T22:07:53.093 INFO:tasks.rados.rados.2.smithi057.stdout:1567: finishing copy_from to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:53.294 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1406 (ObjNum 502 snap 177 seq_num 502) dirty exists 2020-11-16T22:07:53.294 INFO:tasks.rados.rados.2.smithi057.stdout:1567: finishing copy_from racing read to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:53.294 INFO:tasks.rados.rados.2.smithi057.stdout:1560: finishing rollback tid 1 to smithi05720651-40 2020-11-16T22:07:53.295 INFO:tasks.rados.rados.2.smithi057.stdout:1560: finishing rollback tid 2 to smithi05720651-40 2020-11-16T22:07:53.295 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 1461 (ObjNum 483 snap 168 seq_num 483) dirty exists 2020-11-16T22:07:53.295 INFO:tasks.rados.rados.2.smithi057.stdout:1565: finishing copy_from racing read to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:53.295 INFO:tasks.rados.rados.2.smithi057.stdout:1560: done (8 left) 2020-11-16T22:07:53.295 INFO:tasks.rados.rados.2.smithi057.stdout:1563: done (7 left) 2020-11-16T22:07:53.295 INFO:tasks.rados.rados.2.smithi057.stdout:1564: done (6 left) 2020-11-16T22:07:53.296 INFO:tasks.rados.rados.2.smithi057.stdout:1565: done (5 left) 2020-11-16T22:07:53.296 INFO:tasks.rados.rados.2.smithi057.stdout:1566: done (4 left) 2020-11-16T22:07:53.296 INFO:tasks.rados.rados.2.smithi057.stdout:1567: done (3 left) 2020-11-16T22:07:53.296 INFO:tasks.rados.rados.2.smithi057.stdout:1572: snap_remove snap 187 2020-11-16T22:07:53.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:53 smithi016 bash[10302]: cluster 2020-11-16T22:07:51.692696+0000 mgr.x (mgr.24115) 457 : cluster [DBG] pgmap v832: 17 pgs: 17 active+clean; 111 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2020-11-16T22:07:53.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:53 smithi016 bash[10302]: cluster 2020-11-16T22:07:52.086148+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e446: 12 total, 12 up, 12 in 2020-11-16T22:07:53.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:53 smithi195 bash[10218]: cluster 2020-11-16T22:07:51.692696+0000 mgr.x (mgr.24115) 457 : cluster [DBG] pgmap v832: 17 pgs: 17 active+clean; 111 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2020-11-16T22:07:53.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:53 smithi195 bash[10218]: cluster 2020-11-16T22:07:52.086148+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e446: 12 total, 12 up, 12 in 2020-11-16T22:07:53.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:53 smithi057 bash[10301]: cluster 2020-11-16T22:07:51.692696+0000 mgr.x (mgr.24115) 457 : cluster [DBG] pgmap v832: 17 pgs: 17 active+clean; 111 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2020-11-16T22:07:53.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:53 smithi057 bash[10301]: cluster 2020-11-16T22:07:52.086148+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e446: 12 total, 12 up, 12 in 2020-11-16T22:07:54.097 INFO:tasks.rados.rados.2.smithi057.stdout:1572: done (3 left) 2020-11-16T22:07:54.097 INFO:tasks.rados.rados.2.smithi057.stdout:1573: write (excl) oid 10 current snap is 188 2020-11-16T22:07:54.097 INFO:tasks.rados.rados.2.smithi057.stdout:1573: seq_num 527 ranges {457289=484580,1438834=548839,2772623=84666} 2020-11-16T22:07:54.108 INFO:tasks.rados.rados.2.smithi057.stdout:1573: writing smithi05720651-10 from 457289 to 941869 tid 1 2020-11-16T22:07:54.115 INFO:tasks.rados.rados.2.smithi057.stdout:1573: writing smithi05720651-10 from 1438834 to 1987673 tid 2 2020-11-16T22:07:54.120 INFO:tasks.rados.rados.2.smithi057.stdout:1573: writing smithi05720651-10 from 2772623 to 2857289 tid 3 2020-11-16T22:07:54.120 INFO:tasks.rados.rados.2.smithi057.stdout:1574: rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 188 2020-11-16T22:07:54.120 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 181 2020-11-16T22:07:54.120 INFO:tasks.rados.rados.2.smithi057.stdout:1571: finishing rollback tid 0 to smithi05720651-48 2020-11-16T22:07:54.121 INFO:tasks.rados.rados.2.smithi057.stdout:1571: finishing rollback tid 1 to smithi05720651-48 2020-11-16T22:07:54.121 INFO:tasks.rados.rados.2.smithi057.stdout:1570: expect (ObjNum 327 snap 111 seq_num 327) 2020-11-16T22:07:54.270 INFO:tasks.rados.rados.2.smithi057.stdout:1569: expect (ObjNum 469 snap 158 seq_num 469) 2020-11-16T22:07:54.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:54 smithi195 bash[10218]: cluster 2020-11-16T22:07:53.096607+0000 mon.a (mon.0) 1100 : cluster [DBG] osdmap e447: 12 total, 12 up, 12 in 2020-11-16T22:07:54.435 INFO:tasks.rados.rados.2.smithi057.stdout:1571: finishing rollback tid 2 to smithi05720651-48 2020-11-16T22:07:54.435 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 1296 (ObjNum 410 snap 138 seq_num 410) dirty exists 2020-11-16T22:07:54.436 INFO:tasks.rados.rados.2.smithi057.stdout:1573: finishing write tid 1 to smithi05720651-10 2020-11-16T22:07:54.436 INFO:tasks.rados.rados.2.smithi057.stdout:1573: finishing write tid 2 to smithi05720651-10 2020-11-16T22:07:54.436 INFO:tasks.rados.rados.2.smithi057.stdout:1573: finishing write tid 3 to smithi05720651-10 2020-11-16T22:07:54.436 INFO:tasks.rados.rados.2.smithi057.stdout:1573: finishing write tid 5 to smithi05720651-10 2020-11-16T22:07:54.436 INFO:tasks.rados.rados.2.smithi057.stdout:1573: finishing write tid 6 to smithi05720651-10 2020-11-16T22:07:54.436 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 1306 (ObjNum 527 snap 188 seq_num 527) dirty exists 2020-11-16T22:07:54.437 INFO:tasks.rados.rados.2.smithi057.stdout:1573: left oid 10 (ObjNum 527 snap 188 seq_num 527) 2020-11-16T22:07:54.437 INFO:tasks.rados.rados.2.smithi057.stdout:1574: finishing rollback tid 0 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:54.437 INFO:tasks.rados.rados.2.smithi057.stdout:1574: finishing rollback tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:54.437 INFO:tasks.rados.rados.2.smithi057.stdout:1569: done (4 left) 2020-11-16T22:07:54.437 INFO:tasks.rados.rados.2.smithi057.stdout:1570: done (3 left) 2020-11-16T22:07:54.437 INFO:tasks.rados.rados.2.smithi057.stdout:1571: done (2 left) 2020-11-16T22:07:54.437 INFO:tasks.rados.rados.2.smithi057.stdout:1573: done (1 left) 2020-11-16T22:07:54.438 INFO:tasks.rados.rados.2.smithi057.stdout:1575: delete oid 12 current snap is 188 2020-11-16T22:07:54.438 INFO:tasks.rados.rados.2.smithi057.stdout:1574: finishing rollback tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:54.438 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1447 (ObjNum 490 snap 172 seq_num 490) dirty exists 2020-11-16T22:07:54.440 INFO:tasks.rados.rados.2.smithi057.stdout:1574: done (1 left) 2020-11-16T22:07:54.440 INFO:tasks.rados.rados.2.smithi057.stdout:1575: done (0 left) 2020-11-16T22:07:54.440 INFO:tasks.rados.rados.2.smithi057.stdout:1576: read oid 6 snap 183 2020-11-16T22:07:54.440 INFO:tasks.rados.rados.2.smithi057.stdout:1576: expect (ObjNum 429 snap 144 seq_num 429) 2020-11-16T22:07:54.440 INFO:tasks.rados.rados.2.smithi057.stdout:1577: rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 188 2020-11-16T22:07:54.440 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 181 2020-11-16T22:07:54.441 INFO:tasks.rados.rados.2.smithi057.stdout:1578: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:54.441 INFO:tasks.rados.rados.2.smithi057.stdout:1578: expect (ObjNum 525 snap 188 seq_num 525) 2020-11-16T22:07:54.441 INFO:tasks.rados.rados.2.smithi057.stdout:1579: snap_remove snap 184 2020-11-16T22:07:54.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:54 smithi057 bash[10301]: cluster 2020-11-16T22:07:53.096607+0000 mon.a (mon.0) 1100 : cluster [DBG] osdmap e447: 12 total, 12 up, 12 in 2020-11-16T22:07:54.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:54 smithi016 bash[10302]: cluster 2020-11-16T22:07:53.096607+0000 mon.a (mon.0) 1100 : cluster [DBG] osdmap e447: 12 total, 12 up, 12 in 2020-11-16T22:07:54.984 INFO:tasks.rados.rados.2.smithi057.stdout:1579: done (3 left) 2020-11-16T22:07:54.985 INFO:tasks.rados.rados.2.smithi057.stdout:1580: snap_create 2020-11-16T22:07:54.985 INFO:tasks.rados.rados.2.smithi057.stdout:1577: finishing rollback tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:54.985 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 385 snap 0 seq_num 2932702992) dirty dne 2020-11-16T22:07:54.985 INFO:tasks.rados.rados.2.smithi057.stdout:1576: expect (ObjNum 429 snap 144 seq_num 429) 2020-11-16T22:07:55.120 INFO:tasks.rados.rados.2.smithi057.stdout:1578: expect (ObjNum 525 snap 188 seq_num 525) 2020-11-16T22:07:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:55 smithi195 bash[10218]: cluster 2020-11-16T22:07:53.693374+0000 mgr.x (mgr.24115) 458 : cluster [DBG] pgmap v835: 17 pgs: 17 active+clean; 111 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2020-11-16T22:07:55.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:55 smithi195 bash[10218]: cluster 2020-11-16T22:07:54.106117+0000 mon.a (mon.0) 1101 : cluster [DBG] osdmap e448: 12 total, 12 up, 12 in 2020-11-16T22:07:55.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:55 smithi195 bash[10218]: cluster 2020-11-16T22:07:54.994766+0000 mon.a (mon.0) 1102 : cluster [DBG] osdmap e449: 12 total, 12 up, 12 in 2020-11-16T22:07:55.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:55 smithi057 bash[10301]: cluster 2020-11-16T22:07:53.693374+0000 mgr.x (mgr.24115) 458 : cluster [DBG] pgmap v835: 17 pgs: 17 active+clean; 111 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2020-11-16T22:07:55.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:55 smithi057 bash[10301]: cluster 2020-11-16T22:07:54.106117+0000 mon.a (mon.0) 1101 : cluster [DBG] osdmap e448: 12 total, 12 up, 12 in 2020-11-16T22:07:55.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:55 smithi057 bash[10301]: cluster 2020-11-16T22:07:54.994766+0000 mon.a (mon.0) 1102 : cluster [DBG] osdmap e449: 12 total, 12 up, 12 in 2020-11-16T22:07:55.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:55 smithi016 bash[10302]: cluster 2020-11-16T22:07:53.693374+0000 mgr.x (mgr.24115) 458 : cluster [DBG] pgmap v835: 17 pgs: 17 active+clean; 111 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2020-11-16T22:07:55.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:55 smithi016 bash[10302]: cluster 2020-11-16T22:07:54.106117+0000 mon.a (mon.0) 1101 : cluster [DBG] osdmap e448: 12 total, 12 up, 12 in 2020-11-16T22:07:55.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:55 smithi016 bash[10302]: cluster 2020-11-16T22:07:54.994766+0000 mon.a (mon.0) 1102 : cluster [DBG] osdmap e449: 12 total, 12 up, 12 in 2020-11-16T22:07:55.993 INFO:tasks.rados.rados.2.smithi057.stdout:1576: done (3 left) 2020-11-16T22:07:55.994 INFO:tasks.rados.rados.2.smithi057.stdout:1577: done (2 left) 2020-11-16T22:07:55.994 INFO:tasks.rados.rados.2.smithi057.stdout:1578: done (1 left) 2020-11-16T22:07:55.994 INFO:tasks.rados.rados.2.smithi057.stdout:1580: done (0 left) 2020-11-16T22:07:55.994 INFO:tasks.rados.rados.2.smithi057.stdout:1581: snap_remove snap 188 2020-11-16T22:07:57.009 INFO:tasks.rados.rados.2.smithi057.stdout:1581: done (0 left) 2020-11-16T22:07:57.010 INFO:tasks.rados.rados.2.smithi057.stdout:1582: write (excl) oid 10 current snap is 189 2020-11-16T22:07:57.010 INFO:tasks.rados.rados.2.smithi057.stdout:1582: seq_num 529 ranges {490903=635078,1839445=552508} 2020-11-16T22:07:57.022 INFO:tasks.rados.rados.2.smithi057.stdout:1582: writing smithi05720651-10 from 490903 to 1125981 tid 1 2020-11-16T22:07:57.029 INFO:tasks.rados.rados.2.smithi057.stdout:1582: writing smithi05720651-10 from 1839445 to 2391953 tid 2 2020-11-16T22:07:57.030 INFO:tasks.rados.rados.2.smithi057.stdout:1583: snap_create 2020-11-16T22:07:57.031 INFO:tasks.rados.rados.2.smithi057.stdout:1582: finishing write tid 1 to smithi05720651-10 2020-11-16T22:07:57.036 INFO:tasks.rados.rados.2.smithi057.stdout:1582: finishing write tid 2 to smithi05720651-10 2020-11-16T22:07:57.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:57 smithi016 bash[10302]: cluster 2020-11-16T22:07:55.694072+0000 mgr.x (mgr.24115) 459 : cluster [DBG] pgmap v838: 17 pgs: 17 active+clean; 119 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2020-11-16T22:07:57.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:57 smithi016 bash[10302]: cluster 2020-11-16T22:07:56.004178+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e450: 12 total, 12 up, 12 in 2020-11-16T22:07:57.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:57 smithi195 bash[10218]: cluster 2020-11-16T22:07:55.694072+0000 mgr.x (mgr.24115) 459 : cluster [DBG] pgmap v838: 17 pgs: 17 active+clean; 119 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2020-11-16T22:07:57.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:57 smithi195 bash[10218]: cluster 2020-11-16T22:07:56.004178+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e450: 12 total, 12 up, 12 in 2020-11-16T22:07:57.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:57 smithi057 bash[10301]: cluster 2020-11-16T22:07:55.694072+0000 mgr.x (mgr.24115) 459 : cluster [DBG] pgmap v838: 17 pgs: 17 active+clean; 119 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2020-11-16T22:07:57.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:57 smithi057 bash[10301]: cluster 2020-11-16T22:07:56.004178+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e450: 12 total, 12 up, 12 in 2020-11-16T22:07:57.527 INFO:tasks.rados.rados.2.smithi057.stdout:1582: finishing write tid 4 to smithi05720651-10 2020-11-16T22:07:57.528 INFO:tasks.rados.rados.2.smithi057.stdout:1582: finishing write tid 5 to smithi05720651-10 2020-11-16T22:07:57.528 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 1309 (ObjNum 529 snap 189 seq_num 529) dirty exists 2020-11-16T22:07:57.528 INFO:tasks.rados.rados.2.smithi057.stdout:1582: left oid 10 (ObjNum 529 snap 189 seq_num 529) 2020-11-16T22:07:58.013 INFO:tasks.rados.rados.2.smithi057.stdout:1582: done (1 left) 2020-11-16T22:07:58.013 INFO:tasks.rados.rados.2.smithi057.stdout:1583: done (0 left) 2020-11-16T22:07:58.014 INFO:tasks.rados.rados.2.smithi057.stdout:1584: read oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:07:58.014 INFO:tasks.rados.rados.2.smithi057.stdout:1584: expect deleted 2020-11-16T22:07:58.014 INFO:tasks.rados.rados.2.smithi057.stdout:1585: snap_remove snap 189 2020-11-16T22:07:58.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:58 smithi016 bash[10302]: cluster 2020-11-16T22:07:57.013435+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e451: 12 total, 12 up, 12 in 2020-11-16T22:07:58.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:58 smithi195 bash[10218]: cluster 2020-11-16T22:07:57.013435+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e451: 12 total, 12 up, 12 in 2020-11-16T22:07:58.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:58 smithi057 bash[10301]: cluster 2020-11-16T22:07:57.013435+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e451: 12 total, 12 up, 12 in 2020-11-16T22:07:59.022 INFO:tasks.rados.rados.2.smithi057.stdout:1585: done (1 left) 2020-11-16T22:07:59.023 INFO:tasks.rados.rados.2.smithi057.stdout:1586: write (excl) oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 190 2020-11-16T22:07:59.023 INFO:tasks.rados.rados.2.smithi057.stdout:1586: seq_num 530 ranges {507710=710327,1897927=412519,2854892=52818} 2020-11-16T22:07:59.035 INFO:tasks.rados.rados.2.smithi057.stdout:1586: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 507710 to 1218037 tid 1 2020-11-16T22:07:59.041 INFO:tasks.rados.rados.2.smithi057.stdout:1586: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1897927 to 2310446 tid 2 2020-11-16T22:07:59.044 INFO:tasks.rados.rados.2.smithi057.stdout:1586: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2854892 to 2907710 tid 3 2020-11-16T22:07:59.045 INFO:tasks.rados.rados.2.smithi057.stdout:1587: snap_remove snap 183 2020-11-16T22:07:59.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:59 smithi016 bash[10302]: cluster 2020-11-16T22:07:57.694763+0000 mgr.x (mgr.24115) 460 : cluster [DBG] pgmap v841: 17 pgs: 17 active+clean; 125 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.9 MiB/s wr, 22 op/s 2020-11-16T22:07:59.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:07:59 smithi016 bash[10302]: cluster 2020-11-16T22:07:58.023690+0000 mon.a (mon.0) 1105 : cluster [DBG] osdmap e452: 12 total, 12 up, 12 in 2020-11-16T22:07:59.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:59 smithi195 bash[10218]: cluster 2020-11-16T22:07:57.694763+0000 mgr.x (mgr.24115) 460 : cluster [DBG] pgmap v841: 17 pgs: 17 active+clean; 125 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.9 MiB/s wr, 22 op/s 2020-11-16T22:07:59.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:07:59 smithi195 bash[10218]: cluster 2020-11-16T22:07:58.023690+0000 mon.a (mon.0) 1105 : cluster [DBG] osdmap e452: 12 total, 12 up, 12 in 2020-11-16T22:07:59.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:59 smithi057 bash[10301]: cluster 2020-11-16T22:07:57.694763+0000 mgr.x (mgr.24115) 460 : cluster [DBG] pgmap v841: 17 pgs: 17 active+clean; 125 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.9 MiB/s wr, 22 op/s 2020-11-16T22:07:59.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:07:59 smithi057 bash[10301]: cluster 2020-11-16T22:07:58.023690+0000 mon.a (mon.0) 1105 : cluster [DBG] osdmap e452: 12 total, 12 up, 12 in 2020-11-16T22:07:59.986 INFO:tasks.rados.rados.2.smithi057.stdout:1587: done (2 left) 2020-11-16T22:07:59.987 INFO:tasks.rados.rados.2.smithi057.stdout:1588: snap_create 2020-11-16T22:07:59.987 INFO:tasks.rados.rados.2.smithi057.stdout:1586: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:59.987 INFO:tasks.rados.rados.2.smithi057.stdout:1586: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:07:59.987 INFO:tasks.rados.rados.2.smithi057.stdout:1586: finishing write tid 3 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:00.190 INFO:tasks.rados.rados.2.smithi057.stdout:1586: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:00.190 INFO:tasks.rados.rados.2.smithi057.stdout:1586: finishing write tid 6 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:00.190 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1294 (ObjNum 530 snap 190 seq_num 530) dirty exists 2020-11-16T22:08:00.191 INFO:tasks.rados.rados.2.smithi057.stdout:1586: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 530 snap 190 seq_num 530) 2020-11-16T22:08:00.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:00 smithi016 bash[10302]: cluster 2020-11-16T22:07:59.033301+0000 mon.a (mon.0) 1106 : cluster [DBG] osdmap e453: 12 total, 12 up, 12 in 2020-11-16T22:08:00.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:00 smithi016 bash[10302]: cluster 2020-11-16T22:07:59.995847+0000 mon.a (mon.0) 1107 : cluster [DBG] osdmap e454: 12 total, 12 up, 12 in 2020-11-16T22:08:00.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:00 smithi195 bash[10218]: cluster 2020-11-16T22:07:59.033301+0000 mon.a (mon.0) 1106 : cluster [DBG] osdmap e453: 12 total, 12 up, 12 in 2020-11-16T22:08:00.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:00 smithi195 bash[10218]: cluster 2020-11-16T22:07:59.995847+0000 mon.a (mon.0) 1107 : cluster [DBG] osdmap e454: 12 total, 12 up, 12 in 2020-11-16T22:08:00.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:00 smithi057 bash[10301]: cluster 2020-11-16T22:07:59.033301+0000 mon.a (mon.0) 1106 : cluster [DBG] osdmap e453: 12 total, 12 up, 12 in 2020-11-16T22:08:00.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:00 smithi057 bash[10301]: cluster 2020-11-16T22:07:59.995847+0000 mon.a (mon.0) 1107 : cluster [DBG] osdmap e454: 12 total, 12 up, 12 in 2020-11-16T22:08:00.996 INFO:tasks.rados.rados.2.smithi057.stdout:1584: done (2 left) 2020-11-16T22:08:00.996 INFO:tasks.rados.rados.2.smithi057.stdout:1586: done (1 left) 2020-11-16T22:08:00.996 INFO:tasks.rados.rados.2.smithi057.stdout:1588: done (0 left) 2020-11-16T22:08:00.996 INFO:tasks.rados.rados.2.smithi057.stdout:1589: delete oid 32 current snap is 191 2020-11-16T22:08:01.001 INFO:tasks.rados.rados.2.smithi057.stdout:1589: done (0 left) 2020-11-16T22:08:01.001 INFO:tasks.rados.rados.2.smithi057.stdout:1590: write (excl) oid 28 current snap is 191 2020-11-16T22:08:01.001 INFO:tasks.rados.rados.2.smithi057.stdout:1590: seq_num 532 ranges {541324=460825,1498538=416188,2393385=547939} 2020-11-16T22:08:01.016 INFO:tasks.rados.rados.2.smithi057.stdout:1590: writing smithi05720651-28 from 541324 to 1002149 tid 1 2020-11-16T22:08:01.021 INFO:tasks.rados.rados.2.smithi057.stdout:1590: writing smithi05720651-28 from 1498538 to 1914726 tid 2 2020-11-16T22:08:01.027 INFO:tasks.rados.rados.2.smithi057.stdout:1590: writing smithi05720651-28 from 2393385 to 2941324 tid 3 2020-11-16T22:08:01.027 INFO:tasks.rados.rados.2.smithi057.stdout:1591: snap_create 2020-11-16T22:08:01.030 INFO:tasks.rados.rados.2.smithi057.stdout:1590: finishing write tid 1 to smithi05720651-28 2020-11-16T22:08:01.037 INFO:tasks.rados.rados.2.smithi057.stdout:1590: finishing write tid 2 to smithi05720651-28 2020-11-16T22:08:01.038 INFO:tasks.rados.rados.2.smithi057.stdout:1590: finishing write tid 3 to smithi05720651-28 2020-11-16T22:08:01.039 INFO:tasks.rados.rados.2.smithi057.stdout:1590: finishing write tid 5 to smithi05720651-28 2020-11-16T22:08:01.039 INFO:tasks.rados.rados.2.smithi057.stdout:1590: finishing write tid 6 to smithi05720651-28 2020-11-16T22:08:01.039 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 1313 (ObjNum 532 snap 191 seq_num 532) dirty exists 2020-11-16T22:08:01.040 INFO:tasks.rados.rados.2.smithi057.stdout:1590: left oid 28 (ObjNum 532 snap 191 seq_num 532) 2020-11-16T22:08:01.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:01 smithi016 bash[10302]: cluster 2020-11-16T22:07:59.695466+0000 mgr.x (mgr.24115) 461 : cluster [DBG] pgmap v844: 17 pgs: 17 active+clean; 125 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 978 KiB/s wr, 7 op/s 2020-11-16T22:08:01.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:01 smithi016 bash[10302]: cluster 2020-11-16T22:08:01.006349+0000 mon.a (mon.0) 1108 : cluster [DBG] osdmap e455: 12 total, 12 up, 12 in 2020-11-16T22:08:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:01 smithi195 bash[10218]: cluster 2020-11-16T22:07:59.695466+0000 mgr.x (mgr.24115) 461 : cluster [DBG] pgmap v844: 17 pgs: 17 active+clean; 125 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 978 KiB/s wr, 7 op/s 2020-11-16T22:08:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:01 smithi195 bash[10218]: cluster 2020-11-16T22:08:01.006349+0000 mon.a (mon.0) 1108 : cluster [DBG] osdmap e455: 12 total, 12 up, 12 in 2020-11-16T22:08:01.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:01 smithi057 bash[10301]: cluster 2020-11-16T22:07:59.695466+0000 mgr.x (mgr.24115) 461 : cluster [DBG] pgmap v844: 17 pgs: 17 active+clean; 125 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 978 KiB/s wr, 7 op/s 2020-11-16T22:08:01.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:01 smithi057 bash[10301]: cluster 2020-11-16T22:08:01.006349+0000 mon.a (mon.0) 1108 : cluster [DBG] osdmap e455: 12 total, 12 up, 12 in 2020-11-16T22:08:02.042 INFO:tasks.rados.rados.2.smithi057.stdout:1590: done (1 left) 2020-11-16T22:08:02.043 INFO:tasks.rados.rados.2.smithi057.stdout:1591: done (0 left) 2020-11-16T22:08:02.043 INFO:tasks.rados.rados.2.smithi057.stdout:1592: copy_from oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 10 current snap is 192 2020-11-16T22:08:02.043 INFO:tasks.rados.rados.2.smithi057.stdout:1593: write oid 30 current snap is 192 2020-11-16T22:08:02.043 INFO:tasks.rados.rados.2.smithi057.stdout:1593: seq_num 533 ranges {558131=652427,1673373=559846,2820808=137323} 2020-11-16T22:08:02.055 INFO:tasks.rados.rados.2.smithi057.stdout:1593: writing smithi05720651-30 from 558131 to 1210558 tid 1 2020-11-16T22:08:02.063 INFO:tasks.rados.rados.2.smithi057.stdout:1593: writing smithi05720651-30 from 1673373 to 2233219 tid 2 2020-11-16T22:08:02.068 INFO:tasks.rados.rados.2.smithi057.stdout:1593: writing smithi05720651-30 from 2820808 to 2958131 tid 3 2020-11-16T22:08:02.274 INFO:tasks.rados.rados.2.smithi057.stdout:1594: rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 192 2020-11-16T22:08:02.274 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 181 2020-11-16T22:08:02.274 INFO:tasks.rados.rados.2.smithi057.stdout:1593: finishing write tid 1 to smithi05720651-30 2020-11-16T22:08:02.275 INFO:tasks.rados.rados.2.smithi057.stdout:1595: copy_from oid 38 from oid 44 current snap is 192 2020-11-16T22:08:02.275 INFO:tasks.rados.rados.2.smithi057.stdout:1596: snap_create 2020-11-16T22:08:02.276 INFO:tasks.rados.rados.2.smithi057.stdout:1593: finishing write tid 2 to smithi05720651-30 2020-11-16T22:08:02.276 INFO:tasks.rados.rados.2.smithi057.stdout:1592: finishing copy_from to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:02.276 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1309 (ObjNum 529 snap 189 seq_num 529) dirty exists 2020-11-16T22:08:02.277 INFO:tasks.rados.rados.2.smithi057.stdout:1592: finishing copy_from racing read to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:02.277 INFO:tasks.rados.rados.2.smithi057.stdout:1593: finishing write tid 3 to smithi05720651-30 2020-11-16T22:08:02.277 INFO:tasks.rados.rados.2.smithi057.stdout:1593: finishing write tid 5 to smithi05720651-30 2020-11-16T22:08:02.277 INFO:tasks.rados.rados.2.smithi057.stdout:1593: finishing write tid 6 to smithi05720651-30 2020-11-16T22:08:02.277 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 1311 (ObjNum 533 snap 192 seq_num 533) dirty exists 2020-11-16T22:08:02.277 INFO:tasks.rados.rados.2.smithi057.stdout:1593: left oid 30 (ObjNum 533 snap 192 seq_num 533) 2020-11-16T22:08:02.278 INFO:tasks.rados.rados.2.smithi057.stdout:1594: finishing rollback tid 0 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:02.278 INFO:tasks.rados.rados.2.smithi057.stdout:1594: finishing rollback tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:02.278 INFO:tasks.rados.rados.2.smithi057.stdout:1594: finishing rollback tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:02.482 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1314 (ObjNum 482 snap 168 seq_num 482) dirty exists 2020-11-16T22:08:02.482 INFO:tasks.rados.rados.2.smithi057.stdout:1595: finishing copy_from to smithi05720651-38 2020-11-16T22:08:02.482 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 878 (ObjNum 290 snap 99 seq_num 290) dirty exists 2020-11-16T22:08:02.483 INFO:tasks.rados.rados.2.smithi057.stdout:1595: finishing copy_from racing read to smithi05720651-38 2020-11-16T22:08:03.048 INFO:tasks.rados.rados.2.smithi057.stdout:1592: done (4 left) 2020-11-16T22:08:03.048 INFO:tasks.rados.rados.2.smithi057.stdout:1593: done (3 left) 2020-11-16T22:08:03.048 INFO:tasks.rados.rados.2.smithi057.stdout:1594: done (2 left) 2020-11-16T22:08:03.048 INFO:tasks.rados.rados.2.smithi057.stdout:1595: done (1 left) 2020-11-16T22:08:03.049 INFO:tasks.rados.rados.2.smithi057.stdout:1596: done (0 left) 2020-11-16T22:08:03.049 INFO:tasks.rados.rados.2.smithi057.stdout:1597: delete oid 10 current snap is 193 2020-11-16T22:08:03.060 INFO:tasks.rados.rados.2.smithi057.stdout:1597: done (0 left) 2020-11-16T22:08:03.060 INFO:tasks.rados.rados.2.smithi057.stdout:1598: write oid 46 current snap is 193 2020-11-16T22:08:03.060 INFO:tasks.rados.rados.2.smithi057.stdout:1598: seq_num 535 ranges {591745=402925,1790337=563515} 2020-11-16T22:08:03.069 INFO:tasks.rados.rados.2.smithi057.stdout:1598: writing smithi05720651-46 from 591745 to 994670 tid 1 2020-11-16T22:08:03.079 INFO:tasks.rados.rados.2.smithi057.stdout:1598: writing smithi05720651-46 from 1790337 to 2353852 tid 2 2020-11-16T22:08:03.079 INFO:tasks.rados.rados.2.smithi057.stdout:1599: delete oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 193 2020-11-16T22:08:03.079 INFO:tasks.rados.rados.2.smithi057.stdout:1598: finishing write tid 1 to smithi05720651-46 2020-11-16T22:08:03.086 INFO:tasks.rados.rados.2.smithi057.stdout:1598: finishing write tid 2 to smithi05720651-46 2020-11-16T22:08:03.087 INFO:tasks.rados.rados.2.smithi057.stdout:1598: finishing write tid 4 to smithi05720651-46 2020-11-16T22:08:03.087 INFO:tasks.rados.rados.2.smithi057.stdout:1598: finishing write tid 5 to smithi05720651-46 2020-11-16T22:08:03.087 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 1317 (ObjNum 535 snap 193 seq_num 535) dirty exists 2020-11-16T22:08:03.088 INFO:tasks.rados.rados.2.smithi057.stdout:1598: left oid 46 (ObjNum 535 snap 193 seq_num 535) 2020-11-16T22:08:03.088 INFO:tasks.rados.rados.2.smithi057.stdout:1598: done (1 left) 2020-11-16T22:08:03.088 INFO:tasks.rados.rados.2.smithi057.stdout:1599: done (0 left) 2020-11-16T22:08:03.088 INFO:tasks.rados.rados.2.smithi057.stdout:1600: delete oid 44 current snap is 193 2020-11-16T22:08:03.092 INFO:tasks.rados.rados.2.smithi057.stdout:1600: done (0 left) 2020-11-16T22:08:03.092 INFO:tasks.rados.rados.2.smithi057.stdout:1601: copy_from oid 50 from oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 193 2020-11-16T22:08:03.092 INFO:tasks.rados.rados.2.smithi057.stdout:1602: snap_remove snap 191 2020-11-16T22:08:03.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:03 smithi016 bash[10302]: cluster 2020-11-16T22:08:01.696183+0000 mgr.x (mgr.24115) 462 : cluster [DBG] pgmap v847: 17 pgs: 17 active+clean; 126 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 577 KiB/s wr, 3 op/s 2020-11-16T22:08:03.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:03 smithi016 bash[10302]: cluster 2020-11-16T22:08:02.052753+0000 mon.a (mon.0) 1109 : cluster [DBG] osdmap e456: 12 total, 12 up, 12 in 2020-11-16T22:08:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:03 smithi195 bash[10218]: cluster 2020-11-16T22:08:01.696183+0000 mgr.x (mgr.24115) 462 : cluster [DBG] pgmap v847: 17 pgs: 17 active+clean; 126 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 577 KiB/s wr, 3 op/s 2020-11-16T22:08:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:03 smithi195 bash[10218]: cluster 2020-11-16T22:08:02.052753+0000 mon.a (mon.0) 1109 : cluster [DBG] osdmap e456: 12 total, 12 up, 12 in 2020-11-16T22:08:03.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:03 smithi057 bash[10301]: cluster 2020-11-16T22:08:01.696183+0000 mgr.x (mgr.24115) 462 : cluster [DBG] pgmap v847: 17 pgs: 17 active+clean; 126 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 577 KiB/s wr, 3 op/s 2020-11-16T22:08:03.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:03 smithi057 bash[10301]: cluster 2020-11-16T22:08:02.052753+0000 mon.a (mon.0) 1109 : cluster [DBG] osdmap e456: 12 total, 12 up, 12 in 2020-11-16T22:08:04.066 INFO:tasks.rados.rados.2.smithi057.stdout:1602: done (1 left) 2020-11-16T22:08:04.066 INFO:tasks.rados.rados.2.smithi057.stdout:1603: rollback oid 26 current snap is 193 2020-11-16T22:08:04.067 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 26 to 192 2020-11-16T22:08:04.067 INFO:tasks.rados.rados.2.smithi057.stdout:1601: finishing copy_from to smithi05720651-50 2020-11-16T22:08:04.067 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 1231 (ObjNum 517 snap 182 seq_num 517) dirty exists 2020-11-16T22:08:04.067 INFO:tasks.rados.rados.2.smithi057.stdout:1601: finishing copy_from racing read to smithi05720651-50 2020-11-16T22:08:04.067 INFO:tasks.rados.rados.2.smithi057.stdout:1601: done (1 left) 2020-11-16T22:08:04.067 INFO:tasks.rados.rados.2.smithi057.stdout:1604: delete oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 193 2020-11-16T22:08:04.075 INFO:tasks.rados.rados.2.smithi057.stdout:1604: done (1 left) 2020-11-16T22:08:04.075 INFO:tasks.rados.rados.2.smithi057.stdout:1605: snap_remove snap 185 2020-11-16T22:08:04.339 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:04 smithi016 bash[10302]: cluster 2020-11-16T22:08:03.056172+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e457: 12 total, 12 up, 12 in 2020-11-16T22:08:04.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:04 smithi195 bash[10218]: cluster 2020-11-16T22:08:03.056172+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e457: 12 total, 12 up, 12 in 2020-11-16T22:08:04.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:04 smithi057 bash[10301]: cluster 2020-11-16T22:08:03.056172+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e457: 12 total, 12 up, 12 in 2020-11-16T22:08:04.992 INFO:tasks.rados.rados.2.smithi057.stdout:1605: done (1 left) 2020-11-16T22:08:04.992 INFO:tasks.rados.rados.2.smithi057.stdout:1606: rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 193 2020-11-16T22:08:04.993 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 181 2020-11-16T22:08:04.993 INFO:tasks.rados.rados.2.smithi057.stdout:1603: finishing rollback tid 1 to smithi05720651-26 2020-11-16T22:08:04.993 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 0 (ObjNum 385 snap 0 seq_num 2932341920) dirty dne 2020-11-16T22:08:04.993 INFO:tasks.rados.rados.2.smithi057.stdout:1603: done (1 left) 2020-11-16T22:08:04.993 INFO:tasks.rados.rados.2.smithi057.stdout:1607: read oid 34 snap -1 2020-11-16T22:08:04.993 INFO:tasks.rados.rados.2.smithi057.stdout:1607: expect (ObjNum 435 snap 145 seq_num 435) 2020-11-16T22:08:04.994 INFO:tasks.rados.rados.2.smithi057.stdout:1608: rollback oid 18 current snap is 193 2020-11-16T22:08:04.994 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 18 to 192 2020-11-16T22:08:04.994 INFO:tasks.rados.rados.2.smithi057.stdout:1609: delete oid 22 current snap is 193 2020-11-16T22:08:05.001 INFO:tasks.rados.rados.2.smithi057.stdout:1608: finishing rollback tid 1 to smithi05720651-18 2020-11-16T22:08:05.001 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 0 (ObjNum 385 snap 0 seq_num 2933977376) dirty dne 2020-11-16T22:08:05.005 INFO:tasks.rados.rados.2.smithi057.stdout:1608: done (3 left) 2020-11-16T22:08:05.006 INFO:tasks.rados.rados.2.smithi057.stdout:1609: done (2 left) 2020-11-16T22:08:05.006 INFO:tasks.rados.rados.2.smithi057.stdout:1610: delete oid 26 current snap is 193 2020-11-16T22:08:05.011 INFO:tasks.rados.rados.2.smithi057.stdout:1606: finishing rollback tid 0 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:05.011 INFO:tasks.rados.rados.2.smithi057.stdout:1606: finishing rollback tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:05.012 INFO:tasks.rados.rados.2.smithi057.stdout:1607: expect (ObjNum 435 snap 145 seq_num 435) 2020-11-16T22:08:05.110 INFO:tasks.rados.rados.2.smithi057.stdout:1606: finishing rollback tid 2 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:05.110 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1106 (ObjNum 340 snap 115 seq_num 340) dirty exists 2020-11-16T22:08:05.110 INFO:tasks.rados.rados.2.smithi057.stdout:1606: done (2 left) 2020-11-16T22:08:05.110 INFO:tasks.rados.rados.2.smithi057.stdout:1607: done (1 left) 2020-11-16T22:08:05.111 INFO:tasks.rados.rados.2.smithi057.stdout:1610: done (0 left) 2020-11-16T22:08:05.111 INFO:tasks.rados.rados.2.smithi057.stdout:1611: snap_create 2020-11-16T22:08:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:05 smithi016 bash[10302]: cluster 2020-11-16T22:08:03.696880+0000 mgr.x (mgr.24115) 463 : cluster [DBG] pgmap v850: 17 pgs: 17 active+clean; 126 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 577 KiB/s wr, 3 op/s 2020-11-16T22:08:05.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:05 smithi016 bash[10302]: cluster 2020-11-16T22:08:04.075055+0000 mon.a (mon.0) 1111 : cluster [DBG] osdmap e458: 12 total, 12 up, 12 in 2020-11-16T22:08:05.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:05 smithi016 bash[10302]: cluster 2020-11-16T22:08:04.999019+0000 mon.a (mon.0) 1112 : cluster [DBG] osdmap e459: 12 total, 12 up, 12 in 2020-11-16T22:08:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:05 smithi195 bash[10218]: cluster 2020-11-16T22:08:03.696880+0000 mgr.x (mgr.24115) 463 : cluster [DBG] pgmap v850: 17 pgs: 17 active+clean; 126 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 577 KiB/s wr, 3 op/s 2020-11-16T22:08:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:05 smithi195 bash[10218]: cluster 2020-11-16T22:08:04.075055+0000 mon.a (mon.0) 1111 : cluster [DBG] osdmap e458: 12 total, 12 up, 12 in 2020-11-16T22:08:05.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:05 smithi195 bash[10218]: cluster 2020-11-16T22:08:04.999019+0000 mon.a (mon.0) 1112 : cluster [DBG] osdmap e459: 12 total, 12 up, 12 in 2020-11-16T22:08:05.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:05 smithi057 bash[10301]: cluster 2020-11-16T22:08:03.696880+0000 mgr.x (mgr.24115) 463 : cluster [DBG] pgmap v850: 17 pgs: 17 active+clean; 126 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 577 KiB/s wr, 3 op/s 2020-11-16T22:08:05.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:05 smithi057 bash[10301]: cluster 2020-11-16T22:08:04.075055+0000 mon.a (mon.0) 1111 : cluster [DBG] osdmap e458: 12 total, 12 up, 12 in 2020-11-16T22:08:05.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:05 smithi057 bash[10301]: cluster 2020-11-16T22:08:04.999019+0000 mon.a (mon.0) 1112 : cluster [DBG] osdmap e459: 12 total, 12 up, 12 in 2020-11-16T22:08:06.075 INFO:tasks.rados.rados.2.smithi057.stdout:1611: done (0 left) 2020-11-16T22:08:06.075 INFO:tasks.rados.rados.2.smithi057.stdout:1612: write (excl) oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 194 2020-11-16T22:08:06.075 INFO:tasks.rados.rados.2.smithi057.stdout:1612: seq_num 541 ranges {692587=570772,2024876=574522,3040192=52395} 2020-11-16T22:08:06.088 INFO:tasks.rados.rados.2.smithi057.stdout:1612: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 692587 to 1263359 tid 1 2020-11-16T22:08:06.095 INFO:tasks.rados.rados.2.smithi057.stdout:1612: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2024876 to 2599398 tid 2 2020-11-16T22:08:06.098 INFO:tasks.rados.rados.2.smithi057.stdout:1612: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3040192 to 3092587 tid 3 2020-11-16T22:08:06.099 INFO:tasks.rados.rados.2.smithi057.stdout:1613: snap_remove snap 181 2020-11-16T22:08:07.089 INFO:tasks.rados.rados.2.smithi057.stdout:1613: done (1 left) 2020-11-16T22:08:07.090 INFO:tasks.rados.rados.2.smithi057.stdout:1614: snap_remove snap 190 2020-11-16T22:08:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:07 smithi016 bash[10302]: cluster 2020-11-16T22:08:05.697629+0000 mgr.x (mgr.24115) 464 : cluster [DBG] pgmap v853: 17 pgs: 17 active+clean; 138 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 2.2 MiB/s wr, 6 op/s 2020-11-16T22:08:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:07 smithi016 bash[10302]: cluster 2020-11-16T22:08:06.085120+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e460: 12 total, 12 up, 12 in 2020-11-16T22:08:07.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:07 smithi195 bash[10218]: cluster 2020-11-16T22:08:05.697629+0000 mgr.x (mgr.24115) 464 : cluster [DBG] pgmap v853: 17 pgs: 17 active+clean; 138 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 2.2 MiB/s wr, 6 op/s 2020-11-16T22:08:07.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:07 smithi195 bash[10218]: cluster 2020-11-16T22:08:06.085120+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e460: 12 total, 12 up, 12 in 2020-11-16T22:08:07.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:07 smithi057 bash[10301]: cluster 2020-11-16T22:08:05.697629+0000 mgr.x (mgr.24115) 464 : cluster [DBG] pgmap v853: 17 pgs: 17 active+clean; 138 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 2.2 MiB/s wr, 6 op/s 2020-11-16T22:08:07.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:07 smithi057 bash[10301]: cluster 2020-11-16T22:08:06.085120+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e460: 12 total, 12 up, 12 in 2020-11-16T22:08:07.446 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:08:07 smithi057 bash[19569]: debug 2020-11-16T22:08:07.102+0000 7f5e12117700 -1 osd.11 pg_epoch: 461 pg[2.a( v 459'455 (0'0,459'455] local-lis/les=71/72 n=3 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [11,3] r=0 lpr=71 crt=459'455 lcod 454'453 mlcod 454'453 active+clean+snaptrim trimq=[16a~1] ps=[16e~1,170~1,17d~1]] removing snap head 2020-11-16T22:08:07.446 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:08:07 smithi057 bash[12595]: debug 2020-11-16T22:08:07.098+0000 7f737d1a4700 -1 osd.8 pg_epoch: 461 pg[2.5( v 458'944 (0'0,458'944] local-lis/les=71/72 n=6 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,0] r=0 lpr=71 crt=458'944 lcod 457'942 mlcod 457'942 active+clean+snaptrim trimq=[16a~1] ps=[16e~1,170~1,17d~1]] removing snap head 2020-11-16T22:08:07.446 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:08:07 smithi057 bash[12595]: debug 2020-11-16T22:08:07.102+0000 7f737a19e700 -1 osd.8 pg_epoch: 461 pg[2.b( v 461'552 (0'0,461'552] local-lis/les=71/72 n=6 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,11] r=0 lpr=71 luod=459'550 crt=461'552 lcod 459'548 mlcod 459'548 active+clean+snaptrim trimq=[16a~1] ps=[16e~1,170~1,17d~1]] removing snap head 2020-11-16T22:08:08.095 INFO:tasks.rados.rados.2.smithi057.stdout:1614: done (1 left) 2020-11-16T22:08:08.096 INFO:tasks.rados.rados.2.smithi057.stdout:1615: copy_from oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 194 2020-11-16T22:08:08.096 INFO:tasks.rados.rados.2.smithi057.stdout:1612: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:08.298 INFO:tasks.rados.rados.2.smithi057.stdout:1612: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:08.298 INFO:tasks.rados.rados.2.smithi057.stdout:1612: finishing write tid 3 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:08.298 INFO:tasks.rados.rados.2.smithi057.stdout:1612: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:08.299 INFO:tasks.rados.rados.2.smithi057.stdout:1612: finishing write tid 6 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:08.299 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1298 (ObjNum 541 snap 194 seq_num 541) dirty exists 2020-11-16T22:08:08.299 INFO:tasks.rados.rados.2.smithi057.stdout:1612: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 541 snap 194 seq_num 541) 2020-11-16T22:08:08.299 INFO:tasks.rados.rados.2.smithi057.stdout:1612: done (1 left) 2020-11-16T22:08:08.299 INFO:tasks.rados.rados.2.smithi057.stdout:1616: read oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:08:08.299 INFO:tasks.rados.rados.2.smithi057.stdout:1616: expect deleted 2020-11-16T22:08:08.300 INFO:tasks.rados.rados.2.smithi057.stdout:1617: write (excl) oid 26 current snap is 194 2020-11-16T22:08:08.300 INFO:tasks.rados.rados.2.smithi057.stdout:1617: seq_num 542 ranges {709394=646021,2083358=718180} 2020-11-16T22:08:08.301 INFO:tasks.rados.rados.2.smithi057.stdout:1617: writing smithi05720651-26 from 709394 to 1355415 tid 1 2020-11-16T22:08:08.301 INFO:tasks.rados.rados.2.smithi057.stdout:1617: writing smithi05720651-26 from 2083358 to 2801538 tid 2 2020-11-16T22:08:08.301 INFO:tasks.rados.rados.2.smithi057.stdout:1618: snap_remove snap 193 2020-11-16T22:08:08.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:08 smithi195 bash[10218]: cluster 2020-11-16T22:08:07.096882+0000 mon.a (mon.0) 1114 : cluster [DBG] osdmap e461: 12 total, 12 up, 12 in 2020-11-16T22:08:08.550 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:08 smithi057 bash[10301]: cluster 2020-11-16T22:08:07.096882+0000 mon.a (mon.0) 1114 : cluster [DBG] osdmap e461: 12 total, 12 up, 12 in 2020-11-16T22:08:08.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:08 smithi016 bash[10302]: cluster 2020-11-16T22:08:07.096882+0000 mon.a (mon.0) 1114 : cluster [DBG] osdmap e461: 12 total, 12 up, 12 in 2020-11-16T22:08:09.105 INFO:tasks.rados.rados.2.smithi057.stdout:1618: done (3 left) 2020-11-16T22:08:09.106 INFO:tasks.rados.rados.2.smithi057.stdout:1619: snap_remove snap 192 2020-11-16T22:08:09.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:09 smithi195 bash[10218]: cluster 2020-11-16T22:08:07.698340+0000 mgr.x (mgr.24115) 465 : cluster [DBG] pgmap v856: 17 pgs: 17 active+clean; 133 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.9 MiB/s wr, 10 op/s 2020-11-16T22:08:09.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:09 smithi195 bash[10218]: cluster 2020-11-16T22:08:08.106065+0000 mon.a (mon.0) 1115 : cluster [DBG] osdmap e462: 12 total, 12 up, 12 in 2020-11-16T22:08:09.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:09 smithi057 bash[10301]: cluster 2020-11-16T22:08:07.698340+0000 mgr.x (mgr.24115) 465 : cluster [DBG] pgmap v856: 17 pgs: 17 active+clean; 133 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.9 MiB/s wr, 10 op/s 2020-11-16T22:08:09.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:09 smithi057 bash[10301]: cluster 2020-11-16T22:08:08.106065+0000 mon.a (mon.0) 1115 : cluster [DBG] osdmap e462: 12 total, 12 up, 12 in 2020-11-16T22:08:09.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:09 smithi016 bash[10302]: cluster 2020-11-16T22:08:07.698340+0000 mgr.x (mgr.24115) 465 : cluster [DBG] pgmap v856: 17 pgs: 17 active+clean; 133 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 2.9 MiB/s wr, 10 op/s 2020-11-16T22:08:09.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:09 smithi016 bash[10302]: cluster 2020-11-16T22:08:08.106065+0000 mon.a (mon.0) 1115 : cluster [DBG] osdmap e462: 12 total, 12 up, 12 in 2020-11-16T22:08:09.990 INFO:tasks.rados.rados.2.smithi057.stdout:1619: done (3 left) 2020-11-16T22:08:09.991 INFO:tasks.rados.rados.2.smithi057.stdout:1620: write (excl) oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 194 2020-11-16T22:08:09.991 INFO:tasks.rados.rados.2.smithi057.stdout:1620: seq_num 543 ranges {726201=721270,2141840=578191} 2020-11-16T22:08:10.000 INFO:tasks.rados.rados.2.smithi057.stdout:1620: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 726201 to 1447471 tid 1 2020-11-16T22:08:10.008 INFO:tasks.rados.rados.2.smithi057.stdout:1620: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2141840 to 2720031 tid 2 2020-11-16T22:08:10.009 INFO:tasks.rados.rados.2.smithi057.stdout:1621: read oid 46 snap -1 2020-11-16T22:08:10.009 INFO:tasks.rados.rados.2.smithi057.stdout:1621: expect (ObjNum 535 snap 193 seq_num 535) 2020-11-16T22:08:10.009 INFO:tasks.rados.rados.2.smithi057.stdout:1622: read oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:08:10.210 INFO:tasks.rados.rados.2.smithi057.stdout:1622: expect (ObjNum 496 snap 177 seq_num 496) 2020-11-16T22:08:10.210 INFO:tasks.rados.rados.2.smithi057.stdout:1623: snap_create 2020-11-16T22:08:10.210 INFO:tasks.rados.rados.2.smithi057.stdout:1617: finishing write tid 1 to smithi05720651-26 2020-11-16T22:08:10.211 INFO:tasks.rados.rados.2.smithi057.stdout:1617: finishing write tid 2 to smithi05720651-26 2020-11-16T22:08:10.211 INFO:tasks.rados.rados.2.smithi057.stdout:1617: finishing write tid 4 to smithi05720651-26 2020-11-16T22:08:10.211 INFO:tasks.rados.rados.2.smithi057.stdout:1617: finishing write tid 5 to smithi05720651-26 2020-11-16T22:08:10.211 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 1491 (ObjNum 542 snap 194 seq_num 542) dirty exists 2020-11-16T22:08:10.211 INFO:tasks.rados.rados.2.smithi057.stdout:1617: left oid 26 (ObjNum 542 snap 194 seq_num 542) 2020-11-16T22:08:10.211 INFO:tasks.rados.rados.2.smithi057.stdout:1615: finishing copy_from to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:10.211 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1106 (ObjNum 340 snap 115 seq_num 340) dirty exists 2020-11-16T22:08:10.212 INFO:tasks.rados.rados.2.smithi057.stdout:1615: finishing copy_from racing read to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:10.213 INFO:tasks.rados.rados.2.smithi057.stdout:1620: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:10.213 INFO:tasks.rados.rados.2.smithi057.stdout:1622: expect (ObjNum 496 snap 177 seq_num 496) 2020-11-16T22:08:10.213 INFO:tasks.rados.rados.2.smithi057.stdout:1620: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:10.213 INFO:tasks.rados.rados.2.smithi057.stdout:1621: expect (ObjNum 535 snap 193 seq_num 535) 2020-11-16T22:08:10.337 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:08:10 smithi016 bash[19825]: debug 2020-11-16T22:08:10.025+0000 7f0e12c1a700 -1 osd.7 pg_epoch: 464 pg[2.8( v 462'1189 (0'0,462'1189] local-lis/les=71/72 n=7 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [7,9] r=0 lpr=71 crt=462'1189 lcod 462'1187 mlcod 462'1187 active+clean+snaptrim trimq=[17e~1] ps=[16a~1,170~1,17c~1,181~1]] removing snap head 2020-11-16T22:08:10.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:10 smithi016 bash[10302]: cluster 2020-11-16T22:08:09.114249+0000 mon.a (mon.0) 1116 : cluster [DBG] osdmap e463: 12 total, 12 up, 12 in 2020-11-16T22:08:10.546 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:10 smithi016 bash[10302]: cluster 2020-11-16T22:08:09.998458+0000 mon.a (mon.0) 1117 : cluster [DBG] osdmap e464: 12 total, 12 up, 12 in 2020-11-16T22:08:10.547 INFO:tasks.rados.rados.2.smithi057.stdout:1620: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:10.547 INFO:tasks.rados.rados.2.smithi057.stdout:1620: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:10.548 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1234 (ObjNum 543 snap 194 seq_num 543) dirty exists 2020-11-16T22:08:10.548 INFO:tasks.rados.rados.2.smithi057.stdout:1620: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 543 snap 194 seq_num 543) 2020-11-16T22:08:10.548 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:10 smithi057 bash[10301]: cluster 2020-11-16T22:08:09.114249+0000 mon.a (mon.0) 1116 : cluster [DBG] osdmap e463: 12 total, 12 up, 12 in 2020-11-16T22:08:10.548 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:10 smithi057 bash[10301]: cluster 2020-11-16T22:08:09.998458+0000 mon.a (mon.0) 1117 : cluster [DBG] osdmap e464: 12 total, 12 up, 12 in 2020-11-16T22:08:10.548 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:08:10 smithi057 bash[12595]: debug 2020-11-16T22:08:09.998+0000 7f737a19e700 -1 osd.8 pg_epoch: 464 pg[2.b( v 462'560 (0'0,462'560] local-lis/les=71/72 n=4 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,11] r=0 lpr=71 crt=462'560 lcod 462'558 mlcod 462'558 active+clean+snaptrim trimq=[17e~1] ps=[16a~1,170~1,17c~1,181~1]] removing snap head 2020-11-16T22:08:10.549 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:08:10 smithi057 bash[12595]: debug 2020-11-16T22:08:09.998+0000 7f737d1a4700 -1 osd.8 pg_epoch: 464 pg[2.5( v 462'948 (0'0,462'948] local-lis/les=71/72 n=4 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,0] r=0 lpr=71 crt=462'948 lcod 461'946 mlcod 461'946 active+clean+snaptrim trimq=[17e~1] ps=[16a~1,170~1,17c~1,181~1]] removing snap head 2020-11-16T22:08:10.549 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:08:10 smithi057 bash[12595]: debug 2020-11-16T22:08:09.998+0000 7f737a19e700 -1 osd.8 pg_epoch: 464 pg[2.b( v 464'562 (0'0,464'562] local-lis/les=71/72 n=2 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,11] r=0 lpr=71 luod=462'560 crt=464'562 lcod 462'558 mlcod 462'558 active+clean+snaptrim trimq=[17e~1] ps=[16a~1,170~1,17c~1,181~1]] removing snap head 2020-11-16T22:08:10.549 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:10 smithi195 bash[10218]: cluster 2020-11-16T22:08:09.114249+0000 mon.a (mon.0) 1116 : cluster [DBG] osdmap e463: 12 total, 12 up, 12 in 2020-11-16T22:08:10.549 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:10 smithi195 bash[10218]: cluster 2020-11-16T22:08:09.998458+0000 mon.a (mon.0) 1117 : cluster [DBG] osdmap e464: 12 total, 12 up, 12 in 2020-11-16T22:08:10.750 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:08:10 smithi195 bash[18679]: debug 2020-11-16T22:08:10.013+0000 7f994960b700 -1 osd.1 pg_epoch: 464 pg[2.9( v 462'1492 (0'0,462'1492] local-lis/les=71/72 n=8 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,7] r=0 lpr=71 crt=462'1492 lcod 462'1491 mlcod 462'1491 active+clean+snaptrim trimq=[17e~1] ps=[16a~1,170~1,17c~1,181~1]] removing snap head 2020-11-16T22:08:10.999 INFO:tasks.rados.rados.2.smithi057.stdout:1615: done (6 left) 2020-11-16T22:08:10.999 INFO:tasks.rados.rados.2.smithi057.stdout:1616: done (5 left) 2020-11-16T22:08:11.000 INFO:tasks.rados.rados.2.smithi057.stdout:1617: done (4 left) 2020-11-16T22:08:11.000 INFO:tasks.rados.rados.2.smithi057.stdout:1620: done (3 left) 2020-11-16T22:08:11.000 INFO:tasks.rados.rados.2.smithi057.stdout:1621: done (2 left) 2020-11-16T22:08:11.000 INFO:tasks.rados.rados.2.smithi057.stdout:1622: done (1 left) 2020-11-16T22:08:11.000 INFO:tasks.rados.rados.2.smithi057.stdout:1623: done (0 left) 2020-11-16T22:08:11.000 INFO:tasks.rados.rados.2.smithi057.stdout:1624: read oid 32 snap -1 2020-11-16T22:08:11.000 INFO:tasks.rados.rados.2.smithi057.stdout:1624: expect deleted 2020-11-16T22:08:11.001 INFO:tasks.rados.rados.2.smithi057.stdout:1625: snap_create 2020-11-16T22:08:11.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:11 smithi057 bash[10301]: cluster 2020-11-16T22:08:09.699036+0000 mgr.x (mgr.24115) 466 : cluster [DBG] pgmap v859: 17 pgs: 17 active+clean; 133 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 701 KiB/s wr, 3 op/s 2020-11-16T22:08:11.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:11 smithi057 bash[10301]: cluster 2020-11-16T22:08:11.010778+0000 mon.a (mon.0) 1118 : cluster [DBG] osdmap e465: 12 total, 12 up, 12 in 2020-11-16T22:08:11.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:11 smithi016 bash[10302]: cluster 2020-11-16T22:08:09.699036+0000 mgr.x (mgr.24115) 466 : cluster [DBG] pgmap v859: 17 pgs: 17 active+clean; 133 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 701 KiB/s wr, 3 op/s 2020-11-16T22:08:11.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:11 smithi016 bash[10302]: cluster 2020-11-16T22:08:11.010778+0000 mon.a (mon.0) 1118 : cluster [DBG] osdmap e465: 12 total, 12 up, 12 in 2020-11-16T22:08:11.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:11 smithi195 bash[10218]: cluster 2020-11-16T22:08:09.699036+0000 mgr.x (mgr.24115) 466 : cluster [DBG] pgmap v859: 17 pgs: 17 active+clean; 133 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 701 KiB/s wr, 3 op/s 2020-11-16T22:08:11.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:11 smithi195 bash[10218]: cluster 2020-11-16T22:08:11.010778+0000 mon.a (mon.0) 1118 : cluster [DBG] osdmap e465: 12 total, 12 up, 12 in 2020-11-16T22:08:12.003 INFO:tasks.rados.rados.2.smithi057.stdout:1624: done (1 left) 2020-11-16T22:08:12.004 INFO:tasks.rados.rados.2.smithi057.stdout:1625: done (0 left) 2020-11-16T22:08:12.004 INFO:tasks.rados.rados.2.smithi057.stdout:1626: write oid 20 current snap is 196 2020-11-16T22:08:12.004 INFO:tasks.rados.rados.2.smithi057.stdout:1626: seq_num 544 ranges {743008=796519,2200322=721849} 2020-11-16T22:08:12.018 INFO:tasks.rados.rados.2.smithi057.stdout:1626: writing smithi05720651-20 from 743008 to 1539527 tid 1 2020-11-16T22:08:12.027 INFO:tasks.rados.rados.2.smithi057.stdout:1626: writing smithi05720651-20 from 2200322 to 2922171 tid 2 2020-11-16T22:08:12.027 INFO:tasks.rados.rados.2.smithi057.stdout:1627: read oid 32 snap -1 2020-11-16T22:08:12.028 INFO:tasks.rados.rados.2.smithi057.stdout:1627: expect deleted 2020-11-16T22:08:12.028 INFO:tasks.rados.rados.2.smithi057.stdout:1628: copy_from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 196 2020-11-16T22:08:12.234 INFO:tasks.rados.rados.2.smithi057.stdout:1629: snap_create 2020-11-16T22:08:12.235 INFO:tasks.rados.rados.2.smithi057.stdout:1626: finishing write tid 1 to smithi05720651-20 2020-11-16T22:08:12.235 INFO:tasks.rados.rados.2.smithi057.stdout:1626: finishing write tid 2 to smithi05720651-20 2020-11-16T22:08:12.236 INFO:tasks.rados.rados.2.smithi057.stdout:1626: finishing write tid 4 to smithi05720651-20 2020-11-16T22:08:12.236 INFO:tasks.rados.rados.2.smithi057.stdout:1626: finishing write tid 5 to smithi05720651-20 2020-11-16T22:08:12.236 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1079 (ObjNum 544 snap 196 seq_num 544) dirty exists 2020-11-16T22:08:12.236 INFO:tasks.rados.rados.2.smithi057.stdout:1626: left oid 20 (ObjNum 544 snap 196 seq_num 544) 2020-11-16T22:08:12.236 INFO:tasks.rados.rados.2.smithi057.stdout:1628: finishing copy_from to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:12.236 INFO:tasks.rados.rados.2.smithi057.stdout:1628: got expected ENOENT (src dne) 2020-11-16T22:08:12.236 INFO:tasks.rados.rados.2.smithi057.stdout:1628: finishing copy_from racing read to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:13.005 INFO:tasks.rados.rados.2.smithi057.stdout:1626: done (3 left) 2020-11-16T22:08:13.006 INFO:tasks.rados.rados.2.smithi057.stdout:1627: done (2 left) 2020-11-16T22:08:13.006 INFO:tasks.rados.rados.2.smithi057.stdout:1628: done (1 left) 2020-11-16T22:08:13.006 INFO:tasks.rados.rados.2.smithi057.stdout:1629: done (0 left) 2020-11-16T22:08:13.006 INFO:tasks.rados.rados.2.smithi057.stdout:1630: snap_create 2020-11-16T22:08:13.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:13 smithi016 bash[10302]: cluster 2020-11-16T22:08:11.699750+0000 mgr.x (mgr.24115) 467 : cluster [DBG] pgmap v862: 17 pgs: 17 active+clean; 99 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.8 MiB/s wr, 8 op/s 2020-11-16T22:08:13.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:13 smithi016 bash[10302]: cluster 2020-11-16T22:08:12.013071+0000 mon.a (mon.0) 1119 : cluster [DBG] osdmap e466: 12 total, 12 up, 12 in 2020-11-16T22:08:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:13 smithi195 bash[10218]: cluster 2020-11-16T22:08:11.699750+0000 mgr.x (mgr.24115) 467 : cluster [DBG] pgmap v862: 17 pgs: 17 active+clean; 99 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.8 MiB/s wr, 8 op/s 2020-11-16T22:08:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:13 smithi195 bash[10218]: cluster 2020-11-16T22:08:12.013071+0000 mon.a (mon.0) 1119 : cluster [DBG] osdmap e466: 12 total, 12 up, 12 in 2020-11-16T22:08:13.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:13 smithi057 bash[10301]: cluster 2020-11-16T22:08:11.699750+0000 mgr.x (mgr.24115) 467 : cluster [DBG] pgmap v862: 17 pgs: 17 active+clean; 99 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.8 MiB/s wr, 8 op/s 2020-11-16T22:08:13.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:13 smithi057 bash[10301]: cluster 2020-11-16T22:08:12.013071+0000 mon.a (mon.0) 1119 : cluster [DBG] osdmap e466: 12 total, 12 up, 12 in 2020-11-16T22:08:14.031 INFO:tasks.rados.rados.2.smithi057.stdout:1630: done (0 left) 2020-11-16T22:08:14.032 INFO:tasks.rados.rados.2.smithi057.stdout:1631: write (excl) oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 198 2020-11-16T22:08:14.032 INFO:tasks.rados.rados.2.smithi057.stdout:1631: seq_num 545 ranges {759815=471768,1742451=465507,2917178=242637} 2020-11-16T22:08:14.047 INFO:tasks.rados.rados.2.smithi057.stdout:1631: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 759815 to 1231583 tid 1 2020-11-16T22:08:14.053 INFO:tasks.rados.rados.2.smithi057.stdout:1631: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1742451 to 2207958 tid 2 2020-11-16T22:08:14.058 INFO:tasks.rados.rados.2.smithi057.stdout:1631: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2917178 to 3159815 tid 3 2020-11-16T22:08:14.059 INFO:tasks.rados.rados.2.smithi057.stdout:1632: write oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 198 2020-11-16T22:08:14.059 INFO:tasks.rados.rados.2.smithi057.stdout:1632: seq_num 546 ranges {776622=547017,1800933=725518,2944601=232021} 2020-11-16T22:08:14.066 INFO:tasks.rados.rados.2.smithi057.stdout:1632: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 776622 to 1323639 tid 1 2020-11-16T22:08:14.073 INFO:tasks.rados.rados.2.smithi057.stdout:1632: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1800933 to 2526451 tid 2 2020-11-16T22:08:14.077 INFO:tasks.rados.rados.2.smithi057.stdout:1632: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2944601 to 3176622 tid 3 2020-11-16T22:08:14.077 INFO:tasks.rados.rados.2.smithi057.stdout:1633: rollback oid 24 current snap is 198 2020-11-16T22:08:14.078 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 24 to 196 2020-11-16T22:08:14.078 INFO:tasks.rados.rados.2.smithi057.stdout:1631: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:14.286 INFO:tasks.rados.rados.2.smithi057.stdout:1631: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:14.286 INFO:tasks.rados.rados.2.smithi057.stdout:1631: finishing write tid 3 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:14.286 INFO:tasks.rados.rados.2.smithi057.stdout:1631: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:14.287 INFO:tasks.rados.rados.2.smithi057.stdout:1631: finishing write tid 6 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:14.287 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1110 (ObjNum 545 snap 198 seq_num 545) dirty exists 2020-11-16T22:08:14.287 INFO:tasks.rados.rados.2.smithi057.stdout:1631: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 545 snap 198 seq_num 545) 2020-11-16T22:08:14.287 INFO:tasks.rados.rados.2.smithi057.stdout:1631: done (2 left) 2020-11-16T22:08:14.287 INFO:tasks.rados.rados.2.smithi057.stdout:1634: rollback oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 198 2020-11-16T22:08:14.287 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 195 2020-11-16T22:08:14.288 INFO:tasks.rados.rados.2.smithi057.stdout:1635: snap_create 2020-11-16T22:08:14.289 INFO:tasks.rados.rados.2.smithi057.stdout:1632: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:14.490 INFO:tasks.rados.rados.2.smithi057.stdout:1632: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:14.490 INFO:tasks.rados.rados.2.smithi057.stdout:1632: finishing write tid 3 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:14.490 INFO:tasks.rados.rados.2.smithi057.stdout:1632: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:14.491 INFO:tasks.rados.rados.2.smithi057.stdout:1633: finishing rollback tid 0 to smithi05720651-24 2020-11-16T22:08:14.491 INFO:tasks.rados.rados.2.smithi057.stdout:1632: finishing write tid 6 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:14.491 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1118 (ObjNum 546 snap 198 seq_num 546) dirty exists 2020-11-16T22:08:14.491 INFO:tasks.rados.rados.2.smithi057.stdout:1632: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 546 snap 198 seq_num 546) 2020-11-16T22:08:14.491 INFO:tasks.rados.rados.2.smithi057.stdout:1633: finishing rollback tid 1 to smithi05720651-24 2020-11-16T22:08:14.491 INFO:tasks.rados.rados.2.smithi057.stdout:1633: finishing rollback tid 2 to smithi05720651-24 2020-11-16T22:08:14.491 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 1178 (ObjNum 445 snap 150 seq_num 445) dirty exists 2020-11-16T22:08:14.492 INFO:tasks.rados.rados.2.smithi057.stdout:1634: finishing rollback tid 0 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:14.492 INFO:tasks.rados.rados.2.smithi057.stdout:1634: finishing rollback tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:14.694 INFO:tasks.rados.rados.2.smithi057.stdout:1634: finishing rollback tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:14.694 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1301 (ObjNum 432 snap 145 seq_num 432) dirty exists 2020-11-16T22:08:14.695 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:14 smithi195 bash[10218]: cluster 2020-11-16T22:08:13.015565+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e467: 12 total, 12 up, 12 in 2020-11-16T22:08:14.695 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:14 smithi016 bash[10302]: cluster 2020-11-16T22:08:13.015565+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e467: 12 total, 12 up, 12 in 2020-11-16T22:08:14.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:14 smithi057 bash[10301]: cluster 2020-11-16T22:08:13.015565+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e467: 12 total, 12 up, 12 in 2020-11-16T22:08:14.992 INFO:tasks.rados.rados.2.smithi057.stdout:1632: done (3 left) 2020-11-16T22:08:14.993 INFO:tasks.rados.rados.2.smithi057.stdout:1633: done (2 left) 2020-11-16T22:08:14.993 INFO:tasks.rados.rados.2.smithi057.stdout:1634: done (1 left) 2020-11-16T22:08:14.993 INFO:tasks.rados.rados.2.smithi057.stdout:1635: done (0 left) 2020-11-16T22:08:14.993 INFO:tasks.rados.rados.2.smithi057.stdout:1636: write (excl) oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 199 2020-11-16T22:08:14.994 INFO:tasks.rados.rados.2.smithi057.stdout:1636: seq_num 547 ranges {793429=622266,1859415=469176,2972024=221405} 2020-11-16T22:08:15.005 INFO:tasks.rados.rados.2.smithi057.stdout:1636: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 793429 to 1415695 tid 1 2020-11-16T22:08:15.010 INFO:tasks.rados.rados.2.smithi057.stdout:1636: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1859415 to 2328591 tid 2 2020-11-16T22:08:15.015 INFO:tasks.rados.rados.2.smithi057.stdout:1636: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2972024 to 3193429 tid 3 2020-11-16T22:08:15.016 INFO:tasks.rados.rados.2.smithi057.stdout:1637: write oid 8 current snap is 199 2020-11-16T22:08:15.016 INFO:tasks.rados.rados.2.smithi057.stdout:1637: seq_num 548 ranges {410236=413868,1234250=729187,2715800=423063} 2020-11-16T22:08:15.020 INFO:tasks.rados.rados.2.smithi057.stdout:1637: writing smithi05720651-8 from 410236 to 824104 tid 1 2020-11-16T22:08:15.223 INFO:tasks.rados.rados.2.smithi057.stdout:1637: writing smithi05720651-8 from 1234250 to 1963437 tid 2 2020-11-16T22:08:15.224 INFO:tasks.rados.rados.2.smithi057.stdout:1637: writing smithi05720651-8 from 2715800 to 3138863 tid 3 2020-11-16T22:08:15.224 INFO:tasks.rados.rados.2.smithi057.stdout:1638: snap_create 2020-11-16T22:08:15.224 INFO:tasks.rados.rados.2.smithi057.stdout:1636: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:15.224 INFO:tasks.rados.rados.2.smithi057.stdout:1636: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:15.224 INFO:tasks.rados.rados.2.smithi057.stdout:1636: finishing write tid 3 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:15.224 INFO:tasks.rados.rados.2.smithi057.stdout:1636: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:15.224 INFO:tasks.rados.rados.2.smithi057.stdout:1636: finishing write tid 6 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:15.225 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1420 (ObjNum 547 snap 199 seq_num 547) dirty exists 2020-11-16T22:08:15.225 INFO:tasks.rados.rados.2.smithi057.stdout:1636: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 547 snap 199 seq_num 547) 2020-11-16T22:08:15.225 INFO:tasks.rados.rados.2.smithi057.stdout:1637: finishing write tid 1 to smithi05720651-8 2020-11-16T22:08:15.225 INFO:tasks.rados.rados.2.smithi057.stdout:1637: finishing write tid 2 to smithi05720651-8 2020-11-16T22:08:15.225 INFO:tasks.rados.rados.2.smithi057.stdout:1637: finishing write tid 3 to smithi05720651-8 2020-11-16T22:08:15.225 INFO:tasks.rados.rados.2.smithi057.stdout:1637: finishing write tid 5 to smithi05720651-8 2020-11-16T22:08:15.225 INFO:tasks.rados.rados.2.smithi057.stdout:1637: finishing write tid 6 to smithi05720651-8 2020-11-16T22:08:15.226 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 1182 (ObjNum 548 snap 199 seq_num 548) dirty exists 2020-11-16T22:08:15.226 INFO:tasks.rados.rados.2.smithi057.stdout:1637: left oid 8 (ObjNum 548 snap 199 seq_num 548) 2020-11-16T22:08:15.430 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:15 smithi195 bash[10218]: cluster 2020-11-16T22:08:13.700431+0000 mgr.x (mgr.24115) 468 : cluster [DBG] pgmap v865: 17 pgs: 17 active+clean; 102 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.2 MiB/s wr, 9 op/s 2020-11-16T22:08:15.431 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:15 smithi195 bash[10218]: cluster 2020-11-16T22:08:14.040803+0000 mon.a (mon.0) 1121 : cluster [DBG] osdmap e468: 12 total, 12 up, 12 in 2020-11-16T22:08:15.431 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:15 smithi195 bash[10218]: cluster 2020-11-16T22:08:15.001901+0000 mon.a (mon.0) 1122 : cluster [DBG] osdmap e469: 12 total, 12 up, 12 in 2020-11-16T22:08:15.431 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:15 smithi016 bash[10302]: cluster 2020-11-16T22:08:13.700431+0000 mgr.x (mgr.24115) 468 : cluster [DBG] pgmap v865: 17 pgs: 17 active+clean; 102 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.2 MiB/s wr, 9 op/s 2020-11-16T22:08:15.431 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:15 smithi016 bash[10302]: cluster 2020-11-16T22:08:14.040803+0000 mon.a (mon.0) 1121 : cluster [DBG] osdmap e468: 12 total, 12 up, 12 in 2020-11-16T22:08:15.432 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:15 smithi016 bash[10302]: cluster 2020-11-16T22:08:15.001901+0000 mon.a (mon.0) 1122 : cluster [DBG] osdmap e469: 12 total, 12 up, 12 in 2020-11-16T22:08:15.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:15 smithi057 bash[10301]: cluster 2020-11-16T22:08:13.700431+0000 mgr.x (mgr.24115) 468 : cluster [DBG] pgmap v865: 17 pgs: 17 active+clean; 102 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.2 MiB/s wr, 9 op/s 2020-11-16T22:08:15.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:15 smithi057 bash[10301]: cluster 2020-11-16T22:08:14.040803+0000 mon.a (mon.0) 1121 : cluster [DBG] osdmap e468: 12 total, 12 up, 12 in 2020-11-16T22:08:15.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:15 smithi057 bash[10301]: cluster 2020-11-16T22:08:15.001901+0000 mon.a (mon.0) 1122 : cluster [DBG] osdmap e469: 12 total, 12 up, 12 in 2020-11-16T22:08:16.044 INFO:tasks.rados.rados.2.smithi057.stdout:1636: done (2 left) 2020-11-16T22:08:16.044 INFO:tasks.rados.rados.2.smithi057.stdout:1637: done (1 left) 2020-11-16T22:08:16.044 INFO:tasks.rados.rados.2.smithi057.stdout:1638: done (0 left) 2020-11-16T22:08:16.045 INFO:tasks.rados.rados.2.smithi057.stdout:1639: rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 200 2020-11-16T22:08:16.045 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 199 2020-11-16T22:08:16.045 INFO:tasks.rados.rados.2.smithi057.stdout:1640: delete oid 38 current snap is 200 2020-11-16T22:08:16.056 INFO:tasks.rados.rados.2.smithi057.stdout:1639: finishing rollback tid 0 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:16.056 INFO:tasks.rados.rados.2.smithi057.stdout:1639: finishing rollback tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:16.056 INFO:tasks.rados.rados.2.smithi057.stdout:1639: finishing rollback tid 2 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:16.057 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1113 (ObjNum 340 snap 115 seq_num 340) dirty exists 2020-11-16T22:08:16.057 INFO:tasks.rados.rados.2.smithi057.stdout:1639: done (1 left) 2020-11-16T22:08:16.057 INFO:tasks.rados.rados.2.smithi057.stdout:1640: done (0 left) 2020-11-16T22:08:16.058 INFO:tasks.rados.rados.2.smithi057.stdout:1641: copy_from oid 46 from oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 200 2020-11-16T22:08:16.058 INFO:tasks.rados.rados.2.smithi057.stdout:1642: rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 200 2020-11-16T22:08:16.058 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 198 2020-11-16T22:08:16.058 INFO:tasks.rados.rados.2.smithi057.stdout:1643: snap_create 2020-11-16T22:08:16.066 INFO:tasks.rados.rados.2.smithi057.stdout:1642: finishing rollback tid 0 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:16.068 INFO:tasks.rados.rados.2.smithi057.stdout:1642: finishing rollback tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:16.068 INFO:tasks.rados.rados.2.smithi057.stdout:1642: finishing rollback tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:16.068 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1424 (ObjNum 504 snap 177 seq_num 504) dirty exists 2020-11-16T22:08:16.270 INFO:tasks.rados.rados.2.smithi057.stdout:1641: finishing copy_from to smithi05720651-46 2020-11-16T22:08:16.271 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 1113 (ObjNum 340 snap 115 seq_num 340) dirty exists 2020-11-16T22:08:16.271 INFO:tasks.rados.rados.2.smithi057.stdout:1641: finishing copy_from racing read to smithi05720651-46 2020-11-16T22:08:17.051 INFO:tasks.rados.rados.2.smithi057.stdout:1641: done (2 left) 2020-11-16T22:08:17.052 INFO:tasks.rados.rados.2.smithi057.stdout:1642: done (1 left) 2020-11-16T22:08:17.052 INFO:tasks.rados.rados.2.smithi057.stdout:1643: done (0 left) 2020-11-16T22:08:17.052 INFO:tasks.rados.rados.2.smithi057.stdout:1644: read oid 46 snap -1 2020-11-16T22:08:17.052 INFO:tasks.rados.rados.2.smithi057.stdout:1644: expect (ObjNum 340 snap 115 seq_num 340) 2020-11-16T22:08:17.052 INFO:tasks.rados.rados.2.smithi057.stdout:1645: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:08:17.052 INFO:tasks.rados.rados.2.smithi057.stdout:1645: expect (ObjNum 340 snap 115 seq_num 340) 2020-11-16T22:08:17.052 INFO:tasks.rados.rados.2.smithi057.stdout:1646: read oid 36 snap -1 2020-11-16T22:08:17.053 INFO:tasks.rados.rados.2.smithi057.stdout:1646: expect deleted 2020-11-16T22:08:17.053 INFO:tasks.rados.rados.2.smithi057.stdout:1647: write oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 201 2020-11-16T22:08:17.053 INFO:tasks.rados.rados.2.smithi057.stdout:1647: seq_num 550 ranges {443850=564366,1634861=732856,2770646=473204} 2020-11-16T22:08:17.059 INFO:tasks.rados.rados.2.smithi057.stdout:1647: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 443850 to 1008216 tid 1 2020-11-16T22:08:17.068 INFO:tasks.rados.rados.2.smithi057.stdout:1647: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1634861 to 2367717 tid 2 2020-11-16T22:08:17.073 INFO:tasks.rados.rados.2.smithi057.stdout:1647: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2770646 to 3243850 tid 3 2020-11-16T22:08:17.073 INFO:tasks.rados.rados.2.smithi057.stdout:1648: snap_remove snap 196 2020-11-16T22:08:17.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:17 smithi016 bash[10302]: cluster 2020-11-16T22:08:15.701185+0000 mgr.x (mgr.24115) 469 : cluster [DBG] pgmap v868: 17 pgs: 17 active+clean; 95 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 692 KiB/s wr, 6 op/s 2020-11-16T22:08:17.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:17 smithi016 bash[10302]: cluster 2020-11-16T22:08:16.049103+0000 mon.a (mon.0) 1123 : cluster [DBG] osdmap e470: 12 total, 12 up, 12 in 2020-11-16T22:08:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:17 smithi195 bash[10218]: cluster 2020-11-16T22:08:15.701185+0000 mgr.x (mgr.24115) 469 : cluster [DBG] pgmap v868: 17 pgs: 17 active+clean; 95 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 692 KiB/s wr, 6 op/s 2020-11-16T22:08:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:17 smithi195 bash[10218]: cluster 2020-11-16T22:08:16.049103+0000 mon.a (mon.0) 1123 : cluster [DBG] osdmap e470: 12 total, 12 up, 12 in 2020-11-16T22:08:17.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:17 smithi057 bash[10301]: cluster 2020-11-16T22:08:15.701185+0000 mgr.x (mgr.24115) 469 : cluster [DBG] pgmap v868: 17 pgs: 17 active+clean; 95 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 692 KiB/s wr, 6 op/s 2020-11-16T22:08:17.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:17 smithi057 bash[10301]: cluster 2020-11-16T22:08:16.049103+0000 mon.a (mon.0) 1123 : cluster [DBG] osdmap e470: 12 total, 12 up, 12 in 2020-11-16T22:08:18.065 INFO:tasks.rados.rados.2.smithi057.stdout:1648: done (4 left) 2020-11-16T22:08:18.065 INFO:tasks.rados.rados.2.smithi057.stdout:1649: write (excl) oid 28 current snap is 201 2020-11-16T22:08:18.066 INFO:tasks.rados.rados.2.smithi057.stdout:1649: seq_num 551 ranges {460657=639615,1693343=476514,2681716=578941} 2020-11-16T22:08:18.078 INFO:tasks.rados.rados.2.smithi057.stdout:1649: writing smithi05720651-28 from 460657 to 1100272 tid 1 2020-11-16T22:08:18.084 INFO:tasks.rados.rados.2.smithi057.stdout:1649: writing smithi05720651-28 from 1693343 to 2169857 tid 2 2020-11-16T22:08:18.090 INFO:tasks.rados.rados.2.smithi057.stdout:1649: writing smithi05720651-28 from 2681716 to 3260657 tid 3 2020-11-16T22:08:18.091 INFO:tasks.rados.rados.2.smithi057.stdout:1650: snap_remove snap 195 2020-11-16T22:08:18.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:18 smithi016 bash[10302]: cluster 2020-11-16T22:08:17.061546+0000 mon.a (mon.0) 1124 : cluster [DBG] osdmap e471: 12 total, 12 up, 12 in 2020-11-16T22:08:18.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:18 smithi195 bash[10218]: cluster 2020-11-16T22:08:17.061546+0000 mon.a (mon.0) 1124 : cluster [DBG] osdmap e471: 12 total, 12 up, 12 in 2020-11-16T22:08:18.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:18 smithi057 bash[10301]: cluster 2020-11-16T22:08:17.061546+0000 mon.a (mon.0) 1124 : cluster [DBG] osdmap e471: 12 total, 12 up, 12 in 2020-11-16T22:08:19.071 INFO:tasks.rados.rados.2.smithi057.stdout:1650: done (5 left) 2020-11-16T22:08:19.072 INFO:tasks.rados.rados.2.smithi057.stdout:1651: snap_remove snap 197 2020-11-16T22:08:19.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:19 smithi016 bash[10302]: cluster 2020-11-16T22:08:17.701846+0000 mgr.x (mgr.24115) 470 : cluster [DBG] pgmap v871: 17 pgs: 17 active+clean; 98 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 977 KiB/s wr, 8 op/s 2020-11-16T22:08:19.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:19 smithi016 bash[10302]: cluster 2020-11-16T22:08:18.072161+0000 mon.a (mon.0) 1125 : cluster [DBG] osdmap e472: 12 total, 12 up, 12 in 2020-11-16T22:08:19.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:19 smithi195 bash[10218]: cluster 2020-11-16T22:08:17.701846+0000 mgr.x (mgr.24115) 470 : cluster [DBG] pgmap v871: 17 pgs: 17 active+clean; 98 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 977 KiB/s wr, 8 op/s 2020-11-16T22:08:19.351 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:19 smithi195 bash[10218]: cluster 2020-11-16T22:08:18.072161+0000 mon.a (mon.0) 1125 : cluster [DBG] osdmap e472: 12 total, 12 up, 12 in 2020-11-16T22:08:19.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:19 smithi057 bash[10301]: cluster 2020-11-16T22:08:17.701846+0000 mgr.x (mgr.24115) 470 : cluster [DBG] pgmap v871: 17 pgs: 17 active+clean; 98 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 977 KiB/s wr, 8 op/s 2020-11-16T22:08:19.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:19 smithi057 bash[10301]: cluster 2020-11-16T22:08:18.072161+0000 mon.a (mon.0) 1125 : cluster [DBG] osdmap e472: 12 total, 12 up, 12 in 2020-11-16T22:08:19.993 INFO:tasks.rados.rados.2.smithi057.stdout:1651: done (5 left) 2020-11-16T22:08:19.994 INFO:tasks.rados.rados.2.smithi057.stdout:1652: snap_remove snap 194 2020-11-16T22:08:20.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:20 smithi016 bash[10302]: cluster 2020-11-16T22:08:19.081942+0000 mon.a (mon.0) 1126 : cluster [DBG] osdmap e473: 12 total, 12 up, 12 in 2020-11-16T22:08:20.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:20 smithi016 bash[10302]: cluster 2020-11-16T22:08:20.003175+0000 mon.a (mon.0) 1127 : cluster [DBG] osdmap e474: 12 total, 12 up, 12 in 2020-11-16T22:08:20.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:20 smithi195 bash[10218]: cluster 2020-11-16T22:08:19.081942+0000 mon.a (mon.0) 1126 : cluster [DBG] osdmap e473: 12 total, 12 up, 12 in 2020-11-16T22:08:20.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:20 smithi195 bash[10218]: cluster 2020-11-16T22:08:20.003175+0000 mon.a (mon.0) 1127 : cluster [DBG] osdmap e474: 12 total, 12 up, 12 in 2020-11-16T22:08:20.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:20 smithi057 bash[10301]: cluster 2020-11-16T22:08:19.081942+0000 mon.a (mon.0) 1126 : cluster [DBG] osdmap e473: 12 total, 12 up, 12 in 2020-11-16T22:08:20.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:20 smithi057 bash[10301]: cluster 2020-11-16T22:08:20.003175+0000 mon.a (mon.0) 1127 : cluster [DBG] osdmap e474: 12 total, 12 up, 12 in 2020-11-16T22:08:21.004 INFO:tasks.rados.rados.2.smithi057.stdout:1652: done (5 left) 2020-11-16T22:08:21.004 INFO:tasks.rados.rados.2.smithi057.stdout:1653: rollback oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 201 2020-11-16T22:08:21.005 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 199 2020-11-16T22:08:21.005 INFO:tasks.rados.rados.2.smithi057.stdout:1647: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:21.005 INFO:tasks.rados.rados.2.smithi057.stdout:1645: expect (ObjNum 340 snap 115 seq_num 340) 2020-11-16T22:08:21.170 INFO:tasks.rados.rados.2.smithi057.stdout:1647: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:21.170 INFO:tasks.rados.rados.2.smithi057.stdout:1647: finishing write tid 3 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:21.170 INFO:tasks.rados.rados.2.smithi057.stdout:1647: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:21.374 INFO:tasks.rados.rados.2.smithi057.stdout:1647: finishing write tid 6 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:21.374 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1429 (ObjNum 550 snap 201 seq_num 550) dirty exists 2020-11-16T22:08:21.375 INFO:tasks.rados.rados.2.smithi057.stdout:1647: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 550 snap 201 seq_num 550) 2020-11-16T22:08:21.375 INFO:tasks.rados.rados.2.smithi057.stdout:1644: expect (ObjNum 340 snap 115 seq_num 340) 2020-11-16T22:08:21.379 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:21 smithi195 bash[10218]: cluster 2020-11-16T22:08:19.702521+0000 mgr.x (mgr.24115) 471 : cluster [DBG] pgmap v874: 17 pgs: 17 active+clean; 98 MiB data, 477 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 656 KiB/s wr, 3 op/s 2020-11-16T22:08:21.379 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:21 smithi195 bash[10218]: cluster 2020-11-16T22:08:21.014130+0000 mon.a (mon.0) 1128 : cluster [DBG] osdmap e475: 12 total, 12 up, 12 in 2020-11-16T22:08:21.380 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:21 smithi016 bash[10302]: cluster 2020-11-16T22:08:19.702521+0000 mgr.x (mgr.24115) 471 : cluster [DBG] pgmap v874: 17 pgs: 17 active+clean; 98 MiB data, 477 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 656 KiB/s wr, 3 op/s 2020-11-16T22:08:21.380 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:21 smithi016 bash[10302]: cluster 2020-11-16T22:08:21.014130+0000 mon.a (mon.0) 1128 : cluster [DBG] osdmap e475: 12 total, 12 up, 12 in 2020-11-16T22:08:21.380 INFO:tasks.rados.rados.2.smithi057.stdout:1649: finishing write tid 1 to smithi05720651-28 2020-11-16T22:08:21.381 INFO:tasks.rados.rados.2.smithi057.stdout:1649: finishing write tid 2 to smithi05720651-28 2020-11-16T22:08:21.381 INFO:tasks.rados.rados.2.smithi057.stdout:1649: finishing write tid 3 to smithi05720651-28 2020-11-16T22:08:21.381 INFO:tasks.rados.rados.2.smithi057.stdout:1649: finishing write tid 5 to smithi05720651-28 2020-11-16T22:08:21.381 INFO:tasks.rados.rados.2.smithi057.stdout:1649: finishing write tid 6 to smithi05720651-28 2020-11-16T22:08:21.381 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 1318 (ObjNum 551 snap 201 seq_num 551) dirty exists 2020-11-16T22:08:21.382 INFO:tasks.rados.rados.2.smithi057.stdout:1649: left oid 28 (ObjNum 551 snap 201 seq_num 551) 2020-11-16T22:08:21.382 INFO:tasks.rados.rados.2.smithi057.stdout:1653: finishing rollback tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:21.382 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 257 snap 0 seq_num 2930974704) dirty dne 2020-11-16T22:08:21.586 INFO:tasks.rados.rados.2.smithi057.stdout:1644: done (5 left) 2020-11-16T22:08:21.586 INFO:tasks.rados.rados.2.smithi057.stdout:1645: done (4 left) 2020-11-16T22:08:21.587 INFO:tasks.rados.rados.2.smithi057.stdout:1646: done (3 left) 2020-11-16T22:08:21.587 INFO:tasks.rados.rados.2.smithi057.stdout:1647: done (2 left) 2020-11-16T22:08:21.587 INFO:tasks.rados.rados.2.smithi057.stdout:1649: done (1 left) 2020-11-16T22:08:21.587 INFO:tasks.rados.rados.2.smithi057.stdout:1653: done (0 left) 2020-11-16T22:08:21.587 INFO:tasks.rados.rados.2.smithi057.stdout:1654: write (excl) oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 201 2020-11-16T22:08:21.587 INFO:tasks.rados.rados.2.smithi057.stdout:1654: seq_num 552 ranges {477464=714864,1751825=736525,3225492=51972} 2020-11-16T22:08:21.587 INFO:tasks.rados.rados.2.smithi057.stdout:1654: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 477464 to 1192328 tid 1 2020-11-16T22:08:21.588 INFO:tasks.rados.rados.2.smithi057.stdout:1654: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1751825 to 2488350 tid 2 2020-11-16T22:08:21.588 INFO:tasks.rados.rados.2.smithi057.stdout:1654: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3225492 to 3277464 tid 3 2020-11-16T22:08:21.588 INFO:tasks.rados.rados.2.smithi057.stdout:1655: read oid 26 snap -1 2020-11-16T22:08:21.588 INFO:tasks.rados.rados.2.smithi057.stdout:1655: expect (ObjNum 542 snap 194 seq_num 542) 2020-11-16T22:08:21.588 INFO:tasks.rados.rados.2.smithi057.stdout:1656: delete oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 201 2020-11-16T22:08:21.588 INFO:tasks.rados.rados.2.smithi057.stdout:1654: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:21.588 INFO:tasks.rados.rados.2.smithi057.stdout:1654: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:21.794 INFO:tasks.rados.rados.2.smithi057.stdout:1654: finishing write tid 3 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:21.794 INFO:tasks.rados.rados.2.smithi057.stdout:1656: done (2 left) 2020-11-16T22:08:21.794 INFO:tasks.rados.rados.2.smithi057.stdout:1657: rollback oid 6 current snap is 201 2020-11-16T22:08:21.795 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 6 to 199 2020-11-16T22:08:21.795 INFO:tasks.rados.rados.2.smithi057.stdout:1658: delete oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 201 2020-11-16T22:08:21.795 INFO:tasks.rados.rados.2.smithi057.stdout:1654: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:21.795 INFO:tasks.rados.rados.2.smithi057.stdout:1654: finishing write tid 6 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:21.795 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1122 (ObjNum 552 snap 201 seq_num 552) dirty exists 2020-11-16T22:08:21.796 INFO:tasks.rados.rados.2.smithi057.stdout:1654: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 552 snap 201 seq_num 552) 2020-11-16T22:08:21.796 INFO:tasks.rados.rados.2.smithi057.stdout:1654: done (3 left) 2020-11-16T22:08:21.796 INFO:tasks.rados.rados.2.smithi057.stdout:1658: done (2 left) 2020-11-16T22:08:21.796 INFO:tasks.rados.rados.2.smithi057.stdout:1659: delete oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 201 2020-11-16T22:08:21.796 INFO:tasks.rados.rados.2.smithi057.stdout:1657: finishing rollback tid 0 to smithi05720651-6 2020-11-16T22:08:21.797 INFO:tasks.rados.rados.2.smithi057.stdout:1657: finishing rollback tid 1 to smithi05720651-6 2020-11-16T22:08:21.797 INFO:tasks.rados.rados.2.smithi057.stdout:1659: done (2 left) 2020-11-16T22:08:21.797 INFO:tasks.rados.rados.2.smithi057.stdout:1660: snap_create 2020-11-16T22:08:21.797 INFO:tasks.rados.rados.2.smithi057.stdout:1655: expect (ObjNum 542 snap 194 seq_num 542) 2020-11-16T22:08:21.798 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:21 smithi057 bash[10301]: cluster 2020-11-16T22:08:19.702521+0000 mgr.x (mgr.24115) 471 : cluster [DBG] pgmap v874: 17 pgs: 17 active+clean; 98 MiB data, 477 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 656 KiB/s wr, 3 op/s 2020-11-16T22:08:22.002 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:21 smithi057 bash[10301]: cluster 2020-11-16T22:08:21.014130+0000 mon.a (mon.0) 1128 : cluster [DBG] osdmap e475: 12 total, 12 up, 12 in 2020-11-16T22:08:22.002 INFO:tasks.rados.rados.2.smithi057.stdout:1657: finishing rollback tid 2 to smithi05720651-6 2020-11-16T22:08:22.003 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 1449 (ObjNum 523 snap 188 seq_num 523) dirty exists 2020-11-16T22:08:22.095 INFO:tasks.rados.rados.2.smithi057.stdout:1655: done (2 left) 2020-11-16T22:08:22.095 INFO:tasks.rados.rados.2.smithi057.stdout:1657: done (1 left) 2020-11-16T22:08:22.095 INFO:tasks.rados.rados.2.smithi057.stdout:1660: done (0 left) 2020-11-16T22:08:22.095 INFO:tasks.rados.rados.2.smithi057.stdout:1661: snap_create 2020-11-16T22:08:23.103 INFO:tasks.rados.rados.2.smithi057.stdout:1661: done (0 left) 2020-11-16T22:08:23.103 INFO:tasks.rados.rados.2.smithi057.stdout:1662: write oid 2 current snap is 203 2020-11-16T22:08:23.104 INFO:tasks.rados.rados.2.smithi057.stdout:1662: seq_num 556 ranges {544692=732213,1985753=743863,3335184=9508} 2020-11-16T22:08:23.118 INFO:tasks.rados.rados.2.smithi057.stdout:1662: writing smithi05720651-2 from 544692 to 1276905 tid 1 2020-11-16T22:08:23.126 INFO:tasks.rados.rados.2.smithi057.stdout:1662: writing smithi05720651-2 from 1985753 to 2729616 tid 2 2020-11-16T22:08:23.130 INFO:tasks.rados.rados.2.smithi057.stdout:1662: writing smithi05720651-2 from 3335184 to 3344692 tid 3 2020-11-16T22:08:23.130 INFO:tasks.rados.rados.2.smithi057.stdout:1663: write oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 203 2020-11-16T22:08:23.130 INFO:tasks.rados.rados.2.smithi057.stdout:1663: seq_num 557 ranges {561499=407462,1527882=487521,2729901=557217} 2020-11-16T22:08:23.135 INFO:tasks.rados.rados.2.smithi057.stdout:1663: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 561499 to 968961 tid 1 2020-11-16T22:08:23.141 INFO:tasks.rados.rados.2.smithi057.stdout:1663: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1527882 to 2015403 tid 2 2020-11-16T22:08:23.149 INFO:tasks.rados.rados.2.smithi057.stdout:1663: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2729901 to 3287118 tid 3 2020-11-16T22:08:23.149 INFO:tasks.rados.rados.2.smithi057.stdout:1664: read oid 32 snap 202 2020-11-16T22:08:23.149 INFO:tasks.rados.rados.2.smithi057.stdout:1664: expect deleted 2020-11-16T22:08:23.149 INFO:tasks.rados.rados.2.smithi057.stdout:1665: write (excl) oid 42 current snap is 203 2020-11-16T22:08:23.149 INFO:tasks.rados.rados.2.smithi057.stdout:1665: seq_num 558 ranges {578306=482711,1586364=631179,2757324=484842} 2020-11-16T22:08:23.155 INFO:tasks.rados.rados.2.smithi057.stdout:1665: writing smithi05720651-42 from 578306 to 1061017 tid 1 2020-11-16T22:08:23.161 INFO:tasks.rados.rados.2.smithi057.stdout:1665: writing smithi05720651-42 from 1586364 to 2217543 tid 2 2020-11-16T22:08:23.167 INFO:tasks.rados.rados.2.smithi057.stdout:1665: writing smithi05720651-42 from 2757324 to 3242166 tid 3 2020-11-16T22:08:23.168 INFO:tasks.rados.rados.2.smithi057.stdout:1666: read oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:08:23.168 INFO:tasks.rados.rados.2.smithi057.stdout:1666: expect (ObjNum 464 snap 154 seq_num 464) 2020-11-16T22:08:23.168 INFO:tasks.rados.rados.2.smithi057.stdout:1667: read oid 24 snap 201 2020-11-16T22:08:23.168 INFO:tasks.rados.rados.2.smithi057.stdout:1667: expect (ObjNum 445 snap 150 seq_num 445) 2020-11-16T22:08:23.168 INFO:tasks.rados.rados.2.smithi057.stdout:1668: write (excl) oid 20 current snap is 203 2020-11-16T22:08:23.168 INFO:tasks.rados.rados.2.smithi057.stdout:1668: seq_num 559 ranges {595113=557960,1644846=491190,2784747=610366} 2020-11-16T22:08:23.174 INFO:tasks.rados.rados.2.smithi057.stdout:1668: writing smithi05720651-20 from 595113 to 1153073 tid 1 2020-11-16T22:08:23.180 INFO:tasks.rados.rados.2.smithi057.stdout:1668: writing smithi05720651-20 from 1644846 to 2136036 tid 2 2020-11-16T22:08:23.188 INFO:tasks.rados.rados.2.smithi057.stdout:1668: writing smithi05720651-20 from 2784747 to 3395113 tid 3 2020-11-16T22:08:23.188 INFO:tasks.rados.rados.2.smithi057.stdout:1669: write oid 46 current snap is 203 2020-11-16T22:08:23.188 INFO:tasks.rados.rados.2.smithi057.stdout:1669: seq_num 560 ranges {611920=633209,1703328=634848,2812170=507386} 2020-11-16T22:08:23.195 INFO:tasks.rados.rados.2.smithi057.stdout:1669: writing smithi05720651-46 from 611920 to 1245129 tid 1 2020-11-16T22:08:23.202 INFO:tasks.rados.rados.2.smithi057.stdout:1669: writing smithi05720651-46 from 1703328 to 2338176 tid 2 2020-11-16T22:08:23.208 INFO:tasks.rados.rados.2.smithi057.stdout:1669: writing smithi05720651-46 from 2812170 to 3319556 tid 3 2020-11-16T22:08:23.209 INFO:tasks.rados.rados.2.smithi057.stdout:1670: copy_from oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 203 2020-11-16T22:08:23.209 INFO:tasks.rados.rados.2.smithi057.stdout:1662: finishing write tid 1 to smithi05720651-2 2020-11-16T22:08:23.209 INFO:tasks.rados.rados.2.smithi057.stdout:1671: read oid 44 snap -1 2020-11-16T22:08:23.209 INFO:tasks.rados.rados.2.smithi057.stdout:1671: expect deleted 2020-11-16T22:08:23.209 INFO:tasks.rados.rados.2.smithi057.stdout:1672: delete oid 18 current snap is 203 2020-11-16T22:08:23.209 INFO:tasks.rados.rados.2.smithi057.stdout:1662: finishing write tid 2 to smithi05720651-2 2020-11-16T22:08:23.210 INFO:tasks.rados.rados.2.smithi057.stdout:1662: finishing write tid 3 to smithi05720651-2 2020-11-16T22:08:23.210 INFO:tasks.rados.rados.2.smithi057.stdout:1662: finishing write tid 5 to smithi05720651-2 2020-11-16T22:08:23.210 INFO:tasks.rados.rados.2.smithi057.stdout:1662: finishing write tid 6 to smithi05720651-2 2020-11-16T22:08:23.210 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 1499 (ObjNum 556 snap 203 seq_num 556) dirty exists 2020-11-16T22:08:23.210 INFO:tasks.rados.rados.2.smithi057.stdout:1662: left oid 2 (ObjNum 556 snap 203 seq_num 556) 2020-11-16T22:08:23.210 INFO:tasks.rados.rados.2.smithi057.stdout:1663: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:23.210 INFO:tasks.rados.rados.2.smithi057.stdout:1663: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:23.211 INFO:tasks.rados.rados.2.smithi057.stdout:1663: finishing write tid 3 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:23.211 INFO:tasks.rados.rados.2.smithi057.stdout:1663: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:23.211 INFO:tasks.rados.rados.2.smithi057.stdout:1663: finishing write tid 6 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:23.211 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1126 (ObjNum 557 snap 203 seq_num 557) dirty exists 2020-11-16T22:08:23.211 INFO:tasks.rados.rados.2.smithi057.stdout:1663: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 557 snap 203 seq_num 557) 2020-11-16T22:08:23.211 INFO:tasks.rados.rados.2.smithi057.stdout:1665: finishing write tid 1 to smithi05720651-42 2020-11-16T22:08:23.211 INFO:tasks.rados.rados.2.smithi057.stdout:1665: finishing write tid 2 to smithi05720651-42 2020-11-16T22:08:23.212 INFO:tasks.rados.rados.2.smithi057.stdout:1665: finishing write tid 3 to smithi05720651-42 2020-11-16T22:08:23.212 INFO:tasks.rados.rados.2.smithi057.stdout:1665: finishing write tid 5 to smithi05720651-42 2020-11-16T22:08:23.212 INFO:tasks.rados.rados.2.smithi057.stdout:1665: finishing write tid 6 to smithi05720651-42 2020-11-16T22:08:23.212 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 1130 (ObjNum 558 snap 203 seq_num 558) dirty exists 2020-11-16T22:08:23.212 INFO:tasks.rados.rados.2.smithi057.stdout:1665: left oid 42 (ObjNum 558 snap 203 seq_num 558) 2020-11-16T22:08:23.212 INFO:tasks.rados.rados.2.smithi057.stdout:1668: finishing write tid 1 to smithi05720651-20 2020-11-16T22:08:23.212 INFO:tasks.rados.rados.2.smithi057.stdout:1666: expect (ObjNum 464 snap 154 seq_num 464) 2020-11-16T22:08:23.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:23 smithi195 bash[10218]: cluster 2020-11-16T22:08:21.703225+0000 mgr.x (mgr.24115) 472 : cluster [DBG] pgmap v877: 17 pgs: 17 active+clean; 107 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.4 MiB/s wr, 15 op/s 2020-11-16T22:08:23.550 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:23 smithi195 bash[10218]: cluster 2020-11-16T22:08:22.101092+0000 mon.a (mon.0) 1129 : cluster [DBG] osdmap e476: 12 total, 12 up, 12 in 2020-11-16T22:08:23.556 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:23 smithi057 bash[10301]: cluster 2020-11-16T22:08:21.703225+0000 mgr.x (mgr.24115) 472 : cluster [DBG] pgmap v877: 17 pgs: 17 active+clean; 107 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.4 MiB/s wr, 15 op/s 2020-11-16T22:08:23.556 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:23 smithi057 bash[10301]: cluster 2020-11-16T22:08:22.101092+0000 mon.a (mon.0) 1129 : cluster [DBG] osdmap e476: 12 total, 12 up, 12 in 2020-11-16T22:08:23.556 INFO:tasks.rados.rados.2.smithi057.stdout:1668: finishing write tid 2 to smithi05720651-20 2020-11-16T22:08:23.556 INFO:tasks.rados.rados.2.smithi057.stdout:1668: finishing write tid 3 to smithi05720651-20 2020-11-16T22:08:23.557 INFO:tasks.rados.rados.2.smithi057.stdout:1667: expect (ObjNum 445 snap 150 seq_num 445) 2020-11-16T22:08:23.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:23 smithi016 bash[10302]: cluster 2020-11-16T22:08:21.703225+0000 mgr.x (mgr.24115) 472 : cluster [DBG] pgmap v877: 17 pgs: 17 active+clean; 107 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.4 MiB/s wr, 15 op/s 2020-11-16T22:08:23.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:23 smithi016 bash[10302]: cluster 2020-11-16T22:08:22.101092+0000 mon.a (mon.0) 1129 : cluster [DBG] osdmap e476: 12 total, 12 up, 12 in 2020-11-16T22:08:23.627 INFO:tasks.rados.rados.2.smithi057.stdout:1668: finishing write tid 5 to smithi05720651-20 2020-11-16T22:08:23.627 INFO:tasks.rados.rados.2.smithi057.stdout:1668: finishing write tid 6 to smithi05720651-20 2020-11-16T22:08:23.628 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1083 (ObjNum 559 snap 203 seq_num 559) dirty exists 2020-11-16T22:08:23.628 INFO:tasks.rados.rados.2.smithi057.stdout:1668: left oid 20 (ObjNum 559 snap 203 seq_num 559) 2020-11-16T22:08:23.628 INFO:tasks.rados.rados.2.smithi057.stdout:1669: finishing write tid 1 to smithi05720651-46 2020-11-16T22:08:23.628 INFO:tasks.rados.rados.2.smithi057.stdout:1669: finishing write tid 2 to smithi05720651-46 2020-11-16T22:08:23.628 INFO:tasks.rados.rados.2.smithi057.stdout:1670: finishing copy_from to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:23.628 INFO:tasks.rados.rados.2.smithi057.stdout:1670: got expected ENOENT (src dne) 2020-11-16T22:08:23.629 INFO:tasks.rados.rados.2.smithi057.stdout:1670: finishing copy_from racing read to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:23.629 INFO:tasks.rados.rados.2.smithi057.stdout:1669: finishing write tid 3 to smithi05720651-46 2020-11-16T22:08:23.629 INFO:tasks.rados.rados.2.smithi057.stdout:1669: finishing write tid 5 to smithi05720651-46 2020-11-16T22:08:23.629 INFO:tasks.rados.rados.2.smithi057.stdout:1662: done (10 left) 2020-11-16T22:08:23.629 INFO:tasks.rados.rados.2.smithi057.stdout:1663: done (9 left) 2020-11-16T22:08:23.629 INFO:tasks.rados.rados.2.smithi057.stdout:1664: done (8 left) 2020-11-16T22:08:23.629 INFO:tasks.rados.rados.2.smithi057.stdout:1665: done (7 left) 2020-11-16T22:08:23.830 INFO:tasks.rados.rados.2.smithi057.stdout:1666: done (6 left) 2020-11-16T22:08:23.830 INFO:tasks.rados.rados.2.smithi057.stdout:1667: done (5 left) 2020-11-16T22:08:23.830 INFO:tasks.rados.rados.2.smithi057.stdout:1668: done (4 left) 2020-11-16T22:08:23.831 INFO:tasks.rados.rados.2.smithi057.stdout:1670: done (3 left) 2020-11-16T22:08:23.831 INFO:tasks.rados.rados.2.smithi057.stdout:1671: done (2 left) 2020-11-16T22:08:23.831 INFO:tasks.rados.rados.2.smithi057.stdout:1672: done (1 left) 2020-11-16T22:08:23.831 INFO:tasks.rados.rados.2.smithi057.stdout:1673: write (excl) oid 18 current snap is 203 2020-11-16T22:08:23.831 INFO:tasks.rados.rados.2.smithi057.stdout:1673: seq_num 562 ranges {645534=783707,2103939=638517,3150663=294871} 2020-11-16T22:08:23.833 INFO:tasks.rados.rados.2.smithi057.stdout:1673: writing smithi05720651-18 from 645534 to 1429241 tid 1 2020-11-16T22:08:23.833 INFO:tasks.rados.rados.2.smithi057.stdout:1673: writing smithi05720651-18 from 2103939 to 2742456 tid 2 2020-11-16T22:08:23.833 INFO:tasks.rados.rados.2.smithi057.stdout:1673: writing smithi05720651-18 from 3150663 to 3445534 tid 3 2020-11-16T22:08:23.833 INFO:tasks.rados.rados.2.smithi057.stdout:1674: copy_from oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 203 2020-11-16T22:08:23.833 INFO:tasks.rados.rados.2.smithi057.stdout:1669: finishing write tid 6 to smithi05720651-46 2020-11-16T22:08:23.833 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 1322 (ObjNum 560 snap 203 seq_num 560) dirty exists 2020-11-16T22:08:23.834 INFO:tasks.rados.rados.2.smithi057.stdout:1669: left oid 46 (ObjNum 560 snap 203 seq_num 560) 2020-11-16T22:08:23.834 INFO:tasks.rados.rados.2.smithi057.stdout:1669: done (2 left) 2020-11-16T22:08:23.834 INFO:tasks.rados.rados.2.smithi057.stdout:1675: snap_create 2020-11-16T22:08:23.834 INFO:tasks.rados.rados.2.smithi057.stdout:1673: finishing write tid 1 to smithi05720651-18 2020-11-16T22:08:23.834 INFO:tasks.rados.rados.2.smithi057.stdout:1673: finishing write tid 2 to smithi05720651-18 2020-11-16T22:08:23.834 INFO:tasks.rados.rados.2.smithi057.stdout:1673: finishing write tid 3 to smithi05720651-18 2020-11-16T22:08:23.835 INFO:tasks.rados.rados.2.smithi057.stdout:1673: finishing write tid 5 to smithi05720651-18 2020-11-16T22:08:23.835 INFO:tasks.rados.rados.2.smithi057.stdout:1673: finishing write tid 6 to smithi05720651-18 2020-11-16T22:08:23.835 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 1238 (ObjNum 562 snap 203 seq_num 562) dirty exists 2020-11-16T22:08:23.835 INFO:tasks.rados.rados.2.smithi057.stdout:1673: left oid 18 (ObjNum 562 snap 203 seq_num 562) 2020-11-16T22:08:23.835 INFO:tasks.rados.rados.2.smithi057.stdout:1674: finishing copy_from to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:23.835 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1357 (ObjNum 522 snap 188 seq_num 522) dirty exists 2020-11-16T22:08:24.038 INFO:tasks.rados.rados.2.smithi057.stdout:1674: finishing copy_from racing read to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:24.113 INFO:tasks.rados.rados.2.smithi057.stdout:1673: done (2 left) 2020-11-16T22:08:24.113 INFO:tasks.rados.rados.2.smithi057.stdout:1674: done (1 left) 2020-11-16T22:08:24.113 INFO:tasks.rados.rados.2.smithi057.stdout:1675: done (0 left) 2020-11-16T22:08:24.113 INFO:tasks.rados.rados.2.smithi057.stdout:1676: delete oid 38 current snap is 204 2020-11-16T22:08:24.119 INFO:tasks.rados.rados.2.smithi057.stdout:1676: done (0 left) 2020-11-16T22:08:24.120 INFO:tasks.rados.rados.2.smithi057.stdout:1677: write oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 204 2020-11-16T22:08:24.120 INFO:tasks.rados.rados.2.smithi057.stdout:1677: seq_num 564 ranges {679148=650558,1937256=642186,3321862=157286} 2020-11-16T22:08:24.133 INFO:tasks.rados.rados.2.smithi057.stdout:1677: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 679148 to 1329706 tid 1 2020-11-16T22:08:24.141 INFO:tasks.rados.rados.2.smithi057.stdout:1677: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1937256 to 2579442 tid 2 2020-11-16T22:08:24.147 INFO:tasks.rados.rados.2.smithi057.stdout:1677: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3321862 to 3479148 tid 3 2020-11-16T22:08:24.147 INFO:tasks.rados.rados.2.smithi057.stdout:1678: snap_remove snap 203 2020-11-16T22:08:24.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:24 smithi057 bash[10301]: cluster 2020-11-16T22:08:23.110828+0000 mon.a (mon.0) 1130 : cluster [DBG] osdmap e477: 12 total, 12 up, 12 in 2020-11-16T22:08:24.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:24 smithi016 bash[10302]: cluster 2020-11-16T22:08:23.110828+0000 mon.a (mon.0) 1130 : cluster [DBG] osdmap e477: 12 total, 12 up, 12 in 2020-11-16T22:08:24.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:24 smithi195 bash[10218]: cluster 2020-11-16T22:08:23.110828+0000 mon.a (mon.0) 1130 : cluster [DBG] osdmap e477: 12 total, 12 up, 12 in 2020-11-16T22:08:24.995 INFO:tasks.rados.rados.2.smithi057.stdout:1678: done (1 left) 2020-11-16T22:08:24.996 INFO:tasks.rados.rados.2.smithi057.stdout:1679: write oid 28 current snap is 204 2020-11-16T22:08:24.996 INFO:tasks.rados.rados.2.smithi057.stdout:1679: seq_num 565 ranges {695955=725807,1879385=502197,2949285=480099} 2020-11-16T22:08:25.008 INFO:tasks.rados.rados.2.smithi057.stdout:1679: writing smithi05720651-28 from 695955 to 1421762 tid 1 2020-11-16T22:08:25.014 INFO:tasks.rados.rados.2.smithi057.stdout:1679: writing smithi05720651-28 from 1879385 to 2381582 tid 2 2020-11-16T22:08:25.020 INFO:tasks.rados.rados.2.smithi057.stdout:1679: writing smithi05720651-28 from 2949285 to 3429384 tid 3 2020-11-16T22:08:25.021 INFO:tasks.rados.rados.2.smithi057.stdout:1680: write (excl) oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 204 2020-11-16T22:08:25.021 INFO:tasks.rados.rados.2.smithi057.stdout:1680: seq_num 566 ranges {712762=401056,1537867=645855,2860355=652407} 2020-11-16T22:08:25.027 INFO:tasks.rados.rados.2.smithi057.stdout:1680: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 712762 to 1113818 tid 1 2020-11-16T22:08:25.033 INFO:tasks.rados.rados.2.smithi057.stdout:1680: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1537867 to 2183722 tid 2 2020-11-16T22:08:25.040 INFO:tasks.rados.rados.2.smithi057.stdout:1680: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2860355 to 3512762 tid 3 2020-11-16T22:08:25.041 INFO:tasks.rados.rados.2.smithi057.stdout:1681: snap_remove snap 201 2020-11-16T22:08:25.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:25 smithi057 bash[10301]: cluster 2020-11-16T22:08:23.703910+0000 mgr.x (mgr.24115) 473 : cluster [DBG] pgmap v880: 17 pgs: 17 active+clean; 107 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.4 MiB/s wr, 15 op/s 2020-11-16T22:08:25.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:25 smithi057 bash[10301]: cluster 2020-11-16T22:08:24.120242+0000 mon.a (mon.0) 1131 : cluster [DBG] osdmap e478: 12 total, 12 up, 12 in 2020-11-16T22:08:25.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:25 smithi057 bash[10301]: cluster 2020-11-16T22:08:25.005819+0000 mon.a (mon.0) 1132 : cluster [DBG] osdmap e479: 12 total, 12 up, 12 in 2020-11-16T22:08:25.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:25 smithi016 bash[10302]: cluster 2020-11-16T22:08:23.703910+0000 mgr.x (mgr.24115) 473 : cluster [DBG] pgmap v880: 17 pgs: 17 active+clean; 107 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.4 MiB/s wr, 15 op/s 2020-11-16T22:08:25.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:25 smithi016 bash[10302]: cluster 2020-11-16T22:08:24.120242+0000 mon.a (mon.0) 1131 : cluster [DBG] osdmap e478: 12 total, 12 up, 12 in 2020-11-16T22:08:25.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:25 smithi016 bash[10302]: cluster 2020-11-16T22:08:25.005819+0000 mon.a (mon.0) 1132 : cluster [DBG] osdmap e479: 12 total, 12 up, 12 in 2020-11-16T22:08:25.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:25 smithi195 bash[10218]: cluster 2020-11-16T22:08:23.703910+0000 mgr.x (mgr.24115) 473 : cluster [DBG] pgmap v880: 17 pgs: 17 active+clean; 107 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.4 MiB/s wr, 15 op/s 2020-11-16T22:08:25.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:25 smithi195 bash[10218]: cluster 2020-11-16T22:08:24.120242+0000 mon.a (mon.0) 1131 : cluster [DBG] osdmap e478: 12 total, 12 up, 12 in 2020-11-16T22:08:25.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:25 smithi195 bash[10218]: cluster 2020-11-16T22:08:25.005819+0000 mon.a (mon.0) 1132 : cluster [DBG] osdmap e479: 12 total, 12 up, 12 in 2020-11-16T22:08:26.006 INFO:tasks.rados.rados.2.smithi057.stdout:1681: done (3 left) 2020-11-16T22:08:26.006 INFO:tasks.rados.rados.2.smithi057.stdout:1682: write oid 32 current snap is 204 2020-11-16T22:08:26.006 INFO:tasks.rados.rados.2.smithi057.stdout:1682: seq_num 567 ranges {729569=476305,1996349=505866,3004131=525438} 2020-11-16T22:08:26.019 INFO:tasks.rados.rados.2.smithi057.stdout:1682: writing smithi05720651-32 from 729569 to 1205874 tid 1 2020-11-16T22:08:26.028 INFO:tasks.rados.rados.2.smithi057.stdout:1682: writing smithi05720651-32 from 1996349 to 2502215 tid 2 2020-11-16T22:08:26.034 INFO:tasks.rados.rados.2.smithi057.stdout:1682: writing smithi05720651-32 from 3004131 to 3529569 tid 3 2020-11-16T22:08:26.034 INFO:tasks.rados.rados.2.smithi057.stdout:1683: rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 204 2020-11-16T22:08:26.035 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 200 2020-11-16T22:08:26.035 INFO:tasks.rados.rados.2.smithi057.stdout:1677: finishing write tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:26.035 INFO:tasks.rados.rados.2.smithi057.stdout:1677: finishing write tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:26.035 INFO:tasks.rados.rados.2.smithi057.stdout:1677: finishing write tid 3 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:26.035 INFO:tasks.rados.rados.2.smithi057.stdout:1677: finishing write tid 5 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:26.035 INFO:tasks.rados.rados.2.smithi057.stdout:1684: copy_from oid 48 from oid 26 current snap is 204 2020-11-16T22:08:26.035 INFO:tasks.rados.rados.2.smithi057.stdout:1677: finishing write tid 6 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:26.036 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1326 (ObjNum 564 snap 204 seq_num 564) dirty exists 2020-11-16T22:08:26.036 INFO:tasks.rados.rados.2.smithi057.stdout:1677: left oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 564 snap 204 seq_num 564) 2020-11-16T22:08:26.036 INFO:tasks.rados.rados.2.smithi057.stdout:1679: finishing write tid 1 to smithi05720651-28 2020-11-16T22:08:26.036 INFO:tasks.rados.rados.2.smithi057.stdout:1679: finishing write tid 2 to smithi05720651-28 2020-11-16T22:08:26.036 INFO:tasks.rados.rados.2.smithi057.stdout:1679: finishing write tid 3 to smithi05720651-28 2020-11-16T22:08:26.036 INFO:tasks.rados.rados.2.smithi057.stdout:1680: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:26.037 INFO:tasks.rados.rados.2.smithi057.stdout:1680: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:26.037 INFO:tasks.rados.rados.2.smithi057.stdout:1680: finishing write tid 3 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:26.037 INFO:tasks.rados.rados.2.smithi057.stdout:1680: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:26.037 INFO:tasks.rados.rados.2.smithi057.stdout:1680: finishing write tid 6 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:26.037 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1451 (ObjNum 566 snap 204 seq_num 566) dirty exists 2020-11-16T22:08:26.037 INFO:tasks.rados.rados.2.smithi057.stdout:1680: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 566 snap 204 seq_num 566) 2020-11-16T22:08:26.037 INFO:tasks.rados.rados.2.smithi057.stdout:1679: finishing write tid 5 to smithi05720651-28 2020-11-16T22:08:26.238 INFO:tasks.rados.rados.2.smithi057.stdout:1679: finishing write tid 6 to smithi05720651-28 2020-11-16T22:08:26.238 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 1322 (ObjNum 565 snap 204 seq_num 565) dirty exists 2020-11-16T22:08:26.238 INFO:tasks.rados.rados.2.smithi057.stdout:1679: left oid 28 (ObjNum 565 snap 204 seq_num 565) 2020-11-16T22:08:26.238 INFO:tasks.rados.rados.2.smithi057.stdout:1682: finishing write tid 1 to smithi05720651-32 2020-11-16T22:08:26.240 INFO:tasks.rados.rados.2.smithi057.stdout:1677: done (5 left) 2020-11-16T22:08:26.240 INFO:tasks.rados.rados.2.smithi057.stdout:1679: done (4 left) 2020-11-16T22:08:26.240 INFO:tasks.rados.rados.2.smithi057.stdout:1680: done (3 left) 2020-11-16T22:08:26.240 INFO:tasks.rados.rados.2.smithi057.stdout:1685: delete oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 204 2020-11-16T22:08:26.241 INFO:tasks.rados.rados.2.smithi057.stdout:1682: finishing write tid 2 to smithi05720651-32 2020-11-16T22:08:26.241 INFO:tasks.rados.rados.2.smithi057.stdout:1685: done (3 left) 2020-11-16T22:08:26.241 INFO:tasks.rados.rados.2.smithi057.stdout:1686: delete oid 24 current snap is 204 2020-11-16T22:08:26.241 INFO:tasks.rados.rados.2.smithi057.stdout:1682: finishing write tid 3 to smithi05720651-32 2020-11-16T22:08:26.241 INFO:tasks.rados.rados.2.smithi057.stdout:1682: finishing write tid 5 to smithi05720651-32 2020-11-16T22:08:26.241 INFO:tasks.rados.rados.2.smithi057.stdout:1682: finishing write tid 6 to smithi05720651-32 2020-11-16T22:08:26.242 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 1505 (ObjNum 567 snap 204 seq_num 567) dirty exists 2020-11-16T22:08:26.242 INFO:tasks.rados.rados.2.smithi057.stdout:1682: left oid 32 (ObjNum 567 snap 204 seq_num 567) 2020-11-16T22:08:26.242 INFO:tasks.rados.rados.2.smithi057.stdout:1682: done (3 left) 2020-11-16T22:08:26.242 INFO:tasks.rados.rados.2.smithi057.stdout:1686: done (2 left) 2020-11-16T22:08:26.242 INFO:tasks.rados.rados.2.smithi057.stdout:1687: write oid 22 current snap is 204 2020-11-16T22:08:26.242 INFO:tasks.rados.rados.2.smithi057.stdout:1687: seq_num 570 ranges {779990=702052,2055442=653193,3253694=326296} 2020-11-16T22:08:26.242 INFO:tasks.rados.rados.2.smithi057.stdout:1687: writing smithi05720651-22 from 779990 to 1482042 tid 1 2020-11-16T22:08:26.243 INFO:tasks.rados.rados.2.smithi057.stdout:1687: writing smithi05720651-22 from 2055442 to 2708635 tid 2 2020-11-16T22:08:26.243 INFO:tasks.rados.rados.2.smithi057.stdout:1687: writing smithi05720651-22 from 3253694 to 3579990 tid 3 2020-11-16T22:08:26.243 INFO:tasks.rados.rados.2.smithi057.stdout:1688: rollback oid 20 current snap is 204 2020-11-16T22:08:26.243 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 20 to 198 2020-11-16T22:08:26.243 INFO:tasks.rados.rados.2.smithi057.stdout:1683: finishing rollback tid 0 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:26.243 INFO:tasks.rados.rados.2.smithi057.stdout:1683: finishing rollback tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:26.243 INFO:tasks.rados.rados.2.smithi057.stdout:1683: finishing rollback tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:26.244 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1325 (ObjNum 496 snap 177 seq_num 496) dirty exists 2020-11-16T22:08:26.244 INFO:tasks.rados.rados.2.smithi057.stdout:1684: finishing copy_from to smithi05720651-48 2020-11-16T22:08:26.244 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 1491 (ObjNum 542 snap 194 seq_num 542) dirty exists 2020-11-16T22:08:26.244 INFO:tasks.rados.rados.2.smithi057.stdout:1684: finishing copy_from racing read to smithi05720651-48 2020-11-16T22:08:26.244 INFO:tasks.rados.rados.2.smithi057.stdout:1687: finishing write tid 1 to smithi05720651-22 2020-11-16T22:08:26.244 INFO:tasks.rados.rados.2.smithi057.stdout:1687: finishing write tid 2 to smithi05720651-22 2020-11-16T22:08:26.244 INFO:tasks.rados.rados.2.smithi057.stdout:1683: done (3 left) 2020-11-16T22:08:26.245 INFO:tasks.rados.rados.2.smithi057.stdout:1684: done (2 left) 2020-11-16T22:08:26.245 INFO:tasks.rados.rados.2.smithi057.stdout:1689: snap_remove snap 199 2020-11-16T22:08:27.023 INFO:tasks.rados.rados.2.smithi057.stdout:1689: done (2 left) 2020-11-16T22:08:27.024 INFO:tasks.rados.rados.2.smithi057.stdout:1690: snap_remove snap 200 2020-11-16T22:08:27.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:27 smithi016 bash[10302]: cluster 2020-11-16T22:08:25.704662+0000 mgr.x (mgr.24115) 474 : cluster [DBG] pgmap v883: 17 pgs: 17 active+clean; 114 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 1.4 MiB/s wr, 8 op/s 2020-11-16T22:08:27.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:27 smithi016 bash[10302]: cluster 2020-11-16T22:08:26.015152+0000 mon.a (mon.0) 1133 : cluster [DBG] osdmap e480: 12 total, 12 up, 12 in 2020-11-16T22:08:27.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:27 smithi195 bash[10218]: cluster 2020-11-16T22:08:25.704662+0000 mgr.x (mgr.24115) 474 : cluster [DBG] pgmap v883: 17 pgs: 17 active+clean; 114 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 1.4 MiB/s wr, 8 op/s 2020-11-16T22:08:27.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:27 smithi195 bash[10218]: cluster 2020-11-16T22:08:26.015152+0000 mon.a (mon.0) 1133 : cluster [DBG] osdmap e480: 12 total, 12 up, 12 in 2020-11-16T22:08:27.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:27 smithi057 bash[10301]: cluster 2020-11-16T22:08:25.704662+0000 mgr.x (mgr.24115) 474 : cluster [DBG] pgmap v883: 17 pgs: 17 active+clean; 114 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 1.4 MiB/s wr, 8 op/s 2020-11-16T22:08:27.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:27 smithi057 bash[10301]: cluster 2020-11-16T22:08:26.015152+0000 mon.a (mon.0) 1133 : cluster [DBG] osdmap e480: 12 total, 12 up, 12 in 2020-11-16T22:08:28.035 INFO:tasks.rados.rados.2.smithi057.stdout:1690: done (2 left) 2020-11-16T22:08:28.035 INFO:tasks.rados.rados.2.smithi057.stdout:1691: snap_create 2020-11-16T22:08:28.035 INFO:tasks.rados.rados.2.smithi057.stdout:1687: finishing write tid 3 to smithi05720651-22 2020-11-16T22:08:28.035 INFO:tasks.rados.rados.2.smithi057.stdout:1687: finishing write tid 5 to smithi05720651-22 2020-11-16T22:08:28.035 INFO:tasks.rados.rados.2.smithi057.stdout:1687: finishing write tid 6 to smithi05720651-22 2020-11-16T22:08:28.036 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 889 (ObjNum 570 snap 204 seq_num 570) dirty exists 2020-11-16T22:08:28.036 INFO:tasks.rados.rados.2.smithi057.stdout:1687: left oid 22 (ObjNum 570 snap 204 seq_num 570) 2020-11-16T22:08:28.036 INFO:tasks.rados.rados.2.smithi057.stdout:1688: finishing rollback tid 0 to smithi05720651-20 2020-11-16T22:08:28.036 INFO:tasks.rados.rados.2.smithi057.stdout:1688: finishing rollback tid 1 to smithi05720651-20 2020-11-16T22:08:28.036 INFO:tasks.rados.rados.2.smithi057.stdout:1688: finishing rollback tid 2 to smithi05720651-20 2020-11-16T22:08:28.036 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1086 (ObjNum 544 snap 196 seq_num 544) dirty exists 2020-11-16T22:08:28.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:28 smithi016 bash[10302]: cluster 2020-11-16T22:08:27.028624+0000 mon.a (mon.0) 1134 : cluster [DBG] osdmap e481: 12 total, 12 up, 12 in 2020-11-16T22:08:28.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:28 smithi195 bash[10218]: cluster 2020-11-16T22:08:27.028624+0000 mon.a (mon.0) 1134 : cluster [DBG] osdmap e481: 12 total, 12 up, 12 in 2020-11-16T22:08:28.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:28 smithi057 bash[10301]: cluster 2020-11-16T22:08:27.028624+0000 mon.a (mon.0) 1134 : cluster [DBG] osdmap e481: 12 total, 12 up, 12 in 2020-11-16T22:08:29.039 INFO:tasks.rados.rados.2.smithi057.stdout:1687: done (2 left) 2020-11-16T22:08:29.040 INFO:tasks.rados.rados.2.smithi057.stdout:1688: done (1 left) 2020-11-16T22:08:29.040 INFO:tasks.rados.rados.2.smithi057.stdout:1691: done (0 left) 2020-11-16T22:08:29.040 INFO:tasks.rados.rados.2.smithi057.stdout:1692: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:08:29.040 INFO:tasks.rados.rados.2.smithi057.stdout:1692: expect deleted 2020-11-16T22:08:29.040 INFO:tasks.rados.rados.2.smithi057.stdout:1693: copy_from oid 24 from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 205 2020-11-16T22:08:29.040 INFO:tasks.rados.rados.2.smithi057.stdout:1694: rollback oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 205 2020-11-16T22:08:29.041 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 198 2020-11-16T22:08:29.041 INFO:tasks.rados.rados.2.smithi057.stdout:1695: delete oid 34 current snap is 205 2020-11-16T22:08:29.046 INFO:tasks.rados.rados.2.smithi057.stdout:1693: finishing copy_from to smithi05720651-24 2020-11-16T22:08:29.046 INFO:tasks.rados.rados.2.smithi057.stdout:1693: got expected ENOENT (src dne) 2020-11-16T22:08:29.047 INFO:tasks.rados.rados.2.smithi057.stdout:1692: done (3 left) 2020-11-16T22:08:29.047 INFO:tasks.rados.rados.2.smithi057.stdout:1695: done (2 left) 2020-11-16T22:08:29.047 INFO:tasks.rados.rados.2.smithi057.stdout:1696: read oid 30 snap -1 2020-11-16T22:08:29.047 INFO:tasks.rados.rados.2.smithi057.stdout:1696: expect (ObjNum 533 snap 192 seq_num 533) 2020-11-16T22:08:29.048 INFO:tasks.rados.rados.2.smithi057.stdout:1697: rollback oid 14 current snap is 205 2020-11-16T22:08:29.048 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 14 to 202 2020-11-16T22:08:29.048 INFO:tasks.rados.rados.2.smithi057.stdout:1693: finishing copy_from racing read to smithi05720651-24 2020-11-16T22:08:29.048 INFO:tasks.rados.rados.2.smithi057.stdout:1693: done (3 left) 2020-11-16T22:08:29.048 INFO:tasks.rados.rados.2.smithi057.stdout:1698: rollback oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 205 2020-11-16T22:08:29.048 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 202 2020-11-16T22:08:29.048 INFO:tasks.rados.rados.2.smithi057.stdout:1699: read oid 44 snap -1 2020-11-16T22:08:29.049 INFO:tasks.rados.rados.2.smithi057.stdout:1699: expect deleted 2020-11-16T22:08:29.049 INFO:tasks.rados.rados.2.smithi057.stdout:1700: delete oid 32 current snap is 205 2020-11-16T22:08:29.049 INFO:tasks.rados.rados.2.smithi057.stdout:1694: finishing rollback tid 0 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:29.049 INFO:tasks.rados.rados.2.smithi057.stdout:1694: finishing rollback tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:29.050 INFO:tasks.rados.rados.2.smithi057.stdout:1694: finishing rollback tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:29.050 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1471 (ObjNum 522 snap 188 seq_num 522) dirty exists 2020-11-16T22:08:29.059 INFO:tasks.rados.rados.2.smithi057.stdout:1696: expect (ObjNum 533 snap 192 seq_num 533) 2020-11-16T22:08:29.235 INFO:tasks.rados.rados.2.smithi057.stdout:1697: finishing rollback tid 0 to smithi05720651-14 2020-11-16T22:08:29.235 INFO:tasks.rados.rados.2.smithi057.stdout:1697: finishing rollback tid 1 to smithi05720651-14 2020-11-16T22:08:29.236 INFO:tasks.rados.rados.2.smithi057.stdout:1697: finishing rollback tid 2 to smithi05720651-14 2020-11-16T22:08:29.236 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 1513 (ObjNum 502 snap 177 seq_num 502) dirty exists 2020-11-16T22:08:29.236 INFO:tasks.rados.rados.2.smithi057.stdout:1698: finishing rollback tid 0 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:29.236 INFO:tasks.rados.rados.2.smithi057.stdout:1698: finishing rollback tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:29.236 INFO:tasks.rados.rados.2.smithi057.stdout:1698: finishing rollback tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:29.237 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1517 (ObjNum 505 snap 177 seq_num 505) dirty exists 2020-11-16T22:08:29.237 INFO:tasks.rados.rados.2.smithi057.stdout:1694: done (5 left) 2020-11-16T22:08:29.237 INFO:tasks.rados.rados.2.smithi057.stdout:1696: done (4 left) 2020-11-16T22:08:29.237 INFO:tasks.rados.rados.2.smithi057.stdout:1697: done (3 left) 2020-11-16T22:08:29.237 INFO:tasks.rados.rados.2.smithi057.stdout:1698: done (2 left) 2020-11-16T22:08:29.238 INFO:tasks.rados.rados.2.smithi057.stdout:1699: done (1 left) 2020-11-16T22:08:29.238 INFO:tasks.rados.rados.2.smithi057.stdout:1700: done (0 left) 2020-11-16T22:08:29.238 INFO:tasks.rados.rados.2.smithi057.stdout:1701: delete oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 205 2020-11-16T22:08:29.240 INFO:tasks.rados.rados.2.smithi057.stdout:1701: done (0 left) 2020-11-16T22:08:29.240 INFO:tasks.rados.rados.2.smithi057.stdout:1702: snap_create 2020-11-16T22:08:29.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:29 smithi016 bash[10302]: cluster 2020-11-16T22:08:27.705401+0000 mgr.x (mgr.24115) 475 : cluster [DBG] pgmap v886: 17 pgs: 17 active+clean; 131 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 4.8 MiB/s wr, 21 op/s 2020-11-16T22:08:29.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:29 smithi016 bash[10302]: cluster 2020-11-16T22:08:28.036968+0000 mon.a (mon.0) 1135 : cluster [DBG] osdmap e482: 12 total, 12 up, 12 in 2020-11-16T22:08:29.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:29 smithi195 bash[10218]: cluster 2020-11-16T22:08:27.705401+0000 mgr.x (mgr.24115) 475 : cluster [DBG] pgmap v886: 17 pgs: 17 active+clean; 131 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 4.8 MiB/s wr, 21 op/s 2020-11-16T22:08:29.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:29 smithi195 bash[10218]: cluster 2020-11-16T22:08:28.036968+0000 mon.a (mon.0) 1135 : cluster [DBG] osdmap e482: 12 total, 12 up, 12 in 2020-11-16T22:08:29.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:29 smithi057 bash[10301]: cluster 2020-11-16T22:08:27.705401+0000 mgr.x (mgr.24115) 475 : cluster [DBG] pgmap v886: 17 pgs: 17 active+clean; 131 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 4.8 MiB/s wr, 21 op/s 2020-11-16T22:08:29.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:29 smithi057 bash[10301]: cluster 2020-11-16T22:08:28.036968+0000 mon.a (mon.0) 1135 : cluster [DBG] osdmap e482: 12 total, 12 up, 12 in 2020-11-16T22:08:30.019 INFO:tasks.rados.rados.2.smithi057.stdout:1702: done (0 left) 2020-11-16T22:08:30.020 INFO:tasks.rados.rados.2.smithi057.stdout:1703: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:08:30.020 INFO:tasks.rados.rados.2.smithi057.stdout:1703: expect (ObjNum 340 snap 115 seq_num 340) 2020-11-16T22:08:30.020 INFO:tasks.rados.rados.2.smithi057.stdout:1704: read oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:08:30.020 INFO:tasks.rados.rados.2.smithi057.stdout:1704: expect deleted 2020-11-16T22:08:30.020 INFO:tasks.rados.rados.2.smithi057.stdout:1705: rollback oid 24 current snap is 206 2020-11-16T22:08:30.020 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 24 to 198 2020-11-16T22:08:30.020 INFO:tasks.rados.rados.2.smithi057.stdout:1706: copy_from oid 2 from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 206 2020-11-16T22:08:30.021 INFO:tasks.rados.rados.2.smithi057.stdout:1707: write (excl) oid 40 current snap is 206 2020-11-16T22:08:30.021 INFO:tasks.rados.rados.2.smithi057.stdout:1707: seq_num 574 ranges {447218=719401,1889370=660531,2963386=614253} 2020-11-16T22:08:30.032 INFO:tasks.rados.rados.2.smithi057.stdout:1707: writing smithi05720651-40 from 447218 to 1166619 tid 1 2020-11-16T22:08:30.040 INFO:tasks.rados.rados.2.smithi057.stdout:1707: writing smithi05720651-40 from 1889370 to 2549901 tid 2 2020-11-16T22:08:30.046 INFO:tasks.rados.rados.2.smithi057.stdout:1707: writing smithi05720651-40 from 2963386 to 3577639 tid 3 2020-11-16T22:08:30.046 INFO:tasks.rados.rados.2.smithi057.stdout:1708: snap_remove snap 204 2020-11-16T22:08:30.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:30 smithi016 bash[10302]: cluster 2020-11-16T22:08:29.047052+0000 mon.a (mon.0) 1136 : cluster [DBG] osdmap e483: 12 total, 12 up, 12 in 2020-11-16T22:08:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:30 smithi016 bash[10302]: audit 2020-11-16T22:08:29.749440+0000 mon.b (mon.1) 297 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:08:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:30 smithi016 bash[10302]: audit 2020-11-16T22:08:29.750931+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:08:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:30 smithi016 bash[10302]: audit 2020-11-16T22:08:29.753022+0000 mon.b (mon.1) 298 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:08:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:30 smithi016 bash[10302]: audit 2020-11-16T22:08:29.754428+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:08:30.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:30 smithi016 bash[10302]: cluster 2020-11-16T22:08:30.023542+0000 mon.a (mon.0) 1139 : cluster [DBG] osdmap e484: 12 total, 12 up, 12 in 2020-11-16T22:08:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:30 smithi195 bash[10218]: cluster 2020-11-16T22:08:29.047052+0000 mon.a (mon.0) 1136 : cluster [DBG] osdmap e483: 12 total, 12 up, 12 in 2020-11-16T22:08:30.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:30 smithi195 bash[10218]: audit 2020-11-16T22:08:29.749440+0000 mon.b (mon.1) 297 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:08:30.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:30 smithi195 bash[10218]: audit 2020-11-16T22:08:29.750931+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:08:30.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:30 smithi195 bash[10218]: audit 2020-11-16T22:08:29.753022+0000 mon.b (mon.1) 298 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:08:30.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:30 smithi195 bash[10218]: audit 2020-11-16T22:08:29.754428+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:08:30.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:30 smithi195 bash[10218]: cluster 2020-11-16T22:08:30.023542+0000 mon.a (mon.0) 1139 : cluster [DBG] osdmap e484: 12 total, 12 up, 12 in 2020-11-16T22:08:30.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:30 smithi057 bash[10301]: cluster 2020-11-16T22:08:29.047052+0000 mon.a (mon.0) 1136 : cluster [DBG] osdmap e483: 12 total, 12 up, 12 in 2020-11-16T22:08:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:30 smithi057 bash[10301]: audit 2020-11-16T22:08:29.749440+0000 mon.b (mon.1) 297 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:08:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:30 smithi057 bash[10301]: audit 2020-11-16T22:08:29.750931+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:08:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:30 smithi057 bash[10301]: audit 2020-11-16T22:08:29.753022+0000 mon.b (mon.1) 298 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:08:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:30 smithi057 bash[10301]: audit 2020-11-16T22:08:29.754428+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:08:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:30 smithi057 bash[10301]: cluster 2020-11-16T22:08:30.023542+0000 mon.a (mon.0) 1139 : cluster [DBG] osdmap e484: 12 total, 12 up, 12 in 2020-11-16T22:08:31.058 INFO:tasks.rados.rados.2.smithi057.stdout:1708: done (5 left) 2020-11-16T22:08:31.058 INFO:tasks.rados.rados.2.smithi057.stdout:1709: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 206 2020-11-16T22:08:31.059 INFO:tasks.rados.rados.2.smithi057.stdout:1709: seq_num 575 ranges {464025=794650,1947852=404189,2990809=425525} 2020-11-16T22:08:31.069 INFO:tasks.rados.rados.2.smithi057.stdout:1709: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 464025 to 1258675 tid 1 2020-11-16T22:08:31.076 INFO:tasks.rados.rados.2.smithi057.stdout:1709: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1947852 to 2352041 tid 2 2020-11-16T22:08:31.082 INFO:tasks.rados.rados.2.smithi057.stdout:1709: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2990809 to 3416334 tid 3 2020-11-16T22:08:31.082 INFO:tasks.rados.rados.2.smithi057.stdout:1710: write (excl) oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 206 2020-11-16T22:08:31.082 INFO:tasks.rados.rados.2.smithi057.stdout:1710: seq_num 576 ranges {480832=469899,1606334=664200,3018232=662600} 2020-11-16T22:08:31.087 INFO:tasks.rados.rados.2.smithi057.stdout:1710: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 480832 to 950731 tid 1 2020-11-16T22:08:31.095 INFO:tasks.rados.rados.2.smithi057.stdout:1710: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1606334 to 2270534 tid 2 2020-11-16T22:08:31.103 INFO:tasks.rados.rados.2.smithi057.stdout:1710: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3018232 to 3680832 tid 3 2020-11-16T22:08:31.103 INFO:tasks.rados.rados.2.smithi057.stdout:1711: write (excl) oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 206 2020-11-16T22:08:31.103 INFO:tasks.rados.rados.2.smithi057.stdout:1711: seq_num 577 ranges {497639=545148,1548463=407858,2529302=564422,3528143=169496} 2020-11-16T22:08:31.109 INFO:tasks.rados.rados.2.smithi057.stdout:1711: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 497639 to 1042787 tid 1 2020-11-16T22:08:31.114 INFO:tasks.rados.rados.2.smithi057.stdout:1711: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1548463 to 1956321 tid 2 2020-11-16T22:08:31.120 INFO:tasks.rados.rados.2.smithi057.stdout:1711: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2529302 to 3093724 tid 3 2020-11-16T22:08:31.124 INFO:tasks.rados.rados.2.smithi057.stdout:1711: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3528143 to 3697639 tid 4 2020-11-16T22:08:31.124 INFO:tasks.rados.rados.2.smithi057.stdout:1712: copy_from oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 206 2020-11-16T22:08:31.124 INFO:tasks.rados.rados.2.smithi057.stdout:1705: finishing rollback tid 1 to smithi05720651-24 2020-11-16T22:08:31.125 INFO:tasks.rados.rados.2.smithi057.stdout:1713: snap_remove snap 205 2020-11-16T22:08:31.125 INFO:tasks.rados.rados.2.smithi057.stdout:1705: finishing rollback tid 2 to smithi05720651-24 2020-11-16T22:08:31.125 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 1186 (ObjNum 445 snap 150 seq_num 445) dirty exists 2020-11-16T22:08:31.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:31 smithi016 bash[10302]: cluster 2020-11-16T22:08:29.706128+0000 mgr.x (mgr.24115) 476 : cluster [DBG] pgmap v889: 17 pgs: 17 active+clean; 131 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2020-11-16T22:08:31.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:31 smithi195 bash[10218]: cluster 2020-11-16T22:08:29.706128+0000 mgr.x (mgr.24115) 476 : cluster [DBG] pgmap v889: 17 pgs: 17 active+clean; 131 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2020-11-16T22:08:31.349 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:08:31 smithi195 bash[18679]: debug 2020-11-16T22:08:31.097+0000 7f9945603700 -1 osd.1 pg_epoch: 485 pg[2.9( v 485'1536 (0'0,485'1536] local-lis/les=71/72 n=14 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,7] r=0 lpr=71 luod=485'1534 crt=485'1536 lcod 485'1533 mlcod 485'1533 active+clean+snaptrim trimq=[198~1] ps=[18b~2,191~1,193~1]] removing snap head 2020-11-16T22:08:31.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:31 smithi057 bash[10301]: cluster 2020-11-16T22:08:29.706128+0000 mgr.x (mgr.24115) 476 : cluster [DBG] pgmap v889: 17 pgs: 17 active+clean; 131 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.4 MiB/s wr, 12 op/s 2020-11-16T22:08:32.081 INFO:tasks.rados.rados.2.smithi057.stdout:1705: done (9 left) 2020-11-16T22:08:32.081 INFO:tasks.rados.rados.2.smithi057.stdout:1713: done (8 left) 2020-11-16T22:08:32.081 INFO:tasks.rados.rados.2.smithi057.stdout:1714: read oid 38 snap -1 2020-11-16T22:08:32.082 INFO:tasks.rados.rados.2.smithi057.stdout:1714: expect deleted 2020-11-16T22:08:32.082 INFO:tasks.rados.rados.2.smithi057.stdout:1715: delete oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 206 2020-11-16T22:08:32.082 INFO:tasks.rados.rados.2.smithi057.stdout:1703: expect (ObjNum 340 snap 115 seq_num 340) 2020-11-16T22:08:32.241 INFO:tasks.rados.rados.2.smithi057.stdout:1707: finishing write tid 1 to smithi05720651-40 2020-11-16T22:08:32.241 INFO:tasks.rados.rados.2.smithi057.stdout:1706: finishing copy_from to smithi05720651-2 2020-11-16T22:08:32.241 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 1326 (ObjNum 564 snap 204 seq_num 564) dirty exists 2020-11-16T22:08:32.242 INFO:tasks.rados.rados.2.smithi057.stdout:1706: finishing copy_from racing read to smithi05720651-2 2020-11-16T22:08:32.242 INFO:tasks.rados.rados.2.smithi057.stdout:1707: finishing write tid 2 to smithi05720651-40 2020-11-16T22:08:32.242 INFO:tasks.rados.rados.2.smithi057.stdout:1707: finishing write tid 3 to smithi05720651-40 2020-11-16T22:08:32.242 INFO:tasks.rados.rados.2.smithi057.stdout:1707: finishing write tid 5 to smithi05720651-40 2020-11-16T22:08:32.242 INFO:tasks.rados.rados.2.smithi057.stdout:1707: finishing write tid 6 to smithi05720651-40 2020-11-16T22:08:32.242 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 1526 (ObjNum 574 snap 206 seq_num 574) dirty exists 2020-11-16T22:08:32.243 INFO:tasks.rados.rados.2.smithi057.stdout:1707: left oid 40 (ObjNum 574 snap 206 seq_num 574) 2020-11-16T22:08:32.243 INFO:tasks.rados.rados.2.smithi057.stdout:1709: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.243 INFO:tasks.rados.rados.2.smithi057.stdout:1709: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.243 INFO:tasks.rados.rados.2.smithi057.stdout:1709: finishing write tid 3 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.243 INFO:tasks.rados.rados.2.smithi057.stdout:1709: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.243 INFO:tasks.rados.rados.2.smithi057.stdout:1709: finishing write tid 6 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.243 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1534 (ObjNum 575 snap 206 seq_num 575) dirty exists 2020-11-16T22:08:32.244 INFO:tasks.rados.rados.2.smithi057.stdout:1709: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 575 snap 206 seq_num 575) 2020-11-16T22:08:32.244 INFO:tasks.rados.rados.2.smithi057.stdout:1710: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.244 INFO:tasks.rados.rados.2.smithi057.stdout:1710: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.244 INFO:tasks.rados.rados.2.smithi057.stdout:1710: finishing write tid 3 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.244 INFO:tasks.rados.rados.2.smithi057.stdout:1710: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.244 INFO:tasks.rados.rados.2.smithi057.stdout:1710: finishing write tid 6 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.244 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1478 (ObjNum 576 snap 206 seq_num 576) dirty exists 2020-11-16T22:08:32.245 INFO:tasks.rados.rados.2.smithi057.stdout:1710: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 576 snap 206 seq_num 576) 2020-11-16T22:08:32.245 INFO:tasks.rados.rados.2.smithi057.stdout:1711: finishing write tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.245 INFO:tasks.rados.rados.2.smithi057.stdout:1711: finishing write tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.245 INFO:tasks.rados.rados.2.smithi057.stdout:1703: done (9 left) 2020-11-16T22:08:32.245 INFO:tasks.rados.rados.2.smithi057.stdout:1704: done (8 left) 2020-11-16T22:08:32.245 INFO:tasks.rados.rados.2.smithi057.stdout:1706: done (7 left) 2020-11-16T22:08:32.245 INFO:tasks.rados.rados.2.smithi057.stdout:1707: done (6 left) 2020-11-16T22:08:32.246 INFO:tasks.rados.rados.2.smithi057.stdout:1709: done (5 left) 2020-11-16T22:08:32.246 INFO:tasks.rados.rados.2.smithi057.stdout:1710: done (4 left) 2020-11-16T22:08:32.246 INFO:tasks.rados.rados.2.smithi057.stdout:1715: done (3 left) 2020-11-16T22:08:32.246 INFO:tasks.rados.rados.2.smithi057.stdout:1716: delete oid 46 current snap is 206 2020-11-16T22:08:32.246 INFO:tasks.rados.rados.2.smithi057.stdout:1711: finishing write tid 3 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.246 INFO:tasks.rados.rados.2.smithi057.stdout:1711: finishing write tid 4 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.246 INFO:tasks.rados.rados.2.smithi057.stdout:1711: finishing write tid 6 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.247 INFO:tasks.rados.rados.2.smithi057.stdout:1711: finishing write tid 7 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.247 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1331 (ObjNum 577 snap 206 seq_num 577) dirty exists 2020-11-16T22:08:32.247 INFO:tasks.rados.rados.2.smithi057.stdout:1711: left oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 577 snap 206 seq_num 577) 2020-11-16T22:08:32.247 INFO:tasks.rados.rados.2.smithi057.stdout:1712: finishing copy_from to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.247 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1517 (ObjNum 505 snap 177 seq_num 505) dirty exists 2020-11-16T22:08:32.247 INFO:tasks.rados.rados.2.smithi057.stdout:1712: finishing copy_from racing read to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:32.248 INFO:tasks.rados.rados.2.smithi057.stdout:1711: done (3 left) 2020-11-16T22:08:32.248 INFO:tasks.rados.rados.2.smithi057.stdout:1712: done (2 left) 2020-11-16T22:08:32.248 INFO:tasks.rados.rados.2.smithi057.stdout:1714: done (1 left) 2020-11-16T22:08:32.248 INFO:tasks.rados.rados.2.smithi057.stdout:1716: done (0 left) 2020-11-16T22:08:32.248 INFO:tasks.rados.rados.2.smithi057.stdout:1717: write (excl) oid 22 current snap is 206 2020-11-16T22:08:32.249 INFO:tasks.rados.rados.2.smithi057.stdout:1717: seq_num 580 ranges {548060=487248,1440262=671538,2844277=798238} 2020-11-16T22:08:32.257 INFO:tasks.rados.rados.2.smithi057.stdout:1717: writing smithi05720651-22 from 548060 to 1035308 tid 1 2020-11-16T22:08:32.264 INFO:tasks.rados.rados.2.smithi057.stdout:1717: writing smithi05720651-22 from 1440262 to 2111800 tid 2 2020-11-16T22:08:32.273 INFO:tasks.rados.rados.2.smithi057.stdout:1717: writing smithi05720651-22 from 2844277 to 3642515 tid 3 2020-11-16T22:08:32.273 INFO:tasks.rados.rados.2.smithi057.stdout:1718: write (excl) oid 26 current snap is 206 2020-11-16T22:08:32.273 INFO:tasks.rados.rados.2.smithi057.stdout:1718: seq_num 581 ranges {564867=562497,1898744=415196,2755347=725863} 2020-11-16T22:08:32.279 INFO:tasks.rados.rados.2.smithi057.stdout:1718: writing smithi05720651-26 from 564867 to 1127364 tid 1 2020-11-16T22:08:32.286 INFO:tasks.rados.rados.2.smithi057.stdout:1718: writing smithi05720651-26 from 1898744 to 2313940 tid 2 2020-11-16T22:08:32.293 INFO:tasks.rados.rados.2.smithi057.stdout:1718: writing smithi05720651-26 from 2755347 to 3481210 tid 3 2020-11-16T22:08:32.293 INFO:tasks.rados.rados.2.smithi057.stdout:1719: snap_create 2020-11-16T22:08:32.293 INFO:tasks.rados.rados.2.smithi057.stdout:1717: finishing write tid 1 to smithi05720651-22 2020-11-16T22:08:32.293 INFO:tasks.rados.rados.2.smithi057.stdout:1717: finishing write tid 2 to smithi05720651-22 2020-11-16T22:08:32.294 INFO:tasks.rados.rados.2.smithi057.stdout:1717: finishing write tid 3 to smithi05720651-22 2020-11-16T22:08:32.294 INFO:tasks.rados.rados.2.smithi057.stdout:1717: finishing write tid 5 to smithi05720651-22 2020-11-16T22:08:32.294 INFO:tasks.rados.rados.2.smithi057.stdout:1717: finishing write tid 6 to smithi05720651-22 2020-11-16T22:08:32.294 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 893 (ObjNum 580 snap 206 seq_num 580) dirty exists 2020-11-16T22:08:32.294 INFO:tasks.rados.rados.2.smithi057.stdout:1717: left oid 22 (ObjNum 580 snap 206 seq_num 580) 2020-11-16T22:08:32.295 INFO:tasks.rados.rados.2.smithi057.stdout:1718: finishing write tid 1 to smithi05720651-26 2020-11-16T22:08:32.301 INFO:tasks.rados.rados.2.smithi057.stdout:1718: finishing write tid 2 to smithi05720651-26 2020-11-16T22:08:32.302 INFO:tasks.rados.rados.2.smithi057.stdout:1718: finishing write tid 3 to smithi05720651-26 2020-11-16T22:08:32.303 INFO:tasks.rados.rados.2.smithi057.stdout:1718: finishing write tid 5 to smithi05720651-26 2020-11-16T22:08:32.303 INFO:tasks.rados.rados.2.smithi057.stdout:1718: finishing write tid 6 to smithi05720651-26 2020-11-16T22:08:32.303 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 1549 (ObjNum 581 snap 206 seq_num 581) dirty exists 2020-11-16T22:08:32.304 INFO:tasks.rados.rados.2.smithi057.stdout:1718: left oid 26 (ObjNum 581 snap 206 seq_num 581) 2020-11-16T22:08:32.507 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:32 smithi195 bash[10218]: cluster 2020-11-16T22:08:31.064251+0000 mon.a (mon.0) 1140 : cluster [DBG] osdmap e485: 12 total, 12 up, 12 in 2020-11-16T22:08:32.507 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:32 smithi016 bash[10302]: cluster 2020-11-16T22:08:31.064251+0000 mon.a (mon.0) 1140 : cluster [DBG] osdmap e485: 12 total, 12 up, 12 in 2020-11-16T22:08:32.507 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:32 smithi057 bash[10301]: cluster 2020-11-16T22:08:31.064251+0000 mon.a (mon.0) 1140 : cluster [DBG] osdmap e485: 12 total, 12 up, 12 in 2020-11-16T22:08:33.086 INFO:tasks.rados.rados.2.smithi057.stdout:1717: done (2 left) 2020-11-16T22:08:33.087 INFO:tasks.rados.rados.2.smithi057.stdout:1718: done (1 left) 2020-11-16T22:08:33.087 INFO:tasks.rados.rados.2.smithi057.stdout:1719: done (0 left) 2020-11-16T22:08:33.087 INFO:tasks.rados.rados.2.smithi057.stdout:1720: write oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 207 2020-11-16T22:08:33.087 INFO:tasks.rados.rados.2.smithi057.stdout:1720: seq_num 582 ranges {581674=637746,1840873=558854,3066417=537135} 2020-11-16T22:08:33.098 INFO:tasks.rados.rados.2.smithi057.stdout:1720: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 581674 to 1219420 tid 1 2020-11-16T22:08:33.105 INFO:tasks.rados.rados.2.smithi057.stdout:1720: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1840873 to 2399727 tid 2 2020-11-16T22:08:33.113 INFO:tasks.rados.rados.2.smithi057.stdout:1720: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3066417 to 3603552 tid 3 2020-11-16T22:08:33.113 INFO:tasks.rados.rados.2.smithi057.stdout:1721: write oid 4 current snap is 207 2020-11-16T22:08:33.113 INFO:tasks.rados.rados.2.smithi057.stdout:1721: seq_num 583 ranges {598481=712995,1899355=418865,3093840=704641} 2020-11-16T22:08:33.120 INFO:tasks.rados.rados.2.smithi057.stdout:1721: writing smithi05720651-4 from 598481 to 1311476 tid 1 2020-11-16T22:08:33.126 INFO:tasks.rados.rados.2.smithi057.stdout:1721: writing smithi05720651-4 from 1899355 to 2318220 tid 2 2020-11-16T22:08:33.135 INFO:tasks.rados.rados.2.smithi057.stdout:1721: writing smithi05720651-4 from 3093840 to 3798481 tid 3 2020-11-16T22:08:33.135 INFO:tasks.rados.rados.2.smithi057.stdout:1722: rollback oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 207 2020-11-16T22:08:33.135 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 198 2020-11-16T22:08:33.136 INFO:tasks.rados.rados.2.smithi057.stdout:1720: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:33.136 INFO:tasks.rados.rados.2.smithi057.stdout:1723: copy_from oid 10 from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 207 2020-11-16T22:08:33.136 INFO:tasks.rados.rados.2.smithi057.stdout:1720: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:33.136 INFO:tasks.rados.rados.2.smithi057.stdout:1720: finishing write tid 3 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:33.136 INFO:tasks.rados.rados.2.smithi057.stdout:1720: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:33.136 INFO:tasks.rados.rados.2.smithi057.stdout:1720: finishing write tid 6 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:33.137 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1305 (ObjNum 582 snap 207 seq_num 582) dirty exists 2020-11-16T22:08:33.137 INFO:tasks.rados.rados.2.smithi057.stdout:1720: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 582 snap 207 seq_num 582) 2020-11-16T22:08:33.137 INFO:tasks.rados.rados.2.smithi057.stdout:1721: finishing write tid 1 to smithi05720651-4 2020-11-16T22:08:33.137 INFO:tasks.rados.rados.2.smithi057.stdout:1721: finishing write tid 2 to smithi05720651-4 2020-11-16T22:08:33.137 INFO:tasks.rados.rados.2.smithi057.stdout:1720: done (3 left) 2020-11-16T22:08:33.137 INFO:tasks.rados.rados.2.smithi057.stdout:1724: delete oid 24 current snap is 207 2020-11-16T22:08:33.139 INFO:tasks.rados.rados.2.smithi057.stdout:1722: finishing rollback tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:33.139 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 33 snap 0 seq_num 1131374913) dirty dne 2020-11-16T22:08:33.140 INFO:tasks.rados.rados.2.smithi057.stdout:1722: done (3 left) 2020-11-16T22:08:33.140 INFO:tasks.rados.rados.2.smithi057.stdout:1724: done (2 left) 2020-11-16T22:08:33.140 INFO:tasks.rados.rados.2.smithi057.stdout:1725: read oid 18 snap -1 2020-11-16T22:08:33.141 INFO:tasks.rados.rados.2.smithi057.stdout:1725: expect (ObjNum 562 snap 203 seq_num 562) 2020-11-16T22:08:33.141 INFO:tasks.rados.rados.2.smithi057.stdout:1726: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:08:33.141 INFO:tasks.rados.rados.2.smithi057.stdout:1726: expect (ObjNum 505 snap 177 seq_num 505) 2020-11-16T22:08:33.141 INFO:tasks.rados.rados.2.smithi057.stdout:1727: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:08:33.141 INFO:tasks.rados.rados.2.smithi057.stdout:1727: expect (ObjNum 522 snap 188 seq_num 522) 2020-11-16T22:08:33.141 INFO:tasks.rados.rados.2.smithi057.stdout:1728: snap_remove snap 198 2020-11-16T22:08:33.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:33 smithi016 bash[10302]: cluster 2020-11-16T22:08:31.706821+0000 mgr.x (mgr.24115) 477 : cluster [DBG] pgmap v892: 17 pgs: 17 active+clean; 138 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 2.5 MiB/s wr, 13 op/s 2020-11-16T22:08:33.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:33 smithi016 bash[10302]: cluster 2020-11-16T22:08:32.085639+0000 mon.a (mon.0) 1141 : cluster [DBG] osdmap e486: 12 total, 12 up, 12 in 2020-11-16T22:08:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:33 smithi195 bash[10218]: cluster 2020-11-16T22:08:31.706821+0000 mgr.x (mgr.24115) 477 : cluster [DBG] pgmap v892: 17 pgs: 17 active+clean; 138 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 2.5 MiB/s wr, 13 op/s 2020-11-16T22:08:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:33 smithi195 bash[10218]: cluster 2020-11-16T22:08:32.085639+0000 mon.a (mon.0) 1141 : cluster [DBG] osdmap e486: 12 total, 12 up, 12 in 2020-11-16T22:08:33.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:33 smithi057 bash[10301]: cluster 2020-11-16T22:08:31.706821+0000 mgr.x (mgr.24115) 477 : cluster [DBG] pgmap v892: 17 pgs: 17 active+clean; 138 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 2.5 MiB/s wr, 13 op/s 2020-11-16T22:08:33.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:33 smithi057 bash[10301]: cluster 2020-11-16T22:08:32.085639+0000 mon.a (mon.0) 1141 : cluster [DBG] osdmap e486: 12 total, 12 up, 12 in 2020-11-16T22:08:34.094 INFO:tasks.rados.rados.2.smithi057.stdout:1728: done (5 left) 2020-11-16T22:08:34.095 INFO:tasks.rados.rados.2.smithi057.stdout:1729: read oid 20 snap 202 2020-11-16T22:08:34.095 INFO:tasks.rados.rados.2.smithi057.stdout:1729: expect (ObjNum 544 snap 196 seq_num 544) 2020-11-16T22:08:34.095 INFO:tasks.rados.rados.2.smithi057.stdout:1730: snap_remove snap 206 2020-11-16T22:08:34.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:34 smithi195 bash[10218]: cluster 2020-11-16T22:08:33.094621+0000 mon.a (mon.0) 1142 : cluster [DBG] osdmap e487: 12 total, 12 up, 12 in 2020-11-16T22:08:34.357 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:34 smithi016 bash[10302]: cluster 2020-11-16T22:08:33.094621+0000 mon.a (mon.0) 1142 : cluster [DBG] osdmap e487: 12 total, 12 up, 12 in 2020-11-16T22:08:34.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:34 smithi057 bash[10301]: cluster 2020-11-16T22:08:33.094621+0000 mon.a (mon.0) 1142 : cluster [DBG] osdmap e487: 12 total, 12 up, 12 in 2020-11-16T22:08:34.837 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 22:08:34 smithi016 bash[17468]: debug 2020-11-16T22:08:34.364+0000 7fd6636dc700 -1 osd.6 pg_epoch: 488 pg[2.7( v 482'539 (0'0,482'539] local-lis/les=71/72 n=6 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [6,10] r=0 lpr=71 crt=482'539 lcod 481'537 mlcod 481'537 active+clean+snaptrim trimq=[18a~1] ps=[18b~2,191~1,193~1,198~2]] removing snap head 2020-11-16T22:08:34.838 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 22:08:34 smithi016 bash[17468]: debug 2020-11-16T22:08:34.372+0000 7fd6636dc700 -1 osd.6 pg_epoch: 488 pg[2.7( v 488'543 (0'0,488'543] local-lis/les=71/72 n=3 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [6,10] r=0 lpr=71 crt=488'543 lcod 488'541 mlcod 488'541 active+clean+snaptrim trimq=[18a~1] ps=[18b~2,191~1,193~1,198~2]] removing snap head 2020-11-16T22:08:35.018 INFO:tasks.rados.rados.2.smithi057.stdout:1730: done (6 left) 2020-11-16T22:08:35.018 INFO:tasks.rados.rados.2.smithi057.stdout:1731: write oid 30 current snap is 207 2020-11-16T22:08:35.019 INFO:tasks.rados.rados.2.smithi057.stdout:1731: seq_num 585 ranges {632095=463493,1616319=422534,2748686=487304} 2020-11-16T22:08:35.033 INFO:tasks.rados.rados.2.smithi057.stdout:1731: writing smithi05720651-30 from 632095 to 1095588 tid 1 2020-11-16T22:08:35.038 INFO:tasks.rados.rados.2.smithi057.stdout:1731: writing smithi05720651-30 from 1616319 to 2038853 tid 2 2020-11-16T22:08:35.046 INFO:tasks.rados.rados.2.smithi057.stdout:1731: writing smithi05720651-30 from 2748686 to 3235990 tid 3 2020-11-16T22:08:35.046 INFO:tasks.rados.rados.2.smithi057.stdout:1732: rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 207 2020-11-16T22:08:35.046 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 202 2020-11-16T22:08:35.047 INFO:tasks.rados.rados.2.smithi057.stdout:1721: finishing write tid 3 to smithi05720651-4 2020-11-16T22:08:35.047 INFO:tasks.rados.rados.2.smithi057.stdout:1733: read oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:08:35.047 INFO:tasks.rados.rados.2.smithi057.stdout:1733: expect deleted 2020-11-16T22:08:35.047 INFO:tasks.rados.rados.2.smithi057.stdout:1734: read oid 22 snap -1 2020-11-16T22:08:35.047 INFO:tasks.rados.rados.2.smithi057.stdout:1734: expect (ObjNum 580 snap 206 seq_num 580) 2020-11-16T22:08:35.047 INFO:tasks.rados.rados.2.smithi057.stdout:1735: read oid 14 snap -1 2020-11-16T22:08:35.048 INFO:tasks.rados.rados.2.smithi057.stdout:1735: expect (ObjNum 502 snap 177 seq_num 502) 2020-11-16T22:08:35.048 INFO:tasks.rados.rados.2.smithi057.stdout:1736: read oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:08:35.048 INFO:tasks.rados.rados.2.smithi057.stdout:1736: expect deleted 2020-11-16T22:08:35.048 INFO:tasks.rados.rados.2.smithi057.stdout:1737: write oid 40 current snap is 207 2020-11-16T22:08:35.048 INFO:tasks.rados.rados.2.smithi057.stdout:1721: finishing write tid 5 to smithi05720651-4 2020-11-16T22:08:35.048 INFO:tasks.rados.rados.2.smithi057.stdout:1721: finishing write tid 6 to smithi05720651-4 2020-11-16T22:08:35.048 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 1091 (ObjNum 583 snap 207 seq_num 583) dirty exists 2020-11-16T22:08:35.049 INFO:tasks.rados.rados.2.smithi057.stdout:1721: left oid 4 (ObjNum 583 snap 207 seq_num 583) 2020-11-16T22:08:35.049 INFO:tasks.rados.rados.2.smithi057.stdout:1727: expect (ObjNum 522 snap 188 seq_num 522) 2020-11-16T22:08:35.180 INFO:tasks.rados.rados.2.smithi057.stdout:1737: seq_num 586 ranges {648902=655095,2074801=566192,3176109=672793} 2020-11-16T22:08:35.188 INFO:tasks.rados.rados.2.smithi057.stdout:1737: writing smithi05720651-40 from 648902 to 1303997 tid 1 2020-11-16T22:08:35.197 INFO:tasks.rados.rados.2.smithi057.stdout:1737: writing smithi05720651-40 from 2074801 to 2640993 tid 2 2020-11-16T22:08:35.204 INFO:tasks.rados.rados.2.smithi057.stdout:1737: writing smithi05720651-40 from 3176109 to 3848902 tid 3 2020-11-16T22:08:35.204 INFO:tasks.rados.rados.2.smithi057.stdout:1721: done (12 left) 2020-11-16T22:08:35.204 INFO:tasks.rados.rados.2.smithi057.stdout:1727: done (11 left) 2020-11-16T22:08:35.204 INFO:tasks.rados.rados.2.smithi057.stdout:1738: read oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:08:35.205 INFO:tasks.rados.rados.2.smithi057.stdout:1738: expect deleted 2020-11-16T22:08:35.205 INFO:tasks.rados.rados.2.smithi057.stdout:1739: write (excl) oid 36 current snap is 207 2020-11-16T22:08:35.205 INFO:tasks.rados.rados.2.smithi057.stdout:1739: seq_num 587 ranges {665709=730344,2133283=426203,3203532=509848} 2020-11-16T22:08:35.211 INFO:tasks.rados.rados.2.smithi057.stdout:1739: writing smithi05720651-36 from 665709 to 1396053 tid 1 2020-11-16T22:08:35.218 INFO:tasks.rados.rados.2.smithi057.stdout:1739: writing smithi05720651-36 from 2133283 to 2559486 tid 2 2020-11-16T22:08:35.225 INFO:tasks.rados.rados.2.smithi057.stdout:1739: writing smithi05720651-36 from 3203532 to 3713380 tid 3 2020-11-16T22:08:35.225 INFO:tasks.rados.rados.2.smithi057.stdout:1740: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:08:35.225 INFO:tasks.rados.rados.2.smithi057.stdout:1740: expect (ObjNum 340 snap 115 seq_num 340) 2020-11-16T22:08:35.225 INFO:tasks.rados.rados.2.smithi057.stdout:1741: rollback oid 2 current snap is 207 2020-11-16T22:08:35.225 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 2 to 202 2020-11-16T22:08:35.226 INFO:tasks.rados.rados.2.smithi057.stdout:1723: finishing copy_from to smithi05720651-10 2020-11-16T22:08:35.226 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 962 (ObjNum 525 snap 188 seq_num 525) dirty exists 2020-11-16T22:08:35.226 INFO:tasks.rados.rados.2.smithi057.stdout:1723: finishing copy_from racing read to smithi05720651-10 2020-11-16T22:08:35.226 INFO:tasks.rados.rados.2.smithi057.stdout:1726: expect (ObjNum 505 snap 177 seq_num 505) 2020-11-16T22:08:35.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:35 smithi195 bash[10218]: cluster 2020-11-16T22:08:33.707497+0000 mgr.x (mgr.24115) 478 : cluster [DBG] pgmap v895: 17 pgs: 17 active+clean; 138 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2020-11-16T22:08:35.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:35 smithi195 bash[10218]: cluster 2020-11-16T22:08:34.105712+0000 mon.a (mon.0) 1143 : cluster [DBG] osdmap e488: 12 total, 12 up, 12 in 2020-11-16T22:08:35.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:35 smithi195 bash[10218]: cluster 2020-11-16T22:08:35.028314+0000 mon.a (mon.0) 1144 : cluster [DBG] osdmap e489: 12 total, 12 up, 12 in 2020-11-16T22:08:35.363 INFO:tasks.rados.rados.2.smithi057.stdout:1725: expect (ObjNum 562 snap 203 seq_num 562) 2020-11-16T22:08:35.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:35 smithi057 bash[10301]: cluster 2020-11-16T22:08:33.707497+0000 mgr.x (mgr.24115) 478 : cluster [DBG] pgmap v895: 17 pgs: 17 active+clean; 138 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2020-11-16T22:08:35.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:35 smithi057 bash[10301]: cluster 2020-11-16T22:08:34.105712+0000 mon.a (mon.0) 1143 : cluster [DBG] osdmap e488: 12 total, 12 up, 12 in 2020-11-16T22:08:35.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:35 smithi057 bash[10301]: cluster 2020-11-16T22:08:35.028314+0000 mon.a (mon.0) 1144 : cluster [DBG] osdmap e489: 12 total, 12 up, 12 in 2020-11-16T22:08:35.466 INFO:tasks.rados.rados.2.smithi057.stdout:1729: expect (ObjNum 544 snap 196 seq_num 544) 2020-11-16T22:08:35.558 INFO:tasks.rados.rados.2.smithi057.stdout:1731: finishing write tid 1 to smithi05720651-30 2020-11-16T22:08:35.558 INFO:tasks.rados.rados.2.smithi057.stdout:1723: done (14 left) 2020-11-16T22:08:35.559 INFO:tasks.rados.rados.2.smithi057.stdout:1725: done (13 left) 2020-11-16T22:08:35.559 INFO:tasks.rados.rados.2.smithi057.stdout:1726: done (12 left) 2020-11-16T22:08:35.559 INFO:tasks.rados.rados.2.smithi057.stdout:1729: done (11 left) 2020-11-16T22:08:35.559 INFO:tasks.rados.rados.2.smithi057.stdout:1742: read oid 44 snap 202 2020-11-16T22:08:35.559 INFO:tasks.rados.rados.2.smithi057.stdout:1742: expect deleted 2020-11-16T22:08:35.559 INFO:tasks.rados.rados.2.smithi057.stdout:1743: write (excl) oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 207 2020-11-16T22:08:35.560 INFO:tasks.rados.rados.2.smithi057.stdout:1743: seq_num 588 ranges {682516=405593,1791765=569861,2830955=721120} 2020-11-16T22:08:35.564 INFO:tasks.rados.rados.2.smithi057.stdout:1743: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 682516 to 1088109 tid 1 2020-11-16T22:08:35.572 INFO:tasks.rados.rados.2.smithi057.stdout:1743: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1791765 to 2361626 tid 2 2020-11-16T22:08:35.580 INFO:tasks.rados.rados.2.smithi057.stdout:1743: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2830955 to 3552075 tid 3 2020-11-16T22:08:35.580 INFO:tasks.rados.rados.2.smithi057.stdout:1744: delete oid 32 current snap is 207 2020-11-16T22:08:35.580 INFO:tasks.rados.rados.2.smithi057.stdout:1731: finishing write tid 2 to smithi05720651-30 2020-11-16T22:08:35.581 INFO:tasks.rados.rados.2.smithi057.stdout:1731: finishing write tid 3 to smithi05720651-30 2020-11-16T22:08:35.581 INFO:tasks.rados.rados.2.smithi057.stdout:1731: finishing write tid 5 to smithi05720651-30 2020-11-16T22:08:35.581 INFO:tasks.rados.rados.2.smithi057.stdout:1731: finishing write tid 6 to smithi05720651-30 2020-11-16T22:08:35.581 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 1336 (ObjNum 585 snap 207 seq_num 585) dirty exists 2020-11-16T22:08:35.581 INFO:tasks.rados.rados.2.smithi057.stdout:1731: left oid 30 (ObjNum 585 snap 207 seq_num 585) 2020-11-16T22:08:35.581 INFO:tasks.rados.rados.2.smithi057.stdout:1732: finishing rollback tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:35.581 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 129 snap 0 seq_num 2932578464) dirty dne 2020-11-16T22:08:35.582 INFO:tasks.rados.rados.2.smithi057.stdout:1734: expect (ObjNum 580 snap 206 seq_num 580) 2020-11-16T22:08:35.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:35 smithi016 bash[10302]: cluster 2020-11-16T22:08:33.707497+0000 mgr.x (mgr.24115) 478 : cluster [DBG] pgmap v895: 17 pgs: 17 active+clean; 138 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2020-11-16T22:08:35.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:35 smithi016 bash[10302]: cluster 2020-11-16T22:08:34.105712+0000 mon.a (mon.0) 1143 : cluster [DBG] osdmap e488: 12 total, 12 up, 12 in 2020-11-16T22:08:35.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:35 smithi016 bash[10302]: cluster 2020-11-16T22:08:35.028314+0000 mon.a (mon.0) 1144 : cluster [DBG] osdmap e489: 12 total, 12 up, 12 in 2020-11-16T22:08:35.735 INFO:tasks.rados.rados.2.smithi057.stdout:1735: expect (ObjNum 502 snap 177 seq_num 502) 2020-11-16T22:08:35.840 INFO:tasks.rados.rados.2.smithi057.stdout:1737: finishing write tid 1 to smithi05720651-40 2020-11-16T22:08:35.840 INFO:tasks.rados.rados.2.smithi057.stdout:1737: finishing write tid 2 to smithi05720651-40 2020-11-16T22:08:35.840 INFO:tasks.rados.rados.2.smithi057.stdout:1731: done (13 left) 2020-11-16T22:08:35.840 INFO:tasks.rados.rados.2.smithi057.stdout:1732: done (12 left) 2020-11-16T22:08:35.841 INFO:tasks.rados.rados.2.smithi057.stdout:1733: done (11 left) 2020-11-16T22:08:35.841 INFO:tasks.rados.rados.2.smithi057.stdout:1734: done (10 left) 2020-11-16T22:08:35.841 INFO:tasks.rados.rados.2.smithi057.stdout:1735: done (9 left) 2020-11-16T22:08:35.841 INFO:tasks.rados.rados.2.smithi057.stdout:1736: done (8 left) 2020-11-16T22:08:35.841 INFO:tasks.rados.rados.2.smithi057.stdout:1744: done (7 left) 2020-11-16T22:08:35.841 INFO:tasks.rados.rados.2.smithi057.stdout:1745: copy_from oid 22 from oid 4 current snap is 207 2020-11-16T22:08:35.841 INFO:tasks.rados.rados.2.smithi057.stdout:1737: finishing write tid 3 to smithi05720651-40 2020-11-16T22:08:35.842 INFO:tasks.rados.rados.2.smithi057.stdout:1737: finishing write tid 5 to smithi05720651-40 2020-11-16T22:08:35.842 INFO:tasks.rados.rados.2.smithi057.stdout:1737: finishing write tid 6 to smithi05720651-40 2020-11-16T22:08:35.842 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 1563 (ObjNum 586 snap 207 seq_num 586) dirty exists 2020-11-16T22:08:35.842 INFO:tasks.rados.rados.2.smithi057.stdout:1737: left oid 40 (ObjNum 586 snap 207 seq_num 586) 2020-11-16T22:08:35.842 INFO:tasks.rados.rados.2.smithi057.stdout:1739: finishing write tid 1 to smithi05720651-36 2020-11-16T22:08:35.842 INFO:tasks.rados.rados.2.smithi057.stdout:1739: finishing write tid 2 to smithi05720651-36 2020-11-16T22:08:35.842 INFO:tasks.rados.rados.2.smithi057.stdout:1739: finishing write tid 3 to smithi05720651-36 2020-11-16T22:08:35.843 INFO:tasks.rados.rados.2.smithi057.stdout:1739: finishing write tid 5 to smithi05720651-36 2020-11-16T22:08:35.843 INFO:tasks.rados.rados.2.smithi057.stdout:1739: finishing write tid 6 to smithi05720651-36 2020-11-16T22:08:35.843 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 1329 (ObjNum 587 snap 207 seq_num 587) dirty exists 2020-11-16T22:08:35.843 INFO:tasks.rados.rados.2.smithi057.stdout:1739: left oid 36 (ObjNum 587 snap 207 seq_num 587) 2020-11-16T22:08:35.843 INFO:tasks.rados.rados.2.smithi057.stdout:1740: expect (ObjNum 340 snap 115 seq_num 340) 2020-11-16T22:08:35.996 INFO:tasks.rados.rados.2.smithi057.stdout:1741: finishing rollback tid 0 to smithi05720651-2 2020-11-16T22:08:35.996 INFO:tasks.rados.rados.2.smithi057.stdout:1741: finishing rollback tid 1 to smithi05720651-2 2020-11-16T22:08:35.996 INFO:tasks.rados.rados.2.smithi057.stdout:1741: finishing rollback tid 2 to smithi05720651-2 2020-11-16T22:08:35.996 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 1566 (ObjNum 496 snap 177 seq_num 496) dirty exists 2020-11-16T22:08:35.996 INFO:tasks.rados.rados.2.smithi057.stdout:1737: done (7 left) 2020-11-16T22:08:35.997 INFO:tasks.rados.rados.2.smithi057.stdout:1738: done (6 left) 2020-11-16T22:08:35.997 INFO:tasks.rados.rados.2.smithi057.stdout:1739: done (5 left) 2020-11-16T22:08:35.997 INFO:tasks.rados.rados.2.smithi057.stdout:1740: done (4 left) 2020-11-16T22:08:35.997 INFO:tasks.rados.rados.2.smithi057.stdout:1741: done (3 left) 2020-11-16T22:08:35.997 INFO:tasks.rados.rados.2.smithi057.stdout:1746: write oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 207 2020-11-16T22:08:35.997 INFO:tasks.rados.rados.2.smithi057.stdout:1746: seq_num 590 ranges {716130=556091,1792376=573530,2769448=460017,3821956=94174} 2020-11-16T22:08:36.002 INFO:tasks.rados.rados.2.smithi057.stdout:1746: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 716130 to 1272221 tid 1 2020-11-16T22:08:36.010 INFO:tasks.rados.rados.2.smithi057.stdout:1746: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1792376 to 2365906 tid 2 2020-11-16T22:08:36.015 INFO:tasks.rados.rados.2.smithi057.stdout:1746: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2769448 to 3229465 tid 3 2020-11-16T22:08:36.019 INFO:tasks.rados.rados.2.smithi057.stdout:1746: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3821956 to 3916130 tid 4 2020-11-16T22:08:36.019 INFO:tasks.rados.rados.2.smithi057.stdout:1747: write oid 16 current snap is 207 2020-11-16T22:08:36.019 INFO:tasks.rados.rados.2.smithi057.stdout:1747: seq_num 591 ranges {732937=631340,1850858=433541,2796871=671289,3888195=44742} 2020-11-16T22:08:36.026 INFO:tasks.rados.rados.2.smithi057.stdout:1747: writing smithi05720651-16 from 732937 to 1364277 tid 1 2020-11-16T22:08:36.031 INFO:tasks.rados.rados.2.smithi057.stdout:1747: writing smithi05720651-16 from 1850858 to 2284399 tid 2 2020-11-16T22:08:36.038 INFO:tasks.rados.rados.2.smithi057.stdout:1747: writing smithi05720651-16 from 2796871 to 3468160 tid 3 2020-11-16T22:08:36.041 INFO:tasks.rados.rados.2.smithi057.stdout:1747: writing smithi05720651-16 from 3888195 to 3932937 tid 4 2020-11-16T22:08:36.041 INFO:tasks.rados.rados.2.smithi057.stdout:1748: write (excl) oid 32 current snap is 207 2020-11-16T22:08:36.041 INFO:tasks.rados.rados.2.smithi057.stdout:1748: seq_num 592 ranges {749744=706589,1909340=577199,3224294=482561} 2020-11-16T22:08:36.049 INFO:tasks.rados.rados.2.smithi057.stdout:1748: writing smithi05720651-32 from 749744 to 1456333 tid 1 2020-11-16T22:08:36.054 INFO:tasks.rados.rados.2.smithi057.stdout:1748: writing smithi05720651-32 from 1909340 to 2486539 tid 2 2020-11-16T22:08:36.062 INFO:tasks.rados.rados.2.smithi057.stdout:1748: writing smithi05720651-32 from 3224294 to 3706855 tid 3 2020-11-16T22:08:36.062 INFO:tasks.rados.rados.2.smithi057.stdout:1749: read oid 12 snap -1 2020-11-16T22:08:36.062 INFO:tasks.rados.rados.2.smithi057.stdout:1749: expect deleted 2020-11-16T22:08:36.062 INFO:tasks.rados.rados.2.smithi057.stdout:1750: delete oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 207 2020-11-16T22:08:36.062 INFO:tasks.rados.rados.2.smithi057.stdout:1743: finishing write tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:36.063 INFO:tasks.rados.rados.2.smithi057.stdout:1743: finishing write tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:36.063 INFO:tasks.rados.rados.2.smithi057.stdout:1743: finishing write tid 3 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:36.063 INFO:tasks.rados.rados.2.smithi057.stdout:1743: finishing write tid 5 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:36.063 INFO:tasks.rados.rados.2.smithi057.stdout:1743: finishing write tid 6 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:36.063 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1340 (ObjNum 588 snap 207 seq_num 588) dirty exists 2020-11-16T22:08:36.063 INFO:tasks.rados.rados.2.smithi057.stdout:1743: left oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 588 snap 207 seq_num 588) 2020-11-16T22:08:36.064 INFO:tasks.rados.rados.2.smithi057.stdout:1745: finishing copy_from to smithi05720651-22 2020-11-16T22:08:36.064 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 1091 (ObjNum 583 snap 207 seq_num 583) dirty exists 2020-11-16T22:08:36.064 INFO:tasks.rados.rados.2.smithi057.stdout:1745: finishing copy_from racing read to smithi05720651-22 2020-11-16T22:08:36.064 INFO:tasks.rados.rados.2.smithi057.stdout:1746: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:36.064 INFO:tasks.rados.rados.2.smithi057.stdout:1746: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:36.064 INFO:tasks.rados.rados.2.smithi057.stdout:1746: finishing write tid 3 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:36.064 INFO:tasks.rados.rados.2.smithi057.stdout:1746: finishing write tid 4 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:36.065 INFO:tasks.rados.rados.2.smithi057.stdout:1746: finishing write tid 6 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:36.065 INFO:tasks.rados.rados.2.smithi057.stdout:1746: finishing write tid 7 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:36.266 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1135 (ObjNum 590 snap 207 seq_num 590) dirty exists 2020-11-16T22:08:36.266 INFO:tasks.rados.rados.2.smithi057.stdout:1746: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 590 snap 207 seq_num 590) 2020-11-16T22:08:36.266 INFO:tasks.rados.rados.2.smithi057.stdout:1747: finishing write tid 1 to smithi05720651-16 2020-11-16T22:08:36.266 INFO:tasks.rados.rados.2.smithi057.stdout:1747: finishing write tid 2 to smithi05720651-16 2020-11-16T22:08:36.267 INFO:tasks.rados.rados.2.smithi057.stdout:1747: finishing write tid 3 to smithi05720651-16 2020-11-16T22:08:36.267 INFO:tasks.rados.rados.2.smithi057.stdout:1747: finishing write tid 4 to smithi05720651-16 2020-11-16T22:08:36.267 INFO:tasks.rados.rados.2.smithi057.stdout:1747: finishing write tid 6 to smithi05720651-16 2020-11-16T22:08:36.267 INFO:tasks.rados.rados.2.smithi057.stdout:1747: finishing write tid 7 to smithi05720651-16 2020-11-16T22:08:36.267 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 1345 (ObjNum 591 snap 207 seq_num 591) dirty exists 2020-11-16T22:08:36.267 INFO:tasks.rados.rados.2.smithi057.stdout:1747: left oid 16 (ObjNum 591 snap 207 seq_num 591) 2020-11-16T22:08:36.268 INFO:tasks.rados.rados.2.smithi057.stdout:1748: finishing write tid 1 to smithi05720651-32 2020-11-16T22:08:36.268 INFO:tasks.rados.rados.2.smithi057.stdout:1748: finishing write tid 2 to smithi05720651-32 2020-11-16T22:08:36.269 INFO:tasks.rados.rados.2.smithi057.stdout:1742: done (7 left) 2020-11-16T22:08:36.270 INFO:tasks.rados.rados.2.smithi057.stdout:1743: done (6 left) 2020-11-16T22:08:36.270 INFO:tasks.rados.rados.2.smithi057.stdout:1745: done (5 left) 2020-11-16T22:08:36.270 INFO:tasks.rados.rados.2.smithi057.stdout:1746: done (4 left) 2020-11-16T22:08:36.270 INFO:tasks.rados.rados.2.smithi057.stdout:1747: done (3 left) 2020-11-16T22:08:36.270 INFO:tasks.rados.rados.2.smithi057.stdout:1749: done (2 left) 2020-11-16T22:08:36.270 INFO:tasks.rados.rados.2.smithi057.stdout:1750: done (1 left) 2020-11-16T22:08:36.271 INFO:tasks.rados.rados.2.smithi057.stdout:1751: write oid 38 current snap is 207 2020-11-16T22:08:36.271 INFO:tasks.rados.rados.2.smithi057.stdout:1751: seq_num 594 ranges {783358=573440,2026304=580868,3279140=621458} 2020-11-16T22:08:36.271 INFO:tasks.rados.rados.2.smithi057.stdout:1751: writing smithi05720651-38 from 783358 to 1356798 tid 1 2020-11-16T22:08:36.271 INFO:tasks.rados.rados.2.smithi057.stdout:1751: writing smithi05720651-38 from 2026304 to 2607172 tid 2 2020-11-16T22:08:36.271 INFO:tasks.rados.rados.2.smithi057.stdout:1751: writing smithi05720651-38 from 3279140 to 3900598 tid 3 2020-11-16T22:08:36.271 INFO:tasks.rados.rados.2.smithi057.stdout:1752: rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 207 2020-11-16T22:08:36.271 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 202 2020-11-16T22:08:36.474 INFO:tasks.rados.rados.2.smithi057.stdout:1748: finishing write tid 3 to smithi05720651-32 2020-11-16T22:08:36.474 INFO:tasks.rados.rados.2.smithi057.stdout:1753: write (excl) oid 34 current snap is 207 2020-11-16T22:08:36.474 INFO:tasks.rados.rados.2.smithi057.stdout:1753: seq_num 595 ranges {400165=648689,1684786=315379} 2020-11-16T22:08:36.474 INFO:tasks.rados.rados.2.smithi057.stdout:1753: writing smithi05720651-34 from 400165 to 1048854 tid 1 2020-11-16T22:08:36.475 INFO:tasks.rados.rados.2.smithi057.stdout:1753: writing smithi05720651-34 from 1684786 to 2000165 tid 2 2020-11-16T22:08:36.475 INFO:tasks.rados.rados.2.smithi057.stdout:1754: copy_from oid 40 from oid 4 current snap is 207 2020-11-16T22:08:36.475 INFO:tasks.rados.rados.2.smithi057.stdout:1748: finishing write tid 5 to smithi05720651-32 2020-11-16T22:08:36.475 INFO:tasks.rados.rados.2.smithi057.stdout:1748: finishing write tid 6 to smithi05720651-32 2020-11-16T22:08:36.475 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 1571 (ObjNum 592 snap 207 seq_num 592) dirty exists 2020-11-16T22:08:36.475 INFO:tasks.rados.rados.2.smithi057.stdout:1748: left oid 32 (ObjNum 592 snap 207 seq_num 592) 2020-11-16T22:08:36.475 INFO:tasks.rados.rados.2.smithi057.stdout:1748: done (4 left) 2020-11-16T22:08:36.476 INFO:tasks.rados.rados.2.smithi057.stdout:1755: snap_create 2020-11-16T22:08:36.476 INFO:tasks.rados.rados.2.smithi057.stdout:1751: finishing write tid 1 to smithi05720651-38 2020-11-16T22:08:36.476 INFO:tasks.rados.rados.2.smithi057.stdout:1751: finishing write tid 2 to smithi05720651-38 2020-11-16T22:08:36.476 INFO:tasks.rados.rados.2.smithi057.stdout:1752: finishing rollback tid 0 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:36.476 INFO:tasks.rados.rados.2.smithi057.stdout:1752: finishing rollback tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:36.476 INFO:tasks.rados.rados.2.smithi057.stdout:1751: finishing write tid 3 to smithi05720651-38 2020-11-16T22:08:36.476 INFO:tasks.rados.rados.2.smithi057.stdout:1752: finishing rollback tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:36.477 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1138 (ObjNum 552 snap 201 seq_num 552) dirty exists 2020-11-16T22:08:36.477 INFO:tasks.rados.rados.2.smithi057.stdout:1751: finishing write tid 5 to smithi05720651-38 2020-11-16T22:08:36.477 INFO:tasks.rados.rados.2.smithi057.stdout:1751: finishing write tid 6 to smithi05720651-38 2020-11-16T22:08:36.477 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 1119 (ObjNum 594 snap 207 seq_num 594) dirty exists 2020-11-16T22:08:36.477 INFO:tasks.rados.rados.2.smithi057.stdout:1751: left oid 38 (ObjNum 594 snap 207 seq_num 594) 2020-11-16T22:08:36.477 INFO:tasks.rados.rados.2.smithi057.stdout:1753: finishing write tid 1 to smithi05720651-34 2020-11-16T22:08:36.678 INFO:tasks.rados.rados.2.smithi057.stdout:1753: finishing write tid 2 to smithi05720651-34 2020-11-16T22:08:36.678 INFO:tasks.rados.rados.2.smithi057.stdout:1753: finishing write tid 4 to smithi05720651-34 2020-11-16T22:08:36.678 INFO:tasks.rados.rados.2.smithi057.stdout:1753: finishing write tid 5 to smithi05720651-34 2020-11-16T22:08:36.678 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 1094 (ObjNum 595 snap 207 seq_num 595) dirty exists 2020-11-16T22:08:36.679 INFO:tasks.rados.rados.2.smithi057.stdout:1753: left oid 34 (ObjNum 595 snap 207 seq_num 595) 2020-11-16T22:08:36.679 INFO:tasks.rados.rados.2.smithi057.stdout:1754: finishing copy_from to smithi05720651-40 2020-11-16T22:08:36.679 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 1091 (ObjNum 583 snap 207 seq_num 583) dirty exists 2020-11-16T22:08:36.679 INFO:tasks.rados.rados.2.smithi057.stdout:1754: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:08:37.104 INFO:tasks.rados.rados.2.smithi057.stdout:1751: done (4 left) 2020-11-16T22:08:37.104 INFO:tasks.rados.rados.2.smithi057.stdout:1752: done (3 left) 2020-11-16T22:08:37.104 INFO:tasks.rados.rados.2.smithi057.stdout:1753: done (2 left) 2020-11-16T22:08:37.105 INFO:tasks.rados.rados.2.smithi057.stdout:1754: done (1 left) 2020-11-16T22:08:37.105 INFO:tasks.rados.rados.2.smithi057.stdout:1755: done (0 left) 2020-11-16T22:08:37.105 INFO:tasks.rados.rados.2.smithi057.stdout:1756: snap_create 2020-11-16T22:08:37.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:37 smithi057 bash[10301]: cluster 2020-11-16T22:08:35.708212+0000 mgr.x (mgr.24115) 479 : cluster [DBG] pgmap v898: 17 pgs: 17 active+clean; 142 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 3.7 MiB/s wr, 17 op/s 2020-11-16T22:08:37.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:37 smithi016 bash[10302]: cluster 2020-11-16T22:08:35.708212+0000 mgr.x (mgr.24115) 479 : cluster [DBG] pgmap v898: 17 pgs: 17 active+clean; 142 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 3.7 MiB/s wr, 17 op/s 2020-11-16T22:08:37.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:37 smithi195 bash[10218]: cluster 2020-11-16T22:08:35.708212+0000 mgr.x (mgr.24115) 479 : cluster [DBG] pgmap v898: 17 pgs: 17 active+clean; 142 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 3.7 MiB/s wr, 17 op/s 2020-11-16T22:08:38.122 INFO:tasks.rados.rados.2.smithi057.stdout:1756: done (0 left) 2020-11-16T22:08:38.122 INFO:tasks.rados.rados.2.smithi057.stdout:1757: snap_remove snap 207 2020-11-16T22:08:38.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:38 smithi057 bash[10301]: cluster 2020-11-16T22:08:37.112599+0000 mon.a (mon.0) 1145 : cluster [DBG] osdmap e490: 12 total, 12 up, 12 in 2020-11-16T22:08:38.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:38 smithi016 bash[10302]: cluster 2020-11-16T22:08:37.112599+0000 mon.a (mon.0) 1145 : cluster [DBG] osdmap e490: 12 total, 12 up, 12 in 2020-11-16T22:08:38.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:38 smithi195 bash[10218]: cluster 2020-11-16T22:08:37.112599+0000 mon.a (mon.0) 1145 : cluster [DBG] osdmap e490: 12 total, 12 up, 12 in 2020-11-16T22:08:39.126 INFO:tasks.rados.rados.2.smithi057.stdout:1757: done (0 left) 2020-11-16T22:08:39.127 INFO:tasks.rados.rados.2.smithi057.stdout:1758: write (excl) oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 209 2020-11-16T22:08:39.127 INFO:tasks.rados.rados.2.smithi057.stdout:1758: seq_num 596 ranges {416972=723938,1743268=273704} 2020-11-16T22:08:39.136 INFO:tasks.rados.rados.2.smithi057.stdout:1758: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 416972 to 1140910 tid 1 2020-11-16T22:08:39.141 INFO:tasks.rados.rados.2.smithi057.stdout:1758: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1743268 to 2016972 tid 2 2020-11-16T22:08:39.141 INFO:tasks.rados.rados.2.smithi057.stdout:1759: read oid 46 snap -1 2020-11-16T22:08:39.142 INFO:tasks.rados.rados.2.smithi057.stdout:1759: expect deleted 2020-11-16T22:08:39.142 INFO:tasks.rados.rados.2.smithi057.stdout:1760: delete oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 209 2020-11-16T22:08:39.146 INFO:tasks.rados.rados.2.smithi057.stdout:1760: done (2 left) 2020-11-16T22:08:39.147 INFO:tasks.rados.rados.2.smithi057.stdout:1761: rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 209 2020-11-16T22:08:39.147 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 202 2020-11-16T22:08:39.147 INFO:tasks.rados.rados.2.smithi057.stdout:1759: done (2 left) 2020-11-16T22:08:39.147 INFO:tasks.rados.rados.2.smithi057.stdout:1762: snap_create 2020-11-16T22:08:39.149 INFO:tasks.rados.rados.2.smithi057.stdout:1758: finishing write tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:39.154 INFO:tasks.rados.rados.2.smithi057.stdout:1758: finishing write tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:39.154 INFO:tasks.rados.rados.2.smithi057.stdout:1758: finishing write tid 4 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:39.155 INFO:tasks.rados.rados.2.smithi057.stdout:1758: finishing write tid 5 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:39.155 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1348 (ObjNum 596 snap 209 seq_num 596) dirty exists 2020-11-16T22:08:39.155 INFO:tasks.rados.rados.2.smithi057.stdout:1758: left oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 596 snap 209 seq_num 596) 2020-11-16T22:08:39.162 INFO:tasks.rados.rados.2.smithi057.stdout:1761: finishing rollback tid 0 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:39.165 INFO:tasks.rados.rados.2.smithi057.stdout:1761: finishing rollback tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:39.165 INFO:tasks.rados.rados.2.smithi057.stdout:1761: finishing rollback tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:39.165 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1141 (ObjNum 552 snap 201 seq_num 552) dirty exists 2020-11-16T22:08:39.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:39 smithi057 bash[10301]: cluster 2020-11-16T22:08:37.708957+0000 mgr.x (mgr.24115) 480 : cluster [DBG] pgmap v900: 17 pgs: 17 active+clean; 145 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.0 MiB/s wr, 31 op/s 2020-11-16T22:08:39.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:39 smithi057 bash[10301]: cluster 2020-11-16T22:08:38.131313+0000 mon.a (mon.0) 1146 : cluster [DBG] osdmap e491: 12 total, 12 up, 12 in 2020-11-16T22:08:39.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:39 smithi016 bash[10302]: cluster 2020-11-16T22:08:37.708957+0000 mgr.x (mgr.24115) 480 : cluster [DBG] pgmap v900: 17 pgs: 17 active+clean; 145 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.0 MiB/s wr, 31 op/s 2020-11-16T22:08:39.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:39 smithi016 bash[10302]: cluster 2020-11-16T22:08:38.131313+0000 mon.a (mon.0) 1146 : cluster [DBG] osdmap e491: 12 total, 12 up, 12 in 2020-11-16T22:08:39.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:39 smithi195 bash[10218]: cluster 2020-11-16T22:08:37.708957+0000 mgr.x (mgr.24115) 480 : cluster [DBG] pgmap v900: 17 pgs: 17 active+clean; 145 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 6.0 MiB/s wr, 31 op/s 2020-11-16T22:08:39.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:39 smithi195 bash[10218]: cluster 2020-11-16T22:08:38.131313+0000 mon.a (mon.0) 1146 : cluster [DBG] osdmap e491: 12 total, 12 up, 12 in 2020-11-16T22:08:40.020 INFO:tasks.rados.rados.2.smithi057.stdout:1758: done (2 left) 2020-11-16T22:08:40.021 INFO:tasks.rados.rados.2.smithi057.stdout:1761: done (1 left) 2020-11-16T22:08:40.021 INFO:tasks.rados.rados.2.smithi057.stdout:1762: done (0 left) 2020-11-16T22:08:40.021 INFO:tasks.rados.rados.2.smithi057.stdout:1763: write (excl) oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 210 2020-11-16T22:08:40.021 INFO:tasks.rados.rados.2.smithi057.stdout:1763: seq_num 598 ranges {450586=474436,1343879=588206} 2020-11-16T22:08:40.030 INFO:tasks.rados.rados.2.smithi057.stdout:1763: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 450586 to 925022 tid 1 2020-11-16T22:08:40.036 INFO:tasks.rados.rados.2.smithi057.stdout:1763: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1343879 to 1932085 tid 2 2020-11-16T22:08:40.036 INFO:tasks.rados.rados.2.smithi057.stdout:1764: read oid 38 snap 209 2020-11-16T22:08:40.037 INFO:tasks.rados.rados.2.smithi057.stdout:1764: expect (ObjNum 594 snap 207 seq_num 594) 2020-11-16T22:08:40.037 INFO:tasks.rados.rados.2.smithi057.stdout:1765: write (excl) oid 34 current snap is 210 2020-11-16T22:08:40.037 INFO:tasks.rados.rados.2.smithi057.stdout:1765: seq_num 599 ranges {467393=549685,1802361=265032} 2020-11-16T22:08:40.042 INFO:tasks.rados.rados.2.smithi057.stdout:1765: writing smithi05720651-34 from 467393 to 1017078 tid 1 2020-11-16T22:08:40.049 INFO:tasks.rados.rados.2.smithi057.stdout:1765: writing smithi05720651-34 from 1802361 to 2067393 tid 2 2020-11-16T22:08:40.049 INFO:tasks.rados.rados.2.smithi057.stdout:1766: read oid 18 snap -1 2020-11-16T22:08:40.049 INFO:tasks.rados.rados.2.smithi057.stdout:1766: expect (ObjNum 562 snap 203 seq_num 562) 2020-11-16T22:08:40.049 INFO:tasks.rados.rados.2.smithi057.stdout:1767: snap_remove snap 208 2020-11-16T22:08:40.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:40 smithi057 bash[10301]: cluster 2020-11-16T22:08:39.134154+0000 mon.a (mon.0) 1147 : cluster [DBG] osdmap e492: 12 total, 12 up, 12 in 2020-11-16T22:08:40.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:40 smithi057 bash[10301]: cluster 2020-11-16T22:08:40.030976+0000 mon.a (mon.0) 1148 : cluster [DBG] osdmap e493: 12 total, 12 up, 12 in 2020-11-16T22:08:40.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:40 smithi016 bash[10302]: cluster 2020-11-16T22:08:39.134154+0000 mon.a (mon.0) 1147 : cluster [DBG] osdmap e492: 12 total, 12 up, 12 in 2020-11-16T22:08:40.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:40 smithi016 bash[10302]: cluster 2020-11-16T22:08:40.030976+0000 mon.a (mon.0) 1148 : cluster [DBG] osdmap e493: 12 total, 12 up, 12 in 2020-11-16T22:08:40.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:40 smithi195 bash[10218]: cluster 2020-11-16T22:08:39.134154+0000 mon.a (mon.0) 1147 : cluster [DBG] osdmap e492: 12 total, 12 up, 12 in 2020-11-16T22:08:40.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:40 smithi195 bash[10218]: cluster 2020-11-16T22:08:40.030976+0000 mon.a (mon.0) 1148 : cluster [DBG] osdmap e493: 12 total, 12 up, 12 in 2020-11-16T22:08:41.032 INFO:tasks.rados.rados.2.smithi057.stdout:1767: done (4 left) 2020-11-16T22:08:41.032 INFO:tasks.rados.rados.2.smithi057.stdout:1768: snap_remove snap 202 2020-11-16T22:08:41.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:41 smithi057 bash[10301]: cluster 2020-11-16T22:08:39.709671+0000 mgr.x (mgr.24115) 481 : cluster [DBG] pgmap v903: 17 pgs: 17 active+clean; 145 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.1 MiB/s wr, 24 op/s 2020-11-16T22:08:41.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:41 smithi057 bash[10301]: cluster 2020-11-16T22:08:41.040472+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e494: 12 total, 12 up, 12 in 2020-11-16T22:08:41.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:41 smithi016 bash[10302]: cluster 2020-11-16T22:08:39.709671+0000 mgr.x (mgr.24115) 481 : cluster [DBG] pgmap v903: 17 pgs: 17 active+clean; 145 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.1 MiB/s wr, 24 op/s 2020-11-16T22:08:41.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:41 smithi016 bash[10302]: cluster 2020-11-16T22:08:41.040472+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e494: 12 total, 12 up, 12 in 2020-11-16T22:08:41.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:41 smithi195 bash[10218]: cluster 2020-11-16T22:08:39.709671+0000 mgr.x (mgr.24115) 481 : cluster [DBG] pgmap v903: 17 pgs: 17 active+clean; 145 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.1 MiB/s wr, 24 op/s 2020-11-16T22:08:41.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:41 smithi195 bash[10218]: cluster 2020-11-16T22:08:41.040472+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e494: 12 total, 12 up, 12 in 2020-11-16T22:08:42.037 INFO:tasks.rados.rados.2.smithi057.stdout:1768: done (4 left) 2020-11-16T22:08:42.038 INFO:tasks.rados.rados.2.smithi057.stdout:1769: snap_create 2020-11-16T22:08:42.038 INFO:tasks.rados.rados.2.smithi057.stdout:1763: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:42.038 INFO:tasks.rados.rados.2.smithi057.stdout:1763: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:42.038 INFO:tasks.rados.rados.2.smithi057.stdout:1763: finishing write tid 4 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:42.038 INFO:tasks.rados.rados.2.smithi057.stdout:1763: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:42.039 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1455 (ObjNum 598 snap 210 seq_num 598) dirty exists 2020-11-16T22:08:42.039 INFO:tasks.rados.rados.2.smithi057.stdout:1763: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 598 snap 210 seq_num 598) 2020-11-16T22:08:42.039 INFO:tasks.rados.rados.2.smithi057.stdout:1765: finishing write tid 1 to smithi05720651-34 2020-11-16T22:08:42.039 INFO:tasks.rados.rados.2.smithi057.stdout:1764: expect (ObjNum 594 snap 207 seq_num 594) 2020-11-16T22:08:42.164 INFO:tasks.rados.rados.2.smithi057.stdout:1765: finishing write tid 2 to smithi05720651-34 2020-11-16T22:08:42.164 INFO:tasks.rados.rados.2.smithi057.stdout:1765: finishing write tid 4 to smithi05720651-34 2020-11-16T22:08:42.165 INFO:tasks.rados.rados.2.smithi057.stdout:1765: finishing write tid 5 to smithi05720651-34 2020-11-16T22:08:42.165 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 1097 (ObjNum 599 snap 210 seq_num 599) dirty exists 2020-11-16T22:08:42.165 INFO:tasks.rados.rados.2.smithi057.stdout:1765: left oid 34 (ObjNum 599 snap 210 seq_num 599) 2020-11-16T22:08:42.165 INFO:tasks.rados.rados.2.smithi057.stdout:1766: expect (ObjNum 562 snap 203 seq_num 562) 2020-11-16T22:08:42.337 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:08:42 smithi016 bash[19825]: debug 2020-11-16T22:08:42.088+0000 7f0e16c22700 -1 osd.7 pg_epoch: 495 pg[2.8( v 495'1265 (0'0,495'1265] local-lis/les=71/72 n=7 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [7,9] r=0 lpr=71 luod=495'1263 crt=495'1265 lcod 495'1261 mlcod 495'1261 active+clean+snaptrim trimq=[192~1] ps=[19c~1,19f~2]] removing snap head 2020-11-16T22:08:42.349 INFO:journalctl@ceph.osd.2.smithi195.stdout:Nov 16 22:08:42 smithi195 bash[21024]: debug 2020-11-16T22:08:42.044+0000 7f3c19f37700 -1 osd.2 pg_epoch: 495 pg[2.e( v 489'445 (0'0,489'445] local-lis/les=71/72 n=4 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [2,3] r=0 lpr=71 crt=489'445 lcod 488'443 mlcod 488'443 active+clean+snaptrim trimq=[192~1] ps=[19c~1,19f~2]] removing snap head 2020-11-16T22:08:43.046 INFO:tasks.rados.rados.2.smithi057.stdout:1763: done (4 left) 2020-11-16T22:08:43.047 INFO:tasks.rados.rados.2.smithi057.stdout:1764: done (3 left) 2020-11-16T22:08:43.047 INFO:tasks.rados.rados.2.smithi057.stdout:1765: done (2 left) 2020-11-16T22:08:43.047 INFO:tasks.rados.rados.2.smithi057.stdout:1766: done (1 left) 2020-11-16T22:08:43.047 INFO:tasks.rados.rados.2.smithi057.stdout:1769: done (0 left) 2020-11-16T22:08:43.047 INFO:tasks.rados.rados.2.smithi057.stdout:1770: read oid 12 snap -1 2020-11-16T22:08:43.047 INFO:tasks.rados.rados.2.smithi057.stdout:1770: expect deleted 2020-11-16T22:08:43.048 INFO:tasks.rados.rados.2.smithi057.stdout:1771: snap_remove snap 210 2020-11-16T22:08:43.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:43 smithi016 bash[10302]: cluster 2020-11-16T22:08:41.710402+0000 mgr.x (mgr.24115) 482 : cluster [DBG] pgmap v906: 17 pgs: 17 active+clean; 158 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.6 MiB/s wr, 15 op/s 2020-11-16T22:08:43.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:43 smithi016 bash[10302]: cluster 2020-11-16T22:08:42.040857+0000 mon.a (mon.0) 1150 : cluster [DBG] osdmap e495: 12 total, 12 up, 12 in 2020-11-16T22:08:43.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:43 smithi195 bash[10218]: cluster 2020-11-16T22:08:41.710402+0000 mgr.x (mgr.24115) 482 : cluster [DBG] pgmap v906: 17 pgs: 17 active+clean; 158 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.6 MiB/s wr, 15 op/s 2020-11-16T22:08:43.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:43 smithi195 bash[10218]: cluster 2020-11-16T22:08:42.040857+0000 mon.a (mon.0) 1150 : cluster [DBG] osdmap e495: 12 total, 12 up, 12 in 2020-11-16T22:08:43.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:43 smithi057 bash[10301]: cluster 2020-11-16T22:08:41.710402+0000 mgr.x (mgr.24115) 482 : cluster [DBG] pgmap v906: 17 pgs: 17 active+clean; 158 MiB data, 563 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.6 MiB/s wr, 15 op/s 2020-11-16T22:08:43.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:43 smithi057 bash[10301]: cluster 2020-11-16T22:08:42.040857+0000 mon.a (mon.0) 1150 : cluster [DBG] osdmap e495: 12 total, 12 up, 12 in 2020-11-16T22:08:44.059 INFO:tasks.rados.rados.2.smithi057.stdout:1771: done (1 left) 2020-11-16T22:08:44.059 INFO:tasks.rados.rados.2.smithi057.stdout:1772: read oid 36 snap -1 2020-11-16T22:08:44.060 INFO:tasks.rados.rados.2.smithi057.stdout:1772: expect (ObjNum 587 snap 207 seq_num 587) 2020-11-16T22:08:44.060 INFO:tasks.rados.rados.2.smithi057.stdout:1770: done (1 left) 2020-11-16T22:08:44.060 INFO:tasks.rados.rados.2.smithi057.stdout:1773: snap_create 2020-11-16T22:08:44.076 INFO:tasks.rados.rados.2.smithi057.stdout:1772: expect (ObjNum 587 snap 207 seq_num 587) 2020-11-16T22:08:44.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:44 smithi016 bash[10302]: cluster 2020-11-16T22:08:43.052856+0000 mon.a (mon.0) 1151 : cluster [DBG] osdmap e496: 12 total, 12 up, 12 in 2020-11-16T22:08:44.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:44 smithi195 bash[10218]: cluster 2020-11-16T22:08:43.052856+0000 mon.a (mon.0) 1151 : cluster [DBG] osdmap e496: 12 total, 12 up, 12 in 2020-11-16T22:08:44.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:44 smithi057 bash[10301]: cluster 2020-11-16T22:08:43.052856+0000 mon.a (mon.0) 1151 : cluster [DBG] osdmap e496: 12 total, 12 up, 12 in 2020-11-16T22:08:45.029 INFO:tasks.rados.rados.2.smithi057.stdout:1772: done (1 left) 2020-11-16T22:08:45.029 INFO:tasks.rados.rados.2.smithi057.stdout:1773: done (0 left) 2020-11-16T22:08:45.030 INFO:tasks.rados.rados.2.smithi057.stdout:1774: rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 212 2020-11-16T22:08:45.030 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 209 2020-11-16T22:08:45.030 INFO:tasks.rados.rados.2.smithi057.stdout:1775: rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 212 2020-11-16T22:08:45.030 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 209 2020-11-16T22:08:45.030 INFO:tasks.rados.rados.2.smithi057.stdout:1776: write (excl) oid 22 current snap is 212 2020-11-16T22:08:45.030 INFO:tasks.rados.rados.2.smithi057.stdout:1776: seq_num 600 ranges {484200=624934,1860843=223357} 2020-11-16T22:08:45.040 INFO:tasks.rados.rados.2.smithi057.stdout:1776: writing smithi05720651-22 from 484200 to 1109134 tid 1 2020-11-16T22:08:45.047 INFO:tasks.rados.rados.2.smithi057.stdout:1776: writing smithi05720651-22 from 1860843 to 2084200 tid 2 2020-11-16T22:08:45.047 INFO:tasks.rados.rados.2.smithi057.stdout:1777: read oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 211 2020-11-16T22:08:45.047 INFO:tasks.rados.rados.2.smithi057.stdout:1777: expect deleted 2020-11-16T22:08:45.047 INFO:tasks.rados.rados.2.smithi057.stdout:1778: read oid 34 snap -1 2020-11-16T22:08:45.047 INFO:tasks.rados.rados.2.smithi057.stdout:1778: expect (ObjNum 599 snap 210 seq_num 599) 2020-11-16T22:08:45.047 INFO:tasks.rados.rados.2.smithi057.stdout:1779: copy_from oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 36 current snap is 212 2020-11-16T22:08:45.048 INFO:tasks.rados.rados.2.smithi057.stdout:1774: finishing rollback tid 0 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:45.048 INFO:tasks.rados.rados.2.smithi057.stdout:1780: delete oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 212 2020-11-16T22:08:45.048 INFO:tasks.rados.rados.2.smithi057.stdout:1774: finishing rollback tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:45.048 INFO:tasks.rados.rados.2.smithi057.stdout:1774: finishing rollback tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:45.048 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1144 (ObjNum 552 snap 201 seq_num 552) dirty exists 2020-11-16T22:08:45.048 INFO:tasks.rados.rados.2.smithi057.stdout:1775: finishing rollback tid 0 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:45.049 INFO:tasks.rados.rados.2.smithi057.stdout:1775: finishing rollback tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:45.049 INFO:tasks.rados.rados.2.smithi057.stdout:1775: finishing rollback tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:45.049 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1351 (ObjNum 577 snap 206 seq_num 577) dirty exists 2020-11-16T22:08:45.050 INFO:tasks.rados.rados.2.smithi057.stdout:1776: finishing write tid 1 to smithi05720651-22 2020-11-16T22:08:45.052 INFO:tasks.rados.rados.2.smithi057.stdout:1774: done (6 left) 2020-11-16T22:08:45.052 INFO:tasks.rados.rados.2.smithi057.stdout:1775: done (5 left) 2020-11-16T22:08:45.052 INFO:tasks.rados.rados.2.smithi057.stdout:1780: done (4 left) 2020-11-16T22:08:45.053 INFO:tasks.rados.rados.2.smithi057.stdout:1781: snap_remove snap 209 2020-11-16T22:08:45.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:45 smithi016 bash[10302]: cluster 2020-11-16T22:08:43.711095+0000 mgr.x (mgr.24115) 483 : cluster [DBG] pgmap v909: 17 pgs: 17 active+clean; 152 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.8 MiB/s wr, 16 op/s 2020-11-16T22:08:45.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:45 smithi016 bash[10302]: cluster 2020-11-16T22:08:44.062451+0000 mon.a (mon.0) 1152 : cluster [DBG] osdmap e497: 12 total, 12 up, 12 in 2020-11-16T22:08:45.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:45 smithi016 bash[10302]: cluster 2020-11-16T22:08:45.032470+0000 mon.a (mon.0) 1153 : cluster [DBG] osdmap e498: 12 total, 12 up, 12 in 2020-11-16T22:08:45.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:45 smithi195 bash[10218]: cluster 2020-11-16T22:08:43.711095+0000 mgr.x (mgr.24115) 483 : cluster [DBG] pgmap v909: 17 pgs: 17 active+clean; 152 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.8 MiB/s wr, 16 op/s 2020-11-16T22:08:45.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:45 smithi195 bash[10218]: cluster 2020-11-16T22:08:44.062451+0000 mon.a (mon.0) 1152 : cluster [DBG] osdmap e497: 12 total, 12 up, 12 in 2020-11-16T22:08:45.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:45 smithi195 bash[10218]: cluster 2020-11-16T22:08:45.032470+0000 mon.a (mon.0) 1153 : cluster [DBG] osdmap e498: 12 total, 12 up, 12 in 2020-11-16T22:08:45.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:45 smithi057 bash[10301]: cluster 2020-11-16T22:08:43.711095+0000 mgr.x (mgr.24115) 483 : cluster [DBG] pgmap v909: 17 pgs: 17 active+clean; 152 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.8 MiB/s wr, 16 op/s 2020-11-16T22:08:45.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:45 smithi057 bash[10301]: cluster 2020-11-16T22:08:44.062451+0000 mon.a (mon.0) 1152 : cluster [DBG] osdmap e497: 12 total, 12 up, 12 in 2020-11-16T22:08:45.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:45 smithi057 bash[10301]: cluster 2020-11-16T22:08:45.032470+0000 mon.a (mon.0) 1153 : cluster [DBG] osdmap e498: 12 total, 12 up, 12 in 2020-11-16T22:08:46.063 INFO:tasks.rados.rados.2.smithi057.stdout:1781: done (4 left) 2020-11-16T22:08:46.064 INFO:tasks.rados.rados.2.smithi057.stdout:1782: write (excl) oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 212 2020-11-16T22:08:46.064 INFO:tasks.rados.rados.2.smithi057.stdout:1782: seq_num 602 ranges {517814=491785,1577807=540007} 2020-11-16T22:08:46.077 INFO:tasks.rados.rados.2.smithi057.stdout:1782: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 517814 to 1009599 tid 1 2020-11-16T22:08:46.084 INFO:tasks.rados.rados.2.smithi057.stdout:1782: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1577807 to 2117814 tid 2 2020-11-16T22:08:46.084 INFO:tasks.rados.rados.2.smithi057.stdout:1783: rollback oid 46 current snap is 212 2020-11-16T22:08:46.084 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 46 to 211 2020-11-16T22:08:46.084 INFO:tasks.rados.rados.2.smithi057.stdout:1784: delete oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 212 2020-11-16T22:08:46.085 INFO:tasks.rados.rados.2.smithi057.stdout:1776: finishing write tid 2 to smithi05720651-22 2020-11-16T22:08:46.085 INFO:tasks.rados.rados.2.smithi057.stdout:1778: expect (ObjNum 599 snap 210 seq_num 599) 2020-11-16T22:08:46.179 INFO:tasks.rados.rados.2.smithi057.stdout:1776: finishing write tid 4 to smithi05720651-22 2020-11-16T22:08:46.179 INFO:tasks.rados.rados.2.smithi057.stdout:1779: finishing copy_from to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:46.179 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1329 (ObjNum 587 snap 207 seq_num 587) dirty exists 2020-11-16T22:08:46.179 INFO:tasks.rados.rados.2.smithi057.stdout:1779: finishing copy_from racing read to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:46.180 INFO:tasks.rados.rados.2.smithi057.stdout:1776: finishing write tid 5 to smithi05720651-22 2020-11-16T22:08:46.180 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 1094 (ObjNum 600 snap 212 seq_num 600) dirty exists 2020-11-16T22:08:46.180 INFO:tasks.rados.rados.2.smithi057.stdout:1776: left oid 22 (ObjNum 600 snap 212 seq_num 600) 2020-11-16T22:08:46.180 INFO:tasks.rados.rados.2.smithi057.stdout:1776: done (6 left) 2020-11-16T22:08:46.180 INFO:tasks.rados.rados.2.smithi057.stdout:1777: done (5 left) 2020-11-16T22:08:46.180 INFO:tasks.rados.rados.2.smithi057.stdout:1778: done (4 left) 2020-11-16T22:08:46.180 INFO:tasks.rados.rados.2.smithi057.stdout:1779: done (3 left) 2020-11-16T22:08:46.181 INFO:tasks.rados.rados.2.smithi057.stdout:1784: done (2 left) 2020-11-16T22:08:46.181 INFO:tasks.rados.rados.2.smithi057.stdout:1785: copy_from oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 10 current snap is 212 2020-11-16T22:08:46.181 INFO:tasks.rados.rados.2.smithi057.stdout:1783: finishing rollback tid 1 to smithi05720651-46 2020-11-16T22:08:46.382 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 0 (ObjNum 497 snap 0 seq_num 2932741872) dirty dne 2020-11-16T22:08:46.382 INFO:tasks.rados.rados.2.smithi057.stdout:1782: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:46.382 INFO:tasks.rados.rados.2.smithi057.stdout:1782: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:46.383 INFO:tasks.rados.rados.2.smithi057.stdout:1782: finishing write tid 4 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:46.383 INFO:tasks.rados.rados.2.smithi057.stdout:1782: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:46.383 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1586 (ObjNum 602 snap 212 seq_num 602) dirty exists 2020-11-16T22:08:46.383 INFO:tasks.rados.rados.2.smithi057.stdout:1782: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 602 snap 212 seq_num 602) 2020-11-16T22:08:46.383 INFO:tasks.rados.rados.2.smithi057.stdout:1782: done (2 left) 2020-11-16T22:08:46.383 INFO:tasks.rados.rados.2.smithi057.stdout:1783: done (1 left) 2020-11-16T22:08:46.383 INFO:tasks.rados.rados.2.smithi057.stdout:1786: write oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 212 2020-11-16T22:08:46.384 INFO:tasks.rados.rados.2.smithi057.stdout:1786: seq_num 604 ranges {551428=642283,1694771=456657} 2020-11-16T22:08:46.385 INFO:tasks.rados.rados.2.smithi057.stdout:1786: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 551428 to 1193711 tid 1 2020-11-16T22:08:46.386 INFO:tasks.rados.rados.2.smithi057.stdout:1786: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1694771 to 2151428 tid 2 2020-11-16T22:08:46.590 INFO:tasks.rados.rados.2.smithi057.stdout:1787: delete oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 212 2020-11-16T22:08:46.590 INFO:tasks.rados.rados.2.smithi057.stdout:1787: done (2 left) 2020-11-16T22:08:46.590 INFO:tasks.rados.rados.2.smithi057.stdout:1788: rollback oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 212 2020-11-16T22:08:46.591 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 211 2020-11-16T22:08:46.591 INFO:tasks.rados.rados.2.smithi057.stdout:1789: rollback oid 18 current snap is 212 2020-11-16T22:08:46.591 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 18 to 211 2020-11-16T22:08:46.591 INFO:tasks.rados.rados.2.smithi057.stdout:1790: copy_from oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 212 2020-11-16T22:08:46.591 INFO:tasks.rados.rados.2.smithi057.stdout:1791: snap_create 2020-11-16T22:08:46.591 INFO:tasks.rados.rados.2.smithi057.stdout:1785: finishing copy_from to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:46.591 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 962 (ObjNum 525 snap 188 seq_num 525) dirty exists 2020-11-16T22:08:46.592 INFO:tasks.rados.rados.2.smithi057.stdout:1785: finishing copy_from racing read to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:46.592 INFO:tasks.rados.rados.2.smithi057.stdout:1786: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:46.794 INFO:tasks.rados.rados.2.smithi057.stdout:1786: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:46.794 INFO:tasks.rados.rados.2.smithi057.stdout:1786: finishing write tid 4 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:46.794 INFO:tasks.rados.rados.2.smithi057.stdout:1786: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:46.795 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1498 (ObjNum 604 snap 212 seq_num 604) dirty exists 2020-11-16T22:08:46.795 INFO:tasks.rados.rados.2.smithi057.stdout:1786: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 604 snap 212 seq_num 604) 2020-11-16T22:08:46.795 INFO:tasks.rados.rados.2.smithi057.stdout:1788: finishing rollback tid 0 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:46.795 INFO:tasks.rados.rados.2.smithi057.stdout:1788: finishing rollback tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:46.795 INFO:tasks.rados.rados.2.smithi057.stdout:1788: finishing rollback tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:46.795 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1241 (ObjNum 543 snap 194 seq_num 543) dirty exists 2020-11-16T22:08:46.795 INFO:tasks.rados.rados.2.smithi057.stdout:1789: finishing rollback tid 0 to smithi05720651-18 2020-11-16T22:08:46.796 INFO:tasks.rados.rados.2.smithi057.stdout:1789: finishing rollback tid 1 to smithi05720651-18 2020-11-16T22:08:46.998 INFO:tasks.rados.rados.2.smithi057.stdout:1789: finishing rollback tid 2 to smithi05720651-18 2020-11-16T22:08:46.998 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 1244 (ObjNum 562 snap 203 seq_num 562) dirty exists 2020-11-16T22:08:46.998 INFO:tasks.rados.rados.2.smithi057.stdout:1790: finishing copy_from to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:46.999 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1471 (ObjNum 522 snap 188 seq_num 522) dirty exists 2020-11-16T22:08:46.999 INFO:tasks.rados.rados.2.smithi057.stdout:1790: finishing copy_from racing read to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:47.072 INFO:tasks.rados.rados.2.smithi057.stdout:1785: done (5 left) 2020-11-16T22:08:47.073 INFO:tasks.rados.rados.2.smithi057.stdout:1786: done (4 left) 2020-11-16T22:08:47.073 INFO:tasks.rados.rados.2.smithi057.stdout:1788: done (3 left) 2020-11-16T22:08:47.073 INFO:tasks.rados.rados.2.smithi057.stdout:1789: done (2 left) 2020-11-16T22:08:47.073 INFO:tasks.rados.rados.2.smithi057.stdout:1790: done (1 left) 2020-11-16T22:08:47.073 INFO:tasks.rados.rados.2.smithi057.stdout:1791: done (0 left) 2020-11-16T22:08:47.073 INFO:tasks.rados.rados.2.smithi057.stdout:1792: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:08:47.074 INFO:tasks.rados.rados.2.smithi057.stdout:1792: expect (ObjNum 598 snap 210 seq_num 598) 2020-11-16T22:08:47.074 INFO:tasks.rados.rados.2.smithi057.stdout:1793: write oid 4 current snap is 213 2020-11-16T22:08:47.074 INFO:tasks.rados.rados.2.smithi057.stdout:1793: seq_num 606 ranges {585042=792781,2095382=89660} 2020-11-16T22:08:47.088 INFO:tasks.rados.rados.2.smithi057.stdout:1793: writing smithi05720651-4 from 585042 to 1377823 tid 1 2020-11-16T22:08:47.093 INFO:tasks.rados.rados.2.smithi057.stdout:1793: writing smithi05720651-4 from 2095382 to 2185042 tid 2 2020-11-16T22:08:47.093 INFO:tasks.rados.rados.2.smithi057.stdout:1794: rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 213 2020-11-16T22:08:47.093 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 211 2020-11-16T22:08:47.094 INFO:tasks.rados.rados.2.smithi057.stdout:1792: expect (ObjNum 598 snap 210 seq_num 598) 2020-11-16T22:08:47.163 INFO:tasks.rados.rados.2.smithi057.stdout:1793: finishing write tid 1 to smithi05720651-4 2020-11-16T22:08:47.163 INFO:tasks.rados.rados.2.smithi057.stdout:1793: finishing write tid 2 to smithi05720651-4 2020-11-16T22:08:47.163 INFO:tasks.rados.rados.2.smithi057.stdout:1793: finishing write tid 4 to smithi05720651-4 2020-11-16T22:08:47.164 INFO:tasks.rados.rados.2.smithi057.stdout:1793: finishing write tid 5 to smithi05720651-4 2020-11-16T22:08:47.164 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 1100 (ObjNum 606 snap 213 seq_num 606) dirty exists 2020-11-16T22:08:47.164 INFO:tasks.rados.rados.2.smithi057.stdout:1793: left oid 4 (ObjNum 606 snap 213 seq_num 606) 2020-11-16T22:08:47.164 INFO:tasks.rados.rados.2.smithi057.stdout:1794: finishing rollback tid 0 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:47.164 INFO:tasks.rados.rados.2.smithi057.stdout:1794: finishing rollback tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:47.164 INFO:tasks.rados.rados.2.smithi057.stdout:1794: finishing rollback tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:47.164 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1354 (ObjNum 577 snap 206 seq_num 577) dirty exists 2020-11-16T22:08:47.165 INFO:tasks.rados.rados.2.smithi057.stdout:1792: done (2 left) 2020-11-16T22:08:47.165 INFO:tasks.rados.rados.2.smithi057.stdout:1793: done (1 left) 2020-11-16T22:08:47.165 INFO:tasks.rados.rados.2.smithi057.stdout:1794: done (0 left) 2020-11-16T22:08:47.165 INFO:tasks.rados.rados.2.smithi057.stdout:1795: delete oid 42 current snap is 213 2020-11-16T22:08:47.171 INFO:tasks.rados.rados.2.smithi057.stdout:1795: done (0 left) 2020-11-16T22:08:47.171 INFO:tasks.rados.rados.2.smithi057.stdout:1796: delete oid 14 current snap is 213 2020-11-16T22:08:47.176 INFO:tasks.rados.rados.2.smithi057.stdout:1796: done (0 left) 2020-11-16T22:08:47.177 INFO:tasks.rados.rados.2.smithi057.stdout:1797: snap_create 2020-11-16T22:08:47.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:47 smithi016 bash[10302]: cluster 2020-11-16T22:08:45.711822+0000 mgr.x (mgr.24115) 484 : cluster [DBG] pgmap v912: 17 pgs: 17 active+clean; 136 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 199 KiB/s wr, 4 op/s 2020-11-16T22:08:47.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:47 smithi016 bash[10302]: cluster 2020-11-16T22:08:46.072454+0000 mon.a (mon.0) 1154 : cluster [DBG] osdmap e499: 12 total, 12 up, 12 in 2020-11-16T22:08:47.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:47 smithi195 bash[10218]: cluster 2020-11-16T22:08:45.711822+0000 mgr.x (mgr.24115) 484 : cluster [DBG] pgmap v912: 17 pgs: 17 active+clean; 136 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 199 KiB/s wr, 4 op/s 2020-11-16T22:08:47.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:47 smithi195 bash[10218]: cluster 2020-11-16T22:08:46.072454+0000 mon.a (mon.0) 1154 : cluster [DBG] osdmap e499: 12 total, 12 up, 12 in 2020-11-16T22:08:47.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:47 smithi057 bash[10301]: cluster 2020-11-16T22:08:45.711822+0000 mgr.x (mgr.24115) 484 : cluster [DBG] pgmap v912: 17 pgs: 17 active+clean; 136 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 199 KiB/s wr, 4 op/s 2020-11-16T22:08:47.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:47 smithi057 bash[10301]: cluster 2020-11-16T22:08:46.072454+0000 mon.a (mon.0) 1154 : cluster [DBG] osdmap e499: 12 total, 12 up, 12 in 2020-11-16T22:08:48.084 INFO:tasks.rados.rados.2.smithi057.stdout:1797: done (0 left) 2020-11-16T22:08:48.084 INFO:tasks.rados.rados.2.smithi057.stdout:1798: delete oid 4 current snap is 214 2020-11-16T22:08:48.091 INFO:tasks.rados.rados.2.smithi057.stdout:1798: done (0 left) 2020-11-16T22:08:48.091 INFO:tasks.rados.rados.2.smithi057.stdout:1799: write oid 12 current snap is 214 2020-11-16T22:08:48.091 INFO:tasks.rados.rados.2.smithi057.stdout:1799: seq_num 610 ranges {652270=410130,1529310=493867} 2020-11-16T22:08:48.107 INFO:tasks.rados.rados.2.smithi057.stdout:1799: writing smithi05720651-12 from 652270 to 1062400 tid 1 2020-11-16T22:08:48.113 INFO:tasks.rados.rados.2.smithi057.stdout:1799: writing smithi05720651-12 from 1529310 to 2023177 tid 2 2020-11-16T22:08:48.113 INFO:tasks.rados.rados.2.smithi057.stdout:1800: copy_from oid 44 from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 214 2020-11-16T22:08:48.113 INFO:tasks.rados.rados.2.smithi057.stdout:1801: write (excl) oid 20 current snap is 214 2020-11-16T22:08:48.113 INFO:tasks.rados.rados.2.smithi057.stdout:1801: seq_num 611 ranges {669077=485379,1587792=681285} 2020-11-16T22:08:48.120 INFO:tasks.rados.rados.2.smithi057.stdout:1801: writing smithi05720651-20 from 669077 to 1154456 tid 1 2020-11-16T22:08:48.127 INFO:tasks.rados.rados.2.smithi057.stdout:1801: writing smithi05720651-20 from 1587792 to 2269077 tid 2 2020-11-16T22:08:48.127 INFO:tasks.rados.rados.2.smithi057.stdout:1802: read oid 48 snap -1 2020-11-16T22:08:48.127 INFO:tasks.rados.rados.2.smithi057.stdout:1802: expect (ObjNum 542 snap 194 seq_num 542) 2020-11-16T22:08:48.127 INFO:tasks.rados.rados.2.smithi057.stdout:1803: rollback oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 214 2020-11-16T22:08:48.128 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 211 2020-11-16T22:08:48.128 INFO:tasks.rados.rados.2.smithi057.stdout:1799: finishing write tid 1 to smithi05720651-12 2020-11-16T22:08:48.128 INFO:tasks.rados.rados.2.smithi057.stdout:1799: finishing write tid 2 to smithi05720651-12 2020-11-16T22:08:48.128 INFO:tasks.rados.rados.2.smithi057.stdout:1799: finishing write tid 4 to smithi05720651-12 2020-11-16T22:08:48.128 INFO:tasks.rados.rados.2.smithi057.stdout:1799: finishing write tid 5 to smithi05720651-12 2020-11-16T22:08:48.128 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 1097 (ObjNum 610 snap 214 seq_num 610) dirty exists 2020-11-16T22:08:48.128 INFO:tasks.rados.rados.2.smithi057.stdout:1799: left oid 12 (ObjNum 610 snap 214 seq_num 610) 2020-11-16T22:08:48.129 INFO:tasks.rados.rados.2.smithi057.stdout:1801: finishing write tid 1 to smithi05720651-20 2020-11-16T22:08:48.129 INFO:tasks.rados.rados.2.smithi057.stdout:1799: done (4 left) 2020-11-16T22:08:48.129 INFO:tasks.rados.rados.2.smithi057.stdout:1804: delete oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 214 2020-11-16T22:08:48.131 INFO:tasks.rados.rados.2.smithi057.stdout:1800: finishing copy_from to smithi05720651-44 2020-11-16T22:08:48.132 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 962 (ObjNum 525 snap 188 seq_num 525) dirty exists 2020-11-16T22:08:48.132 INFO:tasks.rados.rados.2.smithi057.stdout:1800: finishing copy_from racing read to smithi05720651-44 2020-11-16T22:08:48.136 INFO:tasks.rados.rados.2.smithi057.stdout:1802: expect (ObjNum 542 snap 194 seq_num 542) 2020-11-16T22:08:48.236 INFO:tasks.rados.rados.2.smithi057.stdout:1801: finishing write tid 2 to smithi05720651-20 2020-11-16T22:08:48.236 INFO:tasks.rados.rados.2.smithi057.stdout:1801: finishing write tid 4 to smithi05720651-20 2020-11-16T22:08:48.237 INFO:tasks.rados.rados.2.smithi057.stdout:1801: finishing write tid 5 to smithi05720651-20 2020-11-16T22:08:48.237 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1104 (ObjNum 611 snap 214 seq_num 611) dirty exists 2020-11-16T22:08:48.237 INFO:tasks.rados.rados.2.smithi057.stdout:1801: left oid 20 (ObjNum 611 snap 214 seq_num 611) 2020-11-16T22:08:48.237 INFO:tasks.rados.rados.2.smithi057.stdout:1803: finishing rollback tid 0 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:48.237 INFO:tasks.rados.rados.2.smithi057.stdout:1803: finishing rollback tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:48.237 INFO:tasks.rados.rados.2.smithi057.stdout:1800: done (4 left) 2020-11-16T22:08:48.237 INFO:tasks.rados.rados.2.smithi057.stdout:1801: done (3 left) 2020-11-16T22:08:48.238 INFO:tasks.rados.rados.2.smithi057.stdout:1802: done (2 left) 2020-11-16T22:08:48.238 INFO:tasks.rados.rados.2.smithi057.stdout:1804: done (1 left) 2020-11-16T22:08:48.238 INFO:tasks.rados.rados.2.smithi057.stdout:1805: snap_remove snap 212 2020-11-16T22:08:48.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:48 smithi016 bash[10302]: cluster 2020-11-16T22:08:47.083093+0000 mon.a (mon.0) 1155 : cluster [DBG] osdmap e500: 12 total, 12 up, 12 in 2020-11-16T22:08:48.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:48 smithi195 bash[10218]: cluster 2020-11-16T22:08:47.083093+0000 mon.a (mon.0) 1155 : cluster [DBG] osdmap e500: 12 total, 12 up, 12 in 2020-11-16T22:08:48.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:48 smithi057 bash[10301]: cluster 2020-11-16T22:08:47.083093+0000 mon.a (mon.0) 1155 : cluster [DBG] osdmap e500: 12 total, 12 up, 12 in 2020-11-16T22:08:49.094 INFO:tasks.rados.rados.2.smithi057.stdout:1805: done (1 left) 2020-11-16T22:08:49.094 INFO:tasks.rados.rados.2.smithi057.stdout:1806: snap_remove snap 213 2020-11-16T22:08:49.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:49 smithi016 bash[10302]: cluster 2020-11-16T22:08:47.712558+0000 mgr.x (mgr.24115) 485 : cluster [DBG] pgmap v915: 17 pgs: 17 active+clean; 126 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2020-11-16T22:08:49.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:49 smithi016 bash[10302]: cluster 2020-11-16T22:08:48.093087+0000 mon.a (mon.0) 1156 : cluster [DBG] osdmap e501: 12 total, 12 up, 12 in 2020-11-16T22:08:49.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:49 smithi195 bash[10218]: cluster 2020-11-16T22:08:47.712558+0000 mgr.x (mgr.24115) 485 : cluster [DBG] pgmap v915: 17 pgs: 17 active+clean; 126 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2020-11-16T22:08:49.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:49 smithi195 bash[10218]: cluster 2020-11-16T22:08:48.093087+0000 mon.a (mon.0) 1156 : cluster [DBG] osdmap e501: 12 total, 12 up, 12 in 2020-11-16T22:08:49.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:49 smithi057 bash[10301]: cluster 2020-11-16T22:08:47.712558+0000 mgr.x (mgr.24115) 485 : cluster [DBG] pgmap v915: 17 pgs: 17 active+clean; 126 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.1 MiB/s wr, 9 op/s 2020-11-16T22:08:49.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:49 smithi057 bash[10301]: cluster 2020-11-16T22:08:48.093087+0000 mon.a (mon.0) 1156 : cluster [DBG] osdmap e501: 12 total, 12 up, 12 in 2020-11-16T22:08:50.024 INFO:tasks.rados.rados.2.smithi057.stdout:1806: done (1 left) 2020-11-16T22:08:50.024 INFO:tasks.rados.rados.2.smithi057.stdout:1807: rollback oid 8 current snap is 214 2020-11-16T22:08:50.024 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 8 to 211 2020-11-16T22:08:50.025 INFO:tasks.rados.rados.2.smithi057.stdout:1803: finishing rollback tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:50.025 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1502 (ObjNum 522 snap 188 seq_num 522) dirty exists 2020-11-16T22:08:50.025 INFO:tasks.rados.rados.2.smithi057.stdout:1803: done (1 left) 2020-11-16T22:08:50.025 INFO:tasks.rados.rados.2.smithi057.stdout:1808: rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 214 2020-11-16T22:08:50.025 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 211 2020-11-16T22:08:50.025 INFO:tasks.rados.rados.2.smithi057.stdout:1809: write (excl) oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 214 2020-11-16T22:08:50.025 INFO:tasks.rados.rados.2.smithi057.stdout:1809: seq_num 613 ranges {702691=635877,2104756=197935} 2020-11-16T22:08:50.040 INFO:tasks.rados.rados.2.smithi057.stdout:1809: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 702691 to 1338568 tid 1 2020-11-16T22:08:50.045 INFO:tasks.rados.rados.2.smithi057.stdout:1809: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2104756 to 2302691 tid 2 2020-11-16T22:08:50.046 INFO:tasks.rados.rados.2.smithi057.stdout:1810: snap_create 2020-11-16T22:08:50.046 INFO:tasks.rados.rados.2.smithi057.stdout:1807: finishing rollback tid 0 to smithi05720651-8 2020-11-16T22:08:50.046 INFO:tasks.rados.rados.2.smithi057.stdout:1807: finishing rollback tid 1 to smithi05720651-8 2020-11-16T22:08:50.046 INFO:tasks.rados.rados.2.smithi057.stdout:1807: finishing rollback tid 2 to smithi05720651-8 2020-11-16T22:08:50.046 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 1521 (ObjNum 548 snap 199 seq_num 548) dirty exists 2020-11-16T22:08:50.046 INFO:tasks.rados.rados.2.smithi057.stdout:1808: finishing rollback tid 0 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:50.047 INFO:tasks.rados.rados.2.smithi057.stdout:1808: finishing rollback tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:50.047 INFO:tasks.rados.rados.2.smithi057.stdout:1808: finishing rollback tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:50.047 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1357 (ObjNum 596 snap 209 seq_num 596) dirty exists 2020-11-16T22:08:50.047 INFO:tasks.rados.rados.2.smithi057.stdout:1809: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:50.048 INFO:tasks.rados.rados.2.smithi057.stdout:1809: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:50.049 INFO:tasks.rados.rados.2.smithi057.stdout:1809: finishing write tid 4 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:50.050 INFO:tasks.rados.rados.2.smithi057.stdout:1809: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:50.050 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1309 (ObjNum 613 snap 214 seq_num 613) dirty exists 2020-11-16T22:08:50.050 INFO:tasks.rados.rados.2.smithi057.stdout:1809: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 613 snap 214 seq_num 613) 2020-11-16T22:08:50.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:50 smithi195 bash[10218]: cluster 2020-11-16T22:08:49.102090+0000 mon.a (mon.0) 1157 : cluster [DBG] osdmap e502: 12 total, 12 up, 12 in 2020-11-16T22:08:50.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:50 smithi195 bash[10218]: cluster 2020-11-16T22:08:50.035192+0000 mon.a (mon.0) 1158 : cluster [DBG] osdmap e503: 12 total, 12 up, 12 in 2020-11-16T22:08:50.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:50 smithi057 bash[10301]: cluster 2020-11-16T22:08:49.102090+0000 mon.a (mon.0) 1157 : cluster [DBG] osdmap e502: 12 total, 12 up, 12 in 2020-11-16T22:08:50.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:50 smithi057 bash[10301]: cluster 2020-11-16T22:08:50.035192+0000 mon.a (mon.0) 1158 : cluster [DBG] osdmap e503: 12 total, 12 up, 12 in 2020-11-16T22:08:50.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:50 smithi016 bash[10302]: cluster 2020-11-16T22:08:49.102090+0000 mon.a (mon.0) 1157 : cluster [DBG] osdmap e502: 12 total, 12 up, 12 in 2020-11-16T22:08:50.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:50 smithi016 bash[10302]: cluster 2020-11-16T22:08:50.035192+0000 mon.a (mon.0) 1158 : cluster [DBG] osdmap e503: 12 total, 12 up, 12 in 2020-11-16T22:08:51.033 INFO:tasks.rados.rados.2.smithi057.stdout:1807: done (3 left) 2020-11-16T22:08:51.033 INFO:tasks.rados.rados.2.smithi057.stdout:1808: done (2 left) 2020-11-16T22:08:51.033 INFO:tasks.rados.rados.2.smithi057.stdout:1809: done (1 left) 2020-11-16T22:08:51.033 INFO:tasks.rados.rados.2.smithi057.stdout:1810: done (0 left) 2020-11-16T22:08:51.034 INFO:tasks.rados.rados.2.smithi057.stdout:1811: write oid 38 current snap is 215 2020-11-16T22:08:51.034 INFO:tasks.rados.rados.2.smithi057.stdout:1811: seq_num 614 ranges {719498=711126,2046885=272613} 2020-11-16T22:08:51.050 INFO:tasks.rados.rados.2.smithi057.stdout:1811: writing smithi05720651-38 from 719498 to 1430624 tid 1 2020-11-16T22:08:51.055 INFO:tasks.rados.rados.2.smithi057.stdout:1811: writing smithi05720651-38 from 2046885 to 2319498 tid 2 2020-11-16T22:08:51.056 INFO:tasks.rados.rados.2.smithi057.stdout:1812: copy_from oid 14 from oid 10 current snap is 215 2020-11-16T22:08:51.056 INFO:tasks.rados.rados.2.smithi057.stdout:1813: snap_create 2020-11-16T22:08:51.061 INFO:tasks.rados.rados.2.smithi057.stdout:1811: finishing write tid 1 to smithi05720651-38 2020-11-16T22:08:51.061 INFO:tasks.rados.rados.2.smithi057.stdout:1811: finishing write tid 2 to smithi05720651-38 2020-11-16T22:08:51.061 INFO:tasks.rados.rados.2.smithi057.stdout:1811: finishing write tid 4 to smithi05720651-38 2020-11-16T22:08:51.062 INFO:tasks.rados.rados.2.smithi057.stdout:1811: finishing write tid 5 to smithi05720651-38 2020-11-16T22:08:51.062 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 1122 (ObjNum 614 snap 215 seq_num 614) dirty exists 2020-11-16T22:08:51.062 INFO:tasks.rados.rados.2.smithi057.stdout:1811: left oid 38 (ObjNum 614 snap 215 seq_num 614) 2020-11-16T22:08:51.096 INFO:tasks.rados.rados.2.smithi057.stdout:1812: finishing copy_from to smithi05720651-14 2020-11-16T22:08:51.096 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 962 (ObjNum 525 snap 188 seq_num 525) dirty exists 2020-11-16T22:08:51.097 INFO:tasks.rados.rados.2.smithi057.stdout:1812: finishing copy_from racing read to smithi05720651-14 2020-11-16T22:08:51.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:51 smithi057 bash[10301]: cluster 2020-11-16T22:08:49.713291+0000 mgr.x (mgr.24115) 486 : cluster [DBG] pgmap v918: 17 pgs: 17 active+clean; 126 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 1.1 MiB/s wr, 6 op/s 2020-11-16T22:08:51.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:51 smithi057 bash[10301]: cluster 2020-11-16T22:08:51.044711+0000 mon.a (mon.0) 1159 : cluster [DBG] osdmap e504: 12 total, 12 up, 12 in 2020-11-16T22:08:51.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:51 smithi016 bash[10302]: cluster 2020-11-16T22:08:49.713291+0000 mgr.x (mgr.24115) 486 : cluster [DBG] pgmap v918: 17 pgs: 17 active+clean; 126 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 1.1 MiB/s wr, 6 op/s 2020-11-16T22:08:51.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:51 smithi016 bash[10302]: cluster 2020-11-16T22:08:51.044711+0000 mon.a (mon.0) 1159 : cluster [DBG] osdmap e504: 12 total, 12 up, 12 in 2020-11-16T22:08:51.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:51 smithi195 bash[10218]: cluster 2020-11-16T22:08:49.713291+0000 mgr.x (mgr.24115) 486 : cluster [DBG] pgmap v918: 17 pgs: 17 active+clean; 126 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 1.1 MiB/s wr, 6 op/s 2020-11-16T22:08:51.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:51 smithi195 bash[10218]: cluster 2020-11-16T22:08:51.044711+0000 mon.a (mon.0) 1159 : cluster [DBG] osdmap e504: 12 total, 12 up, 12 in 2020-11-16T22:08:52.035 INFO:tasks.rados.rados.2.smithi057.stdout:1811: done (2 left) 2020-11-16T22:08:52.036 INFO:tasks.rados.rados.2.smithi057.stdout:1812: done (1 left) 2020-11-16T22:08:52.036 INFO:tasks.rados.rados.2.smithi057.stdout:1813: done (0 left) 2020-11-16T22:08:52.036 INFO:tasks.rados.rados.2.smithi057.stdout:1814: read oid 10 snap -1 2020-11-16T22:08:52.036 INFO:tasks.rados.rados.2.smithi057.stdout:1814: expect (ObjNum 525 snap 188 seq_num 525) 2020-11-16T22:08:52.036 INFO:tasks.rados.rados.2.smithi057.stdout:1815: read oid 2 snap -1 2020-11-16T22:08:52.036 INFO:tasks.rados.rados.2.smithi057.stdout:1815: expect (ObjNum 496 snap 177 seq_num 496) 2020-11-16T22:08:52.037 INFO:tasks.rados.rados.2.smithi057.stdout:1816: rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 216 2020-11-16T22:08:52.037 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 215 2020-11-16T22:08:52.037 INFO:tasks.rados.rados.2.smithi057.stdout:1817: snap_remove snap 214 2020-11-16T22:08:53.044 INFO:tasks.rados.rados.2.smithi057.stdout:1817: done (3 left) 2020-11-16T22:08:53.045 INFO:tasks.rados.rados.2.smithi057.stdout:1818: read oid 48 snap -1 2020-11-16T22:08:53.045 INFO:tasks.rados.rados.2.smithi057.stdout:1818: expect (ObjNum 542 snap 194 seq_num 542) 2020-11-16T22:08:53.045 INFO:tasks.rados.rados.2.smithi057.stdout:1819: write oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 216 2020-11-16T22:08:53.045 INFO:tasks.rados.rados.2.smithi057.stdout:1819: seq_num 615 ranges {736305=786375,2105367=230938} 2020-11-16T22:08:53.060 INFO:tasks.rados.rados.2.smithi057.stdout:1819: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 736305 to 1522680 tid 1 2020-11-16T22:08:53.066 INFO:tasks.rados.rados.2.smithi057.stdout:1819: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2105367 to 2336305 tid 2 2020-11-16T22:08:53.066 INFO:tasks.rados.rados.2.smithi057.stdout:1820: write (excl) oid 30 current snap is 216 2020-11-16T22:08:53.066 INFO:tasks.rados.rados.2.smithi057.stdout:1820: seq_num 616 ranges {753112=577977,1880202=472910} 2020-11-16T22:08:53.073 INFO:tasks.rados.rados.2.smithi057.stdout:1820: writing smithi05720651-30 from 753112 to 1331089 tid 1 2020-11-16T22:08:53.079 INFO:tasks.rados.rados.2.smithi057.stdout:1820: writing smithi05720651-30 from 1880202 to 2353112 tid 2 2020-11-16T22:08:53.079 INFO:tasks.rados.rados.2.smithi057.stdout:1821: write oid 24 current snap is 216 2020-11-16T22:08:53.079 INFO:tasks.rados.rados.2.smithi057.stdout:1821: seq_num 617 ranges {769919=653226,1938684=431235} 2020-11-16T22:08:53.087 INFO:tasks.rados.rados.2.smithi057.stdout:1821: writing smithi05720651-24 from 769919 to 1423145 tid 1 2020-11-16T22:08:53.093 INFO:tasks.rados.rados.2.smithi057.stdout:1821: writing smithi05720651-24 from 1938684 to 2369919 tid 2 2020-11-16T22:08:53.093 INFO:tasks.rados.rados.2.smithi057.stdout:1822: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 211 2020-11-16T22:08:53.093 INFO:tasks.rados.rados.2.smithi057.stdout:1822: expect (ObjNum 582 snap 207 seq_num 582) 2020-11-16T22:08:53.093 INFO:tasks.rados.rados.2.smithi057.stdout:1823: rollback oid 32 current snap is 216 2020-11-16T22:08:53.093 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 32 to 215 2020-11-16T22:08:53.094 INFO:tasks.rados.rados.2.smithi057.stdout:1816: finishing rollback tid 0 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:53.094 INFO:tasks.rados.rados.2.smithi057.stdout:1816: finishing rollback tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:53.094 INFO:tasks.rados.rados.2.smithi057.stdout:1824: snap_create 2020-11-16T22:08:53.094 INFO:tasks.rados.rados.2.smithi057.stdout:1816: finishing rollback tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:53.094 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1458 (ObjNum 598 snap 210 seq_num 598) dirty exists 2020-11-16T22:08:53.094 INFO:tasks.rados.rados.2.smithi057.stdout:1815: expect (ObjNum 496 snap 177 seq_num 496) 2020-11-16T22:08:53.177 INFO:tasks.rados.rados.2.smithi057.stdout:1814: expect (ObjNum 525 snap 188 seq_num 525) 2020-11-16T22:08:53.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:53 smithi016 bash[10302]: cluster 2020-11-16T22:08:51.714088+0000 mgr.x (mgr.24115) 487 : cluster [DBG] pgmap v921: 17 pgs: 17 active+clean; 138 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 10 op/s 2020-11-16T22:08:53.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:53 smithi016 bash[10302]: cluster 2020-11-16T22:08:52.046960+0000 mon.a (mon.0) 1160 : cluster [DBG] osdmap e505: 12 total, 12 up, 12 in 2020-11-16T22:08:53.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:53 smithi195 bash[10218]: cluster 2020-11-16T22:08:51.714088+0000 mgr.x (mgr.24115) 487 : cluster [DBG] pgmap v921: 17 pgs: 17 active+clean; 138 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 10 op/s 2020-11-16T22:08:53.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:53 smithi195 bash[10218]: cluster 2020-11-16T22:08:52.046960+0000 mon.a (mon.0) 1160 : cluster [DBG] osdmap e505: 12 total, 12 up, 12 in 2020-11-16T22:08:53.376 INFO:tasks.rados.rados.2.smithi057.stdout:1818: expect (ObjNum 542 snap 194 seq_num 542) 2020-11-16T22:08:53.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:53 smithi057 bash[10301]: cluster 2020-11-16T22:08:51.714088+0000 mgr.x (mgr.24115) 487 : cluster [DBG] pgmap v921: 17 pgs: 17 active+clean; 138 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 10 op/s 2020-11-16T22:08:53.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:53 smithi057 bash[10301]: cluster 2020-11-16T22:08:52.046960+0000 mon.a (mon.0) 1160 : cluster [DBG] osdmap e505: 12 total, 12 up, 12 in 2020-11-16T22:08:53.470 INFO:tasks.rados.rados.2.smithi057.stdout:1819: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:53.470 INFO:tasks.rados.rados.2.smithi057.stdout:1819: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:53.471 INFO:tasks.rados.rados.2.smithi057.stdout:1819: finishing write tid 4 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:53.471 INFO:tasks.rados.rados.2.smithi057.stdout:1820: finishing write tid 1 to smithi05720651-30 2020-11-16T22:08:53.471 INFO:tasks.rados.rados.2.smithi057.stdout:1820: finishing write tid 2 to smithi05720651-30 2020-11-16T22:08:53.471 INFO:tasks.rados.rados.2.smithi057.stdout:1820: finishing write tid 4 to smithi05720651-30 2020-11-16T22:08:53.471 INFO:tasks.rados.rados.2.smithi057.stdout:1820: finishing write tid 5 to smithi05720651-30 2020-11-16T22:08:53.471 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 1360 (ObjNum 616 snap 216 seq_num 616) dirty exists 2020-11-16T22:08:53.472 INFO:tasks.rados.rados.2.smithi057.stdout:1820: left oid 30 (ObjNum 616 snap 216 seq_num 616) 2020-11-16T22:08:53.472 INFO:tasks.rados.rados.2.smithi057.stdout:1821: finishing write tid 1 to smithi05720651-24 2020-11-16T22:08:53.472 INFO:tasks.rados.rados.2.smithi057.stdout:1823: finishing rollback tid 0 to smithi05720651-32 2020-11-16T22:08:53.472 INFO:tasks.rados.rados.2.smithi057.stdout:1821: finishing write tid 2 to smithi05720651-24 2020-11-16T22:08:53.472 INFO:tasks.rados.rados.2.smithi057.stdout:1821: finishing write tid 4 to smithi05720651-24 2020-11-16T22:08:53.472 INFO:tasks.rados.rados.2.smithi057.stdout:1821: finishing write tid 5 to smithi05720651-24 2020-11-16T22:08:53.472 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 1524 (ObjNum 617 snap 216 seq_num 617) dirty exists 2020-11-16T22:08:53.473 INFO:tasks.rados.rados.2.smithi057.stdout:1821: left oid 24 (ObjNum 617 snap 216 seq_num 617) 2020-11-16T22:08:53.473 INFO:tasks.rados.rados.2.smithi057.stdout:1823: finishing rollback tid 1 to smithi05720651-32 2020-11-16T22:08:53.473 INFO:tasks.rados.rados.2.smithi057.stdout:1823: finishing rollback tid 2 to smithi05720651-32 2020-11-16T22:08:53.473 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 1596 (ObjNum 592 snap 207 seq_num 592) dirty exists 2020-11-16T22:08:53.473 INFO:tasks.rados.rados.2.smithi057.stdout:1822: expect (ObjNum 582 snap 207 seq_num 582) 2020-11-16T22:08:53.878 INFO:tasks.rados.rados.2.smithi057.stdout:1819: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:53.879 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1510 (ObjNum 615 snap 216 seq_num 615) dirty exists 2020-11-16T22:08:53.879 INFO:tasks.rados.rados.2.smithi057.stdout:1819: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 615 snap 216 seq_num 615) 2020-11-16T22:08:54.055 INFO:tasks.rados.rados.2.smithi057.stdout:1814: done (9 left) 2020-11-16T22:08:54.055 INFO:tasks.rados.rados.2.smithi057.stdout:1815: done (8 left) 2020-11-16T22:08:54.055 INFO:tasks.rados.rados.2.smithi057.stdout:1816: done (7 left) 2020-11-16T22:08:54.055 INFO:tasks.rados.rados.2.smithi057.stdout:1818: done (6 left) 2020-11-16T22:08:54.056 INFO:tasks.rados.rados.2.smithi057.stdout:1819: done (5 left) 2020-11-16T22:08:54.056 INFO:tasks.rados.rados.2.smithi057.stdout:1820: done (4 left) 2020-11-16T22:08:54.056 INFO:tasks.rados.rados.2.smithi057.stdout:1821: done (3 left) 2020-11-16T22:08:54.056 INFO:tasks.rados.rados.2.smithi057.stdout:1822: done (2 left) 2020-11-16T22:08:54.056 INFO:tasks.rados.rados.2.smithi057.stdout:1823: done (1 left) 2020-11-16T22:08:54.056 INFO:tasks.rados.rados.2.smithi057.stdout:1824: done (0 left) 2020-11-16T22:08:54.056 INFO:tasks.rados.rados.2.smithi057.stdout:1825: read oid 38 snap -1 2020-11-16T22:08:54.057 INFO:tasks.rados.rados.2.smithi057.stdout:1825: expect (ObjNum 614 snap 215 seq_num 614) 2020-11-16T22:08:54.057 INFO:tasks.rados.rados.2.smithi057.stdout:1826: snap_remove snap 211 2020-11-16T22:08:54.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:54 smithi016 bash[10302]: cluster 2020-11-16T22:08:53.056282+0000 mon.a (mon.0) 1161 : cluster [DBG] osdmap e506: 12 total, 12 up, 12 in 2020-11-16T22:08:54.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:54 smithi195 bash[10218]: cluster 2020-11-16T22:08:53.056282+0000 mon.a (mon.0) 1161 : cluster [DBG] osdmap e506: 12 total, 12 up, 12 in 2020-11-16T22:08:54.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:54 smithi057 bash[10301]: cluster 2020-11-16T22:08:53.056282+0000 mon.a (mon.0) 1161 : cluster [DBG] osdmap e506: 12 total, 12 up, 12 in 2020-11-16T22:08:55.024 INFO:tasks.rados.rados.2.smithi057.stdout:1826: done (1 left) 2020-11-16T22:08:55.025 INFO:tasks.rados.rados.2.smithi057.stdout:1827: write (excl) oid 22 current snap is 217 2020-11-16T22:08:55.025 INFO:tasks.rados.rados.2.smithi057.stdout:1827: seq_num 618 ranges {786726=728475,2280813=105913} 2020-11-16T22:08:55.040 INFO:tasks.rados.rados.2.smithi057.stdout:1827: writing smithi05720651-22 from 786726 to 1515201 tid 1 2020-11-16T22:08:55.046 INFO:tasks.rados.rados.2.smithi057.stdout:1827: writing smithi05720651-22 from 2280813 to 2386726 tid 2 2020-11-16T22:08:55.046 INFO:tasks.rados.rados.2.smithi057.stdout:1828: snap_remove snap 215 2020-11-16T22:08:55.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:55 smithi016 bash[10302]: cluster 2020-11-16T22:08:53.714870+0000 mgr.x (mgr.24115) 488 : cluster [DBG] pgmap v924: 17 pgs: 17 active+clean; 138 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.9 MiB/s wr, 15 op/s 2020-11-16T22:08:55.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:55 smithi016 bash[10302]: cluster 2020-11-16T22:08:54.066338+0000 mon.a (mon.0) 1162 : cluster [DBG] osdmap e507: 12 total, 12 up, 12 in 2020-11-16T22:08:55.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:55 smithi016 bash[10302]: cluster 2020-11-16T22:08:55.035895+0000 mon.a (mon.0) 1163 : cluster [DBG] osdmap e508: 12 total, 12 up, 12 in 2020-11-16T22:08:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:55 smithi195 bash[10218]: cluster 2020-11-16T22:08:53.714870+0000 mgr.x (mgr.24115) 488 : cluster [DBG] pgmap v924: 17 pgs: 17 active+clean; 138 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.9 MiB/s wr, 15 op/s 2020-11-16T22:08:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:55 smithi195 bash[10218]: cluster 2020-11-16T22:08:54.066338+0000 mon.a (mon.0) 1162 : cluster [DBG] osdmap e507: 12 total, 12 up, 12 in 2020-11-16T22:08:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:55 smithi195 bash[10218]: cluster 2020-11-16T22:08:55.035895+0000 mon.a (mon.0) 1163 : cluster [DBG] osdmap e508: 12 total, 12 up, 12 in 2020-11-16T22:08:55.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:55 smithi057 bash[10301]: cluster 2020-11-16T22:08:53.714870+0000 mgr.x (mgr.24115) 488 : cluster [DBG] pgmap v924: 17 pgs: 17 active+clean; 138 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 3.9 MiB/s wr, 15 op/s 2020-11-16T22:08:55.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:55 smithi057 bash[10301]: cluster 2020-11-16T22:08:54.066338+0000 mon.a (mon.0) 1162 : cluster [DBG] osdmap e507: 12 total, 12 up, 12 in 2020-11-16T22:08:55.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:55 smithi057 bash[10301]: cluster 2020-11-16T22:08:55.035895+0000 mon.a (mon.0) 1163 : cluster [DBG] osdmap e508: 12 total, 12 up, 12 in 2020-11-16T22:08:55.445 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:08:55 smithi057 bash[19569]: debug 2020-11-16T22:08:55.061+0000 7f5e12117700 -1 osd.11 pg_epoch: 508 pg[2.a( v 503'519 (0'0,503'519] local-lis/les=71/72 n=5 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [11,3] r=0 lpr=71 crt=503'519 lcod 503'517 mlcod 503'517 active+clean+snaptrim trimq=[1a7~1] ps=[1aa~1,1ad~1]] removing snap head 2020-11-16T22:08:56.035 INFO:tasks.rados.rados.2.smithi057.stdout:1828: done (2 left) 2020-11-16T22:08:56.035 INFO:tasks.rados.rados.2.smithi057.stdout:1829: snap_remove snap 216 2020-11-16T22:08:56.349 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:08:55 smithi195 bash[18679]: debug 2020-11-16T22:08:55.920+0000 7f9947e08700 -1 osd.1 pg_epoch: 508 pg[2.4( v 508'476 (0'0,508'476] local-lis/les=71/72 n=3 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,0] r=0 lpr=71 luod=502'474 crt=508'476 lcod 500'472 mlcod 500'472 active+clean+snaptrim trimq=[1a7~1] ps=[1aa~1,1ad~1]] removing snap head 2020-11-16T22:08:57.047 INFO:tasks.rados.rados.2.smithi057.stdout:1829: done (2 left) 2020-11-16T22:08:57.047 INFO:tasks.rados.rados.2.smithi057.stdout:1830: write oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 217 2020-11-16T22:08:57.047 INFO:tasks.rados.rados.2.smithi057.stdout:1830: seq_num 619 ranges {403533=403724,1539295=652201} 2020-11-16T22:08:57.050 INFO:tasks.rados.rados.2.smithi057.stdout:1830: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 403533 to 807257 tid 1 2020-11-16T22:08:57.059 INFO:tasks.rados.rados.2.smithi057.stdout:1830: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1539295 to 2191496 tid 2 2020-11-16T22:08:57.059 INFO:tasks.rados.rados.2.smithi057.stdout:1831: copy_from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 4 current snap is 217 2020-11-16T22:08:57.059 INFO:tasks.rados.rados.2.smithi057.stdout:1825: expect (ObjNum 614 snap 215 seq_num 614) 2020-11-16T22:08:57.171 INFO:tasks.rados.rados.2.smithi057.stdout:1827: finishing write tid 1 to smithi05720651-22 2020-11-16T22:08:57.171 INFO:tasks.rados.rados.2.smithi057.stdout:1827: finishing write tid 2 to smithi05720651-22 2020-11-16T22:08:57.171 INFO:tasks.rados.rados.2.smithi057.stdout:1827: finishing write tid 4 to smithi05720651-22 2020-11-16T22:08:57.171 INFO:tasks.rados.rados.2.smithi057.stdout:1827: finishing write tid 5 to smithi05720651-22 2020-11-16T22:08:57.172 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 1100 (ObjNum 618 snap 217 seq_num 618) dirty exists 2020-11-16T22:08:57.172 INFO:tasks.rados.rados.2.smithi057.stdout:1827: left oid 22 (ObjNum 618 snap 217 seq_num 618) 2020-11-16T22:08:57.172 INFO:tasks.rados.rados.2.smithi057.stdout:1830: finishing write tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:57.172 INFO:tasks.rados.rados.2.smithi057.stdout:1831: finishing copy_from to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:57.172 INFO:tasks.rados.rados.2.smithi057.stdout:1831: got expected ENOENT (src dne) 2020-11-16T22:08:57.172 INFO:tasks.rados.rados.2.smithi057.stdout:1831: finishing copy_from racing read to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:57.172 INFO:tasks.rados.rados.2.smithi057.stdout:1830: finishing write tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:57.173 INFO:tasks.rados.rados.2.smithi057.stdout:1830: finishing write tid 4 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:57.173 INFO:tasks.rados.rados.2.smithi057.stdout:1825: done (3 left) 2020-11-16T22:08:57.173 INFO:tasks.rados.rados.2.smithi057.stdout:1827: done (2 left) 2020-11-16T22:08:57.173 INFO:tasks.rados.rados.2.smithi057.stdout:1831: done (1 left) 2020-11-16T22:08:57.173 INFO:tasks.rados.rados.2.smithi057.stdout:1832: rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 217 2020-11-16T22:08:57.173 INFO:tasks.rados.rados.2.smithi057.stdout:1832: done (1 left) 2020-11-16T22:08:57.174 INFO:tasks.rados.rados.2.smithi057.stdout:1833: write oid 20 current snap is 217 2020-11-16T22:08:57.174 INFO:tasks.rados.rados.2.smithi057.stdout:1833: seq_num 620 ranges {420340=478973,1597777=512212} 2020-11-16T22:08:57.180 INFO:tasks.rados.rados.2.smithi057.stdout:1833: writing smithi05720651-20 from 420340 to 899313 tid 1 2020-11-16T22:08:57.190 INFO:tasks.rados.rados.2.smithi057.stdout:1833: writing smithi05720651-20 from 1597777 to 2109989 tid 2 2020-11-16T22:08:57.191 INFO:tasks.rados.rados.2.smithi057.stdout:1834: delete oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 217 2020-11-16T22:08:57.191 INFO:tasks.rados.rados.2.smithi057.stdout:1830: finishing write tid 5 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:57.191 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1363 (ObjNum 619 snap 217 seq_num 619) dirty exists 2020-11-16T22:08:57.191 INFO:tasks.rados.rados.2.smithi057.stdout:1830: left oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 619 snap 217 seq_num 619) 2020-11-16T22:08:57.192 INFO:tasks.rados.rados.2.smithi057.stdout:1833: finishing write tid 1 to smithi05720651-20 2020-11-16T22:08:57.194 INFO:tasks.rados.rados.2.smithi057.stdout:1830: done (2 left) 2020-11-16T22:08:57.194 INFO:tasks.rados.rados.2.smithi057.stdout:1834: done (1 left) 2020-11-16T22:08:57.195 INFO:tasks.rados.rados.2.smithi057.stdout:1835: write (excl) oid 34 current snap is 217 2020-11-16T22:08:57.195 INFO:tasks.rados.rados.2.smithi057.stdout:1835: seq_num 622 ranges {453954=629471,1598388=515881} 2020-11-16T22:08:57.200 INFO:tasks.rados.rados.2.smithi057.stdout:1835: writing smithi05720651-34 from 453954 to 1083425 tid 1 2020-11-16T22:08:57.207 INFO:tasks.rados.rados.2.smithi057.stdout:1835: writing smithi05720651-34 from 1598388 to 2114269 tid 2 2020-11-16T22:08:57.208 INFO:tasks.rados.rados.2.smithi057.stdout:1836: rollback oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 217 2020-11-16T22:08:57.208 INFO:tasks.rados.rados.2.smithi057.stdout:1836: done (2 left) 2020-11-16T22:08:57.208 INFO:tasks.rados.rados.2.smithi057.stdout:1837: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:08:57.208 INFO:tasks.rados.rados.2.smithi057.stdout:1837: expect (ObjNum 340 snap 115 seq_num 340) 2020-11-16T22:08:57.209 INFO:tasks.rados.rados.2.smithi057.stdout:1838: delete oid 16 current snap is 217 2020-11-16T22:08:57.209 INFO:tasks.rados.rados.2.smithi057.stdout:1833: finishing write tid 2 to smithi05720651-20 2020-11-16T22:08:57.209 INFO:tasks.rados.rados.2.smithi057.stdout:1833: finishing write tid 4 to smithi05720651-20 2020-11-16T22:08:57.209 INFO:tasks.rados.rados.2.smithi057.stdout:1833: finishing write tid 5 to smithi05720651-20 2020-11-16T22:08:57.209 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1107 (ObjNum 620 snap 217 seq_num 620) dirty exists 2020-11-16T22:08:57.209 INFO:tasks.rados.rados.2.smithi057.stdout:1833: left oid 20 (ObjNum 620 snap 217 seq_num 620) 2020-11-16T22:08:57.209 INFO:tasks.rados.rados.2.smithi057.stdout:1835: finishing write tid 1 to smithi05720651-34 2020-11-16T22:08:57.212 INFO:tasks.rados.rados.2.smithi057.stdout:1833: done (3 left) 2020-11-16T22:08:57.212 INFO:tasks.rados.rados.2.smithi057.stdout:1838: done (2 left) 2020-11-16T22:08:57.212 INFO:tasks.rados.rados.2.smithi057.stdout:1839: write oid 44 current snap is 217 2020-11-16T22:08:57.212 INFO:tasks.rados.rados.2.smithi057.stdout:1839: seq_num 624 ranges {487568=496322,1431705=519550} 2020-11-16T22:08:57.222 INFO:tasks.rados.rados.2.smithi057.stdout:1839: writing smithi05720651-44 from 487568 to 983890 tid 1 2020-11-16T22:08:57.228 INFO:tasks.rados.rados.2.smithi057.stdout:1839: writing smithi05720651-44 from 1431705 to 1951255 tid 2 2020-11-16T22:08:57.228 INFO:tasks.rados.rados.2.smithi057.stdout:1840: write (excl) oid 2 current snap is 217 2020-11-16T22:08:57.228 INFO:tasks.rados.rados.2.smithi057.stdout:1840: seq_num 625 ranges {504375=571571,1490187=663208} 2020-11-16T22:08:57.234 INFO:tasks.rados.rados.2.smithi057.stdout:1840: writing smithi05720651-2 from 504375 to 1075946 tid 1 2020-11-16T22:08:57.241 INFO:tasks.rados.rados.2.smithi057.stdout:1840: writing smithi05720651-2 from 1490187 to 2153395 tid 2 2020-11-16T22:08:57.241 INFO:tasks.rados.rados.2.smithi057.stdout:1841: snap_create 2020-11-16T22:08:57.241 INFO:tasks.rados.rados.2.smithi057.stdout:1835: finishing write tid 2 to smithi05720651-34 2020-11-16T22:08:57.241 INFO:tasks.rados.rados.2.smithi057.stdout:1835: finishing write tid 4 to smithi05720651-34 2020-11-16T22:08:57.241 INFO:tasks.rados.rados.2.smithi057.stdout:1835: finishing write tid 5 to smithi05720651-34 2020-11-16T22:08:57.241 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 1110 (ObjNum 622 snap 217 seq_num 622) dirty exists 2020-11-16T22:08:57.242 INFO:tasks.rados.rados.2.smithi057.stdout:1835: left oid 34 (ObjNum 622 snap 217 seq_num 622) 2020-11-16T22:08:57.242 INFO:tasks.rados.rados.2.smithi057.stdout:1837: expect (ObjNum 340 snap 115 seq_num 340) 2020-11-16T22:08:57.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:57 smithi016 bash[10302]: cluster 2020-11-16T22:08:55.715568+0000 mgr.x (mgr.24115) 489 : cluster [DBG] pgmap v927: 17 pgs: 17 active+clean; 144 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2020-11-16T22:08:57.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:57 smithi016 bash[10302]: cluster 2020-11-16T22:08:56.046961+0000 mon.a (mon.0) 1164 : cluster [DBG] osdmap e509: 12 total, 12 up, 12 in 2020-11-16T22:08:57.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:57 smithi195 bash[10218]: cluster 2020-11-16T22:08:55.715568+0000 mgr.x (mgr.24115) 489 : cluster [DBG] pgmap v927: 17 pgs: 17 active+clean; 144 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2020-11-16T22:08:57.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:57 smithi195 bash[10218]: cluster 2020-11-16T22:08:56.046961+0000 mon.a (mon.0) 1164 : cluster [DBG] osdmap e509: 12 total, 12 up, 12 in 2020-11-16T22:08:57.408 INFO:tasks.rados.rados.2.smithi057.stdout:1839: finishing write tid 1 to smithi05720651-44 2020-11-16T22:08:57.409 INFO:tasks.rados.rados.2.smithi057.stdout:1839: finishing write tid 2 to smithi05720651-44 2020-11-16T22:08:57.409 INFO:tasks.rados.rados.2.smithi057.stdout:1839: finishing write tid 4 to smithi05720651-44 2020-11-16T22:08:57.409 INFO:tasks.rados.rados.2.smithi057.stdout:1839: finishing write tid 5 to smithi05720651-44 2020-11-16T22:08:57.409 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 1103 (ObjNum 624 snap 217 seq_num 624) dirty exists 2020-11-16T22:08:57.409 INFO:tasks.rados.rados.2.smithi057.stdout:1839: left oid 44 (ObjNum 624 snap 217 seq_num 624) 2020-11-16T22:08:57.409 INFO:tasks.rados.rados.2.smithi057.stdout:1840: finishing write tid 1 to smithi05720651-2 2020-11-16T22:08:57.410 INFO:tasks.rados.rados.2.smithi057.stdout:1840: finishing write tid 2 to smithi05720651-2 2020-11-16T22:08:57.410 INFO:tasks.rados.rados.2.smithi057.stdout:1840: finishing write tid 4 to smithi05720651-2 2020-11-16T22:08:57.410 INFO:tasks.rados.rados.2.smithi057.stdout:1840: finishing write tid 5 to smithi05720651-2 2020-11-16T22:08:57.410 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 1607 (ObjNum 625 snap 217 seq_num 625) dirty exists 2020-11-16T22:08:57.410 INFO:tasks.rados.rados.2.smithi057.stdout:1840: left oid 2 (ObjNum 625 snap 217 seq_num 625) 2020-11-16T22:08:57.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:57 smithi057 bash[10301]: cluster 2020-11-16T22:08:55.715568+0000 mgr.x (mgr.24115) 489 : cluster [DBG] pgmap v927: 17 pgs: 17 active+clean; 144 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2020-11-16T22:08:57.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:57 smithi057 bash[10301]: cluster 2020-11-16T22:08:56.046961+0000 mon.a (mon.0) 1164 : cluster [DBG] osdmap e509: 12 total, 12 up, 12 in 2020-11-16T22:08:58.055 INFO:tasks.rados.rados.2.smithi057.stdout:1835: done (4 left) 2020-11-16T22:08:58.055 INFO:tasks.rados.rados.2.smithi057.stdout:1837: done (3 left) 2020-11-16T22:08:58.056 INFO:tasks.rados.rados.2.smithi057.stdout:1839: done (2 left) 2020-11-16T22:08:58.056 INFO:tasks.rados.rados.2.smithi057.stdout:1840: done (1 left) 2020-11-16T22:08:58.056 INFO:tasks.rados.rados.2.smithi057.stdout:1841: done (0 left) 2020-11-16T22:08:58.056 INFO:tasks.rados.rados.2.smithi057.stdout:1842: rollback oid 24 current snap is 218 2020-11-16T22:08:58.056 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 24 to 217 2020-11-16T22:08:58.056 INFO:tasks.rados.rados.2.smithi057.stdout:1843: copy_from oid 40 from oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 218 2020-11-16T22:08:58.057 INFO:tasks.rados.rados.2.smithi057.stdout:1844: write oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 218 2020-11-16T22:08:58.057 INFO:tasks.rados.rados.2.smithi057.stdout:1844: seq_num 626 ranges {521182=646820,1948669=523219} 2020-11-16T22:08:58.067 INFO:tasks.rados.rados.2.smithi057.stdout:1844: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 521182 to 1168002 tid 1 2020-11-16T22:08:58.076 INFO:tasks.rados.rados.2.smithi057.stdout:1844: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1948669 to 2471888 tid 2 2020-11-16T22:08:58.077 INFO:tasks.rados.rados.2.smithi057.stdout:1845: read oid 34 snap -1 2020-11-16T22:08:58.077 INFO:tasks.rados.rados.2.smithi057.stdout:1845: expect (ObjNum 622 snap 217 seq_num 622) 2020-11-16T22:08:58.077 INFO:tasks.rados.rados.2.smithi057.stdout:1846: read oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:08:58.077 INFO:tasks.rados.rados.2.smithi057.stdout:1846: expect deleted 2020-11-16T22:08:58.077 INFO:tasks.rados.rados.2.smithi057.stdout:1847: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 217 2020-11-16T22:08:58.077 INFO:tasks.rados.rados.2.smithi057.stdout:1847: expect (ObjNum 340 snap 115 seq_num 340) 2020-11-16T22:08:58.078 INFO:tasks.rados.rados.2.smithi057.stdout:1848: snap_create 2020-11-16T22:08:58.078 INFO:tasks.rados.rados.2.smithi057.stdout:1842: finishing rollback tid 0 to smithi05720651-24 2020-11-16T22:08:58.078 INFO:tasks.rados.rados.2.smithi057.stdout:1842: finishing rollback tid 1 to smithi05720651-24 2020-11-16T22:08:58.078 INFO:tasks.rados.rados.2.smithi057.stdout:1842: finishing rollback tid 2 to smithi05720651-24 2020-11-16T22:08:58.078 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 1527 (ObjNum 617 snap 216 seq_num 617) dirty exists 2020-11-16T22:08:58.080 INFO:tasks.rados.rados.2.smithi057.stdout:1843: finishing copy_from to smithi05720651-40 2020-11-16T22:08:58.080 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 1471 (ObjNum 522 snap 188 seq_num 522) dirty exists 2020-11-16T22:08:58.081 INFO:tasks.rados.rados.2.smithi057.stdout:1843: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:08:58.081 INFO:tasks.rados.rados.2.smithi057.stdout:1844: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:58.083 INFO:tasks.rados.rados.2.smithi057.stdout:1844: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:58.083 INFO:tasks.rados.rados.2.smithi057.stdout:1844: finishing write tid 4 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:58.084 INFO:tasks.rados.rados.2.smithi057.stdout:1844: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:08:58.084 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1613 (ObjNum 626 snap 218 seq_num 626) dirty exists 2020-11-16T22:08:58.084 INFO:tasks.rados.rados.2.smithi057.stdout:1844: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 626 snap 218 seq_num 626) 2020-11-16T22:08:58.088 INFO:tasks.rados.rados.2.smithi057.stdout:1845: expect (ObjNum 622 snap 217 seq_num 622) 2020-11-16T22:08:58.208 INFO:tasks.rados.rados.2.smithi057.stdout:1847: expect (ObjNum 340 snap 115 seq_num 340) 2020-11-16T22:08:58.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:58 smithi016 bash[10302]: cluster 2020-11-16T22:08:57.056331+0000 mon.a (mon.0) 1165 : cluster [DBG] osdmap e510: 12 total, 12 up, 12 in 2020-11-16T22:08:58.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:58 smithi195 bash[10218]: cluster 2020-11-16T22:08:57.056331+0000 mon.a (mon.0) 1165 : cluster [DBG] osdmap e510: 12 total, 12 up, 12 in 2020-11-16T22:08:58.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:58 smithi057 bash[10301]: cluster 2020-11-16T22:08:57.056331+0000 mon.a (mon.0) 1165 : cluster [DBG] osdmap e510: 12 total, 12 up, 12 in 2020-11-16T22:08:59.058 INFO:tasks.rados.rados.2.smithi057.stdout:1842: done (6 left) 2020-11-16T22:08:59.058 INFO:tasks.rados.rados.2.smithi057.stdout:1843: done (5 left) 2020-11-16T22:08:59.058 INFO:tasks.rados.rados.2.smithi057.stdout:1844: done (4 left) 2020-11-16T22:08:59.058 INFO:tasks.rados.rados.2.smithi057.stdout:1845: done (3 left) 2020-11-16T22:08:59.058 INFO:tasks.rados.rados.2.smithi057.stdout:1846: done (2 left) 2020-11-16T22:08:59.059 INFO:tasks.rados.rados.2.smithi057.stdout:1847: done (1 left) 2020-11-16T22:08:59.059 INFO:tasks.rados.rados.2.smithi057.stdout:1848: done (0 left) 2020-11-16T22:08:59.059 INFO:tasks.rados.rados.2.smithi057.stdout:1849: copy_from oid 50 from oid 12 current snap is 219 2020-11-16T22:08:59.059 INFO:tasks.rados.rados.2.smithi057.stdout:1850: rollback oid 38 current snap is 219 2020-11-16T22:08:59.059 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 38 to 217 2020-11-16T22:08:59.059 INFO:tasks.rados.rados.2.smithi057.stdout:1851: snap_remove snap 218 2020-11-16T22:08:59.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:59 smithi016 bash[10302]: cluster 2020-11-16T22:08:57.716296+0000 mgr.x (mgr.24115) 490 : cluster [DBG] pgmap v930: 17 pgs: 17 active+clean; 131 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 1.7 MiB/s wr, 21 op/s 2020-11-16T22:08:59.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:08:59 smithi016 bash[10302]: cluster 2020-11-16T22:08:58.066592+0000 mon.a (mon.0) 1166 : cluster [DBG] osdmap e511: 12 total, 12 up, 12 in 2020-11-16T22:08:59.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:59 smithi195 bash[10218]: cluster 2020-11-16T22:08:57.716296+0000 mgr.x (mgr.24115) 490 : cluster [DBG] pgmap v930: 17 pgs: 17 active+clean; 131 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 1.7 MiB/s wr, 21 op/s 2020-11-16T22:08:59.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:08:59 smithi195 bash[10218]: cluster 2020-11-16T22:08:58.066592+0000 mon.a (mon.0) 1166 : cluster [DBG] osdmap e511: 12 total, 12 up, 12 in 2020-11-16T22:08:59.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:59 smithi057 bash[10301]: cluster 2020-11-16T22:08:57.716296+0000 mgr.x (mgr.24115) 490 : cluster [DBG] pgmap v930: 17 pgs: 17 active+clean; 131 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 1.7 MiB/s wr, 21 op/s 2020-11-16T22:08:59.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:08:59 smithi057 bash[10301]: cluster 2020-11-16T22:08:58.066592+0000 mon.a (mon.0) 1166 : cluster [DBG] osdmap e511: 12 total, 12 up, 12 in 2020-11-16T22:09:00.026 INFO:tasks.rados.rados.2.smithi057.stdout:1851: done (2 left) 2020-11-16T22:09:00.027 INFO:tasks.rados.rados.2.smithi057.stdout:1852: write oid 16 current snap is 219 2020-11-16T22:09:00.027 INFO:tasks.rados.rados.2.smithi057.stdout:1852: seq_num 627 ranges {537989=722069,1890798=647191} 2020-11-16T22:09:00.039 INFO:tasks.rados.rados.2.smithi057.stdout:1852: writing smithi05720651-16 from 537989 to 1260058 tid 1 2020-11-16T22:09:00.047 INFO:tasks.rados.rados.2.smithi057.stdout:1852: writing smithi05720651-16 from 1890798 to 2537989 tid 2 2020-11-16T22:09:00.047 INFO:tasks.rados.rados.2.smithi057.stdout:1853: read oid 24 snap -1 2020-11-16T22:09:00.047 INFO:tasks.rados.rados.2.smithi057.stdout:1853: expect (ObjNum 617 snap 216 seq_num 617) 2020-11-16T22:09:00.048 INFO:tasks.rados.rados.2.smithi057.stdout:1854: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:00.048 INFO:tasks.rados.rados.2.smithi057.stdout:1854: expect deleted 2020-11-16T22:09:00.048 INFO:tasks.rados.rados.2.smithi057.stdout:1855: delete oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 219 2020-11-16T22:09:00.048 INFO:tasks.rados.rados.2.smithi057.stdout:1850: finishing rollback tid 0 to smithi05720651-38 2020-11-16T22:09:00.048 INFO:tasks.rados.rados.2.smithi057.stdout:1850: finishing rollback tid 1 to smithi05720651-38 2020-11-16T22:09:00.048 INFO:tasks.rados.rados.2.smithi057.stdout:1850: finishing rollback tid 2 to smithi05720651-38 2020-11-16T22:09:00.049 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 1125 (ObjNum 614 snap 215 seq_num 614) dirty exists 2020-11-16T22:09:00.049 INFO:tasks.rados.rados.2.smithi057.stdout:1849: finishing copy_from to smithi05720651-50 2020-11-16T22:09:00.049 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 1097 (ObjNum 610 snap 214 seq_num 610) dirty exists 2020-11-16T22:09:00.049 INFO:tasks.rados.rados.2.smithi057.stdout:1849: finishing copy_from racing read to smithi05720651-50 2020-11-16T22:09:00.054 INFO:tasks.rados.rados.2.smithi057.stdout:1852: finishing write tid 1 to smithi05720651-16 2020-11-16T22:09:00.054 INFO:tasks.rados.rados.2.smithi057.stdout:1852: finishing write tid 2 to smithi05720651-16 2020-11-16T22:09:00.054 INFO:tasks.rados.rados.2.smithi057.stdout:1852: finishing write tid 4 to smithi05720651-16 2020-11-16T22:09:00.056 INFO:tasks.rados.rados.2.smithi057.stdout:1852: finishing write tid 5 to smithi05720651-16 2020-11-16T22:09:00.056 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 1367 (ObjNum 627 snap 219 seq_num 627) dirty exists 2020-11-16T22:09:00.056 INFO:tasks.rados.rados.2.smithi057.stdout:1852: left oid 16 (ObjNum 627 snap 219 seq_num 627) 2020-11-16T22:09:00.059 INFO:tasks.rados.rados.2.smithi057.stdout:1849: done (5 left) 2020-11-16T22:09:00.059 INFO:tasks.rados.rados.2.smithi057.stdout:1850: done (4 left) 2020-11-16T22:09:00.060 INFO:tasks.rados.rados.2.smithi057.stdout:1852: done (3 left) 2020-11-16T22:09:00.060 INFO:tasks.rados.rados.2.smithi057.stdout:1854: done (2 left) 2020-11-16T22:09:00.060 INFO:tasks.rados.rados.2.smithi057.stdout:1855: done (1 left) 2020-11-16T22:09:00.060 INFO:tasks.rados.rados.2.smithi057.stdout:1856: read oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:00.060 INFO:tasks.rados.rados.2.smithi057.stdout:1856: expect (ObjNum 432 snap 145 seq_num 432) 2020-11-16T22:09:00.060 INFO:tasks.rados.rados.2.smithi057.stdout:1857: snap_remove snap 217 2020-11-16T22:09:00.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:00 smithi016 bash[10302]: cluster 2020-11-16T22:08:59.068443+0000 mon.a (mon.0) 1167 : cluster [DBG] osdmap e512: 12 total, 12 up, 12 in 2020-11-16T22:09:00.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:00 smithi016 bash[10302]: cluster 2020-11-16T22:09:00.037976+0000 mon.a (mon.0) 1168 : cluster [DBG] osdmap e513: 12 total, 12 up, 12 in 2020-11-16T22:09:00.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:00 smithi195 bash[10218]: cluster 2020-11-16T22:08:59.068443+0000 mon.a (mon.0) 1167 : cluster [DBG] osdmap e512: 12 total, 12 up, 12 in 2020-11-16T22:09:00.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:00 smithi195 bash[10218]: cluster 2020-11-16T22:09:00.037976+0000 mon.a (mon.0) 1168 : cluster [DBG] osdmap e513: 12 total, 12 up, 12 in 2020-11-16T22:09:00.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:00 smithi057 bash[10301]: cluster 2020-11-16T22:08:59.068443+0000 mon.a (mon.0) 1167 : cluster [DBG] osdmap e512: 12 total, 12 up, 12 in 2020-11-16T22:09:00.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:00 smithi057 bash[10301]: cluster 2020-11-16T22:09:00.037976+0000 mon.a (mon.0) 1168 : cluster [DBG] osdmap e513: 12 total, 12 up, 12 in 2020-11-16T22:09:01.037 INFO:tasks.rados.rados.2.smithi057.stdout:1857: done (2 left) 2020-11-16T22:09:01.038 INFO:tasks.rados.rados.2.smithi057.stdout:1858: snap_create 2020-11-16T22:09:01.038 INFO:tasks.rados.rados.2.smithi057.stdout:1853: expect (ObjNum 617 snap 216 seq_num 617) 2020-11-16T22:09:01.118 INFO:tasks.rados.rados.2.smithi057.stdout:1856: expect (ObjNum 432 snap 145 seq_num 432) 2020-11-16T22:09:01.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:01 smithi016 bash[10302]: cluster 2020-11-16T22:08:59.717005+0000 mgr.x (mgr.24115) 491 : cluster [DBG] pgmap v933: 17 pgs: 17 active+clean; 131 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 762 KiB/s wr, 11 op/s 2020-11-16T22:09:01.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:01 smithi016 bash[10302]: cluster 2020-11-16T22:09:01.049273+0000 mon.a (mon.0) 1169 : cluster [DBG] osdmap e514: 12 total, 12 up, 12 in 2020-11-16T22:09:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:01 smithi195 bash[10218]: cluster 2020-11-16T22:08:59.717005+0000 mgr.x (mgr.24115) 491 : cluster [DBG] pgmap v933: 17 pgs: 17 active+clean; 131 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 762 KiB/s wr, 11 op/s 2020-11-16T22:09:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:01 smithi195 bash[10218]: cluster 2020-11-16T22:09:01.049273+0000 mon.a (mon.0) 1169 : cluster [DBG] osdmap e514: 12 total, 12 up, 12 in 2020-11-16T22:09:01.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:01 smithi057 bash[10301]: cluster 2020-11-16T22:08:59.717005+0000 mgr.x (mgr.24115) 491 : cluster [DBG] pgmap v933: 17 pgs: 17 active+clean; 131 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 762 KiB/s wr, 11 op/s 2020-11-16T22:09:01.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:01 smithi057 bash[10301]: cluster 2020-11-16T22:09:01.049273+0000 mon.a (mon.0) 1169 : cluster [DBG] osdmap e514: 12 total, 12 up, 12 in 2020-11-16T22:09:02.040 INFO:tasks.rados.rados.2.smithi057.stdout:1853: done (2 left) 2020-11-16T22:09:02.040 INFO:tasks.rados.rados.2.smithi057.stdout:1856: done (1 left) 2020-11-16T22:09:02.041 INFO:tasks.rados.rados.2.smithi057.stdout:1858: done (0 left) 2020-11-16T22:09:02.041 INFO:tasks.rados.rados.2.smithi057.stdout:1859: rollback oid 42 current snap is 220 2020-11-16T22:09:02.041 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 42 to 219 2020-11-16T22:09:02.041 INFO:tasks.rados.rados.2.smithi057.stdout:1860: write (excl) oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 220 2020-11-16T22:09:02.041 INFO:tasks.rados.rados.2.smithi057.stdout:1860: seq_num 629 ranges {571603=472567,1607762=670546} 2020-11-16T22:09:02.051 INFO:tasks.rados.rados.2.smithi057.stdout:1860: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 571603 to 1044170 tid 1 2020-11-16T22:09:02.059 INFO:tasks.rados.rados.2.smithi057.stdout:1860: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1607762 to 2278308 tid 2 2020-11-16T22:09:02.059 INFO:tasks.rados.rados.2.smithi057.stdout:1861: delete oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 220 2020-11-16T22:09:02.060 INFO:tasks.rados.rados.2.smithi057.stdout:1859: finishing rollback tid 1 to smithi05720651-42 2020-11-16T22:09:02.060 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 0 (ObjNum 129 snap 0 seq_num 2932328800) dirty dne 2020-11-16T22:09:02.061 INFO:tasks.rados.rados.2.smithi057.stdout:1860: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:02.066 INFO:tasks.rados.rados.2.smithi057.stdout:1859: done (2 left) 2020-11-16T22:09:02.067 INFO:tasks.rados.rados.2.smithi057.stdout:1861: done (1 left) 2020-11-16T22:09:02.067 INFO:tasks.rados.rados.2.smithi057.stdout:1862: read oid 44 snap 219 2020-11-16T22:09:02.067 INFO:tasks.rados.rados.2.smithi057.stdout:1862: expect (ObjNum 624 snap 217 seq_num 624) 2020-11-16T22:09:02.067 INFO:tasks.rados.rados.2.smithi057.stdout:1863: read oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:02.068 INFO:tasks.rados.rados.2.smithi057.stdout:1863: expect deleted 2020-11-16T22:09:02.068 INFO:tasks.rados.rados.2.smithi057.stdout:1864: read oid 16 snap -1 2020-11-16T22:09:02.068 INFO:tasks.rados.rados.2.smithi057.stdout:1864: expect (ObjNum 627 snap 219 seq_num 627) 2020-11-16T22:09:02.068 INFO:tasks.rados.rados.2.smithi057.stdout:1865: rollback oid 10 current snap is 220 2020-11-16T22:09:02.068 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 10 to 219 2020-11-16T22:09:02.068 INFO:tasks.rados.rados.2.smithi057.stdout:1866: read oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 219 2020-11-16T22:09:02.069 INFO:tasks.rados.rados.2.smithi057.stdout:1866: expect (ObjNum 552 snap 201 seq_num 552) 2020-11-16T22:09:02.069 INFO:tasks.rados.rados.2.smithi057.stdout:1867: read oid 2 snap -1 2020-11-16T22:09:02.069 INFO:tasks.rados.rados.2.smithi057.stdout:1867: expect (ObjNum 625 snap 217 seq_num 625) 2020-11-16T22:09:02.069 INFO:tasks.rados.rados.2.smithi057.stdout:1868: write oid 4 current snap is 220 2020-11-16T22:09:02.070 INFO:tasks.rados.rados.2.smithi057.stdout:1868: seq_num 631 ranges {605217=739418,2124726=480491} 2020-11-16T22:09:02.082 INFO:tasks.rados.rados.2.smithi057.stdout:1868: writing smithi05720651-4 from 605217 to 1344635 tid 1 2020-11-16T22:09:02.090 INFO:tasks.rados.rados.2.smithi057.stdout:1868: writing smithi05720651-4 from 2124726 to 2605217 tid 2 2020-11-16T22:09:02.090 INFO:tasks.rados.rados.2.smithi057.stdout:1869: write oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 220 2020-11-16T22:09:02.090 INFO:tasks.rados.rados.2.smithi057.stdout:1869: seq_num 632 ranges {622024=414667,1783208=417873} 2020-11-16T22:09:02.096 INFO:tasks.rados.rados.2.smithi057.stdout:1869: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 622024 to 1036691 tid 1 2020-11-16T22:09:02.103 INFO:tasks.rados.rados.2.smithi057.stdout:1869: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1783208 to 2201081 tid 2 2020-11-16T22:09:02.103 INFO:tasks.rados.rados.2.smithi057.stdout:1870: copy_from oid 20 from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 220 2020-11-16T22:09:02.104 INFO:tasks.rados.rados.2.smithi057.stdout:1860: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:02.104 INFO:tasks.rados.rados.2.smithi057.stdout:1860: finishing write tid 4 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:02.104 INFO:tasks.rados.rados.2.smithi057.stdout:1860: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:02.104 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1128 (ObjNum 629 snap 220 seq_num 629) dirty exists 2020-11-16T22:09:02.104 INFO:tasks.rados.rados.2.smithi057.stdout:1860: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 629 snap 220 seq_num 629) 2020-11-16T22:09:02.104 INFO:tasks.rados.rados.2.smithi057.stdout:1860: done (9 left) 2020-11-16T22:09:02.104 INFO:tasks.rados.rados.2.smithi057.stdout:1863: done (8 left) 2020-11-16T22:09:02.105 INFO:tasks.rados.rados.2.smithi057.stdout:1871: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:02.105 INFO:tasks.rados.rados.2.smithi057.stdout:1871: expect deleted 2020-11-16T22:09:02.105 INFO:tasks.rados.rados.2.smithi057.stdout:1872: read oid 12 snap -1 2020-11-16T22:09:02.105 INFO:tasks.rados.rados.2.smithi057.stdout:1872: expect (ObjNum 610 snap 214 seq_num 610) 2020-11-16T22:09:02.105 INFO:tasks.rados.rados.2.smithi057.stdout:1873: write (excl) oid 38 current snap is 220 2020-11-16T22:09:02.105 INFO:tasks.rados.rados.2.smithi057.stdout:1873: seq_num 633 ranges {638831=489916,1841690=677884} 2020-11-16T22:09:02.109 INFO:tasks.rados.rados.2.smithi057.stdout:1873: writing smithi05720651-38 from 638831 to 1128747 tid 1 2020-11-16T22:09:02.118 INFO:tasks.rados.rados.2.smithi057.stdout:1873: writing smithi05720651-38 from 1841690 to 2519574 tid 2 2020-11-16T22:09:02.118 INFO:tasks.rados.rados.2.smithi057.stdout:1874: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:02.118 INFO:tasks.rados.rados.2.smithi057.stdout:1874: expect (ObjNum 525 snap 188 seq_num 525) 2020-11-16T22:09:02.119 INFO:tasks.rados.rados.2.smithi057.stdout:1875: write (excl) oid 24 current snap is 220 2020-11-16T22:09:02.119 INFO:tasks.rados.rados.2.smithi057.stdout:1875: seq_num 634 ranges {655638=565165,1900172=421542} 2020-11-16T22:09:02.124 INFO:tasks.rados.rados.2.smithi057.stdout:1875: writing smithi05720651-24 from 655638 to 1220803 tid 1 2020-11-16T22:09:02.131 INFO:tasks.rados.rados.2.smithi057.stdout:1875: writing smithi05720651-24 from 1900172 to 2321714 tid 2 2020-11-16T22:09:02.131 INFO:tasks.rados.rados.2.smithi057.stdout:1876: copy_from oid 50 from oid 8 current snap is 220 2020-11-16T22:09:02.131 INFO:tasks.rados.rados.2.smithi057.stdout:1862: expect (ObjNum 624 snap 217 seq_num 624) 2020-11-16T22:09:02.328 INFO:tasks.rados.rados.2.smithi057.stdout:1865: finishing rollback tid 0 to smithi05720651-10 2020-11-16T22:09:02.329 INFO:tasks.rados.rados.2.smithi057.stdout:1865: finishing rollback tid 1 to smithi05720651-10 2020-11-16T22:09:02.329 INFO:tasks.rados.rados.2.smithi057.stdout:1865: finishing rollback tid 2 to smithi05720651-10 2020-11-16T22:09:02.329 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 1332 (ObjNum 525 snap 188 seq_num 525) dirty exists 2020-11-16T22:09:02.329 INFO:tasks.rados.rados.2.smithi057.stdout:1866: expect (ObjNum 552 snap 201 seq_num 552) 2020-11-16T22:09:02.560 INFO:tasks.rados.rados.2.smithi057.stdout:1867: expect (ObjNum 625 snap 217 seq_num 625) 2020-11-16T22:09:02.667 INFO:tasks.rados.rados.2.smithi057.stdout:1864: expect (ObjNum 627 snap 219 seq_num 627) 2020-11-16T22:09:02.740 INFO:tasks.rados.rados.2.smithi057.stdout:1868: finishing write tid 1 to smithi05720651-4 2020-11-16T22:09:02.740 INFO:tasks.rados.rados.2.smithi057.stdout:1868: finishing write tid 2 to smithi05720651-4 2020-11-16T22:09:02.741 INFO:tasks.rados.rados.2.smithi057.stdout:1868: finishing write tid 4 to smithi05720651-4 2020-11-16T22:09:02.741 INFO:tasks.rados.rados.2.smithi057.stdout:1868: finishing write tid 5 to smithi05720651-4 2020-11-16T22:09:02.741 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 1113 (ObjNum 631 snap 220 seq_num 631) dirty exists 2020-11-16T22:09:02.741 INFO:tasks.rados.rados.2.smithi057.stdout:1868: left oid 4 (ObjNum 631 snap 220 seq_num 631) 2020-11-16T22:09:02.741 INFO:tasks.rados.rados.2.smithi057.stdout:1870: finishing copy_from to smithi05720651-20 2020-11-16T22:09:02.741 INFO:tasks.rados.rados.2.smithi057.stdout:1870: got expected ENOENT (src dne) 2020-11-16T22:09:02.742 INFO:tasks.rados.rados.2.smithi057.stdout:1870: finishing copy_from racing read to smithi05720651-20 2020-11-16T22:09:02.742 INFO:tasks.rados.rados.2.smithi057.stdout:1869: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:02.742 INFO:tasks.rados.rados.2.smithi057.stdout:1872: expect (ObjNum 610 snap 214 seq_num 610) 2020-11-16T22:09:02.809 INFO:tasks.rados.rados.2.smithi057.stdout:1869: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:02.809 INFO:tasks.rados.rados.2.smithi057.stdout:1869: finishing write tid 4 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:02.809 INFO:tasks.rados.rados.2.smithi057.stdout:1869: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:02.809 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1312 (ObjNum 632 snap 220 seq_num 632) dirty exists 2020-11-16T22:09:02.810 INFO:tasks.rados.rados.2.smithi057.stdout:1869: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 632 snap 220 seq_num 632) 2020-11-16T22:09:02.810 INFO:tasks.rados.rados.2.smithi057.stdout:1873: finishing write tid 1 to smithi05720651-38 2020-11-16T22:09:02.810 INFO:tasks.rados.rados.2.smithi057.stdout:1873: finishing write tid 2 to smithi05720651-38 2020-11-16T22:09:02.810 INFO:tasks.rados.rados.2.smithi057.stdout:1873: finishing write tid 4 to smithi05720651-38 2020-11-16T22:09:02.810 INFO:tasks.rados.rados.2.smithi057.stdout:1873: finishing write tid 5 to smithi05720651-38 2020-11-16T22:09:02.810 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 1131 (ObjNum 633 snap 220 seq_num 633) dirty exists 2020-11-16T22:09:02.811 INFO:tasks.rados.rados.2.smithi057.stdout:1873: left oid 38 (ObjNum 633 snap 220 seq_num 633) 2020-11-16T22:09:02.811 INFO:tasks.rados.rados.2.smithi057.stdout:1874: expect (ObjNum 525 snap 188 seq_num 525) 2020-11-16T22:09:03.002 INFO:tasks.rados.rados.2.smithi057.stdout:1875: finishing write tid 1 to smithi05720651-24 2020-11-16T22:09:03.002 INFO:tasks.rados.rados.2.smithi057.stdout:1875: finishing write tid 2 to smithi05720651-24 2020-11-16T22:09:03.003 INFO:tasks.rados.rados.2.smithi057.stdout:1875: finishing write tid 4 to smithi05720651-24 2020-11-16T22:09:03.003 INFO:tasks.rados.rados.2.smithi057.stdout:1875: finishing write tid 5 to smithi05720651-24 2020-11-16T22:09:03.003 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 1530 (ObjNum 634 snap 220 seq_num 634) dirty exists 2020-11-16T22:09:03.003 INFO:tasks.rados.rados.2.smithi057.stdout:1875: left oid 24 (ObjNum 634 snap 220 seq_num 634) 2020-11-16T22:09:03.004 INFO:tasks.rados.rados.2.smithi057.stdout:1876: finishing copy_from to smithi05720651-50 2020-11-16T22:09:03.004 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 1521 (ObjNum 548 snap 199 seq_num 548) dirty exists 2020-11-16T22:09:03.004 INFO:tasks.rados.rados.2.smithi057.stdout:1876: finishing copy_from racing read to smithi05720651-50 2020-11-16T22:09:03.004 INFO:tasks.rados.rados.2.smithi057.stdout:1862: done (13 left) 2020-11-16T22:09:03.005 INFO:tasks.rados.rados.2.smithi057.stdout:1864: done (12 left) 2020-11-16T22:09:03.005 INFO:tasks.rados.rados.2.smithi057.stdout:1865: done (11 left) 2020-11-16T22:09:03.005 INFO:tasks.rados.rados.2.smithi057.stdout:1866: done (10 left) 2020-11-16T22:09:03.006 INFO:tasks.rados.rados.2.smithi057.stdout:1867: done (9 left) 2020-11-16T22:09:03.006 INFO:tasks.rados.rados.2.smithi057.stdout:1868: done (8 left) 2020-11-16T22:09:03.006 INFO:tasks.rados.rados.2.smithi057.stdout:1869: done (7 left) 2020-11-16T22:09:03.006 INFO:tasks.rados.rados.2.smithi057.stdout:1870: done (6 left) 2020-11-16T22:09:03.007 INFO:tasks.rados.rados.2.smithi057.stdout:1871: done (5 left) 2020-11-16T22:09:03.007 INFO:tasks.rados.rados.2.smithi057.stdout:1872: done (4 left) 2020-11-16T22:09:03.007 INFO:tasks.rados.rados.2.smithi057.stdout:1873: done (3 left) 2020-11-16T22:09:03.007 INFO:tasks.rados.rados.2.smithi057.stdout:1874: done (2 left) 2020-11-16T22:09:03.007 INFO:tasks.rados.rados.2.smithi057.stdout:1875: done (1 left) 2020-11-16T22:09:03.008 INFO:tasks.rados.rados.2.smithi057.stdout:1876: done (0 left) 2020-11-16T22:09:03.008 INFO:tasks.rados.rados.2.smithi057.stdout:1877: read oid 42 snap -1 2020-11-16T22:09:03.008 INFO:tasks.rados.rados.2.smithi057.stdout:1877: expect deleted 2020-11-16T22:09:03.008 INFO:tasks.rados.rados.2.smithi057.stdout:1878: read oid 30 snap -1 2020-11-16T22:09:03.008 INFO:tasks.rados.rados.2.smithi057.stdout:1878: expect (ObjNum 616 snap 216 seq_num 616) 2020-11-16T22:09:03.009 INFO:tasks.rados.rados.2.smithi057.stdout:1879: rollback oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 220 2020-11-16T22:09:03.009 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 219 2020-11-16T22:09:03.009 INFO:tasks.rados.rados.2.smithi057.stdout:1880: delete oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 220 2020-11-16T22:09:03.012 INFO:tasks.rados.rados.2.smithi057.stdout:1879: finishing rollback tid 0 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:03.013 INFO:tasks.rados.rados.2.smithi057.stdout:1879: finishing rollback tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:03.013 INFO:tasks.rados.rados.2.smithi057.stdout:1879: finishing rollback tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:03.014 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1529 (ObjNum 615 snap 216 seq_num 615) dirty exists 2020-11-16T22:09:03.015 INFO:tasks.rados.rados.2.smithi057.stdout:1878: expect (ObjNum 616 snap 216 seq_num 616) 2020-11-16T22:09:03.165 INFO:tasks.rados.rados.2.smithi057.stdout:1877: done (3 left) 2020-11-16T22:09:03.165 INFO:tasks.rados.rados.2.smithi057.stdout:1878: done (2 left) 2020-11-16T22:09:03.165 INFO:tasks.rados.rados.2.smithi057.stdout:1879: done (1 left) 2020-11-16T22:09:03.166 INFO:tasks.rados.rados.2.smithi057.stdout:1880: done (0 left) 2020-11-16T22:09:03.166 INFO:tasks.rados.rados.2.smithi057.stdout:1881: snap_remove snap 219 2020-11-16T22:09:03.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:03 smithi016 bash[10302]: cluster 2020-11-16T22:09:01.717795+0000 mgr.x (mgr.24115) 492 : cluster [DBG] pgmap v936: 17 pgs: 17 active+clean; 113 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 2.8 MiB/s wr, 15 op/s 2020-11-16T22:09:03.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:03 smithi016 bash[10302]: cluster 2020-11-16T22:09:02.051648+0000 mon.a (mon.0) 1170 : cluster [DBG] osdmap e515: 12 total, 12 up, 12 in 2020-11-16T22:09:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:03 smithi195 bash[10218]: cluster 2020-11-16T22:09:01.717795+0000 mgr.x (mgr.24115) 492 : cluster [DBG] pgmap v936: 17 pgs: 17 active+clean; 113 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 2.8 MiB/s wr, 15 op/s 2020-11-16T22:09:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:03 smithi195 bash[10218]: cluster 2020-11-16T22:09:02.051648+0000 mon.a (mon.0) 1170 : cluster [DBG] osdmap e515: 12 total, 12 up, 12 in 2020-11-16T22:09:03.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:03 smithi057 bash[10301]: cluster 2020-11-16T22:09:01.717795+0000 mgr.x (mgr.24115) 492 : cluster [DBG] pgmap v936: 17 pgs: 17 active+clean; 113 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 2.8 MiB/s wr, 15 op/s 2020-11-16T22:09:03.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:03 smithi057 bash[10301]: cluster 2020-11-16T22:09:02.051648+0000 mon.a (mon.0) 1170 : cluster [DBG] osdmap e515: 12 total, 12 up, 12 in 2020-11-16T22:09:04.055 INFO:tasks.rados.rados.2.smithi057.stdout:1881: done (0 left) 2020-11-16T22:09:04.056 INFO:tasks.rados.rados.2.smithi057.stdout:1882: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:04.056 INFO:tasks.rados.rados.2.smithi057.stdout:1882: expect (ObjNum 522 snap 188 seq_num 522) 2020-11-16T22:09:04.056 INFO:tasks.rados.rados.2.smithi057.stdout:1883: read oid 30 snap -1 2020-11-16T22:09:04.057 INFO:tasks.rados.rados.2.smithi057.stdout:1883: expect (ObjNum 616 snap 216 seq_num 616) 2020-11-16T22:09:04.057 INFO:tasks.rados.rados.2.smithi057.stdout:1884: read oid 40 snap -1 2020-11-16T22:09:04.057 INFO:tasks.rados.rados.2.smithi057.stdout:1884: expect (ObjNum 522 snap 188 seq_num 522) 2020-11-16T22:09:04.058 INFO:tasks.rados.rados.2.smithi057.stdout:1885: read oid 12 snap -1 2020-11-16T22:09:04.058 INFO:tasks.rados.rados.2.smithi057.stdout:1885: expect (ObjNum 610 snap 214 seq_num 610) 2020-11-16T22:09:04.058 INFO:tasks.rados.rados.2.smithi057.stdout:1886: rollback oid 2 current snap is 220 2020-11-16T22:09:04.059 INFO:tasks.rados.rados.2.smithi057.stdout:1886: done (4 left) 2020-11-16T22:09:04.059 INFO:tasks.rados.rados.2.smithi057.stdout:1887: snap_create 2020-11-16T22:09:04.070 INFO:tasks.rados.rados.2.smithi057.stdout:1885: expect (ObjNum 610 snap 214 seq_num 610) 2020-11-16T22:09:04.143 INFO:tasks.rados.rados.2.smithi057.stdout:1882: expect (ObjNum 522 snap 188 seq_num 522) 2020-11-16T22:09:04.275 INFO:tasks.rados.rados.2.smithi057.stdout:1884: expect (ObjNum 522 snap 188 seq_num 522) 2020-11-16T22:09:04.337 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:09:04 smithi016 bash[19825]: debug 2020-11-16T22:09:04.072+0000 7f0e12c1a700 -1 osd.7 pg_epoch: 516 pg[2.8( v 515'1304 (0'0,515'1304] local-lis/les=71/72 n=6 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [7,9] r=0 lpr=71 crt=515'1304 lcod 513'1302 mlcod 513'1302 active+clean+snaptrim trimq=[1b8~1] ps=[1a7~1,1ae~1,1b0~1,1b4~2]] removing snap head 2020-11-16T22:09:04.349 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:09:04 smithi195 bash[18679]: debug 2020-11-16T22:09:04.064+0000 7f9945603700 -1 osd.1 pg_epoch: 516 pg[2.9( v 515'1619 (0'0,515'1619] local-lis/les=71/72 n=9 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,7] r=0 lpr=71 crt=515'1619 lcod 514'1617 mlcod 514'1617 active+clean+snaptrim trimq=[1b8~1] ps=[1a7~1,1ae~1,1b0~1,1b4~2]] removing snap head 2020-11-16T22:09:04.404 INFO:tasks.rados.rados.2.smithi057.stdout:1883: expect (ObjNum 616 snap 216 seq_num 616) 2020-11-16T22:09:05.029 INFO:tasks.rados.rados.2.smithi057.stdout:1882: done (4 left) 2020-11-16T22:09:05.029 INFO:tasks.rados.rados.2.smithi057.stdout:1883: done (3 left) 2020-11-16T22:09:05.029 INFO:tasks.rados.rados.2.smithi057.stdout:1884: done (2 left) 2020-11-16T22:09:05.029 INFO:tasks.rados.rados.2.smithi057.stdout:1885: done (1 left) 2020-11-16T22:09:05.029 INFO:tasks.rados.rados.2.smithi057.stdout:1887: done (0 left) 2020-11-16T22:09:05.030 INFO:tasks.rados.rados.2.smithi057.stdout:1888: snap_create 2020-11-16T22:09:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:05 smithi016 bash[10302]: cluster 2020-11-16T22:09:03.718489+0000 mgr.x (mgr.24115) 493 : cluster [DBG] pgmap v938: 17 pgs: 17 active+clean; 115 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2020-11-16T22:09:05.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:05 smithi016 bash[10302]: cluster 2020-11-16T22:09:04.067063+0000 mon.a (mon.0) 1171 : cluster [DBG] osdmap e516: 12 total, 12 up, 12 in 2020-11-16T22:09:05.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:05 smithi016 bash[10302]: cluster 2020-11-16T22:09:05.040168+0000 mon.a (mon.0) 1172 : cluster [DBG] osdmap e517: 12 total, 12 up, 12 in 2020-11-16T22:09:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:05 smithi195 bash[10218]: cluster 2020-11-16T22:09:03.718489+0000 mgr.x (mgr.24115) 493 : cluster [DBG] pgmap v938: 17 pgs: 17 active+clean; 115 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2020-11-16T22:09:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:05 smithi195 bash[10218]: cluster 2020-11-16T22:09:04.067063+0000 mon.a (mon.0) 1171 : cluster [DBG] osdmap e516: 12 total, 12 up, 12 in 2020-11-16T22:09:05.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:05 smithi195 bash[10218]: cluster 2020-11-16T22:09:05.040168+0000 mon.a (mon.0) 1172 : cluster [DBG] osdmap e517: 12 total, 12 up, 12 in 2020-11-16T22:09:05.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:05 smithi057 bash[10301]: cluster 2020-11-16T22:09:03.718489+0000 mgr.x (mgr.24115) 493 : cluster [DBG] pgmap v938: 17 pgs: 17 active+clean; 115 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2020-11-16T22:09:05.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:05 smithi057 bash[10301]: cluster 2020-11-16T22:09:04.067063+0000 mon.a (mon.0) 1171 : cluster [DBG] osdmap e516: 12 total, 12 up, 12 in 2020-11-16T22:09:05.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:05 smithi057 bash[10301]: cluster 2020-11-16T22:09:05.040168+0000 mon.a (mon.0) 1172 : cluster [DBG] osdmap e517: 12 total, 12 up, 12 in 2020-11-16T22:09:06.031 INFO:tasks.rados.rados.2.smithi057.stdout:1888: done (0 left) 2020-11-16T22:09:06.032 INFO:tasks.rados.rados.2.smithi057.stdout:1889: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:06.032 INFO:tasks.rados.rados.2.smithi057.stdout:1889: expect (ObjNum 525 snap 188 seq_num 525) 2020-11-16T22:09:06.032 INFO:tasks.rados.rados.2.smithi057.stdout:1890: delete oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 222 2020-11-16T22:09:06.040 INFO:tasks.rados.rados.2.smithi057.stdout:1890: done (1 left) 2020-11-16T22:09:06.040 INFO:tasks.rados.rados.2.smithi057.stdout:1891: write (excl) oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 222 2020-11-16T22:09:06.040 INFO:tasks.rados.rados.2.smithi057.stdout:1891: seq_num 637 ranges {706059=790912,1959265=685222} 2020-11-16T22:09:06.058 INFO:tasks.rados.rados.2.smithi057.stdout:1891: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 706059 to 1496971 tid 1 2020-11-16T22:09:06.065 INFO:tasks.rados.rados.2.smithi057.stdout:1891: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1959265 to 2644487 tid 2 2020-11-16T22:09:06.065 INFO:tasks.rados.rados.2.smithi057.stdout:1892: copy_from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 24 current snap is 222 2020-11-16T22:09:06.066 INFO:tasks.rados.rados.2.smithi057.stdout:1889: expect (ObjNum 525 snap 188 seq_num 525) 2020-11-16T22:09:06.271 INFO:tasks.rados.rados.2.smithi057.stdout:1891: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:06.271 INFO:tasks.rados.rados.2.smithi057.stdout:1891: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:06.271 INFO:tasks.rados.rados.2.smithi057.stdout:1891: finishing write tid 4 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:06.271 INFO:tasks.rados.rados.2.smithi057.stdout:1891: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:06.271 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1335 (ObjNum 637 snap 222 seq_num 637) dirty exists 2020-11-16T22:09:06.272 INFO:tasks.rados.rados.2.smithi057.stdout:1891: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 637 snap 222 seq_num 637) 2020-11-16T22:09:06.272 INFO:tasks.rados.rados.2.smithi057.stdout:1892: finishing copy_from to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:06.272 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1530 (ObjNum 634 snap 220 seq_num 634) dirty exists 2020-11-16T22:09:06.272 INFO:tasks.rados.rados.2.smithi057.stdout:1892: finishing copy_from racing read to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:06.272 INFO:tasks.rados.rados.2.smithi057.stdout:1889: done (2 left) 2020-11-16T22:09:06.272 INFO:tasks.rados.rados.2.smithi057.stdout:1891: done (1 left) 2020-11-16T22:09:06.273 INFO:tasks.rados.rados.2.smithi057.stdout:1892: done (0 left) 2020-11-16T22:09:06.273 INFO:tasks.rados.rados.2.smithi057.stdout:1893: delete oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 222 2020-11-16T22:09:06.277 INFO:tasks.rados.rados.2.smithi057.stdout:1893: done (0 left) 2020-11-16T22:09:06.277 INFO:tasks.rados.rados.2.smithi057.stdout:1894: read oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:06.278 INFO:tasks.rados.rados.2.smithi057.stdout:1894: expect deleted 2020-11-16T22:09:06.278 INFO:tasks.rados.rados.2.smithi057.stdout:1895: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:06.278 INFO:tasks.rados.rados.2.smithi057.stdout:1895: expect (ObjNum 632 snap 220 seq_num 632) 2020-11-16T22:09:06.482 INFO:tasks.rados.rados.2.smithi057.stdout:1896: write (excl) oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 222 2020-11-16T22:09:06.482 INFO:tasks.rados.rados.2.smithi057.stdout:1896: seq_num 639 ranges {739673=657763,2076229=663444} 2020-11-16T22:09:06.484 INFO:tasks.rados.rados.2.smithi057.stdout:1896: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 739673 to 1397436 tid 1 2020-11-16T22:09:06.485 INFO:tasks.rados.rados.2.smithi057.stdout:1896: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2076229 to 2739673 tid 2 2020-11-16T22:09:06.485 INFO:tasks.rados.rados.2.smithi057.stdout:1897: read oid 20 snap 220 2020-11-16T22:09:06.485 INFO:tasks.rados.rados.2.smithi057.stdout:1897: expect (ObjNum 620 snap 217 seq_num 620) 2020-11-16T22:09:06.485 INFO:tasks.rados.rados.2.smithi057.stdout:1898: rollback oid 46 current snap is 222 2020-11-16T22:09:06.485 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 46 to 220 2020-11-16T22:09:06.486 INFO:tasks.rados.rados.2.smithi057.stdout:1896: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:06.486 INFO:tasks.rados.rados.2.smithi057.stdout:1894: done (4 left) 2020-11-16T22:09:06.486 INFO:tasks.rados.rados.2.smithi057.stdout:1899: read oid 16 snap -1 2020-11-16T22:09:06.486 INFO:tasks.rados.rados.2.smithi057.stdout:1899: expect (ObjNum 627 snap 219 seq_num 627) 2020-11-16T22:09:06.486 INFO:tasks.rados.rados.2.smithi057.stdout:1900: read oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:06.486 INFO:tasks.rados.rados.2.smithi057.stdout:1900: expect deleted 2020-11-16T22:09:06.486 INFO:tasks.rados.rados.2.smithi057.stdout:1901: snap_remove snap 221 2020-11-16T22:09:07.062 INFO:tasks.rados.rados.2.smithi057.stdout:1901: done (6 left) 2020-11-16T22:09:07.062 INFO:tasks.rados.rados.2.smithi057.stdout:1902: delete oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 222 2020-11-16T22:09:07.063 INFO:tasks.rados.rados.2.smithi057.stdout:1896: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:07.063 INFO:tasks.rados.rados.2.smithi057.stdout:1896: finishing write tid 4 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:07.063 INFO:tasks.rados.rados.2.smithi057.stdout:1899: expect (ObjNum 627 snap 219 seq_num 627) 2020-11-16T22:09:07.143 INFO:tasks.rados.rados.2.smithi057.stdout:1898: finishing rollback tid 1 to smithi05720651-46 2020-11-16T22:09:07.143 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 0 (ObjNum 257 snap 0 seq_num 0) dirty dne 2020-11-16T22:09:07.143 INFO:tasks.rados.rados.2.smithi057.stdout:1897: expect (ObjNum 620 snap 217 seq_num 620) 2020-11-16T22:09:07.271 INFO:tasks.rados.rados.2.smithi057.stdout:1896: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:07.272 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1462 (ObjNum 639 snap 222 seq_num 639) dirty exists 2020-11-16T22:09:07.272 INFO:tasks.rados.rados.2.smithi057.stdout:1896: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 639 snap 222 seq_num 639) 2020-11-16T22:09:07.272 INFO:tasks.rados.rados.2.smithi057.stdout:1895: expect (ObjNum 632 snap 220 seq_num 632) 2020-11-16T22:09:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:07 smithi016 bash[10302]: cluster 2020-11-16T22:09:05.719228+0000 mgr.x (mgr.24115) 494 : cluster [DBG] pgmap v941: 17 pgs: 17 active+clean; 114 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 2.3 MiB/s wr, 29 op/s 2020-11-16T22:09:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:07 smithi016 bash[10302]: cluster 2020-11-16T22:09:06.042973+0000 mon.a (mon.0) 1173 : cluster [DBG] osdmap e518: 12 total, 12 up, 12 in 2020-11-16T22:09:07.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:07 smithi195 bash[10218]: cluster 2020-11-16T22:09:05.719228+0000 mgr.x (mgr.24115) 494 : cluster [DBG] pgmap v941: 17 pgs: 17 active+clean; 114 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 2.3 MiB/s wr, 29 op/s 2020-11-16T22:09:07.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:07 smithi195 bash[10218]: cluster 2020-11-16T22:09:06.042973+0000 mon.a (mon.0) 1173 : cluster [DBG] osdmap e518: 12 total, 12 up, 12 in 2020-11-16T22:09:07.387 INFO:tasks.rados.rados.2.smithi057.stdout:1895: done (6 left) 2020-11-16T22:09:07.387 INFO:tasks.rados.rados.2.smithi057.stdout:1896: done (5 left) 2020-11-16T22:09:07.388 INFO:tasks.rados.rados.2.smithi057.stdout:1897: done (4 left) 2020-11-16T22:09:07.388 INFO:tasks.rados.rados.2.smithi057.stdout:1898: done (3 left) 2020-11-16T22:09:07.388 INFO:tasks.rados.rados.2.smithi057.stdout:1899: done (2 left) 2020-11-16T22:09:07.388 INFO:tasks.rados.rados.2.smithi057.stdout:1900: done (1 left) 2020-11-16T22:09:07.388 INFO:tasks.rados.rados.2.smithi057.stdout:1902: done (0 left) 2020-11-16T22:09:07.388 INFO:tasks.rados.rados.2.smithi057.stdout:1903: snap_remove snap 220 2020-11-16T22:09:07.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:07 smithi057 bash[10301]: cluster 2020-11-16T22:09:05.719228+0000 mgr.x (mgr.24115) 494 : cluster [DBG] pgmap v941: 17 pgs: 17 active+clean; 114 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 2.3 MiB/s wr, 29 op/s 2020-11-16T22:09:07.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:07 smithi057 bash[10301]: cluster 2020-11-16T22:09:06.042973+0000 mon.a (mon.0) 1173 : cluster [DBG] osdmap e518: 12 total, 12 up, 12 in 2020-11-16T22:09:08.071 INFO:tasks.rados.rados.2.smithi057.stdout:1903: done (0 left) 2020-11-16T22:09:08.071 INFO:tasks.rados.rados.2.smithi057.stdout:1904: rollback oid 10 current snap is 222 2020-11-16T22:09:08.072 INFO:tasks.rados.rados.2.smithi057.stdout:1904: done (0 left) 2020-11-16T22:09:08.072 INFO:tasks.rados.rados.2.smithi057.stdout:1905: rollback oid 22 current snap is 222 2020-11-16T22:09:08.072 INFO:tasks.rados.rados.2.smithi057.stdout:1905: done (0 left) 2020-11-16T22:09:08.072 INFO:tasks.rados.rados.2.smithi057.stdout:1906: copy_from oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 40 current snap is 222 2020-11-16T22:09:08.072 INFO:tasks.rados.rados.2.smithi057.stdout:1907: delete oid 12 current snap is 222 2020-11-16T22:09:08.076 INFO:tasks.rados.rados.2.smithi057.stdout:1907: done (1 left) 2020-11-16T22:09:08.076 INFO:tasks.rados.rados.2.smithi057.stdout:1908: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:08.076 INFO:tasks.rados.rados.2.smithi057.stdout:1908: expect deleted 2020-11-16T22:09:08.076 INFO:tasks.rados.rados.2.smithi057.stdout:1909: read oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:08.076 INFO:tasks.rados.rados.2.smithi057.stdout:1909: expect deleted 2020-11-16T22:09:08.077 INFO:tasks.rados.rados.2.smithi057.stdout:1910: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 222 2020-11-16T22:09:08.077 INFO:tasks.rados.rados.2.smithi057.stdout:1910: seq_num 642 ranges {790094=483510,1851675=436218} 2020-11-16T22:09:08.086 INFO:tasks.rados.rados.2.smithi057.stdout:1910: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 790094 to 1273604 tid 1 2020-11-16T22:09:08.092 INFO:tasks.rados.rados.2.smithi057.stdout:1910: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1851675 to 2287893 tid 2 2020-11-16T22:09:08.092 INFO:tasks.rados.rados.2.smithi057.stdout:1911: snap_create 2020-11-16T22:09:08.096 INFO:tasks.rados.rados.2.smithi057.stdout:1906: finishing copy_from to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:08.096 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1471 (ObjNum 522 snap 188 seq_num 522) dirty exists 2020-11-16T22:09:08.096 INFO:tasks.rados.rados.2.smithi057.stdout:1906: finishing copy_from racing read to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:08.097 INFO:tasks.rados.rados.2.smithi057.stdout:1910: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:08.097 INFO:tasks.rados.rados.2.smithi057.stdout:1910: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:08.097 INFO:tasks.rados.rados.2.smithi057.stdout:1910: finishing write tid 4 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:08.097 INFO:tasks.rados.rados.2.smithi057.stdout:1910: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:08.098 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1629 (ObjNum 642 snap 222 seq_num 642) dirty exists 2020-11-16T22:09:08.098 INFO:tasks.rados.rados.2.smithi057.stdout:1910: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 642 snap 222 seq_num 642) 2020-11-16T22:09:08.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:08 smithi016 bash[10302]: cluster 2020-11-16T22:09:07.073294+0000 mon.a (mon.0) 1174 : cluster [DBG] osdmap e519: 12 total, 12 up, 12 in 2020-11-16T22:09:08.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:08 smithi195 bash[10218]: cluster 2020-11-16T22:09:07.073294+0000 mon.a (mon.0) 1174 : cluster [DBG] osdmap e519: 12 total, 12 up, 12 in 2020-11-16T22:09:08.349 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:09:08 smithi195 bash[18679]: debug 2020-11-16T22:09:08.088+0000 7f9945603700 -1 osd.1 pg_epoch: 520 pg[2.9( v 518'1623 (0'0,518'1623] local-lis/les=71/72 n=8 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,7] r=0 lpr=71 crt=518'1623 lcod 516'1621 mlcod 516'1621 active+clean+snaptrim trimq=[1ba~2] ps=[1b4~2,1b8~1]] removing snap head 2020-11-16T22:09:08.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:08 smithi057 bash[10301]: cluster 2020-11-16T22:09:07.073294+0000 mon.a (mon.0) 1174 : cluster [DBG] osdmap e519: 12 total, 12 up, 12 in 2020-11-16T22:09:09.080 INFO:tasks.rados.rados.2.smithi057.stdout:1906: done (4 left) 2020-11-16T22:09:09.081 INFO:tasks.rados.rados.2.smithi057.stdout:1908: done (3 left) 2020-11-16T22:09:09.081 INFO:tasks.rados.rados.2.smithi057.stdout:1909: done (2 left) 2020-11-16T22:09:09.081 INFO:tasks.rados.rados.2.smithi057.stdout:1910: done (1 left) 2020-11-16T22:09:09.081 INFO:tasks.rados.rados.2.smithi057.stdout:1911: done (0 left) 2020-11-16T22:09:09.081 INFO:tasks.rados.rados.2.smithi057.stdout:1912: snap_remove snap 222 2020-11-16T22:09:09.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:09 smithi016 bash[10302]: cluster 2020-11-16T22:09:07.719932+0000 mgr.x (mgr.24115) 495 : cluster [DBG] pgmap v944: 17 pgs: 17 active+clean; 117 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 2.7 MiB/s wr, 41 op/s 2020-11-16T22:09:09.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:09 smithi016 bash[10302]: cluster 2020-11-16T22:09:08.082158+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e520: 12 total, 12 up, 12 in 2020-11-16T22:09:09.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:09 smithi195 bash[10218]: cluster 2020-11-16T22:09:07.719932+0000 mgr.x (mgr.24115) 495 : cluster [DBG] pgmap v944: 17 pgs: 17 active+clean; 117 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 2.7 MiB/s wr, 41 op/s 2020-11-16T22:09:09.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:09 smithi195 bash[10218]: cluster 2020-11-16T22:09:08.082158+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e520: 12 total, 12 up, 12 in 2020-11-16T22:09:09.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:09 smithi057 bash[10301]: cluster 2020-11-16T22:09:07.719932+0000 mgr.x (mgr.24115) 495 : cluster [DBG] pgmap v944: 17 pgs: 17 active+clean; 117 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 40 MiB/s rd, 2.7 MiB/s wr, 41 op/s 2020-11-16T22:09:09.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:09 smithi057 bash[10301]: cluster 2020-11-16T22:09:08.082158+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e520: 12 total, 12 up, 12 in 2020-11-16T22:09:10.031 INFO:tasks.rados.rados.2.smithi057.stdout:1912: done (0 left) 2020-11-16T22:09:10.031 INFO:tasks.rados.rados.2.smithi057.stdout:1913: read oid 30 snap -1 2020-11-16T22:09:10.031 INFO:tasks.rados.rados.2.smithi057.stdout:1913: expect (ObjNum 616 snap 216 seq_num 616) 2020-11-16T22:09:10.031 INFO:tasks.rados.rados.2.smithi057.stdout:1914: read oid 50 snap -1 2020-11-16T22:09:10.031 INFO:tasks.rados.rados.2.smithi057.stdout:1914: expect (ObjNum 548 snap 199 seq_num 548) 2020-11-16T22:09:10.032 INFO:tasks.rados.rados.2.smithi057.stdout:1915: read oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:10.032 INFO:tasks.rados.rados.2.smithi057.stdout:1915: expect deleted 2020-11-16T22:09:10.032 INFO:tasks.rados.rados.2.smithi057.stdout:1916: snap_create 2020-11-16T22:09:10.053 INFO:tasks.rados.rados.2.smithi057.stdout:1914: expect (ObjNum 548 snap 199 seq_num 548) 2020-11-16T22:09:10.238 INFO:tasks.rados.rados.2.smithi057.stdout:1913: expect (ObjNum 616 snap 216 seq_num 616) 2020-11-16T22:09:10.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:10 smithi016 bash[10302]: cluster 2020-11-16T22:09:09.092081+0000 mon.a (mon.0) 1176 : cluster [DBG] osdmap e521: 12 total, 12 up, 12 in 2020-11-16T22:09:10.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:10 smithi016 bash[10302]: cluster 2020-11-16T22:09:10.041712+0000 mon.a (mon.0) 1177 : cluster [DBG] osdmap e522: 12 total, 12 up, 12 in 2020-11-16T22:09:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:10 smithi195 bash[10218]: cluster 2020-11-16T22:09:09.092081+0000 mon.a (mon.0) 1176 : cluster [DBG] osdmap e521: 12 total, 12 up, 12 in 2020-11-16T22:09:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:10 smithi195 bash[10218]: cluster 2020-11-16T22:09:10.041712+0000 mon.a (mon.0) 1177 : cluster [DBG] osdmap e522: 12 total, 12 up, 12 in 2020-11-16T22:09:10.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:10 smithi057 bash[10301]: cluster 2020-11-16T22:09:09.092081+0000 mon.a (mon.0) 1176 : cluster [DBG] osdmap e521: 12 total, 12 up, 12 in 2020-11-16T22:09:10.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:10 smithi057 bash[10301]: cluster 2020-11-16T22:09:10.041712+0000 mon.a (mon.0) 1177 : cluster [DBG] osdmap e522: 12 total, 12 up, 12 in 2020-11-16T22:09:11.032 INFO:tasks.rados.rados.2.smithi057.stdout:1913: done (3 left) 2020-11-16T22:09:11.032 INFO:tasks.rados.rados.2.smithi057.stdout:1914: done (2 left) 2020-11-16T22:09:11.033 INFO:tasks.rados.rados.2.smithi057.stdout:1915: done (1 left) 2020-11-16T22:09:11.033 INFO:tasks.rados.rados.2.smithi057.stdout:1916: done (0 left) 2020-11-16T22:09:11.033 INFO:tasks.rados.rados.2.smithi057.stdout:1917: rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 224 2020-11-16T22:09:11.033 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 223 2020-11-16T22:09:11.033 INFO:tasks.rados.rados.2.smithi057.stdout:1918: snap_create 2020-11-16T22:09:11.042 INFO:tasks.rados.rados.2.smithi057.stdout:1917: finishing rollback tid 0 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:11.042 INFO:tasks.rados.rados.2.smithi057.stdout:1917: finishing rollback tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:11.043 INFO:tasks.rados.rados.2.smithi057.stdout:1917: finishing rollback tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:11.043 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1533 (ObjNum 525 snap 188 seq_num 525) dirty exists 2020-11-16T22:09:11.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:11 smithi195 bash[10218]: cluster 2020-11-16T22:09:09.720591+0000 mgr.x (mgr.24115) 496 : cluster [DBG] pgmap v947: 17 pgs: 17 active+clean; 117 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2020-11-16T22:09:11.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:11 smithi195 bash[10218]: cluster 2020-11-16T22:09:11.044102+0000 mon.a (mon.0) 1178 : cluster [DBG] osdmap e523: 12 total, 12 up, 12 in 2020-11-16T22:09:11.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:11 smithi057 bash[10301]: cluster 2020-11-16T22:09:09.720591+0000 mgr.x (mgr.24115) 496 : cluster [DBG] pgmap v947: 17 pgs: 17 active+clean; 117 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2020-11-16T22:09:11.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:11 smithi057 bash[10301]: cluster 2020-11-16T22:09:11.044102+0000 mon.a (mon.0) 1178 : cluster [DBG] osdmap e523: 12 total, 12 up, 12 in 2020-11-16T22:09:11.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:11 smithi016 bash[10302]: cluster 2020-11-16T22:09:09.720591+0000 mgr.x (mgr.24115) 496 : cluster [DBG] pgmap v947: 17 pgs: 17 active+clean; 117 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2020-11-16T22:09:11.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:11 smithi016 bash[10302]: cluster 2020-11-16T22:09:11.044102+0000 mon.a (mon.0) 1178 : cluster [DBG] osdmap e523: 12 total, 12 up, 12 in 2020-11-16T22:09:12.034 INFO:tasks.rados.rados.2.smithi057.stdout:1917: done (1 left) 2020-11-16T22:09:12.035 INFO:tasks.rados.rados.2.smithi057.stdout:1918: done (0 left) 2020-11-16T22:09:12.035 INFO:tasks.rados.rados.2.smithi057.stdout:1919: write oid 36 current snap is 225 2020-11-16T22:09:12.035 INFO:tasks.rados.rados.2.smithi057.stdout:1919: seq_num 643 ranges {406901=558759,1393804=579876,2608396=198505} 2020-11-16T22:09:12.046 INFO:tasks.rados.rados.2.smithi057.stdout:1919: writing smithi05720651-36 from 406901 to 965660 tid 1 2020-11-16T22:09:12.052 INFO:tasks.rados.rados.2.smithi057.stdout:1919: writing smithi05720651-36 from 1393804 to 1973680 tid 2 2020-11-16T22:09:12.057 INFO:tasks.rados.rados.2.smithi057.stdout:1919: writing smithi05720651-36 from 2608396 to 2806901 tid 3 2020-11-16T22:09:12.058 INFO:tasks.rados.rados.2.smithi057.stdout:1920: write (excl) oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 225 2020-11-16T22:09:12.058 INFO:tasks.rados.rados.2.smithi057.stdout:1920: seq_num 644 ranges {423708=634008,1852286=439887,2752172=71536} 2020-11-16T22:09:12.064 INFO:tasks.rados.rados.2.smithi057.stdout:1920: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 423708 to 1057716 tid 1 2020-11-16T22:09:12.071 INFO:tasks.rados.rados.2.smithi057.stdout:1920: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1852286 to 2292173 tid 2 2020-11-16T22:09:12.074 INFO:tasks.rados.rados.2.smithi057.stdout:1920: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2752172 to 2823708 tid 3 2020-11-16T22:09:12.074 INFO:tasks.rados.rados.2.smithi057.stdout:1921: copy_from oid 16 from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 225 2020-11-16T22:09:12.074 INFO:tasks.rados.rados.2.smithi057.stdout:1922: write oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 225 2020-11-16T22:09:12.075 INFO:tasks.rados.rados.2.smithi057.stdout:1922: seq_num 645 ranges {440515=709257,1910768=583545} 2020-11-16T22:09:12.080 INFO:tasks.rados.rados.2.smithi057.stdout:1922: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 440515 to 1149772 tid 1 2020-11-16T22:09:12.089 INFO:tasks.rados.rados.2.smithi057.stdout:1922: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1910768 to 2494313 tid 2 2020-11-16T22:09:12.089 INFO:tasks.rados.rados.2.smithi057.stdout:1923: read oid 22 snap 224 2020-11-16T22:09:12.089 INFO:tasks.rados.rados.2.smithi057.stdout:1923: expect (ObjNum 618 snap 217 seq_num 618) 2020-11-16T22:09:12.089 INFO:tasks.rados.rados.2.smithi057.stdout:1924: rollback oid 10 current snap is 225 2020-11-16T22:09:12.089 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 10 to 223 2020-11-16T22:09:12.089 INFO:tasks.rados.rados.2.smithi057.stdout:1919: finishing write tid 1 to smithi05720651-36 2020-11-16T22:09:12.090 INFO:tasks.rados.rados.2.smithi057.stdout:1919: finishing write tid 2 to smithi05720651-36 2020-11-16T22:09:12.090 INFO:tasks.rados.rados.2.smithi057.stdout:1919: finishing write tid 3 to smithi05720651-36 2020-11-16T22:09:12.090 INFO:tasks.rados.rados.2.smithi057.stdout:1919: finishing write tid 5 to smithi05720651-36 2020-11-16T22:09:12.090 INFO:tasks.rados.rados.2.smithi057.stdout:1919: finishing write tid 6 to smithi05720651-36 2020-11-16T22:09:12.090 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 1339 (ObjNum 643 snap 225 seq_num 643) dirty exists 2020-11-16T22:09:12.090 INFO:tasks.rados.rados.2.smithi057.stdout:1919: left oid 36 (ObjNum 643 snap 225 seq_num 643) 2020-11-16T22:09:12.090 INFO:tasks.rados.rados.2.smithi057.stdout:1920: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:12.091 INFO:tasks.rados.rados.2.smithi057.stdout:1919: done (5 left) 2020-11-16T22:09:12.091 INFO:tasks.rados.rados.2.smithi057.stdout:1925: read oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:12.091 INFO:tasks.rados.rados.2.smithi057.stdout:1925: expect (ObjNum 634 snap 220 seq_num 634) 2020-11-16T22:09:12.091 INFO:tasks.rados.rados.2.smithi057.stdout:1926: write (excl) oid 18 current snap is 225 2020-11-16T22:09:12.091 INFO:tasks.rados.rados.2.smithi057.stdout:1926: seq_num 646 ranges {457322=784506,1969250=443556} 2020-11-16T22:09:12.096 INFO:tasks.rados.rados.2.smithi057.stdout:1926: writing smithi05720651-18 from 457322 to 1241828 tid 1 2020-11-16T22:09:12.103 INFO:tasks.rados.rados.2.smithi057.stdout:1926: writing smithi05720651-18 from 1969250 to 2412806 tid 2 2020-11-16T22:09:12.103 INFO:tasks.rados.rados.2.smithi057.stdout:1927: rollback oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 225 2020-11-16T22:09:12.104 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 223 2020-11-16T22:09:12.104 INFO:tasks.rados.rados.2.smithi057.stdout:1921: finishing copy_from to smithi05720651-16 2020-11-16T22:09:12.104 INFO:tasks.rados.rados.2.smithi057.stdout:1921: got expected ENOENT (src dne) 2020-11-16T22:09:12.104 INFO:tasks.rados.rados.2.smithi057.stdout:1921: finishing copy_from racing read to smithi05720651-16 2020-11-16T22:09:12.104 INFO:tasks.rados.rados.2.smithi057.stdout:1920: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:12.104 INFO:tasks.rados.rados.2.smithi057.stdout:1920: finishing write tid 3 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:12.105 INFO:tasks.rados.rados.2.smithi057.stdout:1923: expect (ObjNum 618 snap 217 seq_num 618) 2020-11-16T22:09:12.209 INFO:tasks.rados.rados.2.smithi057.stdout:1922: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:12.209 INFO:tasks.rados.rados.2.smithi057.stdout:1922: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:12.209 INFO:tasks.rados.rados.2.smithi057.stdout:1922: finishing write tid 4 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:12.209 INFO:tasks.rados.rados.2.smithi057.stdout:1924: finishing rollback tid 0 to smithi05720651-10 2020-11-16T22:09:12.210 INFO:tasks.rados.rados.2.smithi057.stdout:1922: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:12.210 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1538 (ObjNum 645 snap 225 seq_num 645) dirty exists 2020-11-16T22:09:12.210 INFO:tasks.rados.rados.2.smithi057.stdout:1922: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 645 snap 225 seq_num 645) 2020-11-16T22:09:12.210 INFO:tasks.rados.rados.2.smithi057.stdout:1924: finishing rollback tid 1 to smithi05720651-10 2020-11-16T22:09:12.210 INFO:tasks.rados.rados.2.smithi057.stdout:1924: finishing rollback tid 2 to smithi05720651-10 2020-11-16T22:09:12.210 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 1342 (ObjNum 525 snap 188 seq_num 525) dirty exists 2020-11-16T22:09:12.210 INFO:tasks.rados.rados.2.smithi057.stdout:1921: done (7 left) 2020-11-16T22:09:12.211 INFO:tasks.rados.rados.2.smithi057.stdout:1922: done (6 left) 2020-11-16T22:09:12.211 INFO:tasks.rados.rados.2.smithi057.stdout:1923: done (5 left) 2020-11-16T22:09:12.211 INFO:tasks.rados.rados.2.smithi057.stdout:1924: done (4 left) 2020-11-16T22:09:12.211 INFO:tasks.rados.rados.2.smithi057.stdout:1928: write oid 44 current snap is 225 2020-11-16T22:09:12.211 INFO:tasks.rados.rados.2.smithi057.stdout:1928: seq_num 647 ranges {474129=576108,1627732=587214,2718088=156041} 2020-11-16T22:09:12.214 INFO:tasks.rados.rados.2.smithi057.stdout:1928: writing smithi05720651-44 from 474129 to 1050237 tid 1 2020-11-16T22:09:12.223 INFO:tasks.rados.rados.2.smithi057.stdout:1928: writing smithi05720651-44 from 1627732 to 2214946 tid 2 2020-11-16T22:09:12.227 INFO:tasks.rados.rados.2.smithi057.stdout:1928: writing smithi05720651-44 from 2718088 to 2874129 tid 3 2020-11-16T22:09:12.227 INFO:tasks.rados.rados.2.smithi057.stdout:1929: delete oid 6 current snap is 225 2020-11-16T22:09:12.227 INFO:tasks.rados.rados.2.smithi057.stdout:1925: expect (ObjNum 634 snap 220 seq_num 634) 2020-11-16T22:09:12.351 INFO:tasks.rados.rados.2.smithi057.stdout:1926: finishing write tid 1 to smithi05720651-18 2020-11-16T22:09:12.351 INFO:tasks.rados.rados.2.smithi057.stdout:1927: finishing rollback tid 0 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:12.351 INFO:tasks.rados.rados.2.smithi057.stdout:1927: finishing rollback tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:12.351 INFO:tasks.rados.rados.2.smithi057.stdout:1927: finishing rollback tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:12.351 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1345 (ObjNum 637 snap 222 seq_num 637) dirty exists 2020-11-16T22:09:12.352 INFO:tasks.rados.rados.2.smithi057.stdout:1926: finishing write tid 2 to smithi05720651-18 2020-11-16T22:09:12.352 INFO:tasks.rados.rados.2.smithi057.stdout:1926: finishing write tid 4 to smithi05720651-18 2020-11-16T22:09:12.352 INFO:tasks.rados.rados.2.smithi057.stdout:1926: finishing write tid 5 to smithi05720651-18 2020-11-16T22:09:12.352 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 1247 (ObjNum 646 snap 225 seq_num 646) dirty exists 2020-11-16T22:09:12.352 INFO:tasks.rados.rados.2.smithi057.stdout:1926: left oid 18 (ObjNum 646 snap 225 seq_num 646) 2020-11-16T22:09:12.352 INFO:tasks.rados.rados.2.smithi057.stdout:1925: done (5 left) 2020-11-16T22:09:12.352 INFO:tasks.rados.rados.2.smithi057.stdout:1926: done (4 left) 2020-11-16T22:09:12.353 INFO:tasks.rados.rados.2.smithi057.stdout:1927: done (3 left) 2020-11-16T22:09:12.353 INFO:tasks.rados.rados.2.smithi057.stdout:1929: done (2 left) 2020-11-16T22:09:12.353 INFO:tasks.rados.rados.2.smithi057.stdout:1930: rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 225 2020-11-16T22:09:12.353 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 224 2020-11-16T22:09:12.354 INFO:tasks.rados.rados.2.smithi057.stdout:1928: finishing write tid 1 to smithi05720651-44 2020-11-16T22:09:12.354 INFO:tasks.rados.rados.2.smithi057.stdout:1928: finishing write tid 2 to smithi05720651-44 2020-11-16T22:09:12.354 INFO:tasks.rados.rados.2.smithi057.stdout:1928: finishing write tid 3 to smithi05720651-44 2020-11-16T22:09:12.354 INFO:tasks.rados.rados.2.smithi057.stdout:1928: finishing write tid 5 to smithi05720651-44 2020-11-16T22:09:12.354 INFO:tasks.rados.rados.2.smithi057.stdout:1928: finishing write tid 6 to smithi05720651-44 2020-11-16T22:09:12.354 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 1108 (ObjNum 647 snap 225 seq_num 647) dirty exists 2020-11-16T22:09:12.354 INFO:tasks.rados.rados.2.smithi057.stdout:1928: left oid 44 (ObjNum 647 snap 225 seq_num 647) 2020-11-16T22:09:12.355 INFO:tasks.rados.rados.2.smithi057.stdout:1928: done (2 left) 2020-11-16T22:09:12.355 INFO:tasks.rados.rados.2.smithi057.stdout:1931: read oid 2 snap -1 2020-11-16T22:09:12.355 INFO:tasks.rados.rados.2.smithi057.stdout:1931: expect (ObjNum 625 snap 217 seq_num 625) 2020-11-16T22:09:12.355 INFO:tasks.rados.rados.2.smithi057.stdout:1932: snap_create 2020-11-16T22:09:12.360 INFO:tasks.rados.rados.2.smithi057.stdout:1930: finishing rollback tid 0 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:12.360 INFO:tasks.rados.rados.2.smithi057.stdout:1930: finishing rollback tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:12.361 INFO:tasks.rados.rados.2.smithi057.stdout:1931: expect (ObjNum 625 snap 217 seq_num 625) 2020-11-16T22:09:12.475 INFO:tasks.rados.rados.2.smithi057.stdout:1930: finishing rollback tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:12.476 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1371 (ObjNum 588 snap 207 seq_num 588) dirty exists 2020-11-16T22:09:12.833 INFO:tasks.rados.rados.2.smithi057.stdout:1920: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:12.834 INFO:tasks.rados.rados.2.smithi057.stdout:1920: finishing write tid 6 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:12.834 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1634 (ObjNum 644 snap 225 seq_num 644) dirty exists 2020-11-16T22:09:12.834 INFO:tasks.rados.rados.2.smithi057.stdout:1920: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 644 snap 225 seq_num 644) 2020-11-16T22:09:13.096 INFO:tasks.rados.rados.2.smithi057.stdout:1920: done (3 left) 2020-11-16T22:09:13.096 INFO:tasks.rados.rados.2.smithi057.stdout:1930: done (2 left) 2020-11-16T22:09:13.096 INFO:tasks.rados.rados.2.smithi057.stdout:1931: done (1 left) 2020-11-16T22:09:13.097 INFO:tasks.rados.rados.2.smithi057.stdout:1932: done (0 left) 2020-11-16T22:09:13.097 INFO:tasks.rados.rados.2.smithi057.stdout:1933: read oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:13.097 INFO:tasks.rados.rados.2.smithi057.stdout:1933: expect (ObjNum 637 snap 222 seq_num 637) 2020-11-16T22:09:13.097 INFO:tasks.rados.rados.2.smithi057.stdout:1934: write oid 20 current snap is 226 2020-11-16T22:09:13.097 INFO:tasks.rados.rados.2.smithi057.stdout:1934: seq_num 649 ranges {507743=726606,1744696=590883,2772934=134809} 2020-11-16T22:09:13.110 INFO:tasks.rados.rados.2.smithi057.stdout:1934: writing smithi05720651-20 from 507743 to 1234349 tid 1 2020-11-16T22:09:13.116 INFO:tasks.rados.rados.2.smithi057.stdout:1934: writing smithi05720651-20 from 1744696 to 2335579 tid 2 2020-11-16T22:09:13.120 INFO:tasks.rados.rados.2.smithi057.stdout:1934: writing smithi05720651-20 from 2772934 to 2907743 tid 3 2020-11-16T22:09:13.120 INFO:tasks.rados.rados.2.smithi057.stdout:1935: snap_remove snap 224 2020-11-16T22:09:13.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:13 smithi016 bash[10302]: cluster 2020-11-16T22:09:11.721324+0000 mgr.x (mgr.24115) 497 : cluster [DBG] pgmap v950: 17 pgs: 17 active+clean; 112 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2020-11-16T22:09:13.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:13 smithi016 bash[10302]: cluster 2020-11-16T22:09:12.046399+0000 mon.a (mon.0) 1179 : cluster [DBG] osdmap e524: 12 total, 12 up, 12 in 2020-11-16T22:09:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:13 smithi195 bash[10218]: cluster 2020-11-16T22:09:11.721324+0000 mgr.x (mgr.24115) 497 : cluster [DBG] pgmap v950: 17 pgs: 17 active+clean; 112 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2020-11-16T22:09:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:13 smithi195 bash[10218]: cluster 2020-11-16T22:09:12.046399+0000 mon.a (mon.0) 1179 : cluster [DBG] osdmap e524: 12 total, 12 up, 12 in 2020-11-16T22:09:13.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:13 smithi057 bash[10301]: cluster 2020-11-16T22:09:11.721324+0000 mgr.x (mgr.24115) 497 : cluster [DBG] pgmap v950: 17 pgs: 17 active+clean; 112 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2020-11-16T22:09:13.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:13 smithi057 bash[10301]: cluster 2020-11-16T22:09:12.046399+0000 mon.a (mon.0) 1179 : cluster [DBG] osdmap e524: 12 total, 12 up, 12 in 2020-11-16T22:09:14.109 INFO:tasks.rados.rados.2.smithi057.stdout:1935: done (2 left) 2020-11-16T22:09:14.110 INFO:tasks.rados.rados.2.smithi057.stdout:1936: snap_create 2020-11-16T22:09:14.110 INFO:tasks.rados.rados.2.smithi057.stdout:1933: expect (ObjNum 637 snap 222 seq_num 637) 2020-11-16T22:09:14.197 INFO:tasks.rados.rados.2.smithi057.stdout:1934: finishing write tid 1 to smithi05720651-20 2020-11-16T22:09:14.197 INFO:tasks.rados.rados.2.smithi057.stdout:1934: finishing write tid 2 to smithi05720651-20 2020-11-16T22:09:14.197 INFO:tasks.rados.rados.2.smithi057.stdout:1934: finishing write tid 3 to smithi05720651-20 2020-11-16T22:09:14.197 INFO:tasks.rados.rados.2.smithi057.stdout:1934: finishing write tid 5 to smithi05720651-20 2020-11-16T22:09:14.197 INFO:tasks.rados.rados.2.smithi057.stdout:1934: finishing write tid 6 to smithi05720651-20 2020-11-16T22:09:14.197 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1117 (ObjNum 649 snap 226 seq_num 649) dirty exists 2020-11-16T22:09:14.198 INFO:tasks.rados.rados.2.smithi057.stdout:1934: left oid 20 (ObjNum 649 snap 226 seq_num 649) 2020-11-16T22:09:14.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:14 smithi057 bash[10301]: cluster 2020-11-16T22:09:13.107592+0000 mon.a (mon.0) 1180 : cluster [DBG] osdmap e525: 12 total, 12 up, 12 in 2020-11-16T22:09:14.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:14 smithi016 bash[10302]: cluster 2020-11-16T22:09:13.107592+0000 mon.a (mon.0) 1180 : cluster [DBG] osdmap e525: 12 total, 12 up, 12 in 2020-11-16T22:09:14.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:14 smithi195 bash[10218]: cluster 2020-11-16T22:09:13.107592+0000 mon.a (mon.0) 1180 : cluster [DBG] osdmap e525: 12 total, 12 up, 12 in 2020-11-16T22:09:15.030 INFO:tasks.rados.rados.2.smithi057.stdout:1933: done (2 left) 2020-11-16T22:09:15.031 INFO:tasks.rados.rados.2.smithi057.stdout:1934: done (1 left) 2020-11-16T22:09:15.031 INFO:tasks.rados.rados.2.smithi057.stdout:1936: done (0 left) 2020-11-16T22:09:15.031 INFO:tasks.rados.rados.2.smithi057.stdout:1937: rollback oid 18 current snap is 227 2020-11-16T22:09:15.031 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 18 to 223 2020-11-16T22:09:15.032 INFO:tasks.rados.rados.2.smithi057.stdout:1938: snap_remove snap 225 2020-11-16T22:09:15.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:15 smithi057 bash[10301]: cluster 2020-11-16T22:09:13.722016+0000 mgr.x (mgr.24115) 498 : cluster [DBG] pgmap v953: 17 pgs: 17 active+clean; 112 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2020-11-16T22:09:15.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:15 smithi057 bash[10301]: cluster 2020-11-16T22:09:14.119774+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e526: 12 total, 12 up, 12 in 2020-11-16T22:09:15.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:15 smithi057 bash[10301]: cluster 2020-11-16T22:09:15.042318+0000 mon.a (mon.0) 1182 : cluster [DBG] osdmap e527: 12 total, 12 up, 12 in 2020-11-16T22:09:15.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:15 smithi016 bash[10302]: cluster 2020-11-16T22:09:13.722016+0000 mgr.x (mgr.24115) 498 : cluster [DBG] pgmap v953: 17 pgs: 17 active+clean; 112 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2020-11-16T22:09:15.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:15 smithi016 bash[10302]: cluster 2020-11-16T22:09:14.119774+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e526: 12 total, 12 up, 12 in 2020-11-16T22:09:15.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:15 smithi016 bash[10302]: cluster 2020-11-16T22:09:15.042318+0000 mon.a (mon.0) 1182 : cluster [DBG] osdmap e527: 12 total, 12 up, 12 in 2020-11-16T22:09:15.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:15 smithi195 bash[10218]: cluster 2020-11-16T22:09:13.722016+0000 mgr.x (mgr.24115) 498 : cluster [DBG] pgmap v953: 17 pgs: 17 active+clean; 112 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2020-11-16T22:09:15.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:15 smithi195 bash[10218]: cluster 2020-11-16T22:09:14.119774+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e526: 12 total, 12 up, 12 in 2020-11-16T22:09:15.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:15 smithi195 bash[10218]: cluster 2020-11-16T22:09:15.042318+0000 mon.a (mon.0) 1182 : cluster [DBG] osdmap e527: 12 total, 12 up, 12 in 2020-11-16T22:09:16.034 INFO:tasks.rados.rados.2.smithi057.stdout:1938: done (1 left) 2020-11-16T22:09:16.035 INFO:tasks.rados.rados.2.smithi057.stdout:1939: read oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 223 2020-11-16T22:09:16.035 INFO:tasks.rados.rados.2.smithi057.stdout:1939: expect deleted 2020-11-16T22:09:16.035 INFO:tasks.rados.rados.2.smithi057.stdout:1940: rollback oid 2 current snap is 227 2020-11-16T22:09:16.035 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 2 to 223 2020-11-16T22:09:16.035 INFO:tasks.rados.rados.2.smithi057.stdout:1937: finishing rollback tid 0 to smithi05720651-18 2020-11-16T22:09:16.036 INFO:tasks.rados.rados.2.smithi057.stdout:1937: finishing rollback tid 1 to smithi05720651-18 2020-11-16T22:09:16.036 INFO:tasks.rados.rados.2.smithi057.stdout:1937: finishing rollback tid 2 to smithi05720651-18 2020-11-16T22:09:16.036 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 1250 (ObjNum 562 snap 203 seq_num 562) dirty exists 2020-11-16T22:09:16.036 INFO:tasks.rados.rados.2.smithi057.stdout:1937: done (2 left) 2020-11-16T22:09:16.036 INFO:tasks.rados.rados.2.smithi057.stdout:1941: read oid 4 snap -1 2020-11-16T22:09:16.036 INFO:tasks.rados.rados.2.smithi057.stdout:1941: expect (ObjNum 631 snap 220 seq_num 631) 2020-11-16T22:09:16.036 INFO:tasks.rados.rados.2.smithi057.stdout:1942: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:16.037 INFO:tasks.rados.rados.2.smithi057.stdout:1942: expect (ObjNum 525 snap 188 seq_num 525) 2020-11-16T22:09:16.037 INFO:tasks.rados.rados.2.smithi057.stdout:1943: copy_from oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 227 2020-11-16T22:09:16.037 INFO:tasks.rados.rados.2.smithi057.stdout:1944: snap_create 2020-11-16T22:09:16.048 INFO:tasks.rados.rados.2.smithi057.stdout:1940: finishing rollback tid 0 to smithi05720651-2 2020-11-16T22:09:16.048 INFO:tasks.rados.rados.2.smithi057.stdout:1940: finishing rollback tid 1 to smithi05720651-2 2020-11-16T22:09:16.048 INFO:tasks.rados.rados.2.smithi057.stdout:1940: finishing rollback tid 2 to smithi05720651-2 2020-11-16T22:09:16.049 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 1640 (ObjNum 625 snap 217 seq_num 625) dirty exists 2020-11-16T22:09:16.055 INFO:tasks.rados.rados.2.smithi057.stdout:1941: expect (ObjNum 631 snap 220 seq_num 631) 2020-11-16T22:09:16.132 INFO:tasks.rados.rados.2.smithi057.stdout:1942: expect (ObjNum 525 snap 188 seq_num 525) 2020-11-16T22:09:16.329 INFO:tasks.rados.rados.2.smithi057.stdout:1943: finishing copy_from to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:16.329 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1325 (ObjNum 496 snap 177 seq_num 496) dirty exists 2020-11-16T22:09:16.329 INFO:tasks.rados.rados.2.smithi057.stdout:1943: finishing copy_from racing read to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:17.044 INFO:tasks.rados.rados.2.smithi057.stdout:1939: done (5 left) 2020-11-16T22:09:17.045 INFO:tasks.rados.rados.2.smithi057.stdout:1940: done (4 left) 2020-11-16T22:09:17.045 INFO:tasks.rados.rados.2.smithi057.stdout:1941: done (3 left) 2020-11-16T22:09:17.045 INFO:tasks.rados.rados.2.smithi057.stdout:1942: done (2 left) 2020-11-16T22:09:17.045 INFO:tasks.rados.rados.2.smithi057.stdout:1943: done (1 left) 2020-11-16T22:09:17.045 INFO:tasks.rados.rados.2.smithi057.stdout:1944: done (0 left) 2020-11-16T22:09:17.045 INFO:tasks.rados.rados.2.smithi057.stdout:1945: read oid 12 snap 227 2020-11-16T22:09:17.046 INFO:tasks.rados.rados.2.smithi057.stdout:1945: expect deleted 2020-11-16T22:09:17.046 INFO:tasks.rados.rados.2.smithi057.stdout:1946: read oid 34 snap -1 2020-11-16T22:09:17.046 INFO:tasks.rados.rados.2.smithi057.stdout:1946: expect (ObjNum 622 snap 217 seq_num 622) 2020-11-16T22:09:17.046 INFO:tasks.rados.rados.2.smithi057.stdout:1947: copy_from oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 44 current snap is 228 2020-11-16T22:09:17.046 INFO:tasks.rados.rados.2.smithi057.stdout:1948: write oid 14 current snap is 228 2020-11-16T22:09:17.046 INFO:tasks.rados.rados.2.smithi057.stdout:1948: seq_num 650 ranges {524550=401855,1403178=450894,2516710=407840} 2020-11-16T22:09:17.056 INFO:tasks.rados.rados.2.smithi057.stdout:1948: writing smithi05720651-14 from 524550 to 926405 tid 1 2020-11-16T22:09:17.061 INFO:tasks.rados.rados.2.smithi057.stdout:1948: writing smithi05720651-14 from 1403178 to 1854072 tid 2 2020-11-16T22:09:17.067 INFO:tasks.rados.rados.2.smithi057.stdout:1948: writing smithi05720651-14 from 2516710 to 2924550 tid 3 2020-11-16T22:09:17.068 INFO:tasks.rados.rados.2.smithi057.stdout:1949: write (excl) oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 228 2020-11-16T22:09:17.068 INFO:tasks.rados.rados.2.smithi057.stdout:1949: seq_num 651 ranges {541357=477104,1745307=594552} 2020-11-16T22:09:17.073 INFO:tasks.rados.rados.2.smithi057.stdout:1949: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 541357 to 1018461 tid 1 2020-11-16T22:09:17.081 INFO:tasks.rados.rados.2.smithi057.stdout:1949: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1745307 to 2339859 tid 2 2020-11-16T22:09:17.081 INFO:tasks.rados.rados.2.smithi057.stdout:1950: read oid 50 snap 226 2020-11-16T22:09:17.081 INFO:tasks.rados.rados.2.smithi057.stdout:1950: expect (ObjNum 548 snap 199 seq_num 548) 2020-11-16T22:09:17.081 INFO:tasks.rados.rados.2.smithi057.stdout:1951: write oid 24 current snap is 228 2020-11-16T22:09:17.082 INFO:tasks.rados.rados.2.smithi057.stdout:1951: seq_num 652 ranges {558164=552353,1803789=454563,2855203=102961} 2020-11-16T22:09:17.087 INFO:tasks.rados.rados.2.smithi057.stdout:1951: writing smithi05720651-24 from 558164 to 1110517 tid 1 2020-11-16T22:09:17.094 INFO:tasks.rados.rados.2.smithi057.stdout:1951: writing smithi05720651-24 from 1803789 to 2258352 tid 2 2020-11-16T22:09:17.098 INFO:tasks.rados.rados.2.smithi057.stdout:1951: writing smithi05720651-24 from 2855203 to 2958164 tid 3 2020-11-16T22:09:17.098 INFO:tasks.rados.rados.2.smithi057.stdout:1952: snap_create 2020-11-16T22:09:17.098 INFO:tasks.rados.rados.2.smithi057.stdout:1946: expect (ObjNum 622 snap 217 seq_num 622) 2020-11-16T22:09:17.225 INFO:tasks.rados.rados.2.smithi057.stdout:1947: finishing copy_from to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:17.225 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1108 (ObjNum 647 snap 225 seq_num 647) dirty exists 2020-11-16T22:09:17.225 INFO:tasks.rados.rados.2.smithi057.stdout:1947: finishing copy_from racing read to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:17.225 INFO:tasks.rados.rados.2.smithi057.stdout:1948: finishing write tid 1 to smithi05720651-14 2020-11-16T22:09:17.226 INFO:tasks.rados.rados.2.smithi057.stdout:1948: finishing write tid 2 to smithi05720651-14 2020-11-16T22:09:17.226 INFO:tasks.rados.rados.2.smithi057.stdout:1948: finishing write tid 3 to smithi05720651-14 2020-11-16T22:09:17.226 INFO:tasks.rados.rados.2.smithi057.stdout:1948: finishing write tid 5 to smithi05720651-14 2020-11-16T22:09:17.226 INFO:tasks.rados.rados.2.smithi057.stdout:1948: finishing write tid 6 to smithi05720651-14 2020-11-16T22:09:17.226 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 1645 (ObjNum 650 snap 228 seq_num 650) dirty exists 2020-11-16T22:09:17.226 INFO:tasks.rados.rados.2.smithi057.stdout:1948: left oid 14 (ObjNum 650 snap 228 seq_num 650) 2020-11-16T22:09:17.227 INFO:tasks.rados.rados.2.smithi057.stdout:1949: finishing write tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:17.227 INFO:tasks.rados.rados.2.smithi057.stdout:1951: finishing write tid 1 to smithi05720651-24 2020-11-16T22:09:17.227 INFO:tasks.rados.rados.2.smithi057.stdout:1950: expect (ObjNum 548 snap 199 seq_num 548) 2020-11-16T22:09:17.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:17 smithi016 bash[10302]: cluster 2020-11-16T22:09:15.722736+0000 mgr.x (mgr.24115) 499 : cluster [DBG] pgmap v956: 17 pgs: 17 active+clean; 116 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 965 KiB/s wr, 10 op/s 2020-11-16T22:09:17.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:17 smithi016 bash[10302]: cluster 2020-11-16T22:09:16.046005+0000 mon.a (mon.0) 1183 : cluster [DBG] osdmap e528: 12 total, 12 up, 12 in 2020-11-16T22:09:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:17 smithi195 bash[10218]: cluster 2020-11-16T22:09:15.722736+0000 mgr.x (mgr.24115) 499 : cluster [DBG] pgmap v956: 17 pgs: 17 active+clean; 116 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 965 KiB/s wr, 10 op/s 2020-11-16T22:09:17.554 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:17 smithi195 bash[10218]: cluster 2020-11-16T22:09:16.046005+0000 mon.a (mon.0) 1183 : cluster [DBG] osdmap e528: 12 total, 12 up, 12 in 2020-11-16T22:09:17.759 INFO:tasks.rados.rados.2.smithi057.stdout:1949: finishing write tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:17.962 INFO:tasks.rados.rados.2.smithi057.stdout:1949: finishing write tid 4 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:18.166 INFO:tasks.rados.rados.2.smithi057.stdout:1949: finishing write tid 5 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:18.370 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1547 (ObjNum 651 snap 228 seq_num 651) dirty exists 2020-11-16T22:09:18.370 INFO:tasks.rados.rados.2.smithi057.stdout:1949: left oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 651 snap 228 seq_num 651) 2020-11-16T22:09:18.574 INFO:tasks.rados.rados.2.smithi057.stdout:1951: finishing write tid 2 to smithi05720651-24 2020-11-16T22:09:18.574 INFO:tasks.rados.rados.2.smithi057.stdout:1951: finishing write tid 3 to smithi05720651-24 2020-11-16T22:09:18.778 INFO:tasks.rados.rados.2.smithi057.stdout:1951: finishing write tid 5 to smithi05720651-24 2020-11-16T22:09:18.778 INFO:tasks.rados.rados.2.smithi057.stdout:1951: finishing write tid 6 to smithi05720651-24 2020-11-16T22:09:18.778 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 1537 (ObjNum 652 snap 228 seq_num 652) dirty exists 2020-11-16T22:09:18.779 INFO:tasks.rados.rados.2.smithi057.stdout:1951: left oid 24 (ObjNum 652 snap 228 seq_num 652) 2020-11-16T22:09:18.779 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:17 smithi057 bash[10301]: cluster 2020-11-16T22:09:15.722736+0000 mgr.x (mgr.24115) 499 : cluster [DBG] pgmap v956: 17 pgs: 17 active+clean; 116 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 965 KiB/s wr, 10 op/s 2020-11-16T22:09:18.779 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:17 smithi057 bash[10301]: cluster 2020-11-16T22:09:16.046005+0000 mon.a (mon.0) 1183 : cluster [DBG] osdmap e528: 12 total, 12 up, 12 in 2020-11-16T22:09:18.780 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:18 smithi195 bash[10218]: cluster 2020-11-16T22:09:17.055847+0000 mon.a (mon.0) 1184 : cluster [DBG] osdmap e529: 12 total, 12 up, 12 in 2020-11-16T22:09:18.780 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:18 smithi016 bash[10302]: cluster 2020-11-16T22:09:17.055847+0000 mon.a (mon.0) 1184 : cluster [DBG] osdmap e529: 12 total, 12 up, 12 in 2020-11-16T22:09:18.781 INFO:tasks.rados.rados.2.smithi057.stdout:1945: done (7 left) 2020-11-16T22:09:18.781 INFO:tasks.rados.rados.2.smithi057.stdout:1946: done (6 left) 2020-11-16T22:09:18.781 INFO:tasks.rados.rados.2.smithi057.stdout:1947: done (5 left) 2020-11-16T22:09:18.781 INFO:tasks.rados.rados.2.smithi057.stdout:1948: done (4 left) 2020-11-16T22:09:18.781 INFO:tasks.rados.rados.2.smithi057.stdout:1949: done (3 left) 2020-11-16T22:09:18.781 INFO:tasks.rados.rados.2.smithi057.stdout:1950: done (2 left) 2020-11-16T22:09:18.781 INFO:tasks.rados.rados.2.smithi057.stdout:1951: done (1 left) 2020-11-16T22:09:18.782 INFO:tasks.rados.rados.2.smithi057.stdout:1952: done (0 left) 2020-11-16T22:09:18.782 INFO:tasks.rados.rados.2.smithi057.stdout:1953: write oid 20 current snap is 229 2020-11-16T22:09:18.782 INFO:tasks.rados.rados.2.smithi057.stdout:1953: seq_num 653 ranges {574971=627602,1862271=598221} 2020-11-16T22:09:18.782 INFO:tasks.rados.rados.2.smithi057.stdout:1953: writing smithi05720651-20 from 574971 to 1202573 tid 1 2020-11-16T22:09:18.986 INFO:tasks.rados.rados.2.smithi057.stdout:1953: writing smithi05720651-20 from 1862271 to 2460492 tid 2 2020-11-16T22:09:18.986 INFO:tasks.rados.rados.2.smithi057.stdout:1954: snap_remove snap 228 2020-11-16T22:09:18.986 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:18 smithi057 bash[10301]: cluster 2020-11-16T22:09:17.055847+0000 mon.a (mon.0) 1184 : cluster [DBG] osdmap e529: 12 total, 12 up, 12 in 2020-11-16T22:09:19.057 INFO:tasks.rados.rados.2.smithi057.stdout:1954: done (1 left) 2020-11-16T22:09:19.057 INFO:tasks.rados.rados.2.smithi057.stdout:1955: snap_remove snap 226 2020-11-16T22:09:19.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:19 smithi016 bash[10302]: cluster 2020-11-16T22:09:17.723411+0000 mgr.x (mgr.24115) 500 : cluster [DBG] pgmap v959: 17 pgs: 17 active+clean; 122 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 1.9 MiB/s wr, 25 op/s 2020-11-16T22:09:19.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:19 smithi016 bash[10302]: cluster 2020-11-16T22:09:18.065885+0000 mon.a (mon.0) 1185 : cluster [DBG] osdmap e530: 12 total, 12 up, 12 in 2020-11-16T22:09:19.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:19 smithi195 bash[10218]: cluster 2020-11-16T22:09:17.723411+0000 mgr.x (mgr.24115) 500 : cluster [DBG] pgmap v959: 17 pgs: 17 active+clean; 122 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 1.9 MiB/s wr, 25 op/s 2020-11-16T22:09:19.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:19 smithi195 bash[10218]: cluster 2020-11-16T22:09:18.065885+0000 mon.a (mon.0) 1185 : cluster [DBG] osdmap e530: 12 total, 12 up, 12 in 2020-11-16T22:09:19.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:19 smithi057 bash[10301]: cluster 2020-11-16T22:09:17.723411+0000 mgr.x (mgr.24115) 500 : cluster [DBG] pgmap v959: 17 pgs: 17 active+clean; 122 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 1.9 MiB/s wr, 25 op/s 2020-11-16T22:09:19.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:19 smithi057 bash[10301]: cluster 2020-11-16T22:09:18.065885+0000 mon.a (mon.0) 1185 : cluster [DBG] osdmap e530: 12 total, 12 up, 12 in 2020-11-16T22:09:20.034 INFO:tasks.rados.rados.2.smithi057.stdout:1955: done (1 left) 2020-11-16T22:09:20.034 INFO:tasks.rados.rados.2.smithi057.stdout:1956: read oid 38 snap -1 2020-11-16T22:09:20.035 INFO:tasks.rados.rados.2.smithi057.stdout:1956: expect (ObjNum 633 snap 220 seq_num 633) 2020-11-16T22:09:20.035 INFO:tasks.rados.rados.2.smithi057.stdout:1957: snap_create 2020-11-16T22:09:20.035 INFO:tasks.rados.rados.2.smithi057.stdout:1953: finishing write tid 1 to smithi05720651-20 2020-11-16T22:09:20.035 INFO:tasks.rados.rados.2.smithi057.stdout:1953: finishing write tid 2 to smithi05720651-20 2020-11-16T22:09:20.035 INFO:tasks.rados.rados.2.smithi057.stdout:1953: finishing write tid 4 to smithi05720651-20 2020-11-16T22:09:20.036 INFO:tasks.rados.rados.2.smithi057.stdout:1953: finishing write tid 5 to smithi05720651-20 2020-11-16T22:09:20.036 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1120 (ObjNum 653 snap 229 seq_num 653) dirty exists 2020-11-16T22:09:20.036 INFO:tasks.rados.rados.2.smithi057.stdout:1953: left oid 20 (ObjNum 653 snap 229 seq_num 653) 2020-11-16T22:09:20.047 INFO:tasks.rados.rados.2.smithi057.stdout:1956: expect (ObjNum 633 snap 220 seq_num 633) 2020-11-16T22:09:20.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:20 smithi016 bash[10302]: cluster 2020-11-16T22:09:19.068159+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e531: 12 total, 12 up, 12 in 2020-11-16T22:09:20.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:20 smithi016 bash[10302]: cluster 2020-11-16T22:09:20.045339+0000 mon.a (mon.0) 1187 : cluster [DBG] osdmap e532: 12 total, 12 up, 12 in 2020-11-16T22:09:20.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:20 smithi195 bash[10218]: cluster 2020-11-16T22:09:19.068159+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e531: 12 total, 12 up, 12 in 2020-11-16T22:09:20.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:20 smithi195 bash[10218]: cluster 2020-11-16T22:09:20.045339+0000 mon.a (mon.0) 1187 : cluster [DBG] osdmap e532: 12 total, 12 up, 12 in 2020-11-16T22:09:20.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:20 smithi057 bash[10301]: cluster 2020-11-16T22:09:19.068159+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e531: 12 total, 12 up, 12 in 2020-11-16T22:09:20.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:20 smithi057 bash[10301]: cluster 2020-11-16T22:09:20.045339+0000 mon.a (mon.0) 1187 : cluster [DBG] osdmap e532: 12 total, 12 up, 12 in 2020-11-16T22:09:21.036 INFO:tasks.rados.rados.2.smithi057.stdout:1953: done (2 left) 2020-11-16T22:09:21.036 INFO:tasks.rados.rados.2.smithi057.stdout:1956: done (1 left) 2020-11-16T22:09:21.036 INFO:tasks.rados.rados.2.smithi057.stdout:1957: done (0 left) 2020-11-16T22:09:21.036 INFO:tasks.rados.rados.2.smithi057.stdout:1958: copy_from oid 12 from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 230 2020-11-16T22:09:21.037 INFO:tasks.rados.rados.2.smithi057.stdout:1959: snap_remove snap 229 2020-11-16T22:09:21.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:21 smithi016 bash[10302]: cluster 2020-11-16T22:09:19.724061+0000 mgr.x (mgr.24115) 501 : cluster [DBG] pgmap v962: 17 pgs: 17 active+clean; 122 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 935 KiB/s wr, 14 op/s 2020-11-16T22:09:21.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:21 smithi016 bash[10302]: cluster 2020-11-16T22:09:21.047520+0000 mon.a (mon.0) 1188 : cluster [DBG] osdmap e533: 12 total, 12 up, 12 in 2020-11-16T22:09:21.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:21 smithi195 bash[10218]: cluster 2020-11-16T22:09:19.724061+0000 mgr.x (mgr.24115) 501 : cluster [DBG] pgmap v962: 17 pgs: 17 active+clean; 122 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 935 KiB/s wr, 14 op/s 2020-11-16T22:09:21.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:21 smithi195 bash[10218]: cluster 2020-11-16T22:09:21.047520+0000 mon.a (mon.0) 1188 : cluster [DBG] osdmap e533: 12 total, 12 up, 12 in 2020-11-16T22:09:21.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:21 smithi057 bash[10301]: cluster 2020-11-16T22:09:19.724061+0000 mgr.x (mgr.24115) 501 : cluster [DBG] pgmap v962: 17 pgs: 17 active+clean; 122 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 935 KiB/s wr, 14 op/s 2020-11-16T22:09:21.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:21 smithi057 bash[10301]: cluster 2020-11-16T22:09:21.047520+0000 mon.a (mon.0) 1188 : cluster [DBG] osdmap e533: 12 total, 12 up, 12 in 2020-11-16T22:09:22.038 INFO:tasks.rados.rados.2.smithi057.stdout:1959: done (1 left) 2020-11-16T22:09:22.039 INFO:tasks.rados.rados.2.smithi057.stdout:1960: snap_remove snap 223 2020-11-16T22:09:23.049 INFO:tasks.rados.rados.2.smithi057.stdout:1960: done (1 left) 2020-11-16T22:09:23.049 INFO:tasks.rados.rados.2.smithi057.stdout:1961: copy_from oid 40 from oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 230 2020-11-16T22:09:23.049 INFO:tasks.rados.rados.2.smithi057.stdout:1958: finishing copy_from to smithi05720651-12 2020-11-16T22:09:23.049 INFO:tasks.rados.rados.2.smithi057.stdout:1958: got expected ENOENT (src dne) 2020-11-16T22:09:23.050 INFO:tasks.rados.rados.2.smithi057.stdout:1958: finishing copy_from racing read to smithi05720651-12 2020-11-16T22:09:23.050 INFO:tasks.rados.rados.2.smithi057.stdout:1958: done (1 left) 2020-11-16T22:09:23.050 INFO:tasks.rados.rados.2.smithi057.stdout:1962: snap_remove snap 227 2020-11-16T22:09:23.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:23 smithi016 bash[10302]: cluster 2020-11-16T22:09:21.724744+0000 mgr.x (mgr.24115) 502 : cluster [DBG] pgmap v965: 17 pgs: 17 active+clean; 131 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2020-11-16T22:09:23.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:23 smithi016 bash[10302]: cluster 2020-11-16T22:09:22.050148+0000 mon.a (mon.0) 1189 : cluster [DBG] osdmap e534: 12 total, 12 up, 12 in 2020-11-16T22:09:23.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:23 smithi195 bash[10218]: cluster 2020-11-16T22:09:21.724744+0000 mgr.x (mgr.24115) 502 : cluster [DBG] pgmap v965: 17 pgs: 17 active+clean; 131 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2020-11-16T22:09:23.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:23 smithi195 bash[10218]: cluster 2020-11-16T22:09:22.050148+0000 mon.a (mon.0) 1189 : cluster [DBG] osdmap e534: 12 total, 12 up, 12 in 2020-11-16T22:09:23.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:23 smithi057 bash[10301]: cluster 2020-11-16T22:09:21.724744+0000 mgr.x (mgr.24115) 502 : cluster [DBG] pgmap v965: 17 pgs: 17 active+clean; 131 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 2.1 MiB/s wr, 11 op/s 2020-11-16T22:09:23.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:23 smithi057 bash[10301]: cluster 2020-11-16T22:09:22.050148+0000 mon.a (mon.0) 1189 : cluster [DBG] osdmap e534: 12 total, 12 up, 12 in 2020-11-16T22:09:23.837 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 22:09:23 smithi016 bash[15120]: debug 2020-11-16T22:09:23.348+0000 7f8fc6db9700 -1 osd.5 pg_epoch: 535 pg[2.3( v 529'1547 (0'0,529'1547] local-lis/les=71/72 n=9 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [5,2] r=0 lpr=71 crt=529'1547 lcod 529'1546 mlcod 529'1546 active+clean+snaptrim trimq=[1c0~1] ps=[1c2~1,1c4~1,1c7~1,1ca~1]] removing snap head 2020-11-16T22:09:24.059 INFO:tasks.rados.rados.2.smithi057.stdout:1962: done (1 left) 2020-11-16T22:09:24.059 INFO:tasks.rados.rados.2.smithi057.stdout:1963: read oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:24.059 INFO:tasks.rados.rados.2.smithi057.stdout:1963: expect deleted 2020-11-16T22:09:24.059 INFO:tasks.rados.rados.2.smithi057.stdout:1964: snap_create 2020-11-16T22:09:24.059 INFO:tasks.rados.rados.2.smithi057.stdout:1961: finishing copy_from to smithi05720651-40 2020-11-16T22:09:24.060 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 1108 (ObjNum 647 snap 225 seq_num 647) dirty exists 2020-11-16T22:09:24.060 INFO:tasks.rados.rados.2.smithi057.stdout:1961: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:09:24.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:24 smithi016 bash[10302]: cluster 2020-11-16T22:09:23.060355+0000 mon.a (mon.0) 1190 : cluster [DBG] osdmap e535: 12 total, 12 up, 12 in 2020-11-16T22:09:24.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:24 smithi195 bash[10218]: cluster 2020-11-16T22:09:23.060355+0000 mon.a (mon.0) 1190 : cluster [DBG] osdmap e535: 12 total, 12 up, 12 in 2020-11-16T22:09:24.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:24 smithi057 bash[10301]: cluster 2020-11-16T22:09:23.060355+0000 mon.a (mon.0) 1190 : cluster [DBG] osdmap e535: 12 total, 12 up, 12 in 2020-11-16T22:09:25.036 INFO:tasks.rados.rados.2.smithi057.stdout:1961: done (2 left) 2020-11-16T22:09:25.037 INFO:tasks.rados.rados.2.smithi057.stdout:1963: done (1 left) 2020-11-16T22:09:25.037 INFO:tasks.rados.rados.2.smithi057.stdout:1964: done (0 left) 2020-11-16T22:09:25.037 INFO:tasks.rados.rados.2.smithi057.stdout:1965: read oid 32 snap -1 2020-11-16T22:09:25.037 INFO:tasks.rados.rados.2.smithi057.stdout:1965: expect (ObjNum 592 snap 207 seq_num 592) 2020-11-16T22:09:25.037 INFO:tasks.rados.rados.2.smithi057.stdout:1966: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:25.037 INFO:tasks.rados.rados.2.smithi057.stdout:1966: expect deleted 2020-11-16T22:09:25.038 INFO:tasks.rados.rados.2.smithi057.stdout:1967: rollback oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 231 2020-11-16T22:09:25.038 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 230 2020-11-16T22:09:25.038 INFO:tasks.rados.rados.2.smithi057.stdout:1968: write oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 231 2020-11-16T22:09:25.038 INFO:tasks.rados.rados.2.smithi057.stdout:1968: seq_num 654 ranges {591778=419204,1637106=741879,2910049=81729} 2020-11-16T22:09:25.049 INFO:tasks.rados.rados.2.smithi057.stdout:1968: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 591778 to 1010982 tid 1 2020-11-16T22:09:25.058 INFO:tasks.rados.rados.2.smithi057.stdout:1968: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1637106 to 2378985 tid 2 2020-11-16T22:09:25.061 INFO:tasks.rados.rados.2.smithi057.stdout:1968: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2910049 to 2991778 tid 3 2020-11-16T22:09:25.062 INFO:tasks.rados.rados.2.smithi057.stdout:1969: snap_create 2020-11-16T22:09:25.062 INFO:tasks.rados.rados.2.smithi057.stdout:1965: expect (ObjNum 592 snap 207 seq_num 592) 2020-11-16T22:09:25.186 INFO:tasks.rados.rados.2.smithi057.stdout:1967: finishing rollback tid 0 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:25.186 INFO:tasks.rados.rados.2.smithi057.stdout:1967: finishing rollback tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:25.186 INFO:tasks.rados.rados.2.smithi057.stdout:1967: finishing rollback tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:25.187 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1665 (ObjNum 644 snap 225 seq_num 644) dirty exists 2020-11-16T22:09:25.187 INFO:tasks.rados.rados.2.smithi057.stdout:1968: finishing write tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:25.187 INFO:tasks.rados.rados.2.smithi057.stdout:1968: finishing write tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:25.187 INFO:tasks.rados.rados.2.smithi057.stdout:1968: finishing write tid 3 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:25.187 INFO:tasks.rados.rados.2.smithi057.stdout:1968: finishing write tid 5 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:25.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:25 smithi016 bash[10302]: cluster 2020-11-16T22:09:23.725464+0000 mgr.x (mgr.24115) 503 : cluster [DBG] pgmap v968: 17 pgs: 17 active+clean; 132 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2020-11-16T22:09:25.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:25 smithi016 bash[10302]: cluster 2020-11-16T22:09:24.070161+0000 mon.a (mon.0) 1191 : cluster [DBG] osdmap e536: 12 total, 12 up, 12 in 2020-11-16T22:09:25.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:25 smithi016 bash[10302]: cluster 2020-11-16T22:09:25.047425+0000 mon.a (mon.0) 1192 : cluster [DBG] osdmap e537: 12 total, 12 up, 12 in 2020-11-16T22:09:25.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:25 smithi195 bash[10218]: cluster 2020-11-16T22:09:23.725464+0000 mgr.x (mgr.24115) 503 : cluster [DBG] pgmap v968: 17 pgs: 17 active+clean; 132 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2020-11-16T22:09:25.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:25 smithi195 bash[10218]: cluster 2020-11-16T22:09:24.070161+0000 mon.a (mon.0) 1191 : cluster [DBG] osdmap e536: 12 total, 12 up, 12 in 2020-11-16T22:09:25.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:25 smithi195 bash[10218]: cluster 2020-11-16T22:09:25.047425+0000 mon.a (mon.0) 1192 : cluster [DBG] osdmap e537: 12 total, 12 up, 12 in 2020-11-16T22:09:25.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:25 smithi057 bash[10301]: cluster 2020-11-16T22:09:23.725464+0000 mgr.x (mgr.24115) 503 : cluster [DBG] pgmap v968: 17 pgs: 17 active+clean; 132 MiB data, 559 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 2.4 MiB/s wr, 12 op/s 2020-11-16T22:09:25.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:25 smithi057 bash[10301]: cluster 2020-11-16T22:09:24.070161+0000 mon.a (mon.0) 1191 : cluster [DBG] osdmap e536: 12 total, 12 up, 12 in 2020-11-16T22:09:25.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:25 smithi057 bash[10301]: cluster 2020-11-16T22:09:25.047425+0000 mon.a (mon.0) 1192 : cluster [DBG] osdmap e537: 12 total, 12 up, 12 in 2020-11-16T22:09:25.793 INFO:tasks.rados.rados.2.smithi057.stdout:1968: finishing write tid 6 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:25.794 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1669 (ObjNum 654 snap 231 seq_num 654) dirty exists 2020-11-16T22:09:25.794 INFO:tasks.rados.rados.2.smithi057.stdout:1968: left oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 654 snap 231 seq_num 654) 2020-11-16T22:09:26.068 INFO:tasks.rados.rados.2.smithi057.stdout:1965: done (4 left) 2020-11-16T22:09:26.069 INFO:tasks.rados.rados.2.smithi057.stdout:1966: done (3 left) 2020-11-16T22:09:26.069 INFO:tasks.rados.rados.2.smithi057.stdout:1967: done (2 left) 2020-11-16T22:09:26.069 INFO:tasks.rados.rados.2.smithi057.stdout:1968: done (1 left) 2020-11-16T22:09:26.069 INFO:tasks.rados.rados.2.smithi057.stdout:1969: done (0 left) 2020-11-16T22:09:26.069 INFO:tasks.rados.rados.2.smithi057.stdout:1970: rollback oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 232 2020-11-16T22:09:26.070 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 231 2020-11-16T22:09:26.070 INFO:tasks.rados.rados.2.smithi057.stdout:1971: copy_from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 12 current snap is 232 2020-11-16T22:09:26.070 INFO:tasks.rados.rados.2.smithi057.stdout:1972: read oid 48 snap -1 2020-11-16T22:09:26.070 INFO:tasks.rados.rados.2.smithi057.stdout:1972: expect (ObjNum 542 snap 194 seq_num 542) 2020-11-16T22:09:26.070 INFO:tasks.rados.rados.2.smithi057.stdout:1973: write (excl) oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 232 2020-11-16T22:09:26.070 INFO:tasks.rados.rados.2.smithi057.stdout:1973: seq_num 655 ranges {608585=494453,1579235=601890,2821119=187466} 2020-11-16T22:09:26.084 INFO:tasks.rados.rados.2.smithi057.stdout:1973: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 608585 to 1103038 tid 1 2020-11-16T22:09:26.090 INFO:tasks.rados.rados.2.smithi057.stdout:1973: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1579235 to 2181125 tid 2 2020-11-16T22:09:26.094 INFO:tasks.rados.rados.2.smithi057.stdout:1973: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2821119 to 3008585 tid 3 2020-11-16T22:09:26.095 INFO:tasks.rados.rados.2.smithi057.stdout:1974: read oid 40 snap -1 2020-11-16T22:09:26.095 INFO:tasks.rados.rados.2.smithi057.stdout:1974: expect (ObjNum 647 snap 225 seq_num 647) 2020-11-16T22:09:26.095 INFO:tasks.rados.rados.2.smithi057.stdout:1975: read oid 2 snap -1 2020-11-16T22:09:26.095 INFO:tasks.rados.rados.2.smithi057.stdout:1975: expect (ObjNum 625 snap 217 seq_num 625) 2020-11-16T22:09:26.095 INFO:tasks.rados.rados.2.smithi057.stdout:1976: rollback oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 232 2020-11-16T22:09:26.095 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 231 2020-11-16T22:09:26.096 INFO:tasks.rados.rados.2.smithi057.stdout:1970: finishing rollback tid 0 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:26.096 INFO:tasks.rados.rados.2.smithi057.stdout:1970: finishing rollback tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:26.096 INFO:tasks.rados.rados.2.smithi057.stdout:1970: finishing rollback tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:26.096 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1673 (ObjNum 644 snap 225 seq_num 644) dirty exists 2020-11-16T22:09:26.096 INFO:tasks.rados.rados.2.smithi057.stdout:1972: expect (ObjNum 542 snap 194 seq_num 542) 2020-11-16T22:09:26.198 INFO:tasks.rados.rados.2.smithi057.stdout:1974: expect (ObjNum 647 snap 225 seq_num 647) 2020-11-16T22:09:26.437 INFO:tasks.rados.rados.2.smithi057.stdout:1975: expect (ObjNum 625 snap 217 seq_num 625) 2020-11-16T22:09:26.545 INFO:tasks.rados.rados.2.smithi057.stdout:1971: finishing copy_from to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:26.546 INFO:tasks.rados.rados.2.smithi057.stdout:1971: got expected ENOENT (src dne) 2020-11-16T22:09:26.546 INFO:tasks.rados.rados.2.smithi057.stdout:1971: finishing copy_from racing read to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:26.546 INFO:tasks.rados.rados.2.smithi057.stdout:1973: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:26.546 INFO:tasks.rados.rados.2.smithi057.stdout:1976: finishing rollback tid 0 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:26.546 INFO:tasks.rados.rados.2.smithi057.stdout:1976: finishing rollback tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:26.547 INFO:tasks.rados.rados.2.smithi057.stdout:1973: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:26.547 INFO:tasks.rados.rados.2.smithi057.stdout:1973: finishing write tid 3 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:26.547 INFO:tasks.rados.rados.2.smithi057.stdout:1973: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:26.547 INFO:tasks.rados.rados.2.smithi057.stdout:1973: finishing write tid 6 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:26.547 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1559 (ObjNum 655 snap 232 seq_num 655) dirty exists 2020-11-16T22:09:26.547 INFO:tasks.rados.rados.2.smithi057.stdout:1973: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 655 snap 232 seq_num 655) 2020-11-16T22:09:26.548 INFO:tasks.rados.rados.2.smithi057.stdout:1970: done (6 left) 2020-11-16T22:09:26.548 INFO:tasks.rados.rados.2.smithi057.stdout:1971: done (5 left) 2020-11-16T22:09:26.548 INFO:tasks.rados.rados.2.smithi057.stdout:1972: done (4 left) 2020-11-16T22:09:26.548 INFO:tasks.rados.rados.2.smithi057.stdout:1973: done (3 left) 2020-11-16T22:09:26.548 INFO:tasks.rados.rados.2.smithi057.stdout:1974: done (2 left) 2020-11-16T22:09:26.548 INFO:tasks.rados.rados.2.smithi057.stdout:1975: done (1 left) 2020-11-16T22:09:26.548 INFO:tasks.rados.rados.2.smithi057.stdout:1977: read oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:26.549 INFO:tasks.rados.rados.2.smithi057.stdout:1977: expect (ObjNum 634 snap 220 seq_num 634) 2020-11-16T22:09:26.549 INFO:tasks.rados.rados.2.smithi057.stdout:1978: write (excl) oid 48 current snap is 232 2020-11-16T22:09:26.549 INFO:tasks.rados.rados.2.smithi057.stdout:1978: seq_num 656 ranges {625392=569702,1637717=745548,2848542=176850} 2020-11-16T22:09:26.561 INFO:tasks.rados.rados.2.smithi057.stdout:1978: writing smithi05720651-48 from 625392 to 1195094 tid 1 2020-11-16T22:09:26.568 INFO:tasks.rados.rados.2.smithi057.stdout:1978: writing smithi05720651-48 from 1637717 to 2383265 tid 2 2020-11-16T22:09:26.572 INFO:tasks.rados.rados.2.smithi057.stdout:1978: writing smithi05720651-48 from 2848542 to 3025392 tid 3 2020-11-16T22:09:26.572 INFO:tasks.rados.rados.2.smithi057.stdout:1979: delete oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 232 2020-11-16T22:09:26.572 INFO:tasks.rados.rados.2.smithi057.stdout:1976: finishing rollback tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:26.572 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1560 (ObjNum 651 snap 228 seq_num 651) dirty exists 2020-11-16T22:09:26.572 INFO:tasks.rados.rados.2.smithi057.stdout:1977: expect (ObjNum 634 snap 220 seq_num 634) 2020-11-16T22:09:26.694 INFO:tasks.rados.rados.2.smithi057.stdout:1978: finishing write tid 1 to smithi05720651-48 2020-11-16T22:09:26.695 INFO:tasks.rados.rados.2.smithi057.stdout:1978: finishing write tid 2 to smithi05720651-48 2020-11-16T22:09:26.695 INFO:tasks.rados.rados.2.smithi057.stdout:1978: finishing write tid 3 to smithi05720651-48 2020-11-16T22:09:26.695 INFO:tasks.rados.rados.2.smithi057.stdout:1978: finishing write tid 5 to smithi05720651-48 2020-11-16T22:09:26.695 INFO:tasks.rados.rados.2.smithi057.stdout:1978: finishing write tid 6 to smithi05720651-48 2020-11-16T22:09:26.695 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 1495 (ObjNum 656 snap 232 seq_num 656) dirty exists 2020-11-16T22:09:26.695 INFO:tasks.rados.rados.2.smithi057.stdout:1978: left oid 48 (ObjNum 656 snap 232 seq_num 656) 2020-11-16T22:09:26.707 INFO:tasks.rados.rados.2.smithi057.stdout:1976: done (3 left) 2020-11-16T22:09:26.707 INFO:tasks.rados.rados.2.smithi057.stdout:1977: done (2 left) 2020-11-16T22:09:26.707 INFO:tasks.rados.rados.2.smithi057.stdout:1978: done (1 left) 2020-11-16T22:09:26.707 INFO:tasks.rados.rados.2.smithi057.stdout:1979: done (0 left) 2020-11-16T22:09:26.707 INFO:tasks.rados.rados.2.smithi057.stdout:1980: copy_from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 232 2020-11-16T22:09:26.708 INFO:tasks.rados.rados.2.smithi057.stdout:1981: rollback oid 14 current snap is 232 2020-11-16T22:09:26.708 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 14 to 231 2020-11-16T22:09:26.708 INFO:tasks.rados.rados.2.smithi057.stdout:1982: copy_from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 232 2020-11-16T22:09:26.708 INFO:tasks.rados.rados.2.smithi057.stdout:1983: write oid 34 current snap is 232 2020-11-16T22:09:26.708 INFO:tasks.rados.rados.2.smithi057.stdout:1983: seq_num 658 ranges {659006=720200,2154681=749217} 2020-11-16T22:09:26.724 INFO:tasks.rados.rados.2.smithi057.stdout:1983: writing smithi05720651-34 from 659006 to 1379206 tid 1 2020-11-16T22:09:26.733 INFO:tasks.rados.rados.2.smithi057.stdout:1983: writing smithi05720651-34 from 2154681 to 2903898 tid 2 2020-11-16T22:09:26.733 INFO:tasks.rados.rados.2.smithi057.stdout:1984: snap_remove snap 230 2020-11-16T22:09:27.080 INFO:tasks.rados.rados.2.smithi057.stdout:1984: done (4 left) 2020-11-16T22:09:27.080 INFO:tasks.rados.rados.2.smithi057.stdout:1985: snap_create 2020-11-16T22:09:27.081 INFO:tasks.rados.rados.2.smithi057.stdout:1980: finishing copy_from to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:27.081 INFO:tasks.rados.rados.2.smithi057.stdout:1980: got expected ENOENT (src dne) 2020-11-16T22:09:27.081 INFO:tasks.rados.rados.2.smithi057.stdout:1980: finishing copy_from racing read to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:27.081 INFO:tasks.rados.rados.2.smithi057.stdout:1981: finishing rollback tid 0 to smithi05720651-14 2020-11-16T22:09:27.081 INFO:tasks.rados.rados.2.smithi057.stdout:1981: finishing rollback tid 1 to smithi05720651-14 2020-11-16T22:09:27.081 INFO:tasks.rados.rados.2.smithi057.stdout:1981: finishing rollback tid 2 to smithi05720651-14 2020-11-16T22:09:27.081 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 1677 (ObjNum 650 snap 228 seq_num 650) dirty exists 2020-11-16T22:09:27.082 INFO:tasks.rados.rados.2.smithi057.stdout:1982: finishing copy_from to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:27.082 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1325 (ObjNum 496 snap 177 seq_num 496) dirty exists 2020-11-16T22:09:27.082 INFO:tasks.rados.rados.2.smithi057.stdout:1982: finishing copy_from racing read to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:27.082 INFO:tasks.rados.rados.2.smithi057.stdout:1983: finishing write tid 1 to smithi05720651-34 2020-11-16T22:09:27.082 INFO:tasks.rados.rados.2.smithi057.stdout:1983: finishing write tid 2 to smithi05720651-34 2020-11-16T22:09:27.082 INFO:tasks.rados.rados.2.smithi057.stdout:1983: finishing write tid 4 to smithi05720651-34 2020-11-16T22:09:27.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:27 smithi016 bash[10302]: cluster 2020-11-16T22:09:25.726164+0000 mgr.x (mgr.24115) 504 : cluster [DBG] pgmap v971: 17 pgs: 17 active+clean; 124 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 299 KiB/s wr, 1 op/s 2020-11-16T22:09:27.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:27 smithi016 bash[10302]: cluster 2020-11-16T22:09:26.079888+0000 mon.a (mon.0) 1193 : cluster [DBG] osdmap e538: 12 total, 12 up, 12 in 2020-11-16T22:09:27.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:27 smithi195 bash[10218]: cluster 2020-11-16T22:09:25.726164+0000 mgr.x (mgr.24115) 504 : cluster [DBG] pgmap v971: 17 pgs: 17 active+clean; 124 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 299 KiB/s wr, 1 op/s 2020-11-16T22:09:27.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:27 smithi195 bash[10218]: cluster 2020-11-16T22:09:26.079888+0000 mon.a (mon.0) 1193 : cluster [DBG] osdmap e538: 12 total, 12 up, 12 in 2020-11-16T22:09:27.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:27 smithi057 bash[10301]: cluster 2020-11-16T22:09:25.726164+0000 mgr.x (mgr.24115) 504 : cluster [DBG] pgmap v971: 17 pgs: 17 active+clean; 124 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 299 KiB/s wr, 1 op/s 2020-11-16T22:09:27.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:27 smithi057 bash[10301]: cluster 2020-11-16T22:09:26.079888+0000 mon.a (mon.0) 1193 : cluster [DBG] osdmap e538: 12 total, 12 up, 12 in 2020-11-16T22:09:27.573 INFO:tasks.rados.rados.2.smithi057.stdout:1983: finishing write tid 5 to smithi05720651-34 2020-11-16T22:09:27.574 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 1123 (ObjNum 658 snap 232 seq_num 658) dirty exists 2020-11-16T22:09:27.574 INFO:tasks.rados.rados.2.smithi057.stdout:1983: left oid 34 (ObjNum 658 snap 232 seq_num 658) 2020-11-16T22:09:28.083 INFO:tasks.rados.rados.2.smithi057.stdout:1980: done (4 left) 2020-11-16T22:09:28.083 INFO:tasks.rados.rados.2.smithi057.stdout:1981: done (3 left) 2020-11-16T22:09:28.083 INFO:tasks.rados.rados.2.smithi057.stdout:1982: done (2 left) 2020-11-16T22:09:28.083 INFO:tasks.rados.rados.2.smithi057.stdout:1983: done (1 left) 2020-11-16T22:09:28.083 INFO:tasks.rados.rados.2.smithi057.stdout:1985: done (0 left) 2020-11-16T22:09:28.084 INFO:tasks.rados.rados.2.smithi057.stdout:1986: write oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 233 2020-11-16T22:09:28.084 INFO:tasks.rados.rados.2.smithi057.stdout:1986: seq_num 659 ranges {675813=795449,2096810=609228} 2020-11-16T22:09:28.098 INFO:tasks.rados.rados.2.smithi057.stdout:1986: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 675813 to 1471262 tid 1 2020-11-16T22:09:28.106 INFO:tasks.rados.rados.2.smithi057.stdout:1986: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2096810 to 2706038 tid 2 2020-11-16T22:09:28.106 INFO:tasks.rados.rados.2.smithi057.stdout:1987: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:28.106 INFO:tasks.rados.rados.2.smithi057.stdout:1987: expect (ObjNum 654 snap 231 seq_num 654) 2020-11-16T22:09:28.106 INFO:tasks.rados.rados.2.smithi057.stdout:1988: rollback oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 233 2020-11-16T22:09:28.107 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 231 2020-11-16T22:09:28.107 INFO:tasks.rados.rados.2.smithi057.stdout:1989: rollback oid 36 current snap is 233 2020-11-16T22:09:28.107 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 36 to 231 2020-11-16T22:09:28.107 INFO:tasks.rados.rados.2.smithi057.stdout:1990: write oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 233 2020-11-16T22:09:28.107 INFO:tasks.rados.rados.2.smithi057.stdout:1990: seq_num 660 ranges {692620=470698,1755292=752886} 2020-11-16T22:09:28.112 INFO:tasks.rados.rados.2.smithi057.stdout:1990: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 692620 to 1163318 tid 1 2020-11-16T22:09:28.121 INFO:tasks.rados.rados.2.smithi057.stdout:1990: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1755292 to 2508178 tid 2 2020-11-16T22:09:28.121 INFO:tasks.rados.rados.2.smithi057.stdout:1991: read oid 14 snap -1 2020-11-16T22:09:28.121 INFO:tasks.rados.rados.2.smithi057.stdout:1991: expect (ObjNum 650 snap 228 seq_num 650) 2020-11-16T22:09:28.121 INFO:tasks.rados.rados.2.smithi057.stdout:1992: copy_from oid 12 from oid 46 current snap is 233 2020-11-16T22:09:28.121 INFO:tasks.rados.rados.2.smithi057.stdout:1986: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:28.122 INFO:tasks.rados.rados.2.smithi057.stdout:1989: finishing rollback tid 0 to smithi05720651-36 2020-11-16T22:09:28.122 INFO:tasks.rados.rados.2.smithi057.stdout:1986: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:28.122 INFO:tasks.rados.rados.2.smithi057.stdout:1989: finishing rollback tid 1 to smithi05720651-36 2020-11-16T22:09:28.122 INFO:tasks.rados.rados.2.smithi057.stdout:1986: finishing write tid 4 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:28.122 INFO:tasks.rados.rados.2.smithi057.stdout:1993: copy_from oid 4 from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 233 2020-11-16T22:09:28.122 INFO:tasks.rados.rados.2.smithi057.stdout:1986: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:28.122 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1572 (ObjNum 659 snap 233 seq_num 659) dirty exists 2020-11-16T22:09:28.123 INFO:tasks.rados.rados.2.smithi057.stdout:1986: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 659 snap 233 seq_num 659) 2020-11-16T22:09:28.123 INFO:tasks.rados.rados.2.smithi057.stdout:1989: finishing rollback tid 2 to smithi05720651-36 2020-11-16T22:09:28.123 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 1348 (ObjNum 643 snap 225 seq_num 643) dirty exists 2020-11-16T22:09:28.123 INFO:tasks.rados.rados.2.smithi057.stdout:1986: done (7 left) 2020-11-16T22:09:28.123 INFO:tasks.rados.rados.2.smithi057.stdout:1989: done (6 left) 2020-11-16T22:09:28.123 INFO:tasks.rados.rados.2.smithi057.stdout:1994: snap_remove snap 232 2020-11-16T22:09:28.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:28 smithi016 bash[10302]: cluster 2020-11-16T22:09:27.091768+0000 mon.a (mon.0) 1194 : cluster [DBG] osdmap e539: 12 total, 12 up, 12 in 2020-11-16T22:09:28.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:28 smithi195 bash[10218]: cluster 2020-11-16T22:09:27.091768+0000 mon.a (mon.0) 1194 : cluster [DBG] osdmap e539: 12 total, 12 up, 12 in 2020-11-16T22:09:28.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:28 smithi057 bash[10301]: cluster 2020-11-16T22:09:27.091768+0000 mon.a (mon.0) 1194 : cluster [DBG] osdmap e539: 12 total, 12 up, 12 in 2020-11-16T22:09:29.112 INFO:tasks.rados.rados.2.smithi057.stdout:1994: done (6 left) 2020-11-16T22:09:29.112 INFO:tasks.rados.rados.2.smithi057.stdout:1995: write (excl) oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 233 2020-11-16T22:09:29.112 INFO:tasks.rados.rados.2.smithi057.stdout:1995: seq_num 661 ranges {709427=545947,1813774=612897,2985657=123770} 2020-11-16T22:09:29.124 INFO:tasks.rados.rados.2.smithi057.stdout:1995: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 709427 to 1255374 tid 1 2020-11-16T22:09:29.131 INFO:tasks.rados.rados.2.smithi057.stdout:1995: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1813774 to 2426671 tid 2 2020-11-16T22:09:29.135 INFO:tasks.rados.rados.2.smithi057.stdout:1995: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2985657 to 3109427 tid 3 2020-11-16T22:09:29.135 INFO:tasks.rados.rados.2.smithi057.stdout:1996: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:29.136 INFO:tasks.rados.rados.2.smithi057.stdout:1996: expect (ObjNum 543 snap 194 seq_num 543) 2020-11-16T22:09:29.136 INFO:tasks.rados.rados.2.smithi057.stdout:1997: snap_create 2020-11-16T22:09:29.136 INFO:tasks.rados.rados.2.smithi057.stdout:1987: expect (ObjNum 654 snap 231 seq_num 654) 2020-11-16T22:09:29.238 INFO:tasks.rados.rados.2.smithi057.stdout:1990: finishing write tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:29.239 INFO:tasks.rados.rados.2.smithi057.stdout:1992: finishing copy_from to smithi05720651-12 2020-11-16T22:09:29.239 INFO:tasks.rados.rados.2.smithi057.stdout:1992: got expected ENOENT (src dne) 2020-11-16T22:09:29.239 INFO:tasks.rados.rados.2.smithi057.stdout:1992: finishing copy_from racing read to smithi05720651-12 2020-11-16T22:09:29.239 INFO:tasks.rados.rados.2.smithi057.stdout:1990: finishing write tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:29.239 INFO:tasks.rados.rados.2.smithi057.stdout:1990: finishing write tid 4 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:29.240 INFO:tasks.rados.rados.2.smithi057.stdout:1990: finishing write tid 5 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:29.240 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1540 (ObjNum 660 snap 233 seq_num 660) dirty exists 2020-11-16T22:09:29.240 INFO:tasks.rados.rados.2.smithi057.stdout:1990: left oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 660 snap 233 seq_num 660) 2020-11-16T22:09:29.240 INFO:tasks.rados.rados.2.smithi057.stdout:1988: finishing rollback tid 0 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:29.240 INFO:tasks.rados.rados.2.smithi057.stdout:1988: finishing rollback tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:29.240 INFO:tasks.rados.rados.2.smithi057.stdout:1988: finishing rollback tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:29.241 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1685 (ObjNum 642 snap 222 seq_num 642) dirty exists 2020-11-16T22:09:29.241 INFO:tasks.rados.rados.2.smithi057.stdout:1991: expect (ObjNum 650 snap 228 seq_num 650) 2020-11-16T22:09:29.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:29 smithi195 bash[10218]: cluster 2020-11-16T22:09:27.726861+0000 mgr.x (mgr.24115) 505 : cluster [DBG] pgmap v974: 17 pgs: 17 active+clean; 118 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2020-11-16T22:09:29.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:29 smithi195 bash[10218]: cluster 2020-11-16T22:09:28.093820+0000 mon.a (mon.0) 1195 : cluster [DBG] osdmap e540: 12 total, 12 up, 12 in 2020-11-16T22:09:29.437 INFO:tasks.rados.rados.2.smithi057.stdout:1993: finishing copy_from to smithi05720651-4 2020-11-16T22:09:29.438 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 1530 (ObjNum 634 snap 220 seq_num 634) dirty exists 2020-11-16T22:09:29.438 INFO:tasks.rados.rados.2.smithi057.stdout:1993: finishing copy_from racing read to smithi05720651-4 2020-11-16T22:09:29.438 INFO:tasks.rados.rados.2.smithi057.stdout:1995: finishing write tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:29.438 INFO:tasks.rados.rados.2.smithi057.stdout:1995: finishing write tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:29.439 INFO:tasks.rados.rados.2.smithi057.stdout:1995: finishing write tid 3 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:29.439 INFO:tasks.rados.rados.2.smithi057.stdout:1995: finishing write tid 5 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:29.439 INFO:tasks.rados.rados.2.smithi057.stdout:1995: finishing write tid 6 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:29.439 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1316 (ObjNum 661 snap 233 seq_num 661) dirty exists 2020-11-16T22:09:29.439 INFO:tasks.rados.rados.2.smithi057.stdout:1995: left oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 661 snap 233 seq_num 661) 2020-11-16T22:09:29.439 INFO:tasks.rados.rados.2.smithi057.stdout:1996: expect (ObjNum 543 snap 194 seq_num 543) 2020-11-16T22:09:29.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:29 smithi057 bash[10301]: cluster 2020-11-16T22:09:27.726861+0000 mgr.x (mgr.24115) 505 : cluster [DBG] pgmap v974: 17 pgs: 17 active+clean; 118 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2020-11-16T22:09:29.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:29 smithi057 bash[10301]: cluster 2020-11-16T22:09:28.093820+0000 mon.a (mon.0) 1195 : cluster [DBG] osdmap e540: 12 total, 12 up, 12 in 2020-11-16T22:09:29.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:29 smithi016 bash[10302]: cluster 2020-11-16T22:09:27.726861+0000 mgr.x (mgr.24115) 505 : cluster [DBG] pgmap v974: 17 pgs: 17 active+clean; 118 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2020-11-16T22:09:29.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:29 smithi016 bash[10302]: cluster 2020-11-16T22:09:28.093820+0000 mon.a (mon.0) 1195 : cluster [DBG] osdmap e540: 12 total, 12 up, 12 in 2020-11-16T22:09:30.038 INFO:tasks.rados.rados.2.smithi057.stdout:1987: done (8 left) 2020-11-16T22:09:30.038 INFO:tasks.rados.rados.2.smithi057.stdout:1988: done (7 left) 2020-11-16T22:09:30.038 INFO:tasks.rados.rados.2.smithi057.stdout:1990: done (6 left) 2020-11-16T22:09:30.039 INFO:tasks.rados.rados.2.smithi057.stdout:1991: done (5 left) 2020-11-16T22:09:30.039 INFO:tasks.rados.rados.2.smithi057.stdout:1992: done (4 left) 2020-11-16T22:09:30.039 INFO:tasks.rados.rados.2.smithi057.stdout:1993: done (3 left) 2020-11-16T22:09:30.039 INFO:tasks.rados.rados.2.smithi057.stdout:1995: done (2 left) 2020-11-16T22:09:30.039 INFO:tasks.rados.rados.2.smithi057.stdout:1996: done (1 left) 2020-11-16T22:09:30.039 INFO:tasks.rados.rados.2.smithi057.stdout:1997: done (0 left) 2020-11-16T22:09:30.039 INFO:tasks.rados.rados.2.smithi057.stdout:1998: read oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:30.040 INFO:tasks.rados.rados.2.smithi057.stdout:1998: expect (ObjNum 496 snap 177 seq_num 496) 2020-11-16T22:09:30.040 INFO:tasks.rados.rados.2.smithi057.stdout:1999: copy_from oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 234 2020-11-16T22:09:30.040 INFO:tasks.rados.rados.2.smithi057.stdout:2000: delete oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 234 2020-11-16T22:09:30.045 INFO:tasks.rados.rados.2.smithi057.stdout:2000: done (2 left) 2020-11-16T22:09:30.045 INFO:tasks.rados.rados.2.smithi057.stdout:2001: snap_create 2020-11-16T22:09:30.047 INFO:tasks.rados.rados.2.smithi057.stdout:1998: expect (ObjNum 496 snap 177 seq_num 496) 2020-11-16T22:09:30.128 INFO:tasks.rados.rados.2.smithi057.stdout:1999: finishing copy_from to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:30.128 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1241 (ObjNum 543 snap 194 seq_num 543) dirty exists 2020-11-16T22:09:30.128 INFO:tasks.rados.rados.2.smithi057.stdout:1999: finishing copy_from racing read to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:30.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:30 smithi057 bash[10301]: cluster 2020-11-16T22:09:29.123273+0000 mon.a (mon.0) 1196 : cluster [DBG] osdmap e541: 12 total, 12 up, 12 in 2020-11-16T22:09:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:30 smithi057 bash[10301]: audit 2020-11-16T22:09:29.758515+0000 mon.b (mon.1) 299 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:09:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:30 smithi057 bash[10301]: audit 2020-11-16T22:09:29.758833+0000 mon.b (mon.1) 300 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:09:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:30 smithi057 bash[10301]: audit 2020-11-16T22:09:29.760151+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:09:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:30 smithi057 bash[10301]: audit 2020-11-16T22:09:29.760552+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:09:30.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:30 smithi057 bash[10301]: cluster 2020-11-16T22:09:30.049039+0000 mon.a (mon.0) 1199 : cluster [DBG] osdmap e542: 12 total, 12 up, 12 in 2020-11-16T22:09:30.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:30 smithi016 bash[10302]: cluster 2020-11-16T22:09:29.123273+0000 mon.a (mon.0) 1196 : cluster [DBG] osdmap e541: 12 total, 12 up, 12 in 2020-11-16T22:09:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:30 smithi016 bash[10302]: audit 2020-11-16T22:09:29.758515+0000 mon.b (mon.1) 299 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:09:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:30 smithi016 bash[10302]: audit 2020-11-16T22:09:29.758833+0000 mon.b (mon.1) 300 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:09:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:30 smithi016 bash[10302]: audit 2020-11-16T22:09:29.760151+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:09:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:30 smithi016 bash[10302]: audit 2020-11-16T22:09:29.760552+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:09:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:30 smithi016 bash[10302]: cluster 2020-11-16T22:09:30.049039+0000 mon.a (mon.0) 1199 : cluster [DBG] osdmap e542: 12 total, 12 up, 12 in 2020-11-16T22:09:30.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:30 smithi195 bash[10218]: cluster 2020-11-16T22:09:29.123273+0000 mon.a (mon.0) 1196 : cluster [DBG] osdmap e541: 12 total, 12 up, 12 in 2020-11-16T22:09:30.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:30 smithi195 bash[10218]: audit 2020-11-16T22:09:29.758515+0000 mon.b (mon.1) 299 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:09:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:30 smithi195 bash[10218]: audit 2020-11-16T22:09:29.758833+0000 mon.b (mon.1) 300 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:09:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:30 smithi195 bash[10218]: audit 2020-11-16T22:09:29.760151+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:09:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:30 smithi195 bash[10218]: audit 2020-11-16T22:09:29.760552+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:09:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:30 smithi195 bash[10218]: cluster 2020-11-16T22:09:30.049039+0000 mon.a (mon.0) 1199 : cluster [DBG] osdmap e542: 12 total, 12 up, 12 in 2020-11-16T22:09:31.049 INFO:tasks.rados.rados.2.smithi057.stdout:1998: done (2 left) 2020-11-16T22:09:31.049 INFO:tasks.rados.rados.2.smithi057.stdout:1999: done (1 left) 2020-11-16T22:09:31.049 INFO:tasks.rados.rados.2.smithi057.stdout:2001: done (0 left) 2020-11-16T22:09:31.050 INFO:tasks.rados.rados.2.smithi057.stdout:2002: delete oid 48 current snap is 235 2020-11-16T22:09:31.057 INFO:tasks.rados.rados.2.smithi057.stdout:2002: done (0 left) 2020-11-16T22:09:31.057 INFO:tasks.rados.rados.2.smithi057.stdout:2003: write oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 235 2020-11-16T22:09:31.057 INFO:tasks.rados.rados.2.smithi057.stdout:2003: seq_num 664 ranges {759848=488047,1989220=760224} 2020-11-16T22:09:31.073 INFO:tasks.rados.rados.2.smithi057.stdout:2003: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 759848 to 1247895 tid 1 2020-11-16T22:09:31.082 INFO:tasks.rados.rados.2.smithi057.stdout:2003: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1989220 to 2749444 tid 2 2020-11-16T22:09:31.082 INFO:tasks.rados.rados.2.smithi057.stdout:2004: read oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:31.082 INFO:tasks.rados.rados.2.smithi057.stdout:2004: expect (ObjNum 661 snap 233 seq_num 661) 2020-11-16T22:09:31.083 INFO:tasks.rados.rados.2.smithi057.stdout:2005: write (excl) oid 22 current snap is 235 2020-11-16T22:09:31.083 INFO:tasks.rados.rados.2.smithi057.stdout:2005: seq_num 665 ranges {776655=563296,2047702=620235,3095349=81306} 2020-11-16T22:09:31.089 INFO:tasks.rados.rados.2.smithi057.stdout:2005: writing smithi05720651-22 from 776655 to 1339951 tid 1 2020-11-16T22:09:31.098 INFO:tasks.rados.rados.2.smithi057.stdout:2005: writing smithi05720651-22 from 2047702 to 2667937 tid 2 2020-11-16T22:09:31.102 INFO:tasks.rados.rados.2.smithi057.stdout:2005: writing smithi05720651-22 from 3095349 to 3176655 tid 3 2020-11-16T22:09:31.102 INFO:tasks.rados.rados.2.smithi057.stdout:2006: snap_remove snap 231 2020-11-16T22:09:31.102 INFO:tasks.rados.rados.2.smithi057.stdout:2003: finishing write tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:31.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:31 smithi057 bash[10301]: cluster 2020-11-16T22:09:29.727542+0000 mgr.x (mgr.24115) 506 : cluster [DBG] pgmap v977: 17 pgs: 17 active+clean; 118 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2020-11-16T22:09:31.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:31 smithi057 bash[10301]: cluster 2020-11-16T22:09:31.060705+0000 mon.a (mon.0) 1200 : cluster [DBG] osdmap e543: 12 total, 12 up, 12 in 2020-11-16T22:09:31.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:31 smithi016 bash[10302]: cluster 2020-11-16T22:09:29.727542+0000 mgr.x (mgr.24115) 506 : cluster [DBG] pgmap v977: 17 pgs: 17 active+clean; 118 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2020-11-16T22:09:31.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:31 smithi016 bash[10302]: cluster 2020-11-16T22:09:31.060705+0000 mon.a (mon.0) 1200 : cluster [DBG] osdmap e543: 12 total, 12 up, 12 in 2020-11-16T22:09:31.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:31 smithi195 bash[10218]: cluster 2020-11-16T22:09:29.727542+0000 mgr.x (mgr.24115) 506 : cluster [DBG] pgmap v977: 17 pgs: 17 active+clean; 118 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2020-11-16T22:09:31.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:31 smithi195 bash[10218]: cluster 2020-11-16T22:09:31.060705+0000 mon.a (mon.0) 1200 : cluster [DBG] osdmap e543: 12 total, 12 up, 12 in 2020-11-16T22:09:32.051 INFO:tasks.rados.rados.2.smithi057.stdout:2006: done (3 left) 2020-11-16T22:09:32.052 INFO:tasks.rados.rados.2.smithi057.stdout:2007: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:32.052 INFO:tasks.rados.rados.2.smithi057.stdout:2007: expect deleted 2020-11-16T22:09:32.052 INFO:tasks.rados.rados.2.smithi057.stdout:2008: rollback oid 40 current snap is 235 2020-11-16T22:09:32.052 INFO:tasks.rados.rados.2.smithi057.stdout:2003: finishing write tid 2 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:32.052 INFO:tasks.rados.rados.2.smithi057.stdout:2003: finishing write tid 4 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:32.052 INFO:tasks.rados.rados.2.smithi057.stdout:2003: finishing write tid 5 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:32.053 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1328 (ObjNum 664 snap 235 seq_num 664) dirty exists 2020-11-16T22:09:32.053 INFO:tasks.rados.rados.2.smithi057.stdout:2003: left oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 664 snap 235 seq_num 664) 2020-11-16T22:09:32.053 INFO:tasks.rados.rados.2.smithi057.stdout:2004: expect (ObjNum 661 snap 233 seq_num 661) 2020-11-16T22:09:32.277 INFO:tasks.rados.rados.2.smithi057.stdout:2005: finishing write tid 1 to smithi05720651-22 2020-11-16T22:09:32.277 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 40 to 234 2020-11-16T22:09:32.277 INFO:tasks.rados.rados.2.smithi057.stdout:2005: finishing write tid 2 to smithi05720651-22 2020-11-16T22:09:32.278 INFO:tasks.rados.rados.2.smithi057.stdout:2005: finishing write tid 3 to smithi05720651-22 2020-11-16T22:09:32.278 INFO:tasks.rados.rados.2.smithi057.stdout:2005: finishing write tid 5 to smithi05720651-22 2020-11-16T22:09:32.278 INFO:tasks.rados.rados.2.smithi057.stdout:2005: finishing write tid 6 to smithi05720651-22 2020-11-16T22:09:32.278 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 1112 (ObjNum 665 snap 235 seq_num 665) dirty exists 2020-11-16T22:09:32.278 INFO:tasks.rados.rados.2.smithi057.stdout:2005: left oid 22 (ObjNum 665 snap 235 seq_num 665) 2020-11-16T22:09:32.278 INFO:tasks.rados.rados.2.smithi057.stdout:2003: done (4 left) 2020-11-16T22:09:32.278 INFO:tasks.rados.rados.2.smithi057.stdout:2004: done (3 left) 2020-11-16T22:09:32.279 INFO:tasks.rados.rados.2.smithi057.stdout:2005: done (2 left) 2020-11-16T22:09:32.279 INFO:tasks.rados.rados.2.smithi057.stdout:2007: done (1 left) 2020-11-16T22:09:32.279 INFO:tasks.rados.rados.2.smithi057.stdout:2009: delete oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 235 2020-11-16T22:09:32.281 INFO:tasks.rados.rados.2.smithi057.stdout:2009: done (1 left) 2020-11-16T22:09:32.281 INFO:tasks.rados.rados.2.smithi057.stdout:2010: write oid 18 current snap is 235 2020-11-16T22:09:32.281 INFO:tasks.rados.rados.2.smithi057.stdout:2010: seq_num 667 ranges {410269=713794,1648313=507551,2917489=292780} 2020-11-16T22:09:32.287 INFO:tasks.rados.rados.2.smithi057.stdout:2010: writing smithi05720651-18 from 410269 to 1124063 tid 1 2020-11-16T22:09:32.293 INFO:tasks.rados.rados.2.smithi057.stdout:2010: writing smithi05720651-18 from 1648313 to 2155864 tid 2 2020-11-16T22:09:32.299 INFO:tasks.rados.rados.2.smithi057.stdout:2010: writing smithi05720651-18 from 2917489 to 3210269 tid 3 2020-11-16T22:09:32.299 INFO:tasks.rados.rados.2.smithi057.stdout:2011: delete oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 235 2020-11-16T22:09:32.299 INFO:tasks.rados.rados.2.smithi057.stdout:2008: finishing rollback tid 0 to smithi05720651-40 2020-11-16T22:09:32.299 INFO:tasks.rados.rados.2.smithi057.stdout:2008: finishing rollback tid 1 to smithi05720651-40 2020-11-16T22:09:32.299 INFO:tasks.rados.rados.2.smithi057.stdout:2008: finishing rollback tid 2 to smithi05720651-40 2020-11-16T22:09:32.300 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 1697 (ObjNum 647 snap 225 seq_num 647) dirty exists 2020-11-16T22:09:32.300 INFO:tasks.rados.rados.2.smithi057.stdout:2010: finishing write tid 1 to smithi05720651-18 2020-11-16T22:09:32.300 INFO:tasks.rados.rados.2.smithi057.stdout:2010: finishing write tid 2 to smithi05720651-18 2020-11-16T22:09:32.303 INFO:tasks.rados.rados.2.smithi057.stdout:2008: done (2 left) 2020-11-16T22:09:32.303 INFO:tasks.rados.rados.2.smithi057.stdout:2011: done (1 left) 2020-11-16T22:09:32.303 INFO:tasks.rados.rados.2.smithi057.stdout:2012: snap_create 2020-11-16T22:09:32.304 INFO:tasks.rados.rados.2.smithi057.stdout:2010: finishing write tid 3 to smithi05720651-18 2020-11-16T22:09:32.304 INFO:tasks.rados.rados.2.smithi057.stdout:2010: finishing write tid 5 to smithi05720651-18 2020-11-16T22:09:32.304 INFO:tasks.rados.rados.2.smithi057.stdout:2010: finishing write tid 6 to smithi05720651-18 2020-11-16T22:09:32.304 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 1254 (ObjNum 667 snap 235 seq_num 667) dirty exists 2020-11-16T22:09:32.304 INFO:tasks.rados.rados.2.smithi057.stdout:2010: left oid 18 (ObjNum 667 snap 235 seq_num 667) 2020-11-16T22:09:32.587 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 22:09:32 smithi016 bash[15120]: debug 2020-11-16T22:09:32.231+0000 7f8fc2db1700 -1 osd.5 pg_epoch: 544 pg[2.3( v 541'1574 (0'0,541'1574] local-lis/les=71/72 n=10 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [5,2] r=0 lpr=71 crt=541'1574 lcod 540'1572 mlcod 540'1572 active+clean+snaptrim trimq=[1cf~1] ps=[1ce~1,1d1~1]] removing snap head 2020-11-16T22:09:33.127 INFO:tasks.rados.rados.2.smithi057.stdout:2010: done (1 left) 2020-11-16T22:09:33.128 INFO:tasks.rados.rados.2.smithi057.stdout:2012: done (0 left) 2020-11-16T22:09:33.128 INFO:tasks.rados.rados.2.smithi057.stdout:2013: write (excl) oid 42 current snap is 236 2020-11-16T22:09:33.128 INFO:tasks.rados.rados.2.smithi057.stdout:2013: seq_num 669 ranges {443883=464292,1365277=511220,2572335=671548} 2020-11-16T22:09:33.138 INFO:tasks.rados.rados.2.smithi057.stdout:2013: writing smithi05720651-42 from 443883 to 908175 tid 1 2020-11-16T22:09:33.144 INFO:tasks.rados.rados.2.smithi057.stdout:2013: writing smithi05720651-42 from 1365277 to 1876497 tid 2 2020-11-16T22:09:33.153 INFO:tasks.rados.rados.2.smithi057.stdout:2013: writing smithi05720651-42 from 2572335 to 3243883 tid 3 2020-11-16T22:09:33.153 INFO:tasks.rados.rados.2.smithi057.stdout:2014: read oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 233 2020-11-16T22:09:33.153 INFO:tasks.rados.rados.2.smithi057.stdout:2014: expect deleted 2020-11-16T22:09:33.153 INFO:tasks.rados.rados.2.smithi057.stdout:2015: copy_from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 236 2020-11-16T22:09:33.153 INFO:tasks.rados.rados.2.smithi057.stdout:2013: finishing write tid 1 to smithi05720651-42 2020-11-16T22:09:33.154 INFO:tasks.rados.rados.2.smithi057.stdout:2016: copy_from oid 24 from oid 26 current snap is 236 2020-11-16T22:09:33.154 INFO:tasks.rados.rados.2.smithi057.stdout:2017: delete oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 236 2020-11-16T22:09:33.154 INFO:tasks.rados.rados.2.smithi057.stdout:2013: finishing write tid 2 to smithi05720651-42 2020-11-16T22:09:33.160 INFO:tasks.rados.rados.2.smithi057.stdout:2013: finishing write tid 3 to smithi05720651-42 2020-11-16T22:09:33.161 INFO:tasks.rados.rados.2.smithi057.stdout:2013: finishing write tid 5 to smithi05720651-42 2020-11-16T22:09:33.162 INFO:tasks.rados.rados.2.smithi057.stdout:2013: finishing write tid 6 to smithi05720651-42 2020-11-16T22:09:33.162 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 1534 (ObjNum 669 snap 236 seq_num 669) dirty exists 2020-11-16T22:09:33.162 INFO:tasks.rados.rados.2.smithi057.stdout:2013: left oid 42 (ObjNum 669 snap 236 seq_num 669) 2020-11-16T22:09:33.163 INFO:tasks.rados.rados.2.smithi057.stdout:2013: done (4 left) 2020-11-16T22:09:33.163 INFO:tasks.rados.rados.2.smithi057.stdout:2014: done (3 left) 2020-11-16T22:09:33.163 INFO:tasks.rados.rados.2.smithi057.stdout:2017: done (2 left) 2020-11-16T22:09:33.163 INFO:tasks.rados.rados.2.smithi057.stdout:2018: read oid 40 snap -1 2020-11-16T22:09:33.163 INFO:tasks.rados.rados.2.smithi057.stdout:2018: expect (ObjNum 647 snap 225 seq_num 647) 2020-11-16T22:09:33.164 INFO:tasks.rados.rados.2.smithi057.stdout:2019: read oid 30 snap -1 2020-11-16T22:09:33.164 INFO:tasks.rados.rados.2.smithi057.stdout:2019: expect (ObjNum 616 snap 216 seq_num 616) 2020-11-16T22:09:33.164 INFO:tasks.rados.rados.2.smithi057.stdout:2020: snap_remove snap 235 2020-11-16T22:09:33.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:33 smithi016 bash[10302]: cluster 2020-11-16T22:09:31.728275+0000 mgr.x (mgr.24115) 507 : cluster [DBG] pgmap v980: 17 pgs: 17 active+clean; 126 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2020-11-16T22:09:33.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:33 smithi016 bash[10302]: cluster 2020-11-16T22:09:32.062811+0000 mon.a (mon.0) 1201 : cluster [DBG] osdmap e544: 12 total, 12 up, 12 in 2020-11-16T22:09:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:33 smithi195 bash[10218]: cluster 2020-11-16T22:09:31.728275+0000 mgr.x (mgr.24115) 507 : cluster [DBG] pgmap v980: 17 pgs: 17 active+clean; 126 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2020-11-16T22:09:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:33 smithi195 bash[10218]: cluster 2020-11-16T22:09:32.062811+0000 mon.a (mon.0) 1201 : cluster [DBG] osdmap e544: 12 total, 12 up, 12 in 2020-11-16T22:09:33.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:33 smithi057 bash[10301]: cluster 2020-11-16T22:09:31.728275+0000 mgr.x (mgr.24115) 507 : cluster [DBG] pgmap v980: 17 pgs: 17 active+clean; 126 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.8 MiB/s wr, 16 op/s 2020-11-16T22:09:33.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:33 smithi057 bash[10301]: cluster 2020-11-16T22:09:32.062811+0000 mon.a (mon.0) 1201 : cluster [DBG] osdmap e544: 12 total, 12 up, 12 in 2020-11-16T22:09:34.137 INFO:tasks.rados.rados.2.smithi057.stdout:2020: done (4 left) 2020-11-16T22:09:34.137 INFO:tasks.rados.rados.2.smithi057.stdout:2021: copy_from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 44 current snap is 236 2020-11-16T22:09:34.137 INFO:tasks.rados.rados.2.smithi057.stdout:2018: expect (ObjNum 647 snap 225 seq_num 647) 2020-11-16T22:09:34.387 INFO:tasks.rados.rados.2.smithi057.stdout:2016: finishing copy_from to smithi05720651-24 2020-11-16T22:09:34.387 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 1549 (ObjNum 581 snap 206 seq_num 581) dirty exists 2020-11-16T22:09:34.388 INFO:tasks.rados.rados.2.smithi057.stdout:2016: finishing copy_from racing read to smithi05720651-24 2020-11-16T22:09:34.388 INFO:tasks.rados.rados.2.smithi057.stdout:2019: expect (ObjNum 616 snap 216 seq_num 616) 2020-11-16T22:09:34.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:34 smithi057 bash[10301]: cluster 2020-11-16T22:09:33.139253+0000 mon.a (mon.0) 1202 : cluster [DBG] osdmap e545: 12 total, 12 up, 12 in 2020-11-16T22:09:34.526 INFO:tasks.rados.rados.2.smithi057.stdout:2015: finishing copy_from to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:34.527 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1685 (ObjNum 642 snap 222 seq_num 642) dirty exists 2020-11-16T22:09:34.527 INFO:tasks.rados.rados.2.smithi057.stdout:2015: finishing copy_from racing read to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:34.527 INFO:tasks.rados.rados.2.smithi057.stdout:2021: finishing copy_from to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:34.527 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1108 (ObjNum 647 snap 225 seq_num 647) dirty exists 2020-11-16T22:09:34.528 INFO:tasks.rados.rados.2.smithi057.stdout:2021: finishing copy_from racing read to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:34.528 INFO:tasks.rados.rados.2.smithi057.stdout:2015: done (4 left) 2020-11-16T22:09:34.528 INFO:tasks.rados.rados.2.smithi057.stdout:2016: done (3 left) 2020-11-16T22:09:34.528 INFO:tasks.rados.rados.2.smithi057.stdout:2018: done (2 left) 2020-11-16T22:09:34.528 INFO:tasks.rados.rados.2.smithi057.stdout:2019: done (1 left) 2020-11-16T22:09:34.528 INFO:tasks.rados.rados.2.smithi057.stdout:2021: done (0 left) 2020-11-16T22:09:34.529 INFO:tasks.rados.rados.2.smithi057.stdout:2022: delete oid 44 current snap is 236 2020-11-16T22:09:34.531 INFO:tasks.rados.rados.2.smithi057.stdout:2022: done (0 left) 2020-11-16T22:09:34.531 INFO:tasks.rados.rados.2.smithi057.stdout:2023: rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 236 2020-11-16T22:09:34.532 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 234 2020-11-16T22:09:34.532 INFO:tasks.rados.rados.2.smithi057.stdout:2024: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:34.532 INFO:tasks.rados.rados.2.smithi057.stdout:2024: expect (ObjNum 664 snap 235 seq_num 664) 2020-11-16T22:09:34.532 INFO:tasks.rados.rados.2.smithi057.stdout:2025: read oid 50 snap -1 2020-11-16T22:09:34.532 INFO:tasks.rados.rados.2.smithi057.stdout:2025: expect (ObjNum 548 snap 199 seq_num 548) 2020-11-16T22:09:34.532 INFO:tasks.rados.rados.2.smithi057.stdout:2026: rollback oid 30 current snap is 236 2020-11-16T22:09:34.533 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 30 to 234 2020-11-16T22:09:34.533 INFO:tasks.rados.rados.2.smithi057.stdout:2027: rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 236 2020-11-16T22:09:34.533 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 234 2020-11-16T22:09:34.533 INFO:tasks.rados.rados.2.smithi057.stdout:2028: delete oid 28 current snap is 236 2020-11-16T22:09:34.536 INFO:tasks.rados.rados.2.smithi057.stdout:2028: done (5 left) 2020-11-16T22:09:34.537 INFO:tasks.rados.rados.2.smithi057.stdout:2029: delete oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 236 2020-11-16T22:09:34.542 INFO:tasks.rados.rados.2.smithi057.stdout:2026: finishing rollback tid 0 to smithi05720651-30 2020-11-16T22:09:34.542 INFO:tasks.rados.rados.2.smithi057.stdout:2026: finishing rollback tid 1 to smithi05720651-30 2020-11-16T22:09:34.543 INFO:tasks.rados.rados.2.smithi057.stdout:2026: finishing rollback tid 2 to smithi05720651-30 2020-11-16T22:09:34.543 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 1375 (ObjNum 616 snap 216 seq_num 616) dirty exists 2020-11-16T22:09:34.544 INFO:tasks.rados.rados.2.smithi057.stdout:2023: finishing rollback tid 0 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:34.545 INFO:tasks.rados.rados.2.smithi057.stdout:2023: finishing rollback tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:34.545 INFO:tasks.rados.rados.2.smithi057.stdout:2023: finishing rollback tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:34.545 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1705 (ObjNum 654 snap 231 seq_num 654) dirty exists 2020-11-16T22:09:34.548 INFO:tasks.rados.rados.2.smithi057.stdout:2027: finishing rollback tid 0 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:34.550 INFO:tasks.rados.rados.2.smithi057.stdout:2027: finishing rollback tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:34.550 INFO:tasks.rados.rados.2.smithi057.stdout:2027: finishing rollback tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:34.551 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1378 (ObjNum 588 snap 207 seq_num 588) dirty exists 2020-11-16T22:09:34.552 INFO:tasks.rados.rados.2.smithi057.stdout:2025: expect (ObjNum 548 snap 199 seq_num 548) 2020-11-16T22:09:34.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:34 smithi016 bash[10302]: cluster 2020-11-16T22:09:33.139253+0000 mon.a (mon.0) 1202 : cluster [DBG] osdmap e545: 12 total, 12 up, 12 in 2020-11-16T22:09:34.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:34 smithi195 bash[10218]: cluster 2020-11-16T22:09:33.139253+0000 mon.a (mon.0) 1202 : cluster [DBG] osdmap e545: 12 total, 12 up, 12 in 2020-11-16T22:09:34.734 INFO:tasks.rados.rados.2.smithi057.stdout:2024: expect (ObjNum 664 snap 235 seq_num 664) 2020-11-16T22:09:34.878 INFO:tasks.rados.rados.2.smithi057.stdout:2023: done (5 left) 2020-11-16T22:09:34.878 INFO:tasks.rados.rados.2.smithi057.stdout:2024: done (4 left) 2020-11-16T22:09:34.878 INFO:tasks.rados.rados.2.smithi057.stdout:2025: done (3 left) 2020-11-16T22:09:34.878 INFO:tasks.rados.rados.2.smithi057.stdout:2026: done (2 left) 2020-11-16T22:09:34.878 INFO:tasks.rados.rados.2.smithi057.stdout:2027: done (1 left) 2020-11-16T22:09:34.879 INFO:tasks.rados.rados.2.smithi057.stdout:2029: done (0 left) 2020-11-16T22:09:34.879 INFO:tasks.rados.rados.2.smithi057.stdout:2030: write oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 236 2020-11-16T22:09:34.879 INFO:tasks.rados.rados.2.smithi057.stdout:2030: seq_num 674 ranges {527918=556890,1657687=778569,3225803=102115} 2020-11-16T22:09:34.892 INFO:tasks.rados.rados.2.smithi057.stdout:2030: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 527918 to 1084808 tid 1 2020-11-16T22:09:34.900 INFO:tasks.rados.rados.2.smithi057.stdout:2030: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1657687 to 2436256 tid 2 2020-11-16T22:09:34.905 INFO:tasks.rados.rados.2.smithi057.stdout:2030: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3225803 to 3327918 tid 3 2020-11-16T22:09:34.905 INFO:tasks.rados.rados.2.smithi057.stdout:2031: copy_from oid 2 from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 236 2020-11-16T22:09:34.905 INFO:tasks.rados.rados.2.smithi057.stdout:2030: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:34.905 INFO:tasks.rados.rados.2.smithi057.stdout:2032: write oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 236 2020-11-16T22:09:34.905 INFO:tasks.rados.rados.2.smithi057.stdout:2032: seq_num 675 ranges {544725=632139,1716169=522227,2736873=512491} 2020-11-16T22:09:34.911 INFO:tasks.rados.rados.2.smithi057.stdout:2032: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 544725 to 1176864 tid 1 2020-11-16T22:09:34.917 INFO:tasks.rados.rados.2.smithi057.stdout:2032: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1716169 to 2238396 tid 2 2020-11-16T22:09:34.923 INFO:tasks.rados.rados.2.smithi057.stdout:2032: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2736873 to 3249364 tid 3 2020-11-16T22:09:34.924 INFO:tasks.rados.rados.2.smithi057.stdout:2033: copy_from oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 30 current snap is 236 2020-11-16T22:09:34.924 INFO:tasks.rados.rados.2.smithi057.stdout:2030: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:34.924 INFO:tasks.rados.rados.2.smithi057.stdout:2030: finishing write tid 3 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:34.924 INFO:tasks.rados.rados.2.smithi057.stdout:2030: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:34.924 INFO:tasks.rados.rados.2.smithi057.stdout:2030: finishing write tid 6 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:34.924 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 96 (ObjNum 674 snap 236 seq_num 674) dirty exists 2020-11-16T22:09:34.925 INFO:tasks.rados.rados.2.smithi057.stdout:2030: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 674 snap 236 seq_num 674) 2020-11-16T22:09:34.925 INFO:tasks.rados.rados.2.smithi057.stdout:2032: finishing write tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:34.925 INFO:tasks.rados.rados.2.smithi057.stdout:2032: finishing write tid 2 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:34.925 INFO:tasks.rados.rados.2.smithi057.stdout:2030: done (3 left) 2020-11-16T22:09:34.925 INFO:tasks.rados.rados.2.smithi057.stdout:2034: read oid 8 snap -1 2020-11-16T22:09:34.925 INFO:tasks.rados.rados.2.smithi057.stdout:2034: expect (ObjNum 548 snap 199 seq_num 548) 2020-11-16T22:09:34.925 INFO:tasks.rados.rados.2.smithi057.stdout:2035: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:34.926 INFO:tasks.rados.rados.2.smithi057.stdout:2035: expect (ObjNum 664 snap 235 seq_num 664) 2020-11-16T22:09:34.926 INFO:tasks.rados.rados.2.smithi057.stdout:2036: read oid 36 snap -1 2020-11-16T22:09:34.926 INFO:tasks.rados.rados.2.smithi057.stdout:2036: expect (ObjNum 643 snap 225 seq_num 643) 2020-11-16T22:09:34.926 INFO:tasks.rados.rados.2.smithi057.stdout:2037: rollback oid 6 current snap is 236 2020-11-16T22:09:34.926 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 6 to 233 2020-11-16T22:09:34.926 INFO:tasks.rados.rados.2.smithi057.stdout:2038: write oid 22 current snap is 236 2020-11-16T22:09:34.926 INFO:tasks.rados.rados.2.smithi057.stdout:2038: seq_num 676 ranges {561532=707388,2058298=782238} 2020-11-16T22:09:34.931 INFO:tasks.rados.rados.2.smithi057.stdout:2038: writing smithi05720651-22 from 561532 to 1268920 tid 1 2020-11-16T22:09:34.941 INFO:tasks.rados.rados.2.smithi057.stdout:2038: writing smithi05720651-22 from 2058298 to 2840536 tid 2 2020-11-16T22:09:34.941 INFO:tasks.rados.rados.2.smithi057.stdout:2039: rollback oid 26 current snap is 236 2020-11-16T22:09:34.941 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 26 to 233 2020-11-16T22:09:34.941 INFO:tasks.rados.rados.2.smithi057.stdout:2037: finishing rollback tid 1 to smithi05720651-6 2020-11-16T22:09:34.941 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 0 (ObjNum 385 snap 0 seq_num 2932756432) dirty dne 2020-11-16T22:09:35.142 INFO:tasks.rados.rados.2.smithi057.stdout:2031: finishing copy_from to smithi05720651-2 2020-11-16T22:09:35.142 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 1325 (ObjNum 496 snap 177 seq_num 496) dirty exists 2020-11-16T22:09:35.142 INFO:tasks.rados.rados.2.smithi057.stdout:2031: finishing copy_from racing read to smithi05720651-2 2020-11-16T22:09:35.143 INFO:tasks.rados.rados.2.smithi057.stdout:2032: finishing write tid 3 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:35.143 INFO:tasks.rados.rados.2.smithi057.stdout:2032: finishing write tid 5 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:35.143 INFO:tasks.rados.rados.2.smithi057.stdout:2032: finishing write tid 6 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:35.143 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1500 (ObjNum 675 snap 236 seq_num 675) dirty exists 2020-11-16T22:09:35.143 INFO:tasks.rados.rados.2.smithi057.stdout:2032: left oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 675 snap 236 seq_num 675) 2020-11-16T22:09:35.143 INFO:tasks.rados.rados.2.smithi057.stdout:2036: expect (ObjNum 643 snap 225 seq_num 643) 2020-11-16T22:09:35.144 INFO:tasks.rados.rados.2.smithi057.stdout:2035: expect (ObjNum 664 snap 235 seq_num 664) 2020-11-16T22:09:35.203 INFO:tasks.rados.rados.2.smithi057.stdout:2038: finishing write tid 1 to smithi05720651-22 2020-11-16T22:09:35.203 INFO:tasks.rados.rados.2.smithi057.stdout:2034: expect (ObjNum 548 snap 199 seq_num 548) 2020-11-16T22:09:35.379 INFO:tasks.rados.rados.2.smithi057.stdout:2038: finishing write tid 2 to smithi05720651-22 2020-11-16T22:09:35.379 INFO:tasks.rados.rados.2.smithi057.stdout:2033: finishing copy_from to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:35.379 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1375 (ObjNum 616 snap 216 seq_num 616) dirty exists 2020-11-16T22:09:35.379 INFO:tasks.rados.rados.2.smithi057.stdout:2038: finishing write tid 4 to smithi05720651-22 2020-11-16T22:09:35.379 INFO:tasks.rados.rados.2.smithi057.stdout:2033: finishing copy_from racing read to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:35.380 INFO:tasks.rados.rados.2.smithi057.stdout:2039: finishing rollback tid 0 to smithi05720651-26 2020-11-16T22:09:35.380 INFO:tasks.rados.rados.2.smithi057.stdout:2038: finishing write tid 5 to smithi05720651-22 2020-11-16T22:09:35.380 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 1116 (ObjNum 676 snap 236 seq_num 676) dirty exists 2020-11-16T22:09:35.380 INFO:tasks.rados.rados.2.smithi057.stdout:2038: left oid 22 (ObjNum 676 snap 236 seq_num 676) 2020-11-16T22:09:35.380 INFO:tasks.rados.rados.2.smithi057.stdout:2039: finishing rollback tid 1 to smithi05720651-26 2020-11-16T22:09:35.380 INFO:tasks.rados.rados.2.smithi057.stdout:2039: finishing rollback tid 2 to smithi05720651-26 2020-11-16T22:09:35.380 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 1713 (ObjNum 581 snap 206 seq_num 581) dirty exists 2020-11-16T22:09:35.381 INFO:tasks.rados.rados.2.smithi057.stdout:2031: done (8 left) 2020-11-16T22:09:35.381 INFO:tasks.rados.rados.2.smithi057.stdout:2032: done (7 left) 2020-11-16T22:09:35.381 INFO:tasks.rados.rados.2.smithi057.stdout:2033: done (6 left) 2020-11-16T22:09:35.381 INFO:tasks.rados.rados.2.smithi057.stdout:2034: done (5 left) 2020-11-16T22:09:35.381 INFO:tasks.rados.rados.2.smithi057.stdout:2035: done (4 left) 2020-11-16T22:09:35.381 INFO:tasks.rados.rados.2.smithi057.stdout:2036: done (3 left) 2020-11-16T22:09:35.381 INFO:tasks.rados.rados.2.smithi057.stdout:2037: done (2 left) 2020-11-16T22:09:35.381 INFO:tasks.rados.rados.2.smithi057.stdout:2038: done (1 left) 2020-11-16T22:09:35.382 INFO:tasks.rados.rados.2.smithi057.stdout:2039: done (0 left) 2020-11-16T22:09:35.382 INFO:tasks.rados.rados.2.smithi057.stdout:2040: write oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 236 2020-11-16T22:09:35.382 INFO:tasks.rados.rados.2.smithi057.stdout:2040: seq_num 677 ranges {578339=498990,1833133=525896,2791719=586620} 2020-11-16T22:09:35.392 INFO:tasks.rados.rados.2.smithi057.stdout:2040: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 578339 to 1077329 tid 1 2020-11-16T22:09:35.401 INFO:tasks.rados.rados.2.smithi057.stdout:2040: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1833133 to 2359029 tid 2 2020-11-16T22:09:35.406 INFO:tasks.rados.rados.2.smithi057.stdout:2040: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2791719 to 3378339 tid 3 2020-11-16T22:09:35.407 INFO:tasks.rados.rados.2.smithi057.stdout:2041: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:35.407 INFO:tasks.rados.rados.2.smithi057.stdout:2041: expect (ObjNum 632 snap 220 seq_num 632) 2020-11-16T22:09:35.407 INFO:tasks.rados.rados.2.smithi057.stdout:2042: copy_from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 4 current snap is 236 2020-11-16T22:09:35.407 INFO:tasks.rados.rados.2.smithi057.stdout:2040: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:35.407 INFO:tasks.rados.rados.2.smithi057.stdout:2043: write (excl) oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 236 2020-11-16T22:09:35.407 INFO:tasks.rados.rados.2.smithi057.stdout:2043: seq_num 678 ranges {595146=574239,1891615=669554,3219142=176004} 2020-11-16T22:09:35.413 INFO:tasks.rados.rados.2.smithi057.stdout:2043: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 595146 to 1169385 tid 1 2020-11-16T22:09:35.421 INFO:tasks.rados.rados.2.smithi057.stdout:2043: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1891615 to 2561169 tid 2 2020-11-16T22:09:35.426 INFO:tasks.rados.rados.2.smithi057.stdout:2043: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3219142 to 3395146 tid 3 2020-11-16T22:09:35.426 INFO:tasks.rados.rados.2.smithi057.stdout:2044: write oid 24 current snap is 236 2020-11-16T22:09:35.426 INFO:tasks.rados.rados.2.smithi057.stdout:2044: seq_num 679 ranges {611953=649488,1950097=529565,3246565=165388} 2020-11-16T22:09:35.433 INFO:tasks.rados.rados.2.smithi057.stdout:2044: writing smithi05720651-24 from 611953 to 1261441 tid 1 2020-11-16T22:09:35.439 INFO:tasks.rados.rados.2.smithi057.stdout:2044: writing smithi05720651-24 from 1950097 to 2479662 tid 2 2020-11-16T22:09:35.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:35 smithi057 bash[10301]: cluster 2020-11-16T22:09:33.728942+0000 mgr.x (mgr.24115) 508 : cluster [DBG] pgmap v983: 17 pgs: 17 active+clean; 123 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2020-11-16T22:09:35.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:35 smithi057 bash[10301]: cluster 2020-11-16T22:09:34.148525+0000 mon.a (mon.0) 1203 : cluster [DBG] osdmap e546: 12 total, 12 up, 12 in 2020-11-16T22:09:35.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:35 smithi057 bash[10301]: cluster 2020-11-16T22:09:35.050197+0000 mon.a (mon.0) 1204 : cluster [DBG] osdmap e547: 12 total, 12 up, 12 in 2020-11-16T22:09:35.445 INFO:tasks.rados.rados.2.smithi057.stdout:2044: writing smithi05720651-24 from 3246565 to 3411953 tid 3 2020-11-16T22:09:35.445 INFO:tasks.rados.rados.2.smithi057.stdout:2045: snap_create 2020-11-16T22:09:35.445 INFO:tasks.rados.rados.2.smithi057.stdout:2040: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:35.446 INFO:tasks.rados.rados.2.smithi057.stdout:2040: finishing write tid 3 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:35.446 INFO:tasks.rados.rados.2.smithi057.stdout:2040: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:35.446 INFO:tasks.rados.rados.2.smithi057.stdout:2040: finishing write tid 6 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:35.446 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1258 (ObjNum 677 snap 236 seq_num 677) dirty exists 2020-11-16T22:09:35.446 INFO:tasks.rados.rados.2.smithi057.stdout:2040: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 677 snap 236 seq_num 677) 2020-11-16T22:09:35.446 INFO:tasks.rados.rados.2.smithi057.stdout:2041: expect (ObjNum 632 snap 220 seq_num 632) 2020-11-16T22:09:35.574 INFO:tasks.rados.rados.2.smithi057.stdout:2043: finishing write tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:35.574 INFO:tasks.rados.rados.2.smithi057.stdout:2043: finishing write tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:35.574 INFO:tasks.rados.rados.2.smithi057.stdout:2043: finishing write tid 3 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:35.574 INFO:tasks.rados.rados.2.smithi057.stdout:2042: finishing copy_from to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:35.574 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1530 (ObjNum 634 snap 220 seq_num 634) dirty exists 2020-11-16T22:09:35.575 INFO:tasks.rados.rados.2.smithi057.stdout:2043: finishing write tid 5 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:35.575 INFO:tasks.rados.rados.2.smithi057.stdout:2042: finishing copy_from racing read to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:35.575 INFO:tasks.rados.rados.2.smithi057.stdout:2043: finishing write tid 6 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:35.575 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1588 (ObjNum 678 snap 236 seq_num 678) dirty exists 2020-11-16T22:09:35.575 INFO:tasks.rados.rados.2.smithi057.stdout:2043: left oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 678 snap 236 seq_num 678) 2020-11-16T22:09:35.575 INFO:tasks.rados.rados.2.smithi057.stdout:2044: finishing write tid 1 to smithi05720651-24 2020-11-16T22:09:35.576 INFO:tasks.rados.rados.2.smithi057.stdout:2044: finishing write tid 2 to smithi05720651-24 2020-11-16T22:09:35.576 INFO:tasks.rados.rados.2.smithi057.stdout:2044: finishing write tid 3 to smithi05720651-24 2020-11-16T22:09:35.576 INFO:tasks.rados.rados.2.smithi057.stdout:2044: finishing write tid 5 to smithi05720651-24 2020-11-16T22:09:35.576 INFO:tasks.rados.rados.2.smithi057.stdout:2044: finishing write tid 6 to smithi05720651-24 2020-11-16T22:09:35.576 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 1553 (ObjNum 679 snap 236 seq_num 679) dirty exists 2020-11-16T22:09:35.576 INFO:tasks.rados.rados.2.smithi057.stdout:2044: left oid 24 (ObjNum 679 snap 236 seq_num 679) 2020-11-16T22:09:35.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:35 smithi016 bash[10302]: cluster 2020-11-16T22:09:33.728942+0000 mgr.x (mgr.24115) 508 : cluster [DBG] pgmap v983: 17 pgs: 17 active+clean; 123 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2020-11-16T22:09:35.790 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:35 smithi016 bash[10302]: cluster 2020-11-16T22:09:34.148525+0000 mon.a (mon.0) 1203 : cluster [DBG] osdmap e546: 12 total, 12 up, 12 in 2020-11-16T22:09:35.790 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:35 smithi016 bash[10302]: cluster 2020-11-16T22:09:35.050197+0000 mon.a (mon.0) 1204 : cluster [DBG] osdmap e547: 12 total, 12 up, 12 in 2020-11-16T22:09:35.791 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:35 smithi195 bash[10218]: cluster 2020-11-16T22:09:33.728942+0000 mgr.x (mgr.24115) 508 : cluster [DBG] pgmap v983: 17 pgs: 17 active+clean; 123 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2020-11-16T22:09:35.791 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:35 smithi195 bash[10218]: cluster 2020-11-16T22:09:34.148525+0000 mon.a (mon.0) 1203 : cluster [DBG] osdmap e546: 12 total, 12 up, 12 in 2020-11-16T22:09:35.791 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:35 smithi195 bash[10218]: cluster 2020-11-16T22:09:35.050197+0000 mon.a (mon.0) 1204 : cluster [DBG] osdmap e547: 12 total, 12 up, 12 in 2020-11-16T22:09:36.148 INFO:tasks.rados.rados.2.smithi057.stdout:2040: done (5 left) 2020-11-16T22:09:36.148 INFO:tasks.rados.rados.2.smithi057.stdout:2041: done (4 left) 2020-11-16T22:09:36.148 INFO:tasks.rados.rados.2.smithi057.stdout:2042: done (3 left) 2020-11-16T22:09:36.148 INFO:tasks.rados.rados.2.smithi057.stdout:2043: done (2 left) 2020-11-16T22:09:36.149 INFO:tasks.rados.rados.2.smithi057.stdout:2044: done (1 left) 2020-11-16T22:09:36.149 INFO:tasks.rados.rados.2.smithi057.stdout:2045: done (0 left) 2020-11-16T22:09:36.149 INFO:tasks.rados.rados.2.smithi057.stdout:2046: snap_create 2020-11-16T22:09:37.152 INFO:tasks.rados.rados.2.smithi057.stdout:2046: done (0 left) 2020-11-16T22:09:37.153 INFO:tasks.rados.rados.2.smithi057.stdout:2047: delete oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 238 2020-11-16T22:09:37.158 INFO:tasks.rados.rados.2.smithi057.stdout:2047: done (0 left) 2020-11-16T22:09:37.158 INFO:tasks.rados.rados.2.smithi057.stdout:2048: write oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 238 2020-11-16T22:09:37.158 INFO:tasks.rados.rados.2.smithi057.stdout:2048: seq_num 681 ranges {645567=799986,1950708=533234,3185058=260509} 2020-11-16T22:09:37.175 INFO:tasks.rados.rados.2.smithi057.stdout:2048: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 645567 to 1445553 tid 1 2020-11-16T22:09:37.181 INFO:tasks.rados.rados.2.smithi057.stdout:2048: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1950708 to 2483942 tid 2 2020-11-16T22:09:37.187 INFO:tasks.rados.rados.2.smithi057.stdout:2048: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3185058 to 3445567 tid 3 2020-11-16T22:09:37.187 INFO:tasks.rados.rados.2.smithi057.stdout:2049: delete oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 238 2020-11-16T22:09:37.187 INFO:tasks.rados.rados.2.smithi057.stdout:2048: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:37.188 INFO:tasks.rados.rados.2.smithi057.stdout:2048: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:37.191 INFO:tasks.rados.rados.2.smithi057.stdout:2048: finishing write tid 3 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:37.192 INFO:tasks.rados.rados.2.smithi057.stdout:2048: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:37.193 INFO:tasks.rados.rados.2.smithi057.stdout:2048: finishing write tid 6 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:37.193 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1690 (ObjNum 681 snap 238 seq_num 681) dirty exists 2020-11-16T22:09:37.193 INFO:tasks.rados.rados.2.smithi057.stdout:2048: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 681 snap 238 seq_num 681) 2020-11-16T22:09:37.195 INFO:tasks.rados.rados.2.smithi057.stdout:2048: done (1 left) 2020-11-16T22:09:37.195 INFO:tasks.rados.rados.2.smithi057.stdout:2049: done (0 left) 2020-11-16T22:09:37.195 INFO:tasks.rados.rados.2.smithi057.stdout:2050: write oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 238 2020-11-16T22:09:37.195 INFO:tasks.rados.rados.2.smithi057.stdout:2050: seq_num 683 ranges {679181=550484,1667672=536903,2839904=435373} 2020-11-16T22:09:37.202 INFO:tasks.rados.rados.2.smithi057.stdout:2050: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 679181 to 1229665 tid 1 2020-11-16T22:09:37.209 INFO:tasks.rados.rados.2.smithi057.stdout:2050: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1667672 to 2204575 tid 2 2020-11-16T22:09:37.215 INFO:tasks.rados.rados.2.smithi057.stdout:2050: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2839904 to 3275277 tid 3 2020-11-16T22:09:37.215 INFO:tasks.rados.rados.2.smithi057.stdout:2051: snap_create 2020-11-16T22:09:37.216 INFO:tasks.rados.rados.2.smithi057.stdout:2050: finishing write tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:37.221 INFO:tasks.rados.rados.2.smithi057.stdout:2050: finishing write tid 2 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:37.221 INFO:tasks.rados.rados.2.smithi057.stdout:2050: finishing write tid 3 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:37.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:37 smithi057 bash[10301]: cluster 2020-11-16T22:09:35.729660+0000 mgr.x (mgr.24115) 509 : cluster [DBG] pgmap v986: 17 pgs: 17 active+clean; 124 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.9 MiB/s wr, 15 op/s 2020-11-16T22:09:37.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:37 smithi057 bash[10301]: cluster 2020-11-16T22:09:36.159501+0000 mon.a (mon.0) 1205 : cluster [DBG] osdmap e548: 12 total, 12 up, 12 in 2020-11-16T22:09:37.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:37 smithi016 bash[10302]: cluster 2020-11-16T22:09:35.729660+0000 mgr.x (mgr.24115) 509 : cluster [DBG] pgmap v986: 17 pgs: 17 active+clean; 124 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.9 MiB/s wr, 15 op/s 2020-11-16T22:09:37.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:37 smithi016 bash[10302]: cluster 2020-11-16T22:09:36.159501+0000 mon.a (mon.0) 1205 : cluster [DBG] osdmap e548: 12 total, 12 up, 12 in 2020-11-16T22:09:37.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:37 smithi195 bash[10218]: cluster 2020-11-16T22:09:35.729660+0000 mgr.x (mgr.24115) 509 : cluster [DBG] pgmap v986: 17 pgs: 17 active+clean; 124 MiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.9 MiB/s wr, 15 op/s 2020-11-16T22:09:37.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:37 smithi195 bash[10218]: cluster 2020-11-16T22:09:36.159501+0000 mon.a (mon.0) 1205 : cluster [DBG] osdmap e548: 12 total, 12 up, 12 in 2020-11-16T22:09:37.829 INFO:tasks.rados.rados.2.smithi057.stdout:2050: finishing write tid 5 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:37.830 INFO:tasks.rados.rados.2.smithi057.stdout:2050: finishing write tid 6 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:37.830 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1332 (ObjNum 683 snap 238 seq_num 683) dirty exists 2020-11-16T22:09:37.830 INFO:tasks.rados.rados.2.smithi057.stdout:2050: left oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 683 snap 238 seq_num 683) 2020-11-16T22:09:38.169 INFO:tasks.rados.rados.2.smithi057.stdout:2050: done (1 left) 2020-11-16T22:09:38.169 INFO:tasks.rados.rados.2.smithi057.stdout:2051: done (0 left) 2020-11-16T22:09:38.170 INFO:tasks.rados.rados.2.smithi057.stdout:2052: rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 239 2020-11-16T22:09:38.170 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 234 2020-11-16T22:09:38.170 INFO:tasks.rados.rados.2.smithi057.stdout:2053: read oid 50 snap -1 2020-11-16T22:09:38.170 INFO:tasks.rados.rados.2.smithi057.stdout:2053: expect (ObjNum 548 snap 199 seq_num 548) 2020-11-16T22:09:38.170 INFO:tasks.rados.rados.2.smithi057.stdout:2054: rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 239 2020-11-16T22:09:38.170 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 233 2020-11-16T22:09:38.170 INFO:tasks.rados.rados.2.smithi057.stdout:2055: copy_from oid 32 from oid 28 current snap is 239 2020-11-16T22:09:38.171 INFO:tasks.rados.rados.2.smithi057.stdout:2056: snap_create 2020-11-16T22:09:38.173 INFO:tasks.rados.rados.2.smithi057.stdout:2054: finishing rollback tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:38.173 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 1869573999 snap 28527 seq_num 336) dirty dne 2020-11-16T22:09:38.175 INFO:tasks.rados.rados.2.smithi057.stdout:2055: finishing copy_from to smithi05720651-32 2020-11-16T22:09:38.175 INFO:tasks.rados.rados.2.smithi057.stdout:2055: got expected ENOENT (src dne) 2020-11-16T22:09:38.175 INFO:tasks.rados.rados.2.smithi057.stdout:2055: finishing copy_from racing read to smithi05720651-32 2020-11-16T22:09:38.181 INFO:tasks.rados.rados.2.smithi057.stdout:2052: finishing rollback tid 0 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:38.181 INFO:tasks.rados.rados.2.smithi057.stdout:2052: finishing rollback tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:38.187 INFO:tasks.rados.rados.2.smithi057.stdout:2053: expect (ObjNum 548 snap 199 seq_num 548) 2020-11-16T22:09:38.377 INFO:tasks.rados.rados.2.smithi057.stdout:2052: finishing rollback tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:38.378 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1592 (ObjNum 659 snap 233 seq_num 659) dirty exists 2020-11-16T22:09:38.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:38 smithi057 bash[10301]: cluster 2020-11-16T22:09:37.163326+0000 mon.a (mon.0) 1206 : cluster [DBG] osdmap e549: 12 total, 12 up, 12 in 2020-11-16T22:09:38.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:38 smithi016 bash[10302]: cluster 2020-11-16T22:09:37.163326+0000 mon.a (mon.0) 1206 : cluster [DBG] osdmap e549: 12 total, 12 up, 12 in 2020-11-16T22:09:38.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:38 smithi195 bash[10218]: cluster 2020-11-16T22:09:37.163326+0000 mon.a (mon.0) 1206 : cluster [DBG] osdmap e549: 12 total, 12 up, 12 in 2020-11-16T22:09:39.178 INFO:tasks.rados.rados.2.smithi057.stdout:2052: done (4 left) 2020-11-16T22:09:39.178 INFO:tasks.rados.rados.2.smithi057.stdout:2053: done (3 left) 2020-11-16T22:09:39.179 INFO:tasks.rados.rados.2.smithi057.stdout:2054: done (2 left) 2020-11-16T22:09:39.179 INFO:tasks.rados.rados.2.smithi057.stdout:2055: done (1 left) 2020-11-16T22:09:39.179 INFO:tasks.rados.rados.2.smithi057.stdout:2056: done (0 left) 2020-11-16T22:09:39.179 INFO:tasks.rados.rados.2.smithi057.stdout:2057: snap_create 2020-11-16T22:09:39.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:39 smithi057 bash[10301]: cluster 2020-11-16T22:09:37.730340+0000 mgr.x (mgr.24115) 510 : cluster [DBG] pgmap v989: 17 pgs: 17 active+clean; 144 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 6.6 MiB/s wr, 32 op/s 2020-11-16T22:09:39.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:39 smithi057 bash[10301]: cluster 2020-11-16T22:09:38.180315+0000 mon.a (mon.0) 1207 : cluster [DBG] osdmap e550: 12 total, 12 up, 12 in 2020-11-16T22:09:39.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:39 smithi016 bash[10302]: cluster 2020-11-16T22:09:37.730340+0000 mgr.x (mgr.24115) 510 : cluster [DBG] pgmap v989: 17 pgs: 17 active+clean; 144 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 6.6 MiB/s wr, 32 op/s 2020-11-16T22:09:39.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:39 smithi016 bash[10302]: cluster 2020-11-16T22:09:38.180315+0000 mon.a (mon.0) 1207 : cluster [DBG] osdmap e550: 12 total, 12 up, 12 in 2020-11-16T22:09:39.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:39 smithi195 bash[10218]: cluster 2020-11-16T22:09:37.730340+0000 mgr.x (mgr.24115) 510 : cluster [DBG] pgmap v989: 17 pgs: 17 active+clean; 144 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 6.6 MiB/s wr, 32 op/s 2020-11-16T22:09:39.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:39 smithi195 bash[10218]: cluster 2020-11-16T22:09:38.180315+0000 mon.a (mon.0) 1207 : cluster [DBG] osdmap e550: 12 total, 12 up, 12 in 2020-11-16T22:09:40.041 INFO:tasks.rados.rados.2.smithi057.stdout:2057: done (0 left) 2020-11-16T22:09:40.041 INFO:tasks.rados.rados.2.smithi057.stdout:2058: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:40.041 INFO:tasks.rados.rados.2.smithi057.stdout:2058: expect (ObjNum 616 snap 216 seq_num 616) 2020-11-16T22:09:40.041 INFO:tasks.rados.rados.2.smithi057.stdout:2059: read oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:40.042 INFO:tasks.rados.rados.2.smithi057.stdout:2059: expect (ObjNum 674 snap 236 seq_num 674) 2020-11-16T22:09:40.042 INFO:tasks.rados.rados.2.smithi057.stdout:2060: read oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 237 2020-11-16T22:09:40.042 INFO:tasks.rados.rados.2.smithi057.stdout:2060: expect deleted 2020-11-16T22:09:40.042 INFO:tasks.rados.rados.2.smithi057.stdout:2061: copy_from oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 48 current snap is 241 2020-11-16T22:09:40.043 INFO:tasks.rados.rados.2.smithi057.stdout:2062: copy_from oid 42 from oid 12 current snap is 241 2020-11-16T22:09:40.043 INFO:tasks.rados.rados.2.smithi057.stdout:2063: read oid 20 snap 233 2020-11-16T22:09:40.043 INFO:tasks.rados.rados.2.smithi057.stdout:2063: expect (ObjNum 653 snap 229 seq_num 653) 2020-11-16T22:09:40.043 INFO:tasks.rados.rados.2.smithi057.stdout:2064: read oid 22 snap -1 2020-11-16T22:09:40.043 INFO:tasks.rados.rados.2.smithi057.stdout:2064: expect (ObjNum 676 snap 236 seq_num 676) 2020-11-16T22:09:40.043 INFO:tasks.rados.rados.2.smithi057.stdout:2065: write oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 241 2020-11-16T22:09:40.044 INFO:tasks.rados.rados.2.smithi057.stdout:2065: seq_num 684 ranges {695988=625733,2009801=680561,3150974=345014} 2020-11-16T22:09:40.054 INFO:tasks.rados.rados.2.smithi057.stdout:2065: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 695988 to 1321721 tid 1 2020-11-16T22:09:40.062 INFO:tasks.rados.rados.2.smithi057.stdout:2065: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2009801 to 2690362 tid 2 2020-11-16T22:09:40.067 INFO:tasks.rados.rados.2.smithi057.stdout:2065: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3150974 to 3495988 tid 3 2020-11-16T22:09:40.067 INFO:tasks.rados.rados.2.smithi057.stdout:2066: delete oid 34 current snap is 241 2020-11-16T22:09:40.067 INFO:tasks.rados.rados.2.smithi057.stdout:2063: expect (ObjNum 653 snap 229 seq_num 653) 2020-11-16T22:09:40.298 INFO:tasks.rados.rados.2.smithi057.stdout:2064: expect (ObjNum 676 snap 236 seq_num 676) 2020-11-16T22:09:40.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:40 smithi057 bash[10301]: cluster 2020-11-16T22:09:39.189885+0000 mon.a (mon.0) 1208 : cluster [DBG] osdmap e551: 12 total, 12 up, 12 in 2020-11-16T22:09:40.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:40 smithi057 bash[10301]: cluster 2020-11-16T22:09:40.052380+0000 mon.a (mon.0) 1209 : cluster [DBG] osdmap e552: 12 total, 12 up, 12 in 2020-11-16T22:09:40.525 INFO:tasks.rados.rados.2.smithi057.stdout:2058: expect (ObjNum 616 snap 216 seq_num 616) 2020-11-16T22:09:40.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:40 smithi016 bash[10302]: cluster 2020-11-16T22:09:39.189885+0000 mon.a (mon.0) 1208 : cluster [DBG] osdmap e551: 12 total, 12 up, 12 in 2020-11-16T22:09:40.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:40 smithi016 bash[10302]: cluster 2020-11-16T22:09:40.052380+0000 mon.a (mon.0) 1209 : cluster [DBG] osdmap e552: 12 total, 12 up, 12 in 2020-11-16T22:09:40.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:40 smithi195 bash[10218]: cluster 2020-11-16T22:09:39.189885+0000 mon.a (mon.0) 1208 : cluster [DBG] osdmap e551: 12 total, 12 up, 12 in 2020-11-16T22:09:40.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:40 smithi195 bash[10218]: cluster 2020-11-16T22:09:40.052380+0000 mon.a (mon.0) 1209 : cluster [DBG] osdmap e552: 12 total, 12 up, 12 in 2020-11-16T22:09:40.665 INFO:tasks.rados.rados.2.smithi057.stdout:2062: finishing copy_from to smithi05720651-42 2020-11-16T22:09:40.665 INFO:tasks.rados.rados.2.smithi057.stdout:2062: got expected ENOENT (src dne) 2020-11-16T22:09:40.665 INFO:tasks.rados.rados.2.smithi057.stdout:2062: finishing copy_from racing read to smithi05720651-42 2020-11-16T22:09:40.665 INFO:tasks.rados.rados.2.smithi057.stdout:2061: finishing copy_from to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:40.665 INFO:tasks.rados.rados.2.smithi057.stdout:2061: got expected ENOENT (src dne) 2020-11-16T22:09:40.665 INFO:tasks.rados.rados.2.smithi057.stdout:2061: finishing copy_from racing read to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:40.666 INFO:tasks.rados.rados.2.smithi057.stdout:2059: expect (ObjNum 674 snap 236 seq_num 674) 2020-11-16T22:09:40.765 INFO:tasks.rados.rados.2.smithi057.stdout:2065: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:40.765 INFO:tasks.rados.rados.2.smithi057.stdout:2065: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:40.766 INFO:tasks.rados.rados.2.smithi057.stdout:2058: done (8 left) 2020-11-16T22:09:40.766 INFO:tasks.rados.rados.2.smithi057.stdout:2059: done (7 left) 2020-11-16T22:09:40.766 INFO:tasks.rados.rados.2.smithi057.stdout:2060: done (6 left) 2020-11-16T22:09:40.766 INFO:tasks.rados.rados.2.smithi057.stdout:2061: done (5 left) 2020-11-16T22:09:40.766 INFO:tasks.rados.rados.2.smithi057.stdout:2062: done (4 left) 2020-11-16T22:09:40.766 INFO:tasks.rados.rados.2.smithi057.stdout:2063: done (3 left) 2020-11-16T22:09:40.767 INFO:tasks.rados.rados.2.smithi057.stdout:2064: done (2 left) 2020-11-16T22:09:40.767 INFO:tasks.rados.rados.2.smithi057.stdout:2066: done (1 left) 2020-11-16T22:09:40.767 INFO:tasks.rados.rados.2.smithi057.stdout:2067: delete oid 34 current snap is 241 2020-11-16T22:09:40.767 INFO:tasks.rados.rados.2.smithi057.stdout:2065: finishing write tid 3 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:40.767 INFO:tasks.rados.rados.2.smithi057.stdout:2065: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:40.767 INFO:tasks.rados.rados.2.smithi057.stdout:2065: finishing write tid 6 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:40.767 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1538 (ObjNum 684 snap 241 seq_num 684) dirty exists 2020-11-16T22:09:40.768 INFO:tasks.rados.rados.2.smithi057.stdout:2065: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 684 snap 241 seq_num 684) 2020-11-16T22:09:40.769 INFO:tasks.rados.rados.2.smithi057.stdout:2065: done (1 left) 2020-11-16T22:09:40.769 INFO:tasks.rados.rados.2.smithi057.stdout:2067: done (0 left) 2020-11-16T22:09:40.769 INFO:tasks.rados.rados.2.smithi057.stdout:2068: rollback oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 241 2020-11-16T22:09:40.770 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 240 2020-11-16T22:09:40.770 INFO:tasks.rados.rados.2.smithi057.stdout:2069: rollback oid 30 current snap is 241 2020-11-16T22:09:40.770 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 30 to 238 2020-11-16T22:09:40.770 INFO:tasks.rados.rados.2.smithi057.stdout:2070: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:40.770 INFO:tasks.rados.rados.2.smithi057.stdout:2070: expect (ObjNum 683 snap 238 seq_num 683) 2020-11-16T22:09:40.770 INFO:tasks.rados.rados.2.smithi057.stdout:2071: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:40.770 INFO:tasks.rados.rados.2.smithi057.stdout:2071: expect (ObjNum 681 snap 238 seq_num 681) 2020-11-16T22:09:40.771 INFO:tasks.rados.rados.2.smithi057.stdout:2072: snap_create 2020-11-16T22:09:40.779 INFO:tasks.rados.rados.2.smithi057.stdout:2069: finishing rollback tid 0 to smithi05720651-30 2020-11-16T22:09:40.779 INFO:tasks.rados.rados.2.smithi057.stdout:2068: finishing rollback tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:40.779 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1686 (ObjNum 33 snap 0 seq_num 2932531520) dirty dne 2020-11-16T22:09:40.779 INFO:tasks.rados.rados.2.smithi057.stdout:2071: expect (ObjNum 681 snap 238 seq_num 681) 2020-11-16T22:09:40.950 INFO:tasks.rados.rados.2.smithi057.stdout:2069: finishing rollback tid 1 to smithi05720651-30 2020-11-16T22:09:40.951 INFO:tasks.rados.rados.2.smithi057.stdout:2069: finishing rollback tid 2 to smithi05720651-30 2020-11-16T22:09:40.951 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 1381 (ObjNum 616 snap 216 seq_num 616) dirty exists 2020-11-16T22:09:40.951 INFO:tasks.rados.rados.2.smithi057.stdout:2070: expect (ObjNum 683 snap 238 seq_num 683) 2020-11-16T22:09:41.191 INFO:tasks.rados.rados.2.smithi057.stdout:2068: done (4 left) 2020-11-16T22:09:41.191 INFO:tasks.rados.rados.2.smithi057.stdout:2069: done (3 left) 2020-11-16T22:09:41.191 INFO:tasks.rados.rados.2.smithi057.stdout:2070: done (2 left) 2020-11-16T22:09:41.192 INFO:tasks.rados.rados.2.smithi057.stdout:2071: done (1 left) 2020-11-16T22:09:41.192 INFO:tasks.rados.rados.2.smithi057.stdout:2072: done (0 left) 2020-11-16T22:09:41.192 INFO:tasks.rados.rados.2.smithi057.stdout:2073: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 242 2020-11-16T22:09:41.192 INFO:tasks.rados.rados.2.smithi057.stdout:2073: seq_num 687 ranges {746409=567833,1901600=544241,3065949=480460} 2020-11-16T22:09:41.204 INFO:tasks.rados.rados.2.smithi057.stdout:2073: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 746409 to 1314242 tid 1 2020-11-16T22:09:41.210 INFO:tasks.rados.rados.2.smithi057.stdout:2073: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1901600 to 2445841 tid 2 2020-11-16T22:09:41.217 INFO:tasks.rados.rados.2.smithi057.stdout:2073: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3065949 to 3546409 tid 3 2020-11-16T22:09:41.217 INFO:tasks.rados.rados.2.smithi057.stdout:2074: snap_remove snap 238 2020-11-16T22:09:41.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:41 smithi016 bash[10302]: cluster 2020-11-16T22:09:39.731012+0000 mgr.x (mgr.24115) 511 : cluster [DBG] pgmap v992: 17 pgs: 17 active+clean; 144 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 17 op/s 2020-11-16T22:09:41.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:41 smithi195 bash[10218]: cluster 2020-11-16T22:09:39.731012+0000 mgr.x (mgr.24115) 511 : cluster [DBG] pgmap v992: 17 pgs: 17 active+clean; 144 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 17 op/s 2020-11-16T22:09:41.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:41 smithi057 bash[10301]: cluster 2020-11-16T22:09:39.731012+0000 mgr.x (mgr.24115) 511 : cluster [DBG] pgmap v992: 17 pgs: 17 active+clean; 144 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 17 op/s 2020-11-16T22:09:42.208 INFO:tasks.rados.rados.2.smithi057.stdout:2074: done (1 left) 2020-11-16T22:09:42.208 INFO:tasks.rados.rados.2.smithi057.stdout:2075: rollback oid 18 current snap is 242 2020-11-16T22:09:42.208 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 18 to 234 2020-11-16T22:09:42.208 INFO:tasks.rados.rados.2.smithi057.stdout:2073: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.209 INFO:tasks.rados.rados.2.smithi057.stdout:2073: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.209 INFO:tasks.rados.rados.2.smithi057.stdout:2073: finishing write tid 3 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.209 INFO:tasks.rados.rados.2.smithi057.stdout:2073: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.209 INFO:tasks.rados.rados.2.smithi057.stdout:2073: finishing write tid 6 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.209 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1718 (ObjNum 687 snap 242 seq_num 687) dirty exists 2020-11-16T22:09:42.209 INFO:tasks.rados.rados.2.smithi057.stdout:2073: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 687 snap 242 seq_num 687) 2020-11-16T22:09:42.210 INFO:tasks.rados.rados.2.smithi057.stdout:2073: done (1 left) 2020-11-16T22:09:42.210 INFO:tasks.rados.rados.2.smithi057.stdout:2076: copy_from oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 242 2020-11-16T22:09:42.210 INFO:tasks.rados.rados.2.smithi057.stdout:2077: write oid 44 current snap is 242 2020-11-16T22:09:42.210 INFO:tasks.rados.rados.2.smithi057.stdout:2077: seq_num 688 ranges {763216=643082,1843729=687899,3260666=302550} 2020-11-16T22:09:42.221 INFO:tasks.rados.rados.2.smithi057.stdout:2077: writing smithi05720651-44 from 763216 to 1406298 tid 1 2020-11-16T22:09:42.229 INFO:tasks.rados.rados.2.smithi057.stdout:2077: writing smithi05720651-44 from 1843729 to 2531628 tid 2 2020-11-16T22:09:42.236 INFO:tasks.rados.rados.2.smithi057.stdout:2077: writing smithi05720651-44 from 3260666 to 3563216 tid 3 2020-11-16T22:09:42.236 INFO:tasks.rados.rados.2.smithi057.stdout:2078: delete oid 42 current snap is 242 2020-11-16T22:09:42.236 INFO:tasks.rados.rados.2.smithi057.stdout:2075: finishing rollback tid 0 to smithi05720651-18 2020-11-16T22:09:42.236 INFO:tasks.rados.rados.2.smithi057.stdout:2075: finishing rollback tid 1 to smithi05720651-18 2020-11-16T22:09:42.236 INFO:tasks.rados.rados.2.smithi057.stdout:2075: finishing rollback tid 2 to smithi05720651-18 2020-11-16T22:09:42.236 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 1261 (ObjNum 562 snap 203 seq_num 562) dirty exists 2020-11-16T22:09:42.237 INFO:tasks.rados.rados.2.smithi057.stdout:2077: finishing write tid 1 to smithi05720651-44 2020-11-16T22:09:42.237 INFO:tasks.rados.rados.2.smithi057.stdout:2076: finishing copy_from to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.237 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1588 (ObjNum 678 snap 236 seq_num 678) dirty exists 2020-11-16T22:09:42.237 INFO:tasks.rados.rados.2.smithi057.stdout:2076: finishing copy_from racing read to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.237 INFO:tasks.rados.rados.2.smithi057.stdout:2077: finishing write tid 2 to smithi05720651-44 2020-11-16T22:09:42.239 INFO:tasks.rados.rados.2.smithi057.stdout:2075: done (3 left) 2020-11-16T22:09:42.239 INFO:tasks.rados.rados.2.smithi057.stdout:2076: done (2 left) 2020-11-16T22:09:42.239 INFO:tasks.rados.rados.2.smithi057.stdout:2078: done (1 left) 2020-11-16T22:09:42.239 INFO:tasks.rados.rados.2.smithi057.stdout:2079: write (excl) oid 22 current snap is 242 2020-11-16T22:09:42.239 INFO:tasks.rados.rados.2.smithi057.stdout:2079: seq_num 690 ranges {796830=793580,2360693=691568} 2020-11-16T22:09:42.248 INFO:tasks.rados.rados.2.smithi057.stdout:2079: writing smithi05720651-22 from 796830 to 1590410 tid 1 2020-11-16T22:09:42.256 INFO:tasks.rados.rados.2.smithi057.stdout:2079: writing smithi05720651-22 from 2360693 to 3052261 tid 2 2020-11-16T22:09:42.257 INFO:tasks.rados.rados.2.smithi057.stdout:2080: rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 242 2020-11-16T22:09:42.257 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 233 2020-11-16T22:09:42.257 INFO:tasks.rados.rados.2.smithi057.stdout:2077: finishing write tid 3 to smithi05720651-44 2020-11-16T22:09:42.257 INFO:tasks.rados.rados.2.smithi057.stdout:2077: finishing write tid 5 to smithi05720651-44 2020-11-16T22:09:42.257 INFO:tasks.rados.rados.2.smithi057.stdout:2081: write oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 242 2020-11-16T22:09:42.257 INFO:tasks.rados.rados.2.smithi057.stdout:2081: seq_num 691 ranges {413637=468829,1619175=435226,2542935=758255} 2020-11-16T22:09:42.262 INFO:tasks.rados.rados.2.smithi057.stdout:2081: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 413637 to 882466 tid 1 2020-11-16T22:09:42.268 INFO:tasks.rados.rados.2.smithi057.stdout:2081: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1619175 to 2054401 tid 2 2020-11-16T22:09:42.276 INFO:tasks.rados.rados.2.smithi057.stdout:2081: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2542935 to 3301190 tid 3 2020-11-16T22:09:42.276 INFO:tasks.rados.rados.2.smithi057.stdout:2082: read oid 20 snap -1 2020-11-16T22:09:42.276 INFO:tasks.rados.rados.2.smithi057.stdout:2082: expect (ObjNum 653 snap 229 seq_num 653) 2020-11-16T22:09:42.276 INFO:tasks.rados.rados.2.smithi057.stdout:2083: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 241 2020-11-16T22:09:42.277 INFO:tasks.rados.rados.2.smithi057.stdout:2083: expect (ObjNum 645 snap 225 seq_num 645) 2020-11-16T22:09:42.277 INFO:tasks.rados.rados.2.smithi057.stdout:2084: rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 242 2020-11-16T22:09:42.277 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 234 2020-11-16T22:09:42.277 INFO:tasks.rados.rados.2.smithi057.stdout:2077: finishing write tid 6 to smithi05720651-44 2020-11-16T22:09:42.277 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 1120 (ObjNum 688 snap 242 seq_num 688) dirty exists 2020-11-16T22:09:42.277 INFO:tasks.rados.rados.2.smithi057.stdout:2077: left oid 44 (ObjNum 688 snap 242 seq_num 688) 2020-11-16T22:09:42.277 INFO:tasks.rados.rados.2.smithi057.stdout:2079: finishing write tid 1 to smithi05720651-22 2020-11-16T22:09:42.278 INFO:tasks.rados.rados.2.smithi057.stdout:2079: finishing write tid 2 to smithi05720651-22 2020-11-16T22:09:42.278 INFO:tasks.rados.rados.2.smithi057.stdout:2079: finishing write tid 4 to smithi05720651-22 2020-11-16T22:09:42.278 INFO:tasks.rados.rados.2.smithi057.stdout:2080: finishing rollback tid 0 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.278 INFO:tasks.rados.rados.2.smithi057.stdout:2080: finishing rollback tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.278 INFO:tasks.rados.rados.2.smithi057.stdout:2079: finishing write tid 5 to smithi05720651-22 2020-11-16T22:09:42.278 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 1123 (ObjNum 690 snap 242 seq_num 690) dirty exists 2020-11-16T22:09:42.278 INFO:tasks.rados.rados.2.smithi057.stdout:2079: left oid 22 (ObjNum 690 snap 242 seq_num 690) 2020-11-16T22:09:42.279 INFO:tasks.rados.rados.2.smithi057.stdout:2080: finishing rollback tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.279 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1533 (ObjNum 632 snap 220 seq_num 632) dirty exists 2020-11-16T22:09:42.279 INFO:tasks.rados.rados.2.smithi057.stdout:2081: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.279 INFO:tasks.rados.rados.2.smithi057.stdout:2077: done (6 left) 2020-11-16T22:09:42.279 INFO:tasks.rados.rados.2.smithi057.stdout:2079: done (5 left) 2020-11-16T22:09:42.279 INFO:tasks.rados.rados.2.smithi057.stdout:2080: done (4 left) 2020-11-16T22:09:42.279 INFO:tasks.rados.rados.2.smithi057.stdout:2085: write (excl) oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 242 2020-11-16T22:09:42.280 INFO:tasks.rados.rados.2.smithi057.stdout:2085: seq_num 692 ranges {430444=660431,1677657=695237,2970358=569527} 2020-11-16T22:09:42.282 INFO:tasks.rados.rados.2.smithi057.stdout:2085: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 430444 to 1090875 tid 1 2020-11-16T22:09:42.290 INFO:tasks.rados.rados.2.smithi057.stdout:2085: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1677657 to 2372894 tid 2 2020-11-16T22:09:42.297 INFO:tasks.rados.rados.2.smithi057.stdout:2085: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2970358 to 3539885 tid 3 2020-11-16T22:09:42.297 INFO:tasks.rados.rados.2.smithi057.stdout:2086: copy_from oid 28 from oid 48 current snap is 242 2020-11-16T22:09:42.297 INFO:tasks.rados.rados.2.smithi057.stdout:2081: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.298 INFO:tasks.rados.rados.2.smithi057.stdout:2082: expect (ObjNum 653 snap 229 seq_num 653) 2020-11-16T22:09:42.522 INFO:tasks.rados.rados.2.smithi057.stdout:2084: finishing rollback tid 0 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.523 INFO:tasks.rados.rados.2.smithi057.stdout:2081: finishing write tid 3 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.523 INFO:tasks.rados.rados.2.smithi057.stdout:2084: finishing rollback tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.523 INFO:tasks.rados.rados.2.smithi057.stdout:2084: finishing rollback tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.523 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1725 (ObjNum 654 snap 231 seq_num 654) dirty exists 2020-11-16T22:09:42.523 INFO:tasks.rados.rados.2.smithi057.stdout:2081: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.523 INFO:tasks.rados.rados.2.smithi057.stdout:2081: finishing write tid 6 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.523 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1694 (ObjNum 691 snap 242 seq_num 691) dirty exists 2020-11-16T22:09:42.524 INFO:tasks.rados.rados.2.smithi057.stdout:2081: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 691 snap 242 seq_num 691) 2020-11-16T22:09:42.524 INFO:tasks.rados.rados.2.smithi057.stdout:2085: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.524 INFO:tasks.rados.rados.2.smithi057.stdout:2083: expect (ObjNum 645 snap 225 seq_num 645) 2020-11-16T22:09:42.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:42 smithi016 bash[10302]: cluster 2020-11-16T22:09:41.202333+0000 mon.a (mon.0) 1210 : cluster [DBG] osdmap e553: 12 total, 12 up, 12 in 2020-11-16T22:09:42.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:42 smithi195 bash[10218]: cluster 2020-11-16T22:09:41.202333+0000 mon.a (mon.0) 1210 : cluster [DBG] osdmap e553: 12 total, 12 up, 12 in 2020-11-16T22:09:42.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:42 smithi057 bash[10301]: cluster 2020-11-16T22:09:41.202333+0000 mon.a (mon.0) 1210 : cluster [DBG] osdmap e553: 12 total, 12 up, 12 in 2020-11-16T22:09:42.703 INFO:tasks.rados.rados.2.smithi057.stdout:2085: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.704 INFO:tasks.rados.rados.2.smithi057.stdout:2086: finishing copy_from to smithi05720651-28 2020-11-16T22:09:42.704 INFO:tasks.rados.rados.2.smithi057.stdout:2086: got expected ENOENT (src dne) 2020-11-16T22:09:42.704 INFO:tasks.rados.rados.2.smithi057.stdout:2086: finishing copy_from racing read to smithi05720651-28 2020-11-16T22:09:42.704 INFO:tasks.rados.rados.2.smithi057.stdout:2085: finishing write tid 3 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.704 INFO:tasks.rados.rados.2.smithi057.stdout:2085: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.704 INFO:tasks.rados.rados.2.smithi057.stdout:2085: finishing write tid 6 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:42.705 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 101 (ObjNum 692 snap 242 seq_num 692) dirty exists 2020-11-16T22:09:42.705 INFO:tasks.rados.rados.2.smithi057.stdout:2085: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 692 snap 242 seq_num 692) 2020-11-16T22:09:42.705 INFO:tasks.rados.rados.2.smithi057.stdout:2081: done (5 left) 2020-11-16T22:09:42.705 INFO:tasks.rados.rados.2.smithi057.stdout:2082: done (4 left) 2020-11-16T22:09:42.705 INFO:tasks.rados.rados.2.smithi057.stdout:2083: done (3 left) 2020-11-16T22:09:42.705 INFO:tasks.rados.rados.2.smithi057.stdout:2084: done (2 left) 2020-11-16T22:09:42.705 INFO:tasks.rados.rados.2.smithi057.stdout:2085: done (1 left) 2020-11-16T22:09:42.706 INFO:tasks.rados.rados.2.smithi057.stdout:2086: done (0 left) 2020-11-16T22:09:42.706 INFO:tasks.rados.rados.2.smithi057.stdout:2087: snap_create 2020-11-16T22:09:43.210 INFO:tasks.rados.rados.2.smithi057.stdout:2087: done (0 left) 2020-11-16T22:09:43.210 INFO:tasks.rados.rados.2.smithi057.stdout:2088: snap_remove snap 242 2020-11-16T22:09:43.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:43 smithi016 bash[10302]: cluster 2020-11-16T22:09:41.731820+0000 mgr.x (mgr.24115) 512 : cluster [DBG] pgmap v995: 17 pgs: 17 active+clean; 158 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.2 MiB/s wr, 27 op/s 2020-11-16T22:09:43.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:43 smithi016 bash[10302]: cluster 2020-11-16T22:09:42.219356+0000 mon.a (mon.0) 1211 : cluster [DBG] osdmap e554: 12 total, 12 up, 12 in 2020-11-16T22:09:43.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:43 smithi195 bash[10218]: cluster 2020-11-16T22:09:41.731820+0000 mgr.x (mgr.24115) 512 : cluster [DBG] pgmap v995: 17 pgs: 17 active+clean; 158 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.2 MiB/s wr, 27 op/s 2020-11-16T22:09:43.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:43 smithi195 bash[10218]: cluster 2020-11-16T22:09:42.219356+0000 mon.a (mon.0) 1211 : cluster [DBG] osdmap e554: 12 total, 12 up, 12 in 2020-11-16T22:09:43.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:43 smithi057 bash[10301]: cluster 2020-11-16T22:09:41.731820+0000 mgr.x (mgr.24115) 512 : cluster [DBG] pgmap v995: 17 pgs: 17 active+clean; 158 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.2 MiB/s wr, 27 op/s 2020-11-16T22:09:43.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:43 smithi057 bash[10301]: cluster 2020-11-16T22:09:42.219356+0000 mon.a (mon.0) 1211 : cluster [DBG] osdmap e554: 12 total, 12 up, 12 in 2020-11-16T22:09:44.213 INFO:tasks.rados.rados.2.smithi057.stdout:2088: done (0 left) 2020-11-16T22:09:44.213 INFO:tasks.rados.rados.2.smithi057.stdout:2089: write (excl) oid 18 current snap is 243 2020-11-16T22:09:44.213 INFO:tasks.rados.rados.2.smithi057.stdout:2089: seq_num 693 ranges {447251=735680,1736139=438895,2597781=780799} 2020-11-16T22:09:44.229 INFO:tasks.rados.rados.2.smithi057.stdout:2089: writing smithi05720651-18 from 447251 to 1182931 tid 1 2020-11-16T22:09:44.234 INFO:tasks.rados.rados.2.smithi057.stdout:2089: writing smithi05720651-18 from 1736139 to 2175034 tid 2 2020-11-16T22:09:44.242 INFO:tasks.rados.rados.2.smithi057.stdout:2089: writing smithi05720651-18 from 2597781 to 3378580 tid 3 2020-11-16T22:09:44.242 INFO:tasks.rados.rados.2.smithi057.stdout:2090: read oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:44.242 INFO:tasks.rados.rados.2.smithi057.stdout:2090: expect (ObjNum 496 snap 177 seq_num 496) 2020-11-16T22:09:44.242 INFO:tasks.rados.rados.2.smithi057.stdout:2091: write (excl) oid 34 current snap is 243 2020-11-16T22:09:44.243 INFO:tasks.rados.rados.2.smithi057.stdout:2091: seq_num 694 ranges {464058=410929,1394621=698906,2625204=592071,3656107=7951} 2020-11-16T22:09:44.247 INFO:tasks.rados.rados.2.smithi057.stdout:2091: writing smithi05720651-34 from 464058 to 874987 tid 1 2020-11-16T22:09:44.254 INFO:tasks.rados.rados.2.smithi057.stdout:2091: writing smithi05720651-34 from 1394621 to 2093527 tid 2 2020-11-16T22:09:44.261 INFO:tasks.rados.rados.2.smithi057.stdout:2091: writing smithi05720651-34 from 2625204 to 3217275 tid 3 2020-11-16T22:09:44.263 INFO:tasks.rados.rados.2.smithi057.stdout:2091: writing smithi05720651-34 from 3656107 to 3664058 tid 4 2020-11-16T22:09:44.264 INFO:tasks.rados.rados.2.smithi057.stdout:2092: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:44.264 INFO:tasks.rados.rados.2.smithi057.stdout:2092: expect (ObjNum 632 snap 220 seq_num 632) 2020-11-16T22:09:44.264 INFO:tasks.rados.rados.2.smithi057.stdout:2093: write (excl) oid 22 current snap is 243 2020-11-16T22:09:44.264 INFO:tasks.rados.rados.2.smithi057.stdout:2093: seq_num 695 ranges {480865=486178,1453103=442564,2652627=519696} 2020-11-16T22:09:44.269 INFO:tasks.rados.rados.2.smithi057.stdout:2093: writing smithi05720651-22 from 480865 to 967043 tid 1 2020-11-16T22:09:44.275 INFO:tasks.rados.rados.2.smithi057.stdout:2093: writing smithi05720651-22 from 1453103 to 1895667 tid 2 2020-11-16T22:09:44.282 INFO:tasks.rados.rados.2.smithi057.stdout:2093: writing smithi05720651-22 from 2652627 to 3172323 tid 3 2020-11-16T22:09:44.282 INFO:tasks.rados.rados.2.smithi057.stdout:2094: snap_remove snap 237 2020-11-16T22:09:44.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:44 smithi016 bash[10302]: cluster 2020-11-16T22:09:43.221491+0000 mon.a (mon.0) 1212 : cluster [DBG] osdmap e555: 12 total, 12 up, 12 in 2020-11-16T22:09:44.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:44 smithi016 bash[10302]: cluster 2020-11-16T22:09:44.224777+0000 mon.a (mon.0) 1213 : cluster [DBG] osdmap e556: 12 total, 12 up, 12 in 2020-11-16T22:09:44.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:44 smithi195 bash[10218]: cluster 2020-11-16T22:09:43.221491+0000 mon.a (mon.0) 1212 : cluster [DBG] osdmap e555: 12 total, 12 up, 12 in 2020-11-16T22:09:44.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:44 smithi195 bash[10218]: cluster 2020-11-16T22:09:44.224777+0000 mon.a (mon.0) 1213 : cluster [DBG] osdmap e556: 12 total, 12 up, 12 in 2020-11-16T22:09:44.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:44 smithi057 bash[10301]: cluster 2020-11-16T22:09:43.221491+0000 mon.a (mon.0) 1212 : cluster [DBG] osdmap e555: 12 total, 12 up, 12 in 2020-11-16T22:09:44.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:44 smithi057 bash[10301]: cluster 2020-11-16T22:09:44.224777+0000 mon.a (mon.0) 1213 : cluster [DBG] osdmap e556: 12 total, 12 up, 12 in 2020-11-16T22:09:45.233 INFO:tasks.rados.rados.2.smithi057.stdout:2094: done (5 left) 2020-11-16T22:09:45.234 INFO:tasks.rados.rados.2.smithi057.stdout:2095: write oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 243 2020-11-16T22:09:45.234 INFO:tasks.rados.rados.2.smithi057.stdout:2095: seq_num 696 ranges {497672=561427,1795232=702575,2963697=730968} 2020-11-16T22:09:45.241 INFO:tasks.rados.rados.2.smithi057.stdout:2095: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 497672 to 1059099 tid 1 2020-11-16T22:09:45.252 INFO:tasks.rados.rados.2.smithi057.stdout:2095: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1795232 to 2497807 tid 2 2020-11-16T22:09:45.259 INFO:tasks.rados.rados.2.smithi057.stdout:2095: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2963697 to 3694665 tid 3 2020-11-16T22:09:45.259 INFO:tasks.rados.rados.2.smithi057.stdout:2096: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:45.260 INFO:tasks.rados.rados.2.smithi057.stdout:2096: expect (ObjNum 645 snap 225 seq_num 645) 2020-11-16T22:09:45.260 INFO:tasks.rados.rados.2.smithi057.stdout:2097: write oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 243 2020-11-16T22:09:45.260 INFO:tasks.rados.rados.2.smithi057.stdout:2097: seq_num 697 ranges {514479=636676,1853714=446233,2991120=542240} 2020-11-16T22:09:45.266 INFO:tasks.rados.rados.2.smithi057.stdout:2097: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 514479 to 1151155 tid 1 2020-11-16T22:09:45.273 INFO:tasks.rados.rados.2.smithi057.stdout:2097: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1853714 to 2299947 tid 2 2020-11-16T22:09:45.280 INFO:tasks.rados.rados.2.smithi057.stdout:2097: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2991120 to 3533360 tid 3 2020-11-16T22:09:45.280 INFO:tasks.rados.rados.2.smithi057.stdout:2098: delete oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 243 2020-11-16T22:09:45.280 INFO:tasks.rados.rados.2.smithi057.stdout:2089: finishing write tid 1 to smithi05720651-18 2020-11-16T22:09:45.281 INFO:tasks.rados.rados.2.smithi057.stdout:2089: finishing write tid 2 to smithi05720651-18 2020-11-16T22:09:45.281 INFO:tasks.rados.rados.2.smithi057.stdout:2090: expect (ObjNum 496 snap 177 seq_num 496) 2020-11-16T22:09:45.360 INFO:tasks.rados.rados.2.smithi057.stdout:2089: finishing write tid 3 to smithi05720651-18 2020-11-16T22:09:45.361 INFO:tasks.rados.rados.2.smithi057.stdout:2089: finishing write tid 5 to smithi05720651-18 2020-11-16T22:09:45.361 INFO:tasks.rados.rados.2.smithi057.stdout:2089: finishing write tid 6 to smithi05720651-18 2020-11-16T22:09:45.361 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 1265 (ObjNum 693 snap 243 seq_num 693) dirty exists 2020-11-16T22:09:45.361 INFO:tasks.rados.rados.2.smithi057.stdout:2089: left oid 18 (ObjNum 693 snap 243 seq_num 693) 2020-11-16T22:09:45.361 INFO:tasks.rados.rados.2.smithi057.stdout:2091: finishing write tid 1 to smithi05720651-34 2020-11-16T22:09:45.361 INFO:tasks.rados.rados.2.smithi057.stdout:2091: finishing write tid 2 to smithi05720651-34 2020-11-16T22:09:45.361 INFO:tasks.rados.rados.2.smithi057.stdout:2091: finishing write tid 3 to smithi05720651-34 2020-11-16T22:09:45.362 INFO:tasks.rados.rados.2.smithi057.stdout:2091: finishing write tid 4 to smithi05720651-34 2020-11-16T22:09:45.362 INFO:tasks.rados.rados.2.smithi057.stdout:2091: finishing write tid 6 to smithi05720651-34 2020-11-16T22:09:45.362 INFO:tasks.rados.rados.2.smithi057.stdout:2091: finishing write tid 7 to smithi05720651-34 2020-11-16T22:09:45.362 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 1536 (ObjNum 694 snap 243 seq_num 694) dirty exists 2020-11-16T22:09:45.362 INFO:tasks.rados.rados.2.smithi057.stdout:2091: left oid 34 (ObjNum 694 snap 243 seq_num 694) 2020-11-16T22:09:45.362 INFO:tasks.rados.rados.2.smithi057.stdout:2093: finishing write tid 1 to smithi05720651-22 2020-11-16T22:09:45.362 INFO:tasks.rados.rados.2.smithi057.stdout:2092: expect (ObjNum 632 snap 220 seq_num 632) 2020-11-16T22:09:45.479 INFO:tasks.rados.rados.2.smithi057.stdout:2093: finishing write tid 2 to smithi05720651-22 2020-11-16T22:09:45.479 INFO:tasks.rados.rados.2.smithi057.stdout:2093: finishing write tid 3 to smithi05720651-22 2020-11-16T22:09:45.479 INFO:tasks.rados.rados.2.smithi057.stdout:2093: finishing write tid 5 to smithi05720651-22 2020-11-16T22:09:45.479 INFO:tasks.rados.rados.2.smithi057.stdout:2093: finishing write tid 6 to smithi05720651-22 2020-11-16T22:09:45.479 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 1127 (ObjNum 695 snap 243 seq_num 695) dirty exists 2020-11-16T22:09:45.480 INFO:tasks.rados.rados.2.smithi057.stdout:2093: left oid 22 (ObjNum 695 snap 243 seq_num 695) 2020-11-16T22:09:45.480 INFO:tasks.rados.rados.2.smithi057.stdout:2095: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:45.480 INFO:tasks.rados.rados.2.smithi057.stdout:2095: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:45.480 INFO:tasks.rados.rados.2.smithi057.stdout:2095: finishing write tid 3 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:45.480 INFO:tasks.rados.rados.2.smithi057.stdout:2095: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:45.480 INFO:tasks.rados.rados.2.smithi057.stdout:2095: finishing write tid 6 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:45.480 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 107 (ObjNum 696 snap 243 seq_num 696) dirty exists 2020-11-16T22:09:45.481 INFO:tasks.rados.rados.2.smithi057.stdout:2095: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 696 snap 243 seq_num 696) 2020-11-16T22:09:45.481 INFO:tasks.rados.rados.2.smithi057.stdout:2096: expect (ObjNum 645 snap 225 seq_num 645) 2020-11-16T22:09:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:45 smithi016 bash[10302]: cluster 2020-11-16T22:09:43.732523+0000 mgr.x (mgr.24115) 513 : cluster [DBG] pgmap v998: 17 pgs: 17 active+clean; 158 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 3.2 MiB/s wr, 31 op/s 2020-11-16T22:09:45.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:45 smithi195 bash[10218]: cluster 2020-11-16T22:09:43.732523+0000 mgr.x (mgr.24115) 513 : cluster [DBG] pgmap v998: 17 pgs: 17 active+clean; 158 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 3.2 MiB/s wr, 31 op/s 2020-11-16T22:09:45.664 INFO:tasks.rados.rados.2.smithi057.stdout:2097: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:45.664 INFO:tasks.rados.rados.2.smithi057.stdout:2097: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:45.664 INFO:tasks.rados.rados.2.smithi057.stdout:2097: finishing write tid 3 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:45.664 INFO:tasks.rados.rados.2.smithi057.stdout:2097: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:45.664 INFO:tasks.rados.rados.2.smithi057.stdout:2097: finishing write tid 6 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:45.665 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1336 (ObjNum 697 snap 243 seq_num 697) dirty exists 2020-11-16T22:09:45.665 INFO:tasks.rados.rados.2.smithi057.stdout:2097: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 697 snap 243 seq_num 697) 2020-11-16T22:09:45.665 INFO:tasks.rados.rados.2.smithi057.stdout:2089: done (8 left) 2020-11-16T22:09:45.665 INFO:tasks.rados.rados.2.smithi057.stdout:2090: done (7 left) 2020-11-16T22:09:45.665 INFO:tasks.rados.rados.2.smithi057.stdout:2091: done (6 left) 2020-11-16T22:09:45.665 INFO:tasks.rados.rados.2.smithi057.stdout:2092: done (5 left) 2020-11-16T22:09:45.665 INFO:tasks.rados.rados.2.smithi057.stdout:2093: done (4 left) 2020-11-16T22:09:45.666 INFO:tasks.rados.rados.2.smithi057.stdout:2095: done (3 left) 2020-11-16T22:09:45.666 INFO:tasks.rados.rados.2.smithi057.stdout:2096: done (2 left) 2020-11-16T22:09:45.666 INFO:tasks.rados.rados.2.smithi057.stdout:2097: done (1 left) 2020-11-16T22:09:45.666 INFO:tasks.rados.rados.2.smithi057.stdout:2098: done (0 left) 2020-11-16T22:09:45.666 INFO:tasks.rados.rados.2.smithi057.stdout:2099: write (excl) oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 243 2020-11-16T22:09:45.666 INFO:tasks.rados.rados.2.smithi057.stdout:2099: seq_num 699 ranges {548093=787174,1970678=449902,3045966=681137} 2020-11-16T22:09:45.681 INFO:tasks.rados.rados.2.smithi057.stdout:2099: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 548093 to 1335267 tid 1 2020-11-16T22:09:45.687 INFO:tasks.rados.rados.2.smithi057.stdout:2099: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1970678 to 2420580 tid 2 2020-11-16T22:09:45.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:45 smithi057 bash[10301]: cluster 2020-11-16T22:09:43.732523+0000 mgr.x (mgr.24115) 513 : cluster [DBG] pgmap v998: 17 pgs: 17 active+clean; 158 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 3.2 MiB/s wr, 31 op/s 2020-11-16T22:09:45.695 INFO:tasks.rados.rados.2.smithi057.stdout:2099: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3045966 to 3727103 tid 3 2020-11-16T22:09:45.695 INFO:tasks.rados.rados.2.smithi057.stdout:2100: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 239 2020-11-16T22:09:45.695 INFO:tasks.rados.rados.2.smithi057.stdout:2100: expect (ObjNum 654 snap 231 seq_num 654) 2020-11-16T22:09:45.695 INFO:tasks.rados.rados.2.smithi057.stdout:2101: snap_create 2020-11-16T22:09:45.695 INFO:tasks.rados.rados.2.smithi057.stdout:2099: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:45.700 INFO:tasks.rados.rados.2.smithi057.stdout:2099: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:45.703 INFO:tasks.rados.rados.2.smithi057.stdout:2099: finishing write tid 3 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:45.703 INFO:tasks.rados.rados.2.smithi057.stdout:2099: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:45.703 INFO:tasks.rados.rados.2.smithi057.stdout:2099: finishing write tid 6 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:45.704 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1603 (ObjNum 699 snap 243 seq_num 699) dirty exists 2020-11-16T22:09:45.704 INFO:tasks.rados.rados.2.smithi057.stdout:2099: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 699 snap 243 seq_num 699) 2020-11-16T22:09:45.708 INFO:tasks.rados.rados.2.smithi057.stdout:2100: expect (ObjNum 654 snap 231 seq_num 654) 2020-11-16T22:09:46.250 INFO:tasks.rados.rados.2.smithi057.stdout:2099: done (2 left) 2020-11-16T22:09:46.251 INFO:tasks.rados.rados.2.smithi057.stdout:2100: done (1 left) 2020-11-16T22:09:46.251 INFO:tasks.rados.rados.2.smithi057.stdout:2101: done (0 left) 2020-11-16T22:09:46.251 INFO:tasks.rados.rados.2.smithi057.stdout:2102: snap_create 2020-11-16T22:09:46.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:46 smithi016 bash[10302]: cluster 2020-11-16T22:09:45.244485+0000 mon.a (mon.0) 1214 : cluster [DBG] osdmap e557: 12 total, 12 up, 12 in 2020-11-16T22:09:46.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:46 smithi195 bash[10218]: cluster 2020-11-16T22:09:45.244485+0000 mon.a (mon.0) 1214 : cluster [DBG] osdmap e557: 12 total, 12 up, 12 in 2020-11-16T22:09:46.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:46 smithi057 bash[10301]: cluster 2020-11-16T22:09:45.244485+0000 mon.a (mon.0) 1214 : cluster [DBG] osdmap e557: 12 total, 12 up, 12 in 2020-11-16T22:09:47.260 INFO:tasks.rados.rados.2.smithi057.stdout:2102: done (0 left) 2020-11-16T22:09:47.260 INFO:tasks.rados.rados.2.smithi057.stdout:2103: write (excl) oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 245 2020-11-16T22:09:47.260 INFO:tasks.rados.rados.2.smithi057.stdout:2103: seq_num 700 ranges {564900=578776,1629160=709913,3073389=492409} 2020-11-16T22:09:47.271 INFO:tasks.rados.rados.2.smithi057.stdout:2103: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 564900 to 1143676 tid 1 2020-11-16T22:09:47.278 INFO:tasks.rados.rados.2.smithi057.stdout:2103: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1629160 to 2339073 tid 2 2020-11-16T22:09:47.286 INFO:tasks.rados.rados.2.smithi057.stdout:2103: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3073389 to 3565798 tid 3 2020-11-16T22:09:47.286 INFO:tasks.rados.rados.2.smithi057.stdout:2104: write oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 245 2020-11-16T22:09:47.286 INFO:tasks.rados.rados.2.smithi057.stdout:2104: seq_num 701 ranges {581707=654025,1687642=453571,2700812=703681} 2020-11-16T22:09:47.293 INFO:tasks.rados.rados.2.smithi057.stdout:2104: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 581707 to 1235732 tid 1 2020-11-16T22:09:47.299 INFO:tasks.rados.rados.2.smithi057.stdout:2104: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1687642 to 2141213 tid 2 2020-11-16T22:09:47.306 INFO:tasks.rados.rados.2.smithi057.stdout:2104: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2700812 to 3404493 tid 3 2020-11-16T22:09:47.306 INFO:tasks.rados.rados.2.smithi057.stdout:2105: snap_create 2020-11-16T22:09:47.306 INFO:tasks.rados.rados.2.smithi057.stdout:2103: finishing write tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:47.306 INFO:tasks.rados.rados.2.smithi057.stdout:2103: finishing write tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:47.307 INFO:tasks.rados.rados.2.smithi057.stdout:2103: finishing write tid 3 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:47.307 INFO:tasks.rados.rados.2.smithi057.stdout:2103: finishing write tid 5 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:47.307 INFO:tasks.rados.rados.2.smithi057.stdout:2103: finishing write tid 6 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:47.307 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1607 (ObjNum 700 snap 245 seq_num 700) dirty exists 2020-11-16T22:09:47.307 INFO:tasks.rados.rados.2.smithi057.stdout:2103: left oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 700 snap 245 seq_num 700) 2020-11-16T22:09:47.307 INFO:tasks.rados.rados.2.smithi057.stdout:2104: finishing write tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:47.308 INFO:tasks.rados.rados.2.smithi057.stdout:2104: finishing write tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:47.312 INFO:tasks.rados.rados.2.smithi057.stdout:2104: finishing write tid 3 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:47.312 INFO:tasks.rados.rados.2.smithi057.stdout:2104: finishing write tid 5 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:47.313 INFO:tasks.rados.rados.2.smithi057.stdout:2104: finishing write tid 6 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:47.313 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1353 (ObjNum 701 snap 245 seq_num 701) dirty exists 2020-11-16T22:09:47.313 INFO:tasks.rados.rados.2.smithi057.stdout:2104: left oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 701 snap 245 seq_num 701) 2020-11-16T22:09:47.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:47 smithi016 bash[10302]: cluster 2020-11-16T22:09:45.733154+0000 mgr.x (mgr.24115) 514 : cluster [DBG] pgmap v1001: 17 pgs: 17 active+clean; 165 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2020-11-16T22:09:47.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:47 smithi016 bash[10302]: cluster 2020-11-16T22:09:46.262259+0000 mon.a (mon.0) 1215 : cluster [DBG] osdmap e558: 12 total, 12 up, 12 in 2020-11-16T22:09:47.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:47 smithi195 bash[10218]: cluster 2020-11-16T22:09:45.733154+0000 mgr.x (mgr.24115) 514 : cluster [DBG] pgmap v1001: 17 pgs: 17 active+clean; 165 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2020-11-16T22:09:47.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:47 smithi195 bash[10218]: cluster 2020-11-16T22:09:46.262259+0000 mon.a (mon.0) 1215 : cluster [DBG] osdmap e558: 12 total, 12 up, 12 in 2020-11-16T22:09:47.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:47 smithi057 bash[10301]: cluster 2020-11-16T22:09:45.733154+0000 mgr.x (mgr.24115) 514 : cluster [DBG] pgmap v1001: 17 pgs: 17 active+clean; 165 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 1.5 MiB/s wr, 24 op/s 2020-11-16T22:09:47.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:47 smithi057 bash[10301]: cluster 2020-11-16T22:09:46.262259+0000 mon.a (mon.0) 1215 : cluster [DBG] osdmap e558: 12 total, 12 up, 12 in 2020-11-16T22:09:48.282 INFO:tasks.rados.rados.2.smithi057.stdout:2103: done (2 left) 2020-11-16T22:09:48.282 INFO:tasks.rados.rados.2.smithi057.stdout:2104: done (1 left) 2020-11-16T22:09:48.283 INFO:tasks.rados.rados.2.smithi057.stdout:2105: done (0 left) 2020-11-16T22:09:48.283 INFO:tasks.rados.rados.2.smithi057.stdout:2106: rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 246 2020-11-16T22:09:48.283 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 240 2020-11-16T22:09:48.283 INFO:tasks.rados.rados.2.smithi057.stdout:2107: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 234 2020-11-16T22:09:48.283 INFO:tasks.rados.rados.2.smithi057.stdout:2107: expect deleted 2020-11-16T22:09:48.283 INFO:tasks.rados.rados.2.smithi057.stdout:2108: write oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 246 2020-11-16T22:09:48.283 INFO:tasks.rados.rados.2.smithi057.stdout:2108: seq_num 702 ranges {598514=729274,1746124=597229,3128235=514953} 2020-11-16T22:09:48.295 INFO:tasks.rados.rados.2.smithi057.stdout:2108: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 598514 to 1327788 tid 1 2020-11-16T22:09:48.301 INFO:tasks.rados.rados.2.smithi057.stdout:2108: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1746124 to 2343353 tid 2 2020-11-16T22:09:48.309 INFO:tasks.rados.rados.2.smithi057.stdout:2108: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3128235 to 3643188 tid 3 2020-11-16T22:09:48.309 INFO:tasks.rados.rados.2.smithi057.stdout:2109: copy_from oid 24 from oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 246 2020-11-16T22:09:48.309 INFO:tasks.rados.rados.2.smithi057.stdout:2106: finishing rollback tid 0 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:48.309 INFO:tasks.rados.rados.2.smithi057.stdout:2106: finishing rollback tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:48.309 INFO:tasks.rados.rados.2.smithi057.stdout:2106: finishing rollback tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:48.309 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1733 (ObjNum 654 snap 231 seq_num 654) dirty exists 2020-11-16T22:09:48.310 INFO:tasks.rados.rados.2.smithi057.stdout:2108: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:48.310 INFO:tasks.rados.rados.2.smithi057.stdout:2108: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:48.310 INFO:tasks.rados.rados.2.smithi057.stdout:2106: done (3 left) 2020-11-16T22:09:48.310 INFO:tasks.rados.rados.2.smithi057.stdout:2107: done (2 left) 2020-11-16T22:09:48.310 INFO:tasks.rados.rados.2.smithi057.stdout:2110: snap_create 2020-11-16T22:09:48.312 INFO:tasks.rados.rados.2.smithi057.stdout:2109: finishing copy_from to smithi05720651-24 2020-11-16T22:09:48.313 INFO:tasks.rados.rados.2.smithi057.stdout:2109: got expected ENOENT (src dne) 2020-11-16T22:09:48.313 INFO:tasks.rados.rados.2.smithi057.stdout:2109: finishing copy_from racing read to smithi05720651-24 2020-11-16T22:09:48.316 INFO:tasks.rados.rados.2.smithi057.stdout:2108: finishing write tid 3 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:48.316 INFO:tasks.rados.rados.2.smithi057.stdout:2108: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:48.316 INFO:tasks.rados.rados.2.smithi057.stdout:2108: finishing write tid 6 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:48.316 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1612 (ObjNum 702 snap 246 seq_num 702) dirty exists 2020-11-16T22:09:48.317 INFO:tasks.rados.rados.2.smithi057.stdout:2108: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 702 snap 246 seq_num 702) 2020-11-16T22:09:48.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:48 smithi016 bash[10302]: cluster 2020-11-16T22:09:47.271606+0000 mon.a (mon.0) 1216 : cluster [DBG] osdmap e559: 12 total, 12 up, 12 in 2020-11-16T22:09:48.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:48 smithi195 bash[10218]: cluster 2020-11-16T22:09:47.271606+0000 mon.a (mon.0) 1216 : cluster [DBG] osdmap e559: 12 total, 12 up, 12 in 2020-11-16T22:09:48.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:48 smithi057 bash[10301]: cluster 2020-11-16T22:09:47.271606+0000 mon.a (mon.0) 1216 : cluster [DBG] osdmap e559: 12 total, 12 up, 12 in 2020-11-16T22:09:49.292 INFO:tasks.rados.rados.2.smithi057.stdout:2108: done (2 left) 2020-11-16T22:09:49.292 INFO:tasks.rados.rados.2.smithi057.stdout:2109: done (1 left) 2020-11-16T22:09:49.292 INFO:tasks.rados.rados.2.smithi057.stdout:2110: done (0 left) 2020-11-16T22:09:49.292 INFO:tasks.rados.rados.2.smithi057.stdout:2111: delete oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 247 2020-11-16T22:09:49.300 INFO:tasks.rados.rados.2.smithi057.stdout:2111: done (0 left) 2020-11-16T22:09:49.300 INFO:tasks.rados.rados.2.smithi057.stdout:2112: snap_create 2020-11-16T22:09:49.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:49 smithi016 bash[10302]: cluster 2020-11-16T22:09:47.733846+0000 mgr.x (mgr.24115) 515 : cluster [DBG] pgmap v1004: 17 pgs: 17 active+clean; 178 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 4.0 MiB/s wr, 31 op/s 2020-11-16T22:09:49.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:49 smithi016 bash[10302]: cluster 2020-11-16T22:09:48.293683+0000 mon.a (mon.0) 1217 : cluster [DBG] osdmap e560: 12 total, 12 up, 12 in 2020-11-16T22:09:49.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:49 smithi195 bash[10218]: cluster 2020-11-16T22:09:47.733846+0000 mgr.x (mgr.24115) 515 : cluster [DBG] pgmap v1004: 17 pgs: 17 active+clean; 178 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 4.0 MiB/s wr, 31 op/s 2020-11-16T22:09:49.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:49 smithi195 bash[10218]: cluster 2020-11-16T22:09:48.293683+0000 mon.a (mon.0) 1217 : cluster [DBG] osdmap e560: 12 total, 12 up, 12 in 2020-11-16T22:09:49.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:49 smithi057 bash[10301]: cluster 2020-11-16T22:09:47.733846+0000 mgr.x (mgr.24115) 515 : cluster [DBG] pgmap v1004: 17 pgs: 17 active+clean; 178 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 4.0 MiB/s wr, 31 op/s 2020-11-16T22:09:49.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:49 smithi057 bash[10301]: cluster 2020-11-16T22:09:48.293683+0000 mon.a (mon.0) 1217 : cluster [DBG] osdmap e560: 12 total, 12 up, 12 in 2020-11-16T22:09:50.043 INFO:tasks.rados.rados.2.smithi057.stdout:2112: done (0 left) 2020-11-16T22:09:50.044 INFO:tasks.rados.rados.2.smithi057.stdout:2113: write (excl) oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 248 2020-11-16T22:09:50.044 INFO:tasks.rados.rados.2.smithi057.stdout:2113: seq_num 704 ranges {632128=479772,1746735=600898,3066728=653850} 2020-11-16T22:09:50.055 INFO:tasks.rados.rados.2.smithi057.stdout:2113: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 632128 to 1111900 tid 1 2020-11-16T22:09:50.062 INFO:tasks.rados.rados.2.smithi057.stdout:2113: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1746735 to 2347633 tid 2 2020-11-16T22:09:50.070 INFO:tasks.rados.rados.2.smithi057.stdout:2113: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3066728 to 3720578 tid 3 2020-11-16T22:09:50.071 INFO:tasks.rados.rados.2.smithi057.stdout:2114: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:50.071 INFO:tasks.rados.rados.2.smithi057.stdout:2114: expect (ObjNum 645 snap 225 seq_num 645) 2020-11-16T22:09:50.071 INFO:tasks.rados.rados.2.smithi057.stdout:2115: read oid 12 snap -1 2020-11-16T22:09:50.071 INFO:tasks.rados.rados.2.smithi057.stdout:2115: expect deleted 2020-11-16T22:09:50.071 INFO:tasks.rados.rados.2.smithi057.stdout:2116: rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 248 2020-11-16T22:09:50.071 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 246 2020-11-16T22:09:50.072 INFO:tasks.rados.rados.2.smithi057.stdout:2113: finishing write tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:50.072 INFO:tasks.rados.rados.2.smithi057.stdout:2113: finishing write tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:50.072 INFO:tasks.rados.rados.2.smithi057.stdout:2117: write (excl) oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 248 2020-11-16T22:09:50.072 INFO:tasks.rados.rados.2.smithi057.stdout:2117: seq_num 705 ranges {648935=555021,1805217=460909,2694151=465122,3817442=31493} 2020-11-16T22:09:50.078 INFO:tasks.rados.rados.2.smithi057.stdout:2117: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 648935 to 1203956 tid 1 2020-11-16T22:09:50.084 INFO:tasks.rados.rados.2.smithi057.stdout:2117: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1805217 to 2266126 tid 2 2020-11-16T22:09:50.089 INFO:tasks.rados.rados.2.smithi057.stdout:2117: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2694151 to 3159273 tid 3 2020-11-16T22:09:50.093 INFO:tasks.rados.rados.2.smithi057.stdout:2117: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3817442 to 3848935 tid 4 2020-11-16T22:09:50.094 INFO:tasks.rados.rados.2.smithi057.stdout:2118: snap_create 2020-11-16T22:09:50.094 INFO:tasks.rados.rados.2.smithi057.stdout:2113: finishing write tid 3 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:50.094 INFO:tasks.rados.rados.2.smithi057.stdout:2113: finishing write tid 5 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:50.094 INFO:tasks.rados.rados.2.smithi057.stdout:2113: finishing write tid 6 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:50.094 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1386 (ObjNum 704 snap 248 seq_num 704) dirty exists 2020-11-16T22:09:50.094 INFO:tasks.rados.rados.2.smithi057.stdout:2113: left oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 704 snap 248 seq_num 704) 2020-11-16T22:09:50.095 INFO:tasks.rados.rados.2.smithi057.stdout:2114: expect (ObjNum 645 snap 225 seq_num 645) 2020-11-16T22:09:50.285 INFO:tasks.rados.rados.2.smithi057.stdout:2116: finishing rollback tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:50.286 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 1869573999 snap 28527 seq_num 336) dirty dne 2020-11-16T22:09:50.286 INFO:tasks.rados.rados.2.smithi057.stdout:2117: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:50.286 INFO:tasks.rados.rados.2.smithi057.stdout:2117: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:50.286 INFO:tasks.rados.rados.2.smithi057.stdout:2117: finishing write tid 3 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:50.286 INFO:tasks.rados.rados.2.smithi057.stdout:2117: finishing write tid 4 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:50.286 INFO:tasks.rados.rados.2.smithi057.stdout:2117: finishing write tid 6 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:50.287 INFO:tasks.rados.rados.2.smithi057.stdout:2117: finishing write tid 7 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:50.287 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1358 (ObjNum 705 snap 248 seq_num 705) dirty exists 2020-11-16T22:09:50.287 INFO:tasks.rados.rados.2.smithi057.stdout:2117: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 705 snap 248 seq_num 705) 2020-11-16T22:09:50.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:50 smithi016 bash[10302]: cluster 2020-11-16T22:09:49.303639+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e561: 12 total, 12 up, 12 in 2020-11-16T22:09:50.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:50 smithi016 bash[10302]: cluster 2020-11-16T22:09:49.734518+0000 mgr.x (mgr.24115) 516 : cluster [DBG] pgmap v1007: 17 pgs: 17 active+clean; 178 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2020-11-16T22:09:50.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:50 smithi016 bash[10302]: cluster 2020-11-16T22:09:50.054914+0000 mon.a (mon.0) 1219 : cluster [DBG] osdmap e562: 12 total, 12 up, 12 in 2020-11-16T22:09:50.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:50 smithi195 bash[10218]: cluster 2020-11-16T22:09:49.303639+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e561: 12 total, 12 up, 12 in 2020-11-16T22:09:50.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:50 smithi195 bash[10218]: cluster 2020-11-16T22:09:49.734518+0000 mgr.x (mgr.24115) 516 : cluster [DBG] pgmap v1007: 17 pgs: 17 active+clean; 178 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2020-11-16T22:09:50.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:50 smithi195 bash[10218]: cluster 2020-11-16T22:09:50.054914+0000 mon.a (mon.0) 1219 : cluster [DBG] osdmap e562: 12 total, 12 up, 12 in 2020-11-16T22:09:50.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:50 smithi057 bash[10301]: cluster 2020-11-16T22:09:49.303639+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e561: 12 total, 12 up, 12 in 2020-11-16T22:09:50.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:50 smithi057 bash[10301]: cluster 2020-11-16T22:09:49.734518+0000 mgr.x (mgr.24115) 516 : cluster [DBG] pgmap v1007: 17 pgs: 17 active+clean; 178 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2020-11-16T22:09:50.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:50 smithi057 bash[10301]: cluster 2020-11-16T22:09:50.054914+0000 mon.a (mon.0) 1219 : cluster [DBG] osdmap e562: 12 total, 12 up, 12 in 2020-11-16T22:09:51.054 INFO:tasks.rados.rados.2.smithi057.stdout:2113: done (5 left) 2020-11-16T22:09:51.054 INFO:tasks.rados.rados.2.smithi057.stdout:2114: done (4 left) 2020-11-16T22:09:51.054 INFO:tasks.rados.rados.2.smithi057.stdout:2115: done (3 left) 2020-11-16T22:09:51.054 INFO:tasks.rados.rados.2.smithi057.stdout:2116: done (2 left) 2020-11-16T22:09:51.055 INFO:tasks.rados.rados.2.smithi057.stdout:2117: done (1 left) 2020-11-16T22:09:51.055 INFO:tasks.rados.rados.2.smithi057.stdout:2118: done (0 left) 2020-11-16T22:09:51.055 INFO:tasks.rados.rados.2.smithi057.stdout:2119: write (excl) oid 32 current snap is 249 2020-11-16T22:09:51.055 INFO:tasks.rados.rados.2.smithi057.stdout:2119: seq_num 706 ranges {665742=630270,1863699=604567,3121574=676394} 2020-11-16T22:09:51.067 INFO:tasks.rados.rados.2.smithi057.stdout:2119: writing smithi05720651-32 from 665742 to 1296012 tid 1 2020-11-16T22:09:51.075 INFO:tasks.rados.rados.2.smithi057.stdout:2119: writing smithi05720651-32 from 1863699 to 2468266 tid 2 2020-11-16T22:09:51.082 INFO:tasks.rados.rados.2.smithi057.stdout:2119: writing smithi05720651-32 from 3121574 to 3797968 tid 3 2020-11-16T22:09:51.083 INFO:tasks.rados.rados.2.smithi057.stdout:2120: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:51.083 INFO:tasks.rados.rados.2.smithi057.stdout:2120: expect (ObjNum 699 snap 243 seq_num 699) 2020-11-16T22:09:51.083 INFO:tasks.rados.rados.2.smithi057.stdout:2121: delete oid 18 current snap is 249 2020-11-16T22:09:51.083 INFO:tasks.rados.rados.2.smithi057.stdout:2119: finishing write tid 1 to smithi05720651-32 2020-11-16T22:09:51.089 INFO:tasks.rados.rados.2.smithi057.stdout:2119: finishing write tid 2 to smithi05720651-32 2020-11-16T22:09:51.090 INFO:tasks.rados.rados.2.smithi057.stdout:2121: done (2 left) 2020-11-16T22:09:51.090 INFO:tasks.rados.rados.2.smithi057.stdout:2122: write oid 18 current snap is 249 2020-11-16T22:09:51.090 INFO:tasks.rados.rados.2.smithi057.stdout:2122: seq_num 708 ranges {699356=497121,1980663=608236,3176420=415291} 2020-11-16T22:09:51.097 INFO:tasks.rados.rados.2.smithi057.stdout:2122: writing smithi05720651-18 from 699356 to 1196477 tid 1 2020-11-16T22:09:51.108 INFO:tasks.rados.rados.2.smithi057.stdout:2122: writing smithi05720651-18 from 1980663 to 2588899 tid 2 2020-11-16T22:09:51.114 INFO:tasks.rados.rados.2.smithi057.stdout:2122: writing smithi05720651-18 from 3176420 to 3591711 tid 3 2020-11-16T22:09:51.114 INFO:tasks.rados.rados.2.smithi057.stdout:2119: finishing write tid 3 to smithi05720651-32 2020-11-16T22:09:51.114 INFO:tasks.rados.rados.2.smithi057.stdout:2123: read oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:51.114 INFO:tasks.rados.rados.2.smithi057.stdout:2123: expect (ObjNum 705 snap 248 seq_num 705) 2020-11-16T22:09:51.114 INFO:tasks.rados.rados.2.smithi057.stdout:2124: rollback oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 249 2020-11-16T22:09:51.115 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 241 2020-11-16T22:09:51.115 INFO:tasks.rados.rados.2.smithi057.stdout:2120: expect (ObjNum 699 snap 243 seq_num 699) 2020-11-16T22:09:51.353 INFO:tasks.rados.rados.2.smithi057.stdout:2122: finishing write tid 1 to smithi05720651-18 2020-11-16T22:09:51.354 INFO:tasks.rados.rados.2.smithi057.stdout:2122: finishing write tid 2 to smithi05720651-18 2020-11-16T22:09:51.354 INFO:tasks.rados.rados.2.smithi057.stdout:2122: finishing write tid 3 to smithi05720651-18 2020-11-16T22:09:51.354 INFO:tasks.rados.rados.2.smithi057.stdout:2122: finishing write tid 5 to smithi05720651-18 2020-11-16T22:09:51.354 INFO:tasks.rados.rados.2.smithi057.stdout:2122: finishing write tid 6 to smithi05720651-18 2020-11-16T22:09:51.354 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 1270 (ObjNum 708 snap 249 seq_num 708) dirty exists 2020-11-16T22:09:51.355 INFO:tasks.rados.rados.2.smithi057.stdout:2122: left oid 18 (ObjNum 708 snap 249 seq_num 708) 2020-11-16T22:09:51.355 INFO:tasks.rados.rados.2.smithi057.stdout:2123: expect (ObjNum 705 snap 248 seq_num 705) 2020-11-16T22:09:51.522 INFO:tasks.rados.rados.2.smithi057.stdout:2124: finishing rollback tid 0 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:51.523 INFO:tasks.rados.rados.2.smithi057.stdout:2124: finishing rollback tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:51.523 INFO:tasks.rados.rados.2.smithi057.stdout:2124: finishing rollback tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:51.523 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 111 (ObjNum 674 snap 236 seq_num 674) dirty exists 2020-11-16T22:09:51.523 INFO:tasks.rados.rados.2.smithi057.stdout:2120: done (4 left) 2020-11-16T22:09:51.523 INFO:tasks.rados.rados.2.smithi057.stdout:2122: done (3 left) 2020-11-16T22:09:51.523 INFO:tasks.rados.rados.2.smithi057.stdout:2123: done (2 left) 2020-11-16T22:09:51.524 INFO:tasks.rados.rados.2.smithi057.stdout:2124: done (1 left) 2020-11-16T22:09:51.524 INFO:tasks.rados.rados.2.smithi057.stdout:2125: delete oid 18 current snap is 249 2020-11-16T22:09:51.525 INFO:tasks.rados.rados.2.smithi057.stdout:2125: done (1 left) 2020-11-16T22:09:51.526 INFO:tasks.rados.rados.2.smithi057.stdout:2126: read oid 6 snap -1 2020-11-16T22:09:51.526 INFO:tasks.rados.rados.2.smithi057.stdout:2126: expect deleted 2020-11-16T22:09:51.526 INFO:tasks.rados.rados.2.smithi057.stdout:2127: write (excl) oid 34 current snap is 249 2020-11-16T22:09:51.526 INFO:tasks.rados.rados.2.smithi057.stdout:2127: seq_num 710 ranges {732970=647619,2097627=611905,3231266=437835} 2020-11-16T22:09:51.542 INFO:tasks.rados.rados.2.smithi057.stdout:2127: writing smithi05720651-34 from 732970 to 1380589 tid 1 2020-11-16T22:09:51.550 INFO:tasks.rados.rados.2.smithi057.stdout:2127: writing smithi05720651-34 from 2097627 to 2709532 tid 2 2020-11-16T22:09:51.555 INFO:tasks.rados.rados.2.smithi057.stdout:2127: writing smithi05720651-34 from 3231266 to 3669101 tid 3 2020-11-16T22:09:51.556 INFO:tasks.rados.rados.2.smithi057.stdout:2128: read oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 241 2020-11-16T22:09:51.556 INFO:tasks.rados.rados.2.smithi057.stdout:2128: expect (ObjNum 647 snap 225 seq_num 647) 2020-11-16T22:09:51.556 INFO:tasks.rados.rados.2.smithi057.stdout:2129: write (excl) oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 249 2020-11-16T22:09:51.556 INFO:tasks.rados.rados.2.smithi057.stdout:2129: seq_num 711 ranges {749777=722868,2156109=471916,3258689=649107} 2020-11-16T22:09:51.564 INFO:tasks.rados.rados.2.smithi057.stdout:2129: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 749777 to 1472645 tid 1 2020-11-16T22:09:51.571 INFO:tasks.rados.rados.2.smithi057.stdout:2129: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2156109 to 2628025 tid 2 2020-11-16T22:09:51.578 INFO:tasks.rados.rados.2.smithi057.stdout:2129: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3258689 to 3907796 tid 3 2020-11-16T22:09:51.578 INFO:tasks.rados.rados.2.smithi057.stdout:2130: write oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 249 2020-11-16T22:09:51.578 INFO:tasks.rados.rados.2.smithi057.stdout:2130: seq_num 712 ranges {766584=798117,2098238=615574,3169759=460379} 2020-11-16T22:09:51.587 INFO:tasks.rados.rados.2.smithi057.stdout:2130: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 766584 to 1564701 tid 1 2020-11-16T22:09:51.593 INFO:tasks.rados.rados.2.smithi057.stdout:2130: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2098238 to 2713812 tid 2 2020-11-16T22:09:51.598 INFO:tasks.rados.rados.2.smithi057.stdout:2130: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3169759 to 3630138 tid 3 2020-11-16T22:09:51.599 INFO:tasks.rados.rados.2.smithi057.stdout:2131: write (excl) oid 46 current snap is 249 2020-11-16T22:09:51.599 INFO:tasks.rados.rados.2.smithi057.stdout:2131: seq_num 713 ranges {783391=473366,1756720=475585,2797182=788004} 2020-11-16T22:09:51.605 INFO:tasks.rados.rados.2.smithi057.stdout:2131: writing smithi05720651-46 from 783391 to 1256757 tid 1 2020-11-16T22:09:51.611 INFO:tasks.rados.rados.2.smithi057.stdout:2131: writing smithi05720651-46 from 1756720 to 2232305 tid 2 2020-11-16T22:09:51.619 INFO:tasks.rados.rados.2.smithi057.stdout:2131: writing smithi05720651-46 from 2797182 to 3585186 tid 3 2020-11-16T22:09:51.619 INFO:tasks.rados.rados.2.smithi057.stdout:2132: snap_remove snap 244 2020-11-16T22:09:52.070 INFO:tasks.rados.rados.2.smithi057.stdout:2132: done (7 left) 2020-11-16T22:09:52.070 INFO:tasks.rados.rados.2.smithi057.stdout:2133: snap_remove snap 233 2020-11-16T22:09:52.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:52 smithi016 bash[10302]: cluster 2020-11-16T22:09:51.065571+0000 mon.a (mon.0) 1220 : cluster [DBG] osdmap e563: 12 total, 12 up, 12 in 2020-11-16T22:09:52.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:52 smithi195 bash[10218]: cluster 2020-11-16T22:09:51.065571+0000 mon.a (mon.0) 1220 : cluster [DBG] osdmap e563: 12 total, 12 up, 12 in 2020-11-16T22:09:52.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:52 smithi057 bash[10301]: cluster 2020-11-16T22:09:51.065571+0000 mon.a (mon.0) 1220 : cluster [DBG] osdmap e563: 12 total, 12 up, 12 in 2020-11-16T22:09:53.075 INFO:tasks.rados.rados.2.smithi057.stdout:2133: done (7 left) 2020-11-16T22:09:53.075 INFO:tasks.rados.rados.2.smithi057.stdout:2134: write (excl) oid 28 current snap is 249 2020-11-16T22:09:53.075 INFO:tasks.rados.rados.2.smithi057.stdout:2134: seq_num 714 ranges {400198=548615,1415202=584996} 2020-11-16T22:09:53.085 INFO:tasks.rados.rados.2.smithi057.stdout:2134: writing smithi05720651-28 from 400198 to 948813 tid 1 2020-11-16T22:09:53.092 INFO:tasks.rados.rados.2.smithi057.stdout:2134: writing smithi05720651-28 from 1415202 to 2000198 tid 2 2020-11-16T22:09:53.093 INFO:tasks.rados.rados.2.smithi057.stdout:2135: copy_from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 249 2020-11-16T22:09:53.093 INFO:tasks.rados.rados.2.smithi057.stdout:2127: finishing write tid 1 to smithi05720651-34 2020-11-16T22:09:53.093 INFO:tasks.rados.rados.2.smithi057.stdout:2127: finishing write tid 2 to smithi05720651-34 2020-11-16T22:09:53.093 INFO:tasks.rados.rados.2.smithi057.stdout:2127: finishing write tid 3 to smithi05720651-34 2020-11-16T22:09:53.093 INFO:tasks.rados.rados.2.smithi057.stdout:2126: done (8 left) 2020-11-16T22:09:53.094 INFO:tasks.rados.rados.2.smithi057.stdout:2136: rollback oid 10 current snap is 249 2020-11-16T22:09:53.094 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 10 to 236 2020-11-16T22:09:53.094 INFO:tasks.rados.rados.2.smithi057.stdout:2137: delete oid 36 current snap is 249 2020-11-16T22:09:53.094 INFO:tasks.rados.rados.2.smithi057.stdout:2128: expect (ObjNum 647 snap 225 seq_num 647) 2020-11-16T22:09:53.337 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:09:53 smithi016 bash[19825]: debug 2020-11-16T22:09:53.107+0000 7f0e12c1a700 -1 osd.7 pg_epoch: 565 pg[2.8( v 565'1352 (0'0,565'1352] local-lis/les=71/72 n=11 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [7,9] r=0 lpr=71 luod=564'1350 crt=565'1352 lcod 563'1348 mlcod 563'1348 active+clean+snaptrim trimq=[1d3~1] ps=[1d9~1,1e3~1]] removing snap head 2020-11-16T22:09:53.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:53 smithi016 bash[10302]: cluster 2020-11-16T22:09:51.735323+0000 mgr.x (mgr.24115) 517 : cluster [DBG] pgmap v1010: 17 pgs: 17 active+clean; 195 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 16 op/s 2020-11-16T22:09:53.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:53 smithi016 bash[10302]: cluster 2020-11-16T22:09:52.082672+0000 mon.a (mon.0) 1221 : cluster [DBG] osdmap e564: 12 total, 12 up, 12 in 2020-11-16T22:09:53.340 INFO:tasks.rados.rados.2.smithi057.stdout:2129: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:53.340 INFO:tasks.rados.rados.2.smithi057.stdout:2129: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:53.340 INFO:tasks.rados.rados.2.smithi057.stdout:2129: finishing write tid 3 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:53.341 INFO:tasks.rados.rados.2.smithi057.stdout:2129: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:53.341 INFO:tasks.rados.rados.2.smithi057.stdout:2129: finishing write tid 6 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:53.341 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1617 (ObjNum 711 snap 249 seq_num 711) dirty exists 2020-11-16T22:09:53.341 INFO:tasks.rados.rados.2.smithi057.stdout:2129: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 711 snap 249 seq_num 711) 2020-11-16T22:09:53.341 INFO:tasks.rados.rados.2.smithi057.stdout:2130: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:53.341 INFO:tasks.rados.rados.2.smithi057.stdout:2130: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:53.341 INFO:tasks.rados.rados.2.smithi057.stdout:2130: finishing write tid 3 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:53.342 INFO:tasks.rados.rados.2.smithi057.stdout:2130: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:53.342 INFO:tasks.rados.rados.2.smithi057.stdout:2130: finishing write tid 6 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:53.342 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1543 (ObjNum 712 snap 249 seq_num 712) dirty exists 2020-11-16T22:09:53.342 INFO:tasks.rados.rados.2.smithi057.stdout:2130: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 712 snap 249 seq_num 712) 2020-11-16T22:09:53.342 INFO:tasks.rados.rados.2.smithi057.stdout:2131: finishing write tid 1 to smithi05720651-46 2020-11-16T22:09:53.342 INFO:tasks.rados.rados.2.smithi057.stdout:2131: finishing write tid 2 to smithi05720651-46 2020-11-16T22:09:53.343 INFO:tasks.rados.rados.2.smithi057.stdout:2131: finishing write tid 3 to smithi05720651-46 2020-11-16T22:09:53.343 INFO:tasks.rados.rados.2.smithi057.stdout:2131: finishing write tid 5 to smithi05720651-46 2020-11-16T22:09:53.343 INFO:tasks.rados.rados.2.smithi057.stdout:2128: done (9 left) 2020-11-16T22:09:53.343 INFO:tasks.rados.rados.2.smithi057.stdout:2129: done (8 left) 2020-11-16T22:09:53.343 INFO:tasks.rados.rados.2.smithi057.stdout:2130: done (7 left) 2020-11-16T22:09:53.343 INFO:tasks.rados.rados.2.smithi057.stdout:2137: done (6 left) 2020-11-16T22:09:53.343 INFO:tasks.rados.rados.2.smithi057.stdout:2138: delete oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 249 2020-11-16T22:09:53.344 INFO:tasks.rados.rados.2.smithi057.stdout:2131: finishing write tid 6 to smithi05720651-46 2020-11-16T22:09:53.344 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 1390 (ObjNum 713 snap 249 seq_num 713) dirty exists 2020-11-16T22:09:53.344 INFO:tasks.rados.rados.2.smithi057.stdout:2131: left oid 46 (ObjNum 713 snap 249 seq_num 713) 2020-11-16T22:09:53.344 INFO:tasks.rados.rados.2.smithi057.stdout:2119: finishing write tid 5 to smithi05720651-32 2020-11-16T22:09:53.344 INFO:tasks.rados.rados.2.smithi057.stdout:2119: finishing write tid 6 to smithi05720651-32 2020-11-16T22:09:53.344 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 1738 (ObjNum 706 snap 249 seq_num 706) dirty exists 2020-11-16T22:09:53.344 INFO:tasks.rados.rados.2.smithi057.stdout:2119: left oid 32 (ObjNum 706 snap 249 seq_num 706) 2020-11-16T22:09:53.344 INFO:tasks.rados.rados.2.smithi057.stdout:2127: finishing write tid 5 to smithi05720651-34 2020-11-16T22:09:53.345 INFO:tasks.rados.rados.2.smithi057.stdout:2127: finishing write tid 6 to smithi05720651-34 2020-11-16T22:09:53.345 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 1540 (ObjNum 710 snap 249 seq_num 710) dirty exists 2020-11-16T22:09:53.345 INFO:tasks.rados.rados.2.smithi057.stdout:2127: left oid 34 (ObjNum 710 snap 249 seq_num 710) 2020-11-16T22:09:53.345 INFO:tasks.rados.rados.2.smithi057.stdout:2134: finishing write tid 1 to smithi05720651-28 2020-11-16T22:09:53.345 INFO:tasks.rados.rados.2.smithi057.stdout:2136: finishing rollback tid 0 to smithi05720651-10 2020-11-16T22:09:53.345 INFO:tasks.rados.rados.2.smithi057.stdout:2135: finishing copy_from to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:53.345 INFO:tasks.rados.rados.2.smithi057.stdout:2135: got expected ENOENT (src dne) 2020-11-16T22:09:53.346 INFO:tasks.rados.rados.2.smithi057.stdout:2135: finishing copy_from racing read to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:53.346 INFO:tasks.rados.rados.2.smithi057.stdout:2134: finishing write tid 2 to smithi05720651-28 2020-11-16T22:09:53.346 INFO:tasks.rados.rados.2.smithi057.stdout:2134: finishing write tid 4 to smithi05720651-28 2020-11-16T22:09:53.346 INFO:tasks.rados.rados.2.smithi057.stdout:2134: finishing write tid 5 to smithi05720651-28 2020-11-16T22:09:53.346 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 1362 (ObjNum 714 snap 249 seq_num 714) dirty exists 2020-11-16T22:09:53.346 INFO:tasks.rados.rados.2.smithi057.stdout:2134: left oid 28 (ObjNum 714 snap 249 seq_num 714) 2020-11-16T22:09:53.346 INFO:tasks.rados.rados.2.smithi057.stdout:2136: finishing rollback tid 1 to smithi05720651-10 2020-11-16T22:09:53.347 INFO:tasks.rados.rados.2.smithi057.stdout:2136: finishing rollback tid 2 to smithi05720651-10 2020-11-16T22:09:53.347 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 1364 (ObjNum 525 snap 188 seq_num 525) dirty exists 2020-11-16T22:09:53.347 INFO:tasks.rados.rados.2.smithi057.stdout:2119: done (6 left) 2020-11-16T22:09:53.347 INFO:tasks.rados.rados.2.smithi057.stdout:2127: done (5 left) 2020-11-16T22:09:53.347 INFO:tasks.rados.rados.2.smithi057.stdout:2131: done (4 left) 2020-11-16T22:09:53.348 INFO:tasks.rados.rados.2.smithi057.stdout:2134: done (3 left) 2020-11-16T22:09:53.348 INFO:tasks.rados.rados.2.smithi057.stdout:2135: done (2 left) 2020-11-16T22:09:53.348 INFO:tasks.rados.rados.2.smithi057.stdout:2136: done (1 left) 2020-11-16T22:09:53.348 INFO:tasks.rados.rados.2.smithi057.stdout:2138: done (0 left) 2020-11-16T22:09:53.348 INFO:tasks.rados.rados.2.smithi057.stdout:2139: snap_remove snap 240 2020-11-16T22:09:53.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:53 smithi195 bash[10218]: cluster 2020-11-16T22:09:51.735323+0000 mgr.x (mgr.24115) 517 : cluster [DBG] pgmap v1010: 17 pgs: 17 active+clean; 195 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 16 op/s 2020-11-16T22:09:53.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:53 smithi195 bash[10218]: cluster 2020-11-16T22:09:52.082672+0000 mon.a (mon.0) 1221 : cluster [DBG] osdmap e564: 12 total, 12 up, 12 in 2020-11-16T22:09:53.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:53 smithi057 bash[10301]: cluster 2020-11-16T22:09:51.735323+0000 mgr.x (mgr.24115) 517 : cluster [DBG] pgmap v1010: 17 pgs: 17 active+clean; 195 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 16 op/s 2020-11-16T22:09:53.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:53 smithi057 bash[10301]: cluster 2020-11-16T22:09:52.082672+0000 mon.a (mon.0) 1221 : cluster [DBG] osdmap e564: 12 total, 12 up, 12 in 2020-11-16T22:09:54.090 INFO:tasks.rados.rados.2.smithi057.stdout:2139: done (0 left) 2020-11-16T22:09:54.090 INFO:tasks.rados.rados.2.smithi057.stdout:2140: copy_from oid 16 from oid 6 current snap is 249 2020-11-16T22:09:54.090 INFO:tasks.rados.rados.2.smithi057.stdout:2141: delete oid 8 current snap is 249 2020-11-16T22:09:54.099 INFO:tasks.rados.rados.2.smithi057.stdout:2140: finishing copy_from to smithi05720651-16 2020-11-16T22:09:54.099 INFO:tasks.rados.rados.2.smithi057.stdout:2140: got expected ENOENT (src dne) 2020-11-16T22:09:54.100 INFO:tasks.rados.rados.2.smithi057.stdout:2140: finishing copy_from racing read to smithi05720651-16 2020-11-16T22:09:54.286 INFO:tasks.rados.rados.2.smithi057.stdout:2140: done (1 left) 2020-11-16T22:09:54.287 INFO:tasks.rados.rados.2.smithi057.stdout:2141: done (0 left) 2020-11-16T22:09:54.287 INFO:tasks.rados.rados.2.smithi057.stdout:2142: rollback oid 28 current snap is 249 2020-11-16T22:09:54.287 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 28 to 239 2020-11-16T22:09:54.287 INFO:tasks.rados.rados.2.smithi057.stdout:2143: rollback oid 16 current snap is 249 2020-11-16T22:09:54.287 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 16 to 241 2020-11-16T22:09:54.287 INFO:tasks.rados.rados.2.smithi057.stdout:2144: delete oid 36 current snap is 249 2020-11-16T22:09:54.292 INFO:tasks.rados.rados.2.smithi057.stdout:2142: finishing rollback tid 0 to smithi05720651-28 2020-11-16T22:09:54.292 INFO:tasks.rados.rados.2.smithi057.stdout:2142: finishing rollback tid 1 to smithi05720651-28 2020-11-16T22:09:54.293 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 1367 (ObjNum 321 snap 0 seq_num 1864380724) dirty dne 2020-11-16T22:09:54.293 INFO:tasks.rados.rados.2.smithi057.stdout:2143: finishing rollback tid 0 to smithi05720651-16 2020-11-16T22:09:54.293 INFO:tasks.rados.rados.2.smithi057.stdout:2143: finishing rollback tid 1 to smithi05720651-16 2020-11-16T22:09:54.294 INFO:tasks.rados.rados.2.smithi057.stdout:2143: finishing rollback tid 2 to smithi05720651-16 2020-11-16T22:09:54.294 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 1393 (ObjNum 627 snap 219 seq_num 627) dirty exists 2020-11-16T22:09:54.294 INFO:tasks.rados.rados.2.smithi057.stdout:2142: done (2 left) 2020-11-16T22:09:54.295 INFO:tasks.rados.rados.2.smithi057.stdout:2143: done (1 left) 2020-11-16T22:09:54.295 INFO:tasks.rados.rados.2.smithi057.stdout:2144: done (0 left) 2020-11-16T22:09:54.295 INFO:tasks.rados.rados.2.smithi057.stdout:2145: write (excl) oid 50 current snap is 249 2020-11-16T22:09:54.295 INFO:tasks.rados.rados.2.smithi057.stdout:2145: seq_num 719 ranges {484233=641213,1707612=376621} 2020-11-16T22:09:54.303 INFO:tasks.rados.rados.2.smithi057.stdout:2145: writing smithi05720651-50 from 484233 to 1125446 tid 1 2020-11-16T22:09:54.310 INFO:tasks.rados.rados.2.smithi057.stdout:2145: writing smithi05720651-50 from 1707612 to 2084233 tid 2 2020-11-16T22:09:54.310 INFO:tasks.rados.rados.2.smithi057.stdout:2146: copy_from oid 18 from oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 249 2020-11-16T22:09:54.310 INFO:tasks.rados.rados.2.smithi057.stdout:2147: copy_from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 249 2020-11-16T22:09:54.310 INFO:tasks.rados.rados.2.smithi057.stdout:2148: snap_remove snap 246 2020-11-16T22:09:54.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:54 smithi195 bash[10218]: cluster 2020-11-16T22:09:53.085955+0000 mon.a (mon.0) 1222 : cluster [DBG] osdmap e565: 12 total, 12 up, 12 in 2020-11-16T22:09:54.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:54 smithi057 bash[10301]: cluster 2020-11-16T22:09:53.085955+0000 mon.a (mon.0) 1222 : cluster [DBG] osdmap e565: 12 total, 12 up, 12 in 2020-11-16T22:09:54.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:54 smithi016 bash[10302]: cluster 2020-11-16T22:09:53.085955+0000 mon.a (mon.0) 1222 : cluster [DBG] osdmap e565: 12 total, 12 up, 12 in 2020-11-16T22:09:55.048 INFO:tasks.rados.rados.2.smithi057.stdout:2148: done (3 left) 2020-11-16T22:09:55.049 INFO:tasks.rados.rados.2.smithi057.stdout:2149: snap_create 2020-11-16T22:09:55.049 INFO:tasks.rados.rados.2.smithi057.stdout:2145: finishing write tid 1 to smithi05720651-50 2020-11-16T22:09:55.049 INFO:tasks.rados.rados.2.smithi057.stdout:2145: finishing write tid 2 to smithi05720651-50 2020-11-16T22:09:55.049 INFO:tasks.rados.rados.2.smithi057.stdout:2145: finishing write tid 4 to smithi05720651-50 2020-11-16T22:09:55.049 INFO:tasks.rados.rados.2.smithi057.stdout:2145: finishing write tid 5 to smithi05720651-50 2020-11-16T22:09:55.049 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 1642 (ObjNum 719 snap 249 seq_num 719) dirty exists 2020-11-16T22:09:55.049 INFO:tasks.rados.rados.2.smithi057.stdout:2145: left oid 50 (ObjNum 719 snap 249 seq_num 719) 2020-11-16T22:09:55.050 INFO:tasks.rados.rados.2.smithi057.stdout:2146: finishing copy_from to smithi05720651-18 2020-11-16T22:09:55.050 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 1718 (ObjNum 687 snap 242 seq_num 687) dirty exists 2020-11-16T22:09:55.050 INFO:tasks.rados.rados.2.smithi057.stdout:2146: finishing copy_from racing read to smithi05720651-18 2020-11-16T22:09:55.050 INFO:tasks.rados.rados.2.smithi057.stdout:2147: finishing copy_from to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:55.050 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1336 (ObjNum 697 snap 243 seq_num 697) dirty exists 2020-11-16T22:09:55.050 INFO:tasks.rados.rados.2.smithi057.stdout:2147: finishing copy_from racing read to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:55.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:55 smithi195 bash[10218]: cluster 2020-11-16T22:09:53.736048+0000 mgr.x (mgr.24115) 518 : cluster [DBG] pgmap v1013: 17 pgs: 17 active+clean; 197 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 18 op/s 2020-11-16T22:09:55.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:55 smithi195 bash[10218]: cluster 2020-11-16T22:09:54.101317+0000 mon.a (mon.0) 1223 : cluster [DBG] osdmap e566: 12 total, 12 up, 12 in 2020-11-16T22:09:55.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:55 smithi195 bash[10218]: cluster 2020-11-16T22:09:55.059744+0000 mon.a (mon.0) 1224 : cluster [DBG] osdmap e567: 12 total, 12 up, 12 in 2020-11-16T22:09:55.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:55 smithi057 bash[10301]: cluster 2020-11-16T22:09:53.736048+0000 mgr.x (mgr.24115) 518 : cluster [DBG] pgmap v1013: 17 pgs: 17 active+clean; 197 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 18 op/s 2020-11-16T22:09:55.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:55 smithi057 bash[10301]: cluster 2020-11-16T22:09:54.101317+0000 mon.a (mon.0) 1223 : cluster [DBG] osdmap e566: 12 total, 12 up, 12 in 2020-11-16T22:09:55.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:55 smithi057 bash[10301]: cluster 2020-11-16T22:09:55.059744+0000 mon.a (mon.0) 1224 : cluster [DBG] osdmap e567: 12 total, 12 up, 12 in 2020-11-16T22:09:55.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:55 smithi016 bash[10302]: cluster 2020-11-16T22:09:53.736048+0000 mgr.x (mgr.24115) 518 : cluster [DBG] pgmap v1013: 17 pgs: 17 active+clean; 197 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 18 op/s 2020-11-16T22:09:55.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:55 smithi016 bash[10302]: cluster 2020-11-16T22:09:54.101317+0000 mon.a (mon.0) 1223 : cluster [DBG] osdmap e566: 12 total, 12 up, 12 in 2020-11-16T22:09:55.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:55 smithi016 bash[10302]: cluster 2020-11-16T22:09:55.059744+0000 mon.a (mon.0) 1224 : cluster [DBG] osdmap e567: 12 total, 12 up, 12 in 2020-11-16T22:09:56.052 INFO:tasks.rados.rados.2.smithi057.stdout:2145: done (3 left) 2020-11-16T22:09:56.052 INFO:tasks.rados.rados.2.smithi057.stdout:2146: done (2 left) 2020-11-16T22:09:56.052 INFO:tasks.rados.rados.2.smithi057.stdout:2147: done (1 left) 2020-11-16T22:09:56.052 INFO:tasks.rados.rados.2.smithi057.stdout:2149: done (0 left) 2020-11-16T22:09:56.052 INFO:tasks.rados.rados.2.smithi057.stdout:2150: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 239 2020-11-16T22:09:56.053 INFO:tasks.rados.rados.2.smithi057.stdout:2150: expect (ObjNum 654 snap 231 seq_num 654) 2020-11-16T22:09:56.053 INFO:tasks.rados.rados.2.smithi057.stdout:2151: read oid 48 snap -1 2020-11-16T22:09:56.053 INFO:tasks.rados.rados.2.smithi057.stdout:2151: expect deleted 2020-11-16T22:09:56.053 INFO:tasks.rados.rados.2.smithi057.stdout:2152: write oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 250 2020-11-16T22:09:56.053 INFO:tasks.rados.rados.2.smithi057.stdout:2152: seq_num 720 ranges {501040=716462,1766094=334946} 2020-11-16T22:09:56.066 INFO:tasks.rados.rados.2.smithi057.stdout:2152: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 501040 to 1217502 tid 1 2020-11-16T22:09:56.071 INFO:tasks.rados.rados.2.smithi057.stdout:2152: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1766094 to 2101040 tid 2 2020-11-16T22:09:56.071 INFO:tasks.rados.rados.2.smithi057.stdout:2153: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:56.071 INFO:tasks.rados.rados.2.smithi057.stdout:2153: expect (ObjNum 691 snap 242 seq_num 691) 2020-11-16T22:09:56.072 INFO:tasks.rados.rados.2.smithi057.stdout:2154: snap_create 2020-11-16T22:09:56.072 INFO:tasks.rados.rados.2.smithi057.stdout:2150: expect (ObjNum 654 snap 231 seq_num 654) 2020-11-16T22:09:56.173 INFO:tasks.rados.rados.2.smithi057.stdout:2152: finishing write tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:56.173 INFO:tasks.rados.rados.2.smithi057.stdout:2152: finishing write tid 2 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:56.173 INFO:tasks.rados.rados.2.smithi057.stdout:2153: expect (ObjNum 691 snap 242 seq_num 691) 2020-11-16T22:09:56.394 INFO:tasks.rados.rados.2.smithi057.stdout:2152: finishing write tid 4 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:56.394 INFO:tasks.rados.rados.2.smithi057.stdout:2152: finishing write tid 5 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:56.395 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1503 (ObjNum 720 snap 250 seq_num 720) dirty exists 2020-11-16T22:09:56.395 INFO:tasks.rados.rados.2.smithi057.stdout:2152: left oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 720 snap 250 seq_num 720) 2020-11-16T22:09:57.060 INFO:tasks.rados.rados.2.smithi057.stdout:2150: done (4 left) 2020-11-16T22:09:57.061 INFO:tasks.rados.rados.2.smithi057.stdout:2151: done (3 left) 2020-11-16T22:09:57.061 INFO:tasks.rados.rados.2.smithi057.stdout:2152: done (2 left) 2020-11-16T22:09:57.061 INFO:tasks.rados.rados.2.smithi057.stdout:2153: done (1 left) 2020-11-16T22:09:57.061 INFO:tasks.rados.rados.2.smithi057.stdout:2154: done (0 left) 2020-11-16T22:09:57.061 INFO:tasks.rados.rados.2.smithi057.stdout:2155: write oid 46 current snap is 251 2020-11-16T22:09:57.061 INFO:tasks.rados.rados.2.smithi057.stdout:2155: seq_num 721 ranges {517847=791711,2108223=9624} 2020-11-16T22:09:57.075 INFO:tasks.rados.rados.2.smithi057.stdout:2155: writing smithi05720651-46 from 517847 to 1309558 tid 1 2020-11-16T22:09:57.079 INFO:tasks.rados.rados.2.smithi057.stdout:2155: writing smithi05720651-46 from 2108223 to 2117847 tid 2 2020-11-16T22:09:57.079 INFO:tasks.rados.rados.2.smithi057.stdout:2156: delete oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 251 2020-11-16T22:09:57.091 INFO:tasks.rados.rados.2.smithi057.stdout:2155: finishing write tid 1 to smithi05720651-46 2020-11-16T22:09:57.091 INFO:tasks.rados.rados.2.smithi057.stdout:2155: finishing write tid 2 to smithi05720651-46 2020-11-16T22:09:57.091 INFO:tasks.rados.rados.2.smithi057.stdout:2155: finishing write tid 4 to smithi05720651-46 2020-11-16T22:09:57.092 INFO:tasks.rados.rados.2.smithi057.stdout:2155: finishing write tid 5 to smithi05720651-46 2020-11-16T22:09:57.092 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 1396 (ObjNum 721 snap 251 seq_num 721) dirty exists 2020-11-16T22:09:57.092 INFO:tasks.rados.rados.2.smithi057.stdout:2155: left oid 46 (ObjNum 721 snap 251 seq_num 721) 2020-11-16T22:09:57.092 INFO:tasks.rados.rados.2.smithi057.stdout:2155: done (1 left) 2020-11-16T22:09:57.092 INFO:tasks.rados.rados.2.smithi057.stdout:2156: done (0 left) 2020-11-16T22:09:57.093 INFO:tasks.rados.rados.2.smithi057.stdout:2157: delete oid 6 current snap is 251 2020-11-16T22:09:57.100 INFO:tasks.rados.rados.2.smithi057.stdout:2157: done (0 left) 2020-11-16T22:09:57.101 INFO:tasks.rados.rados.2.smithi057.stdout:2158: read oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:09:57.101 INFO:tasks.rados.rados.2.smithi057.stdout:2158: expect (ObjNum 701 snap 245 seq_num 701) 2020-11-16T22:09:57.101 INFO:tasks.rados.rados.2.smithi057.stdout:2159: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 251 2020-11-16T22:09:57.101 INFO:tasks.rados.rados.2.smithi057.stdout:2159: seq_num 724 ranges {568268=733811,2000022=168246} 2020-11-16T22:09:57.114 INFO:tasks.rados.rados.2.smithi057.stdout:2159: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 568268 to 1302079 tid 1 2020-11-16T22:09:57.119 INFO:tasks.rados.rados.2.smithi057.stdout:2159: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2000022 to 2168268 tid 2 2020-11-16T22:09:57.120 INFO:tasks.rados.rados.2.smithi057.stdout:2160: rollback oid 16 current snap is 251 2020-11-16T22:09:57.120 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 16 to 249 2020-11-16T22:09:57.120 INFO:tasks.rados.rados.2.smithi057.stdout:2158: expect (ObjNum 701 snap 245 seq_num 701) 2020-11-16T22:09:57.297 INFO:tasks.rados.rados.2.smithi057.stdout:2160: finishing rollback tid 0 to smithi05720651-16 2020-11-16T22:09:57.298 INFO:tasks.rados.rados.2.smithi057.stdout:2160: finishing rollback tid 1 to smithi05720651-16 2020-11-16T22:09:57.298 INFO:tasks.rados.rados.2.smithi057.stdout:2160: finishing rollback tid 2 to smithi05720651-16 2020-11-16T22:09:57.298 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 1399 (ObjNum 627 snap 219 seq_num 627) dirty exists 2020-11-16T22:09:57.298 INFO:tasks.rados.rados.2.smithi057.stdout:2159: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:57.298 INFO:tasks.rados.rados.2.smithi057.stdout:2159: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:57.299 INFO:tasks.rados.rados.2.smithi057.stdout:2159: finishing write tid 4 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:57.299 INFO:tasks.rados.rados.2.smithi057.stdout:2159: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:57.299 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1768 (ObjNum 724 snap 251 seq_num 724) dirty exists 2020-11-16T22:09:57.299 INFO:tasks.rados.rados.2.smithi057.stdout:2159: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 724 snap 251 seq_num 724) 2020-11-16T22:09:57.299 INFO:tasks.rados.rados.2.smithi057.stdout:2158: done (2 left) 2020-11-16T22:09:57.299 INFO:tasks.rados.rados.2.smithi057.stdout:2159: done (1 left) 2020-11-16T22:09:57.299 INFO:tasks.rados.rados.2.smithi057.stdout:2160: done (0 left) 2020-11-16T22:09:57.300 INFO:tasks.rados.rados.2.smithi057.stdout:2161: rollback oid 46 current snap is 251 2020-11-16T22:09:57.300 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 46 to 243 2020-11-16T22:09:57.300 INFO:tasks.rados.rados.2.smithi057.stdout:2162: rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 251 2020-11-16T22:09:57.300 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 236 2020-11-16T22:09:57.300 INFO:tasks.rados.rados.2.smithi057.stdout:2163: write oid 40 current snap is 251 2020-11-16T22:09:57.300 INFO:tasks.rados.rados.2.smithi057.stdout:2163: seq_num 725 ranges {585075=409060,1542151=642924} 2020-11-16T22:09:57.312 INFO:tasks.rados.rados.2.smithi057.stdout:2163: writing smithi05720651-40 from 585075 to 994135 tid 1 2020-11-16T22:09:57.319 INFO:tasks.rados.rados.2.smithi057.stdout:2163: writing smithi05720651-40 from 1542151 to 2185075 tid 2 2020-11-16T22:09:57.319 INFO:tasks.rados.rados.2.smithi057.stdout:2164: snap_create 2020-11-16T22:09:57.319 INFO:tasks.rados.rados.2.smithi057.stdout:2161: finishing rollback tid 0 to smithi05720651-46 2020-11-16T22:09:57.319 INFO:tasks.rados.rados.2.smithi057.stdout:2161: finishing rollback tid 1 to smithi05720651-46 2020-11-16T22:09:57.320 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 1401 (ObjNum 129 snap 0 seq_num 2932564208) dirty dne 2020-11-16T22:09:57.320 INFO:tasks.rados.rados.2.smithi057.stdout:2162: finishing rollback tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:57.320 INFO:tasks.rados.rados.2.smithi057.stdout:2162: finishing rollback tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:57.320 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1403 (ObjNum 588 snap 207 seq_num 588) dirty exists 2020-11-16T22:09:57.320 INFO:tasks.rados.rados.2.smithi057.stdout:2163: finishing write tid 1 to smithi05720651-40 2020-11-16T22:09:57.329 INFO:tasks.rados.rados.2.smithi057.stdout:2163: finishing write tid 2 to smithi05720651-40 2020-11-16T22:09:57.330 INFO:tasks.rados.rados.2.smithi057.stdout:2163: finishing write tid 4 to smithi05720651-40 2020-11-16T22:09:57.330 INFO:tasks.rados.rados.2.smithi057.stdout:2163: finishing write tid 5 to smithi05720651-40 2020-11-16T22:09:57.330 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 1772 (ObjNum 725 snap 251 seq_num 725) dirty exists 2020-11-16T22:09:57.331 INFO:tasks.rados.rados.2.smithi057.stdout:2163: left oid 40 (ObjNum 725 snap 251 seq_num 725) 2020-11-16T22:09:57.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:57 smithi016 bash[10302]: cluster 2020-11-16T22:09:55.736778+0000 mgr.x (mgr.24115) 519 : cluster [DBG] pgmap v1016: 17 pgs: 17 active+clean; 203 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 3.0 MiB/s wr, 18 op/s 2020-11-16T22:09:57.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:57 smithi016 bash[10302]: cluster 2020-11-16T22:09:56.063014+0000 mon.a (mon.0) 1225 : cluster [DBG] osdmap e568: 12 total, 12 up, 12 in 2020-11-16T22:09:57.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:57 smithi195 bash[10218]: cluster 2020-11-16T22:09:55.736778+0000 mgr.x (mgr.24115) 519 : cluster [DBG] pgmap v1016: 17 pgs: 17 active+clean; 203 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 3.0 MiB/s wr, 18 op/s 2020-11-16T22:09:57.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:57 smithi195 bash[10218]: cluster 2020-11-16T22:09:56.063014+0000 mon.a (mon.0) 1225 : cluster [DBG] osdmap e568: 12 total, 12 up, 12 in 2020-11-16T22:09:57.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:57 smithi057 bash[10301]: cluster 2020-11-16T22:09:55.736778+0000 mgr.x (mgr.24115) 519 : cluster [DBG] pgmap v1016: 17 pgs: 17 active+clean; 203 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 3.0 MiB/s wr, 18 op/s 2020-11-16T22:09:57.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:57 smithi057 bash[10301]: cluster 2020-11-16T22:09:56.063014+0000 mon.a (mon.0) 1225 : cluster [DBG] osdmap e568: 12 total, 12 up, 12 in 2020-11-16T22:09:58.070 INFO:tasks.rados.rados.2.smithi057.stdout:2161: done (3 left) 2020-11-16T22:09:58.071 INFO:tasks.rados.rados.2.smithi057.stdout:2162: done (2 left) 2020-11-16T22:09:58.071 INFO:tasks.rados.rados.2.smithi057.stdout:2163: done (1 left) 2020-11-16T22:09:58.071 INFO:tasks.rados.rados.2.smithi057.stdout:2164: done (0 left) 2020-11-16T22:09:58.071 INFO:tasks.rados.rados.2.smithi057.stdout:2165: write (excl) oid 36 current snap is 252 2020-11-16T22:09:58.071 INFO:tasks.rados.rados.2.smithi057.stdout:2165: seq_num 726 ranges {601882=484309,1600633=524904} 2020-11-16T22:09:58.082 INFO:tasks.rados.rados.2.smithi057.stdout:2165: writing smithi05720651-36 from 601882 to 1086191 tid 1 2020-11-16T22:09:58.088 INFO:tasks.rados.rados.2.smithi057.stdout:2165: writing smithi05720651-36 from 1600633 to 2125537 tid 2 2020-11-16T22:09:58.088 INFO:tasks.rados.rados.2.smithi057.stdout:2166: rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 252 2020-11-16T22:09:58.088 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 251 2020-11-16T22:09:58.089 INFO:tasks.rados.rados.2.smithi057.stdout:2167: write oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 252 2020-11-16T22:09:58.089 INFO:tasks.rados.rados.2.smithi057.stdout:2167: seq_num 727 ranges {618689=559558,1659115=559574} 2020-11-16T22:09:58.095 INFO:tasks.rados.rados.2.smithi057.stdout:2167: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 618689 to 1178247 tid 1 2020-11-16T22:09:58.101 INFO:tasks.rados.rados.2.smithi057.stdout:2167: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1659115 to 2218689 tid 2 2020-11-16T22:09:58.101 INFO:tasks.rados.rados.2.smithi057.stdout:2168: delete oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 252 2020-11-16T22:09:58.101 INFO:tasks.rados.rados.2.smithi057.stdout:2165: finishing write tid 1 to smithi05720651-36 2020-11-16T22:09:58.102 INFO:tasks.rados.rados.2.smithi057.stdout:2165: finishing write tid 2 to smithi05720651-36 2020-11-16T22:09:58.102 INFO:tasks.rados.rados.2.smithi057.stdout:2165: finishing write tid 4 to smithi05720651-36 2020-11-16T22:09:58.102 INFO:tasks.rados.rados.2.smithi057.stdout:2165: finishing write tid 5 to smithi05720651-36 2020-11-16T22:09:58.102 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 1370 (ObjNum 726 snap 252 seq_num 726) dirty exists 2020-11-16T22:09:58.102 INFO:tasks.rados.rados.2.smithi057.stdout:2165: left oid 36 (ObjNum 726 snap 252 seq_num 726) 2020-11-16T22:09:58.102 INFO:tasks.rados.rados.2.smithi057.stdout:2166: finishing rollback tid 0 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:58.102 INFO:tasks.rados.rados.2.smithi057.stdout:2166: finishing rollback tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:58.103 INFO:tasks.rados.rados.2.smithi057.stdout:2166: finishing rollback tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:58.103 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1546 (ObjNum 712 snap 249 seq_num 712) dirty exists 2020-11-16T22:09:58.108 INFO:tasks.rados.rados.2.smithi057.stdout:2167: finishing write tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:58.110 INFO:tasks.rados.rados.2.smithi057.stdout:2167: finishing write tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:58.110 INFO:tasks.rados.rados.2.smithi057.stdout:2167: finishing write tid 4 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:58.111 INFO:tasks.rados.rados.2.smithi057.stdout:2167: finishing write tid 5 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:58.111 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1406 (ObjNum 727 snap 252 seq_num 727) dirty exists 2020-11-16T22:09:58.111 INFO:tasks.rados.rados.2.smithi057.stdout:2167: left oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 727 snap 252 seq_num 727) 2020-11-16T22:09:58.112 INFO:tasks.rados.rados.2.smithi057.stdout:2165: done (3 left) 2020-11-16T22:09:58.112 INFO:tasks.rados.rados.2.smithi057.stdout:2166: done (2 left) 2020-11-16T22:09:58.112 INFO:tasks.rados.rados.2.smithi057.stdout:2167: done (1 left) 2020-11-16T22:09:58.112 INFO:tasks.rados.rados.2.smithi057.stdout:2168: done (0 left) 2020-11-16T22:09:58.112 INFO:tasks.rados.rados.2.smithi057.stdout:2169: write oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 252 2020-11-16T22:09:58.112 INFO:tasks.rados.rados.2.smithi057.stdout:2169: seq_num 729 ranges {652303=710056,2059726=192577} 2020-11-16T22:09:58.122 INFO:tasks.rados.rados.2.smithi057.stdout:2169: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 652303 to 1362359 tid 1 2020-11-16T22:09:58.129 INFO:tasks.rados.rados.2.smithi057.stdout:2169: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2059726 to 2252303 tid 2 2020-11-16T22:09:58.129 INFO:tasks.rados.rados.2.smithi057.stdout:2170: delete oid 46 current snap is 252 2020-11-16T22:09:58.129 INFO:tasks.rados.rados.2.smithi057.stdout:2169: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:58.133 INFO:tasks.rados.rados.2.smithi057.stdout:2169: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:58.133 INFO:tasks.rados.rados.2.smithi057.stdout:2169: finishing write tid 4 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:58.134 INFO:tasks.rados.rados.2.smithi057.stdout:2170: done (1 left) 2020-11-16T22:09:58.134 INFO:tasks.rados.rados.2.smithi057.stdout:2171: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 249 2020-11-16T22:09:58.135 INFO:tasks.rados.rados.2.smithi057.stdout:2171: expect (ObjNum 691 snap 242 seq_num 691) 2020-11-16T22:09:58.135 INFO:tasks.rados.rados.2.smithi057.stdout:2172: copy_from oid 16 from oid 14 current snap is 252 2020-11-16T22:09:58.135 INFO:tasks.rados.rados.2.smithi057.stdout:2169: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:58.135 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1697 (ObjNum 729 snap 252 seq_num 729) dirty exists 2020-11-16T22:09:58.135 INFO:tasks.rados.rados.2.smithi057.stdout:2169: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 729 snap 252 seq_num 729) 2020-11-16T22:09:58.135 INFO:tasks.rados.rados.2.smithi057.stdout:2169: done (2 left) 2020-11-16T22:09:58.135 INFO:tasks.rados.rados.2.smithi057.stdout:2173: snap_remove snap 250 2020-11-16T22:09:58.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:58 smithi016 bash[10302]: cluster 2020-11-16T22:09:57.072266+0000 mon.a (mon.0) 1226 : cluster [DBG] osdmap e569: 12 total, 12 up, 12 in 2020-11-16T22:09:58.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:58 smithi195 bash[10218]: cluster 2020-11-16T22:09:57.072266+0000 mon.a (mon.0) 1226 : cluster [DBG] osdmap e569: 12 total, 12 up, 12 in 2020-11-16T22:09:58.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:58 smithi057 bash[10301]: cluster 2020-11-16T22:09:57.072266+0000 mon.a (mon.0) 1226 : cluster [DBG] osdmap e569: 12 total, 12 up, 12 in 2020-11-16T22:09:59.081 INFO:tasks.rados.rados.2.smithi057.stdout:2173: done (2 left) 2020-11-16T22:09:59.081 INFO:tasks.rados.rados.2.smithi057.stdout:2174: write (excl) oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 252 2020-11-16T22:09:59.081 INFO:tasks.rados.rados.2.smithi057.stdout:2174: seq_num 731 ranges {685917=576907,1893043=392874} 2020-11-16T22:09:59.095 INFO:tasks.rados.rados.2.smithi057.stdout:2174: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 685917 to 1262824 tid 1 2020-11-16T22:09:59.101 INFO:tasks.rados.rados.2.smithi057.stdout:2174: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1893043 to 2285917 tid 2 2020-11-16T22:09:59.101 INFO:tasks.rados.rados.2.smithi057.stdout:2175: delete oid 26 current snap is 252 2020-11-16T22:09:59.101 INFO:tasks.rados.rados.2.smithi057.stdout:2171: expect (ObjNum 691 snap 242 seq_num 691) 2020-11-16T22:09:59.328 INFO:tasks.rados.rados.2.smithi057.stdout:2172: finishing copy_from to smithi05720651-16 2020-11-16T22:09:59.328 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 1677 (ObjNum 650 snap 228 seq_num 650) dirty exists 2020-11-16T22:09:59.329 INFO:tasks.rados.rados.2.smithi057.stdout:2172: finishing copy_from racing read to smithi05720651-16 2020-11-16T22:09:59.329 INFO:tasks.rados.rados.2.smithi057.stdout:2174: finishing write tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:59.329 INFO:tasks.rados.rados.2.smithi057.stdout:2174: finishing write tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:59.329 INFO:tasks.rados.rados.2.smithi057.stdout:2174: finishing write tid 4 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:59.329 INFO:tasks.rados.rados.2.smithi057.stdout:2174: finishing write tid 5 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:09:59.329 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1680 (ObjNum 731 snap 252 seq_num 731) dirty exists 2020-11-16T22:09:59.329 INFO:tasks.rados.rados.2.smithi057.stdout:2174: left oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 731 snap 252 seq_num 731) 2020-11-16T22:09:59.330 INFO:tasks.rados.rados.2.smithi057.stdout:2171: done (3 left) 2020-11-16T22:09:59.330 INFO:tasks.rados.rados.2.smithi057.stdout:2172: done (2 left) 2020-11-16T22:09:59.330 INFO:tasks.rados.rados.2.smithi057.stdout:2174: done (1 left) 2020-11-16T22:09:59.330 INFO:tasks.rados.rados.2.smithi057.stdout:2175: done (0 left) 2020-11-16T22:09:59.330 INFO:tasks.rados.rados.2.smithi057.stdout:2176: write oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 252 2020-11-16T22:09:59.330 INFO:tasks.rados.rados.2.smithi057.stdout:2176: seq_num 733 ranges {719531=727405,1893654=425877} 2020-11-16T22:09:59.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:59 smithi016 bash[10302]: cluster 2020-11-16T22:09:57.737510+0000 mgr.x (mgr.24115) 520 : cluster [DBG] pgmap v1019: 17 pgs: 17 active+clean; 208 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 3.8 MiB/s wr, 26 op/s 2020-11-16T22:09:59.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:09:59 smithi016 bash[10302]: cluster 2020-11-16T22:09:58.082142+0000 mon.a (mon.0) 1227 : cluster [DBG] osdmap e570: 12 total, 12 up, 12 in 2020-11-16T22:09:59.342 INFO:tasks.rados.rados.2.smithi057.stdout:2176: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 719531 to 1446936 tid 1 2020-11-16T22:09:59.347 INFO:tasks.rados.rados.2.smithi057.stdout:2176: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1893654 to 2319531 tid 2 2020-11-16T22:09:59.348 INFO:tasks.rados.rados.2.smithi057.stdout:2177: write (excl) oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 252 2020-11-16T22:09:59.348 INFO:tasks.rados.rados.2.smithi057.stdout:2177: seq_num 734 ranges {736338=402654,1552136=539580} 2020-11-16T22:09:59.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:59 smithi195 bash[10218]: cluster 2020-11-16T22:09:57.737510+0000 mgr.x (mgr.24115) 520 : cluster [DBG] pgmap v1019: 17 pgs: 17 active+clean; 208 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 3.8 MiB/s wr, 26 op/s 2020-11-16T22:09:59.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:09:59 smithi195 bash[10218]: cluster 2020-11-16T22:09:58.082142+0000 mon.a (mon.0) 1227 : cluster [DBG] osdmap e570: 12 total, 12 up, 12 in 2020-11-16T22:09:59.354 INFO:tasks.rados.rados.2.smithi057.stdout:2177: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 736338 to 1138992 tid 1 2020-11-16T22:09:59.359 INFO:tasks.rados.rados.2.smithi057.stdout:2177: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1552136 to 2091716 tid 2 2020-11-16T22:09:59.360 INFO:tasks.rados.rados.2.smithi057.stdout:2178: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 251 2020-11-16T22:09:59.360 INFO:tasks.rados.rados.2.smithi057.stdout:2178: expect deleted 2020-11-16T22:09:59.360 INFO:tasks.rados.rados.2.smithi057.stdout:2179: snap_remove snap 248 2020-11-16T22:09:59.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:59 smithi057 bash[10301]: cluster 2020-11-16T22:09:57.737510+0000 mgr.x (mgr.24115) 520 : cluster [DBG] pgmap v1019: 17 pgs: 17 active+clean; 208 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 3.8 MiB/s wr, 26 op/s 2020-11-16T22:09:59.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:09:59 smithi057 bash[10301]: cluster 2020-11-16T22:09:58.082142+0000 mon.a (mon.0) 1227 : cluster [DBG] osdmap e570: 12 total, 12 up, 12 in 2020-11-16T22:10:00.052 INFO:tasks.rados.rados.2.smithi057.stdout:2179: done (3 left) 2020-11-16T22:10:00.052 INFO:tasks.rados.rados.2.smithi057.stdout:2180: delete oid 40 current snap is 252 2020-11-16T22:10:00.053 INFO:tasks.rados.rados.2.smithi057.stdout:2176: finishing write tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:00.053 INFO:tasks.rados.rados.2.smithi057.stdout:2176: finishing write tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:00.053 INFO:tasks.rados.rados.2.smithi057.stdout:2176: finishing write tid 4 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:00.053 INFO:tasks.rados.rados.2.smithi057.stdout:2176: finishing write tid 5 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:00.054 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1683 (ObjNum 733 snap 252 seq_num 733) dirty exists 2020-11-16T22:10:00.054 INFO:tasks.rados.rados.2.smithi057.stdout:2176: left oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 733 snap 252 seq_num 733) 2020-11-16T22:10:00.054 INFO:tasks.rados.rados.2.smithi057.stdout:2177: finishing write tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:00.054 INFO:tasks.rados.rados.2.smithi057.stdout:2177: finishing write tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:00.054 INFO:tasks.rados.rados.2.smithi057.stdout:2177: finishing write tid 4 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:00.054 INFO:tasks.rados.rados.2.smithi057.stdout:2177: finishing write tid 5 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:00.055 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1651 (ObjNum 734 snap 252 seq_num 734) dirty exists 2020-11-16T22:10:00.055 INFO:tasks.rados.rados.2.smithi057.stdout:2177: left oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 734 snap 252 seq_num 734) 2020-11-16T22:10:00.064 INFO:tasks.rados.rados.2.smithi057.stdout:2176: done (3 left) 2020-11-16T22:10:00.065 INFO:tasks.rados.rados.2.smithi057.stdout:2177: done (2 left) 2020-11-16T22:10:00.065 INFO:tasks.rados.rados.2.smithi057.stdout:2178: done (1 left) 2020-11-16T22:10:00.065 INFO:tasks.rados.rados.2.smithi057.stdout:2180: done (0 left) 2020-11-16T22:10:00.065 INFO:tasks.rados.rados.2.smithi057.stdout:2181: snap_create 2020-11-16T22:10:00.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:00 smithi016 bash[10302]: cluster 2020-11-16T22:09:59.092574+0000 mon.a (mon.0) 1228 : cluster [DBG] osdmap e571: 12 total, 12 up, 12 in 2020-11-16T22:10:00.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:00 smithi016 bash[10302]: cluster 2020-11-16T22:10:00.000144+0000 mon.a (mon.0) 1229 : cluster [INF] overall HEALTH_OK 2020-11-16T22:10:00.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:00 smithi016 bash[10302]: cluster 2020-11-16T22:10:00.062697+0000 mon.a (mon.0) 1230 : cluster [DBG] osdmap e572: 12 total, 12 up, 12 in 2020-11-16T22:10:00.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:00 smithi195 bash[10218]: cluster 2020-11-16T22:09:59.092574+0000 mon.a (mon.0) 1228 : cluster [DBG] osdmap e571: 12 total, 12 up, 12 in 2020-11-16T22:10:00.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:00 smithi195 bash[10218]: cluster 2020-11-16T22:10:00.000144+0000 mon.a (mon.0) 1229 : cluster [INF] overall HEALTH_OK 2020-11-16T22:10:00.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:00 smithi195 bash[10218]: cluster 2020-11-16T22:10:00.062697+0000 mon.a (mon.0) 1230 : cluster [DBG] osdmap e572: 12 total, 12 up, 12 in 2020-11-16T22:10:00.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:00 smithi057 bash[10301]: cluster 2020-11-16T22:09:59.092574+0000 mon.a (mon.0) 1228 : cluster [DBG] osdmap e571: 12 total, 12 up, 12 in 2020-11-16T22:10:00.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:00 smithi057 bash[10301]: cluster 2020-11-16T22:10:00.000144+0000 mon.a (mon.0) 1229 : cluster [INF] overall HEALTH_OK 2020-11-16T22:10:00.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:00 smithi057 bash[10301]: cluster 2020-11-16T22:10:00.062697+0000 mon.a (mon.0) 1230 : cluster [DBG] osdmap e572: 12 total, 12 up, 12 in 2020-11-16T22:10:01.065 INFO:tasks.rados.rados.2.smithi057.stdout:2181: done (0 left) 2020-11-16T22:10:01.065 INFO:tasks.rados.rados.2.smithi057.stdout:2182: rollback oid 34 current snap is 253 2020-11-16T22:10:01.065 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 34 to 239 2020-11-16T22:10:01.065 INFO:tasks.rados.rados.2.smithi057.stdout:2183: rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 253 2020-11-16T22:10:01.066 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 236 2020-11-16T22:10:01.066 INFO:tasks.rados.rados.2.smithi057.stdout:2184: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:01.066 INFO:tasks.rados.rados.2.smithi057.stdout:2184: expect (ObjNum 720 snap 250 seq_num 720) 2020-11-16T22:10:01.066 INFO:tasks.rados.rados.2.smithi057.stdout:2185: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:01.066 INFO:tasks.rados.rados.2.smithi057.stdout:2185: expect deleted 2020-11-16T22:10:01.066 INFO:tasks.rados.rados.2.smithi057.stdout:2186: snap_create 2020-11-16T22:10:01.074 INFO:tasks.rados.rados.2.smithi057.stdout:2183: finishing rollback tid 0 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:01.074 INFO:tasks.rados.rados.2.smithi057.stdout:2183: finishing rollback tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:01.075 INFO:tasks.rados.rados.2.smithi057.stdout:2183: finishing rollback tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:01.075 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1549 (ObjNum 647 snap 225 seq_num 647) dirty exists 2020-11-16T22:10:01.078 INFO:tasks.rados.rados.2.smithi057.stdout:2184: expect (ObjNum 720 snap 250 seq_num 720) 2020-11-16T22:10:01.176 INFO:tasks.rados.rados.2.smithi057.stdout:2182: finishing rollback tid 0 to smithi05720651-34 2020-11-16T22:10:01.176 INFO:tasks.rados.rados.2.smithi057.stdout:2182: finishing rollback tid 1 to smithi05720651-34 2020-11-16T22:10:01.176 INFO:tasks.rados.rados.2.smithi057.stdout:2182: finishing rollback tid 2 to smithi05720651-34 2020-11-16T22:10:01.177 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 1543 (ObjNum 658 snap 232 seq_num 658) dirty exists 2020-11-16T22:10:01.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:01 smithi016 bash[10302]: cluster 2020-11-16T22:09:59.738227+0000 mgr.x (mgr.24115) 521 : cluster [DBG] pgmap v1022: 17 pgs: 17 active+clean; 208 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2020-11-16T22:10:01.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:01 smithi016 bash[10302]: cluster 2020-11-16T22:10:01.076327+0000 mon.a (mon.0) 1231 : cluster [DBG] osdmap e573: 12 total, 12 up, 12 in 2020-11-16T22:10:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:01 smithi195 bash[10218]: cluster 2020-11-16T22:09:59.738227+0000 mgr.x (mgr.24115) 521 : cluster [DBG] pgmap v1022: 17 pgs: 17 active+clean; 208 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2020-11-16T22:10:01.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:01 smithi195 bash[10218]: cluster 2020-11-16T22:10:01.076327+0000 mon.a (mon.0) 1231 : cluster [DBG] osdmap e573: 12 total, 12 up, 12 in 2020-11-16T22:10:01.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:01 smithi057 bash[10301]: cluster 2020-11-16T22:09:59.738227+0000 mgr.x (mgr.24115) 521 : cluster [DBG] pgmap v1022: 17 pgs: 17 active+clean; 208 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2020-11-16T22:10:01.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:01 smithi057 bash[10301]: cluster 2020-11-16T22:10:01.076327+0000 mon.a (mon.0) 1231 : cluster [DBG] osdmap e573: 12 total, 12 up, 12 in 2020-11-16T22:10:02.067 INFO:tasks.rados.rados.2.smithi057.stdout:2182: done (4 left) 2020-11-16T22:10:02.068 INFO:tasks.rados.rados.2.smithi057.stdout:2183: done (3 left) 2020-11-16T22:10:02.068 INFO:tasks.rados.rados.2.smithi057.stdout:2184: done (2 left) 2020-11-16T22:10:02.068 INFO:tasks.rados.rados.2.smithi057.stdout:2185: done (1 left) 2020-11-16T22:10:02.068 INFO:tasks.rados.rados.2.smithi057.stdout:2186: done (0 left) 2020-11-16T22:10:02.068 INFO:tasks.rados.rados.2.smithi057.stdout:2187: snap_create 2020-11-16T22:10:03.069 INFO:tasks.rados.rados.2.smithi057.stdout:2187: done (0 left) 2020-11-16T22:10:03.070 INFO:tasks.rados.rados.2.smithi057.stdout:2188: snap_create 2020-11-16T22:10:03.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:03 smithi016 bash[10302]: cluster 2020-11-16T22:10:01.739068+0000 mgr.x (mgr.24115) 522 : cluster [DBG] pgmap v1025: 17 pgs: 17 active+clean; 227 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.8 MiB/s wr, 19 op/s 2020-11-16T22:10:03.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:03 smithi016 bash[10302]: cluster 2020-11-16T22:10:02.078774+0000 mon.a (mon.0) 1232 : cluster [DBG] osdmap e574: 12 total, 12 up, 12 in 2020-11-16T22:10:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:03 smithi195 bash[10218]: cluster 2020-11-16T22:10:01.739068+0000 mgr.x (mgr.24115) 522 : cluster [DBG] pgmap v1025: 17 pgs: 17 active+clean; 227 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.8 MiB/s wr, 19 op/s 2020-11-16T22:10:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:03 smithi195 bash[10218]: cluster 2020-11-16T22:10:02.078774+0000 mon.a (mon.0) 1232 : cluster [DBG] osdmap e574: 12 total, 12 up, 12 in 2020-11-16T22:10:03.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:03 smithi057 bash[10301]: cluster 2020-11-16T22:10:01.739068+0000 mgr.x (mgr.24115) 522 : cluster [DBG] pgmap v1025: 17 pgs: 17 active+clean; 227 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.8 MiB/s wr, 19 op/s 2020-11-16T22:10:03.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:03 smithi057 bash[10301]: cluster 2020-11-16T22:10:02.078774+0000 mon.a (mon.0) 1232 : cluster [DBG] osdmap e574: 12 total, 12 up, 12 in 2020-11-16T22:10:04.071 INFO:tasks.rados.rados.2.smithi057.stdout:2188: done (0 left) 2020-11-16T22:10:04.072 INFO:tasks.rados.rados.2.smithi057.stdout:2189: rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 256 2020-11-16T22:10:04.072 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 245 2020-11-16T22:10:04.072 INFO:tasks.rados.rados.2.smithi057.stdout:2190: write oid 2 current snap is 256 2020-11-16T22:10:04.072 INFO:tasks.rados.rados.2.smithi057.stdout:2190: seq_num 736 ranges {769952=553152,2069100=300852} 2020-11-16T22:10:04.086 INFO:tasks.rados.rados.2.smithi057.stdout:2190: writing smithi05720651-2 from 769952 to 1323104 tid 1 2020-11-16T22:10:04.092 INFO:tasks.rados.rados.2.smithi057.stdout:2190: writing smithi05720651-2 from 2069100 to 2369952 tid 2 2020-11-16T22:10:04.093 INFO:tasks.rados.rados.2.smithi057.stdout:2191: read oid 8 snap -1 2020-11-16T22:10:04.093 INFO:tasks.rados.rados.2.smithi057.stdout:2191: expect deleted 2020-11-16T22:10:04.093 INFO:tasks.rados.rados.2.smithi057.stdout:2192: copy_from oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 256 2020-11-16T22:10:04.093 INFO:tasks.rados.rados.2.smithi057.stdout:2189: finishing rollback tid 0 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:04.093 INFO:tasks.rados.rados.2.smithi057.stdout:2193: write oid 14 current snap is 256 2020-11-16T22:10:04.093 INFO:tasks.rados.rados.2.smithi057.stdout:2193: seq_num 737 ranges {786759=628401,2011229=375530} 2020-11-16T22:10:04.100 INFO:tasks.rados.rados.2.smithi057.stdout:2193: writing smithi05720651-14 from 786759 to 1415160 tid 1 2020-11-16T22:10:04.106 INFO:tasks.rados.rados.2.smithi057.stdout:2193: writing smithi05720651-14 from 2011229 to 2386759 tid 2 2020-11-16T22:10:04.106 INFO:tasks.rados.rados.2.smithi057.stdout:2194: snap_remove snap 253 2020-11-16T22:10:04.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:04 smithi195 bash[10218]: cluster 2020-11-16T22:10:03.080802+0000 mon.a (mon.0) 1233 : cluster [DBG] osdmap e575: 12 total, 12 up, 12 in 2020-11-16T22:10:04.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:04 smithi195 bash[10218]: cluster 2020-11-16T22:10:04.083186+0000 mon.a (mon.0) 1234 : cluster [DBG] osdmap e576: 12 total, 12 up, 12 in 2020-11-16T22:10:04.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:04 smithi057 bash[10301]: cluster 2020-11-16T22:10:03.080802+0000 mon.a (mon.0) 1233 : cluster [DBG] osdmap e575: 12 total, 12 up, 12 in 2020-11-16T22:10:04.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:04 smithi057 bash[10301]: cluster 2020-11-16T22:10:04.083186+0000 mon.a (mon.0) 1234 : cluster [DBG] osdmap e576: 12 total, 12 up, 12 in 2020-11-16T22:10:04.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:04 smithi016 bash[10302]: cluster 2020-11-16T22:10:03.080802+0000 mon.a (mon.0) 1233 : cluster [DBG] osdmap e575: 12 total, 12 up, 12 in 2020-11-16T22:10:04.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:04 smithi016 bash[10302]: cluster 2020-11-16T22:10:04.083186+0000 mon.a (mon.0) 1234 : cluster [DBG] osdmap e576: 12 total, 12 up, 12 in 2020-11-16T22:10:05.054 INFO:tasks.rados.rados.2.smithi057.stdout:2194: done (5 left) 2020-11-16T22:10:05.055 INFO:tasks.rados.rados.2.smithi057.stdout:2195: snap_create 2020-11-16T22:10:05.055 INFO:tasks.rados.rados.2.smithi057.stdout:2189: finishing rollback tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:05.055 INFO:tasks.rados.rados.2.smithi057.stdout:2189: finishing rollback tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:05.055 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1536 (ObjNum 632 snap 220 seq_num 632) dirty exists 2020-11-16T22:10:05.055 INFO:tasks.rados.rados.2.smithi057.stdout:2190: finishing write tid 1 to smithi05720651-2 2020-11-16T22:10:05.055 INFO:tasks.rados.rados.2.smithi057.stdout:2190: finishing write tid 2 to smithi05720651-2 2020-11-16T22:10:05.055 INFO:tasks.rados.rados.2.smithi057.stdout:2190: finishing write tid 4 to smithi05720651-2 2020-11-16T22:10:05.056 INFO:tasks.rados.rados.2.smithi057.stdout:2190: finishing write tid 5 to smithi05720651-2 2020-11-16T22:10:05.056 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 1792 (ObjNum 736 snap 256 seq_num 736) dirty exists 2020-11-16T22:10:05.056 INFO:tasks.rados.rados.2.smithi057.stdout:2190: left oid 2 (ObjNum 736 snap 256 seq_num 736) 2020-11-16T22:10:05.056 INFO:tasks.rados.rados.2.smithi057.stdout:2193: finishing write tid 1 to smithi05720651-14 2020-11-16T22:10:05.056 INFO:tasks.rados.rados.2.smithi057.stdout:2193: finishing write tid 2 to smithi05720651-14 2020-11-16T22:10:05.056 INFO:tasks.rados.rados.2.smithi057.stdout:2193: finishing write tid 4 to smithi05720651-14 2020-11-16T22:10:05.056 INFO:tasks.rados.rados.2.smithi057.stdout:2193: finishing write tid 5 to smithi05720651-14 2020-11-16T22:10:05.057 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 1796 (ObjNum 737 snap 256 seq_num 737) dirty exists 2020-11-16T22:10:05.057 INFO:tasks.rados.rados.2.smithi057.stdout:2193: left oid 14 (ObjNum 737 snap 256 seq_num 737) 2020-11-16T22:10:05.057 INFO:tasks.rados.rados.2.smithi057.stdout:2192: finishing copy_from to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:05.057 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 111 (ObjNum 674 snap 236 seq_num 674) dirty exists 2020-11-16T22:10:05.057 INFO:tasks.rados.rados.2.smithi057.stdout:2192: finishing copy_from racing read to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:05.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:05 smithi195 bash[10218]: cluster 2020-11-16T22:10:03.739822+0000 mgr.x (mgr.24115) 523 : cluster [DBG] pgmap v1028: 17 pgs: 17 active+clean; 230 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.8 MiB/s wr, 21 op/s 2020-11-16T22:10:05.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:05 smithi195 bash[10218]: cluster 2020-11-16T22:10:05.065479+0000 mon.a (mon.0) 1235 : cluster [DBG] osdmap e577: 12 total, 12 up, 12 in 2020-11-16T22:10:05.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:05 smithi057 bash[10301]: cluster 2020-11-16T22:10:03.739822+0000 mgr.x (mgr.24115) 523 : cluster [DBG] pgmap v1028: 17 pgs: 17 active+clean; 230 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.8 MiB/s wr, 21 op/s 2020-11-16T22:10:05.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:05 smithi057 bash[10301]: cluster 2020-11-16T22:10:05.065479+0000 mon.a (mon.0) 1235 : cluster [DBG] osdmap e577: 12 total, 12 up, 12 in 2020-11-16T22:10:05.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:05 smithi016 bash[10302]: cluster 2020-11-16T22:10:03.739822+0000 mgr.x (mgr.24115) 523 : cluster [DBG] pgmap v1028: 17 pgs: 17 active+clean; 230 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.8 MiB/s wr, 21 op/s 2020-11-16T22:10:05.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:05 smithi016 bash[10302]: cluster 2020-11-16T22:10:05.065479+0000 mon.a (mon.0) 1235 : cluster [DBG] osdmap e577: 12 total, 12 up, 12 in 2020-11-16T22:10:06.055 INFO:tasks.rados.rados.2.smithi057.stdout:2189: done (5 left) 2020-11-16T22:10:06.055 INFO:tasks.rados.rados.2.smithi057.stdout:2190: done (4 left) 2020-11-16T22:10:06.055 INFO:tasks.rados.rados.2.smithi057.stdout:2191: done (3 left) 2020-11-16T22:10:06.055 INFO:tasks.rados.rados.2.smithi057.stdout:2192: done (2 left) 2020-11-16T22:10:06.056 INFO:tasks.rados.rados.2.smithi057.stdout:2193: done (1 left) 2020-11-16T22:10:06.056 INFO:tasks.rados.rados.2.smithi057.stdout:2195: done (0 left) 2020-11-16T22:10:06.056 INFO:tasks.rados.rados.2.smithi057.stdout:2196: snap_remove snap 234 2020-11-16T22:10:07.058 INFO:tasks.rados.rados.2.smithi057.stdout:2196: done (0 left) 2020-11-16T22:10:07.058 INFO:tasks.rados.rados.2.smithi057.stdout:2197: snap_remove snap 239 2020-11-16T22:10:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:07 smithi016 bash[10302]: cluster 2020-11-16T22:10:05.740538+0000 mgr.x (mgr.24115) 524 : cluster [DBG] pgmap v1031: 17 pgs: 17 active+clean; 230 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 0 B/s wr, 2 op/s 2020-11-16T22:10:07.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:07 smithi016 bash[10302]: cluster 2020-11-16T22:10:06.066654+0000 mon.a (mon.0) 1236 : cluster [DBG] osdmap e578: 12 total, 12 up, 12 in 2020-11-16T22:10:07.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:07 smithi195 bash[10218]: cluster 2020-11-16T22:10:05.740538+0000 mgr.x (mgr.24115) 524 : cluster [DBG] pgmap v1031: 17 pgs: 17 active+clean; 230 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 0 B/s wr, 2 op/s 2020-11-16T22:10:07.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:07 smithi195 bash[10218]: cluster 2020-11-16T22:10:06.066654+0000 mon.a (mon.0) 1236 : cluster [DBG] osdmap e578: 12 total, 12 up, 12 in 2020-11-16T22:10:07.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:07 smithi057 bash[10301]: cluster 2020-11-16T22:10:05.740538+0000 mgr.x (mgr.24115) 524 : cluster [DBG] pgmap v1031: 17 pgs: 17 active+clean; 230 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 0 B/s wr, 2 op/s 2020-11-16T22:10:07.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:07 smithi057 bash[10301]: cluster 2020-11-16T22:10:06.066654+0000 mon.a (mon.0) 1236 : cluster [DBG] osdmap e578: 12 total, 12 up, 12 in 2020-11-16T22:10:07.945 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:10:07 smithi057 bash[12595]: debug 2020-11-16T22:10:07.540+0000 7f737d1a4700 -1 osd.8 pg_epoch: 579 pg[2.5( v 572'1098 (0'0,572'1098] local-lis/les=71/72 n=10 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,0] r=0 lpr=71 crt=572'1098 lcod 572'1096 mlcod 572'1096 active+clean+snaptrim trimq=[1d4~1] ps=[1e7~1,1f2~1]] removing snap head 2020-11-16T22:10:07.945 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:10:07 smithi057 bash[19569]: debug 2020-11-16T22:10:07.540+0000 7f5e0d10d700 -1 osd.11 pg_epoch: 579 pg[2.c( v 572'380 (0'0,572'380] local-lis/les=71/72 n=4 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [11,0] r=0 lpr=71 crt=572'380 lcod 568'378 mlcod 568'378 active+clean+snaptrim trimq=[1d4~1] ps=[1e7~1,1f2~1]] removing snap head 2020-11-16T22:10:08.060 INFO:tasks.rados.rados.2.smithi057.stdout:2197: done (0 left) 2020-11-16T22:10:08.061 INFO:tasks.rados.rados.2.smithi057.stdout:2198: write oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 257 2020-11-16T22:10:08.061 INFO:tasks.rados.rados.2.smithi057.stdout:2198: seq_num 738 ranges {403566=420003,1386064=546918} 2020-11-16T22:10:08.070 INFO:tasks.rados.rados.2.smithi057.stdout:2198: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 403566 to 823569 tid 1 2020-11-16T22:10:08.078 INFO:tasks.rados.rados.2.smithi057.stdout:2198: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1386064 to 1932982 tid 2 2020-11-16T22:10:08.078 INFO:tasks.rados.rados.2.smithi057.stdout:2199: read oid 30 snap 256 2020-11-16T22:10:08.078 INFO:tasks.rados.rados.2.smithi057.stdout:2199: expect (ObjNum 616 snap 216 seq_num 616) 2020-11-16T22:10:08.078 INFO:tasks.rados.rados.2.smithi057.stdout:2200: write oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 257 2020-11-16T22:10:08.078 INFO:tasks.rados.rados.2.smithi057.stdout:2200: seq_num 739 ranges {420373=495252,1444546=690576} 2020-11-16T22:10:08.083 INFO:tasks.rados.rados.2.smithi057.stdout:2200: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 420373 to 915625 tid 1 2020-11-16T22:10:08.090 INFO:tasks.rados.rados.2.smithi057.stdout:2200: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1444546 to 2135122 tid 2 2020-11-16T22:10:08.091 INFO:tasks.rados.rados.2.smithi057.stdout:2201: copy_from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 257 2020-11-16T22:10:08.091 INFO:tasks.rados.rados.2.smithi057.stdout:2198: finishing write tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:08.091 INFO:tasks.rados.rados.2.smithi057.stdout:2198: finishing write tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:08.091 INFO:tasks.rados.rados.2.smithi057.stdout:2198: finishing write tid 4 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:08.091 INFO:tasks.rados.rados.2.smithi057.stdout:2198: finishing write tid 5 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:08.092 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1686 (ObjNum 738 snap 257 seq_num 738) dirty exists 2020-11-16T22:10:08.092 INFO:tasks.rados.rados.2.smithi057.stdout:2198: left oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 738 snap 257 seq_num 738) 2020-11-16T22:10:08.092 INFO:tasks.rados.rados.2.smithi057.stdout:2198: done (3 left) 2020-11-16T22:10:08.092 INFO:tasks.rados.rados.2.smithi057.stdout:2202: write (excl) oid 20 current snap is 257 2020-11-16T22:10:08.092 INFO:tasks.rados.rados.2.smithi057.stdout:2202: seq_num 740 ranges {437180=570501,1503028=550587} 2020-11-16T22:10:08.096 INFO:tasks.rados.rados.2.smithi057.stdout:2202: writing smithi05720651-20 from 437180 to 1007681 tid 1 2020-11-16T22:10:08.103 INFO:tasks.rados.rados.2.smithi057.stdout:2202: writing smithi05720651-20 from 1503028 to 2053615 tid 2 2020-11-16T22:10:08.103 INFO:tasks.rados.rados.2.smithi057.stdout:2203: snap_remove snap 247 2020-11-16T22:10:08.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:08 smithi016 bash[10302]: cluster 2020-11-16T22:10:07.069320+0000 mon.a (mon.0) 1237 : cluster [DBG] osdmap e579: 12 total, 12 up, 12 in 2020-11-16T22:10:08.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:08 smithi016 bash[10302]: cluster 2020-11-16T22:10:08.072160+0000 mon.a (mon.0) 1238 : cluster [DBG] osdmap e580: 12 total, 12 up, 12 in 2020-11-16T22:10:08.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:08 smithi195 bash[10218]: cluster 2020-11-16T22:10:07.069320+0000 mon.a (mon.0) 1237 : cluster [DBG] osdmap e579: 12 total, 12 up, 12 in 2020-11-16T22:10:08.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:08 smithi195 bash[10218]: cluster 2020-11-16T22:10:08.072160+0000 mon.a (mon.0) 1238 : cluster [DBG] osdmap e580: 12 total, 12 up, 12 in 2020-11-16T22:10:08.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:08 smithi057 bash[10301]: cluster 2020-11-16T22:10:07.069320+0000 mon.a (mon.0) 1237 : cluster [DBG] osdmap e579: 12 total, 12 up, 12 in 2020-11-16T22:10:08.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:08 smithi057 bash[10301]: cluster 2020-11-16T22:10:08.072160+0000 mon.a (mon.0) 1238 : cluster [DBG] osdmap e580: 12 total, 12 up, 12 in 2020-11-16T22:10:09.083 INFO:tasks.rados.rados.2.smithi057.stdout:2203: done (4 left) 2020-11-16T22:10:09.084 INFO:tasks.rados.rados.2.smithi057.stdout:2204: snap_create 2020-11-16T22:10:09.084 INFO:tasks.rados.rados.2.smithi057.stdout:2199: expect (ObjNum 616 snap 216 seq_num 616) 2020-11-16T22:10:09.233 INFO:tasks.rados.rados.2.smithi057.stdout:2200: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:09.233 INFO:tasks.rados.rados.2.smithi057.stdout:2200: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:09.233 INFO:tasks.rados.rados.2.smithi057.stdout:2200: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:09.234 INFO:tasks.rados.rados.2.smithi057.stdout:2200: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:09.234 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1721 (ObjNum 739 snap 257 seq_num 739) dirty exists 2020-11-16T22:10:09.234 INFO:tasks.rados.rados.2.smithi057.stdout:2200: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 739 snap 257 seq_num 739) 2020-11-16T22:10:09.234 INFO:tasks.rados.rados.2.smithi057.stdout:2202: finishing write tid 1 to smithi05720651-20 2020-11-16T22:10:09.234 INFO:tasks.rados.rados.2.smithi057.stdout:2202: finishing write tid 2 to smithi05720651-20 2020-11-16T22:10:09.234 INFO:tasks.rados.rados.2.smithi057.stdout:2202: finishing write tid 4 to smithi05720651-20 2020-11-16T22:10:09.235 INFO:tasks.rados.rados.2.smithi057.stdout:2201: finishing copy_from to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:09.235 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1697 (ObjNum 729 snap 252 seq_num 729) dirty exists 2020-11-16T22:10:09.235 INFO:tasks.rados.rados.2.smithi057.stdout:2201: finishing copy_from racing read to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:09.235 INFO:tasks.rados.rados.2.smithi057.stdout:2202: finishing write tid 5 to smithi05720651-20 2020-11-16T22:10:09.235 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1546 (ObjNum 740 snap 257 seq_num 740) dirty exists 2020-11-16T22:10:09.235 INFO:tasks.rados.rados.2.smithi057.stdout:2202: left oid 20 (ObjNum 740 snap 257 seq_num 740) 2020-11-16T22:10:09.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:09 smithi016 bash[10302]: cluster 2020-11-16T22:10:07.741273+0000 mgr.x (mgr.24115) 525 : cluster [DBG] pgmap v1034: 17 pgs: 17 active+clean; 232 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.2 MiB/s wr, 3 op/s 2020-11-16T22:10:09.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:09 smithi195 bash[10218]: cluster 2020-11-16T22:10:07.741273+0000 mgr.x (mgr.24115) 525 : cluster [DBG] pgmap v1034: 17 pgs: 17 active+clean; 232 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.2 MiB/s wr, 3 op/s 2020-11-16T22:10:09.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:09 smithi057 bash[10301]: cluster 2020-11-16T22:10:07.741273+0000 mgr.x (mgr.24115) 525 : cluster [DBG] pgmap v1034: 17 pgs: 17 active+clean; 232 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.2 MiB/s wr, 3 op/s 2020-11-16T22:10:10.055 INFO:tasks.rados.rados.2.smithi057.stdout:2199: done (4 left) 2020-11-16T22:10:10.056 INFO:tasks.rados.rados.2.smithi057.stdout:2200: done (3 left) 2020-11-16T22:10:10.056 INFO:tasks.rados.rados.2.smithi057.stdout:2201: done (2 left) 2020-11-16T22:10:10.056 INFO:tasks.rados.rados.2.smithi057.stdout:2202: done (1 left) 2020-11-16T22:10:10.056 INFO:tasks.rados.rados.2.smithi057.stdout:2204: done (0 left) 2020-11-16T22:10:10.056 INFO:tasks.rados.rados.2.smithi057.stdout:2205: read oid 40 snap -1 2020-11-16T22:10:10.057 INFO:tasks.rados.rados.2.smithi057.stdout:2205: expect deleted 2020-11-16T22:10:10.057 INFO:tasks.rados.rados.2.smithi057.stdout:2206: copy_from oid 14 from oid 8 current snap is 258 2020-11-16T22:10:10.057 INFO:tasks.rados.rados.2.smithi057.stdout:2207: write oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 258 2020-11-16T22:10:10.057 INFO:tasks.rados.rados.2.smithi057.stdout:2207: seq_num 741 ranges {453987=645750,1845157=608830} 2020-11-16T22:10:10.069 INFO:tasks.rados.rados.2.smithi057.stdout:2207: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 453987 to 1099737 tid 1 2020-11-16T22:10:10.077 INFO:tasks.rados.rados.2.smithi057.stdout:2207: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1845157 to 2453987 tid 2 2020-11-16T22:10:10.078 INFO:tasks.rados.rados.2.smithi057.stdout:2208: read oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:10.078 INFO:tasks.rados.rados.2.smithi057.stdout:2208: expect (ObjNum 678 snap 236 seq_num 678) 2020-11-16T22:10:10.078 INFO:tasks.rados.rados.2.smithi057.stdout:2209: snap_remove snap 252 2020-11-16T22:10:10.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:10 smithi195 bash[10218]: cluster 2020-11-16T22:10:09.093804+0000 mon.a (mon.0) 1239 : cluster [DBG] osdmap e581: 12 total, 12 up, 12 in 2020-11-16T22:10:10.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:10 smithi195 bash[10218]: cluster 2020-11-16T22:10:10.066326+0000 mon.a (mon.0) 1240 : cluster [DBG] osdmap e582: 12 total, 12 up, 12 in 2020-11-16T22:10:10.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:10 smithi057 bash[10301]: cluster 2020-11-16T22:10:09.093804+0000 mon.a (mon.0) 1239 : cluster [DBG] osdmap e581: 12 total, 12 up, 12 in 2020-11-16T22:10:10.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:10 smithi057 bash[10301]: cluster 2020-11-16T22:10:10.066326+0000 mon.a (mon.0) 1240 : cluster [DBG] osdmap e582: 12 total, 12 up, 12 in 2020-11-16T22:10:10.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:10 smithi016 bash[10302]: cluster 2020-11-16T22:10:09.093804+0000 mon.a (mon.0) 1239 : cluster [DBG] osdmap e581: 12 total, 12 up, 12 in 2020-11-16T22:10:10.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:10 smithi016 bash[10302]: cluster 2020-11-16T22:10:10.066326+0000 mon.a (mon.0) 1240 : cluster [DBG] osdmap e582: 12 total, 12 up, 12 in 2020-11-16T22:10:11.067 INFO:tasks.rados.rados.2.smithi057.stdout:2209: done (4 left) 2020-11-16T22:10:11.067 INFO:tasks.rados.rados.2.smithi057.stdout:2210: snap_remove snap 241 2020-11-16T22:10:11.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:11 smithi195 bash[10218]: cluster 2020-11-16T22:10:09.741907+0000 mgr.x (mgr.24115) 526 : cluster [DBG] pgmap v1037: 17 pgs: 17 active+clean; 232 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.2 MiB/s wr, 2 op/s 2020-11-16T22:10:11.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:11 smithi195 bash[10218]: cluster 2020-11-16T22:10:11.078457+0000 mon.a (mon.0) 1241 : cluster [DBG] osdmap e583: 12 total, 12 up, 12 in 2020-11-16T22:10:11.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:11 smithi057 bash[10301]: cluster 2020-11-16T22:10:09.741907+0000 mgr.x (mgr.24115) 526 : cluster [DBG] pgmap v1037: 17 pgs: 17 active+clean; 232 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.2 MiB/s wr, 2 op/s 2020-11-16T22:10:11.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:11 smithi057 bash[10301]: cluster 2020-11-16T22:10:11.078457+0000 mon.a (mon.0) 1241 : cluster [DBG] osdmap e583: 12 total, 12 up, 12 in 2020-11-16T22:10:11.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:11 smithi016 bash[10302]: cluster 2020-11-16T22:10:09.741907+0000 mgr.x (mgr.24115) 526 : cluster [DBG] pgmap v1037: 17 pgs: 17 active+clean; 232 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.2 MiB/s wr, 2 op/s 2020-11-16T22:10:11.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:11 smithi016 bash[10302]: cluster 2020-11-16T22:10:11.078457+0000 mon.a (mon.0) 1241 : cluster [DBG] osdmap e583: 12 total, 12 up, 12 in 2020-11-16T22:10:12.069 INFO:tasks.rados.rados.2.smithi057.stdout:2210: done (4 left) 2020-11-16T22:10:12.069 INFO:tasks.rados.rados.2.smithi057.stdout:2211: write oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 258 2020-11-16T22:10:12.069 INFO:tasks.rados.rados.2.smithi057.stdout:2211: seq_num 742 ranges {470794=720999,1903639=554256} 2020-11-16T22:10:12.080 INFO:tasks.rados.rados.2.smithi057.stdout:2211: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 470794 to 1191793 tid 1 2020-11-16T22:10:12.089 INFO:tasks.rados.rados.2.smithi057.stdout:2211: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1903639 to 2457895 tid 2 2020-11-16T22:10:12.089 INFO:tasks.rados.rados.2.smithi057.stdout:2212: copy_from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 32 current snap is 258 2020-11-16T22:10:12.089 INFO:tasks.rados.rados.2.smithi057.stdout:2213: snap_create 2020-11-16T22:10:12.090 INFO:tasks.rados.rados.2.smithi057.stdout:2206: finishing copy_from to smithi05720651-14 2020-11-16T22:10:12.091 INFO:tasks.rados.rados.2.smithi057.stdout:2206: got expected ENOENT (src dne) 2020-11-16T22:10:12.091 INFO:tasks.rados.rados.2.smithi057.stdout:2206: finishing copy_from racing read to smithi05720651-14 2020-11-16T22:10:12.091 INFO:tasks.rados.rados.2.smithi057.stdout:2207: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:12.091 INFO:tasks.rados.rados.2.smithi057.stdout:2207: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:12.092 INFO:tasks.rados.rados.2.smithi057.stdout:2207: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:12.092 INFO:tasks.rados.rados.2.smithi057.stdout:2207: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:12.092 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1724 (ObjNum 741 snap 258 seq_num 741) dirty exists 2020-11-16T22:10:12.092 INFO:tasks.rados.rados.2.smithi057.stdout:2207: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 741 snap 258 seq_num 741) 2020-11-16T22:10:12.093 INFO:tasks.rados.rados.2.smithi057.stdout:2208: expect (ObjNum 678 snap 236 seq_num 678) 2020-11-16T22:10:12.199 INFO:tasks.rados.rados.2.smithi057.stdout:2211: finishing write tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:12.200 INFO:tasks.rados.rados.2.smithi057.stdout:2211: finishing write tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:12.200 INFO:tasks.rados.rados.2.smithi057.stdout:2211: finishing write tid 4 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:12.200 INFO:tasks.rados.rados.2.smithi057.stdout:2211: finishing write tid 5 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:12.200 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1373 (ObjNum 742 snap 258 seq_num 742) dirty exists 2020-11-16T22:10:12.200 INFO:tasks.rados.rados.2.smithi057.stdout:2211: left oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 742 snap 258 seq_num 742) 2020-11-16T22:10:12.201 INFO:tasks.rados.rados.2.smithi057.stdout:2212: finishing copy_from to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:12.201 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1738 (ObjNum 706 snap 249 seq_num 706) dirty exists 2020-11-16T22:10:12.201 INFO:tasks.rados.rados.2.smithi057.stdout:2212: finishing copy_from racing read to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:13.071 INFO:tasks.rados.rados.2.smithi057.stdout:2205: done (6 left) 2020-11-16T22:10:13.072 INFO:tasks.rados.rados.2.smithi057.stdout:2206: done (5 left) 2020-11-16T22:10:13.072 INFO:tasks.rados.rados.2.smithi057.stdout:2207: done (4 left) 2020-11-16T22:10:13.072 INFO:tasks.rados.rados.2.smithi057.stdout:2208: done (3 left) 2020-11-16T22:10:13.072 INFO:tasks.rados.rados.2.smithi057.stdout:2211: done (2 left) 2020-11-16T22:10:13.072 INFO:tasks.rados.rados.2.smithi057.stdout:2212: done (1 left) 2020-11-16T22:10:13.072 INFO:tasks.rados.rados.2.smithi057.stdout:2213: done (0 left) 2020-11-16T22:10:13.073 INFO:tasks.rados.rados.2.smithi057.stdout:2214: read oid 24 snap -1 2020-11-16T22:10:13.073 INFO:tasks.rados.rados.2.smithi057.stdout:2214: expect (ObjNum 679 snap 236 seq_num 679) 2020-11-16T22:10:13.073 INFO:tasks.rados.rados.2.smithi057.stdout:2215: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:13.073 INFO:tasks.rados.rados.2.smithi057.stdout:2215: expect (ObjNum 724 snap 251 seq_num 724) 2020-11-16T22:10:13.073 INFO:tasks.rados.rados.2.smithi057.stdout:2216: write oid 46 current snap is 259 2020-11-16T22:10:13.073 INFO:tasks.rados.rados.2.smithi057.stdout:2216: seq_num 743 ranges {487601=796248,1962121=525480} 2020-11-16T22:10:13.085 INFO:tasks.rados.rados.2.smithi057.stdout:2216: writing smithi05720651-46 from 487601 to 1283849 tid 1 2020-11-16T22:10:13.094 INFO:tasks.rados.rados.2.smithi057.stdout:2216: writing smithi05720651-46 from 1962121 to 2487601 tid 2 2020-11-16T22:10:13.094 INFO:tasks.rados.rados.2.smithi057.stdout:2217: write (excl) oid 40 current snap is 259 2020-11-16T22:10:13.094 INFO:tasks.rados.rados.2.smithi057.stdout:2217: seq_num 744 ranges {504408=471497,1620603=557925} 2020-11-16T22:10:13.099 INFO:tasks.rados.rados.2.smithi057.stdout:2217: writing smithi05720651-40 from 504408 to 975905 tid 1 2020-11-16T22:10:13.106 INFO:tasks.rados.rados.2.smithi057.stdout:2217: writing smithi05720651-40 from 1620603 to 2178528 tid 2 2020-11-16T22:10:13.106 INFO:tasks.rados.rados.2.smithi057.stdout:2218: snap_create 2020-11-16T22:10:13.107 INFO:tasks.rados.rados.2.smithi057.stdout:2215: expect (ObjNum 724 snap 251 seq_num 724) 2020-11-16T22:10:13.316 INFO:tasks.rados.rados.2.smithi057.stdout:2214: expect (ObjNum 679 snap 236 seq_num 679) 2020-11-16T22:10:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:13 smithi195 bash[10218]: cluster 2020-11-16T22:10:11.742759+0000 mgr.x (mgr.24115) 527 : cluster [DBG] pgmap v1040: 17 pgs: 17 active+clean; 208 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 1.3 MiB/s wr, 8 op/s 2020-11-16T22:10:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:13 smithi195 bash[10218]: cluster 2020-11-16T22:10:12.079878+0000 mon.a (mon.0) 1242 : cluster [DBG] osdmap e584: 12 total, 12 up, 12 in 2020-11-16T22:10:13.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:13 smithi057 bash[10301]: cluster 2020-11-16T22:10:11.742759+0000 mgr.x (mgr.24115) 527 : cluster [DBG] pgmap v1040: 17 pgs: 17 active+clean; 208 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 1.3 MiB/s wr, 8 op/s 2020-11-16T22:10:13.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:13 smithi057 bash[10301]: cluster 2020-11-16T22:10:12.079878+0000 mon.a (mon.0) 1242 : cluster [DBG] osdmap e584: 12 total, 12 up, 12 in 2020-11-16T22:10:13.511 INFO:tasks.rados.rados.2.smithi057.stdout:2216: finishing write tid 1 to smithi05720651-46 2020-11-16T22:10:13.512 INFO:tasks.rados.rados.2.smithi057.stdout:2216: finishing write tid 2 to smithi05720651-46 2020-11-16T22:10:13.512 INFO:tasks.rados.rados.2.smithi057.stdout:2216: finishing write tid 4 to smithi05720651-46 2020-11-16T22:10:13.512 INFO:tasks.rados.rados.2.smithi057.stdout:2216: finishing write tid 5 to smithi05720651-46 2020-11-16T22:10:13.512 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 1689 (ObjNum 743 snap 259 seq_num 743) dirty exists 2020-11-16T22:10:13.512 INFO:tasks.rados.rados.2.smithi057.stdout:2216: left oid 46 (ObjNum 743 snap 259 seq_num 743) 2020-11-16T22:10:13.512 INFO:tasks.rados.rados.2.smithi057.stdout:2217: finishing write tid 1 to smithi05720651-40 2020-11-16T22:10:13.512 INFO:tasks.rados.rados.2.smithi057.stdout:2217: finishing write tid 2 to smithi05720651-40 2020-11-16T22:10:13.513 INFO:tasks.rados.rados.2.smithi057.stdout:2217: finishing write tid 4 to smithi05720651-40 2020-11-16T22:10:13.513 INFO:tasks.rados.rados.2.smithi057.stdout:2217: finishing write tid 5 to smithi05720651-40 2020-11-16T22:10:13.513 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 1863 (ObjNum 744 snap 259 seq_num 744) dirty exists 2020-11-16T22:10:13.513 INFO:tasks.rados.rados.2.smithi057.stdout:2217: left oid 40 (ObjNum 744 snap 259 seq_num 744) 2020-11-16T22:10:13.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:13 smithi016 bash[10302]: cluster 2020-11-16T22:10:11.742759+0000 mgr.x (mgr.24115) 527 : cluster [DBG] pgmap v1040: 17 pgs: 17 active+clean; 208 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 1.3 MiB/s wr, 8 op/s 2020-11-16T22:10:13.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:13 smithi016 bash[10302]: cluster 2020-11-16T22:10:12.079878+0000 mon.a (mon.0) 1242 : cluster [DBG] osdmap e584: 12 total, 12 up, 12 in 2020-11-16T22:10:14.106 INFO:tasks.rados.rados.2.smithi057.stdout:2214: done (4 left) 2020-11-16T22:10:14.107 INFO:tasks.rados.rados.2.smithi057.stdout:2215: done (3 left) 2020-11-16T22:10:14.107 INFO:tasks.rados.rados.2.smithi057.stdout:2216: done (2 left) 2020-11-16T22:10:14.107 INFO:tasks.rados.rados.2.smithi057.stdout:2217: done (1 left) 2020-11-16T22:10:14.107 INFO:tasks.rados.rados.2.smithi057.stdout:2218: done (0 left) 2020-11-16T22:10:14.107 INFO:tasks.rados.rados.2.smithi057.stdout:2219: delete oid 24 current snap is 260 2020-11-16T22:10:14.114 INFO:tasks.rados.rados.2.smithi057.stdout:2219: done (0 left) 2020-11-16T22:10:14.114 INFO:tasks.rados.rados.2.smithi057.stdout:2220: read oid 36 snap -1 2020-11-16T22:10:14.115 INFO:tasks.rados.rados.2.smithi057.stdout:2220: expect (ObjNum 726 snap 252 seq_num 726) 2020-11-16T22:10:14.115 INFO:tasks.rados.rados.2.smithi057.stdout:2221: read oid 48 snap -1 2020-11-16T22:10:14.115 INFO:tasks.rados.rados.2.smithi057.stdout:2221: expect deleted 2020-11-16T22:10:14.115 INFO:tasks.rados.rados.2.smithi057.stdout:2222: delete oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 260 2020-11-16T22:10:14.126 INFO:tasks.rados.rados.2.smithi057.stdout:2220: expect (ObjNum 726 snap 252 seq_num 726) 2020-11-16T22:10:14.198 INFO:tasks.rados.rados.2.smithi057.stdout:2220: done (2 left) 2020-11-16T22:10:14.198 INFO:tasks.rados.rados.2.smithi057.stdout:2221: done (1 left) 2020-11-16T22:10:14.198 INFO:tasks.rados.rados.2.smithi057.stdout:2222: done (0 left) 2020-11-16T22:10:14.198 INFO:tasks.rados.rados.2.smithi057.stdout:2223: rollback oid 24 current snap is 260 2020-11-16T22:10:14.198 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 24 to 256 2020-11-16T22:10:14.198 INFO:tasks.rados.rados.2.smithi057.stdout:2224: rollback oid 12 current snap is 260 2020-11-16T22:10:14.199 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 12 to 254 2020-11-16T22:10:14.199 INFO:tasks.rados.rados.2.smithi057.stdout:2225: delete oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 260 2020-11-16T22:10:14.201 INFO:tasks.rados.rados.2.smithi057.stdout:2224: finishing rollback tid 1 to smithi05720651-12 2020-11-16T22:10:14.202 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 0 (ObjNum 385 snap 0 seq_num 2932402144) dirty dne 2020-11-16T22:10:14.202 INFO:tasks.rados.rados.2.smithi057.stdout:2224: done (2 left) 2020-11-16T22:10:14.202 INFO:tasks.rados.rados.2.smithi057.stdout:2225: done (1 left) 2020-11-16T22:10:14.202 INFO:tasks.rados.rados.2.smithi057.stdout:2226: write oid 12 current snap is 260 2020-11-16T22:10:14.203 INFO:tasks.rados.rados.2.smithi057.stdout:2226: seq_num 748 ranges {571636=488846,1854531=565263} 2020-11-16T22:10:14.214 INFO:tasks.rados.rados.2.smithi057.stdout:2226: writing smithi05720651-12 from 571636 to 1060482 tid 1 2020-11-16T22:10:14.222 INFO:tasks.rados.rados.2.smithi057.stdout:2226: writing smithi05720651-12 from 1854531 to 2419794 tid 2 2020-11-16T22:10:14.222 INFO:tasks.rados.rados.2.smithi057.stdout:2227: read oid 36 snap 258 2020-11-16T22:10:14.222 INFO:tasks.rados.rados.2.smithi057.stdout:2227: expect (ObjNum 726 snap 252 seq_num 726) 2020-11-16T22:10:14.222 INFO:tasks.rados.rados.2.smithi057.stdout:2228: delete oid 6 current snap is 260 2020-11-16T22:10:14.223 INFO:tasks.rados.rados.2.smithi057.stdout:2223: finishing rollback tid 1 to smithi05720651-24 2020-11-16T22:10:14.223 INFO:tasks.rados.rados.2.smithi057.stdout:2223: finishing rollback tid 2 to smithi05720651-24 2020-11-16T22:10:14.223 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 1558 (ObjNum 679 snap 236 seq_num 679) dirty exists 2020-11-16T22:10:14.223 INFO:tasks.rados.rados.2.smithi057.stdout:2226: finishing write tid 1 to smithi05720651-12 2020-11-16T22:10:14.226 INFO:tasks.rados.rados.2.smithi057.stdout:2227: expect (ObjNum 726 snap 252 seq_num 726) 2020-11-16T22:10:14.299 INFO:tasks.rados.rados.2.smithi057.stdout:2226: finishing write tid 2 to smithi05720651-12 2020-11-16T22:10:14.300 INFO:tasks.rados.rados.2.smithi057.stdout:2223: done (3 left) 2020-11-16T22:10:14.300 INFO:tasks.rados.rados.2.smithi057.stdout:2227: done (2 left) 2020-11-16T22:10:14.300 INFO:tasks.rados.rados.2.smithi057.stdout:2228: done (1 left) 2020-11-16T22:10:14.300 INFO:tasks.rados.rados.2.smithi057.stdout:2229: rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 260 2020-11-16T22:10:14.300 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 257 2020-11-16T22:10:14.301 INFO:tasks.rados.rados.2.smithi057.stdout:2230: delete oid 26 current snap is 260 2020-11-16T22:10:14.303 INFO:tasks.rados.rados.2.smithi057.stdout:2229: finishing rollback tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:14.304 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1554 (ObjNum 1869573999 snap 28527 seq_num 336) dirty dne 2020-11-16T22:10:14.308 INFO:tasks.rados.rados.2.smithi057.stdout:2229: done (2 left) 2020-11-16T22:10:14.308 INFO:tasks.rados.rados.2.smithi057.stdout:2230: done (1 left) 2020-11-16T22:10:14.308 INFO:tasks.rados.rados.2.smithi057.stdout:2231: rollback oid 20 current snap is 260 2020-11-16T22:10:14.309 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 20 to 236 2020-11-16T22:10:14.309 INFO:tasks.rados.rados.2.smithi057.stdout:2232: snap_remove snap 243 2020-11-16T22:10:14.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:14 smithi195 bash[10218]: cluster 2020-11-16T22:10:13.082500+0000 mon.a (mon.0) 1243 : cluster [DBG] osdmap e585: 12 total, 12 up, 12 in 2020-11-16T22:10:14.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:14 smithi057 bash[10301]: cluster 2020-11-16T22:10:13.082500+0000 mon.a (mon.0) 1243 : cluster [DBG] osdmap e585: 12 total, 12 up, 12 in 2020-11-16T22:10:14.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:14 smithi016 bash[10302]: cluster 2020-11-16T22:10:13.082500+0000 mon.a (mon.0) 1243 : cluster [DBG] osdmap e585: 12 total, 12 up, 12 in 2020-11-16T22:10:15.056 INFO:tasks.rados.rados.2.smithi057.stdout:2232: done (2 left) 2020-11-16T22:10:15.057 INFO:tasks.rados.rados.2.smithi057.stdout:2233: snap_remove snap 256 2020-11-16T22:10:15.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:15 smithi057 bash[10301]: cluster 2020-11-16T22:10:13.743453+0000 mgr.x (mgr.24115) 528 : cluster [DBG] pgmap v1043: 17 pgs: 17 active+clean; 209 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 1.6 MiB/s wr, 9 op/s 2020-11-16T22:10:15.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:15 smithi057 bash[10301]: cluster 2020-11-16T22:10:14.118125+0000 mon.a (mon.0) 1244 : cluster [DBG] osdmap e586: 12 total, 12 up, 12 in 2020-11-16T22:10:15.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:15 smithi057 bash[10301]: cluster 2020-11-16T22:10:15.068248+0000 mon.a (mon.0) 1245 : cluster [DBG] osdmap e587: 12 total, 12 up, 12 in 2020-11-16T22:10:15.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:15 smithi016 bash[10302]: cluster 2020-11-16T22:10:13.743453+0000 mgr.x (mgr.24115) 528 : cluster [DBG] pgmap v1043: 17 pgs: 17 active+clean; 209 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 1.6 MiB/s wr, 9 op/s 2020-11-16T22:10:15.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:15 smithi016 bash[10302]: cluster 2020-11-16T22:10:14.118125+0000 mon.a (mon.0) 1244 : cluster [DBG] osdmap e586: 12 total, 12 up, 12 in 2020-11-16T22:10:15.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:15 smithi016 bash[10302]: cluster 2020-11-16T22:10:15.068248+0000 mon.a (mon.0) 1245 : cluster [DBG] osdmap e587: 12 total, 12 up, 12 in 2020-11-16T22:10:15.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:15 smithi195 bash[10218]: cluster 2020-11-16T22:10:13.743453+0000 mgr.x (mgr.24115) 528 : cluster [DBG] pgmap v1043: 17 pgs: 17 active+clean; 209 MiB data, 694 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 1.6 MiB/s wr, 9 op/s 2020-11-16T22:10:15.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:15 smithi195 bash[10218]: cluster 2020-11-16T22:10:14.118125+0000 mon.a (mon.0) 1244 : cluster [DBG] osdmap e586: 12 total, 12 up, 12 in 2020-11-16T22:10:15.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:15 smithi195 bash[10218]: cluster 2020-11-16T22:10:15.068248+0000 mon.a (mon.0) 1245 : cluster [DBG] osdmap e587: 12 total, 12 up, 12 in 2020-11-16T22:10:16.059 INFO:tasks.rados.rados.2.smithi057.stdout:2233: done (2 left) 2020-11-16T22:10:16.059 INFO:tasks.rados.rados.2.smithi057.stdout:2234: write oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 260 2020-11-16T22:10:16.059 INFO:tasks.rados.rados.2.smithi057.stdout:2234: seq_num 751 ranges {622057=714593,1913624=708433} 2020-11-16T22:10:16.074 INFO:tasks.rados.rados.2.smithi057.stdout:2234: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 622057 to 1336650 tid 1 2020-11-16T22:10:16.082 INFO:tasks.rados.rados.2.smithi057.stdout:2234: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1913624 to 2622057 tid 2 2020-11-16T22:10:16.082 INFO:tasks.rados.rados.2.smithi057.stdout:2235: read oid 22 snap -1 2020-11-16T22:10:16.083 INFO:tasks.rados.rados.2.smithi057.stdout:2235: expect (ObjNum 695 snap 243 seq_num 695) 2020-11-16T22:10:16.083 INFO:tasks.rados.rados.2.smithi057.stdout:2236: delete oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 260 2020-11-16T22:10:16.083 INFO:tasks.rados.rados.2.smithi057.stdout:2231: finishing rollback tid 0 to smithi05720651-20 2020-11-16T22:10:16.083 INFO:tasks.rados.rados.2.smithi057.stdout:2231: finishing rollback tid 1 to smithi05720651-20 2020-11-16T22:10:16.083 INFO:tasks.rados.rados.2.smithi057.stdout:2231: finishing rollback tid 2 to smithi05720651-20 2020-11-16T22:10:16.083 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1549 (ObjNum 653 snap 229 seq_num 653) dirty exists 2020-11-16T22:10:16.084 INFO:tasks.rados.rados.2.smithi057.stdout:2226: finishing write tid 4 to smithi05720651-12 2020-11-16T22:10:16.084 INFO:tasks.rados.rados.2.smithi057.stdout:2226: finishing write tid 5 to smithi05720651-12 2020-11-16T22:10:16.084 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 1130 (ObjNum 748 snap 260 seq_num 748) dirty exists 2020-11-16T22:10:16.084 INFO:tasks.rados.rados.2.smithi057.stdout:2226: left oid 12 (ObjNum 748 snap 260 seq_num 748) 2020-11-16T22:10:16.090 INFO:tasks.rados.rados.2.smithi057.stdout:2234: finishing write tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:16.092 INFO:tasks.rados.rados.2.smithi057.stdout:2234: finishing write tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:16.095 INFO:tasks.rados.rados.2.smithi057.stdout:2234: finishing write tid 4 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:16.096 INFO:tasks.rados.rados.2.smithi057.stdout:2234: finishing write tid 5 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:16.096 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1692 (ObjNum 751 snap 260 seq_num 751) dirty exists 2020-11-16T22:10:16.097 INFO:tasks.rados.rados.2.smithi057.stdout:2234: left oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 751 snap 260 seq_num 751) 2020-11-16T22:10:16.097 INFO:tasks.rados.rados.2.smithi057.stdout:2235: expect (ObjNum 695 snap 243 seq_num 695) 2020-11-16T22:10:16.405 INFO:tasks.rados.rados.2.smithi057.stdout:2226: done (4 left) 2020-11-16T22:10:16.405 INFO:tasks.rados.rados.2.smithi057.stdout:2231: done (3 left) 2020-11-16T22:10:16.405 INFO:tasks.rados.rados.2.smithi057.stdout:2234: done (2 left) 2020-11-16T22:10:16.405 INFO:tasks.rados.rados.2.smithi057.stdout:2235: done (1 left) 2020-11-16T22:10:16.406 INFO:tasks.rados.rados.2.smithi057.stdout:2236: done (0 left) 2020-11-16T22:10:16.406 INFO:tasks.rados.rados.2.smithi057.stdout:2237: copy_from oid 8 from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 260 2020-11-16T22:10:16.406 INFO:tasks.rados.rados.2.smithi057.stdout:2238: snap_remove snap 254 2020-11-16T22:10:17.112 INFO:tasks.rados.rados.2.smithi057.stdout:2238: done (1 left) 2020-11-16T22:10:17.112 INFO:tasks.rados.rados.2.smithi057.stdout:2239: rollback oid 36 current snap is 260 2020-11-16T22:10:17.112 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 36 to 258 2020-11-16T22:10:17.112 INFO:tasks.rados.rados.2.smithi057.stdout:2237: finishing copy_from to smithi05720651-8 2020-11-16T22:10:17.113 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 1403 (ObjNum 588 snap 207 seq_num 588) dirty exists 2020-11-16T22:10:17.113 INFO:tasks.rados.rados.2.smithi057.stdout:2237: finishing copy_from racing read to smithi05720651-8 2020-11-16T22:10:17.113 INFO:tasks.rados.rados.2.smithi057.stdout:2237: done (1 left) 2020-11-16T22:10:17.113 INFO:tasks.rados.rados.2.smithi057.stdout:2240: snap_create 2020-11-16T22:10:17.123 INFO:tasks.rados.rados.2.smithi057.stdout:2239: finishing rollback tid 0 to smithi05720651-36 2020-11-16T22:10:17.123 INFO:tasks.rados.rados.2.smithi057.stdout:2239: finishing rollback tid 1 to smithi05720651-36 2020-11-16T22:10:17.127 INFO:tasks.rados.rados.2.smithi057.stdout:2239: finishing rollback tid 2 to smithi05720651-36 2020-11-16T22:10:17.127 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 1377 (ObjNum 726 snap 252 seq_num 726) dirty exists 2020-11-16T22:10:17.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:17 smithi016 bash[10302]: cluster 2020-11-16T22:10:15.744275+0000 mgr.x (mgr.24115) 529 : cluster [DBG] pgmap v1046: 17 pgs: 17 active+clean; 218 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2020-11-16T22:10:17.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:17 smithi016 bash[10302]: cluster 2020-11-16T22:10:16.070551+0000 mon.a (mon.0) 1246 : cluster [DBG] osdmap e588: 12 total, 12 up, 12 in 2020-11-16T22:10:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:17 smithi195 bash[10218]: cluster 2020-11-16T22:10:15.744275+0000 mgr.x (mgr.24115) 529 : cluster [DBG] pgmap v1046: 17 pgs: 17 active+clean; 218 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2020-11-16T22:10:17.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:17 smithi195 bash[10218]: cluster 2020-11-16T22:10:16.070551+0000 mon.a (mon.0) 1246 : cluster [DBG] osdmap e588: 12 total, 12 up, 12 in 2020-11-16T22:10:17.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:17 smithi057 bash[10301]: cluster 2020-11-16T22:10:15.744275+0000 mgr.x (mgr.24115) 529 : cluster [DBG] pgmap v1046: 17 pgs: 17 active+clean; 218 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2020-11-16T22:10:17.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:17 smithi057 bash[10301]: cluster 2020-11-16T22:10:16.070551+0000 mon.a (mon.0) 1246 : cluster [DBG] osdmap e588: 12 total, 12 up, 12 in 2020-11-16T22:10:18.122 INFO:tasks.rados.rados.2.smithi057.stdout:2239: done (1 left) 2020-11-16T22:10:18.122 INFO:tasks.rados.rados.2.smithi057.stdout:2240: done (0 left) 2020-11-16T22:10:18.122 INFO:tasks.rados.rados.2.smithi057.stdout:2241: read oid 2 snap 257 2020-11-16T22:10:18.122 INFO:tasks.rados.rados.2.smithi057.stdout:2241: expect (ObjNum 736 snap 256 seq_num 736) 2020-11-16T22:10:18.123 INFO:tasks.rados.rados.2.smithi057.stdout:2242: delete oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 261 2020-11-16T22:10:18.132 INFO:tasks.rados.rados.2.smithi057.stdout:2242: done (1 left) 2020-11-16T22:10:18.133 INFO:tasks.rados.rados.2.smithi057.stdout:2243: rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 261 2020-11-16T22:10:18.133 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 259 2020-11-16T22:10:18.133 INFO:tasks.rados.rados.2.smithi057.stdout:2244: write oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 261 2020-11-16T22:10:18.133 INFO:tasks.rados.rados.2.smithi057.stdout:2244: seq_num 754 ranges {672478=656693,2089070=459917} 2020-11-16T22:10:18.145 INFO:tasks.rados.rados.2.smithi057.stdout:2244: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 672478 to 1329171 tid 1 2020-11-16T22:10:18.152 INFO:tasks.rados.rados.2.smithi057.stdout:2244: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2089070 to 2548987 tid 2 2020-11-16T22:10:18.152 INFO:tasks.rados.rados.2.smithi057.stdout:2245: snap_create 2020-11-16T22:10:18.152 INFO:tasks.rados.rados.2.smithi057.stdout:2241: expect (ObjNum 736 snap 256 seq_num 736) 2020-11-16T22:10:18.268 INFO:tasks.rados.rados.2.smithi057.stdout:2243: finishing rollback tid 0 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:18.269 INFO:tasks.rados.rados.2.smithi057.stdout:2243: finishing rollback tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:18.269 INFO:tasks.rados.rados.2.smithi057.stdout:2243: finishing rollback tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:18.269 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1700 (ObjNum 632 snap 220 seq_num 632) dirty exists 2020-11-16T22:10:18.269 INFO:tasks.rados.rados.2.smithi057.stdout:2244: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:18.269 INFO:tasks.rados.rados.2.smithi057.stdout:2244: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:18.270 INFO:tasks.rados.rados.2.smithi057.stdout:2244: finishing write tid 4 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:18.270 INFO:tasks.rados.rados.2.smithi057.stdout:2244: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:18.270 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1703 (ObjNum 754 snap 261 seq_num 754) dirty exists 2020-11-16T22:10:18.270 INFO:tasks.rados.rados.2.smithi057.stdout:2244: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 754 snap 261 seq_num 754) 2020-11-16T22:10:18.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:18 smithi057 bash[10301]: cluster 2020-11-16T22:10:17.124087+0000 mon.a (mon.0) 1247 : cluster [DBG] osdmap e589: 12 total, 12 up, 12 in 2020-11-16T22:10:18.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:18 smithi016 bash[10302]: cluster 2020-11-16T22:10:17.124087+0000 mon.a (mon.0) 1247 : cluster [DBG] osdmap e589: 12 total, 12 up, 12 in 2020-11-16T22:10:18.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:18 smithi195 bash[10218]: cluster 2020-11-16T22:10:17.124087+0000 mon.a (mon.0) 1247 : cluster [DBG] osdmap e589: 12 total, 12 up, 12 in 2020-11-16T22:10:19.125 INFO:tasks.rados.rados.2.smithi057.stdout:2241: done (3 left) 2020-11-16T22:10:19.125 INFO:tasks.rados.rados.2.smithi057.stdout:2243: done (2 left) 2020-11-16T22:10:19.125 INFO:tasks.rados.rados.2.smithi057.stdout:2244: done (1 left) 2020-11-16T22:10:19.125 INFO:tasks.rados.rados.2.smithi057.stdout:2245: done (0 left) 2020-11-16T22:10:19.126 INFO:tasks.rados.rados.2.smithi057.stdout:2246: write (excl) oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 262 2020-11-16T22:10:19.126 INFO:tasks.rados.rados.2.smithi057.stdout:2246: seq_num 755 ranges {689285=731942,2147552=541733} 2020-11-16T22:10:19.139 INFO:tasks.rados.rados.2.smithi057.stdout:2246: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 689285 to 1421227 tid 1 2020-11-16T22:10:19.146 INFO:tasks.rados.rados.2.smithi057.stdout:2246: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2147552 to 2689285 tid 2 2020-11-16T22:10:19.147 INFO:tasks.rados.rados.2.smithi057.stdout:2247: write oid 6 current snap is 262 2020-11-16T22:10:19.147 INFO:tasks.rados.rados.2.smithi057.stdout:2247: seq_num 756 ranges {706092=407191,1806034=463586} 2020-11-16T22:10:19.153 INFO:tasks.rados.rados.2.smithi057.stdout:2247: writing smithi05720651-6 from 706092 to 1113283 tid 1 2020-11-16T22:10:19.159 INFO:tasks.rados.rados.2.smithi057.stdout:2247: writing smithi05720651-6 from 1806034 to 2269620 tid 2 2020-11-16T22:10:19.160 INFO:tasks.rados.rados.2.smithi057.stdout:2248: rollback oid 38 current snap is 262 2020-11-16T22:10:19.160 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 38 to 236 2020-11-16T22:10:19.160 INFO:tasks.rados.rados.2.smithi057.stdout:2249: snap_remove snap 249 2020-11-16T22:10:19.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:19 smithi057 bash[10301]: cluster 2020-11-16T22:10:17.745058+0000 mgr.x (mgr.24115) 530 : cluster [DBG] pgmap v1049: 17 pgs: 17 active+clean; 225 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2020-11-16T22:10:19.447 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:19 smithi057 bash[10301]: cluster 2020-11-16T22:10:18.133220+0000 mon.a (mon.0) 1248 : cluster [DBG] osdmap e590: 12 total, 12 up, 12 in 2020-11-16T22:10:19.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:19 smithi016 bash[10302]: cluster 2020-11-16T22:10:17.745058+0000 mgr.x (mgr.24115) 530 : cluster [DBG] pgmap v1049: 17 pgs: 17 active+clean; 225 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2020-11-16T22:10:19.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:19 smithi016 bash[10302]: cluster 2020-11-16T22:10:18.133220+0000 mon.a (mon.0) 1248 : cluster [DBG] osdmap e590: 12 total, 12 up, 12 in 2020-11-16T22:10:19.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:19 smithi195 bash[10218]: cluster 2020-11-16T22:10:17.745058+0000 mgr.x (mgr.24115) 530 : cluster [DBG] pgmap v1049: 17 pgs: 17 active+clean; 225 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.0 MiB/s wr, 15 op/s 2020-11-16T22:10:19.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:19 smithi195 bash[10218]: cluster 2020-11-16T22:10:18.133220+0000 mon.a (mon.0) 1248 : cluster [DBG] osdmap e590: 12 total, 12 up, 12 in 2020-11-16T22:10:20.060 INFO:tasks.rados.rados.2.smithi057.stdout:2249: done (3 left) 2020-11-16T22:10:20.060 INFO:tasks.rados.rados.2.smithi057.stdout:2250: copy_from oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 34 current snap is 262 2020-11-16T22:10:20.060 INFO:tasks.rados.rados.2.smithi057.stdout:2247: finishing write tid 1 to smithi05720651-6 2020-11-16T22:10:20.060 INFO:tasks.rados.rados.2.smithi057.stdout:2247: finishing write tid 2 to smithi05720651-6 2020-11-16T22:10:20.060 INFO:tasks.rados.rados.2.smithi057.stdout:2247: finishing write tid 4 to smithi05720651-6 2020-11-16T22:10:20.061 INFO:tasks.rados.rados.2.smithi057.stdout:2247: finishing write tid 5 to smithi05720651-6 2020-11-16T22:10:20.061 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 1706 (ObjNum 756 snap 262 seq_num 756) dirty exists 2020-11-16T22:10:20.061 INFO:tasks.rados.rados.2.smithi057.stdout:2247: left oid 6 (ObjNum 756 snap 262 seq_num 756) 2020-11-16T22:10:20.061 INFO:tasks.rados.rados.2.smithi057.stdout:2248: finishing rollback tid 0 to smithi05720651-38 2020-11-16T22:10:20.061 INFO:tasks.rados.rados.2.smithi057.stdout:2248: finishing rollback tid 1 to smithi05720651-38 2020-11-16T22:10:20.061 INFO:tasks.rados.rados.2.smithi057.stdout:2248: finishing rollback tid 2 to smithi05720651-38 2020-11-16T22:10:20.061 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 1339 (ObjNum 633 snap 220 seq_num 633) dirty exists 2020-11-16T22:10:20.062 INFO:tasks.rados.rados.2.smithi057.stdout:2246: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:20.062 INFO:tasks.rados.rados.2.smithi057.stdout:2246: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:20.062 INFO:tasks.rados.rados.2.smithi057.stdout:2246: finishing write tid 4 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:20.062 INFO:tasks.rados.rados.2.smithi057.stdout:2246: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:20.062 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1886 (ObjNum 755 snap 262 seq_num 755) dirty exists 2020-11-16T22:10:20.062 INFO:tasks.rados.rados.2.smithi057.stdout:2246: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 755 snap 262 seq_num 755) 2020-11-16T22:10:20.062 INFO:tasks.rados.rados.2.smithi057.stdout:2246: done (3 left) 2020-11-16T22:10:20.063 INFO:tasks.rados.rados.2.smithi057.stdout:2247: done (2 left) 2020-11-16T22:10:20.063 INFO:tasks.rados.rados.2.smithi057.stdout:2248: done (1 left) 2020-11-16T22:10:20.063 INFO:tasks.rados.rados.2.smithi057.stdout:2251: snap_create 2020-11-16T22:10:20.088 INFO:tasks.rados.rados.2.smithi057.stdout:2250: finishing copy_from to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:20.088 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1543 (ObjNum 658 snap 232 seq_num 658) dirty exists 2020-11-16T22:10:20.088 INFO:tasks.rados.rados.2.smithi057.stdout:2250: finishing copy_from racing read to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:20.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:20 smithi057 bash[10301]: cluster 2020-11-16T22:10:19.135881+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e591: 12 total, 12 up, 12 in 2020-11-16T22:10:20.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:20 smithi057 bash[10301]: cluster 2020-11-16T22:10:20.070801+0000 mon.a (mon.0) 1250 : cluster [DBG] osdmap e592: 12 total, 12 up, 12 in 2020-11-16T22:10:20.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:20 smithi016 bash[10302]: cluster 2020-11-16T22:10:19.135881+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e591: 12 total, 12 up, 12 in 2020-11-16T22:10:20.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:20 smithi016 bash[10302]: cluster 2020-11-16T22:10:20.070801+0000 mon.a (mon.0) 1250 : cluster [DBG] osdmap e592: 12 total, 12 up, 12 in 2020-11-16T22:10:20.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:20 smithi195 bash[10218]: cluster 2020-11-16T22:10:19.135881+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e591: 12 total, 12 up, 12 in 2020-11-16T22:10:20.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:20 smithi195 bash[10218]: cluster 2020-11-16T22:10:20.070801+0000 mon.a (mon.0) 1250 : cluster [DBG] osdmap e592: 12 total, 12 up, 12 in 2020-11-16T22:10:21.061 INFO:tasks.rados.rados.2.smithi057.stdout:2250: done (1 left) 2020-11-16T22:10:21.062 INFO:tasks.rados.rados.2.smithi057.stdout:2251: done (0 left) 2020-11-16T22:10:21.062 INFO:tasks.rados.rados.2.smithi057.stdout:2252: rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 263 2020-11-16T22:10:21.062 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 255 2020-11-16T22:10:21.062 INFO:tasks.rados.rados.2.smithi057.stdout:2253: copy_from oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 8 current snap is 263 2020-11-16T22:10:21.062 INFO:tasks.rados.rados.2.smithi057.stdout:2254: write oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 263 2020-11-16T22:10:21.063 INFO:tasks.rados.rados.2.smithi057.stdout:2254: seq_num 757 ranges {722899=482440,1748163=723597} 2020-11-16T22:10:21.077 INFO:tasks.rados.rados.2.smithi057.stdout:2254: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 722899 to 1205339 tid 1 2020-11-16T22:10:21.085 INFO:tasks.rados.rados.2.smithi057.stdout:2254: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1748163 to 2471760 tid 2 2020-11-16T22:10:21.085 INFO:tasks.rados.rados.2.smithi057.stdout:2255: write oid 34 current snap is 263 2020-11-16T22:10:21.085 INFO:tasks.rados.rados.2.smithi057.stdout:2255: seq_num 758 ranges {739706=557689,1806645=467255} 2020-11-16T22:10:21.093 INFO:tasks.rados.rados.2.smithi057.stdout:2255: writing smithi05720651-34 from 739706 to 1297395 tid 1 2020-11-16T22:10:21.099 INFO:tasks.rados.rados.2.smithi057.stdout:2255: writing smithi05720651-34 from 1806645 to 2273900 tid 2 2020-11-16T22:10:21.100 INFO:tasks.rados.rados.2.smithi057.stdout:2256: write (excl) oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 263 2020-11-16T22:10:21.100 INFO:tasks.rados.rados.2.smithi057.stdout:2256: seq_num 759 ranges {756513=632938,1865127=727266} 2020-11-16T22:10:21.108 INFO:tasks.rados.rados.2.smithi057.stdout:2256: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 756513 to 1389451 tid 1 2020-11-16T22:10:21.115 INFO:tasks.rados.rados.2.smithi057.stdout:2256: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1865127 to 2592393 tid 2 2020-11-16T22:10:21.115 INFO:tasks.rados.rados.2.smithi057.stdout:2257: snap_create 2020-11-16T22:10:21.115 INFO:tasks.rados.rados.2.smithi057.stdout:2252: finishing rollback tid 0 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:21.115 INFO:tasks.rados.rados.2.smithi057.stdout:2252: finishing rollback tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:21.115 INFO:tasks.rados.rados.2.smithi057.stdout:2252: finishing rollback tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:21.115 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1696 (ObjNum 588 snap 207 seq_num 588) dirty exists 2020-11-16T22:10:21.116 INFO:tasks.rados.rados.2.smithi057.stdout:2254: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:21.116 INFO:tasks.rados.rados.2.smithi057.stdout:2254: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:21.116 INFO:tasks.rados.rados.2.smithi057.stdout:2254: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:21.116 INFO:tasks.rados.rados.2.smithi057.stdout:2254: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:21.116 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1727 (ObjNum 757 snap 263 seq_num 757) dirty exists 2020-11-16T22:10:21.116 INFO:tasks.rados.rados.2.smithi057.stdout:2254: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 757 snap 263 seq_num 757) 2020-11-16T22:10:21.117 INFO:tasks.rados.rados.2.smithi057.stdout:2253: finishing copy_from to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:21.117 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1403 (ObjNum 588 snap 207 seq_num 588) dirty exists 2020-11-16T22:10:21.117 INFO:tasks.rados.rados.2.smithi057.stdout:2253: finishing copy_from racing read to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:21.117 INFO:tasks.rados.rados.2.smithi057.stdout:2255: finishing write tid 1 to smithi05720651-34 2020-11-16T22:10:21.117 INFO:tasks.rados.rados.2.smithi057.stdout:2255: finishing write tid 2 to smithi05720651-34 2020-11-16T22:10:21.117 INFO:tasks.rados.rados.2.smithi057.stdout:2255: finishing write tid 4 to smithi05720651-34 2020-11-16T22:10:21.117 INFO:tasks.rados.rados.2.smithi057.stdout:2255: finishing write tid 5 to smithi05720651-34 2020-11-16T22:10:21.118 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 1552 (ObjNum 758 snap 263 seq_num 758) dirty exists 2020-11-16T22:10:21.118 INFO:tasks.rados.rados.2.smithi057.stdout:2255: left oid 34 (ObjNum 758 snap 263 seq_num 758) 2020-11-16T22:10:21.118 INFO:tasks.rados.rados.2.smithi057.stdout:2256: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:21.120 INFO:tasks.rados.rados.2.smithi057.stdout:2256: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:21.121 INFO:tasks.rados.rados.2.smithi057.stdout:2256: finishing write tid 4 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:21.121 INFO:tasks.rados.rados.2.smithi057.stdout:2256: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:21.122 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1742 (ObjNum 759 snap 263 seq_num 759) dirty exists 2020-11-16T22:10:21.122 INFO:tasks.rados.rados.2.smithi057.stdout:2256: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 759 snap 263 seq_num 759) 2020-11-16T22:10:21.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:21 smithi057 bash[10301]: cluster 2020-11-16T22:10:19.745738+0000 mgr.x (mgr.24115) 531 : cluster [DBG] pgmap v1052: 17 pgs: 17 active+clean; 225 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.2 MiB/s wr, 4 op/s 2020-11-16T22:10:21.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:21 smithi057 bash[10301]: cluster 2020-11-16T22:10:21.072929+0000 mon.a (mon.0) 1251 : cluster [DBG] osdmap e593: 12 total, 12 up, 12 in 2020-11-16T22:10:21.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:21 smithi016 bash[10302]: cluster 2020-11-16T22:10:19.745738+0000 mgr.x (mgr.24115) 531 : cluster [DBG] pgmap v1052: 17 pgs: 17 active+clean; 225 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.2 MiB/s wr, 4 op/s 2020-11-16T22:10:21.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:21 smithi016 bash[10302]: cluster 2020-11-16T22:10:21.072929+0000 mon.a (mon.0) 1251 : cluster [DBG] osdmap e593: 12 total, 12 up, 12 in 2020-11-16T22:10:21.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:21 smithi195 bash[10218]: cluster 2020-11-16T22:10:19.745738+0000 mgr.x (mgr.24115) 531 : cluster [DBG] pgmap v1052: 17 pgs: 17 active+clean; 225 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.2 MiB/s wr, 4 op/s 2020-11-16T22:10:21.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:21 smithi195 bash[10218]: cluster 2020-11-16T22:10:21.072929+0000 mon.a (mon.0) 1251 : cluster [DBG] osdmap e593: 12 total, 12 up, 12 in 2020-11-16T22:10:22.063 INFO:tasks.rados.rados.2.smithi057.stdout:2252: done (5 left) 2020-11-16T22:10:22.064 INFO:tasks.rados.rados.2.smithi057.stdout:2253: done (4 left) 2020-11-16T22:10:22.064 INFO:tasks.rados.rados.2.smithi057.stdout:2254: done (3 left) 2020-11-16T22:10:22.064 INFO:tasks.rados.rados.2.smithi057.stdout:2255: done (2 left) 2020-11-16T22:10:22.064 INFO:tasks.rados.rados.2.smithi057.stdout:2256: done (1 left) 2020-11-16T22:10:22.064 INFO:tasks.rados.rados.2.smithi057.stdout:2257: done (0 left) 2020-11-16T22:10:22.064 INFO:tasks.rados.rados.2.smithi057.stdout:2258: snap_create 2020-11-16T22:10:23.066 INFO:tasks.rados.rados.2.smithi057.stdout:2258: done (0 left) 2020-11-16T22:10:23.067 INFO:tasks.rados.rados.2.smithi057.stdout:2259: write oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 265 2020-11-16T22:10:23.067 INFO:tasks.rados.rados.2.smithi057.stdout:2259: seq_num 760 ranges {773320=708187,1923609=470924} 2020-11-16T22:10:23.083 INFO:tasks.rados.rados.2.smithi057.stdout:2259: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 773320 to 1481507 tid 1 2020-11-16T22:10:23.088 INFO:tasks.rados.rados.2.smithi057.stdout:2259: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1923609 to 2394533 tid 2 2020-11-16T22:10:23.088 INFO:tasks.rados.rados.2.smithi057.stdout:2260: snap_remove snap 264 2020-11-16T22:10:23.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:23 smithi016 bash[10302]: cluster 2020-11-16T22:10:21.746556+0000 mgr.x (mgr.24115) 532 : cluster [DBG] pgmap v1055: 17 pgs: 17 active+clean; 238 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.4 MiB/s wr, 15 op/s 2020-11-16T22:10:23.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:23 smithi016 bash[10302]: cluster 2020-11-16T22:10:22.075129+0000 mon.a (mon.0) 1252 : cluster [DBG] osdmap e594: 12 total, 12 up, 12 in 2020-11-16T22:10:23.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:23 smithi195 bash[10218]: cluster 2020-11-16T22:10:21.746556+0000 mgr.x (mgr.24115) 532 : cluster [DBG] pgmap v1055: 17 pgs: 17 active+clean; 238 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.4 MiB/s wr, 15 op/s 2020-11-16T22:10:23.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:23 smithi195 bash[10218]: cluster 2020-11-16T22:10:22.075129+0000 mon.a (mon.0) 1252 : cluster [DBG] osdmap e594: 12 total, 12 up, 12 in 2020-11-16T22:10:23.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:23 smithi057 bash[10301]: cluster 2020-11-16T22:10:21.746556+0000 mgr.x (mgr.24115) 532 : cluster [DBG] pgmap v1055: 17 pgs: 17 active+clean; 238 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.4 MiB/s wr, 15 op/s 2020-11-16T22:10:23.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:23 smithi057 bash[10301]: cluster 2020-11-16T22:10:22.075129+0000 mon.a (mon.0) 1252 : cluster [DBG] osdmap e594: 12 total, 12 up, 12 in 2020-11-16T22:10:24.085 INFO:tasks.rados.rados.2.smithi057.stdout:2260: done (1 left) 2020-11-16T22:10:24.086 INFO:tasks.rados.rados.2.smithi057.stdout:2261: delete oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 265 2020-11-16T22:10:24.086 INFO:tasks.rados.rados.2.smithi057.stdout:2259: finishing write tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:24.086 INFO:tasks.rados.rados.2.smithi057.stdout:2259: finishing write tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:24.086 INFO:tasks.rados.rados.2.smithi057.stdout:2259: finishing write tid 4 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:24.086 INFO:tasks.rados.rados.2.smithi057.stdout:2259: finishing write tid 5 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:24.087 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1699 (ObjNum 760 snap 265 seq_num 760) dirty exists 2020-11-16T22:10:24.087 INFO:tasks.rados.rados.2.smithi057.stdout:2259: left oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 760 snap 265 seq_num 760) 2020-11-16T22:10:24.094 INFO:tasks.rados.rados.2.smithi057.stdout:2259: done (1 left) 2020-11-16T22:10:24.094 INFO:tasks.rados.rados.2.smithi057.stdout:2261: done (0 left) 2020-11-16T22:10:24.094 INFO:tasks.rados.rados.2.smithi057.stdout:2262: delete oid 48 current snap is 265 2020-11-16T22:10:24.102 INFO:tasks.rados.rados.2.smithi057.stdout:2262: done (0 left) 2020-11-16T22:10:24.102 INFO:tasks.rados.rados.2.smithi057.stdout:2263: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:24.102 INFO:tasks.rados.rados.2.smithi057.stdout:2263: expect (ObjNum 699 snap 243 seq_num 699) 2020-11-16T22:10:24.103 INFO:tasks.rados.rados.2.smithi057.stdout:2264: snap_create 2020-11-16T22:10:24.116 INFO:tasks.rados.rados.2.smithi057.stdout:2263: expect (ObjNum 699 snap 243 seq_num 699) 2020-11-16T22:10:24.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:24 smithi016 bash[10302]: cluster 2020-11-16T22:10:23.077445+0000 mon.a (mon.0) 1253 : cluster [DBG] osdmap e595: 12 total, 12 up, 12 in 2020-11-16T22:10:24.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:24 smithi195 bash[10218]: cluster 2020-11-16T22:10:23.077445+0000 mon.a (mon.0) 1253 : cluster [DBG] osdmap e595: 12 total, 12 up, 12 in 2020-11-16T22:10:24.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:24 smithi057 bash[10301]: cluster 2020-11-16T22:10:23.077445+0000 mon.a (mon.0) 1253 : cluster [DBG] osdmap e595: 12 total, 12 up, 12 in 2020-11-16T22:10:25.061 INFO:tasks.rados.rados.2.smithi057.stdout:2263: done (1 left) 2020-11-16T22:10:25.061 INFO:tasks.rados.rados.2.smithi057.stdout:2264: done (0 left) 2020-11-16T22:10:25.061 INFO:tasks.rados.rados.2.smithi057.stdout:2265: write (excl) oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 266 2020-11-16T22:10:25.062 INFO:tasks.rados.rados.2.smithi057.stdout:2265: seq_num 763 ranges {423741=650287,1699055=618251} 2020-11-16T22:10:25.076 INFO:tasks.rados.rados.2.smithi057.stdout:2265: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 423741 to 1074028 tid 1 2020-11-16T22:10:25.083 INFO:tasks.rados.rados.2.smithi057.stdout:2265: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1699055 to 2317306 tid 2 2020-11-16T22:10:25.083 INFO:tasks.rados.rados.2.smithi057.stdout:2266: snap_remove snap 260 2020-11-16T22:10:25.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:25 smithi016 bash[10302]: cluster 2020-11-16T22:10:23.747280+0000 mgr.x (mgr.24115) 533 : cluster [DBG] pgmap v1058: 17 pgs: 17 active+clean; 239 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.6 MiB/s wr, 16 op/s 2020-11-16T22:10:25.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:25 smithi016 bash[10302]: cluster 2020-11-16T22:10:24.096834+0000 mon.a (mon.0) 1254 : cluster [DBG] osdmap e596: 12 total, 12 up, 12 in 2020-11-16T22:10:25.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:25 smithi016 bash[10302]: cluster 2020-11-16T22:10:25.072166+0000 mon.a (mon.0) 1255 : cluster [DBG] osdmap e597: 12 total, 12 up, 12 in 2020-11-16T22:10:25.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:25 smithi195 bash[10218]: cluster 2020-11-16T22:10:23.747280+0000 mgr.x (mgr.24115) 533 : cluster [DBG] pgmap v1058: 17 pgs: 17 active+clean; 239 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.6 MiB/s wr, 16 op/s 2020-11-16T22:10:25.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:25 smithi195 bash[10218]: cluster 2020-11-16T22:10:24.096834+0000 mon.a (mon.0) 1254 : cluster [DBG] osdmap e596: 12 total, 12 up, 12 in 2020-11-16T22:10:25.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:25 smithi195 bash[10218]: cluster 2020-11-16T22:10:25.072166+0000 mon.a (mon.0) 1255 : cluster [DBG] osdmap e597: 12 total, 12 up, 12 in 2020-11-16T22:10:25.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:25 smithi057 bash[10301]: cluster 2020-11-16T22:10:23.747280+0000 mgr.x (mgr.24115) 533 : cluster [DBG] pgmap v1058: 17 pgs: 17 active+clean; 239 MiB data, 744 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.6 MiB/s wr, 16 op/s 2020-11-16T22:10:25.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:25 smithi057 bash[10301]: cluster 2020-11-16T22:10:24.096834+0000 mon.a (mon.0) 1254 : cluster [DBG] osdmap e596: 12 total, 12 up, 12 in 2020-11-16T22:10:25.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:25 smithi057 bash[10301]: cluster 2020-11-16T22:10:25.072166+0000 mon.a (mon.0) 1255 : cluster [DBG] osdmap e597: 12 total, 12 up, 12 in 2020-11-16T22:10:26.097 INFO:tasks.rados.rados.2.smithi057.stdout:2266: done (1 left) 2020-11-16T22:10:26.098 INFO:tasks.rados.rados.2.smithi057.stdout:2267: read oid 36 snap -1 2020-11-16T22:10:26.098 INFO:tasks.rados.rados.2.smithi057.stdout:2267: expect (ObjNum 726 snap 252 seq_num 726) 2020-11-16T22:10:26.098 INFO:tasks.rados.rados.2.smithi057.stdout:2268: write oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 266 2020-11-16T22:10:26.098 INFO:tasks.rados.rados.2.smithi057.stdout:2268: seq_num 764 ranges {440548=725536,1757537=478262,2813990=26558} 2020-11-16T22:10:26.109 INFO:tasks.rados.rados.2.smithi057.stdout:2268: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 440548 to 1166084 tid 1 2020-11-16T22:10:26.115 INFO:tasks.rados.rados.2.smithi057.stdout:2268: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1757537 to 2235799 tid 2 2020-11-16T22:10:26.119 INFO:tasks.rados.rados.2.smithi057.stdout:2268: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2813990 to 2840548 tid 3 2020-11-16T22:10:26.119 INFO:tasks.rados.rados.2.smithi057.stdout:2269: delete oid 34 current snap is 266 2020-11-16T22:10:26.119 INFO:tasks.rados.rados.2.smithi057.stdout:2265: finishing write tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:26.120 INFO:tasks.rados.rados.2.smithi057.stdout:2265: finishing write tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:26.120 INFO:tasks.rados.rados.2.smithi057.stdout:2265: finishing write tid 4 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:26.120 INFO:tasks.rados.rados.2.smithi057.stdout:2265: finishing write tid 5 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:26.120 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1703 (ObjNum 763 snap 266 seq_num 763) dirty exists 2020-11-16T22:10:26.120 INFO:tasks.rados.rados.2.smithi057.stdout:2265: left oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 763 snap 266 seq_num 763) 2020-11-16T22:10:26.120 INFO:tasks.rados.rados.2.smithi057.stdout:2267: expect (ObjNum 726 snap 252 seq_num 726) 2020-11-16T22:10:26.193 INFO:tasks.rados.rados.2.smithi057.stdout:2268: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:26.194 INFO:tasks.rados.rados.2.smithi057.stdout:2268: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:26.194 INFO:tasks.rados.rados.2.smithi057.stdout:2268: finishing write tid 3 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:26.194 INFO:tasks.rados.rados.2.smithi057.stdout:2268: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:26.194 INFO:tasks.rados.rados.2.smithi057.stdout:2268: finishing write tid 6 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:26.195 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1714 (ObjNum 764 snap 266 seq_num 764) dirty exists 2020-11-16T22:10:26.195 INFO:tasks.rados.rados.2.smithi057.stdout:2268: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 764 snap 266 seq_num 764) 2020-11-16T22:10:26.195 INFO:tasks.rados.rados.2.smithi057.stdout:2265: done (3 left) 2020-11-16T22:10:26.195 INFO:tasks.rados.rados.2.smithi057.stdout:2267: done (2 left) 2020-11-16T22:10:26.195 INFO:tasks.rados.rados.2.smithi057.stdout:2268: done (1 left) 2020-11-16T22:10:26.195 INFO:tasks.rados.rados.2.smithi057.stdout:2269: done (0 left) 2020-11-16T22:10:26.195 INFO:tasks.rados.rados.2.smithi057.stdout:2270: snap_create 2020-11-16T22:10:27.106 INFO:tasks.rados.rados.2.smithi057.stdout:2270: done (0 left) 2020-11-16T22:10:27.106 INFO:tasks.rados.rados.2.smithi057.stdout:2271: write (excl) oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 267 2020-11-16T22:10:27.106 INFO:tasks.rados.rados.2.smithi057.stdout:2271: seq_num 766 ranges {474162=476034,1358148=481931,2352483=465303} 2020-11-16T22:10:27.120 INFO:tasks.rados.rados.2.smithi057.stdout:2271: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 474162 to 950196 tid 1 2020-11-16T22:10:27.125 INFO:tasks.rados.rados.2.smithi057.stdout:2271: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1358148 to 1840079 tid 2 2020-11-16T22:10:27.130 INFO:tasks.rados.rados.2.smithi057.stdout:2271: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2352483 to 2817786 tid 3 2020-11-16T22:10:27.131 INFO:tasks.rados.rados.2.smithi057.stdout:2272: read oid 46 snap 266 2020-11-16T22:10:27.131 INFO:tasks.rados.rados.2.smithi057.stdout:2272: expect (ObjNum 743 snap 259 seq_num 743) 2020-11-16T22:10:27.131 INFO:tasks.rados.rados.2.smithi057.stdout:2273: read oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:27.131 INFO:tasks.rados.rados.2.smithi057.stdout:2273: expect (ObjNum 742 snap 258 seq_num 742) 2020-11-16T22:10:27.131 INFO:tasks.rados.rados.2.smithi057.stdout:2274: snap_create 2020-11-16T22:10:27.133 INFO:tasks.rados.rados.2.smithi057.stdout:2271: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:27.140 INFO:tasks.rados.rados.2.smithi057.stdout:2273: expect (ObjNum 742 snap 258 seq_num 742) 2020-11-16T22:10:27.288 INFO:tasks.rados.rados.2.smithi057.stdout:2271: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:27.289 INFO:tasks.rados.rados.2.smithi057.stdout:2271: finishing write tid 3 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:27.289 INFO:tasks.rados.rados.2.smithi057.stdout:2271: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:27.289 INFO:tasks.rados.rados.2.smithi057.stdout:2271: finishing write tid 6 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:27.289 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1718 (ObjNum 766 snap 267 seq_num 766) dirty exists 2020-11-16T22:10:27.290 INFO:tasks.rados.rados.2.smithi057.stdout:2271: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 766 snap 267 seq_num 766) 2020-11-16T22:10:27.290 INFO:tasks.rados.rados.2.smithi057.stdout:2272: expect (ObjNum 743 snap 259 seq_num 743) 2020-11-16T22:10:27.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:27 smithi195 bash[10218]: cluster 2020-11-16T22:10:25.747991+0000 mgr.x (mgr.24115) 534 : cluster [DBG] pgmap v1061: 17 pgs: 17 active+clean; 240 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 538 KiB/s wr, 4 op/s 2020-11-16T22:10:27.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:27 smithi195 bash[10218]: cluster 2020-11-16T22:10:26.108478+0000 mon.a (mon.0) 1256 : cluster [DBG] osdmap e598: 12 total, 12 up, 12 in 2020-11-16T22:10:27.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:27 smithi057 bash[10301]: cluster 2020-11-16T22:10:25.747991+0000 mgr.x (mgr.24115) 534 : cluster [DBG] pgmap v1061: 17 pgs: 17 active+clean; 240 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 538 KiB/s wr, 4 op/s 2020-11-16T22:10:27.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:27 smithi057 bash[10301]: cluster 2020-11-16T22:10:26.108478+0000 mon.a (mon.0) 1256 : cluster [DBG] osdmap e598: 12 total, 12 up, 12 in 2020-11-16T22:10:27.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:27 smithi016 bash[10302]: cluster 2020-11-16T22:10:25.747991+0000 mgr.x (mgr.24115) 534 : cluster [DBG] pgmap v1061: 17 pgs: 17 active+clean; 240 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 538 KiB/s wr, 4 op/s 2020-11-16T22:10:27.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:27 smithi016 bash[10302]: cluster 2020-11-16T22:10:26.108478+0000 mon.a (mon.0) 1256 : cluster [DBG] osdmap e598: 12 total, 12 up, 12 in 2020-11-16T22:10:28.119 INFO:tasks.rados.rados.2.smithi057.stdout:2271: done (3 left) 2020-11-16T22:10:28.119 INFO:tasks.rados.rados.2.smithi057.stdout:2272: done (2 left) 2020-11-16T22:10:28.119 INFO:tasks.rados.rados.2.smithi057.stdout:2273: done (1 left) 2020-11-16T22:10:28.119 INFO:tasks.rados.rados.2.smithi057.stdout:2274: done (0 left) 2020-11-16T22:10:28.119 INFO:tasks.rados.rados.2.smithi057.stdout:2275: copy_from oid 26 from oid 28 current snap is 268 2020-11-16T22:10:28.119 INFO:tasks.rados.rados.2.smithi057.stdout:2276: write oid 12 current snap is 268 2020-11-16T22:10:28.120 INFO:tasks.rados.rados.2.smithi057.stdout:2276: seq_num 767 ranges {490969=551283,1816630=625589} 2020-11-16T22:10:28.131 INFO:tasks.rados.rados.2.smithi057.stdout:2276: writing smithi05720651-12 from 490969 to 1042252 tid 1 2020-11-16T22:10:28.141 INFO:tasks.rados.rados.2.smithi057.stdout:2276: writing smithi05720651-12 from 1816630 to 2442219 tid 2 2020-11-16T22:10:28.142 INFO:tasks.rados.rados.2.smithi057.stdout:2277: read oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:28.142 INFO:tasks.rados.rados.2.smithi057.stdout:2277: expect (ObjNum 674 snap 236 seq_num 674) 2020-11-16T22:10:28.142 INFO:tasks.rados.rados.2.smithi057.stdout:2278: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:28.142 INFO:tasks.rados.rados.2.smithi057.stdout:2278: expect (ObjNum 724 snap 251 seq_num 724) 2020-11-16T22:10:28.142 INFO:tasks.rados.rados.2.smithi057.stdout:2279: copy_from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 268 2020-11-16T22:10:28.142 INFO:tasks.rados.rados.2.smithi057.stdout:2275: finishing copy_from to smithi05720651-26 2020-11-16T22:10:28.143 INFO:tasks.rados.rados.2.smithi057.stdout:2275: got expected ENOENT (src dne) 2020-11-16T22:10:28.143 INFO:tasks.rados.rados.2.smithi057.stdout:2280: write (excl) oid 44 current snap is 268 2020-11-16T22:10:28.143 INFO:tasks.rados.rados.2.smithi057.stdout:2280: seq_num 768 ranges {507776=742885,1991465=485600} 2020-11-16T22:10:28.150 INFO:tasks.rados.rados.2.smithi057.stdout:2280: writing smithi05720651-44 from 507776 to 1250661 tid 1 2020-11-16T22:10:28.158 INFO:tasks.rados.rados.2.smithi057.stdout:2280: writing smithi05720651-44 from 1991465 to 2477065 tid 2 2020-11-16T22:10:28.158 INFO:tasks.rados.rados.2.smithi057.stdout:2281: delete oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 268 2020-11-16T22:10:28.158 INFO:tasks.rados.rados.2.smithi057.stdout:2275: finishing copy_from racing read to smithi05720651-26 2020-11-16T22:10:28.158 INFO:tasks.rados.rados.2.smithi057.stdout:2276: finishing write tid 1 to smithi05720651-12 2020-11-16T22:10:28.158 INFO:tasks.rados.rados.2.smithi057.stdout:2277: expect (ObjNum 674 snap 236 seq_num 674) 2020-11-16T22:10:28.267 INFO:tasks.rados.rados.2.smithi057.stdout:2276: finishing write tid 2 to smithi05720651-12 2020-11-16T22:10:28.267 INFO:tasks.rados.rados.2.smithi057.stdout:2276: finishing write tid 4 to smithi05720651-12 2020-11-16T22:10:28.267 INFO:tasks.rados.rados.2.smithi057.stdout:2278: expect (ObjNum 724 snap 251 seq_num 724) 2020-11-16T22:10:28.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:28 smithi057 bash[10301]: cluster 2020-11-16T22:10:27.117353+0000 mon.a (mon.0) 1257 : cluster [DBG] osdmap e599: 12 total, 12 up, 12 in 2020-11-16T22:10:28.469 INFO:tasks.rados.rados.2.smithi057.stdout:2276: finishing write tid 5 to smithi05720651-12 2020-11-16T22:10:28.469 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 1133 (ObjNum 767 snap 268 seq_num 767) dirty exists 2020-11-16T22:10:28.469 INFO:tasks.rados.rados.2.smithi057.stdout:2276: left oid 12 (ObjNum 767 snap 268 seq_num 767) 2020-11-16T22:10:28.470 INFO:tasks.rados.rados.2.smithi057.stdout:2280: finishing write tid 1 to smithi05720651-44 2020-11-16T22:10:28.470 INFO:tasks.rados.rados.2.smithi057.stdout:2280: finishing write tid 2 to smithi05720651-44 2020-11-16T22:10:28.470 INFO:tasks.rados.rados.2.smithi057.stdout:2280: finishing write tid 4 to smithi05720651-44 2020-11-16T22:10:28.470 INFO:tasks.rados.rados.2.smithi057.stdout:2280: finishing write tid 5 to smithi05720651-44 2020-11-16T22:10:28.470 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 1136 (ObjNum 768 snap 268 seq_num 768) dirty exists 2020-11-16T22:10:28.470 INFO:tasks.rados.rados.2.smithi057.stdout:2280: left oid 44 (ObjNum 768 snap 268 seq_num 768) 2020-11-16T22:10:28.471 INFO:tasks.rados.rados.2.smithi057.stdout:2279: finishing copy_from to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:28.471 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1651 (ObjNum 734 snap 252 seq_num 734) dirty exists 2020-11-16T22:10:28.472 INFO:tasks.rados.rados.2.smithi057.stdout:2279: finishing copy_from racing read to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:28.473 INFO:tasks.rados.rados.2.smithi057.stdout:2275: done (6 left) 2020-11-16T22:10:28.473 INFO:tasks.rados.rados.2.smithi057.stdout:2276: done (5 left) 2020-11-16T22:10:28.473 INFO:tasks.rados.rados.2.smithi057.stdout:2277: done (4 left) 2020-11-16T22:10:28.473 INFO:tasks.rados.rados.2.smithi057.stdout:2278: done (3 left) 2020-11-16T22:10:28.473 INFO:tasks.rados.rados.2.smithi057.stdout:2279: done (2 left) 2020-11-16T22:10:28.473 INFO:tasks.rados.rados.2.smithi057.stdout:2280: done (1 left) 2020-11-16T22:10:28.473 INFO:tasks.rados.rados.2.smithi057.stdout:2281: done (0 left) 2020-11-16T22:10:28.474 INFO:tasks.rados.rados.2.smithi057.stdout:2282: copy_from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 268 2020-11-16T22:10:28.474 INFO:tasks.rados.rados.2.smithi057.stdout:2283: copy_from oid 46 from oid 48 current snap is 268 2020-11-16T22:10:28.474 INFO:tasks.rados.rados.2.smithi057.stdout:2284: delete oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 268 2020-11-16T22:10:28.474 INFO:tasks.rados.rados.2.smithi057.stdout:2284: done (2 left) 2020-11-16T22:10:28.475 INFO:tasks.rados.rados.2.smithi057.stdout:2285: snap_remove snap 265 2020-11-16T22:10:28.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:28 smithi016 bash[10302]: cluster 2020-11-16T22:10:27.117353+0000 mon.a (mon.0) 1257 : cluster [DBG] osdmap e599: 12 total, 12 up, 12 in 2020-11-16T22:10:28.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:28 smithi195 bash[10218]: cluster 2020-11-16T22:10:27.117353+0000 mon.a (mon.0) 1257 : cluster [DBG] osdmap e599: 12 total, 12 up, 12 in 2020-11-16T22:10:29.122 INFO:tasks.rados.rados.2.smithi057.stdout:2285: done (2 left) 2020-11-16T22:10:29.123 INFO:tasks.rados.rados.2.smithi057.stdout:2286: write oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 268 2020-11-16T22:10:29.123 INFO:tasks.rados.rados.2.smithi057.stdout:2286: seq_num 771 ranges {558197=568632,1650558=632927,2773245=184952} 2020-11-16T22:10:29.129 INFO:tasks.rados.rados.2.smithi057.stdout:2286: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 558197 to 1126829 tid 1 2020-11-16T22:10:29.137 INFO:tasks.rados.rados.2.smithi057.stdout:2286: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1650558 to 2283485 tid 2 2020-11-16T22:10:29.141 INFO:tasks.rados.rados.2.smithi057.stdout:2286: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2773245 to 2958197 tid 3 2020-11-16T22:10:29.142 INFO:tasks.rados.rados.2.smithi057.stdout:2287: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:29.142 INFO:tasks.rados.rados.2.smithi057.stdout:2287: expect (ObjNum 766 snap 267 seq_num 766) 2020-11-16T22:10:29.142 INFO:tasks.rados.rados.2.smithi057.stdout:2288: read oid 16 snap -1 2020-11-16T22:10:29.142 INFO:tasks.rados.rados.2.smithi057.stdout:2288: expect (ObjNum 650 snap 228 seq_num 650) 2020-11-16T22:10:29.142 INFO:tasks.rados.rados.2.smithi057.stdout:2289: read oid 32 snap -1 2020-11-16T22:10:29.142 INFO:tasks.rados.rados.2.smithi057.stdout:2289: expect (ObjNum 706 snap 249 seq_num 706) 2020-11-16T22:10:29.142 INFO:tasks.rados.rados.2.smithi057.stdout:2290: write (excl) oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 268 2020-11-16T22:10:29.143 INFO:tasks.rados.rados.2.smithi057.stdout:2290: seq_num 772 ranges {575004=643881,1709040=492938,2917021=57983} 2020-11-16T22:10:29.148 INFO:tasks.rados.rados.2.smithi057.stdout:2290: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 575004 to 1218885 tid 1 2020-11-16T22:10:29.154 INFO:tasks.rados.rados.2.smithi057.stdout:2290: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1709040 to 2201978 tid 2 2020-11-16T22:10:29.159 INFO:tasks.rados.rados.2.smithi057.stdout:2290: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2917021 to 2975004 tid 3 2020-11-16T22:10:29.159 INFO:tasks.rados.rados.2.smithi057.stdout:2291: copy_from oid 20 from oid 50 current snap is 268 2020-11-16T22:10:29.159 INFO:tasks.rados.rados.2.smithi057.stdout:2283: finishing copy_from to smithi05720651-46 2020-11-16T22:10:29.160 INFO:tasks.rados.rados.2.smithi057.stdout:2283: got expected ENOENT (src dne) 2020-11-16T22:10:29.160 INFO:tasks.rados.rados.2.smithi057.stdout:2292: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:29.160 INFO:tasks.rados.rados.2.smithi057.stdout:2292: expect (ObjNum 734 snap 252 seq_num 734) 2020-11-16T22:10:29.160 INFO:tasks.rados.rados.2.smithi057.stdout:2293: copy_from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 42 current snap is 268 2020-11-16T22:10:29.160 INFO:tasks.rados.rados.2.smithi057.stdout:2283: finishing copy_from racing read to smithi05720651-46 2020-11-16T22:10:29.160 INFO:tasks.rados.rados.2.smithi057.stdout:2282: finishing copy_from to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:29.161 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1651 (ObjNum 734 snap 252 seq_num 734) dirty exists 2020-11-16T22:10:29.161 INFO:tasks.rados.rados.2.smithi057.stdout:2282: finishing copy_from racing read to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:29.161 INFO:tasks.rados.rados.2.smithi057.stdout:2282: done (9 left) 2020-11-16T22:10:29.161 INFO:tasks.rados.rados.2.smithi057.stdout:2283: done (8 left) 2020-11-16T22:10:29.161 INFO:tasks.rados.rados.2.smithi057.stdout:2294: read oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:29.161 INFO:tasks.rados.rados.2.smithi057.stdout:2294: expect deleted 2020-11-16T22:10:29.161 INFO:tasks.rados.rados.2.smithi057.stdout:2295: snap_create 2020-11-16T22:10:29.162 INFO:tasks.rados.rados.2.smithi057.stdout:2286: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:29.162 INFO:tasks.rados.rados.2.smithi057.stdout:2286: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:29.162 INFO:tasks.rados.rados.2.smithi057.stdout:2286: finishing write tid 3 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:29.162 INFO:tasks.rados.rados.2.smithi057.stdout:2286: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:29.162 INFO:tasks.rados.rados.2.smithi057.stdout:2286: finishing write tid 6 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:29.162 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1553 (ObjNum 771 snap 268 seq_num 771) dirty exists 2020-11-16T22:10:29.162 INFO:tasks.rados.rados.2.smithi057.stdout:2286: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 771 snap 268 seq_num 771) 2020-11-16T22:10:29.163 INFO:tasks.rados.rados.2.smithi057.stdout:2289: expect (ObjNum 706 snap 249 seq_num 706) 2020-11-16T22:10:29.320 INFO:tasks.rados.rados.2.smithi057.stdout:2290: finishing write tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:29.321 INFO:tasks.rados.rados.2.smithi057.stdout:2287: expect (ObjNum 766 snap 267 seq_num 766) 2020-11-16T22:10:29.404 INFO:tasks.rados.rados.2.smithi057.stdout:2293: finishing copy_from to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:29.404 INFO:tasks.rados.rados.2.smithi057.stdout:2293: got expected ENOENT (src dne) 2020-11-16T22:10:29.404 INFO:tasks.rados.rados.2.smithi057.stdout:2293: finishing copy_from racing read to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:29.405 INFO:tasks.rados.rados.2.smithi057.stdout:2288: expect (ObjNum 650 snap 228 seq_num 650) 2020-11-16T22:10:29.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:29 smithi057 bash[10301]: cluster 2020-11-16T22:10:27.748696+0000 mgr.x (mgr.24115) 535 : cluster [DBG] pgmap v1064: 17 pgs: 17 active+clean; 244 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.2 MiB/s wr, 4 op/s 2020-11-16T22:10:29.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:29 smithi057 bash[10301]: cluster 2020-11-16T22:10:28.130050+0000 mon.a (mon.0) 1258 : cluster [DBG] osdmap e600: 12 total, 12 up, 12 in 2020-11-16T22:10:29.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:29 smithi016 bash[10302]: cluster 2020-11-16T22:10:27.748696+0000 mgr.x (mgr.24115) 535 : cluster [DBG] pgmap v1064: 17 pgs: 17 active+clean; 244 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.2 MiB/s wr, 4 op/s 2020-11-16T22:10:29.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:29 smithi016 bash[10302]: cluster 2020-11-16T22:10:28.130050+0000 mon.a (mon.0) 1258 : cluster [DBG] osdmap e600: 12 total, 12 up, 12 in 2020-11-16T22:10:29.596 INFO:tasks.rados.rados.2.smithi057.stdout:2292: expect (ObjNum 734 snap 252 seq_num 734) 2020-11-16T22:10:29.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:29 smithi195 bash[10218]: cluster 2020-11-16T22:10:27.748696+0000 mgr.x (mgr.24115) 535 : cluster [DBG] pgmap v1064: 17 pgs: 17 active+clean; 244 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.2 MiB/s wr, 4 op/s 2020-11-16T22:10:29.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:29 smithi195 bash[10218]: cluster 2020-11-16T22:10:28.130050+0000 mon.a (mon.0) 1258 : cluster [DBG] osdmap e600: 12 total, 12 up, 12 in 2020-11-16T22:10:29.700 INFO:tasks.rados.rados.2.smithi057.stdout:2290: finishing write tid 2 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:29.700 INFO:tasks.rados.rados.2.smithi057.stdout:2290: finishing write tid 3 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:29.700 INFO:tasks.rados.rados.2.smithi057.stdout:2290: finishing write tid 5 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:29.701 INFO:tasks.rados.rados.2.smithi057.stdout:2290: finishing write tid 6 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:29.701 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1507 (ObjNum 772 snap 268 seq_num 772) dirty exists 2020-11-16T22:10:29.701 INFO:tasks.rados.rados.2.smithi057.stdout:2290: left oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 772 snap 268 seq_num 772) 2020-11-16T22:10:29.701 INFO:tasks.rados.rados.2.smithi057.stdout:2291: finishing copy_from to smithi05720651-20 2020-11-16T22:10:29.701 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1642 (ObjNum 719 snap 249 seq_num 719) dirty exists 2020-11-16T22:10:29.701 INFO:tasks.rados.rados.2.smithi057.stdout:2291: finishing copy_from racing read to smithi05720651-20 2020-11-16T22:10:30.063 INFO:tasks.rados.rados.2.smithi057.stdout:2286: done (9 left) 2020-11-16T22:10:30.063 INFO:tasks.rados.rados.2.smithi057.stdout:2287: done (8 left) 2020-11-16T22:10:30.063 INFO:tasks.rados.rados.2.smithi057.stdout:2288: done (7 left) 2020-11-16T22:10:30.063 INFO:tasks.rados.rados.2.smithi057.stdout:2289: done (6 left) 2020-11-16T22:10:30.063 INFO:tasks.rados.rados.2.smithi057.stdout:2290: done (5 left) 2020-11-16T22:10:30.064 INFO:tasks.rados.rados.2.smithi057.stdout:2291: done (4 left) 2020-11-16T22:10:30.064 INFO:tasks.rados.rados.2.smithi057.stdout:2292: done (3 left) 2020-11-16T22:10:30.064 INFO:tasks.rados.rados.2.smithi057.stdout:2293: done (2 left) 2020-11-16T22:10:30.064 INFO:tasks.rados.rados.2.smithi057.stdout:2294: done (1 left) 2020-11-16T22:10:30.064 INFO:tasks.rados.rados.2.smithi057.stdout:2295: done (0 left) 2020-11-16T22:10:30.064 INFO:tasks.rados.rados.2.smithi057.stdout:2296: read oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:30.064 INFO:tasks.rados.rados.2.smithi057.stdout:2296: expect (ObjNum 755 snap 262 seq_num 755) 2020-11-16T22:10:30.065 INFO:tasks.rados.rados.2.smithi057.stdout:2297: copy_from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 269 2020-11-16T22:10:30.065 INFO:tasks.rados.rados.2.smithi057.stdout:2298: write (excl) oid 42 current snap is 269 2020-11-16T22:10:30.065 INFO:tasks.rados.rados.2.smithi057.stdout:2298: seq_num 773 ranges {591811=719130,1767522=636596,2828091=163720} 2020-11-16T22:10:30.073 INFO:tasks.rados.rados.2.smithi057.stdout:2298: writing smithi05720651-42 from 591811 to 1310941 tid 1 2020-11-16T22:10:30.080 INFO:tasks.rados.rados.2.smithi057.stdout:2298: writing smithi05720651-42 from 1767522 to 2404118 tid 2 2020-11-16T22:10:30.083 INFO:tasks.rados.rados.2.smithi057.stdout:2298: writing smithi05720651-42 from 2828091 to 2991811 tid 3 2020-11-16T22:10:30.083 INFO:tasks.rados.rados.2.smithi057.stdout:2299: snap_remove snap 236 2020-11-16T22:10:30.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:30 smithi057 bash[10301]: cluster 2020-11-16T22:10:29.133424+0000 mon.a (mon.0) 1259 : cluster [DBG] osdmap e601: 12 total, 12 up, 12 in 2020-11-16T22:10:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:30 smithi057 bash[10301]: audit 2020-11-16T22:10:29.768056+0000 mon.b (mon.1) 301 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:10:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:30 smithi057 bash[10301]: audit 2020-11-16T22:10:29.768478+0000 mon.b (mon.1) 302 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:10:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:30 smithi057 bash[10301]: audit 2020-11-16T22:10:29.769634+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:10:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:30 smithi057 bash[10301]: audit 2020-11-16T22:10:29.770125+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:10:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:30 smithi057 bash[10301]: cluster 2020-11-16T22:10:30.074069+0000 mon.a (mon.0) 1262 : cluster [DBG] osdmap e602: 12 total, 12 up, 12 in 2020-11-16T22:10:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:30 smithi016 bash[10302]: cluster 2020-11-16T22:10:29.133424+0000 mon.a (mon.0) 1259 : cluster [DBG] osdmap e601: 12 total, 12 up, 12 in 2020-11-16T22:10:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:30 smithi016 bash[10302]: audit 2020-11-16T22:10:29.768056+0000 mon.b (mon.1) 301 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:10:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:30 smithi016 bash[10302]: audit 2020-11-16T22:10:29.768478+0000 mon.b (mon.1) 302 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:10:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:30 smithi016 bash[10302]: audit 2020-11-16T22:10:29.769634+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:10:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:30 smithi016 bash[10302]: audit 2020-11-16T22:10:29.770125+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:10:30.589 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:30 smithi016 bash[10302]: cluster 2020-11-16T22:10:30.074069+0000 mon.a (mon.0) 1262 : cluster [DBG] osdmap e602: 12 total, 12 up, 12 in 2020-11-16T22:10:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:30 smithi195 bash[10218]: cluster 2020-11-16T22:10:29.133424+0000 mon.a (mon.0) 1259 : cluster [DBG] osdmap e601: 12 total, 12 up, 12 in 2020-11-16T22:10:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:30 smithi195 bash[10218]: audit 2020-11-16T22:10:29.768056+0000 mon.b (mon.1) 301 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:10:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:30 smithi195 bash[10218]: audit 2020-11-16T22:10:29.768478+0000 mon.b (mon.1) 302 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:10:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:30 smithi195 bash[10218]: audit 2020-11-16T22:10:29.769634+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:10:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:30 smithi195 bash[10218]: audit 2020-11-16T22:10:29.770125+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:10:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:30 smithi195 bash[10218]: cluster 2020-11-16T22:10:30.074069+0000 mon.a (mon.0) 1262 : cluster [DBG] osdmap e602: 12 total, 12 up, 12 in 2020-11-16T22:10:31.072 INFO:tasks.rados.rados.2.smithi057.stdout:2299: done (3 left) 2020-11-16T22:10:31.072 INFO:tasks.rados.rados.2.smithi057.stdout:2300: read oid 46 snap -1 2020-11-16T22:10:31.072 INFO:tasks.rados.rados.2.smithi057.stdout:2300: expect (ObjNum 743 snap 259 seq_num 743) 2020-11-16T22:10:31.073 INFO:tasks.rados.rados.2.smithi057.stdout:2301: snap_remove snap 268 2020-11-16T22:10:31.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:31 smithi057 bash[10301]: cluster 2020-11-16T22:10:29.749402+0000 mgr.x (mgr.24115) 536 : cluster [DBG] pgmap v1067: 17 pgs: 17 active+clean; 244 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 948 KiB/s wr, 0 op/s 2020-11-16T22:10:31.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:31 smithi057 bash[10301]: cluster 2020-11-16T22:10:31.083463+0000 mon.a (mon.0) 1263 : cluster [DBG] osdmap e603: 12 total, 12 up, 12 in 2020-11-16T22:10:31.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:31 smithi016 bash[10302]: cluster 2020-11-16T22:10:29.749402+0000 mgr.x (mgr.24115) 536 : cluster [DBG] pgmap v1067: 17 pgs: 17 active+clean; 244 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 948 KiB/s wr, 0 op/s 2020-11-16T22:10:31.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:31 smithi016 bash[10302]: cluster 2020-11-16T22:10:31.083463+0000 mon.a (mon.0) 1263 : cluster [DBG] osdmap e603: 12 total, 12 up, 12 in 2020-11-16T22:10:31.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:31 smithi195 bash[10218]: cluster 2020-11-16T22:10:29.749402+0000 mgr.x (mgr.24115) 536 : cluster [DBG] pgmap v1067: 17 pgs: 17 active+clean; 244 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 948 KiB/s wr, 0 op/s 2020-11-16T22:10:31.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:31 smithi195 bash[10218]: cluster 2020-11-16T22:10:31.083463+0000 mon.a (mon.0) 1263 : cluster [DBG] osdmap e603: 12 total, 12 up, 12 in 2020-11-16T22:10:32.074 INFO:tasks.rados.rados.2.smithi057.stdout:2301: done (4 left) 2020-11-16T22:10:32.075 INFO:tasks.rados.rados.2.smithi057.stdout:2302: snap_remove snap 259 2020-11-16T22:10:32.349 INFO:journalctl@ceph.osd.2.smithi195.stdout:Nov 16 22:10:32 smithi195 bash[21024]: debug 2020-11-16T22:10:32.086+0000 7f3c19f37700 -1 osd.2 pg_epoch: 604 pg[2.e( v 604'556 (0'0,604'556] local-lis/les=71/72 n=6 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [2,3] r=0 lpr=71 crt=604'556 lcod 604'554 mlcod 604'554 active+clean+snaptrim trimq=[1d8~1,20e~1] ps=[202~1,209~1]] removing snap head 2020-11-16T22:10:33.084 INFO:tasks.rados.rados.2.smithi057.stdout:2302: done (4 left) 2020-11-16T22:10:33.085 INFO:tasks.rados.rados.2.smithi057.stdout:2303: snap_create 2020-11-16T22:10:33.085 INFO:tasks.rados.rados.2.smithi057.stdout:2297: finishing copy_from to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:33.085 INFO:tasks.rados.rados.2.smithi057.stdout:2297: got expected ENOENT (src dne) 2020-11-16T22:10:33.085 INFO:tasks.rados.rados.2.smithi057.stdout:2297: finishing copy_from racing read to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:33.085 INFO:tasks.rados.rados.2.smithi057.stdout:2296: expect (ObjNum 755 snap 262 seq_num 755) 2020-11-16T22:10:33.203 INFO:tasks.rados.rados.2.smithi057.stdout:2298: finishing write tid 1 to smithi05720651-42 2020-11-16T22:10:33.203 INFO:tasks.rados.rados.2.smithi057.stdout:2298: finishing write tid 2 to smithi05720651-42 2020-11-16T22:10:33.204 INFO:tasks.rados.rados.2.smithi057.stdout:2298: finishing write tid 3 to smithi05720651-42 2020-11-16T22:10:33.204 INFO:tasks.rados.rados.2.smithi057.stdout:2298: finishing write tid 5 to smithi05720651-42 2020-11-16T22:10:33.204 INFO:tasks.rados.rados.2.smithi057.stdout:2298: finishing write tid 6 to smithi05720651-42 2020-11-16T22:10:33.204 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 1557 (ObjNum 773 snap 269 seq_num 773) dirty exists 2020-11-16T22:10:33.204 INFO:tasks.rados.rados.2.smithi057.stdout:2298: left oid 42 (ObjNum 773 snap 269 seq_num 773) 2020-11-16T22:10:33.204 INFO:tasks.rados.rados.2.smithi057.stdout:2300: expect (ObjNum 743 snap 259 seq_num 743) 2020-11-16T22:10:33.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:33 smithi016 bash[10302]: cluster 2020-11-16T22:10:31.750156+0000 mgr.x (mgr.24115) 537 : cluster [DBG] pgmap v1070: 17 pgs: 17 active+clean; 256 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.3 MiB/s wr, 33 op/s 2020-11-16T22:10:33.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:33 smithi016 bash[10302]: cluster 2020-11-16T22:10:32.085993+0000 mon.a (mon.0) 1264 : cluster [DBG] osdmap e604: 12 total, 12 up, 12 in 2020-11-16T22:10:33.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:33 smithi195 bash[10218]: cluster 2020-11-16T22:10:31.750156+0000 mgr.x (mgr.24115) 537 : cluster [DBG] pgmap v1070: 17 pgs: 17 active+clean; 256 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.3 MiB/s wr, 33 op/s 2020-11-16T22:10:33.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:33 smithi195 bash[10218]: cluster 2020-11-16T22:10:32.085993+0000 mon.a (mon.0) 1264 : cluster [DBG] osdmap e604: 12 total, 12 up, 12 in 2020-11-16T22:10:33.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:33 smithi057 bash[10301]: cluster 2020-11-16T22:10:31.750156+0000 mgr.x (mgr.24115) 537 : cluster [DBG] pgmap v1070: 17 pgs: 17 active+clean; 256 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 3.3 MiB/s wr, 33 op/s 2020-11-16T22:10:33.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:33 smithi057 bash[10301]: cluster 2020-11-16T22:10:32.085993+0000 mon.a (mon.0) 1264 : cluster [DBG] osdmap e604: 12 total, 12 up, 12 in 2020-11-16T22:10:34.094 INFO:tasks.rados.rados.2.smithi057.stdout:2296: done (4 left) 2020-11-16T22:10:34.094 INFO:tasks.rados.rados.2.smithi057.stdout:2297: done (3 left) 2020-11-16T22:10:34.095 INFO:tasks.rados.rados.2.smithi057.stdout:2298: done (2 left) 2020-11-16T22:10:34.095 INFO:tasks.rados.rados.2.smithi057.stdout:2300: done (1 left) 2020-11-16T22:10:34.095 INFO:tasks.rados.rados.2.smithi057.stdout:2303: done (0 left) 2020-11-16T22:10:34.095 INFO:tasks.rados.rados.2.smithi057.stdout:2304: delete oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 270 2020-11-16T22:10:34.101 INFO:tasks.rados.rados.2.smithi057.stdout:2304: done (0 left) 2020-11-16T22:10:34.102 INFO:tasks.rados.rados.2.smithi057.stdout:2305: delete oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 270 2020-11-16T22:10:34.108 INFO:tasks.rados.rados.2.smithi057.stdout:2305: done (0 left) 2020-11-16T22:10:34.108 INFO:tasks.rados.rados.2.smithi057.stdout:2306: rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 270 2020-11-16T22:10:34.108 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 245 2020-11-16T22:10:34.108 INFO:tasks.rados.rados.2.smithi057.stdout:2307: copy_from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 34 current snap is 270 2020-11-16T22:10:34.109 INFO:tasks.rados.rados.2.smithi057.stdout:2308: write oid 42 current snap is 270 2020-11-16T22:10:34.109 INFO:tasks.rados.rados.2.smithi057.stdout:2308: seq_num 776 ranges {642232=661230,1942968=783923} 2020-11-16T22:10:34.119 INFO:tasks.rados.rados.2.smithi057.stdout:2308: writing smithi05720651-42 from 642232 to 1303462 tid 1 2020-11-16T22:10:34.130 INFO:tasks.rados.rados.2.smithi057.stdout:2308: writing smithi05720651-42 from 1942968 to 2726891 tid 2 2020-11-16T22:10:34.130 INFO:tasks.rados.rados.2.smithi057.stdout:2309: snap_remove snap 258 2020-11-16T22:10:34.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:34 smithi195 bash[10218]: cluster 2020-11-16T22:10:33.095776+0000 mon.a (mon.0) 1265 : cluster [DBG] osdmap e605: 12 total, 12 up, 12 in 2020-11-16T22:10:34.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:34 smithi057 bash[10301]: cluster 2020-11-16T22:10:33.095776+0000 mon.a (mon.0) 1265 : cluster [DBG] osdmap e605: 12 total, 12 up, 12 in 2020-11-16T22:10:34.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:34 smithi016 bash[10302]: cluster 2020-11-16T22:10:33.095776+0000 mon.a (mon.0) 1265 : cluster [DBG] osdmap e605: 12 total, 12 up, 12 in 2020-11-16T22:10:35.066 INFO:tasks.rados.rados.2.smithi057.stdout:2309: done (3 left) 2020-11-16T22:10:35.066 INFO:tasks.rados.rados.2.smithi057.stdout:2310: rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 270 2020-11-16T22:10:35.066 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 255 2020-11-16T22:10:35.067 INFO:tasks.rados.rados.2.smithi057.stdout:2306: finishing rollback tid 0 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:35.067 INFO:tasks.rados.rados.2.smithi057.stdout:2306: finishing rollback tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:35.067 INFO:tasks.rados.rados.2.smithi057.stdout:2307: finishing copy_from to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:35.067 INFO:tasks.rados.rados.2.smithi057.stdout:2307: got expected ENOENT (src dne) 2020-11-16T22:10:35.067 INFO:tasks.rados.rados.2.smithi057.stdout:2306: finishing rollback tid 2 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:35.067 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1406 (ObjNum 683 snap 238 seq_num 683) dirty exists 2020-11-16T22:10:35.068 INFO:tasks.rados.rados.2.smithi057.stdout:2307: finishing copy_from racing read to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:35.068 INFO:tasks.rados.rados.2.smithi057.stdout:2308: finishing write tid 1 to smithi05720651-42 2020-11-16T22:10:35.068 INFO:tasks.rados.rados.2.smithi057.stdout:2308: finishing write tid 2 to smithi05720651-42 2020-11-16T22:10:35.068 INFO:tasks.rados.rados.2.smithi057.stdout:2308: finishing write tid 4 to smithi05720651-42 2020-11-16T22:10:35.068 INFO:tasks.rados.rados.2.smithi057.stdout:2308: finishing write tid 5 to smithi05720651-42 2020-11-16T22:10:35.068 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 1560 (ObjNum 776 snap 270 seq_num 776) dirty exists 2020-11-16T22:10:35.068 INFO:tasks.rados.rados.2.smithi057.stdout:2308: left oid 42 (ObjNum 776 snap 270 seq_num 776) 2020-11-16T22:10:35.069 INFO:tasks.rados.rados.2.smithi057.stdout:2306: done (3 left) 2020-11-16T22:10:35.069 INFO:tasks.rados.rados.2.smithi057.stdout:2307: done (2 left) 2020-11-16T22:10:35.069 INFO:tasks.rados.rados.2.smithi057.stdout:2308: done (1 left) 2020-11-16T22:10:35.069 INFO:tasks.rados.rados.2.smithi057.stdout:2311: delete oid 6 current snap is 270 2020-11-16T22:10:35.073 INFO:tasks.rados.rados.2.smithi057.stdout:2311: done (1 left) 2020-11-16T22:10:35.073 INFO:tasks.rados.rados.2.smithi057.stdout:2312: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 267 2020-11-16T22:10:35.073 INFO:tasks.rados.rados.2.smithi057.stdout:2312: expect (ObjNum 757 snap 263 seq_num 757) 2020-11-16T22:10:35.074 INFO:tasks.rados.rados.2.smithi057.stdout:2313: copy_from oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 48 current snap is 270 2020-11-16T22:10:35.074 INFO:tasks.rados.rados.2.smithi057.stdout:2314: delete oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 270 2020-11-16T22:10:35.079 INFO:tasks.rados.rados.2.smithi057.stdout:2310: finishing rollback tid 0 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:35.080 INFO:tasks.rados.rados.2.smithi057.stdout:2310: finishing rollback tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:35.080 INFO:tasks.rados.rados.2.smithi057.stdout:2310: finishing rollback tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:35.080 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1563 (ObjNum 647 snap 225 seq_num 647) dirty exists 2020-11-16T22:10:35.087 INFO:tasks.rados.rados.2.smithi057.stdout:2313: finishing copy_from to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:35.087 INFO:tasks.rados.rados.2.smithi057.stdout:2313: got expected ENOENT (src dne) 2020-11-16T22:10:35.087 INFO:tasks.rados.rados.2.smithi057.stdout:2313: finishing copy_from racing read to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:35.088 INFO:tasks.rados.rados.2.smithi057.stdout:2312: expect (ObjNum 757 snap 263 seq_num 757) 2020-11-16T22:10:35.257 INFO:tasks.rados.rados.2.smithi057.stdout:2310: done (3 left) 2020-11-16T22:10:35.257 INFO:tasks.rados.rados.2.smithi057.stdout:2312: done (2 left) 2020-11-16T22:10:35.257 INFO:tasks.rados.rados.2.smithi057.stdout:2313: done (1 left) 2020-11-16T22:10:35.258 INFO:tasks.rados.rados.2.smithi057.stdout:2314: done (0 left) 2020-11-16T22:10:35.258 INFO:tasks.rados.rados.2.smithi057.stdout:2315: snap_remove snap 263 2020-11-16T22:10:35.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:35 smithi057 bash[10301]: cluster 2020-11-16T22:10:33.750856+0000 mgr.x (mgr.24115) 538 : cluster [DBG] pgmap v1073: 17 pgs: 17 active+clean; 257 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 4.1 MiB/s wr, 36 op/s 2020-11-16T22:10:35.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:35 smithi057 bash[10301]: cluster 2020-11-16T22:10:34.105705+0000 mon.a (mon.0) 1266 : cluster [DBG] osdmap e606: 12 total, 12 up, 12 in 2020-11-16T22:10:35.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:35 smithi057 bash[10301]: cluster 2020-11-16T22:10:35.076614+0000 mon.a (mon.0) 1267 : cluster [DBG] osdmap e607: 12 total, 12 up, 12 in 2020-11-16T22:10:35.459 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:35 smithi195 bash[10218]: cluster 2020-11-16T22:10:33.750856+0000 mgr.x (mgr.24115) 538 : cluster [DBG] pgmap v1073: 17 pgs: 17 active+clean; 257 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 4.1 MiB/s wr, 36 op/s 2020-11-16T22:10:35.460 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:35 smithi195 bash[10218]: cluster 2020-11-16T22:10:34.105705+0000 mon.a (mon.0) 1266 : cluster [DBG] osdmap e606: 12 total, 12 up, 12 in 2020-11-16T22:10:35.460 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:35 smithi195 bash[10218]: cluster 2020-11-16T22:10:35.076614+0000 mon.a (mon.0) 1267 : cluster [DBG] osdmap e607: 12 total, 12 up, 12 in 2020-11-16T22:10:35.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:35 smithi016 bash[10302]: cluster 2020-11-16T22:10:33.750856+0000 mgr.x (mgr.24115) 538 : cluster [DBG] pgmap v1073: 17 pgs: 17 active+clean; 257 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 4.1 MiB/s wr, 36 op/s 2020-11-16T22:10:35.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:35 smithi016 bash[10302]: cluster 2020-11-16T22:10:34.105705+0000 mon.a (mon.0) 1266 : cluster [DBG] osdmap e606: 12 total, 12 up, 12 in 2020-11-16T22:10:35.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:35 smithi016 bash[10302]: cluster 2020-11-16T22:10:35.076614+0000 mon.a (mon.0) 1267 : cluster [DBG] osdmap e607: 12 total, 12 up, 12 in 2020-11-16T22:10:36.104 INFO:tasks.rados.rados.2.smithi057.stdout:2315: done (0 left) 2020-11-16T22:10:36.104 INFO:tasks.rados.rados.2.smithi057.stdout:2316: snap_remove snap 267 2020-11-16T22:10:37.109 INFO:tasks.rados.rados.2.smithi057.stdout:2316: done (0 left) 2020-11-16T22:10:37.109 INFO:tasks.rados.rados.2.smithi057.stdout:2317: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:37.109 INFO:tasks.rados.rados.2.smithi057.stdout:2317: expect (ObjNum 724 snap 251 seq_num 724) 2020-11-16T22:10:37.109 INFO:tasks.rados.rados.2.smithi057.stdout:2318: snap_create 2020-11-16T22:10:37.126 INFO:tasks.rados.rados.2.smithi057.stdout:2317: expect (ObjNum 724 snap 251 seq_num 724) 2020-11-16T22:10:37.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:37 smithi057 bash[10301]: cluster 2020-11-16T22:10:35.751559+0000 mgr.x (mgr.24115) 539 : cluster [DBG] pgmap v1076: 17 pgs: 17 active+clean; 245 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 801 KiB/s wr, 5 op/s 2020-11-16T22:10:37.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:37 smithi057 bash[10301]: cluster 2020-11-16T22:10:36.115527+0000 mon.a (mon.0) 1268 : cluster [DBG] osdmap e608: 12 total, 12 up, 12 in 2020-11-16T22:10:37.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:37 smithi016 bash[10302]: cluster 2020-11-16T22:10:35.751559+0000 mgr.x (mgr.24115) 539 : cluster [DBG] pgmap v1076: 17 pgs: 17 active+clean; 245 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 801 KiB/s wr, 5 op/s 2020-11-16T22:10:37.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:37 smithi016 bash[10302]: cluster 2020-11-16T22:10:36.115527+0000 mon.a (mon.0) 1268 : cluster [DBG] osdmap e608: 12 total, 12 up, 12 in 2020-11-16T22:10:37.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:37 smithi195 bash[10218]: cluster 2020-11-16T22:10:35.751559+0000 mgr.x (mgr.24115) 539 : cluster [DBG] pgmap v1076: 17 pgs: 17 active+clean; 245 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 801 KiB/s wr, 5 op/s 2020-11-16T22:10:37.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:37 smithi195 bash[10218]: cluster 2020-11-16T22:10:36.115527+0000 mon.a (mon.0) 1268 : cluster [DBG] osdmap e608: 12 total, 12 up, 12 in 2020-11-16T22:10:38.109 INFO:tasks.rados.rados.2.smithi057.stdout:2317: done (1 left) 2020-11-16T22:10:38.109 INFO:tasks.rados.rados.2.smithi057.stdout:2318: done (0 left) 2020-11-16T22:10:38.110 INFO:tasks.rados.rados.2.smithi057.stdout:2319: copy_from oid 6 from oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 271 2020-11-16T22:10:38.110 INFO:tasks.rados.rados.2.smithi057.stdout:2320: delete oid 4 current snap is 271 2020-11-16T22:10:38.115 INFO:tasks.rados.rados.2.smithi057.stdout:2319: finishing copy_from to smithi05720651-6 2020-11-16T22:10:38.115 INFO:tasks.rados.rados.2.smithi057.stdout:2319: got expected ENOENT (src dne) 2020-11-16T22:10:38.116 INFO:tasks.rados.rados.2.smithi057.stdout:2319: finishing copy_from racing read to smithi05720651-6 2020-11-16T22:10:38.118 INFO:tasks.rados.rados.2.smithi057.stdout:2319: done (1 left) 2020-11-16T22:10:38.119 INFO:tasks.rados.rados.2.smithi057.stdout:2320: done (0 left) 2020-11-16T22:10:38.119 INFO:tasks.rados.rados.2.smithi057.stdout:2321: copy_from oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 271 2020-11-16T22:10:38.119 INFO:tasks.rados.rados.2.smithi057.stdout:2322: write oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 271 2020-11-16T22:10:38.119 INFO:tasks.rados.rados.2.smithi057.stdout:2322: seq_num 780 ranges {709460=562226,2060543=791261} 2020-11-16T22:10:38.134 INFO:tasks.rados.rados.2.smithi057.stdout:2322: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 709460 to 1271686 tid 1 2020-11-16T22:10:38.144 INFO:tasks.rados.rados.2.smithi057.stdout:2322: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2060543 to 2851804 tid 2 2020-11-16T22:10:38.145 INFO:tasks.rados.rados.2.smithi057.stdout:2323: snap_create 2020-11-16T22:10:38.145 INFO:tasks.rados.rados.2.smithi057.stdout:2322: finishing write tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:38.152 INFO:tasks.rados.rados.2.smithi057.stdout:2321: finishing copy_from to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:38.152 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1403 (ObjNum 588 snap 207 seq_num 588) dirty exists 2020-11-16T22:10:38.153 INFO:tasks.rados.rados.2.smithi057.stdout:2322: finishing write tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:38.153 INFO:tasks.rados.rados.2.smithi057.stdout:2321: finishing copy_from racing read to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:38.153 INFO:tasks.rados.rados.2.smithi057.stdout:2322: finishing write tid 4 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:38.154 INFO:tasks.rados.rados.2.smithi057.stdout:2322: finishing write tid 5 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:38.154 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1561 (ObjNum 780 snap 271 seq_num 780) dirty exists 2020-11-16T22:10:38.154 INFO:tasks.rados.rados.2.smithi057.stdout:2322: left oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 780 snap 271 seq_num 780) 2020-11-16T22:10:38.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:38 smithi057 bash[10301]: cluster 2020-11-16T22:10:37.119401+0000 mon.a (mon.0) 1269 : cluster [DBG] osdmap e609: 12 total, 12 up, 12 in 2020-11-16T22:10:38.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:38 smithi057 bash[10301]: cluster 2020-11-16T22:10:38.121226+0000 mon.a (mon.0) 1270 : cluster [DBG] osdmap e610: 12 total, 12 up, 12 in 2020-11-16T22:10:38.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:38 smithi016 bash[10302]: cluster 2020-11-16T22:10:37.119401+0000 mon.a (mon.0) 1269 : cluster [DBG] osdmap e609: 12 total, 12 up, 12 in 2020-11-16T22:10:38.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:38 smithi016 bash[10302]: cluster 2020-11-16T22:10:38.121226+0000 mon.a (mon.0) 1270 : cluster [DBG] osdmap e610: 12 total, 12 up, 12 in 2020-11-16T22:10:38.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:38 smithi195 bash[10218]: cluster 2020-11-16T22:10:37.119401+0000 mon.a (mon.0) 1269 : cluster [DBG] osdmap e609: 12 total, 12 up, 12 in 2020-11-16T22:10:38.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:38 smithi195 bash[10218]: cluster 2020-11-16T22:10:38.121226+0000 mon.a (mon.0) 1270 : cluster [DBG] osdmap e610: 12 total, 12 up, 12 in 2020-11-16T22:10:39.132 INFO:tasks.rados.rados.2.smithi057.stdout:2321: done (2 left) 2020-11-16T22:10:39.132 INFO:tasks.rados.rados.2.smithi057.stdout:2322: done (1 left) 2020-11-16T22:10:39.133 INFO:tasks.rados.rados.2.smithi057.stdout:2323: done (0 left) 2020-11-16T22:10:39.133 INFO:tasks.rados.rados.2.smithi057.stdout:2324: write (excl) oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 272 2020-11-16T22:10:39.133 INFO:tasks.rados.rados.2.smithi057.stdout:2324: seq_num 781 ranges {726267=637475,2119025=651272} 2020-11-16T22:10:39.147 INFO:tasks.rados.rados.2.smithi057.stdout:2324: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 726267 to 1363742 tid 1 2020-11-16T22:10:39.155 INFO:tasks.rados.rados.2.smithi057.stdout:2324: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2119025 to 2770297 tid 2 2020-11-16T22:10:39.155 INFO:tasks.rados.rados.2.smithi057.stdout:2325: rollback oid 44 current snap is 272 2020-11-16T22:10:39.155 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 44 to 262 2020-11-16T22:10:39.155 INFO:tasks.rados.rados.2.smithi057.stdout:2326: rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 272 2020-11-16T22:10:39.156 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 255 2020-11-16T22:10:39.156 INFO:tasks.rados.rados.2.smithi057.stdout:2327: delete oid 40 current snap is 272 2020-11-16T22:10:39.162 INFO:tasks.rados.rados.2.smithi057.stdout:2324: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:39.162 INFO:tasks.rados.rados.2.smithi057.stdout:2325: finishing rollback tid 0 to smithi05720651-44 2020-11-16T22:10:39.163 INFO:tasks.rados.rados.2.smithi057.stdout:2325: finishing rollback tid 1 to smithi05720651-44 2020-11-16T22:10:39.164 INFO:tasks.rados.rados.2.smithi057.stdout:2325: finishing rollback tid 2 to smithi05720651-44 2020-11-16T22:10:39.164 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 1139 (ObjNum 688 snap 242 seq_num 688) dirty exists 2020-11-16T22:10:39.164 INFO:tasks.rados.rados.2.smithi057.stdout:2325: done (3 left) 2020-11-16T22:10:39.164 INFO:tasks.rados.rados.2.smithi057.stdout:2327: done (2 left) 2020-11-16T22:10:39.165 INFO:tasks.rados.rados.2.smithi057.stdout:2328: rollback oid 34 current snap is 272 2020-11-16T22:10:39.165 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 34 to 266 2020-11-16T22:10:39.165 INFO:tasks.rados.rados.2.smithi057.stdout:2329: delete oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 272 2020-11-16T22:10:39.167 INFO:tasks.rados.rados.2.smithi057.stdout:2326: finishing rollback tid 0 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:39.167 INFO:tasks.rados.rados.2.smithi057.stdout:2326: finishing rollback tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:39.168 INFO:tasks.rados.rados.2.smithi057.stdout:2328: finishing rollback tid 1 to smithi05720651-34 2020-11-16T22:10:39.168 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 1553 (ObjNum 33 snap 0 seq_num 1131374913) dirty dne 2020-11-16T22:10:39.169 INFO:tasks.rados.rados.2.smithi057.stdout:2326: finishing rollback tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:39.169 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1745 (ObjNum 691 snap 242 seq_num 691) dirty exists 2020-11-16T22:10:39.169 INFO:tasks.rados.rados.2.smithi057.stdout:2326: done (3 left) 2020-11-16T22:10:39.169 INFO:tasks.rados.rados.2.smithi057.stdout:2328: done (2 left) 2020-11-16T22:10:39.170 INFO:tasks.rados.rados.2.smithi057.stdout:2329: done (1 left) 2020-11-16T22:10:39.170 INFO:tasks.rados.rados.2.smithi057.stdout:2330: delete oid 20 current snap is 272 2020-11-16T22:10:39.170 INFO:tasks.rados.rados.2.smithi057.stdout:2324: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:39.170 INFO:tasks.rados.rados.2.smithi057.stdout:2324: finishing write tid 4 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:39.171 INFO:tasks.rados.rados.2.smithi057.stdout:2324: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:39.171 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1752 (ObjNum 781 snap 272 seq_num 781) dirty exists 2020-11-16T22:10:39.171 INFO:tasks.rados.rados.2.smithi057.stdout:2324: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 781 snap 272 seq_num 781) 2020-11-16T22:10:39.172 INFO:tasks.rados.rados.2.smithi057.stdout:2324: done (1 left) 2020-11-16T22:10:39.172 INFO:tasks.rados.rados.2.smithi057.stdout:2330: done (0 left) 2020-11-16T22:10:39.172 INFO:tasks.rados.rados.2.smithi057.stdout:2331: write (excl) oid 38 current snap is 272 2020-11-16T22:10:39.172 INFO:tasks.rados.rados.2.smithi057.stdout:2331: seq_num 785 ranges {793495=654824,1952953=658610,3157167=36328} 2020-11-16T22:10:39.183 INFO:tasks.rados.rados.2.smithi057.stdout:2331: writing smithi05720651-38 from 793495 to 1448319 tid 1 2020-11-16T22:10:39.189 INFO:tasks.rados.rados.2.smithi057.stdout:2331: writing smithi05720651-38 from 1952953 to 2611563 tid 2 2020-11-16T22:10:39.193 INFO:tasks.rados.rados.2.smithi057.stdout:2331: writing smithi05720651-38 from 3157167 to 3193495 tid 3 2020-11-16T22:10:39.193 INFO:tasks.rados.rados.2.smithi057.stdout:2332: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:39.193 INFO:tasks.rados.rados.2.smithi057.stdout:2332: expect (ObjNum 683 snap 238 seq_num 683) 2020-11-16T22:10:39.194 INFO:tasks.rados.rados.2.smithi057.stdout:2333: write oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 272 2020-11-16T22:10:39.194 INFO:tasks.rados.rados.2.smithi057.stdout:2333: seq_num 786 ranges {410302=730073,1895082=402268,2951884=258418} 2020-11-16T22:10:39.200 INFO:tasks.rados.rados.2.smithi057.stdout:2333: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 410302 to 1140375 tid 1 2020-11-16T22:10:39.206 INFO:tasks.rados.rados.2.smithi057.stdout:2333: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1895082 to 2297350 tid 2 2020-11-16T22:10:39.212 INFO:tasks.rados.rados.2.smithi057.stdout:2333: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2951884 to 3210302 tid 3 2020-11-16T22:10:39.212 INFO:tasks.rados.rados.2.smithi057.stdout:2334: read oid 24 snap -1 2020-11-16T22:10:39.212 INFO:tasks.rados.rados.2.smithi057.stdout:2334: expect (ObjNum 679 snap 236 seq_num 679) 2020-11-16T22:10:39.213 INFO:tasks.rados.rados.2.smithi057.stdout:2335: copy_from oid 20 from oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 272 2020-11-16T22:10:39.213 INFO:tasks.rados.rados.2.smithi057.stdout:2331: finishing write tid 1 to smithi05720651-38 2020-11-16T22:10:39.213 INFO:tasks.rados.rados.2.smithi057.stdout:2331: finishing write tid 2 to smithi05720651-38 2020-11-16T22:10:39.213 INFO:tasks.rados.rados.2.smithi057.stdout:2331: finishing write tid 3 to smithi05720651-38 2020-11-16T22:10:39.213 INFO:tasks.rados.rados.2.smithi057.stdout:2336: delete oid 48 current snap is 272 2020-11-16T22:10:39.213 INFO:tasks.rados.rados.2.smithi057.stdout:2331: finishing write tid 5 to smithi05720651-38 2020-11-16T22:10:39.213 INFO:tasks.rados.rados.2.smithi057.stdout:2331: finishing write tid 6 to smithi05720651-38 2020-11-16T22:10:39.214 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 1410 (ObjNum 785 snap 272 seq_num 785) dirty exists 2020-11-16T22:10:39.214 INFO:tasks.rados.rados.2.smithi057.stdout:2331: left oid 38 (ObjNum 785 snap 272 seq_num 785) 2020-11-16T22:10:39.214 INFO:tasks.rados.rados.2.smithi057.stdout:2332: expect (ObjNum 683 snap 238 seq_num 683) 2020-11-16T22:10:39.421 INFO:tasks.rados.rados.2.smithi057.stdout:2333: finishing write tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:39.421 INFO:tasks.rados.rados.2.smithi057.stdout:2333: finishing write tid 2 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:39.421 INFO:tasks.rados.rados.2.smithi057.stdout:2333: finishing write tid 3 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:39.421 INFO:tasks.rados.rados.2.smithi057.stdout:2333: finishing write tid 5 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:39.421 INFO:tasks.rados.rados.2.smithi057.stdout:2333: finishing write tid 6 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:39.422 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1511 (ObjNum 786 snap 272 seq_num 786) dirty exists 2020-11-16T22:10:39.422 INFO:tasks.rados.rados.2.smithi057.stdout:2333: left oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 786 snap 272 seq_num 786) 2020-11-16T22:10:39.422 INFO:tasks.rados.rados.2.smithi057.stdout:2334: expect (ObjNum 679 snap 236 seq_num 679) 2020-11-16T22:10:39.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:39 smithi057 bash[10301]: cluster 2020-11-16T22:10:37.752284+0000 mgr.x (mgr.24115) 540 : cluster [DBG] pgmap v1079: 17 pgs: 17 active+clean; 240 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 353 KiB/s wr, 7 op/s 2020-11-16T22:10:39.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:39 smithi016 bash[10302]: cluster 2020-11-16T22:10:37.752284+0000 mgr.x (mgr.24115) 540 : cluster [DBG] pgmap v1079: 17 pgs: 17 active+clean; 240 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 353 KiB/s wr, 7 op/s 2020-11-16T22:10:39.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:39 smithi195 bash[10218]: cluster 2020-11-16T22:10:37.752284+0000 mgr.x (mgr.24115) 540 : cluster [DBG] pgmap v1079: 17 pgs: 17 active+clean; 240 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 353 KiB/s wr, 7 op/s 2020-11-16T22:10:39.614 INFO:tasks.rados.rados.2.smithi057.stdout:2335: finishing copy_from to smithi05720651-20 2020-11-16T22:10:39.615 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1768 (ObjNum 724 snap 251 seq_num 724) dirty exists 2020-11-16T22:10:39.615 INFO:tasks.rados.rados.2.smithi057.stdout:2335: finishing copy_from racing read to smithi05720651-20 2020-11-16T22:10:39.615 INFO:tasks.rados.rados.2.smithi057.stdout:2331: done (5 left) 2020-11-16T22:10:39.615 INFO:tasks.rados.rados.2.smithi057.stdout:2332: done (4 left) 2020-11-16T22:10:39.615 INFO:tasks.rados.rados.2.smithi057.stdout:2333: done (3 left) 2020-11-16T22:10:39.615 INFO:tasks.rados.rados.2.smithi057.stdout:2334: done (2 left) 2020-11-16T22:10:39.616 INFO:tasks.rados.rados.2.smithi057.stdout:2335: done (1 left) 2020-11-16T22:10:39.616 INFO:tasks.rados.rados.2.smithi057.stdout:2336: done (0 left) 2020-11-16T22:10:39.616 INFO:tasks.rados.rados.2.smithi057.stdout:2337: write (excl) oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 272 2020-11-16T22:10:39.616 INFO:tasks.rados.rados.2.smithi057.stdout:2337: seq_num 788 ranges {443916=480571,1612046=405937,2606730=495052} 2020-11-16T22:10:39.620 INFO:tasks.rados.rados.2.smithi057.stdout:2337: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 443916 to 924487 tid 1 2020-11-16T22:10:39.626 INFO:tasks.rados.rados.2.smithi057.stdout:2337: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1612046 to 2017983 tid 2 2020-11-16T22:10:39.632 INFO:tasks.rados.rados.2.smithi057.stdout:2337: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2606730 to 3101782 tid 3 2020-11-16T22:10:39.632 INFO:tasks.rados.rados.2.smithi057.stdout:2338: write oid 44 current snap is 272 2020-11-16T22:10:39.632 INFO:tasks.rados.rados.2.smithi057.stdout:2338: seq_num 789 ranges {460723=555820,1670528=549595,2634153=626570} 2020-11-16T22:10:39.638 INFO:tasks.rados.rados.2.smithi057.stdout:2338: writing smithi05720651-44 from 460723 to 1016543 tid 1 2020-11-16T22:10:39.644 INFO:tasks.rados.rados.2.smithi057.stdout:2338: writing smithi05720651-44 from 1670528 to 2220123 tid 2 2020-11-16T22:10:39.651 INFO:tasks.rados.rados.2.smithi057.stdout:2338: writing smithi05720651-44 from 2634153 to 3260723 tid 3 2020-11-16T22:10:39.651 INFO:tasks.rados.rados.2.smithi057.stdout:2339: copy_from oid 16 from oid 26 current snap is 272 2020-11-16T22:10:39.651 INFO:tasks.rados.rados.2.smithi057.stdout:2337: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:39.651 INFO:tasks.rados.rados.2.smithi057.stdout:2337: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:39.651 INFO:tasks.rados.rados.2.smithi057.stdout:2337: finishing write tid 3 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:39.652 INFO:tasks.rados.rados.2.smithi057.stdout:2337: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:39.652 INFO:tasks.rados.rados.2.smithi057.stdout:2340: snap_create 2020-11-16T22:10:39.652 INFO:tasks.rados.rados.2.smithi057.stdout:2337: finishing write tid 6 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:39.652 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1937 (ObjNum 788 snap 272 seq_num 788) dirty exists 2020-11-16T22:10:39.652 INFO:tasks.rados.rados.2.smithi057.stdout:2337: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 788 snap 272 seq_num 788) 2020-11-16T22:10:39.652 INFO:tasks.rados.rados.2.smithi057.stdout:2338: finishing write tid 1 to smithi05720651-44 2020-11-16T22:10:39.652 INFO:tasks.rados.rados.2.smithi057.stdout:2338: finishing write tid 2 to smithi05720651-44 2020-11-16T22:10:39.654 INFO:tasks.rados.rados.2.smithi057.stdout:2339: finishing copy_from to smithi05720651-16 2020-11-16T22:10:39.654 INFO:tasks.rados.rados.2.smithi057.stdout:2339: got expected ENOENT (src dne) 2020-11-16T22:10:39.654 INFO:tasks.rados.rados.2.smithi057.stdout:2339: finishing copy_from racing read to smithi05720651-16 2020-11-16T22:10:39.655 INFO:tasks.rados.rados.2.smithi057.stdout:2338: finishing write tid 3 to smithi05720651-44 2020-11-16T22:10:39.656 INFO:tasks.rados.rados.2.smithi057.stdout:2338: finishing write tid 5 to smithi05720651-44 2020-11-16T22:10:39.656 INFO:tasks.rados.rados.2.smithi057.stdout:2338: finishing write tid 6 to smithi05720651-44 2020-11-16T22:10:39.656 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 1143 (ObjNum 789 snap 272 seq_num 789) dirty exists 2020-11-16T22:10:39.657 INFO:tasks.rados.rados.2.smithi057.stdout:2338: left oid 44 (ObjNum 789 snap 272 seq_num 789) 2020-11-16T22:10:40.066 INFO:tasks.rados.rados.2.smithi057.stdout:2337: done (3 left) 2020-11-16T22:10:40.066 INFO:tasks.rados.rados.2.smithi057.stdout:2338: done (2 left) 2020-11-16T22:10:40.066 INFO:tasks.rados.rados.2.smithi057.stdout:2339: done (1 left) 2020-11-16T22:10:40.067 INFO:tasks.rados.rados.2.smithi057.stdout:2340: done (0 left) 2020-11-16T22:10:40.067 INFO:tasks.rados.rados.2.smithi057.stdout:2341: delete oid 2 current snap is 273 2020-11-16T22:10:40.075 INFO:tasks.rados.rados.2.smithi057.stdout:2341: done (0 left) 2020-11-16T22:10:40.075 INFO:tasks.rados.rados.2.smithi057.stdout:2342: read oid 46 snap -1 2020-11-16T22:10:40.075 INFO:tasks.rados.rados.2.smithi057.stdout:2342: expect (ObjNum 743 snap 259 seq_num 743) 2020-11-16T22:10:40.075 INFO:tasks.rados.rados.2.smithi057.stdout:2343: read oid 16 snap 257 2020-11-16T22:10:40.075 INFO:tasks.rados.rados.2.smithi057.stdout:2343: expect (ObjNum 650 snap 228 seq_num 650) 2020-11-16T22:10:40.075 INFO:tasks.rados.rados.2.smithi057.stdout:2344: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:40.076 INFO:tasks.rados.rados.2.smithi057.stdout:2344: expect (ObjNum 699 snap 243 seq_num 699) 2020-11-16T22:10:40.076 INFO:tasks.rados.rados.2.smithi057.stdout:2345: read oid 48 snap 257 2020-11-16T22:10:40.076 INFO:tasks.rados.rados.2.smithi057.stdout:2345: expect deleted 2020-11-16T22:10:40.076 INFO:tasks.rados.rados.2.smithi057.stdout:2346: snap_remove snap 245 2020-11-16T22:10:40.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:40 smithi057 bash[10301]: cluster 2020-11-16T22:10:39.143298+0000 mon.a (mon.0) 1271 : cluster [DBG] osdmap e611: 12 total, 12 up, 12 in 2020-11-16T22:10:40.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:40 smithi057 bash[10301]: cluster 2020-11-16T22:10:40.077396+0000 mon.a (mon.0) 1272 : cluster [DBG] osdmap e612: 12 total, 12 up, 12 in 2020-11-16T22:10:40.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:40 smithi016 bash[10302]: cluster 2020-11-16T22:10:39.143298+0000 mon.a (mon.0) 1271 : cluster [DBG] osdmap e611: 12 total, 12 up, 12 in 2020-11-16T22:10:40.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:40 smithi016 bash[10302]: cluster 2020-11-16T22:10:40.077396+0000 mon.a (mon.0) 1272 : cluster [DBG] osdmap e612: 12 total, 12 up, 12 in 2020-11-16T22:10:40.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:40 smithi195 bash[10218]: cluster 2020-11-16T22:10:39.143298+0000 mon.a (mon.0) 1271 : cluster [DBG] osdmap e611: 12 total, 12 up, 12 in 2020-11-16T22:10:40.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:40 smithi195 bash[10218]: cluster 2020-11-16T22:10:40.077396+0000 mon.a (mon.0) 1272 : cluster [DBG] osdmap e612: 12 total, 12 up, 12 in 2020-11-16T22:10:41.077 INFO:tasks.rados.rados.2.smithi057.stdout:2346: done (4 left) 2020-11-16T22:10:41.077 INFO:tasks.rados.rados.2.smithi057.stdout:2347: write (excl) oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 273 2020-11-16T22:10:41.077 INFO:tasks.rados.rados.2.smithi057.stdout:2347: seq_num 791 ranges {494337=422671,1387492=553264,2688999=445221} 2020-11-16T22:10:41.091 INFO:tasks.rados.rados.2.smithi057.stdout:2347: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 494337 to 917008 tid 1 2020-11-16T22:10:41.097 INFO:tasks.rados.rados.2.smithi057.stdout:2347: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1387492 to 1940756 tid 2 2020-11-16T22:10:41.104 INFO:tasks.rados.rados.2.smithi057.stdout:2347: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2688999 to 3134220 tid 3 2020-11-16T22:10:41.104 INFO:tasks.rados.rados.2.smithi057.stdout:2348: write (excl) oid 8 current snap is 273 2020-11-16T22:10:41.104 INFO:tasks.rados.rados.2.smithi057.stdout:2348: seq_num 792 ranges {511144=497920,1445974=413275,2316422=656493} 2020-11-16T22:10:41.110 INFO:tasks.rados.rados.2.smithi057.stdout:2348: writing smithi05720651-8 from 511144 to 1009064 tid 1 2020-11-16T22:10:41.114 INFO:tasks.rados.rados.2.smithi057.stdout:2348: writing smithi05720651-8 from 1445974 to 1859249 tid 2 2020-11-16T22:10:41.121 INFO:tasks.rados.rados.2.smithi057.stdout:2348: writing smithi05720651-8 from 2316422 to 2972915 tid 3 2020-11-16T22:10:41.122 INFO:tasks.rados.rados.2.smithi057.stdout:2349: copy_from oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 273 2020-11-16T22:10:41.122 INFO:tasks.rados.rados.2.smithi057.stdout:2342: expect (ObjNum 743 snap 259 seq_num 743) 2020-11-16T22:10:41.205 INFO:tasks.rados.rados.2.smithi057.stdout:2343: expect (ObjNum 650 snap 228 seq_num 650) 2020-11-16T22:10:41.404 INFO:tasks.rados.rados.2.smithi057.stdout:2344: expect (ObjNum 699 snap 243 seq_num 699) 2020-11-16T22:10:41.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:41 smithi057 bash[10301]: cluster 2020-11-16T22:10:39.753008+0000 mgr.x (mgr.24115) 541 : cluster [DBG] pgmap v1082: 17 pgs: 17 active+clean; 240 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 353 KiB/s wr, 3 op/s 2020-11-16T22:10:41.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:41 smithi057 bash[10301]: cluster 2020-11-16T22:10:41.088187+0000 mon.a (mon.0) 1273 : cluster [DBG] osdmap e613: 12 total, 12 up, 12 in 2020-11-16T22:10:41.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:41 smithi016 bash[10302]: cluster 2020-11-16T22:10:39.753008+0000 mgr.x (mgr.24115) 541 : cluster [DBG] pgmap v1082: 17 pgs: 17 active+clean; 240 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 353 KiB/s wr, 3 op/s 2020-11-16T22:10:41.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:41 smithi016 bash[10302]: cluster 2020-11-16T22:10:41.088187+0000 mon.a (mon.0) 1273 : cluster [DBG] osdmap e613: 12 total, 12 up, 12 in 2020-11-16T22:10:41.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:41 smithi195 bash[10218]: cluster 2020-11-16T22:10:39.753008+0000 mgr.x (mgr.24115) 541 : cluster [DBG] pgmap v1082: 17 pgs: 17 active+clean; 240 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 353 KiB/s wr, 3 op/s 2020-11-16T22:10:41.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:41 smithi195 bash[10218]: cluster 2020-11-16T22:10:41.088187+0000 mon.a (mon.0) 1273 : cluster [DBG] osdmap e613: 12 total, 12 up, 12 in 2020-11-16T22:10:41.631 INFO:tasks.rados.rados.2.smithi057.stdout:2347: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:41.632 INFO:tasks.rados.rados.2.smithi057.stdout:2348: finishing write tid 1 to smithi05720651-8 2020-11-16T22:10:41.632 INFO:tasks.rados.rados.2.smithi057.stdout:2348: finishing write tid 2 to smithi05720651-8 2020-11-16T22:10:41.632 INFO:tasks.rados.rados.2.smithi057.stdout:2347: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:41.632 INFO:tasks.rados.rados.2.smithi057.stdout:2347: finishing write tid 3 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:41.632 INFO:tasks.rados.rados.2.smithi057.stdout:2347: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:41.632 INFO:tasks.rados.rados.2.smithi057.stdout:2347: finishing write tid 6 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:41.632 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1414 (ObjNum 791 snap 273 seq_num 791) dirty exists 2020-11-16T22:10:41.633 INFO:tasks.rados.rados.2.smithi057.stdout:2347: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 791 snap 273 seq_num 791) 2020-11-16T22:10:41.633 INFO:tasks.rados.rados.2.smithi057.stdout:2348: finishing write tid 3 to smithi05720651-8 2020-11-16T22:10:41.633 INFO:tasks.rados.rados.2.smithi057.stdout:2348: finishing write tid 5 to smithi05720651-8 2020-11-16T22:10:41.633 INFO:tasks.rados.rados.2.smithi057.stdout:2348: finishing write tid 6 to smithi05720651-8 2020-11-16T22:10:41.633 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 1565 (ObjNum 792 snap 273 seq_num 792) dirty exists 2020-11-16T22:10:41.633 INFO:tasks.rados.rados.2.smithi057.stdout:2348: left oid 8 (ObjNum 792 snap 273 seq_num 792) 2020-11-16T22:10:41.633 INFO:tasks.rados.rados.2.smithi057.stdout:2349: finishing copy_from to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:41.634 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1752 (ObjNum 781 snap 272 seq_num 781) dirty exists 2020-11-16T22:10:41.634 INFO:tasks.rados.rados.2.smithi057.stdout:2349: finishing copy_from racing read to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:41.634 INFO:tasks.rados.rados.2.smithi057.stdout:2342: done (6 left) 2020-11-16T22:10:41.634 INFO:tasks.rados.rados.2.smithi057.stdout:2343: done (5 left) 2020-11-16T22:10:41.634 INFO:tasks.rados.rados.2.smithi057.stdout:2344: done (4 left) 2020-11-16T22:10:41.634 INFO:tasks.rados.rados.2.smithi057.stdout:2345: done (3 left) 2020-11-16T22:10:41.634 INFO:tasks.rados.rados.2.smithi057.stdout:2347: done (2 left) 2020-11-16T22:10:41.635 INFO:tasks.rados.rados.2.smithi057.stdout:2348: done (1 left) 2020-11-16T22:10:41.635 INFO:tasks.rados.rados.2.smithi057.stdout:2349: done (0 left) 2020-11-16T22:10:41.635 INFO:tasks.rados.rados.2.smithi057.stdout:2350: read oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:41.635 INFO:tasks.rados.rados.2.smithi057.stdout:2350: expect deleted 2020-11-16T22:10:41.635 INFO:tasks.rados.rados.2.smithi057.stdout:2351: snap_create 2020-11-16T22:10:42.158 INFO:tasks.rados.rados.2.smithi057.stdout:2350: done (1 left) 2020-11-16T22:10:42.158 INFO:tasks.rados.rados.2.smithi057.stdout:2351: done (0 left) 2020-11-16T22:10:42.158 INFO:tasks.rados.rados.2.smithi057.stdout:2352: read oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:42.159 INFO:tasks.rados.rados.2.smithi057.stdout:2352: expect (ObjNum 781 snap 272 seq_num 781) 2020-11-16T22:10:42.159 INFO:tasks.rados.rados.2.smithi057.stdout:2353: snap_create 2020-11-16T22:10:42.173 INFO:tasks.rados.rados.2.smithi057.stdout:2352: expect (ObjNum 781 snap 272 seq_num 781) 2020-11-16T22:10:43.161 INFO:tasks.rados.rados.2.smithi057.stdout:2352: done (1 left) 2020-11-16T22:10:43.176 INFO:tasks.rados.rados.2.smithi057.stdout:2353: done (0 left) 2020-11-16T22:10:43.177 INFO:tasks.rados.rados.2.smithi057.stdout:2354: write (excl) oid 10 current snap is 275 2020-11-16T22:10:43.177 INFO:tasks.rados.rados.2.smithi057.stdout:2354: seq_num 793 ranges {527951=573169,1504456=556933,2743845=467765} 2020-11-16T22:10:43.177 INFO:tasks.rados.rados.2.smithi057.stdout:2354: writing smithi05720651-10 from 527951 to 1101120 tid 1 2020-11-16T22:10:43.181 INFO:tasks.rados.rados.2.smithi057.stdout:2354: writing smithi05720651-10 from 1504456 to 2061389 tid 2 2020-11-16T22:10:43.188 INFO:tasks.rados.rados.2.smithi057.stdout:2354: writing smithi05720651-10 from 2743845 to 3211610 tid 3 2020-11-16T22:10:43.188 INFO:tasks.rados.rados.2.smithi057.stdout:2355: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:43.188 INFO:tasks.rados.rados.2.smithi057.stdout:2355: expect (ObjNum 724 snap 251 seq_num 724) 2020-11-16T22:10:43.189 INFO:tasks.rados.rados.2.smithi057.stdout:2356: delete oid 26 current snap is 275 2020-11-16T22:10:43.189 INFO:tasks.rados.rados.2.smithi057.stdout:2354: finishing write tid 1 to smithi05720651-10 2020-11-16T22:10:43.192 INFO:tasks.rados.rados.2.smithi057.stdout:2354: finishing write tid 2 to smithi05720651-10 2020-11-16T22:10:43.194 INFO:tasks.rados.rados.2.smithi057.stdout:2354: finishing write tid 3 to smithi05720651-10 2020-11-16T22:10:43.194 INFO:tasks.rados.rados.2.smithi057.stdout:2354: finishing write tid 5 to smithi05720651-10 2020-11-16T22:10:43.195 INFO:tasks.rados.rados.2.smithi057.stdout:2354: finishing write tid 6 to smithi05720651-10 2020-11-16T22:10:43.195 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 1381 (ObjNum 793 snap 275 seq_num 793) dirty exists 2020-11-16T22:10:43.195 INFO:tasks.rados.rados.2.smithi057.stdout:2354: left oid 10 (ObjNum 793 snap 275 seq_num 793) 2020-11-16T22:10:43.200 INFO:tasks.rados.rados.2.smithi057.stdout:2355: expect (ObjNum 724 snap 251 seq_num 724) 2020-11-16T22:10:43.412 INFO:tasks.rados.rados.2.smithi057.stdout:2354: done (2 left) 2020-11-16T22:10:43.412 INFO:tasks.rados.rados.2.smithi057.stdout:2355: done (1 left) 2020-11-16T22:10:43.412 INFO:tasks.rados.rados.2.smithi057.stdout:2356: done (0 left) 2020-11-16T22:10:43.413 INFO:tasks.rados.rados.2.smithi057.stdout:2357: read oid 48 snap 272 2020-11-16T22:10:43.413 INFO:tasks.rados.rados.2.smithi057.stdout:2357: expect deleted 2020-11-16T22:10:43.413 INFO:tasks.rados.rados.2.smithi057.stdout:2358: snap_create 2020-11-16T22:10:43.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:43 smithi057 bash[10301]: cluster 2020-11-16T22:10:41.753847+0000 mgr.x (mgr.24115) 542 : cluster [DBG] pgmap v1085: 17 pgs: 17 active+clean; 246 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.6 MiB/s wr, 24 op/s 2020-11-16T22:10:43.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:43 smithi057 bash[10301]: cluster 2020-11-16T22:10:42.169606+0000 mon.a (mon.0) 1274 : cluster [DBG] osdmap e614: 12 total, 12 up, 12 in 2020-11-16T22:10:43.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:43 smithi016 bash[10302]: cluster 2020-11-16T22:10:41.753847+0000 mgr.x (mgr.24115) 542 : cluster [DBG] pgmap v1085: 17 pgs: 17 active+clean; 246 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.6 MiB/s wr, 24 op/s 2020-11-16T22:10:43.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:43 smithi016 bash[10302]: cluster 2020-11-16T22:10:42.169606+0000 mon.a (mon.0) 1274 : cluster [DBG] osdmap e614: 12 total, 12 up, 12 in 2020-11-16T22:10:43.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:43 smithi195 bash[10218]: cluster 2020-11-16T22:10:41.753847+0000 mgr.x (mgr.24115) 542 : cluster [DBG] pgmap v1085: 17 pgs: 17 active+clean; 246 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.6 MiB/s wr, 24 op/s 2020-11-16T22:10:43.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:43 smithi195 bash[10218]: cluster 2020-11-16T22:10:42.169606+0000 mon.a (mon.0) 1274 : cluster [DBG] osdmap e614: 12 total, 12 up, 12 in 2020-11-16T22:10:44.181 INFO:tasks.rados.rados.2.smithi057.stdout:2357: done (1 left) 2020-11-16T22:10:44.181 INFO:tasks.rados.rados.2.smithi057.stdout:2358: done (0 left) 2020-11-16T22:10:44.181 INFO:tasks.rados.rados.2.smithi057.stdout:2359: delete oid 24 current snap is 276 2020-11-16T22:10:44.186 INFO:tasks.rados.rados.2.smithi057.stdout:2359: done (0 left) 2020-11-16T22:10:44.186 INFO:tasks.rados.rados.2.smithi057.stdout:2360: write (excl) oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 276 2020-11-16T22:10:44.186 INFO:tasks.rados.rados.2.smithi057.stdout:2360: seq_num 796 ranges {578372=798916,1963549=420613,2826114=417934} 2020-11-16T22:10:44.203 INFO:tasks.rados.rados.2.smithi057.stdout:2360: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 578372 to 1377288 tid 1 2020-11-16T22:10:44.209 INFO:tasks.rados.rados.2.smithi057.stdout:2360: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1963549 to 2384162 tid 2 2020-11-16T22:10:44.214 INFO:tasks.rados.rados.2.smithi057.stdout:2360: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2826114 to 3244048 tid 3 2020-11-16T22:10:44.214 INFO:tasks.rados.rados.2.smithi057.stdout:2361: write oid 12 current snap is 276 2020-11-16T22:10:44.214 INFO:tasks.rados.rados.2.smithi057.stdout:2361: seq_num 797 ranges {595179=474165,1622031=564271,2737184=629206} 2020-11-16T22:10:44.220 INFO:tasks.rados.rados.2.smithi057.stdout:2361: writing smithi05720651-12 from 595179 to 1069344 tid 1 2020-11-16T22:10:44.226 INFO:tasks.rados.rados.2.smithi057.stdout:2361: writing smithi05720651-12 from 1622031 to 2186302 tid 2 2020-11-16T22:10:44.233 INFO:tasks.rados.rados.2.smithi057.stdout:2361: writing smithi05720651-12 from 2737184 to 3366390 tid 3 2020-11-16T22:10:44.233 INFO:tasks.rados.rados.2.smithi057.stdout:2362: snap_remove snap 257 2020-11-16T22:10:44.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:44 smithi057 bash[10301]: cluster 2020-11-16T22:10:43.172729+0000 mon.a (mon.0) 1275 : cluster [DBG] osdmap e615: 12 total, 12 up, 12 in 2020-11-16T22:10:44.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:44 smithi016 bash[10302]: cluster 2020-11-16T22:10:43.172729+0000 mon.a (mon.0) 1275 : cluster [DBG] osdmap e615: 12 total, 12 up, 12 in 2020-11-16T22:10:44.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:44 smithi195 bash[10218]: cluster 2020-11-16T22:10:43.172729+0000 mon.a (mon.0) 1275 : cluster [DBG] osdmap e615: 12 total, 12 up, 12 in 2020-11-16T22:10:45.069 INFO:tasks.rados.rados.2.smithi057.stdout:2362: done (2 left) 2020-11-16T22:10:45.070 INFO:tasks.rados.rados.2.smithi057.stdout:2363: write oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 276 2020-11-16T22:10:45.070 INFO:tasks.rados.rados.2.smithi057.stdout:2363: seq_num 798 ranges {611986=549414,1564160=424282,2764607=440478} 2020-11-16T22:10:45.082 INFO:tasks.rados.rados.2.smithi057.stdout:2363: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 611986 to 1161400 tid 1 2020-11-16T22:10:45.085 INFO:tasks.rados.rados.2.smithi057.stdout:2363: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1564160 to 1988442 tid 2 2020-11-16T22:10:45.092 INFO:tasks.rados.rados.2.smithi057.stdout:2363: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2764607 to 3205085 tid 3 2020-11-16T22:10:45.093 INFO:tasks.rados.rados.2.smithi057.stdout:2364: rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 276 2020-11-16T22:10:45.093 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 251 2020-11-16T22:10:45.093 INFO:tasks.rados.rados.2.smithi057.stdout:2360: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.093 INFO:tasks.rados.rados.2.smithi057.stdout:2360: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.093 INFO:tasks.rados.rados.2.smithi057.stdout:2360: finishing write tid 3 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.093 INFO:tasks.rados.rados.2.smithi057.stdout:2360: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.094 INFO:tasks.rados.rados.2.smithi057.stdout:2360: finishing write tid 6 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.094 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1750 (ObjNum 796 snap 276 seq_num 796) dirty exists 2020-11-16T22:10:45.094 INFO:tasks.rados.rados.2.smithi057.stdout:2360: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 796 snap 276 seq_num 796) 2020-11-16T22:10:45.094 INFO:tasks.rados.rados.2.smithi057.stdout:2361: finishing write tid 1 to smithi05720651-12 2020-11-16T22:10:45.094 INFO:tasks.rados.rados.2.smithi057.stdout:2361: finishing write tid 2 to smithi05720651-12 2020-11-16T22:10:45.094 INFO:tasks.rados.rados.2.smithi057.stdout:2360: done (3 left) 2020-11-16T22:10:45.094 INFO:tasks.rados.rados.2.smithi057.stdout:2365: write oid 38 current snap is 276 2020-11-16T22:10:45.095 INFO:tasks.rados.rados.2.smithi057.stdout:2365: seq_num 799 ranges {628793=741016,2138995=567940,3192030=236763} 2020-11-16T22:10:45.100 INFO:tasks.rados.rados.2.smithi057.stdout:2365: writing smithi05720651-38 from 628793 to 1369809 tid 1 2020-11-16T22:10:45.108 INFO:tasks.rados.rados.2.smithi057.stdout:2365: writing smithi05720651-38 from 2138995 to 2706935 tid 2 2020-11-16T22:10:45.112 INFO:tasks.rados.rados.2.smithi057.stdout:2365: writing smithi05720651-38 from 3192030 to 3428793 tid 3 2020-11-16T22:10:45.112 INFO:tasks.rados.rados.2.smithi057.stdout:2366: write oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 276 2020-11-16T22:10:45.113 INFO:tasks.rados.rados.2.smithi057.stdout:2366: seq_num 800 ranges {645600=416265,1797477=711598,3219453=226147} 2020-11-16T22:10:45.118 INFO:tasks.rados.rados.2.smithi057.stdout:2366: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 645600 to 1061865 tid 1 2020-11-16T22:10:45.126 INFO:tasks.rados.rados.2.smithi057.stdout:2366: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1797477 to 2509075 tid 2 2020-11-16T22:10:45.133 INFO:tasks.rados.rados.2.smithi057.stdout:2366: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3219453 to 3445600 tid 3 2020-11-16T22:10:45.133 INFO:tasks.rados.rados.2.smithi057.stdout:2367: delete oid 10 current snap is 276 2020-11-16T22:10:45.133 INFO:tasks.rados.rados.2.smithi057.stdout:2361: finishing write tid 3 to smithi05720651-12 2020-11-16T22:10:45.133 INFO:tasks.rados.rados.2.smithi057.stdout:2361: finishing write tid 5 to smithi05720651-12 2020-11-16T22:10:45.133 INFO:tasks.rados.rados.2.smithi057.stdout:2361: finishing write tid 6 to smithi05720651-12 2020-11-16T22:10:45.134 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 1147 (ObjNum 797 snap 276 seq_num 797) dirty exists 2020-11-16T22:10:45.134 INFO:tasks.rados.rados.2.smithi057.stdout:2361: left oid 12 (ObjNum 797 snap 276 seq_num 797) 2020-11-16T22:10:45.134 INFO:tasks.rados.rados.2.smithi057.stdout:2363: finishing write tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.134 INFO:tasks.rados.rados.2.smithi057.stdout:2363: finishing write tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.134 INFO:tasks.rados.rados.2.smithi057.stdout:2363: finishing write tid 3 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.134 INFO:tasks.rados.rados.2.smithi057.stdout:2363: finishing write tid 5 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.135 INFO:tasks.rados.rados.2.smithi057.stdout:2363: finishing write tid 6 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.135 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1966 (ObjNum 798 snap 276 seq_num 798) dirty exists 2020-11-16T22:10:45.135 INFO:tasks.rados.rados.2.smithi057.stdout:2363: left oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 798 snap 276 seq_num 798) 2020-11-16T22:10:45.135 INFO:tasks.rados.rados.2.smithi057.stdout:2364: finishing rollback tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.135 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1738 (ObjNum 385 snap 0 seq_num 2933977376) dirty dne 2020-11-16T22:10:45.135 INFO:tasks.rados.rados.2.smithi057.stdout:2365: finishing write tid 1 to smithi05720651-38 2020-11-16T22:10:45.136 INFO:tasks.rados.rados.2.smithi057.stdout:2365: finishing write tid 2 to smithi05720651-38 2020-11-16T22:10:45.136 INFO:tasks.rados.rados.2.smithi057.stdout:2365: finishing write tid 3 to smithi05720651-38 2020-11-16T22:10:45.136 INFO:tasks.rados.rados.2.smithi057.stdout:2365: finishing write tid 5 to smithi05720651-38 2020-11-16T22:10:45.136 INFO:tasks.rados.rados.2.smithi057.stdout:2365: finishing write tid 6 to smithi05720651-38 2020-11-16T22:10:45.136 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 1756 (ObjNum 799 snap 276 seq_num 799) dirty exists 2020-11-16T22:10:45.136 INFO:tasks.rados.rados.2.smithi057.stdout:2365: left oid 38 (ObjNum 799 snap 276 seq_num 799) 2020-11-16T22:10:45.136 INFO:tasks.rados.rados.2.smithi057.stdout:2366: finishing write tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.137 INFO:tasks.rados.rados.2.smithi057.stdout:2361: done (5 left) 2020-11-16T22:10:45.137 INFO:tasks.rados.rados.2.smithi057.stdout:2363: done (4 left) 2020-11-16T22:10:45.137 INFO:tasks.rados.rados.2.smithi057.stdout:2364: done (3 left) 2020-11-16T22:10:45.138 INFO:tasks.rados.rados.2.smithi057.stdout:2365: done (2 left) 2020-11-16T22:10:45.138 INFO:tasks.rados.rados.2.smithi057.stdout:2367: done (1 left) 2020-11-16T22:10:45.138 INFO:tasks.rados.rados.2.smithi057.stdout:2368: delete oid 46 current snap is 276 2020-11-16T22:10:45.138 INFO:tasks.rados.rados.2.smithi057.stdout:2366: finishing write tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.138 INFO:tasks.rados.rados.2.smithi057.stdout:2366: finishing write tid 3 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.139 INFO:tasks.rados.rados.2.smithi057.stdout:2366: finishing write tid 5 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.140 INFO:tasks.rados.rados.2.smithi057.stdout:2366: finishing write tid 6 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.140 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1704 (ObjNum 800 snap 276 seq_num 800) dirty exists 2020-11-16T22:10:45.140 INFO:tasks.rados.rados.2.smithi057.stdout:2366: left oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 800 snap 276 seq_num 800) 2020-11-16T22:10:45.141 INFO:tasks.rados.rados.2.smithi057.stdout:2366: done (1 left) 2020-11-16T22:10:45.141 INFO:tasks.rados.rados.2.smithi057.stdout:2368: done (0 left) 2020-11-16T22:10:45.142 INFO:tasks.rados.rados.2.smithi057.stdout:2369: read oid 20 snap -1 2020-11-16T22:10:45.142 INFO:tasks.rados.rados.2.smithi057.stdout:2369: expect (ObjNum 724 snap 251 seq_num 724) 2020-11-16T22:10:45.142 INFO:tasks.rados.rados.2.smithi057.stdout:2370: write (excl) oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 276 2020-11-16T22:10:45.142 INFO:tasks.rados.rados.2.smithi057.stdout:2370: seq_num 803 ranges {696021=642012,1856570=575278,3185369=310652} 2020-11-16T22:10:45.149 INFO:tasks.rados.rados.2.smithi057.stdout:2370: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 696021 to 1338033 tid 1 2020-11-16T22:10:45.157 INFO:tasks.rados.rados.2.smithi057.stdout:2370: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1856570 to 2431848 tid 2 2020-11-16T22:10:45.163 INFO:tasks.rados.rados.2.smithi057.stdout:2370: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3185369 to 3496021 tid 3 2020-11-16T22:10:45.164 INFO:tasks.rados.rados.2.smithi057.stdout:2371: write oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 276 2020-11-16T22:10:45.164 INFO:tasks.rados.rados.2.smithi057.stdout:2371: seq_num 804 ranges {712828=717261,1915052=718936,3212792=300036} 2020-11-16T22:10:45.172 INFO:tasks.rados.rados.2.smithi057.stdout:2371: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 712828 to 1430089 tid 1 2020-11-16T22:10:45.179 INFO:tasks.rados.rados.2.smithi057.stdout:2371: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1915052 to 2633988 tid 2 2020-11-16T22:10:45.184 INFO:tasks.rados.rados.2.smithi057.stdout:2371: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3212792 to 3512828 tid 3 2020-11-16T22:10:45.184 INFO:tasks.rados.rados.2.smithi057.stdout:2372: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 266 2020-11-16T22:10:45.184 INFO:tasks.rados.rados.2.smithi057.stdout:2372: expect (ObjNum 699 snap 243 seq_num 699) 2020-11-16T22:10:45.185 INFO:tasks.rados.rados.2.smithi057.stdout:2373: copy_from oid 30 from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 276 2020-11-16T22:10:45.185 INFO:tasks.rados.rados.2.smithi057.stdout:2369: expect (ObjNum 724 snap 251 seq_num 724) 2020-11-16T22:10:45.394 INFO:tasks.rados.rados.2.smithi057.stdout:2370: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.394 INFO:tasks.rados.rados.2.smithi057.stdout:2370: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.395 INFO:tasks.rados.rados.2.smithi057.stdout:2370: finishing write tid 3 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.395 INFO:tasks.rados.rados.2.smithi057.stdout:2370: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.395 INFO:tasks.rados.rados.2.smithi057.stdout:2370: finishing write tid 6 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.395 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1760 (ObjNum 803 snap 276 seq_num 803) dirty exists 2020-11-16T22:10:45.395 INFO:tasks.rados.rados.2.smithi057.stdout:2370: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 803 snap 276 seq_num 803) 2020-11-16T22:10:45.395 INFO:tasks.rados.rados.2.smithi057.stdout:2371: finishing write tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.396 INFO:tasks.rados.rados.2.smithi057.stdout:2371: finishing write tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.396 INFO:tasks.rados.rados.2.smithi057.stdout:2369: done (4 left) 2020-11-16T22:10:45.396 INFO:tasks.rados.rados.2.smithi057.stdout:2370: done (3 left) 2020-11-16T22:10:45.396 INFO:tasks.rados.rados.2.smithi057.stdout:2374: copy_from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 26 current snap is 276 2020-11-16T22:10:45.396 INFO:tasks.rados.rados.2.smithi057.stdout:2371: finishing write tid 3 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.396 INFO:tasks.rados.rados.2.smithi057.stdout:2371: finishing write tid 5 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.396 INFO:tasks.rados.rados.2.smithi057.stdout:2371: finishing write tid 6 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.397 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1970 (ObjNum 804 snap 276 seq_num 804) dirty exists 2020-11-16T22:10:45.397 INFO:tasks.rados.rados.2.smithi057.stdout:2371: left oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 804 snap 276 seq_num 804) 2020-11-16T22:10:45.397 INFO:tasks.rados.rados.2.smithi057.stdout:2372: expect (ObjNum 699 snap 243 seq_num 699) 2020-11-16T22:10:45.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:45 smithi057 bash[10301]: cluster 2020-11-16T22:10:43.754531+0000 mgr.x (mgr.24115) 543 : cluster [DBG] pgmap v1088: 17 pgs: 17 active+clean; 246 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 3.5 MiB/s wr, 27 op/s 2020-11-16T22:10:45.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:45 smithi057 bash[10301]: cluster 2020-11-16T22:10:44.192718+0000 mon.a (mon.0) 1276 : cluster [DBG] osdmap e616: 12 total, 12 up, 12 in 2020-11-16T22:10:45.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:45 smithi057 bash[10301]: cluster 2020-11-16T22:10:45.080433+0000 mon.a (mon.0) 1277 : cluster [DBG] osdmap e617: 12 total, 12 up, 12 in 2020-11-16T22:10:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:45 smithi016 bash[10302]: cluster 2020-11-16T22:10:43.754531+0000 mgr.x (mgr.24115) 543 : cluster [DBG] pgmap v1088: 17 pgs: 17 active+clean; 246 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 3.5 MiB/s wr, 27 op/s 2020-11-16T22:10:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:45 smithi016 bash[10302]: cluster 2020-11-16T22:10:44.192718+0000 mon.a (mon.0) 1276 : cluster [DBG] osdmap e616: 12 total, 12 up, 12 in 2020-11-16T22:10:45.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:45 smithi016 bash[10302]: cluster 2020-11-16T22:10:45.080433+0000 mon.a (mon.0) 1277 : cluster [DBG] osdmap e617: 12 total, 12 up, 12 in 2020-11-16T22:10:45.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:45 smithi195 bash[10218]: cluster 2020-11-16T22:10:43.754531+0000 mgr.x (mgr.24115) 543 : cluster [DBG] pgmap v1088: 17 pgs: 17 active+clean; 246 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 3.5 MiB/s wr, 27 op/s 2020-11-16T22:10:45.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:45 smithi195 bash[10218]: cluster 2020-11-16T22:10:44.192718+0000 mon.a (mon.0) 1276 : cluster [DBG] osdmap e616: 12 total, 12 up, 12 in 2020-11-16T22:10:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:45 smithi195 bash[10218]: cluster 2020-11-16T22:10:45.080433+0000 mon.a (mon.0) 1277 : cluster [DBG] osdmap e617: 12 total, 12 up, 12 in 2020-11-16T22:10:45.625 INFO:tasks.rados.rados.2.smithi057.stdout:2373: finishing copy_from to smithi05720651-30 2020-11-16T22:10:45.625 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 1651 (ObjNum 734 snap 252 seq_num 734) dirty exists 2020-11-16T22:10:45.625 INFO:tasks.rados.rados.2.smithi057.stdout:2373: finishing copy_from racing read to smithi05720651-30 2020-11-16T22:10:45.625 INFO:tasks.rados.rados.2.smithi057.stdout:2374: finishing copy_from to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.626 INFO:tasks.rados.rados.2.smithi057.stdout:2374: got expected ENOENT (src dne) 2020-11-16T22:10:45.626 INFO:tasks.rados.rados.2.smithi057.stdout:2374: finishing copy_from racing read to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:45.626 INFO:tasks.rados.rados.2.smithi057.stdout:2371: done (3 left) 2020-11-16T22:10:45.626 INFO:tasks.rados.rados.2.smithi057.stdout:2372: done (2 left) 2020-11-16T22:10:45.626 INFO:tasks.rados.rados.2.smithi057.stdout:2373: done (1 left) 2020-11-16T22:10:45.626 INFO:tasks.rados.rados.2.smithi057.stdout:2374: done (0 left) 2020-11-16T22:10:45.626 INFO:tasks.rados.rados.2.smithi057.stdout:2375: snap_remove snap 269 2020-11-16T22:10:46.192 INFO:tasks.rados.rados.2.smithi057.stdout:2375: done (0 left) 2020-11-16T22:10:46.192 INFO:tasks.rados.rados.2.smithi057.stdout:2376: snap_remove snap 273 2020-11-16T22:10:47.201 INFO:tasks.rados.rados.2.smithi057.stdout:2376: done (0 left) 2020-11-16T22:10:47.201 INFO:tasks.rados.rados.2.smithi057.stdout:2377: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:47.201 INFO:tasks.rados.rados.2.smithi057.stdout:2377: expect (ObjNum 780 snap 271 seq_num 780) 2020-11-16T22:10:47.201 INFO:tasks.rados.rados.2.smithi057.stdout:2378: write oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 276 2020-11-16T22:10:47.201 INFO:tasks.rados.rados.2.smithi057.stdout:2378: seq_num 805 ranges {729635=792510,1973534=578947,3240215=289420} 2020-11-16T22:10:47.218 INFO:tasks.rados.rados.2.smithi057.stdout:2378: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 729635 to 1522145 tid 1 2020-11-16T22:10:47.223 INFO:tasks.rados.rados.2.smithi057.stdout:2378: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1973534 to 2552481 tid 2 2020-11-16T22:10:47.229 INFO:tasks.rados.rados.2.smithi057.stdout:2378: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3240215 to 3529635 tid 3 2020-11-16T22:10:47.229 INFO:tasks.rados.rados.2.smithi057.stdout:2379: read oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:47.230 INFO:tasks.rados.rados.2.smithi057.stdout:2379: expect (ObjNum 800 snap 276 seq_num 800) 2020-11-16T22:10:47.230 INFO:tasks.rados.rados.2.smithi057.stdout:2380: snap_remove snap 262 2020-11-16T22:10:47.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:47 smithi057 bash[10301]: cluster 2020-11-16T22:10:45.755234+0000 mgr.x (mgr.24115) 544 : cluster [DBG] pgmap v1091: 17 pgs: 17 active+clean; 233 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.9 MiB/s wr, 15 op/s 2020-11-16T22:10:47.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:47 smithi057 bash[10301]: cluster 2020-11-16T22:10:46.203852+0000 mon.a (mon.0) 1278 : cluster [DBG] osdmap e618: 12 total, 12 up, 12 in 2020-11-16T22:10:47.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:47 smithi016 bash[10302]: cluster 2020-11-16T22:10:45.755234+0000 mgr.x (mgr.24115) 544 : cluster [DBG] pgmap v1091: 17 pgs: 17 active+clean; 233 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.9 MiB/s wr, 15 op/s 2020-11-16T22:10:47.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:47 smithi016 bash[10302]: cluster 2020-11-16T22:10:46.203852+0000 mon.a (mon.0) 1278 : cluster [DBG] osdmap e618: 12 total, 12 up, 12 in 2020-11-16T22:10:47.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:47 smithi195 bash[10218]: cluster 2020-11-16T22:10:45.755234+0000 mgr.x (mgr.24115) 544 : cluster [DBG] pgmap v1091: 17 pgs: 17 active+clean; 233 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.9 MiB/s wr, 15 op/s 2020-11-16T22:10:47.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:47 smithi195 bash[10218]: cluster 2020-11-16T22:10:46.203852+0000 mon.a (mon.0) 1278 : cluster [DBG] osdmap e618: 12 total, 12 up, 12 in 2020-11-16T22:10:48.219 INFO:tasks.rados.rados.2.smithi057.stdout:2380: done (3 left) 2020-11-16T22:10:48.220 INFO:tasks.rados.rados.2.smithi057.stdout:2381: delete oid 40 current snap is 276 2020-11-16T22:10:48.220 INFO:tasks.rados.rados.2.smithi057.stdout:2377: expect (ObjNum 780 snap 271 seq_num 780) 2020-11-16T22:10:48.323 INFO:tasks.rados.rados.2.smithi057.stdout:2378: finishing write tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:48.323 INFO:tasks.rados.rados.2.smithi057.stdout:2378: finishing write tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:48.324 INFO:tasks.rados.rados.2.smithi057.stdout:2378: finishing write tid 3 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:48.324 INFO:tasks.rados.rados.2.smithi057.stdout:2378: finishing write tid 5 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:48.324 INFO:tasks.rados.rados.2.smithi057.stdout:2378: finishing write tid 6 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:48.324 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1709 (ObjNum 805 snap 276 seq_num 805) dirty exists 2020-11-16T22:10:48.324 INFO:tasks.rados.rados.2.smithi057.stdout:2378: left oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 805 snap 276 seq_num 805) 2020-11-16T22:10:48.324 INFO:tasks.rados.rados.2.smithi057.stdout:2379: expect (ObjNum 800 snap 276 seq_num 800) 2020-11-16T22:10:48.482 INFO:tasks.rados.rados.2.smithi057.stdout:2377: done (3 left) 2020-11-16T22:10:48.482 INFO:tasks.rados.rados.2.smithi057.stdout:2378: done (2 left) 2020-11-16T22:10:48.482 INFO:tasks.rados.rados.2.smithi057.stdout:2379: done (1 left) 2020-11-16T22:10:48.482 INFO:tasks.rados.rados.2.smithi057.stdout:2381: done (0 left) 2020-11-16T22:10:48.482 INFO:tasks.rados.rados.2.smithi057.stdout:2382: copy_from oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 276 2020-11-16T22:10:48.483 INFO:tasks.rados.rados.2.smithi057.stdout:2383: rollback oid 20 current snap is 276 2020-11-16T22:10:48.483 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 20 to 275 2020-11-16T22:10:48.483 INFO:tasks.rados.rados.2.smithi057.stdout:2384: rollback oid 46 current snap is 276 2020-11-16T22:10:48.483 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 46 to 251 2020-11-16T22:10:48.483 INFO:tasks.rados.rados.2.smithi057.stdout:2385: write oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 276 2020-11-16T22:10:48.483 INFO:tasks.rados.rados.2.smithi057.stdout:2385: seq_num 807 ranges {763249=659361,2090498=582616,3295061=268188} 2020-11-16T22:10:48.498 INFO:tasks.rados.rados.2.smithi057.stdout:2385: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 763249 to 1422610 tid 1 2020-11-16T22:10:48.505 INFO:tasks.rados.rados.2.smithi057.stdout:2385: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2090498 to 2673114 tid 2 2020-11-16T22:10:48.511 INFO:tasks.rados.rados.2.smithi057.stdout:2385: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3295061 to 3563249 tid 3 2020-11-16T22:10:48.511 INFO:tasks.rados.rados.2.smithi057.stdout:2386: snap_remove snap 270 2020-11-16T22:10:48.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:48 smithi016 bash[10302]: cluster 2020-11-16T22:10:47.211883+0000 mon.a (mon.0) 1279 : cluster [DBG] osdmap e619: 12 total, 12 up, 12 in 2020-11-16T22:10:48.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:48 smithi195 bash[10218]: cluster 2020-11-16T22:10:47.211883+0000 mon.a (mon.0) 1279 : cluster [DBG] osdmap e619: 12 total, 12 up, 12 in 2020-11-16T22:10:48.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:48 smithi057 bash[10301]: cluster 2020-11-16T22:10:47.211883+0000 mon.a (mon.0) 1279 : cluster [DBG] osdmap e619: 12 total, 12 up, 12 in 2020-11-16T22:10:49.224 INFO:tasks.rados.rados.2.smithi057.stdout:2386: done (4 left) 2020-11-16T22:10:49.224 INFO:tasks.rados.rados.2.smithi057.stdout:2387: write oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 276 2020-11-16T22:10:49.224 INFO:tasks.rados.rados.2.smithi057.stdout:2387: seq_num 808 ranges {780056=734610,2148980=726274,3322484=257572} 2020-11-16T22:10:49.240 INFO:tasks.rados.rados.2.smithi057.stdout:2387: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 780056 to 1514666 tid 1 2020-11-16T22:10:49.248 INFO:tasks.rados.rados.2.smithi057.stdout:2387: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2148980 to 2875254 tid 2 2020-11-16T22:10:49.252 INFO:tasks.rados.rados.2.smithi057.stdout:2387: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3322484 to 3580056 tid 3 2020-11-16T22:10:49.252 INFO:tasks.rados.rados.2.smithi057.stdout:2388: snap_remove snap 261 2020-11-16T22:10:49.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:49 smithi016 bash[10302]: cluster 2020-11-16T22:10:47.755933+0000 mgr.x (mgr.24115) 545 : cluster [DBG] pgmap v1094: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 241 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.0 MiB/s wr, 27 op/s 2020-11-16T22:10:49.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:49 smithi016 bash[10302]: cluster 2020-11-16T22:10:48.230475+0000 mon.a (mon.0) 1280 : cluster [DBG] osdmap e620: 12 total, 12 up, 12 in 2020-11-16T22:10:49.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:49 smithi195 bash[10218]: cluster 2020-11-16T22:10:47.755933+0000 mgr.x (mgr.24115) 545 : cluster [DBG] pgmap v1094: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 241 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.0 MiB/s wr, 27 op/s 2020-11-16T22:10:49.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:49 smithi195 bash[10218]: cluster 2020-11-16T22:10:48.230475+0000 mon.a (mon.0) 1280 : cluster [DBG] osdmap e620: 12 total, 12 up, 12 in 2020-11-16T22:10:49.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:49 smithi057 bash[10301]: cluster 2020-11-16T22:10:47.755933+0000 mgr.x (mgr.24115) 545 : cluster [DBG] pgmap v1094: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 241 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 5.0 MiB/s wr, 27 op/s 2020-11-16T22:10:49.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:49 smithi057 bash[10301]: cluster 2020-11-16T22:10:48.230475+0000 mon.a (mon.0) 1280 : cluster [DBG] osdmap e620: 12 total, 12 up, 12 in 2020-11-16T22:10:50.071 INFO:tasks.rados.rados.2.smithi057.stdout:2388: done (5 left) 2020-11-16T22:10:50.071 INFO:tasks.rados.rados.2.smithi057.stdout:2389: delete oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 276 2020-11-16T22:10:50.071 INFO:tasks.rados.rados.2.smithi057.stdout:2382: finishing copy_from to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:50.071 INFO:tasks.rados.rados.2.smithi057.stdout:2382: got expected ENOENT (src dne) 2020-11-16T22:10:50.071 INFO:tasks.rados.rados.2.smithi057.stdout:2382: finishing copy_from racing read to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:50.071 INFO:tasks.rados.rados.2.smithi057.stdout:2384: finishing rollback tid 1 to smithi05720651-46 2020-11-16T22:10:50.072 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 1705 (ObjNum 321 snap 0 seq_num 1) dirty dne 2020-11-16T22:10:50.072 INFO:tasks.rados.rados.2.smithi057.stdout:2383: finishing rollback tid 0 to smithi05720651-20 2020-11-16T22:10:50.072 INFO:tasks.rados.rados.2.smithi057.stdout:2383: finishing rollback tid 1 to smithi05720651-20 2020-11-16T22:10:50.072 INFO:tasks.rados.rados.2.smithi057.stdout:2383: finishing rollback tid 2 to smithi05720651-20 2020-11-16T22:10:50.072 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1771 (ObjNum 724 snap 251 seq_num 724) dirty exists 2020-11-16T22:10:50.072 INFO:tasks.rados.rados.2.smithi057.stdout:2385: finishing write tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:50.072 INFO:tasks.rados.rados.2.smithi057.stdout:2385: finishing write tid 2 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:50.073 INFO:tasks.rados.rados.2.smithi057.stdout:2385: finishing write tid 3 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:50.073 INFO:tasks.rados.rados.2.smithi057.stdout:2385: finishing write tid 5 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:50.073 INFO:tasks.rados.rados.2.smithi057.stdout:2385: finishing write tid 6 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:50.073 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1764 (ObjNum 807 snap 276 seq_num 807) dirty exists 2020-11-16T22:10:50.073 INFO:tasks.rados.rados.2.smithi057.stdout:2385: left oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 807 snap 276 seq_num 807) 2020-11-16T22:10:50.073 INFO:tasks.rados.rados.2.smithi057.stdout:2387: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:50.073 INFO:tasks.rados.rados.2.smithi057.stdout:2387: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:50.074 INFO:tasks.rados.rados.2.smithi057.stdout:2387: finishing write tid 3 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:50.074 INFO:tasks.rados.rados.2.smithi057.stdout:2387: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:50.074 INFO:tasks.rados.rados.2.smithi057.stdout:2387: finishing write tid 6 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:50.074 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1707 (ObjNum 808 snap 276 seq_num 808) dirty exists 2020-11-16T22:10:50.074 INFO:tasks.rados.rados.2.smithi057.stdout:2387: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 808 snap 276 seq_num 808) 2020-11-16T22:10:50.083 INFO:tasks.rados.rados.2.smithi057.stdout:2382: done (5 left) 2020-11-16T22:10:50.083 INFO:tasks.rados.rados.2.smithi057.stdout:2383: done (4 left) 2020-11-16T22:10:50.083 INFO:tasks.rados.rados.2.smithi057.stdout:2384: done (3 left) 2020-11-16T22:10:50.083 INFO:tasks.rados.rados.2.smithi057.stdout:2385: done (2 left) 2020-11-16T22:10:50.083 INFO:tasks.rados.rados.2.smithi057.stdout:2387: done (1 left) 2020-11-16T22:10:50.083 INFO:tasks.rados.rados.2.smithi057.stdout:2389: done (0 left) 2020-11-16T22:10:50.084 INFO:tasks.rados.rados.2.smithi057.stdout:2390: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 272 2020-11-16T22:10:50.084 INFO:tasks.rados.rados.2.smithi057.stdout:2390: expect (ObjNum 757 snap 263 seq_num 757) 2020-11-16T22:10:50.084 INFO:tasks.rados.rados.2.smithi057.stdout:2391: copy_from oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 26 current snap is 276 2020-11-16T22:10:50.086 INFO:tasks.rados.rados.2.smithi057.stdout:2392: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 276 2020-11-16T22:10:50.086 INFO:tasks.rados.rados.2.smithi057.stdout:2392: seq_num 810 ranges {413670=485108,1465944=729943,2977330=524801} 2020-11-16T22:10:50.089 INFO:tasks.rados.rados.2.smithi057.stdout:2392: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 413670 to 898778 tid 1 2020-11-16T22:10:50.097 INFO:tasks.rados.rados.2.smithi057.stdout:2392: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1465944 to 2195887 tid 2 2020-11-16T22:10:50.105 INFO:tasks.rados.rados.2.smithi057.stdout:2392: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2977330 to 3502131 tid 3 2020-11-16T22:10:50.105 INFO:tasks.rados.rados.2.smithi057.stdout:2393: snap_remove snap 271 2020-11-16T22:10:50.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:50 smithi016 bash[10302]: cluster 2020-11-16T22:10:49.235038+0000 mon.a (mon.0) 1281 : cluster [DBG] osdmap e621: 12 total, 12 up, 12 in 2020-11-16T22:10:50.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:50 smithi016 bash[10302]: cluster 2020-11-16T22:10:50.081755+0000 mon.a (mon.0) 1282 : cluster [DBG] osdmap e622: 12 total, 12 up, 12 in 2020-11-16T22:10:50.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:50 smithi195 bash[10218]: cluster 2020-11-16T22:10:49.235038+0000 mon.a (mon.0) 1281 : cluster [DBG] osdmap e621: 12 total, 12 up, 12 in 2020-11-16T22:10:50.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:50 smithi195 bash[10218]: cluster 2020-11-16T22:10:50.081755+0000 mon.a (mon.0) 1282 : cluster [DBG] osdmap e622: 12 total, 12 up, 12 in 2020-11-16T22:10:50.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:50 smithi057 bash[10301]: cluster 2020-11-16T22:10:49.235038+0000 mon.a (mon.0) 1281 : cluster [DBG] osdmap e621: 12 total, 12 up, 12 in 2020-11-16T22:10:50.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:50 smithi057 bash[10301]: cluster 2020-11-16T22:10:50.081755+0000 mon.a (mon.0) 1282 : cluster [DBG] osdmap e622: 12 total, 12 up, 12 in 2020-11-16T22:10:51.079 INFO:tasks.rados.rados.2.smithi057.stdout:2393: done (3 left) 2020-11-16T22:10:51.080 INFO:tasks.rados.rados.2.smithi057.stdout:2394: delete oid 40 current snap is 276 2020-11-16T22:10:51.080 INFO:tasks.rados.rados.2.smithi057.stdout:2391: finishing copy_from to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:51.080 INFO:tasks.rados.rados.2.smithi057.stdout:2391: got expected ENOENT (src dne) 2020-11-16T22:10:51.080 INFO:tasks.rados.rados.2.smithi057.stdout:2391: finishing copy_from racing read to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:51.080 INFO:tasks.rados.rados.2.smithi057.stdout:2390: expect (ObjNum 757 snap 263 seq_num 757) 2020-11-16T22:10:51.256 INFO:tasks.rados.rados.2.smithi057.stdout:2392: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:51.257 INFO:tasks.rados.rados.2.smithi057.stdout:2392: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:51.257 INFO:tasks.rados.rados.2.smithi057.stdout:2392: finishing write tid 3 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:51.257 INFO:tasks.rados.rados.2.smithi057.stdout:2392: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:51.257 INFO:tasks.rados.rados.2.smithi057.stdout:2392: finishing write tid 6 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:51.257 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2004 (ObjNum 810 snap 276 seq_num 810) dirty exists 2020-11-16T22:10:51.257 INFO:tasks.rados.rados.2.smithi057.stdout:2392: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 810 snap 276 seq_num 810) 2020-11-16T22:10:51.258 INFO:tasks.rados.rados.2.smithi057.stdout:2390: done (3 left) 2020-11-16T22:10:51.258 INFO:tasks.rados.rados.2.smithi057.stdout:2391: done (2 left) 2020-11-16T22:10:51.258 INFO:tasks.rados.rados.2.smithi057.stdout:2392: done (1 left) 2020-11-16T22:10:51.258 INFO:tasks.rados.rados.2.smithi057.stdout:2394: done (0 left) 2020-11-16T22:10:51.258 INFO:tasks.rados.rados.2.smithi057.stdout:2395: rollback oid 42 current snap is 276 2020-11-16T22:10:51.258 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 42 to 274 2020-11-16T22:10:51.258 INFO:tasks.rados.rados.2.smithi057.stdout:2396: rollback oid 50 current snap is 276 2020-11-16T22:10:51.259 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 50 to 272 2020-11-16T22:10:51.259 INFO:tasks.rados.rados.2.smithi057.stdout:2397: delete oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 276 2020-11-16T22:10:51.265 INFO:tasks.rados.rados.2.smithi057.stdout:2395: finishing rollback tid 0 to smithi05720651-42 2020-11-16T22:10:51.265 INFO:tasks.rados.rados.2.smithi057.stdout:2395: finishing rollback tid 1 to smithi05720651-42 2020-11-16T22:10:51.266 INFO:tasks.rados.rados.2.smithi057.stdout:2396: finishing rollback tid 0 to smithi05720651-50 2020-11-16T22:10:51.266 INFO:tasks.rados.rados.2.smithi057.stdout:2395: finishing rollback tid 2 to smithi05720651-42 2020-11-16T22:10:51.266 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 1566 (ObjNum 776 snap 270 seq_num 776) dirty exists 2020-11-16T22:10:51.267 INFO:tasks.rados.rados.2.smithi057.stdout:2396: finishing rollback tid 1 to smithi05720651-50 2020-11-16T22:10:51.268 INFO:tasks.rados.rados.2.smithi057.stdout:2396: finishing rollback tid 2 to smithi05720651-50 2020-11-16T22:10:51.268 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 1791 (ObjNum 719 snap 249 seq_num 719) dirty exists 2020-11-16T22:10:51.270 INFO:tasks.rados.rados.2.smithi057.stdout:2395: done (2 left) 2020-11-16T22:10:51.270 INFO:tasks.rados.rados.2.smithi057.stdout:2396: done (1 left) 2020-11-16T22:10:51.270 INFO:tasks.rados.rados.2.smithi057.stdout:2397: done (0 left) 2020-11-16T22:10:51.270 INFO:tasks.rados.rados.2.smithi057.stdout:2398: rollback oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 276 2020-11-16T22:10:51.270 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 251 2020-11-16T22:10:51.270 INFO:tasks.rados.rados.2.smithi057.stdout:2399: snap_create 2020-11-16T22:10:51.274 INFO:tasks.rados.rados.2.smithi057.stdout:2398: finishing rollback tid 0 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:51.275 INFO:tasks.rados.rados.2.smithi057.stdout:2398: finishing rollback tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:51.275 INFO:tasks.rados.rados.2.smithi057.stdout:2398: finishing rollback tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:51.275 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1710 (ObjNum 697 snap 243 seq_num 697) dirty exists 2020-11-16T22:10:51.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:51 smithi016 bash[10302]: cluster 2020-11-16T22:10:49.756619+0000 mgr.x (mgr.24115) 546 : cluster [DBG] pgmap v1097: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 241 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.0 MiB/s wr, 14 op/s 2020-11-16T22:10:51.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:51 smithi016 bash[10302]: cluster 2020-11-16T22:10:51.091751+0000 mon.a (mon.0) 1283 : cluster [DBG] osdmap e623: 12 total, 12 up, 12 in 2020-11-16T22:10:51.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:51 smithi195 bash[10218]: cluster 2020-11-16T22:10:49.756619+0000 mgr.x (mgr.24115) 546 : cluster [DBG] pgmap v1097: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 241 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.0 MiB/s wr, 14 op/s 2020-11-16T22:10:51.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:51 smithi195 bash[10218]: cluster 2020-11-16T22:10:51.091751+0000 mon.a (mon.0) 1283 : cluster [DBG] osdmap e623: 12 total, 12 up, 12 in 2020-11-16T22:10:51.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:51 smithi057 bash[10301]: cluster 2020-11-16T22:10:49.756619+0000 mgr.x (mgr.24115) 546 : cluster [DBG] pgmap v1097: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 241 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.0 MiB/s wr, 14 op/s 2020-11-16T22:10:51.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:51 smithi057 bash[10301]: cluster 2020-11-16T22:10:51.091751+0000 mon.a (mon.0) 1283 : cluster [DBG] osdmap e623: 12 total, 12 up, 12 in 2020-11-16T22:10:52.252 INFO:tasks.rados.rados.2.smithi057.stdout:2398: done (1 left) 2020-11-16T22:10:52.252 INFO:tasks.rados.rados.2.smithi057.stdout:2399: done (0 left) 2020-11-16T22:10:52.252 INFO:tasks.rados.rados.2.smithi057.stdout:2400: write (excl) oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 277 2020-11-16T22:10:52.252 INFO:tasks.rados.rados.2.smithi057.stdout:2400: seq_num 813 ranges {464091=710855,1925037=477270,2943246=474970} 2020-11-16T22:10:52.268 INFO:tasks.rados.rados.2.smithi057.stdout:2400: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 464091 to 1174946 tid 1 2020-11-16T22:10:52.275 INFO:tasks.rados.rados.2.smithi057.stdout:2400: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1925037 to 2402307 tid 2 2020-11-16T22:10:52.281 INFO:tasks.rados.rados.2.smithi057.stdout:2400: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2943246 to 3418216 tid 3 2020-11-16T22:10:52.281 INFO:tasks.rados.rados.2.smithi057.stdout:2401: snap_create 2020-11-16T22:10:52.281 INFO:tasks.rados.rados.2.smithi057.stdout:2400: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:52.285 INFO:tasks.rados.rados.2.smithi057.stdout:2400: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:52.286 INFO:tasks.rados.rados.2.smithi057.stdout:2400: finishing write tid 3 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:52.287 INFO:tasks.rados.rados.2.smithi057.stdout:2400: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:52.287 INFO:tasks.rados.rados.2.smithi057.stdout:2400: finishing write tid 6 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:52.287 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1754 (ObjNum 813 snap 277 seq_num 813) dirty exists 2020-11-16T22:10:52.287 INFO:tasks.rados.rados.2.smithi057.stdout:2400: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 813 snap 277 seq_num 813) 2020-11-16T22:10:53.255 INFO:tasks.rados.rados.2.smithi057.stdout:2400: done (1 left) 2020-11-16T22:10:53.255 INFO:tasks.rados.rados.2.smithi057.stdout:2401: done (0 left) 2020-11-16T22:10:53.255 INFO:tasks.rados.rados.2.smithi057.stdout:2402: write (excl) oid 10 current snap is 278 2020-11-16T22:10:53.255 INFO:tasks.rados.rados.2.smithi057.stdout:2402: seq_num 814 ranges {480898=502457,1699872=737281,3087022=593876} 2020-11-16T22:10:53.270 INFO:tasks.rados.rados.2.smithi057.stdout:2402: writing smithi05720651-10 from 480898 to 983355 tid 1 2020-11-16T22:10:53.279 INFO:tasks.rados.rados.2.smithi057.stdout:2402: writing smithi05720651-10 from 1699872 to 2437153 tid 2 2020-11-16T22:10:53.286 INFO:tasks.rados.rados.2.smithi057.stdout:2402: writing smithi05720651-10 from 3087022 to 3680898 tid 3 2020-11-16T22:10:53.286 INFO:tasks.rados.rados.2.smithi057.stdout:2403: rollback oid 28 current snap is 278 2020-11-16T22:10:53.287 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 28 to 272 2020-11-16T22:10:53.287 INFO:tasks.rados.rados.2.smithi057.stdout:2402: finishing write tid 1 to smithi05720651-10 2020-11-16T22:10:53.287 INFO:tasks.rados.rados.2.smithi057.stdout:2404: copy_from oid 24 from oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 278 2020-11-16T22:10:53.287 INFO:tasks.rados.rados.2.smithi057.stdout:2405: snap_create 2020-11-16T22:10:53.287 INFO:tasks.rados.rados.2.smithi057.stdout:2402: finishing write tid 2 to smithi05720651-10 2020-11-16T22:10:53.289 INFO:tasks.rados.rados.2.smithi057.stdout:2403: finishing rollback tid 1 to smithi05720651-28 2020-11-16T22:10:53.289 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 0 (ObjNum 353 snap 0 seq_num 1953066355) dirty dne 2020-11-16T22:10:53.291 INFO:tasks.rados.rados.2.smithi057.stdout:2402: finishing write tid 3 to smithi05720651-10 2020-11-16T22:10:53.292 INFO:tasks.rados.rados.2.smithi057.stdout:2402: finishing write tid 5 to smithi05720651-10 2020-11-16T22:10:53.305 INFO:tasks.rados.rados.2.smithi057.stdout:2404: finishing copy_from to smithi05720651-24 2020-11-16T22:10:53.305 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 1561 (ObjNum 780 snap 271 seq_num 780) dirty exists 2020-11-16T22:10:53.305 INFO:tasks.rados.rados.2.smithi057.stdout:2404: finishing copy_from racing read to smithi05720651-24 2020-11-16T22:10:53.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:53 smithi016 bash[10302]: cluster 2020-11-16T22:10:51.757386+0000 mgr.x (mgr.24115) 547 : cluster [DBG] pgmap v1100: 17 pgs: 17 active+clean; 239 MiB data, 763 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2020-11-16T22:10:53.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:53 smithi016 bash[10302]: cluster 2020-11-16T22:10:52.263304+0000 mon.a (mon.0) 1284 : cluster [DBG] osdmap e624: 12 total, 12 up, 12 in 2020-11-16T22:10:53.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:53 smithi195 bash[10218]: cluster 2020-11-16T22:10:51.757386+0000 mgr.x (mgr.24115) 547 : cluster [DBG] pgmap v1100: 17 pgs: 17 active+clean; 239 MiB data, 763 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2020-11-16T22:10:53.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:53 smithi195 bash[10218]: cluster 2020-11-16T22:10:52.263304+0000 mon.a (mon.0) 1284 : cluster [DBG] osdmap e624: 12 total, 12 up, 12 in 2020-11-16T22:10:53.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:53 smithi057 bash[10301]: cluster 2020-11-16T22:10:51.757386+0000 mgr.x (mgr.24115) 547 : cluster [DBG] pgmap v1100: 17 pgs: 17 active+clean; 239 MiB data, 763 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2020-11-16T22:10:53.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:53 smithi057 bash[10301]: cluster 2020-11-16T22:10:52.263304+0000 mon.a (mon.0) 1284 : cluster [DBG] osdmap e624: 12 total, 12 up, 12 in 2020-11-16T22:10:53.891 INFO:tasks.rados.rados.2.smithi057.stdout:2402: finishing write tid 6 to smithi05720651-10 2020-11-16T22:10:53.891 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 1386 (ObjNum 814 snap 278 seq_num 814) dirty exists 2020-11-16T22:10:53.891 INFO:tasks.rados.rados.2.smithi057.stdout:2402: left oid 10 (ObjNum 814 snap 278 seq_num 814) 2020-11-16T22:10:54.275 INFO:tasks.rados.rados.2.smithi057.stdout:2402: done (3 left) 2020-11-16T22:10:54.275 INFO:tasks.rados.rados.2.smithi057.stdout:2403: done (2 left) 2020-11-16T22:10:54.275 INFO:tasks.rados.rados.2.smithi057.stdout:2404: done (1 left) 2020-11-16T22:10:54.276 INFO:tasks.rados.rados.2.smithi057.stdout:2405: done (0 left) 2020-11-16T22:10:54.276 INFO:tasks.rados.rados.2.smithi057.stdout:2406: delete oid 34 current snap is 279 2020-11-16T22:10:54.285 INFO:tasks.rados.rados.2.smithi057.stdout:2406: done (0 left) 2020-11-16T22:10:54.285 INFO:tasks.rados.rados.2.smithi057.stdout:2407: write (excl) oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 279 2020-11-16T22:10:54.286 INFO:tasks.rados.rados.2.smithi057.stdout:2407: seq_num 816 ranges {514512=652955,1700483=740950,3025515=688997} 2020-11-16T22:10:54.296 INFO:tasks.rados.rados.2.smithi057.stdout:2407: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 514512 to 1167467 tid 1 2020-11-16T22:10:54.305 INFO:tasks.rados.rados.2.smithi057.stdout:2407: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1700483 to 2441433 tid 2 2020-11-16T22:10:54.313 INFO:tasks.rados.rados.2.smithi057.stdout:2407: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3025515 to 3714512 tid 3 2020-11-16T22:10:54.313 INFO:tasks.rados.rados.2.smithi057.stdout:2408: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:54.313 INFO:tasks.rados.rados.2.smithi057.stdout:2408: expect (ObjNum 810 snap 276 seq_num 810) 2020-11-16T22:10:54.314 INFO:tasks.rados.rados.2.smithi057.stdout:2409: write oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 279 2020-11-16T22:10:54.314 INFO:tasks.rados.rados.2.smithi057.stdout:2409: seq_num 817 ranges {531319=728204,1758965=484608,2652938=520058} 2020-11-16T22:10:54.320 INFO:tasks.rados.rados.2.smithi057.stdout:2409: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 531319 to 1259523 tid 1 2020-11-16T22:10:54.328 INFO:tasks.rados.rados.2.smithi057.stdout:2409: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1758965 to 2243573 tid 2 2020-11-16T22:10:54.333 INFO:tasks.rados.rados.2.smithi057.stdout:2409: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2652938 to 3172996 tid 3 2020-11-16T22:10:54.334 INFO:tasks.rados.rados.2.smithi057.stdout:2410: snap_remove snap 251 2020-11-16T22:10:54.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:54 smithi016 bash[10302]: cluster 2020-11-16T22:10:53.265606+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e625: 12 total, 12 up, 12 in 2020-11-16T22:10:54.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:54 smithi195 bash[10218]: cluster 2020-11-16T22:10:53.265606+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e625: 12 total, 12 up, 12 in 2020-11-16T22:10:54.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:54 smithi057 bash[10301]: cluster 2020-11-16T22:10:53.265606+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e625: 12 total, 12 up, 12 in 2020-11-16T22:10:55.072 INFO:tasks.rados.rados.2.smithi057.stdout:2410: done (3 left) 2020-11-16T22:10:55.073 INFO:tasks.rados.rados.2.smithi057.stdout:2411: snap_remove snap 272 2020-11-16T22:10:55.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:55 smithi016 bash[10302]: cluster 2020-11-16T22:10:53.758114+0000 mgr.x (mgr.24115) 548 : cluster [DBG] pgmap v1103: 17 pgs: 17 active+clean; 236 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2020-11-16T22:10:55.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:55 smithi016 bash[10302]: cluster 2020-11-16T22:10:54.286450+0000 mon.a (mon.0) 1286 : cluster [DBG] osdmap e626: 12 total, 12 up, 12 in 2020-11-16T22:10:55.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:55 smithi016 bash[10302]: cluster 2020-11-16T22:10:55.083628+0000 mon.a (mon.0) 1287 : cluster [DBG] osdmap e627: 12 total, 12 up, 12 in 2020-11-16T22:10:55.599 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:10:55 smithi195 bash[18679]: debug 2020-11-16T22:10:55.193+0000 7f9945603700 -1 osd.1 pg_epoch: 627 pg[2.9( v 627'2025 (0'0,627'2025] local-lis/les=71/72 n=17 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,7] r=0 lpr=71 crt=627'2025 lcod 627'2023 mlcod 627'2023 active+clean+snaptrim trimq=[1ee~1] ps=[203~1,217~1]] removing snap head 2020-11-16T22:10:55.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:55 smithi195 bash[10218]: cluster 2020-11-16T22:10:53.758114+0000 mgr.x (mgr.24115) 548 : cluster [DBG] pgmap v1103: 17 pgs: 17 active+clean; 236 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2020-11-16T22:10:55.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:55 smithi195 bash[10218]: cluster 2020-11-16T22:10:54.286450+0000 mon.a (mon.0) 1286 : cluster [DBG] osdmap e626: 12 total, 12 up, 12 in 2020-11-16T22:10:55.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:55 smithi195 bash[10218]: cluster 2020-11-16T22:10:55.083628+0000 mon.a (mon.0) 1287 : cluster [DBG] osdmap e627: 12 total, 12 up, 12 in 2020-11-16T22:10:55.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:55 smithi057 bash[10301]: cluster 2020-11-16T22:10:53.758114+0000 mgr.x (mgr.24115) 548 : cluster [DBG] pgmap v1103: 17 pgs: 17 active+clean; 236 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 1.6 MiB/s wr, 14 op/s 2020-11-16T22:10:55.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:55 smithi057 bash[10301]: cluster 2020-11-16T22:10:54.286450+0000 mon.a (mon.0) 1286 : cluster [DBG] osdmap e626: 12 total, 12 up, 12 in 2020-11-16T22:10:55.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:55 smithi057 bash[10301]: cluster 2020-11-16T22:10:55.083628+0000 mon.a (mon.0) 1287 : cluster [DBG] osdmap e627: 12 total, 12 up, 12 in 2020-11-16T22:10:56.075 INFO:tasks.rados.rados.2.smithi057.stdout:2411: done (3 left) 2020-11-16T22:10:56.075 INFO:tasks.rados.rados.2.smithi057.stdout:2412: copy_from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 48 current snap is 279 2020-11-16T22:10:56.075 INFO:tasks.rados.rados.2.smithi057.stdout:2407: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.075 INFO:tasks.rados.rados.2.smithi057.stdout:2407: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.075 INFO:tasks.rados.rados.2.smithi057.stdout:2407: finishing write tid 3 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.076 INFO:tasks.rados.rados.2.smithi057.stdout:2407: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.076 INFO:tasks.rados.rados.2.smithi057.stdout:2407: finishing write tid 6 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.076 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1570 (ObjNum 816 snap 279 seq_num 816) dirty exists 2020-11-16T22:10:56.076 INFO:tasks.rados.rados.2.smithi057.stdout:2407: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 816 snap 279 seq_num 816) 2020-11-16T22:10:56.076 INFO:tasks.rados.rados.2.smithi057.stdout:2408: expect (ObjNum 810 snap 276 seq_num 810) 2020-11-16T22:10:56.315 INFO:tasks.rados.rados.2.smithi057.stdout:2409: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.315 INFO:tasks.rados.rados.2.smithi057.stdout:2409: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.315 INFO:tasks.rados.rados.2.smithi057.stdout:2409: finishing write tid 3 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.316 INFO:tasks.rados.rados.2.smithi057.stdout:2409: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.316 INFO:tasks.rados.rados.2.smithi057.stdout:2409: finishing write tid 6 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.316 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1758 (ObjNum 817 snap 279 seq_num 817) dirty exists 2020-11-16T22:10:56.316 INFO:tasks.rados.rados.2.smithi057.stdout:2409: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 817 snap 279 seq_num 817) 2020-11-16T22:10:56.316 INFO:tasks.rados.rados.2.smithi057.stdout:2412: finishing copy_from to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.316 INFO:tasks.rados.rados.2.smithi057.stdout:2412: got expected ENOENT (src dne) 2020-11-16T22:10:56.317 INFO:tasks.rados.rados.2.smithi057.stdout:2412: finishing copy_from racing read to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.317 INFO:tasks.rados.rados.2.smithi057.stdout:2407: done (3 left) 2020-11-16T22:10:56.317 INFO:tasks.rados.rados.2.smithi057.stdout:2408: done (2 left) 2020-11-16T22:10:56.317 INFO:tasks.rados.rados.2.smithi057.stdout:2409: done (1 left) 2020-11-16T22:10:56.317 INFO:tasks.rados.rados.2.smithi057.stdout:2412: done (0 left) 2020-11-16T22:10:56.317 INFO:tasks.rados.rados.2.smithi057.stdout:2413: copy_from oid 30 from oid 46 current snap is 279 2020-11-16T22:10:56.317 INFO:tasks.rados.rados.2.smithi057.stdout:2414: copy_from oid 8 from oid 34 current snap is 279 2020-11-16T22:10:56.318 INFO:tasks.rados.rados.2.smithi057.stdout:2415: rollback oid 12 current snap is 279 2020-11-16T22:10:56.318 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 12 to 276 2020-11-16T22:10:56.318 INFO:tasks.rados.rados.2.smithi057.stdout:2416: read oid 44 snap -1 2020-11-16T22:10:56.318 INFO:tasks.rados.rados.2.smithi057.stdout:2416: expect (ObjNum 789 snap 272 seq_num 789) 2020-11-16T22:10:56.318 INFO:tasks.rados.rados.2.smithi057.stdout:2417: write oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 279 2020-11-16T22:10:56.318 INFO:tasks.rados.rados.2.smithi057.stdout:2417: seq_num 818 ranges {548126=403453,1417447=744619,2680361=447683,3680450=67676} 2020-11-16T22:10:56.326 INFO:tasks.rados.rados.2.smithi057.stdout:2417: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 548126 to 951579 tid 1 2020-11-16T22:10:56.334 INFO:tasks.rados.rados.2.smithi057.stdout:2417: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1417447 to 2162066 tid 2 2020-11-16T22:10:56.340 INFO:tasks.rados.rados.2.smithi057.stdout:2417: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2680361 to 3128044 tid 3 2020-11-16T22:10:56.344 INFO:tasks.rados.rados.2.smithi057.stdout:2417: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3680450 to 3748126 tid 4 2020-11-16T22:10:56.344 INFO:tasks.rados.rados.2.smithi057.stdout:2418: rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 279 2020-11-16T22:10:56.344 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 274 2020-11-16T22:10:56.344 INFO:tasks.rados.rados.2.smithi057.stdout:2413: finishing copy_from to smithi05720651-30 2020-11-16T22:10:56.345 INFO:tasks.rados.rados.2.smithi057.stdout:2413: got expected ENOENT (src dne) 2020-11-16T22:10:56.345 INFO:tasks.rados.rados.2.smithi057.stdout:2414: finishing copy_from to smithi05720651-8 2020-11-16T22:10:56.345 INFO:tasks.rados.rados.2.smithi057.stdout:2414: got expected ENOENT (src dne) 2020-11-16T22:10:56.345 INFO:tasks.rados.rados.2.smithi057.stdout:2413: finishing copy_from racing read to smithi05720651-30 2020-11-16T22:10:56.345 INFO:tasks.rados.rados.2.smithi057.stdout:2414: finishing copy_from racing read to smithi05720651-8 2020-11-16T22:10:56.345 INFO:tasks.rados.rados.2.smithi057.stdout:2415: finishing rollback tid 0 to smithi05720651-12 2020-11-16T22:10:56.345 INFO:tasks.rados.rados.2.smithi057.stdout:2415: finishing rollback tid 1 to smithi05720651-12 2020-11-16T22:10:56.346 INFO:tasks.rados.rados.2.smithi057.stdout:2415: finishing rollback tid 2 to smithi05720651-12 2020-11-16T22:10:56.346 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 1150 (ObjNum 797 snap 276 seq_num 797) dirty exists 2020-11-16T22:10:56.346 INFO:tasks.rados.rados.2.smithi057.stdout:2416: expect (ObjNum 789 snap 272 seq_num 789) 2020-11-16T22:10:56.477 INFO:tasks.rados.rados.2.smithi057.stdout:2417: finishing write tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.478 INFO:tasks.rados.rados.2.smithi057.stdout:2417: finishing write tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.478 INFO:tasks.rados.rados.2.smithi057.stdout:2417: finishing write tid 3 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.478 INFO:tasks.rados.rados.2.smithi057.stdout:2417: finishing write tid 4 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.478 INFO:tasks.rados.rados.2.smithi057.stdout:2417: finishing write tid 6 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.478 INFO:tasks.rados.rados.2.smithi057.stdout:2417: finishing write tid 7 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.479 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1714 (ObjNum 818 snap 279 seq_num 818) dirty exists 2020-11-16T22:10:56.479 INFO:tasks.rados.rados.2.smithi057.stdout:2417: left oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 818 snap 279 seq_num 818) 2020-11-16T22:10:56.479 INFO:tasks.rados.rados.2.smithi057.stdout:2418: finishing rollback tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:56.479 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1738 (ObjNum 33 snap 0 seq_num 1131374913) dirty dne 2020-11-16T22:10:56.479 INFO:tasks.rados.rados.2.smithi057.stdout:2413: done (5 left) 2020-11-16T22:10:56.479 INFO:tasks.rados.rados.2.smithi057.stdout:2414: done (4 left) 2020-11-16T22:10:56.479 INFO:tasks.rados.rados.2.smithi057.stdout:2415: done (3 left) 2020-11-16T22:10:56.480 INFO:tasks.rados.rados.2.smithi057.stdout:2416: done (2 left) 2020-11-16T22:10:56.480 INFO:tasks.rados.rados.2.smithi057.stdout:2417: done (1 left) 2020-11-16T22:10:56.480 INFO:tasks.rados.rados.2.smithi057.stdout:2418: done (0 left) 2020-11-16T22:10:56.480 INFO:tasks.rados.rados.2.smithi057.stdout:2419: snap_create 2020-11-16T22:10:57.281 INFO:tasks.rados.rados.2.smithi057.stdout:2419: done (0 left) 2020-11-16T22:10:57.282 INFO:tasks.rados.rados.2.smithi057.stdout:2420: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:57.282 INFO:tasks.rados.rados.2.smithi057.stdout:2420: expect (ObjNum 699 snap 243 seq_num 699) 2020-11-16T22:10:57.282 INFO:tasks.rados.rados.2.smithi057.stdout:2421: snap_remove snap 275 2020-11-16T22:10:57.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:57 smithi016 bash[10302]: cluster 2020-11-16T22:10:55.758672+0000 mgr.x (mgr.24115) 549 : cluster [DBG] pgmap v1106: 17 pgs: 17 active+clean; 239 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.2 MiB/s wr, 3 op/s 2020-11-16T22:10:57.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:57 smithi016 bash[10302]: cluster 2020-11-16T22:10:56.085999+0000 mon.a (mon.0) 1288 : cluster [DBG] osdmap e628: 12 total, 12 up, 12 in 2020-11-16T22:10:57.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:57 smithi195 bash[10218]: cluster 2020-11-16T22:10:55.758672+0000 mgr.x (mgr.24115) 549 : cluster [DBG] pgmap v1106: 17 pgs: 17 active+clean; 239 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.2 MiB/s wr, 3 op/s 2020-11-16T22:10:57.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:57 smithi195 bash[10218]: cluster 2020-11-16T22:10:56.085999+0000 mon.a (mon.0) 1288 : cluster [DBG] osdmap e628: 12 total, 12 up, 12 in 2020-11-16T22:10:57.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:57 smithi057 bash[10301]: cluster 2020-11-16T22:10:55.758672+0000 mgr.x (mgr.24115) 549 : cluster [DBG] pgmap v1106: 17 pgs: 17 active+clean; 239 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.2 MiB/s wr, 3 op/s 2020-11-16T22:10:57.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:57 smithi057 bash[10301]: cluster 2020-11-16T22:10:56.085999+0000 mon.a (mon.0) 1288 : cluster [DBG] osdmap e628: 12 total, 12 up, 12 in 2020-11-16T22:10:58.291 INFO:tasks.rados.rados.2.smithi057.stdout:2421: done (1 left) 2020-11-16T22:10:58.292 INFO:tasks.rados.rados.2.smithi057.stdout:2422: read oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:10:58.292 INFO:tasks.rados.rados.2.smithi057.stdout:2422: expect (ObjNum 697 snap 243 seq_num 697) 2020-11-16T22:10:58.292 INFO:tasks.rados.rados.2.smithi057.stdout:2420: expect (ObjNum 699 snap 243 seq_num 699) 2020-11-16T22:10:58.530 INFO:tasks.rados.rados.2.smithi057.stdout:2422: expect (ObjNum 697 snap 243 seq_num 697) 2020-11-16T22:10:58.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:58 smithi016 bash[10302]: cluster 2020-11-16T22:10:57.292827+0000 mon.a (mon.0) 1289 : cluster [DBG] osdmap e629: 12 total, 12 up, 12 in 2020-11-16T22:10:58.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:58 smithi195 bash[10218]: cluster 2020-11-16T22:10:57.292827+0000 mon.a (mon.0) 1289 : cluster [DBG] osdmap e629: 12 total, 12 up, 12 in 2020-11-16T22:10:58.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:58 smithi057 bash[10301]: cluster 2020-11-16T22:10:57.292827+0000 mon.a (mon.0) 1289 : cluster [DBG] osdmap e629: 12 total, 12 up, 12 in 2020-11-16T22:10:58.827 INFO:tasks.rados.rados.2.smithi057.stdout:2420: done (1 left) 2020-11-16T22:10:58.828 INFO:tasks.rados.rados.2.smithi057.stdout:2422: done (0 left) 2020-11-16T22:10:58.828 INFO:tasks.rados.rados.2.smithi057.stdout:2423: write oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 280 2020-11-16T22:10:58.828 INFO:tasks.rados.rados.2.smithi057.stdout:2423: seq_num 819 ranges {564933=478702,1759576=488277,2991431=658955} 2020-11-16T22:10:58.843 INFO:tasks.rados.rados.2.smithi057.stdout:2423: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 564933 to 1043635 tid 1 2020-11-16T22:10:58.850 INFO:tasks.rados.rados.2.smithi057.stdout:2423: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1759576 to 2247853 tid 2 2020-11-16T22:10:58.859 INFO:tasks.rados.rados.2.smithi057.stdout:2423: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2991431 to 3650386 tid 3 2020-11-16T22:10:58.859 INFO:tasks.rados.rados.2.smithi057.stdout:2424: snap_create 2020-11-16T22:10:58.859 INFO:tasks.rados.rados.2.smithi057.stdout:2423: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:58.859 INFO:tasks.rados.rados.2.smithi057.stdout:2423: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:58.864 INFO:tasks.rados.rados.2.smithi057.stdout:2423: finishing write tid 3 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:59.192 INFO:tasks.rados.rados.2.smithi057.stdout:2423: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:59.193 INFO:tasks.rados.rados.2.smithi057.stdout:2423: finishing write tid 6 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:59.193 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1731 (ObjNum 819 snap 280 seq_num 819) dirty exists 2020-11-16T22:10:59.193 INFO:tasks.rados.rados.2.smithi057.stdout:2423: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 819 snap 280 seq_num 819) 2020-11-16T22:10:59.300 INFO:tasks.rados.rados.2.smithi057.stdout:2423: done (1 left) 2020-11-16T22:10:59.300 INFO:tasks.rados.rados.2.smithi057.stdout:2424: done (0 left) 2020-11-16T22:10:59.300 INFO:tasks.rados.rados.2.smithi057.stdout:2425: write oid 38 current snap is 281 2020-11-16T22:10:59.300 INFO:tasks.rados.rados.2.smithi057.stdout:2425: seq_num 820 ranges {581740=553951,1818058=748288,3018854=470227} 2020-11-16T22:10:59.316 INFO:tasks.rados.rados.2.smithi057.stdout:2425: writing smithi05720651-38 from 581740 to 1135691 tid 1 2020-11-16T22:10:59.324 INFO:tasks.rados.rados.2.smithi057.stdout:2425: writing smithi05720651-38 from 1818058 to 2566346 tid 2 2020-11-16T22:10:59.330 INFO:tasks.rados.rados.2.smithi057.stdout:2425: writing smithi05720651-38 from 3018854 to 3489081 tid 3 2020-11-16T22:10:59.330 INFO:tasks.rados.rados.2.smithi057.stdout:2426: rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 281 2020-11-16T22:10:59.330 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 280 2020-11-16T22:10:59.331 INFO:tasks.rados.rados.2.smithi057.stdout:2427: rollback oid 48 current snap is 281 2020-11-16T22:10:59.331 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 48 to 279 2020-11-16T22:10:59.331 INFO:tasks.rados.rados.2.smithi057.stdout:2428: read oid 24 snap -1 2020-11-16T22:10:59.331 INFO:tasks.rados.rados.2.smithi057.stdout:2428: expect (ObjNum 780 snap 271 seq_num 780) 2020-11-16T22:10:59.331 INFO:tasks.rados.rados.2.smithi057.stdout:2429: read oid 4 snap -1 2020-11-16T22:10:59.331 INFO:tasks.rados.rados.2.smithi057.stdout:2429: expect deleted 2020-11-16T22:10:59.331 INFO:tasks.rados.rados.2.smithi057.stdout:2430: rollback oid 10 current snap is 281 2020-11-16T22:10:59.332 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 10 to 266 2020-11-16T22:10:59.332 INFO:tasks.rados.rados.2.smithi057.stdout:2425: finishing write tid 1 to smithi05720651-38 2020-11-16T22:10:59.332 INFO:tasks.rados.rados.2.smithi057.stdout:2431: snap_create 2020-11-16T22:10:59.335 INFO:tasks.rados.rados.2.smithi057.stdout:2427: finishing rollback tid 1 to smithi05720651-48 2020-11-16T22:10:59.335 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 0 (ObjNum 33 snap 0 seq_num 2933935856) dirty dne 2020-11-16T22:10:59.336 INFO:tasks.rados.rados.2.smithi057.stdout:2425: finishing write tid 2 to smithi05720651-38 2020-11-16T22:10:59.337 INFO:tasks.rados.rados.2.smithi057.stdout:2425: finishing write tid 3 to smithi05720651-38 2020-11-16T22:10:59.337 INFO:tasks.rados.rados.2.smithi057.stdout:2425: finishing write tid 5 to smithi05720651-38 2020-11-16T22:10:59.338 INFO:tasks.rados.rados.2.smithi057.stdout:2425: finishing write tid 6 to smithi05720651-38 2020-11-16T22:10:59.338 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 1768 (ObjNum 820 snap 281 seq_num 820) dirty exists 2020-11-16T22:10:59.338 INFO:tasks.rados.rados.2.smithi057.stdout:2425: left oid 38 (ObjNum 820 snap 281 seq_num 820) 2020-11-16T22:10:59.339 INFO:tasks.rados.rados.2.smithi057.stdout:2430: finishing rollback tid 0 to smithi05720651-10 2020-11-16T22:10:59.339 INFO:tasks.rados.rados.2.smithi057.stdout:2430: finishing rollback tid 1 to smithi05720651-10 2020-11-16T22:10:59.339 INFO:tasks.rados.rados.2.smithi057.stdout:2430: finishing rollback tid 2 to smithi05720651-10 2020-11-16T22:10:59.340 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 1389 (ObjNum 525 snap 188 seq_num 525) dirty exists 2020-11-16T22:10:59.340 INFO:tasks.rados.rados.2.smithi057.stdout:2426: finishing rollback tid 0 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:59.346 INFO:tasks.rados.rados.2.smithi057.stdout:2428: expect (ObjNum 780 snap 271 seq_num 780) 2020-11-16T22:10:59.448 INFO:tasks.rados.rados.2.smithi057.stdout:2426: finishing rollback tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:59.448 INFO:tasks.rados.rados.2.smithi057.stdout:2426: finishing rollback tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:10:59.449 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1717 (ObjNum 805 snap 276 seq_num 805) dirty exists 2020-11-16T22:10:59.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:59 smithi016 bash[10302]: cluster 2020-11-16T22:10:57.759326+0000 mgr.x (mgr.24115) 550 : cluster [DBG] pgmap v1109: 17 pgs: 17 active+clean; 234 MiB data, 763 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2020-11-16T22:10:59.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:10:59 smithi016 bash[10302]: cluster 2020-11-16T22:10:58.302886+0000 mon.a (mon.0) 1290 : cluster [DBG] osdmap e630: 12 total, 12 up, 12 in 2020-11-16T22:10:59.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:59 smithi195 bash[10218]: cluster 2020-11-16T22:10:57.759326+0000 mgr.x (mgr.24115) 550 : cluster [DBG] pgmap v1109: 17 pgs: 17 active+clean; 234 MiB data, 763 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2020-11-16T22:10:59.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:10:59 smithi195 bash[10218]: cluster 2020-11-16T22:10:58.302886+0000 mon.a (mon.0) 1290 : cluster [DBG] osdmap e630: 12 total, 12 up, 12 in 2020-11-16T22:10:59.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:59 smithi057 bash[10301]: cluster 2020-11-16T22:10:57.759326+0000 mgr.x (mgr.24115) 550 : cluster [DBG] pgmap v1109: 17 pgs: 17 active+clean; 234 MiB data, 763 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2020-11-16T22:10:59.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:10:59 smithi057 bash[10301]: cluster 2020-11-16T22:10:58.302886+0000 mon.a (mon.0) 1290 : cluster [DBG] osdmap e630: 12 total, 12 up, 12 in 2020-11-16T22:11:00.073 INFO:tasks.rados.rados.2.smithi057.stdout:2425: done (6 left) 2020-11-16T22:11:00.073 INFO:tasks.rados.rados.2.smithi057.stdout:2426: done (5 left) 2020-11-16T22:11:00.074 INFO:tasks.rados.rados.2.smithi057.stdout:2427: done (4 left) 2020-11-16T22:11:00.074 INFO:tasks.rados.rados.2.smithi057.stdout:2428: done (3 left) 2020-11-16T22:11:00.074 INFO:tasks.rados.rados.2.smithi057.stdout:2429: done (2 left) 2020-11-16T22:11:00.074 INFO:tasks.rados.rados.2.smithi057.stdout:2430: done (1 left) 2020-11-16T22:11:00.074 INFO:tasks.rados.rados.2.smithi057.stdout:2431: done (0 left) 2020-11-16T22:11:00.074 INFO:tasks.rados.rados.2.smithi057.stdout:2432: snap_remove snap 266 2020-11-16T22:11:00.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:00 smithi016 bash[10302]: cluster 2020-11-16T22:10:59.311733+0000 mon.a (mon.0) 1291 : cluster [DBG] osdmap e631: 12 total, 12 up, 12 in 2020-11-16T22:11:00.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:00 smithi016 bash[10302]: cluster 2020-11-16T22:10:59.759997+0000 mgr.x (mgr.24115) 551 : cluster [DBG] pgmap v1112: 17 pgs: 17 active+clean; 234 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 1.3 MiB/s wr, 7 op/s 2020-11-16T22:11:00.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:00 smithi016 bash[10302]: cluster 2020-11-16T22:11:00.084510+0000 mon.a (mon.0) 1292 : cluster [DBG] osdmap e632: 12 total, 12 up, 12 in 2020-11-16T22:11:00.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:00 smithi195 bash[10218]: cluster 2020-11-16T22:10:59.311733+0000 mon.a (mon.0) 1291 : cluster [DBG] osdmap e631: 12 total, 12 up, 12 in 2020-11-16T22:11:00.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:00 smithi195 bash[10218]: cluster 2020-11-16T22:10:59.759997+0000 mgr.x (mgr.24115) 551 : cluster [DBG] pgmap v1112: 17 pgs: 17 active+clean; 234 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 1.3 MiB/s wr, 7 op/s 2020-11-16T22:11:00.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:00 smithi195 bash[10218]: cluster 2020-11-16T22:11:00.084510+0000 mon.a (mon.0) 1292 : cluster [DBG] osdmap e632: 12 total, 12 up, 12 in 2020-11-16T22:11:00.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:00 smithi057 bash[10301]: cluster 2020-11-16T22:10:59.311733+0000 mon.a (mon.0) 1291 : cluster [DBG] osdmap e631: 12 total, 12 up, 12 in 2020-11-16T22:11:00.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:00 smithi057 bash[10301]: cluster 2020-11-16T22:10:59.759997+0000 mgr.x (mgr.24115) 551 : cluster [DBG] pgmap v1112: 17 pgs: 17 active+clean; 234 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 1.3 MiB/s wr, 7 op/s 2020-11-16T22:11:00.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:00 smithi057 bash[10301]: cluster 2020-11-16T22:11:00.084510+0000 mon.a (mon.0) 1292 : cluster [DBG] osdmap e632: 12 total, 12 up, 12 in 2020-11-16T22:11:01.075 INFO:tasks.rados.rados.2.smithi057.stdout:2432: done (0 left) 2020-11-16T22:11:01.076 INFO:tasks.rados.rados.2.smithi057.stdout:2433: snap_remove snap 255 2020-11-16T22:11:01.587 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 22:11:01 smithi016 bash[15120]: debug 2020-11-16T22:11:01.110+0000 7f8fc2db1700 -1 osd.5 pg_epoch: 633 pg[2.3( v 633'1809 (0'0,633'1809] local-lis/les=71/72 n=13 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [5,2] r=0 lpr=71 luod=630'1807 crt=633'1809 lcod 630'1805 mlcod 630'1805 active+clean+snaptrim trimq=[20b~1] ps=[1ee~1,218~1,21c~1]] removing snap head 2020-11-16T22:11:01.588 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 22:11:01 smithi016 bash[15120]: debug 2020-11-16T22:11:01.118+0000 7f8fc6db9700 -1 osd.5 pg_epoch: 633 pg[2.3( v 633'1811 (0'0,633'1811] local-lis/les=71/72 n=11 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [5,2] r=0 lpr=71 crt=633'1811 lcod 633'1809 mlcod 633'1809 active+clean+snaptrim trimq=[20b~1] ps=[1ee~1,218~1,21c~1]] removing snap head 2020-11-16T22:11:01.849 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:11:01 smithi195 bash[18679]: debug 2020-11-16T22:11:01.365+0000 7f994960b700 -1 osd.1 pg_epoch: 633 pg[2.9( v 633'2035 (0'0,633'2035] local-lis/les=71/72 n=15 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,7] r=0 lpr=71 luod=630'2033 crt=633'2035 lcod 628'2031 mlcod 628'2031 active+clean+snaptrim trimq=[20b~1] ps=[1ee~1,218~1,21c~1]] removing snap head 2020-11-16T22:11:02.085 INFO:tasks.rados.rados.2.smithi057.stdout:2433: done (0 left) 2020-11-16T22:11:02.086 INFO:tasks.rados.rados.2.smithi057.stdout:2434: rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 282 2020-11-16T22:11:02.086 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 279 2020-11-16T22:11:02.086 INFO:tasks.rados.rados.2.smithi057.stdout:2435: snap_create 2020-11-16T22:11:02.094 INFO:tasks.rados.rados.2.smithi057.stdout:2434: finishing rollback tid 0 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:02.097 INFO:tasks.rados.rados.2.smithi057.stdout:2434: finishing rollback tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:02.097 INFO:tasks.rados.rados.2.smithi057.stdout:2434: finishing rollback tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:02.097 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2051 (ObjNum 804 snap 276 seq_num 804) dirty exists 2020-11-16T22:11:02.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:02 smithi016 bash[10302]: cluster 2020-11-16T22:11:01.086895+0000 mon.a (mon.0) 1293 : cluster [DBG] osdmap e633: 12 total, 12 up, 12 in 2020-11-16T22:11:02.338 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:11:02 smithi016 bash[19825]: debug 2020-11-16T22:11:02.102+0000 7f0e12c1a700 -1 osd.7 pg_epoch: 634 pg[2.8( v 634'1611 (0'0,634'1611] local-lis/les=71/72 n=15 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [7,9] r=0 lpr=71 crt=634'1611 lcod 634'1609 mlcod 634'1609 active+clean+snaptrim trimq=[1f4~1] ps=[1ee~1,20b~1,218~1,21c~1]] removing snap head 2020-11-16T22:11:02.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:02 smithi195 bash[10218]: cluster 2020-11-16T22:11:01.086895+0000 mon.a (mon.0) 1293 : cluster [DBG] osdmap e633: 12 total, 12 up, 12 in 2020-11-16T22:11:02.350 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:11:02 smithi195 bash[18679]: debug 2020-11-16T22:11:02.101+0000 7f994960b700 -1 osd.1 pg_epoch: 634 pg[2.9( v 634'2051 (0'0,634'2051] local-lis/les=71/72 n=11 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,7] r=0 lpr=71 luod=634'2049 crt=634'2051 lcod 634'2047 mlcod 634'2047 active+clean+snaptrim trimq=[1f4~1] ps=[1ee~1,20b~1,218~1,21c~1]] removing snap head 2020-11-16T22:11:02.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:02 smithi057 bash[10301]: cluster 2020-11-16T22:11:01.086895+0000 mon.a (mon.0) 1293 : cluster [DBG] osdmap e633: 12 total, 12 up, 12 in 2020-11-16T22:11:02.445 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:11:02 smithi057 bash[19569]: debug 2020-11-16T22:11:02.107+0000 7f5e12117700 -1 osd.11 pg_epoch: 634 pg[2.a( v 633'721 (0'0,633'721] local-lis/les=71/72 n=7 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [11,3] r=0 lpr=71 crt=633'721 lcod 633'719 mlcod 633'719 active+clean+snaptrim trimq=[1f4~1] ps=[1ee~1,20b~1,218~1,21c~1]] removing snap head 2020-11-16T22:11:02.445 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:11:02 smithi057 bash[19569]: debug 2020-11-16T22:11:02.107+0000 7f5e12117700 -1 osd.11 pg_epoch: 634 pg[2.a( v 634'723 (0'0,634'723] local-lis/les=71/72 n=5 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [11,3] r=0 lpr=71 luod=633'721 crt=634'723 lcod 633'719 mlcod 633'719 active+clean+snaptrim trimq=[1f4~1] ps=[1ee~1,20b~1,218~1,21c~1]] removing snap head 2020-11-16T22:11:02.445 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:11:02 smithi057 bash[12595]: debug 2020-11-16T22:11:02.103+0000 7f737c1a2700 -1 osd.8 pg_epoch: 634 pg[2.f( v 633'153 (0'0,633'153] local-lis/les=71/72 n=2 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,9] r=0 lpr=71 crt=633'153 lcod 627'151 mlcod 627'151 active+clean+snaptrim trimq=[1f4~1] ps=[1ee~1,20b~1,218~1,21c~1]] removing snap head 2020-11-16T22:11:02.445 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:11:02 smithi057 bash[12595]: debug 2020-11-16T22:11:02.107+0000 7f737d1a4700 -1 osd.8 pg_epoch: 634 pg[2.5( v 633'1232 (0'0,633'1232] local-lis/les=71/72 n=9 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,0] r=0 lpr=71 crt=633'1232 lcod 631'1230 mlcod 631'1230 active+clean+snaptrim trimq=[1f4~1] ps=[1ee~1,20b~1,218~1,21c~1]] removing snap head 2020-11-16T22:11:03.094 INFO:tasks.rados.rados.2.smithi057.stdout:2434: done (1 left) 2020-11-16T22:11:03.094 INFO:tasks.rados.rados.2.smithi057.stdout:2435: done (0 left) 2020-11-16T22:11:03.094 INFO:tasks.rados.rados.2.smithi057.stdout:2436: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 276 2020-11-16T22:11:03.094 INFO:tasks.rados.rados.2.smithi057.stdout:2436: expect (ObjNum 780 snap 271 seq_num 780) 2020-11-16T22:11:03.094 INFO:tasks.rados.rados.2.smithi057.stdout:2437: write (excl) oid 26 current snap is 283 2020-11-16T22:11:03.095 INFO:tasks.rados.rados.2.smithi057.stdout:2437: seq_num 821 ranges {598547=629200,1876540=491946,3046277=681499} 2020-11-16T22:11:03.109 INFO:tasks.rados.rados.2.smithi057.stdout:2437: writing smithi05720651-26 from 598547 to 1227747 tid 1 2020-11-16T22:11:03.115 INFO:tasks.rados.rados.2.smithi057.stdout:2437: writing smithi05720651-26 from 1876540 to 2368486 tid 2 2020-11-16T22:11:03.123 INFO:tasks.rados.rados.2.smithi057.stdout:2437: writing smithi05720651-26 from 3046277 to 3727776 tid 3 2020-11-16T22:11:03.123 INFO:tasks.rados.rados.2.smithi057.stdout:2438: snap_create 2020-11-16T22:11:03.124 INFO:tasks.rados.rados.2.smithi057.stdout:2436: expect (ObjNum 780 snap 271 seq_num 780) 2020-11-16T22:11:03.227 INFO:tasks.rados.rados.2.smithi057.stdout:2437: finishing write tid 1 to smithi05720651-26 2020-11-16T22:11:03.227 INFO:tasks.rados.rados.2.smithi057.stdout:2437: finishing write tid 2 to smithi05720651-26 2020-11-16T22:11:03.227 INFO:tasks.rados.rados.2.smithi057.stdout:2437: finishing write tid 3 to smithi05720651-26 2020-11-16T22:11:03.228 INFO:tasks.rados.rados.2.smithi057.stdout:2437: finishing write tid 5 to smithi05720651-26 2020-11-16T22:11:03.228 INFO:tasks.rados.rados.2.smithi057.stdout:2437: finishing write tid 6 to smithi05720651-26 2020-11-16T22:11:03.228 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 2061 (ObjNum 821 snap 283 seq_num 821) dirty exists 2020-11-16T22:11:03.228 INFO:tasks.rados.rados.2.smithi057.stdout:2437: left oid 26 (ObjNum 821 snap 283 seq_num 821) 2020-11-16T22:11:03.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:03 smithi016 bash[10302]: cluster 2020-11-16T22:11:01.760717+0000 mgr.x (mgr.24115) 552 : cluster [DBG] pgmap v1115: 17 pgs: 17 active+clean; 231 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2020-11-16T22:11:03.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:03 smithi016 bash[10302]: cluster 2020-11-16T22:11:02.097259+0000 mon.a (mon.0) 1294 : cluster [DBG] osdmap e634: 12 total, 12 up, 12 in 2020-11-16T22:11:03.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:03 smithi195 bash[10218]: cluster 2020-11-16T22:11:01.760717+0000 mgr.x (mgr.24115) 552 : cluster [DBG] pgmap v1115: 17 pgs: 17 active+clean; 231 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2020-11-16T22:11:03.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:03 smithi195 bash[10218]: cluster 2020-11-16T22:11:02.097259+0000 mon.a (mon.0) 1294 : cluster [DBG] osdmap e634: 12 total, 12 up, 12 in 2020-11-16T22:11:03.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:03 smithi057 bash[10301]: cluster 2020-11-16T22:11:01.760717+0000 mgr.x (mgr.24115) 552 : cluster [DBG] pgmap v1115: 17 pgs: 17 active+clean; 231 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2020-11-16T22:11:03.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:03 smithi057 bash[10301]: cluster 2020-11-16T22:11:02.097259+0000 mon.a (mon.0) 1294 : cluster [DBG] osdmap e634: 12 total, 12 up, 12 in 2020-11-16T22:11:04.103 INFO:tasks.rados.rados.2.smithi057.stdout:2436: done (2 left) 2020-11-16T22:11:04.103 INFO:tasks.rados.rados.2.smithi057.stdout:2437: done (1 left) 2020-11-16T22:11:04.103 INFO:tasks.rados.rados.2.smithi057.stdout:2438: done (0 left) 2020-11-16T22:11:04.103 INFO:tasks.rados.rados.2.smithi057.stdout:2439: write oid 30 current snap is 284 2020-11-16T22:11:04.104 INFO:tasks.rados.rados.2.smithi057.stdout:2439: seq_num 822 ranges {615354=420802,1651375=751957,3190053=492771} 2020-11-16T22:11:04.116 INFO:tasks.rados.rados.2.smithi057.stdout:2439: writing smithi05720651-30 from 615354 to 1036156 tid 1 2020-11-16T22:11:04.126 INFO:tasks.rados.rados.2.smithi057.stdout:2439: writing smithi05720651-30 from 1651375 to 2403332 tid 2 2020-11-16T22:11:04.134 INFO:tasks.rados.rados.2.smithi057.stdout:2439: writing smithi05720651-30 from 3190053 to 3682824 tid 3 2020-11-16T22:11:04.134 INFO:tasks.rados.rados.2.smithi057.stdout:2440: delete oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 284 2020-11-16T22:11:04.134 INFO:tasks.rados.rados.2.smithi057.stdout:2439: finishing write tid 1 to smithi05720651-30 2020-11-16T22:11:04.135 INFO:tasks.rados.rados.2.smithi057.stdout:2439: finishing write tid 2 to smithi05720651-30 2020-11-16T22:11:04.141 INFO:tasks.rados.rados.2.smithi057.stdout:2439: finishing write tid 3 to smithi05720651-30 2020-11-16T22:11:04.142 INFO:tasks.rados.rados.2.smithi057.stdout:2440: done (1 left) 2020-11-16T22:11:04.142 INFO:tasks.rados.rados.2.smithi057.stdout:2441: write (excl) oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 284 2020-11-16T22:11:04.142 INFO:tasks.rados.rados.2.smithi057.stdout:2441: seq_num 824 ranges {648968=571300,1651986=639273,2728546=631668} 2020-11-16T22:11:04.152 INFO:tasks.rados.rados.2.smithi057.stdout:2441: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 648968 to 1220268 tid 1 2020-11-16T22:11:04.159 INFO:tasks.rados.rados.2.smithi057.stdout:2441: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1651986 to 2291259 tid 2 2020-11-16T22:11:04.165 INFO:tasks.rados.rados.2.smithi057.stdout:2441: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2728546 to 3360214 tid 3 2020-11-16T22:11:04.165 INFO:tasks.rados.rados.2.smithi057.stdout:2442: read oid 2 snap 282 2020-11-16T22:11:04.165 INFO:tasks.rados.rados.2.smithi057.stdout:2442: expect deleted 2020-11-16T22:11:04.166 INFO:tasks.rados.rados.2.smithi057.stdout:2443: delete oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 284 2020-11-16T22:11:04.166 INFO:tasks.rados.rados.2.smithi057.stdout:2439: finishing write tid 5 to smithi05720651-30 2020-11-16T22:11:04.166 INFO:tasks.rados.rados.2.smithi057.stdout:2439: finishing write tid 6 to smithi05720651-30 2020-11-16T22:11:04.166 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 1721 (ObjNum 822 snap 284 seq_num 822) dirty exists 2020-11-16T22:11:04.166 INFO:tasks.rados.rados.2.smithi057.stdout:2439: left oid 30 (ObjNum 822 snap 284 seq_num 822) 2020-11-16T22:11:04.166 INFO:tasks.rados.rados.2.smithi057.stdout:2441: finishing write tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:04.173 INFO:tasks.rados.rados.2.smithi057.stdout:2439: done (3 left) 2020-11-16T22:11:04.174 INFO:tasks.rados.rados.2.smithi057.stdout:2442: done (2 left) 2020-11-16T22:11:04.174 INFO:tasks.rados.rados.2.smithi057.stdout:2443: done (1 left) 2020-11-16T22:11:04.174 INFO:tasks.rados.rados.2.smithi057.stdout:2444: rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 284 2020-11-16T22:11:04.174 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 281 2020-11-16T22:11:04.174 INFO:tasks.rados.rados.2.smithi057.stdout:2445: write oid 46 current snap is 284 2020-11-16T22:11:04.174 INFO:tasks.rados.rados.2.smithi057.stdout:2445: seq_num 826 ranges {682582=721798,2168950=642942,3583392=299190} 2020-11-16T22:11:04.183 INFO:tasks.rados.rados.2.smithi057.stdout:2445: writing smithi05720651-46 from 682582 to 1404380 tid 1 2020-11-16T22:11:04.193 INFO:tasks.rados.rados.2.smithi057.stdout:2445: writing smithi05720651-46 from 2168950 to 2811892 tid 2 2020-11-16T22:11:04.199 INFO:tasks.rados.rados.2.smithi057.stdout:2445: writing smithi05720651-46 from 3583392 to 3882582 tid 3 2020-11-16T22:11:04.199 INFO:tasks.rados.rados.2.smithi057.stdout:2446: copy_from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 284 2020-11-16T22:11:04.199 INFO:tasks.rados.rados.2.smithi057.stdout:2441: finishing write tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:04.199 INFO:tasks.rados.rados.2.smithi057.stdout:2447: copy_from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 4 current snap is 284 2020-11-16T22:11:04.200 INFO:tasks.rados.rados.2.smithi057.stdout:2441: finishing write tid 3 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:04.200 INFO:tasks.rados.rados.2.smithi057.stdout:2444: finishing rollback tid 0 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:04.200 INFO:tasks.rados.rados.2.smithi057.stdout:2444: finishing rollback tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:04.200 INFO:tasks.rados.rados.2.smithi057.stdout:2444: finishing rollback tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:04.200 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1724 (ObjNum 818 snap 279 seq_num 818) dirty exists 2020-11-16T22:11:04.200 INFO:tasks.rados.rados.2.smithi057.stdout:2445: finishing write tid 1 to smithi05720651-46 2020-11-16T22:11:04.200 INFO:tasks.rados.rados.2.smithi057.stdout:2445: finishing write tid 2 to smithi05720651-46 2020-11-16T22:11:04.201 INFO:tasks.rados.rados.2.smithi057.stdout:2444: done (4 left) 2020-11-16T22:11:04.201 INFO:tasks.rados.rados.2.smithi057.stdout:2448: write oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 284 2020-11-16T22:11:04.201 INFO:tasks.rados.rados.2.smithi057.stdout:2448: seq_num 827 ranges {699389=797047,2111079=502953,3094462=581837} 2020-11-16T22:11:04.208 INFO:tasks.rados.rados.2.smithi057.stdout:2448: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 699389 to 1496436 tid 1 2020-11-16T22:11:04.214 INFO:tasks.rados.rados.2.smithi057.stdout:2448: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2111079 to 2614032 tid 2 2020-11-16T22:11:04.221 INFO:tasks.rados.rados.2.smithi057.stdout:2448: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3094462 to 3676299 tid 3 2020-11-16T22:11:04.221 INFO:tasks.rados.rados.2.smithi057.stdout:2449: read oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:04.221 INFO:tasks.rados.rados.2.smithi057.stdout:2449: expect (ObjNum 816 snap 279 seq_num 816) 2020-11-16T22:11:04.221 INFO:tasks.rados.rados.2.smithi057.stdout:2450: delete oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 284 2020-11-16T22:11:04.221 INFO:tasks.rados.rados.2.smithi057.stdout:2447: finishing copy_from to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:04.222 INFO:tasks.rados.rados.2.smithi057.stdout:2447: got expected ENOENT (src dne) 2020-11-16T22:11:04.222 INFO:tasks.rados.rados.2.smithi057.stdout:2447: finishing copy_from racing read to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:04.222 INFO:tasks.rados.rados.2.smithi057.stdout:2445: finishing write tid 3 to smithi05720651-46 2020-11-16T22:11:04.222 INFO:tasks.rados.rados.2.smithi057.stdout:2445: finishing write tid 5 to smithi05720651-46 2020-11-16T22:11:04.222 INFO:tasks.rados.rados.2.smithi057.stdout:2445: finishing write tid 6 to smithi05720651-46 2020-11-16T22:11:04.222 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 1728 (ObjNum 826 snap 284 seq_num 826) dirty exists 2020-11-16T22:11:04.222 INFO:tasks.rados.rados.2.smithi057.stdout:2445: left oid 46 (ObjNum 826 snap 284 seq_num 826) 2020-11-16T22:11:04.223 INFO:tasks.rados.rados.2.smithi057.stdout:2448: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:04.223 INFO:tasks.rados.rados.2.smithi057.stdout:2448: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:04.223 INFO:tasks.rados.rados.2.smithi057.stdout:2446: finishing copy_from to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:04.223 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1710 (ObjNum 697 snap 243 seq_num 697) dirty exists 2020-11-16T22:11:04.224 INFO:tasks.rados.rados.2.smithi057.stdout:2448: finishing write tid 3 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:04.224 INFO:tasks.rados.rados.2.smithi057.stdout:2446: finishing copy_from racing read to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:04.225 INFO:tasks.rados.rados.2.smithi057.stdout:2448: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:04.225 INFO:tasks.rados.rados.2.smithi057.stdout:2445: done (6 left) 2020-11-16T22:11:04.225 INFO:tasks.rados.rados.2.smithi057.stdout:2446: done (5 left) 2020-11-16T22:11:04.225 INFO:tasks.rados.rados.2.smithi057.stdout:2447: done (4 left) 2020-11-16T22:11:04.225 INFO:tasks.rados.rados.2.smithi057.stdout:2450: done (3 left) 2020-11-16T22:11:04.225 INFO:tasks.rados.rados.2.smithi057.stdout:2451: snap_remove snap 274 2020-11-16T22:11:04.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:04 smithi195 bash[10218]: cluster 2020-11-16T22:11:03.105091+0000 mon.a (mon.0) 1295 : cluster [DBG] osdmap e635: 12 total, 12 up, 12 in 2020-11-16T22:11:04.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:04 smithi057 bash[10301]: cluster 2020-11-16T22:11:03.105091+0000 mon.a (mon.0) 1295 : cluster [DBG] osdmap e635: 12 total, 12 up, 12 in 2020-11-16T22:11:04.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:04 smithi016 bash[10302]: cluster 2020-11-16T22:11:03.105091+0000 mon.a (mon.0) 1295 : cluster [DBG] osdmap e635: 12 total, 12 up, 12 in 2020-11-16T22:11:05.075 INFO:tasks.rados.rados.2.smithi057.stdout:2451: done (3 left) 2020-11-16T22:11:05.075 INFO:tasks.rados.rados.2.smithi057.stdout:2452: write (excl) oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 284 2020-11-16T22:11:05.076 INFO:tasks.rados.rados.2.smithi057.stdout:2452: seq_num 829 ranges {733003=663898,1944396=506622,2865661=604381} 2020-11-16T22:11:05.091 INFO:tasks.rados.rados.2.smithi057.stdout:2452: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 733003 to 1396901 tid 1 2020-11-16T22:11:05.097 INFO:tasks.rados.rados.2.smithi057.stdout:2452: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1944396 to 2451018 tid 2 2020-11-16T22:11:05.104 INFO:tasks.rados.rados.2.smithi057.stdout:2452: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2865661 to 3470042 tid 3 2020-11-16T22:11:05.104 INFO:tasks.rados.rados.2.smithi057.stdout:2453: snap_create 2020-11-16T22:11:05.104 INFO:tasks.rados.rados.2.smithi057.stdout:2448: finishing write tid 6 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:05.104 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 159 (ObjNum 827 snap 284 seq_num 827) dirty exists 2020-11-16T22:11:05.104 INFO:tasks.rados.rados.2.smithi057.stdout:2448: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 827 snap 284 seq_num 827) 2020-11-16T22:11:05.105 INFO:tasks.rados.rados.2.smithi057.stdout:2449: expect (ObjNum 816 snap 279 seq_num 816) 2020-11-16T22:11:05.370 INFO:tasks.rados.rados.2.smithi057.stdout:2441: finishing write tid 5 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:05.370 INFO:tasks.rados.rados.2.smithi057.stdout:2441: finishing write tid 6 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:05.370 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1827 (ObjNum 824 snap 284 seq_num 824) dirty exists 2020-11-16T22:11:05.370 INFO:tasks.rados.rados.2.smithi057.stdout:2441: left oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 824 snap 284 seq_num 824) 2020-11-16T22:11:05.370 INFO:tasks.rados.rados.2.smithi057.stdout:2452: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:05.371 INFO:tasks.rados.rados.2.smithi057.stdout:2452: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:05.371 INFO:tasks.rados.rados.2.smithi057.stdout:2452: finishing write tid 3 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:05.371 INFO:tasks.rados.rados.2.smithi057.stdout:2452: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:05.371 INFO:tasks.rados.rados.2.smithi057.stdout:2452: finishing write tid 6 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:05.371 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1715 (ObjNum 829 snap 284 seq_num 829) dirty exists 2020-11-16T22:11:05.371 INFO:tasks.rados.rados.2.smithi057.stdout:2452: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 829 snap 284 seq_num 829) 2020-11-16T22:11:05.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:05 smithi057 bash[10301]: cluster 2020-11-16T22:11:03.761388+0000 mgr.x (mgr.24115) 553 : cluster [DBG] pgmap v1118: 17 pgs: 17 active+clean; 220 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2020-11-16T22:11:05.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:05 smithi057 bash[10301]: cluster 2020-11-16T22:11:04.114336+0000 mon.a (mon.0) 1296 : cluster [DBG] osdmap e636: 12 total, 12 up, 12 in 2020-11-16T22:11:05.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:05 smithi057 bash[10301]: cluster 2020-11-16T22:11:05.086465+0000 mon.a (mon.0) 1297 : cluster [DBG] osdmap e637: 12 total, 12 up, 12 in 2020-11-16T22:11:05.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:05 smithi016 bash[10302]: cluster 2020-11-16T22:11:03.761388+0000 mgr.x (mgr.24115) 553 : cluster [DBG] pgmap v1118: 17 pgs: 17 active+clean; 220 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2020-11-16T22:11:05.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:05 smithi016 bash[10302]: cluster 2020-11-16T22:11:04.114336+0000 mon.a (mon.0) 1296 : cluster [DBG] osdmap e636: 12 total, 12 up, 12 in 2020-11-16T22:11:05.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:05 smithi016 bash[10302]: cluster 2020-11-16T22:11:05.086465+0000 mon.a (mon.0) 1297 : cluster [DBG] osdmap e637: 12 total, 12 up, 12 in 2020-11-16T22:11:05.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:05 smithi195 bash[10218]: cluster 2020-11-16T22:11:03.761388+0000 mgr.x (mgr.24115) 553 : cluster [DBG] pgmap v1118: 17 pgs: 17 active+clean; 220 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 14 op/s 2020-11-16T22:11:05.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:05 smithi195 bash[10218]: cluster 2020-11-16T22:11:04.114336+0000 mon.a (mon.0) 1296 : cluster [DBG] osdmap e636: 12 total, 12 up, 12 in 2020-11-16T22:11:05.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:05 smithi195 bash[10218]: cluster 2020-11-16T22:11:05.086465+0000 mon.a (mon.0) 1297 : cluster [DBG] osdmap e637: 12 total, 12 up, 12 in 2020-11-16T22:11:06.114 INFO:tasks.rados.rados.2.smithi057.stdout:2441: done (4 left) 2020-11-16T22:11:06.115 INFO:tasks.rados.rados.2.smithi057.stdout:2448: done (3 left) 2020-11-16T22:11:06.115 INFO:tasks.rados.rados.2.smithi057.stdout:2449: done (2 left) 2020-11-16T22:11:06.115 INFO:tasks.rados.rados.2.smithi057.stdout:2452: done (1 left) 2020-11-16T22:11:06.115 INFO:tasks.rados.rados.2.smithi057.stdout:2453: done (0 left) 2020-11-16T22:11:06.115 INFO:tasks.rados.rados.2.smithi057.stdout:2454: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 281 2020-11-16T22:11:06.116 INFO:tasks.rados.rados.2.smithi057.stdout:2454: expect (ObjNum 810 snap 276 seq_num 810) 2020-11-16T22:11:06.116 INFO:tasks.rados.rados.2.smithi057.stdout:2455: write oid 50 current snap is 285 2020-11-16T22:11:06.116 INFO:tasks.rados.rados.2.smithi057.stdout:2455: seq_num 830 ranges {749810=739147,2002878=650280,3293084=415653} 2020-11-16T22:11:06.131 INFO:tasks.rados.rados.2.smithi057.stdout:2455: writing smithi05720651-50 from 749810 to 1488957 tid 1 2020-11-16T22:11:06.137 INFO:tasks.rados.rados.2.smithi057.stdout:2455: writing smithi05720651-50 from 2002878 to 2653158 tid 2 2020-11-16T22:11:06.143 INFO:tasks.rados.rados.2.smithi057.stdout:2455: writing smithi05720651-50 from 3293084 to 3708737 tid 3 2020-11-16T22:11:06.144 INFO:tasks.rados.rados.2.smithi057.stdout:2456: write oid 48 current snap is 285 2020-11-16T22:11:06.144 INFO:tasks.rados.rados.2.smithi057.stdout:2456: seq_num 831 ranges {766617=414396,1945007=510291,3204154=626925} 2020-11-16T22:11:06.150 INFO:tasks.rados.rados.2.smithi057.stdout:2456: writing smithi05720651-48 from 766617 to 1181013 tid 1 2020-11-16T22:11:06.157 INFO:tasks.rados.rados.2.smithi057.stdout:2456: writing smithi05720651-48 from 1945007 to 2455298 tid 2 2020-11-16T22:11:06.165 INFO:tasks.rados.rados.2.smithi057.stdout:2456: writing smithi05720651-48 from 3204154 to 3831079 tid 3 2020-11-16T22:11:06.166 INFO:tasks.rados.rados.2.smithi057.stdout:2457: delete oid 46 current snap is 285 2020-11-16T22:11:06.166 INFO:tasks.rados.rados.2.smithi057.stdout:2454: expect (ObjNum 810 snap 276 seq_num 810) 2020-11-16T22:11:06.406 INFO:tasks.rados.rados.2.smithi057.stdout:2455: finishing write tid 1 to smithi05720651-50 2020-11-16T22:11:06.406 INFO:tasks.rados.rados.2.smithi057.stdout:2455: finishing write tid 2 to smithi05720651-50 2020-11-16T22:11:06.407 INFO:tasks.rados.rados.2.smithi057.stdout:2455: finishing write tid 3 to smithi05720651-50 2020-11-16T22:11:06.407 INFO:tasks.rados.rados.2.smithi057.stdout:2455: finishing write tid 5 to smithi05720651-50 2020-11-16T22:11:06.407 INFO:tasks.rados.rados.2.smithi057.stdout:2455: finishing write tid 6 to smithi05720651-50 2020-11-16T22:11:06.407 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 1836 (ObjNum 830 snap 285 seq_num 830) dirty exists 2020-11-16T22:11:06.407 INFO:tasks.rados.rados.2.smithi057.stdout:2455: left oid 50 (ObjNum 830 snap 285 seq_num 830) 2020-11-16T22:11:06.407 INFO:tasks.rados.rados.2.smithi057.stdout:2456: finishing write tid 1 to smithi05720651-48 2020-11-16T22:11:06.407 INFO:tasks.rados.rados.2.smithi057.stdout:2456: finishing write tid 2 to smithi05720651-48 2020-11-16T22:11:06.408 INFO:tasks.rados.rados.2.smithi057.stdout:2456: finishing write tid 3 to smithi05720651-48 2020-11-16T22:11:06.408 INFO:tasks.rados.rados.2.smithi057.stdout:2456: finishing write tid 5 to smithi05720651-48 2020-11-16T22:11:06.408 INFO:tasks.rados.rados.2.smithi057.stdout:2456: finishing write tid 6 to smithi05720651-48 2020-11-16T22:11:06.408 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 1515 (ObjNum 831 snap 285 seq_num 831) dirty exists 2020-11-16T22:11:06.408 INFO:tasks.rados.rados.2.smithi057.stdout:2456: left oid 48 (ObjNum 831 snap 285 seq_num 831) 2020-11-16T22:11:06.408 INFO:tasks.rados.rados.2.smithi057.stdout:2454: done (3 left) 2020-11-16T22:11:06.408 INFO:tasks.rados.rados.2.smithi057.stdout:2455: done (2 left) 2020-11-16T22:11:06.409 INFO:tasks.rados.rados.2.smithi057.stdout:2456: done (1 left) 2020-11-16T22:11:06.409 INFO:tasks.rados.rados.2.smithi057.stdout:2457: done (0 left) 2020-11-16T22:11:06.409 INFO:tasks.rados.rados.2.smithi057.stdout:2458: write oid 20 current snap is 285 2020-11-16T22:11:06.409 INFO:tasks.rados.rados.2.smithi057.stdout:2458: seq_num 833 ranges {400231=564894,1661971=338260} 2020-11-16T22:11:06.417 INFO:tasks.rados.rados.2.smithi057.stdout:2458: writing smithi05720651-20 from 400231 to 965125 tid 1 2020-11-16T22:11:06.423 INFO:tasks.rados.rados.2.smithi057.stdout:2458: writing smithi05720651-20 from 1661971 to 2000231 tid 2 2020-11-16T22:11:06.423 INFO:tasks.rados.rados.2.smithi057.stdout:2459: snap_remove snap 279 2020-11-16T22:11:07.124 INFO:tasks.rados.rados.2.smithi057.stdout:2459: done (1 left) 2020-11-16T22:11:07.124 INFO:tasks.rados.rados.2.smithi057.stdout:2460: read oid 44 snap -1 2020-11-16T22:11:07.124 INFO:tasks.rados.rados.2.smithi057.stdout:2460: expect (ObjNum 789 snap 272 seq_num 789) 2020-11-16T22:11:07.125 INFO:tasks.rados.rados.2.smithi057.stdout:2461: read oid 12 snap -1 2020-11-16T22:11:07.125 INFO:tasks.rados.rados.2.smithi057.stdout:2461: expect (ObjNum 797 snap 276 seq_num 797) 2020-11-16T22:11:07.125 INFO:tasks.rados.rados.2.smithi057.stdout:2462: snap_create 2020-11-16T22:11:07.125 INFO:tasks.rados.rados.2.smithi057.stdout:2458: finishing write tid 1 to smithi05720651-20 2020-11-16T22:11:07.125 INFO:tasks.rados.rados.2.smithi057.stdout:2458: finishing write tid 2 to smithi05720651-20 2020-11-16T22:11:07.125 INFO:tasks.rados.rados.2.smithi057.stdout:2458: finishing write tid 4 to smithi05720651-20 2020-11-16T22:11:07.125 INFO:tasks.rados.rados.2.smithi057.stdout:2458: finishing write tid 5 to smithi05720651-20 2020-11-16T22:11:07.126 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1774 (ObjNum 833 snap 285 seq_num 833) dirty exists 2020-11-16T22:11:07.126 INFO:tasks.rados.rados.2.smithi057.stdout:2458: left oid 20 (ObjNum 833 snap 285 seq_num 833) 2020-11-16T22:11:07.135 INFO:tasks.rados.rados.2.smithi057.stdout:2460: expect (ObjNum 789 snap 272 seq_num 789) 2020-11-16T22:11:07.272 INFO:tasks.rados.rados.2.smithi057.stdout:2461: expect (ObjNum 797 snap 276 seq_num 797) 2020-11-16T22:11:07.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:07 smithi057 bash[10301]: cluster 2020-11-16T22:11:05.762100+0000 mgr.x (mgr.24115) 554 : cluster [DBG] pgmap v1121: 17 pgs: 17 active+clean; 187 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 2.6 MiB/s wr, 9 op/s 2020-11-16T22:11:07.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:07 smithi057 bash[10301]: cluster 2020-11-16T22:11:06.125932+0000 mon.a (mon.0) 1298 : cluster [DBG] osdmap e638: 12 total, 12 up, 12 in 2020-11-16T22:11:07.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:07 smithi016 bash[10302]: cluster 2020-11-16T22:11:05.762100+0000 mgr.x (mgr.24115) 554 : cluster [DBG] pgmap v1121: 17 pgs: 17 active+clean; 187 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 2.6 MiB/s wr, 9 op/s 2020-11-16T22:11:07.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:07 smithi016 bash[10302]: cluster 2020-11-16T22:11:06.125932+0000 mon.a (mon.0) 1298 : cluster [DBG] osdmap e638: 12 total, 12 up, 12 in 2020-11-16T22:11:07.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:07 smithi195 bash[10218]: cluster 2020-11-16T22:11:05.762100+0000 mgr.x (mgr.24115) 554 : cluster [DBG] pgmap v1121: 17 pgs: 17 active+clean; 187 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 2.6 MiB/s wr, 9 op/s 2020-11-16T22:11:07.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:07 smithi195 bash[10218]: cluster 2020-11-16T22:11:06.125932+0000 mon.a (mon.0) 1298 : cluster [DBG] osdmap e638: 12 total, 12 up, 12 in 2020-11-16T22:11:08.127 INFO:tasks.rados.rados.2.smithi057.stdout:2458: done (3 left) 2020-11-16T22:11:08.127 INFO:tasks.rados.rados.2.smithi057.stdout:2460: done (2 left) 2020-11-16T22:11:08.127 INFO:tasks.rados.rados.2.smithi057.stdout:2461: done (1 left) 2020-11-16T22:11:08.127 INFO:tasks.rados.rados.2.smithi057.stdout:2462: done (0 left) 2020-11-16T22:11:08.128 INFO:tasks.rados.rados.2.smithi057.stdout:2463: delete oid 34 current snap is 286 2020-11-16T22:11:08.136 INFO:tasks.rados.rados.2.smithi057.stdout:2463: done (0 left) 2020-11-16T22:11:08.137 INFO:tasks.rados.rados.2.smithi057.stdout:2464: snap_create 2020-11-16T22:11:08.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:08 smithi057 bash[10301]: cluster 2020-11-16T22:11:07.135844+0000 mon.a (mon.0) 1299 : cluster [DBG] osdmap e639: 12 total, 12 up, 12 in 2020-11-16T22:11:08.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:08 smithi016 bash[10302]: cluster 2020-11-16T22:11:07.135844+0000 mon.a (mon.0) 1299 : cluster [DBG] osdmap e639: 12 total, 12 up, 12 in 2020-11-16T22:11:08.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:08 smithi195 bash[10218]: cluster 2020-11-16T22:11:07.135844+0000 mon.a (mon.0) 1299 : cluster [DBG] osdmap e639: 12 total, 12 up, 12 in 2020-11-16T22:11:09.144 INFO:tasks.rados.rados.2.smithi057.stdout:2464: done (0 left) 2020-11-16T22:11:09.145 INFO:tasks.rados.rados.2.smithi057.stdout:2465: snap_remove snap 284 2020-11-16T22:11:09.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:09 smithi057 bash[10301]: cluster 2020-11-16T22:11:07.762825+0000 mgr.x (mgr.24115) 555 : cluster [DBG] pgmap v1124: 17 pgs: 17 active+clean; 157 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 3.6 MiB/s wr, 19 op/s 2020-11-16T22:11:09.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:09 smithi057 bash[10301]: cluster 2020-11-16T22:11:08.138234+0000 mon.a (mon.0) 1300 : cluster [DBG] osdmap e640: 12 total, 12 up, 12 in 2020-11-16T22:11:09.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:09 smithi016 bash[10302]: cluster 2020-11-16T22:11:07.762825+0000 mgr.x (mgr.24115) 555 : cluster [DBG] pgmap v1124: 17 pgs: 17 active+clean; 157 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 3.6 MiB/s wr, 19 op/s 2020-11-16T22:11:09.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:09 smithi016 bash[10302]: cluster 2020-11-16T22:11:08.138234+0000 mon.a (mon.0) 1300 : cluster [DBG] osdmap e640: 12 total, 12 up, 12 in 2020-11-16T22:11:09.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:09 smithi195 bash[10218]: cluster 2020-11-16T22:11:07.762825+0000 mgr.x (mgr.24115) 555 : cluster [DBG] pgmap v1124: 17 pgs: 17 active+clean; 157 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 3.6 MiB/s wr, 19 op/s 2020-11-16T22:11:09.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:09 smithi195 bash[10218]: cluster 2020-11-16T22:11:08.138234+0000 mon.a (mon.0) 1300 : cluster [DBG] osdmap e640: 12 total, 12 up, 12 in 2020-11-16T22:11:10.078 INFO:tasks.rados.rados.2.smithi057.stdout:2465: done (0 left) 2020-11-16T22:11:10.079 INFO:tasks.rados.rados.2.smithi057.stdout:2466: rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 287 2020-11-16T22:11:10.079 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 278 2020-11-16T22:11:10.079 INFO:tasks.rados.rados.2.smithi057.stdout:2467: write (excl) oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 287 2020-11-16T22:11:10.079 INFO:tasks.rados.rados.2.smithi057.stdout:2467: seq_num 835 ranges {433845=715392,1662582=371263} 2020-11-16T22:11:10.091 INFO:tasks.rados.rados.2.smithi057.stdout:2467: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 433845 to 1149237 tid 1 2020-11-16T22:11:10.097 INFO:tasks.rados.rados.2.smithi057.stdout:2467: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1662582 to 2033845 tid 2 2020-11-16T22:11:10.097 INFO:tasks.rados.rados.2.smithi057.stdout:2468: snap_create 2020-11-16T22:11:10.097 INFO:tasks.rados.rados.2.smithi057.stdout:2466: finishing rollback tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:10.098 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 33 snap 0 seq_num 1131374913) dirty dne 2020-11-16T22:11:10.098 INFO:tasks.rados.rados.2.smithi057.stdout:2467: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:10.102 INFO:tasks.rados.rados.2.smithi057.stdout:2467: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:10.103 INFO:tasks.rados.rados.2.smithi057.stdout:2467: finishing write tid 4 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:10.103 INFO:tasks.rados.rados.2.smithi057.stdout:2467: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:10.104 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1844 (ObjNum 835 snap 287 seq_num 835) dirty exists 2020-11-16T22:11:10.104 INFO:tasks.rados.rados.2.smithi057.stdout:2467: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 835 snap 287 seq_num 835) 2020-11-16T22:11:10.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:10 smithi016 bash[10302]: cluster 2020-11-16T22:11:09.156123+0000 mon.a (mon.0) 1301 : cluster [DBG] osdmap e641: 12 total, 12 up, 12 in 2020-11-16T22:11:10.338 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:10 smithi016 bash[10302]: cluster 2020-11-16T22:11:10.089695+0000 mon.a (mon.0) 1302 : cluster [DBG] osdmap e642: 12 total, 12 up, 12 in 2020-11-16T22:11:10.338 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:11:10 smithi016 bash[19825]: debug 2020-11-16T22:11:10.086+0000 7f0e12c1a700 -1 osd.7 pg_epoch: 642 pg[2.8( v 639'1646 (0'0,639'1646] local-lis/les=71/72 n=11 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [7,9] r=0 lpr=71 crt=639'1646 lcod 639'1644 mlcod 639'1644 active+clean+snaptrim trimq=[232~1] ps=[21b~1,229~1]] removing snap head 2020-11-16T22:11:10.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:10 smithi057 bash[10301]: cluster 2020-11-16T22:11:09.156123+0000 mon.a (mon.0) 1301 : cluster [DBG] osdmap e641: 12 total, 12 up, 12 in 2020-11-16T22:11:10.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:10 smithi057 bash[10301]: cluster 2020-11-16T22:11:10.089695+0000 mon.a (mon.0) 1302 : cluster [DBG] osdmap e642: 12 total, 12 up, 12 in 2020-11-16T22:11:10.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:10 smithi195 bash[10218]: cluster 2020-11-16T22:11:09.156123+0000 mon.a (mon.0) 1301 : cluster [DBG] osdmap e641: 12 total, 12 up, 12 in 2020-11-16T22:11:10.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:10 smithi195 bash[10218]: cluster 2020-11-16T22:11:10.089695+0000 mon.a (mon.0) 1302 : cluster [DBG] osdmap e642: 12 total, 12 up, 12 in 2020-11-16T22:11:11.092 INFO:tasks.rados.rados.2.smithi057.stdout:2466: done (2 left) 2020-11-16T22:11:11.092 INFO:tasks.rados.rados.2.smithi057.stdout:2467: done (1 left) 2020-11-16T22:11:11.093 INFO:tasks.rados.rados.2.smithi057.stdout:2468: done (0 left) 2020-11-16T22:11:11.093 INFO:tasks.rados.rados.2.smithi057.stdout:2469: read oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:11.093 INFO:tasks.rados.rados.2.smithi057.stdout:2469: expect (ObjNum 829 snap 284 seq_num 829) 2020-11-16T22:11:11.093 INFO:tasks.rados.rados.2.smithi057.stdout:2470: rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 288 2020-11-16T22:11:11.093 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 280 2020-11-16T22:11:11.093 INFO:tasks.rados.rados.2.smithi057.stdout:2471: read oid 18 snap -1 2020-11-16T22:11:11.093 INFO:tasks.rados.rados.2.smithi057.stdout:2471: expect (ObjNum 687 snap 242 seq_num 687) 2020-11-16T22:11:11.094 INFO:tasks.rados.rados.2.smithi057.stdout:2472: snap_remove snap 276 2020-11-16T22:11:11.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:11 smithi057 bash[10301]: cluster 2020-11-16T22:11:09.763499+0000 mgr.x (mgr.24115) 556 : cluster [DBG] pgmap v1127: 17 pgs: 17 active+clean; 157 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2020-11-16T22:11:11.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:11 smithi057 bash[10301]: cluster 2020-11-16T22:11:11.103270+0000 mon.a (mon.0) 1303 : cluster [DBG] osdmap e643: 12 total, 12 up, 12 in 2020-11-16T22:11:11.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:11 smithi016 bash[10302]: cluster 2020-11-16T22:11:09.763499+0000 mgr.x (mgr.24115) 556 : cluster [DBG] pgmap v1127: 17 pgs: 17 active+clean; 157 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2020-11-16T22:11:11.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:11 smithi016 bash[10302]: cluster 2020-11-16T22:11:11.103270+0000 mon.a (mon.0) 1303 : cluster [DBG] osdmap e643: 12 total, 12 up, 12 in 2020-11-16T22:11:11.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:11 smithi195 bash[10218]: cluster 2020-11-16T22:11:09.763499+0000 mgr.x (mgr.24115) 556 : cluster [DBG] pgmap v1127: 17 pgs: 17 active+clean; 157 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.0 MiB/s wr, 9 op/s 2020-11-16T22:11:11.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:11 smithi195 bash[10218]: cluster 2020-11-16T22:11:11.103270+0000 mon.a (mon.0) 1303 : cluster [DBG] osdmap e643: 12 total, 12 up, 12 in 2020-11-16T22:11:12.094 INFO:tasks.rados.rados.2.smithi057.stdout:2472: done (3 left) 2020-11-16T22:11:12.095 INFO:tasks.rados.rados.2.smithi057.stdout:2473: rollback oid 50 current snap is 288 2020-11-16T22:11:12.095 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 50 to 280 2020-11-16T22:11:12.095 INFO:tasks.rados.rados.2.smithi057.stdout:2470: finishing rollback tid 0 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:12.095 INFO:tasks.rados.rados.2.smithi057.stdout:2470: finishing rollback tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:12.095 INFO:tasks.rados.rados.2.smithi057.stdout:2469: expect (ObjNum 829 snap 284 seq_num 829) 2020-11-16T22:11:12.424 INFO:tasks.rados.rados.2.smithi057.stdout:2471: expect (ObjNum 687 snap 242 seq_num 687) 2020-11-16T22:11:12.636 INFO:tasks.rados.rados.2.smithi057.stdout:2470: finishing rollback tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:12.637 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1772 (ObjNum 803 snap 276 seq_num 803) dirty exists 2020-11-16T22:11:12.637 INFO:tasks.rados.rados.2.smithi057.stdout:2473: finishing rollback tid 0 to smithi05720651-50 2020-11-16T22:11:12.637 INFO:tasks.rados.rados.2.smithi057.stdout:2473: finishing rollback tid 1 to smithi05720651-50 2020-11-16T22:11:12.637 INFO:tasks.rados.rados.2.smithi057.stdout:2473: finishing rollback tid 2 to smithi05720651-50 2020-11-16T22:11:12.637 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 1852 (ObjNum 719 snap 249 seq_num 719) dirty exists 2020-11-16T22:11:12.638 INFO:tasks.rados.rados.2.smithi057.stdout:2469: done (3 left) 2020-11-16T22:11:12.638 INFO:tasks.rados.rados.2.smithi057.stdout:2470: done (2 left) 2020-11-16T22:11:12.638 INFO:tasks.rados.rados.2.smithi057.stdout:2471: done (1 left) 2020-11-16T22:11:12.638 INFO:tasks.rados.rados.2.smithi057.stdout:2473: done (0 left) 2020-11-16T22:11:12.638 INFO:tasks.rados.rados.2.smithi057.stdout:2474: snap_create 2020-11-16T22:11:13.165 INFO:tasks.rados.rados.2.smithi057.stdout:2474: done (0 left) 2020-11-16T22:11:13.165 INFO:tasks.rados.rados.2.smithi057.stdout:2475: write oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 289 2020-11-16T22:11:13.165 INFO:tasks.rados.rados.2.smithi057.stdout:2475: seq_num 836 ranges {450652=790641,1721064=329588} 2020-11-16T22:11:13.178 INFO:tasks.rados.rados.2.smithi057.stdout:2475: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 450652 to 1241293 tid 1 2020-11-16T22:11:13.183 INFO:tasks.rados.rados.2.smithi057.stdout:2475: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1721064 to 2050652 tid 2 2020-11-16T22:11:13.184 INFO:tasks.rados.rados.2.smithi057.stdout:2476: write oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 289 2020-11-16T22:11:13.184 INFO:tasks.rados.rados.2.smithi057.stdout:2476: seq_num 837 ranges {467459=582243,1495899=404945} 2020-11-16T22:11:13.189 INFO:tasks.rados.rados.2.smithi057.stdout:2476: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 467459 to 1049702 tid 1 2020-11-16T22:11:13.194 INFO:tasks.rados.rados.2.smithi057.stdout:2476: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1495899 to 1900844 tid 2 2020-11-16T22:11:13.194 INFO:tasks.rados.rados.2.smithi057.stdout:2477: snap_remove snap 287 2020-11-16T22:11:13.349 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:13 smithi195 bash[10218]: cluster 2020-11-16T22:11:11.764215+0000 mgr.x (mgr.24115) 557 : cluster [DBG] pgmap v1130: 17 pgs: 17 active+clean; 146 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2020-11-16T22:11:13.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:13 smithi195 bash[10218]: cluster 2020-11-16T22:11:12.105821+0000 mon.a (mon.0) 1304 : cluster [DBG] osdmap e644: 12 total, 12 up, 12 in 2020-11-16T22:11:13.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:13 smithi057 bash[10301]: cluster 2020-11-16T22:11:11.764215+0000 mgr.x (mgr.24115) 557 : cluster [DBG] pgmap v1130: 17 pgs: 17 active+clean; 146 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2020-11-16T22:11:13.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:13 smithi057 bash[10301]: cluster 2020-11-16T22:11:12.105821+0000 mon.a (mon.0) 1304 : cluster [DBG] osdmap e644: 12 total, 12 up, 12 in 2020-11-16T22:11:13.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:13 smithi016 bash[10302]: cluster 2020-11-16T22:11:11.764215+0000 mgr.x (mgr.24115) 557 : cluster [DBG] pgmap v1130: 17 pgs: 17 active+clean; 146 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2020-11-16T22:11:13.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:13 smithi016 bash[10302]: cluster 2020-11-16T22:11:12.105821+0000 mon.a (mon.0) 1304 : cluster [DBG] osdmap e644: 12 total, 12 up, 12 in 2020-11-16T22:11:14.167 INFO:tasks.rados.rados.2.smithi057.stdout:2477: done (2 left) 2020-11-16T22:11:14.167 INFO:tasks.rados.rados.2.smithi057.stdout:2478: delete oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 289 2020-11-16T22:11:14.168 INFO:tasks.rados.rados.2.smithi057.stdout:2475: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:14.168 INFO:tasks.rados.rados.2.smithi057.stdout:2475: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:14.168 INFO:tasks.rados.rados.2.smithi057.stdout:2475: finishing write tid 4 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:14.168 INFO:tasks.rados.rados.2.smithi057.stdout:2475: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:14.168 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1855 (ObjNum 836 snap 289 seq_num 836) dirty exists 2020-11-16T22:11:14.168 INFO:tasks.rados.rados.2.smithi057.stdout:2475: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 836 snap 289 seq_num 836) 2020-11-16T22:11:14.169 INFO:tasks.rados.rados.2.smithi057.stdout:2476: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:14.169 INFO:tasks.rados.rados.2.smithi057.stdout:2476: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:14.169 INFO:tasks.rados.rados.2.smithi057.stdout:2476: finishing write tid 4 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:14.169 INFO:tasks.rados.rados.2.smithi057.stdout:2476: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:14.169 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1859 (ObjNum 837 snap 289 seq_num 837) dirty exists 2020-11-16T22:11:14.169 INFO:tasks.rados.rados.2.smithi057.stdout:2476: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 837 snap 289 seq_num 837) 2020-11-16T22:11:14.170 INFO:tasks.rados.rados.2.smithi057.stdout:2475: done (2 left) 2020-11-16T22:11:14.171 INFO:tasks.rados.rados.2.smithi057.stdout:2476: done (1 left) 2020-11-16T22:11:14.171 INFO:tasks.rados.rados.2.smithi057.stdout:2478: done (0 left) 2020-11-16T22:11:14.171 INFO:tasks.rados.rados.2.smithi057.stdout:2479: copy_from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 28 current snap is 289 2020-11-16T22:11:14.171 INFO:tasks.rados.rados.2.smithi057.stdout:2480: snap_remove snap 285 2020-11-16T22:11:14.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:14 smithi057 bash[10301]: cluster 2020-11-16T22:11:13.170593+0000 mon.a (mon.0) 1305 : cluster [DBG] osdmap e645: 12 total, 12 up, 12 in 2020-11-16T22:11:14.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:14 smithi057 bash[10301]: audit 2020-11-16T22:11:13.779882+0000 mon.b (mon.1) 303 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T22:11:14.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:14 smithi057 bash[10301]: audit 2020-11-16T22:11:13.780544+0000 mon.b (mon.1) 304 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T22:11:14.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:14 smithi057 bash[10301]: audit 2020-11-16T22:11:13.781229+0000 mon.b (mon.1) 305 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T22:11:14.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:14 smithi016 bash[10302]: cluster 2020-11-16T22:11:13.170593+0000 mon.a (mon.0) 1305 : cluster [DBG] osdmap e645: 12 total, 12 up, 12 in 2020-11-16T22:11:14.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:14 smithi016 bash[10302]: audit 2020-11-16T22:11:13.779882+0000 mon.b (mon.1) 303 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T22:11:14.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:14 smithi016 bash[10302]: audit 2020-11-16T22:11:13.780544+0000 mon.b (mon.1) 304 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T22:11:14.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:14 smithi016 bash[10302]: audit 2020-11-16T22:11:13.781229+0000 mon.b (mon.1) 305 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T22:11:14.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:14 smithi195 bash[10218]: cluster 2020-11-16T22:11:13.170593+0000 mon.a (mon.0) 1305 : cluster [DBG] osdmap e645: 12 total, 12 up, 12 in 2020-11-16T22:11:14.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:14 smithi195 bash[10218]: audit 2020-11-16T22:11:13.779882+0000 mon.b (mon.1) 303 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T22:11:14.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:14 smithi195 bash[10218]: audit 2020-11-16T22:11:13.780544+0000 mon.b (mon.1) 304 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T22:11:14.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:14 smithi195 bash[10218]: audit 2020-11-16T22:11:13.781229+0000 mon.b (mon.1) 305 : audit [DBG] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2020-11-16T22:11:15.085 INFO:tasks.rados.rados.2.smithi057.stdout:2480: done (1 left) 2020-11-16T22:11:15.085 INFO:tasks.rados.rados.2.smithi057.stdout:2481: snap_remove snap 282 2020-11-16T22:11:15.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:15 smithi057 bash[10301]: cluster 2020-11-16T22:11:14.173668+0000 mon.a (mon.0) 1306 : cluster [DBG] osdmap e646: 12 total, 12 up, 12 in 2020-11-16T22:11:15.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:15 smithi057 bash[10301]: audit 2020-11-16T22:11:14.648693+0000 mon.b (mon.1) 306 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644082\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644301\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645006\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645593\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_id\": \"515cac7965a8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.646143\", \"created\": \"2020-11-16T21:59:17.849548\", \"started\": \"2020-11-16T21:59:21.095277\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.646886\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:03:13.288495\"}"}]: dispatch 2020-11-16T22:11:15.446 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:15 smithi057 bash[10301]: audit 2020-11-16T22:11:14.650106+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644082\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644301\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645006\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645593\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_id\": \"515cac7965a8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.646143\", \"created\": \"2020-11-16T21:59:17.849548\", \"started\": \"2020-11-16T21:59:21.095277\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.646886\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:03:13.288495\"}"}]: dispatch 2020-11-16T22:11:15.650 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:15 smithi057 bash[10301]: audit 2020-11-16T22:11:14.651760+0000 mon.b (mon.1) 307 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649152\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649249\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649590\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649873\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_id\": \"845c4348cafa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.650209\", \"created\": \"2020-11-16T21:55:56.917880\", \"started\": \"2020-11-16T21:55:59.862159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.650622\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:01:48.400610\"}"}]: dispatch 2020-11-16T22:11:15.650 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:15 smithi057 bash[10301]: audit 2020-11-16T22:11:14.655982+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644082\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644301\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645006\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645593\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_id\": \"515cac7965a8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.646143\", \"created\": \"2020-11-16T21:59:17.849548\", \"started\": \"2020-11-16T21:59:21.095277\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.646886\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:03:13.288495\"}"}]': finished 2020-11-16T22:11:15.854 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:15 smithi057 bash[10301]: audit 2020-11-16T22:11:14.656695+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649152\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649249\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649590\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649873\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_id\": \"845c4348cafa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.650209\", \"created\": \"2020-11-16T21:55:56.917880\", \"started\": \"2020-11-16T21:55:59.862159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.650622\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:01:48.400610\"}"}]: dispatch 2020-11-16T22:11:16.058 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:15 smithi057 bash[10301]: audit 2020-11-16T22:11:14.660237+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649152\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649249\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649590\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649873\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_id\": \"845c4348cafa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.650209\", \"created\": \"2020-11-16T21:55:56.917880\", \"started\": \"2020-11-16T21:55:59.862159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.650622\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:01:48.400610\"}"}]': finished 2020-11-16T22:11:16.262 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:15 smithi057 bash[10301]: audit 2020-11-16T22:11:14.737378+0000 mon.b (mon.1) 308 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733536\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733718\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733818\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734372\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734775\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_id\": \"78c6be68ad72\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.735173\", \"created\": \"2020-11-16T21:57:35.868755\", \"started\": \"2020-11-16T21:57:39.078945\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.735687\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:03:13.299831\"}"}]: dispatch 2020-11-16T22:11:16.466 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:15 smithi057 bash[10301]: audit 2020-11-16T22:11:14.739057+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733536\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733718\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733818\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734372\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734775\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_id\": \"78c6be68ad72\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.735173\", \"created\": \"2020-11-16T21:57:35.868755\", \"started\": \"2020-11-16T21:57:39.078945\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.735687\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:03:13.299831\"}"}]: dispatch 2020-11-16T22:11:16.670 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:15 smithi057 bash[10301]: audit 2020-11-16T22:11:14.744583+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733536\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733718\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733818\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734372\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734775\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_id\": \"78c6be68ad72\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.735173\", \"created\": \"2020-11-16T21:57:35.868755\", \"started\": \"2020-11-16T21:57:39.078945\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.735687\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:03:13.299831\"}"}]': finished 2020-11-16T22:11:16.670 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:15 smithi057 bash[10301]: audit 2020-11-16T22:11:14.746036+0000 mon.b (mon.1) 309 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:11:16.671 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:15 smithi057 bash[10301]: audit 2020-11-16T22:11:14.747429+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:11:16.671 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:15 smithi057 bash[10301]: audit 2020-11-16T22:11:14.752236+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:11:16.671 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:15 smithi057 bash[10301]: cluster 2020-11-16T22:11:15.089877+0000 mon.a (mon.0) 1315 : cluster [DBG] osdmap e647: 12 total, 12 up, 12 in 2020-11-16T22:11:16.877 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:15 smithi195 bash[10218]: cluster 2020-11-16T22:11:14.173668+0000 mon.a (mon.0) 1306 : cluster [DBG] osdmap e646: 12 total, 12 up, 12 in 2020-11-16T22:11:16.877 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:15 smithi195 bash[10218]: audit 2020-11-16T22:11:14.648693+0000 mon.b (mon.1) 306 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644082\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644301\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645006\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645593\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_id\": \"515cac7965a8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.646143\", \"created\": \"2020-11-16T21:59:17.849548\", \"started\": \"2020-11-16T21:59:21.095277\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.646886\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:03:13.288495\"}"}]: dispatch 2020-11-16T22:11:16.878 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:15 smithi195 bash[10218]: audit 2020-11-16T22:11:14.650106+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644082\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644301\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645006\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645593\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_id\": \"515cac7965a8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.646143\", \"created\": \"2020-11-16T21:59:17.849548\", \"started\": \"2020-11-16T21:59:21.095277\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.646886\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:03:13.288495\"}"}]: dispatch 2020-11-16T22:11:17.082 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:15 smithi195 bash[10218]: audit 2020-11-16T22:11:14.651760+0000 mon.b (mon.1) 307 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649152\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649249\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649590\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649873\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_id\": \"845c4348cafa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.650209\", \"created\": \"2020-11-16T21:55:56.917880\", \"started\": \"2020-11-16T21:55:59.862159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.650622\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:01:48.400610\"}"}]: dispatch 2020-11-16T22:11:17.286 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:15 smithi195 bash[10218]: audit 2020-11-16T22:11:14.655982+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644082\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644301\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645006\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645593\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_id\": \"515cac7965a8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.646143\", \"created\": \"2020-11-16T21:59:17.849548\", \"started\": \"2020-11-16T21:59:21.095277\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.646886\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:03:13.288495\"}"}]': finished 2020-11-16T22:11:17.286 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:15 smithi195 bash[10218]: audit 2020-11-16T22:11:14.656695+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649152\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649249\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649590\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649873\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_id\": \"845c4348cafa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.650209\", \"created\": \"2020-11-16T21:55:56.917880\", \"started\": \"2020-11-16T21:55:59.862159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.650622\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:01:48.400610\"}"}]: dispatch 2020-11-16T22:11:17.286 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:15 smithi195 bash[10218]: audit 2020-11-16T22:11:14.660237+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649152\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649249\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649590\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649873\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_id\": \"845c4348cafa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.650209\", \"created\": \"2020-11-16T21:55:56.917880\", \"started\": \"2020-11-16T21:55:59.862159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.650622\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:01:48.400610\"}"}]': finished 2020-11-16T22:11:17.287 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:15 smithi195 bash[10218]: audit 2020-11-16T22:11:14.737378+0000 mon.b (mon.1) 308 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733536\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733718\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733818\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734372\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734775\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_id\": \"78c6be68ad72\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.735173\", \"created\": \"2020-11-16T21:57:35.868755\", \"started\": \"2020-11-16T21:57:39.078945\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.735687\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:03:13.299831\"}"}]: dispatch 2020-11-16T22:11:17.287 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:15 smithi195 bash[10218]: audit 2020-11-16T22:11:14.739057+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733536\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733718\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733818\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734372\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734775\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_id\": \"78c6be68ad72\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.735173\", \"created\": \"2020-11-16T21:57:35.868755\", \"started\": \"2020-11-16T21:57:39.078945\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.735687\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:03:13.299831\"}"}]: dispatch 2020-11-16T22:11:17.287 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:15 smithi195 bash[10218]: audit 2020-11-16T22:11:14.744583+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733536\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733718\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733818\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734372\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734775\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_id\": \"78c6be68ad72\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.735173\", \"created\": \"2020-11-16T21:57:35.868755\", \"started\": \"2020-11-16T21:57:39.078945\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.735687\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:03:13.299831\"}"}]': finished 2020-11-16T22:11:17.287 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:15 smithi195 bash[10218]: audit 2020-11-16T22:11:14.746036+0000 mon.b (mon.1) 309 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:11:17.288 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:15 smithi195 bash[10218]: audit 2020-11-16T22:11:14.747429+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:11:17.288 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:15 smithi195 bash[10218]: audit 2020-11-16T22:11:14.752236+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:11:17.288 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:15 smithi195 bash[10218]: cluster 2020-11-16T22:11:15.089877+0000 mon.a (mon.0) 1315 : cluster [DBG] osdmap e647: 12 total, 12 up, 12 in 2020-11-16T22:11:17.288 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:15 smithi016 bash[10302]: cluster 2020-11-16T22:11:14.173668+0000 mon.a (mon.0) 1306 : cluster [DBG] osdmap e646: 12 total, 12 up, 12 in 2020-11-16T22:11:17.289 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:15 smithi016 bash[10302]: audit 2020-11-16T22:11:14.648693+0000 mon.b (mon.1) 306 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644082\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644301\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645006\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645593\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_id\": \"515cac7965a8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.646143\", \"created\": \"2020-11-16T21:59:17.849548\", \"started\": \"2020-11-16T21:59:21.095277\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.646886\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:03:13.288495\"}"}]: dispatch 2020-11-16T22:11:17.289 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:15 smithi016 bash[10302]: audit 2020-11-16T22:11:14.650106+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644082\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644301\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645006\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645593\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_id\": \"515cac7965a8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.646143\", \"created\": \"2020-11-16T21:59:17.849548\", \"started\": \"2020-11-16T21:59:21.095277\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.646886\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:03:13.288495\"}"}]: dispatch 2020-11-16T22:11:17.289 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:15 smithi016 bash[10302]: audit 2020-11-16T22:11:14.651760+0000 mon.b (mon.1) 307 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649152\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649249\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649590\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649873\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_id\": \"845c4348cafa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.650209\", \"created\": \"2020-11-16T21:55:56.917880\", \"started\": \"2020-11-16T21:55:59.862159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.650622\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:01:48.400610\"}"}]: dispatch 2020-11-16T22:11:17.289 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:15 smithi016 bash[10302]: audit 2020-11-16T22:11:14.655982+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644082\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644301\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645006\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645593\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_id\": \"515cac7965a8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.646143\", \"created\": \"2020-11-16T21:59:17.849548\", \"started\": \"2020-11-16T21:59:21.095277\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.646886\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:03:13.288495\"}"}]': finished 2020-11-16T22:11:17.290 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:15 smithi016 bash[10302]: audit 2020-11-16T22:11:14.656695+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649152\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649249\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649590\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649873\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_id\": \"845c4348cafa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.650209\", \"created\": \"2020-11-16T21:55:56.917880\", \"started\": \"2020-11-16T21:55:59.862159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.650622\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:01:48.400610\"}"}]: dispatch 2020-11-16T22:11:17.494 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:15 smithi016 bash[10302]: audit 2020-11-16T22:11:14.660237+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649152\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649249\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649590\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649873\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_id\": \"845c4348cafa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.650209\", \"created\": \"2020-11-16T21:55:56.917880\", \"started\": \"2020-11-16T21:55:59.862159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.650622\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:01:48.400610\"}"}]': finished 2020-11-16T22:11:17.494 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:15 smithi016 bash[10302]: audit 2020-11-16T22:11:14.737378+0000 mon.b (mon.1) 308 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733536\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733718\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733818\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734372\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734775\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_id\": \"78c6be68ad72\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.735173\", \"created\": \"2020-11-16T21:57:35.868755\", \"started\": \"2020-11-16T21:57:39.078945\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.735687\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:03:13.299831\"}"}]: dispatch 2020-11-16T22:11:17.495 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:15 smithi016 bash[10302]: audit 2020-11-16T22:11:14.739057+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733536\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733718\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733818\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734372\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734775\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_id\": \"78c6be68ad72\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.735173\", \"created\": \"2020-11-16T21:57:35.868755\", \"started\": \"2020-11-16T21:57:39.078945\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.735687\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:03:13.299831\"}"}]: dispatch 2020-11-16T22:11:17.495 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:15 smithi016 bash[10302]: audit 2020-11-16T22:11:14.744583+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733536\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733718\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733818\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734372\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734775\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_id\": \"78c6be68ad72\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.735173\", \"created\": \"2020-11-16T21:57:35.868755\", \"started\": \"2020-11-16T21:57:39.078945\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.735687\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:03:13.299831\"}"}]': finished 2020-11-16T22:11:17.495 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:15 smithi016 bash[10302]: audit 2020-11-16T22:11:14.746036+0000 mon.b (mon.1) 309 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:11:17.495 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:15 smithi016 bash[10302]: audit 2020-11-16T22:11:14.747429+0000 mon.a (mon.0) 1313 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:11:17.495 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:15 smithi016 bash[10302]: audit 2020-11-16T22:11:14.752236+0000 mon.a (mon.0) 1314 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:11:17.496 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:15 smithi016 bash[10302]: cluster 2020-11-16T22:11:15.089877+0000 mon.a (mon.0) 1315 : cluster [DBG] osdmap e647: 12 total, 12 up, 12 in 2020-11-16T22:11:17.496 INFO:tasks.rados.rados.2.smithi057.stdout:2481: done (1 left) 2020-11-16T22:11:17.496 INFO:tasks.rados.rados.2.smithi057.stdout:2482: read oid 16 snap -1 2020-11-16T22:11:17.496 INFO:tasks.rados.rados.2.smithi057.stdout:2482: expect (ObjNum 650 snap 228 seq_num 650) 2020-11-16T22:11:17.496 INFO:tasks.rados.rados.2.smithi057.stdout:2483: rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 289 2020-11-16T22:11:17.496 INFO:tasks.rados.rados.2.smithi057.stdout:2479: finishing copy_from to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:17.497 INFO:tasks.rados.rados.2.smithi057.stdout:2479: got expected ENOENT (src dne) 2020-11-16T22:11:17.497 INFO:tasks.rados.rados.2.smithi057.stdout:2479: finishing copy_from racing read to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:17.497 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 288 2020-11-16T22:11:17.497 INFO:tasks.rados.rados.2.smithi057.stdout:2479: done (2 left) 2020-11-16T22:11:17.497 INFO:tasks.rados.rados.2.smithi057.stdout:2484: delete oid 42 current snap is 289 2020-11-16T22:11:17.497 INFO:tasks.rados.rados.2.smithi057.stdout:2484: done (2 left) 2020-11-16T22:11:17.497 INFO:tasks.rados.rados.2.smithi057.stdout:2485: read oid 14 snap -1 2020-11-16T22:11:17.498 INFO:tasks.rados.rados.2.smithi057.stdout:2485: expect (ObjNum 737 snap 256 seq_num 737) 2020-11-16T22:11:17.498 INFO:tasks.rados.rados.2.smithi057.stdout:2486: write oid 6 current snap is 289 2020-11-16T22:11:17.498 INFO:tasks.rados.rados.2.smithi057.stdout:2486: seq_num 840 ranges {517880=407990,1554992=562888} 2020-11-16T22:11:17.498 INFO:tasks.rados.rados.2.smithi057.stdout:2486: writing smithi05720651-6 from 517880 to 925870 tid 1 2020-11-16T22:11:17.498 INFO:tasks.rados.rados.2.smithi057.stdout:2486: writing smithi05720651-6 from 1554992 to 2117880 tid 2 2020-11-16T22:11:17.498 INFO:tasks.rados.rados.2.smithi057.stdout:2487: snap_remove snap 280 2020-11-16T22:11:17.500 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:17 smithi195 bash[10218]: cluster 2020-11-16T22:11:15.765640+0000 mgr.x (mgr.24115) 559 : cluster [DBG] pgmap v1136: 17 pgs: 17 active+clean; 150 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 515 KiB/s wr, 5 op/s 2020-11-16T22:11:17.501 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:17 smithi195 bash[10218]: cluster 2020-11-16T22:11:16.105535+0000 mon.a (mon.0) 1316 : cluster [DBG] osdmap e648: 12 total, 12 up, 12 in 2020-11-16T22:11:17.501 INFO:tasks.rados.rados.2.smithi057.stdout:2487: done (4 left) 2020-11-16T22:11:17.501 INFO:tasks.rados.rados.2.smithi057.stdout:2488: write (excl) oid 40 current snap is 289 2020-11-16T22:11:17.501 INFO:tasks.rados.rados.2.smithi057.stdout:2488: seq_num 841 ranges {534687=483239,1613474=412283} 2020-11-16T22:11:17.501 INFO:tasks.rados.rados.2.smithi057.stdout:2488: writing smithi05720651-40 from 534687 to 1017926 tid 1 2020-11-16T22:11:17.502 INFO:tasks.rados.rados.2.smithi057.stdout:2488: writing smithi05720651-40 from 1613474 to 2025757 tid 2 2020-11-16T22:11:17.502 INFO:tasks.rados.rados.2.smithi057.stdout:2489: delete oid 44 current snap is 289 2020-11-16T22:11:17.502 INFO:tasks.rados.rados.2.smithi057.stdout:2483: finishing rollback tid 0 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:17.502 INFO:tasks.rados.rados.2.smithi057.stdout:2483: finishing rollback tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:17.502 INFO:tasks.rados.rados.2.smithi057.stdout:2483: finishing rollback tid 2 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:17.502 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1518 (ObjNum 786 snap 272 seq_num 786) dirty exists 2020-11-16T22:11:17.502 INFO:tasks.rados.rados.2.smithi057.stdout:2485: expect (ObjNum 737 snap 256 seq_num 737) 2020-11-16T22:11:17.503 INFO:tasks.rados.rados.2.smithi057.stdout:2482: expect (ObjNum 650 snap 228 seq_num 650) 2020-11-16T22:11:17.503 INFO:tasks.rados.rados.2.smithi057.stdout:2486: finishing write tid 1 to smithi05720651-6 2020-11-16T22:11:17.503 INFO:tasks.rados.rados.2.smithi057.stdout:2486: finishing write tid 2 to smithi05720651-6 2020-11-16T22:11:17.503 INFO:tasks.rados.rados.2.smithi057.stdout:2486: finishing write tid 4 to smithi05720651-6 2020-11-16T22:11:17.503 INFO:tasks.rados.rados.2.smithi057.stdout:2486: finishing write tid 5 to smithi05720651-6 2020-11-16T22:11:17.503 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 1878 (ObjNum 840 snap 289 seq_num 840) dirty exists 2020-11-16T22:11:17.503 INFO:tasks.rados.rados.2.smithi057.stdout:2486: left oid 6 (ObjNum 840 snap 289 seq_num 840) 2020-11-16T22:11:17.504 INFO:tasks.rados.rados.2.smithi057.stdout:2488: finishing write tid 1 to smithi05720651-40 2020-11-16T22:11:17.504 INFO:tasks.rados.rados.2.smithi057.stdout:2488: finishing write tid 2 to smithi05720651-40 2020-11-16T22:11:17.504 INFO:tasks.rados.rados.2.smithi057.stdout:2488: finishing write tid 4 to smithi05720651-40 2020-11-16T22:11:17.504 INFO:tasks.rados.rados.2.smithi057.stdout:2488: finishing write tid 5 to smithi05720651-40 2020-11-16T22:11:17.504 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 2072 (ObjNum 841 snap 289 seq_num 841) dirty exists 2020-11-16T22:11:17.504 INFO:tasks.rados.rados.2.smithi057.stdout:2488: left oid 40 (ObjNum 841 snap 289 seq_num 841) 2020-11-16T22:11:17.504 INFO:tasks.rados.rados.2.smithi057.stdout:2482: done (5 left) 2020-11-16T22:11:17.505 INFO:tasks.rados.rados.2.smithi057.stdout:2483: done (4 left) 2020-11-16T22:11:17.505 INFO:tasks.rados.rados.2.smithi057.stdout:2485: done (3 left) 2020-11-16T22:11:17.505 INFO:tasks.rados.rados.2.smithi057.stdout:2486: done (2 left) 2020-11-16T22:11:17.505 INFO:tasks.rados.rados.2.smithi057.stdout:2488: done (1 left) 2020-11-16T22:11:17.505 INFO:tasks.rados.rados.2.smithi057.stdout:2489: done (0 left) 2020-11-16T22:11:17.505 INFO:tasks.rados.rados.2.smithi057.stdout:2490: write oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 289 2020-11-16T22:11:17.505 INFO:tasks.rados.rados.2.smithi057.stdout:2490: seq_num 843 ranges {568301=633737,1614085=415952} 2020-11-16T22:11:17.505 INFO:tasks.rados.rados.2.smithi057.stdout:2490: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 568301 to 1202038 tid 1 2020-11-16T22:11:17.506 INFO:tasks.rados.rados.2.smithi057.stdout:2490: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1614085 to 2030037 tid 2 2020-11-16T22:11:17.506 INFO:tasks.rados.rados.2.smithi057.stdout:2491: read oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 281 2020-11-16T22:11:17.506 INFO:tasks.rados.rados.2.smithi057.stdout:2491: expect deleted 2020-11-16T22:11:17.506 INFO:tasks.rados.rados.2.smithi057.stdout:2492: write oid 2 current snap is 289 2020-11-16T22:11:17.506 INFO:tasks.rados.rados.2.smithi057.stdout:2492: seq_num 844 ranges {585108=425339,1788920=396188} 2020-11-16T22:11:17.506 INFO:tasks.rados.rados.2.smithi057.stdout:2492: writing smithi05720651-2 from 585108 to 1010447 tid 1 2020-11-16T22:11:17.506 INFO:tasks.rados.rados.2.smithi057.stdout:2492: writing smithi05720651-2 from 1788920 to 2185108 tid 2 2020-11-16T22:11:17.507 INFO:tasks.rados.rados.2.smithi057.stdout:2493: snap_remove snap 278 2020-11-16T22:11:17.507 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:17 smithi057 bash[10301]: cluster 2020-11-16T22:11:15.765640+0000 mgr.x (mgr.24115) 559 : cluster [DBG] pgmap v1136: 17 pgs: 17 active+clean; 150 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 515 KiB/s wr, 5 op/s 2020-11-16T22:11:17.507 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:17 smithi057 bash[10301]: cluster 2020-11-16T22:11:16.105535+0000 mon.a (mon.0) 1316 : cluster [DBG] osdmap e648: 12 total, 12 up, 12 in 2020-11-16T22:11:17.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:17 smithi016 bash[10302]: cluster 2020-11-16T22:11:15.765640+0000 mgr.x (mgr.24115) 559 : cluster [DBG] pgmap v1136: 17 pgs: 17 active+clean; 150 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 515 KiB/s wr, 5 op/s 2020-11-16T22:11:17.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:17 smithi016 bash[10302]: cluster 2020-11-16T22:11:16.105535+0000 mon.a (mon.0) 1316 : cluster [DBG] osdmap e648: 12 total, 12 up, 12 in 2020-11-16T22:11:18.116 INFO:tasks.rados.rados.2.smithi057.stdout:2493: done (3 left) 2020-11-16T22:11:18.117 INFO:tasks.rados.rados.2.smithi057.stdout:2494: write oid 26 current snap is 289 2020-11-16T22:11:18.117 INFO:tasks.rados.rados.2.smithi057.stdout:2494: seq_num 845 ranges {601915=500588,1847402=354513} 2020-11-16T22:11:18.128 INFO:tasks.rados.rados.2.smithi057.stdout:2494: writing smithi05720651-26 from 601915 to 1102503 tid 1 2020-11-16T22:11:18.134 INFO:tasks.rados.rados.2.smithi057.stdout:2494: writing smithi05720651-26 from 1847402 to 2201915 tid 2 2020-11-16T22:11:18.135 INFO:tasks.rados.rados.2.smithi057.stdout:2495: write oid 22 current snap is 289 2020-11-16T22:11:18.135 INFO:tasks.rados.rados.2.smithi057.stdout:2495: seq_num 846 ranges {618722=575837,1905884=312838} 2020-11-16T22:11:18.141 INFO:tasks.rados.rados.2.smithi057.stdout:2495: writing smithi05720651-22 from 618722 to 1194559 tid 1 2020-11-16T22:11:18.148 INFO:tasks.rados.rados.2.smithi057.stdout:2495: writing smithi05720651-22 from 1905884 to 2218722 tid 2 2020-11-16T22:11:18.148 INFO:tasks.rados.rados.2.smithi057.stdout:2496: copy_from oid 50 from oid 12 current snap is 289 2020-11-16T22:11:18.148 INFO:tasks.rados.rados.2.smithi057.stdout:2492: finishing write tid 1 to smithi05720651-2 2020-11-16T22:11:18.148 INFO:tasks.rados.rados.2.smithi057.stdout:2490: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:18.148 INFO:tasks.rados.rados.2.smithi057.stdout:2490: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:18.148 INFO:tasks.rados.rados.2.smithi057.stdout:2490: finishing write tid 4 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:18.149 INFO:tasks.rados.rados.2.smithi057.stdout:2490: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:18.149 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1886 (ObjNum 843 snap 289 seq_num 843) dirty exists 2020-11-16T22:11:18.149 INFO:tasks.rados.rados.2.smithi057.stdout:2490: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 843 snap 289 seq_num 843) 2020-11-16T22:11:18.149 INFO:tasks.rados.rados.2.smithi057.stdout:2492: finishing write tid 2 to smithi05720651-2 2020-11-16T22:11:18.149 INFO:tasks.rados.rados.2.smithi057.stdout:2492: finishing write tid 4 to smithi05720651-2 2020-11-16T22:11:18.149 INFO:tasks.rados.rados.2.smithi057.stdout:2490: done (5 left) 2020-11-16T22:11:18.149 INFO:tasks.rados.rados.2.smithi057.stdout:2491: done (4 left) 2020-11-16T22:11:18.150 INFO:tasks.rados.rados.2.smithi057.stdout:2497: write (excl) oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 289 2020-11-16T22:11:18.150 INFO:tasks.rados.rados.2.smithi057.stdout:2497: seq_num 847 ranges {635529=651086,1848013=387516} 2020-11-16T22:11:18.155 INFO:tasks.rados.rados.2.smithi057.stdout:2497: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 635529 to 1286615 tid 1 2020-11-16T22:11:18.161 INFO:tasks.rados.rados.2.smithi057.stdout:2497: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1848013 to 2235529 tid 2 2020-11-16T22:11:18.161 INFO:tasks.rados.rados.2.smithi057.stdout:2498: read oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:18.161 INFO:tasks.rados.rados.2.smithi057.stdout:2498: expect (ObjNum 843 snap 289 seq_num 843) 2020-11-16T22:11:18.162 INFO:tasks.rados.rados.2.smithi057.stdout:2499: read oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:18.162 INFO:tasks.rados.rados.2.smithi057.stdout:2499: expect deleted 2020-11-16T22:11:18.162 INFO:tasks.rados.rados.2.smithi057.stdout:2500: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 277 2020-11-16T22:11:18.162 INFO:tasks.rados.rados.2.smithi057.stdout:2500: expect (ObjNum 804 snap 276 seq_num 804) 2020-11-16T22:11:18.162 INFO:tasks.rados.rados.2.smithi057.stdout:2501: copy_from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 289 2020-11-16T22:11:18.163 INFO:tasks.rados.rados.2.smithi057.stdout:2492: finishing write tid 5 to smithi05720651-2 2020-11-16T22:11:18.163 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 2075 (ObjNum 844 snap 289 seq_num 844) dirty exists 2020-11-16T22:11:18.163 INFO:tasks.rados.rados.2.smithi057.stdout:2492: left oid 2 (ObjNum 844 snap 289 seq_num 844) 2020-11-16T22:11:18.163 INFO:tasks.rados.rados.2.smithi057.stdout:2494: finishing write tid 1 to smithi05720651-26 2020-11-16T22:11:18.163 INFO:tasks.rados.rados.2.smithi057.stdout:2494: finishing write tid 2 to smithi05720651-26 2020-11-16T22:11:18.163 INFO:tasks.rados.rados.2.smithi057.stdout:2494: finishing write tid 4 to smithi05720651-26 2020-11-16T22:11:18.163 INFO:tasks.rados.rados.2.smithi057.stdout:2494: finishing write tid 5 to smithi05720651-26 2020-11-16T22:11:18.164 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 2081 (ObjNum 845 snap 289 seq_num 845) dirty exists 2020-11-16T22:11:18.164 INFO:tasks.rados.rados.2.smithi057.stdout:2494: left oid 26 (ObjNum 845 snap 289 seq_num 845) 2020-11-16T22:11:18.164 INFO:tasks.rados.rados.2.smithi057.stdout:2495: finishing write tid 1 to smithi05720651-22 2020-11-16T22:11:18.164 INFO:tasks.rados.rados.2.smithi057.stdout:2495: finishing write tid 2 to smithi05720651-22 2020-11-16T22:11:18.164 INFO:tasks.rados.rados.2.smithi057.stdout:2495: finishing write tid 4 to smithi05720651-22 2020-11-16T22:11:18.164 INFO:tasks.rados.rados.2.smithi057.stdout:2495: finishing write tid 5 to smithi05720651-22 2020-11-16T22:11:18.164 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 1154 (ObjNum 846 snap 289 seq_num 846) dirty exists 2020-11-16T22:11:18.164 INFO:tasks.rados.rados.2.smithi057.stdout:2495: left oid 22 (ObjNum 846 snap 289 seq_num 846) 2020-11-16T22:11:18.165 INFO:tasks.rados.rados.2.smithi057.stdout:2492: done (8 left) 2020-11-16T22:11:18.165 INFO:tasks.rados.rados.2.smithi057.stdout:2494: done (7 left) 2020-11-16T22:11:18.165 INFO:tasks.rados.rados.2.smithi057.stdout:2495: done (6 left) 2020-11-16T22:11:18.165 INFO:tasks.rados.rados.2.smithi057.stdout:2502: read oid 16 snap -1 2020-11-16T22:11:18.165 INFO:tasks.rados.rados.2.smithi057.stdout:2502: expect (ObjNum 650 snap 228 seq_num 650) 2020-11-16T22:11:18.165 INFO:tasks.rados.rados.2.smithi057.stdout:2503: delete oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 289 2020-11-16T22:11:18.168 INFO:tasks.rados.rados.2.smithi057.stdout:2499: done (7 left) 2020-11-16T22:11:18.168 INFO:tasks.rados.rados.2.smithi057.stdout:2503: done (6 left) 2020-11-16T22:11:18.168 INFO:tasks.rados.rados.2.smithi057.stdout:2504: delete oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 289 2020-11-16T22:11:18.177 INFO:tasks.rados.rados.2.smithi057.stdout:2500: expect (ObjNum 804 snap 276 seq_num 804) 2020-11-16T22:11:18.329 INFO:tasks.rados.rados.2.smithi057.stdout:2502: expect (ObjNum 650 snap 228 seq_num 650) 2020-11-16T22:11:18.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:18 smithi057 bash[10301]: cluster 2020-11-16T22:11:17.115454+0000 mon.a (mon.0) 1317 : cluster [DBG] osdmap e649: 12 total, 12 up, 12 in 2020-11-16T22:11:18.526 INFO:tasks.rados.rados.2.smithi057.stdout:2501: finishing copy_from to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:18.526 INFO:tasks.rados.rados.2.smithi057.stdout:2501: got expected ENOENT (src dne) 2020-11-16T22:11:18.526 INFO:tasks.rados.rados.2.smithi057.stdout:2501: finishing copy_from racing read to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:18.526 INFO:tasks.rados.rados.2.smithi057.stdout:2497: finishing write tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:18.526 INFO:tasks.rados.rados.2.smithi057.stdout:2498: expect (ObjNum 843 snap 289 seq_num 843) 2020-11-16T22:11:18.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:18 smithi016 bash[10302]: cluster 2020-11-16T22:11:17.115454+0000 mon.a (mon.0) 1317 : cluster [DBG] osdmap e649: 12 total, 12 up, 12 in 2020-11-16T22:11:18.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:18 smithi195 bash[10218]: cluster 2020-11-16T22:11:17.115454+0000 mon.a (mon.0) 1317 : cluster [DBG] osdmap e649: 12 total, 12 up, 12 in 2020-11-16T22:11:18.750 INFO:tasks.rados.rados.2.smithi057.stdout:2496: finishing copy_from to smithi05720651-50 2020-11-16T22:11:18.750 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 1150 (ObjNum 797 snap 276 seq_num 797) dirty exists 2020-11-16T22:11:18.750 INFO:tasks.rados.rados.2.smithi057.stdout:2496: finishing copy_from racing read to smithi05720651-50 2020-11-16T22:11:18.751 INFO:tasks.rados.rados.2.smithi057.stdout:2497: finishing write tid 2 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:18.751 INFO:tasks.rados.rados.2.smithi057.stdout:2496: done (6 left) 2020-11-16T22:11:18.751 INFO:tasks.rados.rados.2.smithi057.stdout:2498: done (5 left) 2020-11-16T22:11:18.751 INFO:tasks.rados.rados.2.smithi057.stdout:2500: done (4 left) 2020-11-16T22:11:18.751 INFO:tasks.rados.rados.2.smithi057.stdout:2501: done (3 left) 2020-11-16T22:11:18.751 INFO:tasks.rados.rados.2.smithi057.stdout:2502: done (2 left) 2020-11-16T22:11:18.751 INFO:tasks.rados.rados.2.smithi057.stdout:2504: done (1 left) 2020-11-16T22:11:18.752 INFO:tasks.rados.rados.2.smithi057.stdout:2505: write (excl) oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 289 2020-11-16T22:11:18.752 INFO:tasks.rados.rados.2.smithi057.stdout:2505: seq_num 850 ranges {685950=476833,1623459=570617} 2020-11-16T22:11:18.764 INFO:tasks.rados.rados.2.smithi057.stdout:2505: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 685950 to 1162783 tid 1 2020-11-16T22:11:18.771 INFO:tasks.rados.rados.2.smithi057.stdout:2505: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1623459 to 2194076 tid 2 2020-11-16T22:11:18.771 INFO:tasks.rados.rados.2.smithi057.stdout:2506: rollback oid 46 current snap is 289 2020-11-16T22:11:18.772 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 46 to 277 2020-11-16T22:11:18.772 INFO:tasks.rados.rados.2.smithi057.stdout:2507: read oid 6 snap -1 2020-11-16T22:11:18.772 INFO:tasks.rados.rados.2.smithi057.stdout:2507: expect (ObjNum 840 snap 289 seq_num 840) 2020-11-16T22:11:18.772 INFO:tasks.rados.rados.2.smithi057.stdout:2508: rollback oid 28 current snap is 289 2020-11-16T22:11:18.772 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 28 to 286 2020-11-16T22:11:18.772 INFO:tasks.rados.rados.2.smithi057.stdout:2509: write (excl) oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 289 2020-11-16T22:11:18.772 INFO:tasks.rados.rados.2.smithi057.stdout:2509: seq_num 851 ranges {702757=552082,1681941=430628} 2020-11-16T22:11:18.778 INFO:tasks.rados.rados.2.smithi057.stdout:2509: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 702757 to 1254839 tid 1 2020-11-16T22:11:18.783 INFO:tasks.rados.rados.2.smithi057.stdout:2509: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1681941 to 2112569 tid 2 2020-11-16T22:11:18.783 INFO:tasks.rados.rados.2.smithi057.stdout:2510: write oid 30 current snap is 289 2020-11-16T22:11:18.784 INFO:tasks.rados.rados.2.smithi057.stdout:2510: seq_num 852 ranges {719564=743684,2140423=179141} 2020-11-16T22:11:18.791 INFO:tasks.rados.rados.2.smithi057.stdout:2510: writing smithi05720651-30 from 719564 to 1463248 tid 1 2020-11-16T22:11:18.796 INFO:tasks.rados.rados.2.smithi057.stdout:2510: writing smithi05720651-30 from 2140423 to 2319564 tid 2 2020-11-16T22:11:18.797 INFO:tasks.rados.rados.2.smithi057.stdout:2511: copy_from oid 16 from oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 289 2020-11-16T22:11:18.797 INFO:tasks.rados.rados.2.smithi057.stdout:2508: finishing rollback tid 1 to smithi05720651-28 2020-11-16T22:11:18.797 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 0 (ObjNum 385 snap 0 seq_num 2932601216) dirty dne 2020-11-16T22:11:18.797 INFO:tasks.rados.rados.2.smithi057.stdout:2506: finishing rollback tid 1 to smithi05720651-46 2020-11-16T22:11:18.797 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 0 (ObjNum 321 snap 0 seq_num 0) dirty dne 2020-11-16T22:11:18.797 INFO:tasks.rados.rados.2.smithi057.stdout:2505: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:18.798 INFO:tasks.rados.rados.2.smithi057.stdout:2507: expect (ObjNum 840 snap 289 seq_num 840) 2020-11-16T22:11:18.866 INFO:tasks.rados.rados.2.smithi057.stdout:2505: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:18.866 INFO:tasks.rados.rados.2.smithi057.stdout:2505: finishing write tid 4 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:18.866 INFO:tasks.rados.rados.2.smithi057.stdout:2505: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:18.867 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1899 (ObjNum 850 snap 289 seq_num 850) dirty exists 2020-11-16T22:11:18.867 INFO:tasks.rados.rados.2.smithi057.stdout:2505: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 850 snap 289 seq_num 850) 2020-11-16T22:11:18.867 INFO:tasks.rados.rados.2.smithi057.stdout:2509: finishing write tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:18.867 INFO:tasks.rados.rados.2.smithi057.stdout:2505: done (7 left) 2020-11-16T22:11:18.867 INFO:tasks.rados.rados.2.smithi057.stdout:2506: done (6 left) 2020-11-16T22:11:18.867 INFO:tasks.rados.rados.2.smithi057.stdout:2507: done (5 left) 2020-11-16T22:11:18.867 INFO:tasks.rados.rados.2.smithi057.stdout:2508: done (4 left) 2020-11-16T22:11:18.868 INFO:tasks.rados.rados.2.smithi057.stdout:2512: write oid 24 current snap is 289 2020-11-16T22:11:18.868 INFO:tasks.rados.rados.2.smithi057.stdout:2512: seq_num 853 ranges {736371=418933,1798905=434297} 2020-11-16T22:11:18.876 INFO:tasks.rados.rados.2.smithi057.stdout:2512: writing smithi05720651-24 from 736371 to 1155304 tid 1 2020-11-16T22:11:18.883 INFO:tasks.rados.rados.2.smithi057.stdout:2512: writing smithi05720651-24 from 1798905 to 2233202 tid 2 2020-11-16T22:11:18.883 INFO:tasks.rados.rados.2.smithi057.stdout:2513: write oid 50 current snap is 289 2020-11-16T22:11:18.884 INFO:tasks.rados.rados.2.smithi057.stdout:2513: seq_num 854 ranges {753178=494182,1857387=495791} 2020-11-16T22:11:18.890 INFO:tasks.rados.rados.2.smithi057.stdout:2513: writing smithi05720651-50 from 753178 to 1247360 tid 1 2020-11-16T22:11:18.897 INFO:tasks.rados.rados.2.smithi057.stdout:2513: writing smithi05720651-50 from 1857387 to 2353178 tid 2 2020-11-16T22:11:18.897 INFO:tasks.rados.rados.2.smithi057.stdout:2514: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:18.897 INFO:tasks.rados.rados.2.smithi057.stdout:2514: expect (ObjNum 819 snap 280 seq_num 819) 2020-11-16T22:11:18.897 INFO:tasks.rados.rados.2.smithi057.stdout:2515: rollback oid 28 current snap is 289 2020-11-16T22:11:18.898 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 28 to 286 2020-11-16T22:11:18.898 INFO:tasks.rados.rados.2.smithi057.stdout:2509: finishing write tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:18.898 INFO:tasks.rados.rados.2.smithi057.stdout:2516: read oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:18.898 INFO:tasks.rados.rados.2.smithi057.stdout:2516: expect (ObjNum 760 snap 265 seq_num 760) 2020-11-16T22:11:18.898 INFO:tasks.rados.rados.2.smithi057.stdout:2517: write (excl) oid 34 current snap is 289 2020-11-16T22:11:18.898 INFO:tasks.rados.rados.2.smithi057.stdout:2517: seq_num 855 ranges {769985=569431,1915869=437966} 2020-11-16T22:11:18.904 INFO:tasks.rados.rados.2.smithi057.stdout:2517: writing smithi05720651-34 from 769985 to 1339416 tid 1 2020-11-16T22:11:18.911 INFO:tasks.rados.rados.2.smithi057.stdout:2517: writing smithi05720651-34 from 1915869 to 2353835 tid 2 2020-11-16T22:11:18.911 INFO:tasks.rados.rados.2.smithi057.stdout:2518: copy_from oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 289 2020-11-16T22:11:18.911 INFO:tasks.rados.rados.2.smithi057.stdout:2509: finishing write tid 4 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:18.911 INFO:tasks.rados.rados.2.smithi057.stdout:2509: finishing write tid 5 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:18.911 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1903 (ObjNum 851 snap 289 seq_num 851) dirty exists 2020-11-16T22:11:18.911 INFO:tasks.rados.rados.2.smithi057.stdout:2509: left oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 851 snap 289 seq_num 851) 2020-11-16T22:11:18.912 INFO:tasks.rados.rados.2.smithi057.stdout:2510: finishing write tid 1 to smithi05720651-30 2020-11-16T22:11:18.912 INFO:tasks.rados.rados.2.smithi057.stdout:2509: done (10 left) 2020-11-16T22:11:18.912 INFO:tasks.rados.rados.2.smithi057.stdout:2519: write oid 32 current snap is 289 2020-11-16T22:11:18.912 INFO:tasks.rados.rados.2.smithi057.stdout:2519: seq_num 856 ranges {786792=644680,1857998=528794} 2020-11-16T22:11:18.919 INFO:tasks.rados.rados.2.smithi057.stdout:2519: writing smithi05720651-32 from 786792 to 1431472 tid 1 2020-11-16T22:11:18.925 INFO:tasks.rados.rados.2.smithi057.stdout:2519: writing smithi05720651-32 from 1857998 to 2386792 tid 2 2020-11-16T22:11:18.926 INFO:tasks.rados.rados.2.smithi057.stdout:2520: read oid 42 snap 283 2020-11-16T22:11:18.926 INFO:tasks.rados.rados.2.smithi057.stdout:2520: expect (ObjNum 776 snap 270 seq_num 776) 2020-11-16T22:11:18.926 INFO:tasks.rados.rados.2.smithi057.stdout:2521: copy_from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 289 2020-11-16T22:11:18.926 INFO:tasks.rados.rados.2.smithi057.stdout:2510: finishing write tid 2 to smithi05720651-30 2020-11-16T22:11:18.926 INFO:tasks.rados.rados.2.smithi057.stdout:2510: finishing write tid 4 to smithi05720651-30 2020-11-16T22:11:18.926 INFO:tasks.rados.rados.2.smithi057.stdout:2522: read oid 40 snap 286 2020-11-16T22:11:18.927 INFO:tasks.rados.rados.2.smithi057.stdout:2522: expect deleted 2020-11-16T22:11:18.927 INFO:tasks.rados.rados.2.smithi057.stdout:2523: copy_from oid 6 from oid 14 current snap is 289 2020-11-16T22:11:18.927 INFO:tasks.rados.rados.2.smithi057.stdout:2510: finishing write tid 5 to smithi05720651-30 2020-11-16T22:11:18.927 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 1732 (ObjNum 852 snap 289 seq_num 852) dirty exists 2020-11-16T22:11:18.927 INFO:tasks.rados.rados.2.smithi057.stdout:2510: left oid 30 (ObjNum 852 snap 289 seq_num 852) 2020-11-16T22:11:18.927 INFO:tasks.rados.rados.2.smithi057.stdout:2511: finishing copy_from to smithi05720651-16 2020-11-16T22:11:18.927 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 2051 (ObjNum 804 snap 276 seq_num 804) dirty exists 2020-11-16T22:11:18.928 INFO:tasks.rados.rados.2.smithi057.stdout:2511: finishing copy_from racing read to smithi05720651-16 2020-11-16T22:11:18.928 INFO:tasks.rados.rados.2.smithi057.stdout:2510: done (14 left) 2020-11-16T22:11:18.928 INFO:tasks.rados.rados.2.smithi057.stdout:2511: done (13 left) 2020-11-16T22:11:18.928 INFO:tasks.rados.rados.2.smithi057.stdout:2524: copy_from oid 22 from oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 289 2020-11-16T22:11:18.928 INFO:tasks.rados.rados.2.smithi057.stdout:2512: finishing write tid 1 to smithi05720651-24 2020-11-16T22:11:18.928 INFO:tasks.rados.rados.2.smithi057.stdout:2512: finishing write tid 2 to smithi05720651-24 2020-11-16T22:11:18.928 INFO:tasks.rados.rados.2.smithi057.stdout:2512: finishing write tid 4 to smithi05720651-24 2020-11-16T22:11:18.929 INFO:tasks.rados.rados.2.smithi057.stdout:2512: finishing write tid 5 to smithi05720651-24 2020-11-16T22:11:18.929 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 1569 (ObjNum 853 snap 289 seq_num 853) dirty exists 2020-11-16T22:11:18.929 INFO:tasks.rados.rados.2.smithi057.stdout:2512: left oid 24 (ObjNum 853 snap 289 seq_num 853) 2020-11-16T22:11:18.929 INFO:tasks.rados.rados.2.smithi057.stdout:2513: finishing write tid 1 to smithi05720651-50 2020-11-16T22:11:18.929 INFO:tasks.rados.rados.2.smithi057.stdout:2515: finishing rollback tid 1 to smithi05720651-28 2020-11-16T22:11:18.929 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 0 (ObjNum 385 snap 0 seq_num 2932601216) dirty dne 2020-11-16T22:11:18.929 INFO:tasks.rados.rados.2.smithi057.stdout:2512: done (13 left) 2020-11-16T22:11:18.929 INFO:tasks.rados.rados.2.smithi057.stdout:2515: done (12 left) 2020-11-16T22:11:18.930 INFO:tasks.rados.rados.2.smithi057.stdout:2525: snap_remove snap 281 2020-11-16T22:11:19.135 INFO:tasks.rados.rados.2.smithi057.stdout:2525: done (12 left) 2020-11-16T22:11:19.135 INFO:tasks.rados.rados.2.smithi057.stdout:2526: write (excl) oid 46 current snap is 289 2020-11-16T22:11:19.135 INFO:tasks.rados.rados.2.smithi057.stdout:2526: seq_num 857 ranges {403599=719929,1916480=441635} 2020-11-16T22:11:19.145 INFO:tasks.rados.rados.2.smithi057.stdout:2526: writing smithi05720651-46 from 403599 to 1123528 tid 1 2020-11-16T22:11:19.153 INFO:tasks.rados.rados.2.smithi057.stdout:2526: writing smithi05720651-46 from 1916480 to 2358115 tid 2 2020-11-16T22:11:19.153 INFO:tasks.rados.rados.2.smithi057.stdout:2527: snap_create 2020-11-16T22:11:19.153 INFO:tasks.rados.rados.2.smithi057.stdout:2513: finishing write tid 2 to smithi05720651-50 2020-11-16T22:11:19.153 INFO:tasks.rados.rados.2.smithi057.stdout:2513: finishing write tid 4 to smithi05720651-50 2020-11-16T22:11:19.154 INFO:tasks.rados.rados.2.smithi057.stdout:2514: expect (ObjNum 819 snap 280 seq_num 819) 2020-11-16T22:11:19.416 INFO:tasks.rados.rados.2.smithi057.stdout:2517: finishing write tid 1 to smithi05720651-34 2020-11-16T22:11:19.416 INFO:tasks.rados.rados.2.smithi057.stdout:2516: expect (ObjNum 760 snap 265 seq_num 760) 2020-11-16T22:11:19.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:19 smithi057 bash[10301]: cluster 2020-11-16T22:11:17.766355+0000 mgr.x (mgr.24115) 560 : cluster [DBG] pgmap v1139: 17 pgs: 17 active+clean; 150 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 515 KiB/s wr, 8 op/s 2020-11-16T22:11:19.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:19 smithi057 bash[10301]: cluster 2020-11-16T22:11:18.125709+0000 mon.a (mon.0) 1318 : cluster [DBG] osdmap e650: 12 total, 12 up, 12 in 2020-11-16T22:11:19.572 INFO:tasks.rados.rados.2.smithi057.stdout:2518: finishing copy_from to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:19.572 INFO:tasks.rados.rados.2.smithi057.stdout:2518: got expected ENOENT (src dne) 2020-11-16T22:11:19.572 INFO:tasks.rados.rados.2.smithi057.stdout:2518: finishing copy_from racing read to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:19.572 INFO:tasks.rados.rados.2.smithi057.stdout:2517: finishing write tid 2 to smithi05720651-34 2020-11-16T22:11:19.572 INFO:tasks.rados.rados.2.smithi057.stdout:2517: finishing write tid 4 to smithi05720651-34 2020-11-16T22:11:19.573 INFO:tasks.rados.rados.2.smithi057.stdout:2517: finishing write tid 5 to smithi05720651-34 2020-11-16T22:11:19.573 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 1777 (ObjNum 855 snap 289 seq_num 855) dirty exists 2020-11-16T22:11:19.573 INFO:tasks.rados.rados.2.smithi057.stdout:2517: left oid 34 (ObjNum 855 snap 289 seq_num 855) 2020-11-16T22:11:19.573 INFO:tasks.rados.rados.2.smithi057.stdout:2519: finishing write tid 1 to smithi05720651-32 2020-11-16T22:11:19.573 INFO:tasks.rados.rados.2.smithi057.stdout:2520: expect (ObjNum 776 snap 270 seq_num 776) 2020-11-16T22:11:19.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:19 smithi016 bash[10302]: cluster 2020-11-16T22:11:17.766355+0000 mgr.x (mgr.24115) 560 : cluster [DBG] pgmap v1139: 17 pgs: 17 active+clean; 150 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 515 KiB/s wr, 8 op/s 2020-11-16T22:11:19.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:19 smithi016 bash[10302]: cluster 2020-11-16T22:11:18.125709+0000 mon.a (mon.0) 1318 : cluster [DBG] osdmap e650: 12 total, 12 up, 12 in 2020-11-16T22:11:19.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:19 smithi195 bash[10218]: cluster 2020-11-16T22:11:17.766355+0000 mgr.x (mgr.24115) 560 : cluster [DBG] pgmap v1139: 17 pgs: 17 active+clean; 150 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 515 KiB/s wr, 8 op/s 2020-11-16T22:11:19.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:19 smithi195 bash[10218]: cluster 2020-11-16T22:11:18.125709+0000 mon.a (mon.0) 1318 : cluster [DBG] osdmap e650: 12 total, 12 up, 12 in 2020-11-16T22:11:19.705 INFO:tasks.rados.rados.2.smithi057.stdout:2519: finishing write tid 2 to smithi05720651-32 2020-11-16T22:11:19.706 INFO:tasks.rados.rados.2.smithi057.stdout:2519: finishing write tid 4 to smithi05720651-32 2020-11-16T22:11:19.706 INFO:tasks.rados.rados.2.smithi057.stdout:2519: finishing write tid 5 to smithi05720651-32 2020-11-16T22:11:19.706 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 2085 (ObjNum 856 snap 289 seq_num 856) dirty exists 2020-11-16T22:11:19.706 INFO:tasks.rados.rados.2.smithi057.stdout:2519: left oid 32 (ObjNum 856 snap 289 seq_num 856) 2020-11-16T22:11:19.706 INFO:tasks.rados.rados.2.smithi057.stdout:2524: finishing copy_from to smithi05720651-22 2020-11-16T22:11:19.706 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 1518 (ObjNum 786 snap 272 seq_num 786) dirty exists 2020-11-16T22:11:19.707 INFO:tasks.rados.rados.2.smithi057.stdout:2524: finishing copy_from racing read to smithi05720651-22 2020-11-16T22:11:19.707 INFO:tasks.rados.rados.2.smithi057.stdout:2521: finishing copy_from to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:19.707 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1859 (ObjNum 837 snap 289 seq_num 837) dirty exists 2020-11-16T22:11:19.707 INFO:tasks.rados.rados.2.smithi057.stdout:2521: finishing copy_from racing read to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:19.707 INFO:tasks.rados.rados.2.smithi057.stdout:2513: finishing write tid 5 to smithi05720651-50 2020-11-16T22:11:19.707 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 1906 (ObjNum 854 snap 289 seq_num 854) dirty exists 2020-11-16T22:11:19.707 INFO:tasks.rados.rados.2.smithi057.stdout:2513: left oid 50 (ObjNum 854 snap 289 seq_num 854) 2020-11-16T22:11:19.708 INFO:tasks.rados.rados.2.smithi057.stdout:2523: finishing copy_from to smithi05720651-6 2020-11-16T22:11:19.708 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 1796 (ObjNum 737 snap 256 seq_num 737) dirty exists 2020-11-16T22:11:19.708 INFO:tasks.rados.rados.2.smithi057.stdout:2497: finishing write tid 4 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:19.708 INFO:tasks.rados.rados.2.smithi057.stdout:2497: finishing write tid 5 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:19.708 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1776 (ObjNum 847 snap 289 seq_num 847) dirty exists 2020-11-16T22:11:19.708 INFO:tasks.rados.rados.2.smithi057.stdout:2497: left oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 847 snap 289 seq_num 847) 2020-11-16T22:11:19.708 INFO:tasks.rados.rados.2.smithi057.stdout:2526: finishing write tid 1 to smithi05720651-46 2020-11-16T22:11:19.708 INFO:tasks.rados.rados.2.smithi057.stdout:2526: finishing write tid 2 to smithi05720651-46 2020-11-16T22:11:19.709 INFO:tasks.rados.rados.2.smithi057.stdout:2526: finishing write tid 4 to smithi05720651-46 2020-11-16T22:11:19.709 INFO:tasks.rados.rados.2.smithi057.stdout:2526: finishing write tid 5 to smithi05720651-46 2020-11-16T22:11:19.709 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 2054 (ObjNum 857 snap 289 seq_num 857) dirty exists 2020-11-16T22:11:19.709 INFO:tasks.rados.rados.2.smithi057.stdout:2526: left oid 46 (ObjNum 857 snap 289 seq_num 857) 2020-11-16T22:11:19.709 INFO:tasks.rados.rados.2.smithi057.stdout:2523: finishing copy_from racing read to smithi05720651-6 2020-11-16T22:11:20.083 INFO:tasks.rados.rados.2.smithi057.stdout:2497: done (13 left) 2020-11-16T22:11:20.083 INFO:tasks.rados.rados.2.smithi057.stdout:2513: done (12 left) 2020-11-16T22:11:20.083 INFO:tasks.rados.rados.2.smithi057.stdout:2514: done (11 left) 2020-11-16T22:11:20.083 INFO:tasks.rados.rados.2.smithi057.stdout:2516: done (10 left) 2020-11-16T22:11:20.083 INFO:tasks.rados.rados.2.smithi057.stdout:2517: done (9 left) 2020-11-16T22:11:20.083 INFO:tasks.rados.rados.2.smithi057.stdout:2518: done (8 left) 2020-11-16T22:11:20.084 INFO:tasks.rados.rados.2.smithi057.stdout:2519: done (7 left) 2020-11-16T22:11:20.084 INFO:tasks.rados.rados.2.smithi057.stdout:2520: done (6 left) 2020-11-16T22:11:20.084 INFO:tasks.rados.rados.2.smithi057.stdout:2521: done (5 left) 2020-11-16T22:11:20.084 INFO:tasks.rados.rados.2.smithi057.stdout:2522: done (4 left) 2020-11-16T22:11:20.084 INFO:tasks.rados.rados.2.smithi057.stdout:2523: done (3 left) 2020-11-16T22:11:20.084 INFO:tasks.rados.rados.2.smithi057.stdout:2524: done (2 left) 2020-11-16T22:11:20.084 INFO:tasks.rados.rados.2.smithi057.stdout:2526: done (1 left) 2020-11-16T22:11:20.085 INFO:tasks.rados.rados.2.smithi057.stdout:2527: done (0 left) 2020-11-16T22:11:20.085 INFO:tasks.rados.rados.2.smithi057.stdout:2528: write (excl) oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 290 2020-11-16T22:11:20.085 INFO:tasks.rados.rados.2.smithi057.stdout:2528: seq_num 858 ranges {420406=795178,1974962=445444} 2020-11-16T22:11:20.094 INFO:tasks.rados.rados.2.smithi057.stdout:2528: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 420406 to 1215584 tid 1 2020-11-16T22:11:20.102 INFO:tasks.rados.rados.2.smithi057.stdout:2528: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1974962 to 2420406 tid 2 2020-11-16T22:11:20.102 INFO:tasks.rados.rados.2.smithi057.stdout:2529: read oid 48 snap -1 2020-11-16T22:11:20.102 INFO:tasks.rados.rados.2.smithi057.stdout:2529: expect (ObjNum 831 snap 285 seq_num 831) 2020-11-16T22:11:20.103 INFO:tasks.rados.rados.2.smithi057.stdout:2530: copy_from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 8 current snap is 290 2020-11-16T22:11:20.103 INFO:tasks.rados.rados.2.smithi057.stdout:2531: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:20.103 INFO:tasks.rados.rados.2.smithi057.stdout:2531: expect (ObjNum 804 snap 276 seq_num 804) 2020-11-16T22:11:20.103 INFO:tasks.rados.rados.2.smithi057.stdout:2532: copy_from oid 40 from oid 44 current snap is 290 2020-11-16T22:11:20.103 INFO:tasks.rados.rados.2.smithi057.stdout:2533: snap_remove snap 286 2020-11-16T22:11:20.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:20 smithi057 bash[10301]: cluster 2020-11-16T22:11:19.145665+0000 mon.a (mon.0) 1319 : cluster [DBG] osdmap e651: 12 total, 12 up, 12 in 2020-11-16T22:11:20.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:20 smithi057 bash[10301]: cluster 2020-11-16T22:11:20.092231+0000 mon.a (mon.0) 1320 : cluster [DBG] osdmap e652: 12 total, 12 up, 12 in 2020-11-16T22:11:20.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:20 smithi016 bash[10302]: cluster 2020-11-16T22:11:19.145665+0000 mon.a (mon.0) 1319 : cluster [DBG] osdmap e651: 12 total, 12 up, 12 in 2020-11-16T22:11:20.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:20 smithi016 bash[10302]: cluster 2020-11-16T22:11:20.092231+0000 mon.a (mon.0) 1320 : cluster [DBG] osdmap e652: 12 total, 12 up, 12 in 2020-11-16T22:11:20.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:20 smithi195 bash[10218]: cluster 2020-11-16T22:11:19.145665+0000 mon.a (mon.0) 1319 : cluster [DBG] osdmap e651: 12 total, 12 up, 12 in 2020-11-16T22:11:20.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:20 smithi195 bash[10218]: cluster 2020-11-16T22:11:20.092231+0000 mon.a (mon.0) 1320 : cluster [DBG] osdmap e652: 12 total, 12 up, 12 in 2020-11-16T22:11:21.094 INFO:tasks.rados.rados.2.smithi057.stdout:2533: done (5 left) 2020-11-16T22:11:21.094 INFO:tasks.rados.rados.2.smithi057.stdout:2534: read oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:21.094 INFO:tasks.rados.rados.2.smithi057.stdout:2534: expect (ObjNum 805 snap 276 seq_num 805) 2020-11-16T22:11:21.095 INFO:tasks.rados.rados.2.smithi057.stdout:2535: snap_remove snap 288 2020-11-16T22:11:21.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:21 smithi057 bash[10301]: cluster 2020-11-16T22:11:19.767024+0000 mgr.x (mgr.24115) 561 : cluster [DBG] pgmap v1142: 17 pgs: 17 active+clean; 150 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 0 B/s wr, 3 op/s 2020-11-16T22:11:21.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:21 smithi057 bash[10301]: cluster 2020-11-16T22:11:21.102479+0000 mon.a (mon.0) 1321 : cluster [DBG] osdmap e653: 12 total, 12 up, 12 in 2020-11-16T22:11:21.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:21 smithi016 bash[10302]: cluster 2020-11-16T22:11:19.767024+0000 mgr.x (mgr.24115) 561 : cluster [DBG] pgmap v1142: 17 pgs: 17 active+clean; 150 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 0 B/s wr, 3 op/s 2020-11-16T22:11:21.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:21 smithi016 bash[10302]: cluster 2020-11-16T22:11:21.102479+0000 mon.a (mon.0) 1321 : cluster [DBG] osdmap e653: 12 total, 12 up, 12 in 2020-11-16T22:11:21.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:21 smithi195 bash[10218]: cluster 2020-11-16T22:11:19.767024+0000 mgr.x (mgr.24115) 561 : cluster [DBG] pgmap v1142: 17 pgs: 17 active+clean; 150 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 0 B/s wr, 3 op/s 2020-11-16T22:11:21.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:21 smithi195 bash[10218]: cluster 2020-11-16T22:11:21.102479+0000 mon.a (mon.0) 1321 : cluster [DBG] osdmap e653: 12 total, 12 up, 12 in 2020-11-16T22:11:22.097 INFO:tasks.rados.rados.2.smithi057.stdout:2535: done (6 left) 2020-11-16T22:11:22.097 INFO:tasks.rados.rados.2.smithi057.stdout:2536: delete oid 28 current snap is 290 2020-11-16T22:11:22.097 INFO:tasks.rados.rados.2.smithi057.stdout:2528: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:22.098 INFO:tasks.rados.rados.2.smithi057.stdout:2528: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:22.098 INFO:tasks.rados.rados.2.smithi057.stdout:2528: finishing write tid 4 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:22.098 INFO:tasks.rados.rados.2.smithi057.stdout:2528: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:22.098 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1862 (ObjNum 858 snap 290 seq_num 858) dirty exists 2020-11-16T22:11:22.098 INFO:tasks.rados.rados.2.smithi057.stdout:2528: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 858 snap 290 seq_num 858) 2020-11-16T22:11:22.098 INFO:tasks.rados.rados.2.smithi057.stdout:2531: expect (ObjNum 804 snap 276 seq_num 804) 2020-11-16T22:11:22.250 INFO:tasks.rados.rados.2.smithi057.stdout:2532: finishing copy_from to smithi05720651-40 2020-11-16T22:11:22.250 INFO:tasks.rados.rados.2.smithi057.stdout:2532: got expected ENOENT (src dne) 2020-11-16T22:11:22.251 INFO:tasks.rados.rados.2.smithi057.stdout:2532: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:11:22.251 INFO:tasks.rados.rados.2.smithi057.stdout:2529: expect (ObjNum 831 snap 285 seq_num 831) 2020-11-16T22:11:22.372 INFO:tasks.rados.rados.2.smithi057.stdout:2530: finishing copy_from to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:22.372 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1565 (ObjNum 792 snap 273 seq_num 792) dirty exists 2020-11-16T22:11:22.373 INFO:tasks.rados.rados.2.smithi057.stdout:2530: finishing copy_from racing read to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:22.373 INFO:tasks.rados.rados.2.smithi057.stdout:2534: expect (ObjNum 805 snap 276 seq_num 805) 2020-11-16T22:11:22.523 INFO:tasks.rados.rados.2.smithi057.stdout:2528: done (6 left) 2020-11-16T22:11:22.523 INFO:tasks.rados.rados.2.smithi057.stdout:2529: done (5 left) 2020-11-16T22:11:22.523 INFO:tasks.rados.rados.2.smithi057.stdout:2530: done (4 left) 2020-11-16T22:11:22.524 INFO:tasks.rados.rados.2.smithi057.stdout:2531: done (3 left) 2020-11-16T22:11:22.524 INFO:tasks.rados.rados.2.smithi057.stdout:2532: done (2 left) 2020-11-16T22:11:22.524 INFO:tasks.rados.rados.2.smithi057.stdout:2534: done (1 left) 2020-11-16T22:11:22.524 INFO:tasks.rados.rados.2.smithi057.stdout:2536: done (0 left) 2020-11-16T22:11:22.524 INFO:tasks.rados.rados.2.smithi057.stdout:2537: snap_create 2020-11-16T22:11:23.149 INFO:tasks.rados.rados.2.smithi057.stdout:2537: done (0 left) 2020-11-16T22:11:23.149 INFO:tasks.rados.rados.2.smithi057.stdout:2538: snap_remove snap 290 2020-11-16T22:11:23.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:23 smithi195 bash[10218]: cluster 2020-11-16T22:11:21.767775+0000 mgr.x (mgr.24115) 562 : cluster [DBG] pgmap v1145: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 177 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 7.5 MiB/s wr, 41 op/s 2020-11-16T22:11:23.350 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:23 smithi195 bash[10218]: cluster 2020-11-16T22:11:22.104711+0000 mon.a (mon.0) 1322 : cluster [DBG] osdmap e654: 12 total, 12 up, 12 in 2020-11-16T22:11:23.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:23 smithi057 bash[10301]: cluster 2020-11-16T22:11:21.767775+0000 mgr.x (mgr.24115) 562 : cluster [DBG] pgmap v1145: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 177 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 7.5 MiB/s wr, 41 op/s 2020-11-16T22:11:23.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:23 smithi057 bash[10301]: cluster 2020-11-16T22:11:22.104711+0000 mon.a (mon.0) 1322 : cluster [DBG] osdmap e654: 12 total, 12 up, 12 in 2020-11-16T22:11:23.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:23 smithi016 bash[10302]: cluster 2020-11-16T22:11:21.767775+0000 mgr.x (mgr.24115) 562 : cluster [DBG] pgmap v1145: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 177 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 7.5 MiB/s wr, 41 op/s 2020-11-16T22:11:23.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:23 smithi016 bash[10302]: cluster 2020-11-16T22:11:22.104711+0000 mon.a (mon.0) 1322 : cluster [DBG] osdmap e654: 12 total, 12 up, 12 in 2020-11-16T22:11:24.171 INFO:tasks.rados.rados.2.smithi057.stdout:2538: done (0 left) 2020-11-16T22:11:24.172 INFO:tasks.rados.rados.2.smithi057.stdout:2539: rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 291 2020-11-16T22:11:24.172 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 289 2020-11-16T22:11:24.172 INFO:tasks.rados.rados.2.smithi057.stdout:2540: snap_create 2020-11-16T22:11:24.182 INFO:tasks.rados.rados.2.smithi057.stdout:2539: finishing rollback tid 0 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:24.183 INFO:tasks.rados.rados.2.smithi057.stdout:2539: finishing rollback tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:24.183 INFO:tasks.rados.rados.2.smithi057.stdout:2539: finishing rollback tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:24.183 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1933 (ObjNum 843 snap 289 seq_num 843) dirty exists 2020-11-16T22:11:24.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:24 smithi057 bash[10301]: cluster 2020-11-16T22:11:23.159343+0000 mon.a (mon.0) 1323 : cluster [DBG] osdmap e655: 12 total, 12 up, 12 in 2020-11-16T22:11:24.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:24 smithi016 bash[10302]: cluster 2020-11-16T22:11:23.159343+0000 mon.a (mon.0) 1323 : cluster [DBG] osdmap e655: 12 total, 12 up, 12 in 2020-11-16T22:11:24.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:24 smithi195 bash[10218]: cluster 2020-11-16T22:11:23.159343+0000 mon.a (mon.0) 1323 : cluster [DBG] osdmap e655: 12 total, 12 up, 12 in 2020-11-16T22:11:25.091 INFO:tasks.rados.rados.2.smithi057.stdout:2539: done (1 left) 2020-11-16T22:11:25.091 INFO:tasks.rados.rados.2.smithi057.stdout:2540: done (0 left) 2020-11-16T22:11:25.091 INFO:tasks.rados.rados.2.smithi057.stdout:2541: snap_remove snap 283 2020-11-16T22:11:25.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:25 smithi057 bash[10301]: cluster 2020-11-16T22:11:23.768493+0000 mgr.x (mgr.24115) 563 : cluster [DBG] pgmap v1148: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 179 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 7.8 MiB/s wr, 45 op/s 2020-11-16T22:11:25.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:25 smithi057 bash[10301]: cluster 2020-11-16T22:11:24.172871+0000 mon.a (mon.0) 1324 : cluster [DBG] osdmap e656: 12 total, 12 up, 12 in 2020-11-16T22:11:25.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:25 smithi057 bash[10301]: cluster 2020-11-16T22:11:25.094350+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e657: 12 total, 12 up, 12 in 2020-11-16T22:11:25.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:25 smithi016 bash[10302]: cluster 2020-11-16T22:11:23.768493+0000 mgr.x (mgr.24115) 563 : cluster [DBG] pgmap v1148: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 179 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 7.8 MiB/s wr, 45 op/s 2020-11-16T22:11:25.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:25 smithi016 bash[10302]: cluster 2020-11-16T22:11:24.172871+0000 mon.a (mon.0) 1324 : cluster [DBG] osdmap e656: 12 total, 12 up, 12 in 2020-11-16T22:11:25.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:25 smithi016 bash[10302]: cluster 2020-11-16T22:11:25.094350+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e657: 12 total, 12 up, 12 in 2020-11-16T22:11:25.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:25 smithi195 bash[10218]: cluster 2020-11-16T22:11:23.768493+0000 mgr.x (mgr.24115) 563 : cluster [DBG] pgmap v1148: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 179 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 7.8 MiB/s wr, 45 op/s 2020-11-16T22:11:25.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:25 smithi195 bash[10218]: cluster 2020-11-16T22:11:24.172871+0000 mon.a (mon.0) 1324 : cluster [DBG] osdmap e656: 12 total, 12 up, 12 in 2020-11-16T22:11:25.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:25 smithi195 bash[10218]: cluster 2020-11-16T22:11:25.094350+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e657: 12 total, 12 up, 12 in 2020-11-16T22:11:26.105 INFO:tasks.rados.rados.2.smithi057.stdout:2541: done (0 left) 2020-11-16T22:11:26.106 INFO:tasks.rados.rados.2.smithi057.stdout:2542: snap_create 2020-11-16T22:11:27.106 INFO:tasks.rados.rados.2.smithi057.stdout:2542: done (0 left) 2020-11-16T22:11:27.107 INFO:tasks.rados.rados.2.smithi057.stdout:2543: snap_create 2020-11-16T22:11:27.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:27 smithi057 bash[10301]: cluster 2020-11-16T22:11:25.769273+0000 mgr.x (mgr.24115) 564 : cluster [DBG] pgmap v1151: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 172 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 549 KiB/s wr, 7 op/s 2020-11-16T22:11:27.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:27 smithi057 bash[10301]: cluster 2020-11-16T22:11:26.110903+0000 mon.a (mon.0) 1326 : cluster [DBG] osdmap e658: 12 total, 12 up, 12 in 2020-11-16T22:11:27.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:27 smithi016 bash[10302]: cluster 2020-11-16T22:11:25.769273+0000 mgr.x (mgr.24115) 564 : cluster [DBG] pgmap v1151: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 172 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 549 KiB/s wr, 7 op/s 2020-11-16T22:11:27.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:27 smithi016 bash[10302]: cluster 2020-11-16T22:11:26.110903+0000 mon.a (mon.0) 1326 : cluster [DBG] osdmap e658: 12 total, 12 up, 12 in 2020-11-16T22:11:27.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:27 smithi195 bash[10218]: cluster 2020-11-16T22:11:25.769273+0000 mgr.x (mgr.24115) 564 : cluster [DBG] pgmap v1151: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 172 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 549 KiB/s wr, 7 op/s 2020-11-16T22:11:27.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:27 smithi195 bash[10218]: cluster 2020-11-16T22:11:26.110903+0000 mon.a (mon.0) 1326 : cluster [DBG] osdmap e658: 12 total, 12 up, 12 in 2020-11-16T22:11:28.127 INFO:tasks.rados.rados.2.smithi057.stdout:2543: done (0 left) 2020-11-16T22:11:28.127 INFO:tasks.rados.rados.2.smithi057.stdout:2544: write (excl) oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 294 2020-11-16T22:11:28.128 INFO:tasks.rados.rados.2.smithi057.stdout:2544: seq_num 860 ranges {454020=662029,1691926=588962} 2020-11-16T22:11:28.138 INFO:tasks.rados.rados.2.smithi057.stdout:2544: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 454020 to 1116049 tid 1 2020-11-16T22:11:28.145 INFO:tasks.rados.rados.2.smithi057.stdout:2544: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1691926 to 2280888 tid 2 2020-11-16T22:11:28.145 INFO:tasks.rados.rados.2.smithi057.stdout:2545: read oid 42 snap -1 2020-11-16T22:11:28.145 INFO:tasks.rados.rados.2.smithi057.stdout:2545: expect deleted 2020-11-16T22:11:28.145 INFO:tasks.rados.rados.2.smithi057.stdout:2546: write (excl) oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 294 2020-11-16T22:11:28.146 INFO:tasks.rados.rados.2.smithi057.stdout:2546: seq_num 861 ranges {470827=737278,1750408=720419} 2020-11-16T22:11:28.152 INFO:tasks.rados.rados.2.smithi057.stdout:2546: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 470827 to 1208105 tid 1 2020-11-16T22:11:28.159 INFO:tasks.rados.rados.2.smithi057.stdout:2546: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1750408 to 2470827 tid 2 2020-11-16T22:11:28.160 INFO:tasks.rados.rados.2.smithi057.stdout:2547: copy_from oid 12 from oid 48 current snap is 294 2020-11-16T22:11:28.160 INFO:tasks.rados.rados.2.smithi057.stdout:2548: copy_from oid 18 from oid 30 current snap is 294 2020-11-16T22:11:28.160 INFO:tasks.rados.rados.2.smithi057.stdout:2549: snap_create 2020-11-16T22:11:28.163 INFO:tasks.rados.rados.2.smithi057.stdout:2546: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:28.170 INFO:tasks.rados.rados.2.smithi057.stdout:2546: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:28.170 INFO:tasks.rados.rados.2.smithi057.stdout:2546: finishing write tid 4 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:28.171 INFO:tasks.rados.rados.2.smithi057.stdout:2546: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:28.171 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 163 (ObjNum 861 snap 294 seq_num 861) dirty exists 2020-11-16T22:11:28.171 INFO:tasks.rados.rados.2.smithi057.stdout:2546: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 861 snap 294 seq_num 861) 2020-11-16T22:11:28.384 INFO:tasks.rados.rados.2.smithi057.stdout:2544: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:28.389 INFO:tasks.rados.rados.2.smithi057.stdout:2544: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:28.390 INFO:tasks.rados.rados.2.smithi057.stdout:2544: finishing write tid 4 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:28.390 INFO:tasks.rados.rados.2.smithi057.stdout:2544: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:28.390 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2105 (ObjNum 860 snap 294 seq_num 860) dirty exists 2020-11-16T22:11:28.390 INFO:tasks.rados.rados.2.smithi057.stdout:2544: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 860 snap 294 seq_num 860) 2020-11-16T22:11:28.391 INFO:tasks.rados.rados.2.smithi057.stdout:2548: finishing copy_from to smithi05720651-18 2020-11-16T22:11:28.391 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 1732 (ObjNum 852 snap 289 seq_num 852) dirty exists 2020-11-16T22:11:28.391 INFO:tasks.rados.rados.2.smithi057.stdout:2548: finishing copy_from racing read to smithi05720651-18 2020-11-16T22:11:28.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:28 smithi057 bash[10301]: cluster 2020-11-16T22:11:27.113013+0000 mon.a (mon.0) 1327 : cluster [DBG] osdmap e659: 12 total, 12 up, 12 in 2020-11-16T22:11:28.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:28 smithi016 bash[10302]: cluster 2020-11-16T22:11:27.113013+0000 mon.a (mon.0) 1327 : cluster [DBG] osdmap e659: 12 total, 12 up, 12 in 2020-11-16T22:11:28.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:28 smithi195 bash[10218]: cluster 2020-11-16T22:11:27.113013+0000 mon.a (mon.0) 1327 : cluster [DBG] osdmap e659: 12 total, 12 up, 12 in 2020-11-16T22:11:28.813 INFO:tasks.rados.rados.2.smithi057.stdout:2547: finishing copy_from to smithi05720651-12 2020-11-16T22:11:28.813 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 1515 (ObjNum 831 snap 285 seq_num 831) dirty exists 2020-11-16T22:11:28.814 INFO:tasks.rados.rados.2.smithi057.stdout:2547: finishing copy_from racing read to smithi05720651-12 2020-11-16T22:11:29.126 INFO:tasks.rados.rados.2.smithi057.stdout:2544: done (5 left) 2020-11-16T22:11:29.127 INFO:tasks.rados.rados.2.smithi057.stdout:2545: done (4 left) 2020-11-16T22:11:29.127 INFO:tasks.rados.rados.2.smithi057.stdout:2546: done (3 left) 2020-11-16T22:11:29.127 INFO:tasks.rados.rados.2.smithi057.stdout:2547: done (2 left) 2020-11-16T22:11:29.127 INFO:tasks.rados.rados.2.smithi057.stdout:2548: done (1 left) 2020-11-16T22:11:29.127 INFO:tasks.rados.rados.2.smithi057.stdout:2549: done (0 left) 2020-11-16T22:11:29.127 INFO:tasks.rados.rados.2.smithi057.stdout:2550: read oid 30 snap -1 2020-11-16T22:11:29.127 INFO:tasks.rados.rados.2.smithi057.stdout:2550: expect (ObjNum 852 snap 289 seq_num 852) 2020-11-16T22:11:29.128 INFO:tasks.rados.rados.2.smithi057.stdout:2551: snap_remove snap 292 2020-11-16T22:11:29.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:29 smithi057 bash[10301]: cluster 2020-11-16T22:11:27.769975+0000 mgr.x (mgr.24115) 565 : cluster [DBG] pgmap v1154: 17 pgs: 17 active+clean; 168 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 303 KiB/s wr, 3 op/s 2020-11-16T22:11:29.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:29 smithi057 bash[10301]: cluster 2020-11-16T22:11:28.133459+0000 mon.a (mon.0) 1328 : cluster [DBG] osdmap e660: 12 total, 12 up, 12 in 2020-11-16T22:11:29.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:29 smithi016 bash[10302]: cluster 2020-11-16T22:11:27.769975+0000 mgr.x (mgr.24115) 565 : cluster [DBG] pgmap v1154: 17 pgs: 17 active+clean; 168 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 303 KiB/s wr, 3 op/s 2020-11-16T22:11:29.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:29 smithi016 bash[10302]: cluster 2020-11-16T22:11:28.133459+0000 mon.a (mon.0) 1328 : cluster [DBG] osdmap e660: 12 total, 12 up, 12 in 2020-11-16T22:11:29.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:29 smithi195 bash[10218]: cluster 2020-11-16T22:11:27.769975+0000 mgr.x (mgr.24115) 565 : cluster [DBG] pgmap v1154: 17 pgs: 17 active+clean; 168 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 303 KiB/s wr, 3 op/s 2020-11-16T22:11:29.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:29 smithi195 bash[10218]: cluster 2020-11-16T22:11:28.133459+0000 mon.a (mon.0) 1328 : cluster [DBG] osdmap e660: 12 total, 12 up, 12 in 2020-11-16T22:11:30.088 INFO:tasks.rados.rados.2.smithi057.stdout:2551: done (1 left) 2020-11-16T22:11:30.088 INFO:tasks.rados.rados.2.smithi057.stdout:2552: write (excl) oid 14 current snap is 295 2020-11-16T22:11:30.088 INFO:tasks.rados.rados.2.smithi057.stdout:2552: seq_num 862 ranges {487634=412527,1408890=592631} 2020-11-16T22:11:30.097 INFO:tasks.rados.rados.2.smithi057.stdout:2552: writing smithi05720651-14 from 487634 to 900161 tid 1 2020-11-16T22:11:30.104 INFO:tasks.rados.rados.2.smithi057.stdout:2552: writing smithi05720651-14 from 1408890 to 2001521 tid 2 2020-11-16T22:11:30.104 INFO:tasks.rados.rados.2.smithi057.stdout:2553: rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 295 2020-11-16T22:11:30.104 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 277 2020-11-16T22:11:30.104 INFO:tasks.rados.rados.2.smithi057.stdout:2550: expect (ObjNum 852 snap 289 seq_num 852) 2020-11-16T22:11:30.244 INFO:tasks.rados.rados.2.smithi057.stdout:2550: done (2 left) 2020-11-16T22:11:30.244 INFO:tasks.rados.rados.2.smithi057.stdout:2554: snap_remove snap 294 2020-11-16T22:11:30.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:30 smithi057 bash[10301]: cluster 2020-11-16T22:11:29.136050+0000 mon.a (mon.0) 1329 : cluster [DBG] osdmap e661: 12 total, 12 up, 12 in 2020-11-16T22:11:30.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:30 smithi057 bash[10301]: audit 2020-11-16T22:11:29.777332+0000 mon.b (mon.1) 310 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:11:30.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:30 smithi057 bash[10301]: audit 2020-11-16T22:11:29.777927+0000 mon.b (mon.1) 311 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:11:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:30 smithi057 bash[10301]: audit 2020-11-16T22:11:29.778736+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:11:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:30 smithi057 bash[10301]: audit 2020-11-16T22:11:29.779454+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:11:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:30 smithi057 bash[10301]: cluster 2020-11-16T22:11:30.096432+0000 mon.a (mon.0) 1332 : cluster [DBG] osdmap e662: 12 total, 12 up, 12 in 2020-11-16T22:11:30.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:30 smithi016 bash[10302]: cluster 2020-11-16T22:11:29.136050+0000 mon.a (mon.0) 1329 : cluster [DBG] osdmap e661: 12 total, 12 up, 12 in 2020-11-16T22:11:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:30 smithi016 bash[10302]: audit 2020-11-16T22:11:29.777332+0000 mon.b (mon.1) 310 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:11:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:30 smithi016 bash[10302]: audit 2020-11-16T22:11:29.777927+0000 mon.b (mon.1) 311 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:11:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:30 smithi016 bash[10302]: audit 2020-11-16T22:11:29.778736+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:11:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:30 smithi016 bash[10302]: audit 2020-11-16T22:11:29.779454+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:11:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:30 smithi016 bash[10302]: cluster 2020-11-16T22:11:30.096432+0000 mon.a (mon.0) 1332 : cluster [DBG] osdmap e662: 12 total, 12 up, 12 in 2020-11-16T22:11:30.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:30 smithi195 bash[10218]: cluster 2020-11-16T22:11:29.136050+0000 mon.a (mon.0) 1329 : cluster [DBG] osdmap e661: 12 total, 12 up, 12 in 2020-11-16T22:11:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:30 smithi195 bash[10218]: audit 2020-11-16T22:11:29.777332+0000 mon.b (mon.1) 310 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:11:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:30 smithi195 bash[10218]: audit 2020-11-16T22:11:29.777927+0000 mon.b (mon.1) 311 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:11:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:30 smithi195 bash[10218]: audit 2020-11-16T22:11:29.778736+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:11:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:30 smithi195 bash[10218]: audit 2020-11-16T22:11:29.779454+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:11:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:30 smithi195 bash[10218]: cluster 2020-11-16T22:11:30.096432+0000 mon.a (mon.0) 1332 : cluster [DBG] osdmap e662: 12 total, 12 up, 12 in 2020-11-16T22:11:31.147 INFO:tasks.rados.rados.2.smithi057.stdout:2554: done (2 left) 2020-11-16T22:11:31.147 INFO:tasks.rados.rados.2.smithi057.stdout:2555: snap_remove snap 291 2020-11-16T22:11:31.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:31 smithi057 bash[10301]: cluster 2020-11-16T22:11:29.770747+0000 mgr.x (mgr.24115) 566 : cluster [DBG] pgmap v1157: 17 pgs: 17 active+clean; 168 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:11:31.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:31 smithi016 bash[10302]: cluster 2020-11-16T22:11:29.770747+0000 mgr.x (mgr.24115) 566 : cluster [DBG] pgmap v1157: 17 pgs: 17 active+clean; 168 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:11:31.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:31 smithi195 bash[10218]: cluster 2020-11-16T22:11:29.770747+0000 mgr.x (mgr.24115) 566 : cluster [DBG] pgmap v1157: 17 pgs: 17 active+clean; 168 MiB data, 701 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:11:32.168 INFO:tasks.rados.rados.2.smithi057.stdout:2555: done (2 left) 2020-11-16T22:11:32.168 INFO:tasks.rados.rados.2.smithi057.stdout:2556: snap_create 2020-11-16T22:11:32.168 INFO:tasks.rados.rados.2.smithi057.stdout:2552: finishing write tid 1 to smithi05720651-14 2020-11-16T22:11:32.168 INFO:tasks.rados.rados.2.smithi057.stdout:2553: finishing rollback tid 0 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:32.169 INFO:tasks.rados.rados.2.smithi057.stdout:2553: finishing rollback tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:32.169 INFO:tasks.rados.rados.2.smithi057.stdout:2553: finishing rollback tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:32.169 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2057 (ObjNum 800 snap 276 seq_num 800) dirty exists 2020-11-16T22:11:32.169 INFO:tasks.rados.rados.2.smithi057.stdout:2552: finishing write tid 2 to smithi05720651-14 2020-11-16T22:11:32.169 INFO:tasks.rados.rados.2.smithi057.stdout:2552: finishing write tid 4 to smithi05720651-14 2020-11-16T22:11:32.169 INFO:tasks.rados.rados.2.smithi057.stdout:2552: finishing write tid 5 to smithi05720651-14 2020-11-16T22:11:32.169 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 2111 (ObjNum 862 snap 295 seq_num 862) dirty exists 2020-11-16T22:11:32.170 INFO:tasks.rados.rados.2.smithi057.stdout:2552: left oid 14 (ObjNum 862 snap 295 seq_num 862) 2020-11-16T22:11:32.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:32 smithi057 bash[10301]: cluster 2020-11-16T22:11:31.156005+0000 mon.a (mon.0) 1333 : cluster [DBG] osdmap e663: 12 total, 12 up, 12 in 2020-11-16T22:11:32.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:32 smithi016 bash[10302]: cluster 2020-11-16T22:11:31.156005+0000 mon.a (mon.0) 1333 : cluster [DBG] osdmap e663: 12 total, 12 up, 12 in 2020-11-16T22:11:32.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:32 smithi195 bash[10218]: cluster 2020-11-16T22:11:31.156005+0000 mon.a (mon.0) 1333 : cluster [DBG] osdmap e663: 12 total, 12 up, 12 in 2020-11-16T22:11:33.173 INFO:tasks.rados.rados.2.smithi057.stdout:2552: done (2 left) 2020-11-16T22:11:33.173 INFO:tasks.rados.rados.2.smithi057.stdout:2553: done (1 left) 2020-11-16T22:11:33.173 INFO:tasks.rados.rados.2.smithi057.stdout:2556: done (0 left) 2020-11-16T22:11:33.173 INFO:tasks.rados.rados.2.smithi057.stdout:2557: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 296 2020-11-16T22:11:33.174 INFO:tasks.rados.rados.2.smithi057.stdout:2557: seq_num 863 ranges {504441=487776,1467372=736289} 2020-11-16T22:11:33.187 INFO:tasks.rados.rados.2.smithi057.stdout:2557: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 504441 to 992217 tid 1 2020-11-16T22:11:33.194 INFO:tasks.rados.rados.2.smithi057.stdout:2557: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1467372 to 2203661 tid 2 2020-11-16T22:11:33.194 INFO:tasks.rados.rados.2.smithi057.stdout:2558: snap_remove snap 277 2020-11-16T22:11:33.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:33 smithi057 bash[10301]: cluster 2020-11-16T22:11:31.771483+0000 mgr.x (mgr.24115) 567 : cluster [DBG] pgmap v1160: 17 pgs: 17 active+clean; 179 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 7 op/s 2020-11-16T22:11:33.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:33 smithi057 bash[10301]: cluster 2020-11-16T22:11:32.173945+0000 mon.a (mon.0) 1334 : cluster [DBG] osdmap e664: 12 total, 12 up, 12 in 2020-11-16T22:11:33.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:33 smithi016 bash[10302]: cluster 2020-11-16T22:11:31.771483+0000 mgr.x (mgr.24115) 567 : cluster [DBG] pgmap v1160: 17 pgs: 17 active+clean; 179 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 7 op/s 2020-11-16T22:11:33.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:33 smithi016 bash[10302]: cluster 2020-11-16T22:11:32.173945+0000 mon.a (mon.0) 1334 : cluster [DBG] osdmap e664: 12 total, 12 up, 12 in 2020-11-16T22:11:33.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:33 smithi195 bash[10218]: cluster 2020-11-16T22:11:31.771483+0000 mgr.x (mgr.24115) 567 : cluster [DBG] pgmap v1160: 17 pgs: 17 active+clean; 179 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 7 op/s 2020-11-16T22:11:33.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:33 smithi195 bash[10218]: cluster 2020-11-16T22:11:32.173945+0000 mon.a (mon.0) 1334 : cluster [DBG] osdmap e664: 12 total, 12 up, 12 in 2020-11-16T22:11:34.187 INFO:tasks.rados.rados.2.smithi057.stdout:2558: done (1 left) 2020-11-16T22:11:34.187 INFO:tasks.rados.rados.2.smithi057.stdout:2559: snap_remove snap 295 2020-11-16T22:11:34.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:34 smithi057 bash[10301]: cluster 2020-11-16T22:11:33.183536+0000 mon.a (mon.0) 1335 : cluster [DBG] osdmap e665: 12 total, 12 up, 12 in 2020-11-16T22:11:34.445 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:11:34 smithi057 bash[12595]: debug 2020-11-16T22:11:34.247+0000 7f737919c700 -1 osd.8 pg_epoch: 666 pg[2.5( v 658'1275 (0'0,658'1275] local-lis/les=71/72 n=5 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,0] r=0 lpr=71 crt=658'1275 lcod 654'1273 mlcod 654'1273 active+clean+snaptrim trimq=[225~1] ps=[230~1,245~1,247~1,249~1]] removing snap head 2020-11-16T22:11:34.445 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:11:34 smithi057 bash[12595]: debug 2020-11-16T22:11:34.255+0000 7f737a19e700 -1 osd.8 pg_epoch: 666 pg[2.b( v 666'772 (0'0,666'772] local-lis/les=71/72 n=5 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,11] r=0 lpr=71 crt=666'772 lcod 666'770 mlcod 666'770 active+clean+snaptrim trimq=[225~1] ps=[230~1,245~1,247~1,249~1]] removing snap head 2020-11-16T22:11:34.445 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 22:11:34 smithi057 bash[14912]: debug 2020-11-16T22:11:34.199+0000 7faa6db1c700 -1 osd.9 pg_epoch: 666 pg[2.d( v 658'634 (0'0,658'634] local-lis/les=71/72 n=3 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [9,4] r=0 lpr=71 crt=658'634 lcod 654'632 mlcod 654'632 active+clean+snaptrim trimq=[225~1] ps=[230~1,245~1,247~1,249~1]] removing snap head 2020-11-16T22:11:34.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:34 smithi016 bash[10302]: cluster 2020-11-16T22:11:33.183536+0000 mon.a (mon.0) 1335 : cluster [DBG] osdmap e665: 12 total, 12 up, 12 in 2020-11-16T22:11:34.588 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 22:11:34 smithi016 bash[17468]: debug 2020-11-16T22:11:34.241+0000 7fd65f6d4700 -1 osd.6 pg_epoch: 666 pg[2.7( v 658'842 (0'0,658'842] local-lis/les=71/72 n=6 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [6,10] r=0 lpr=71 crt=658'842 lcod 658'840 mlcod 658'840 active+clean+snaptrim trimq=[225~1] ps=[230~1,245~1,247~1,249~1]] removing snap head 2020-11-16T22:11:34.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:34 smithi195 bash[10218]: cluster 2020-11-16T22:11:33.183536+0000 mon.a (mon.0) 1335 : cluster [DBG] osdmap e665: 12 total, 12 up, 12 in 2020-11-16T22:11:34.600 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:11:34 smithi195 bash[18679]: debug 2020-11-16T22:11:34.245+0000 7f9943e00700 -1 osd.1 pg_epoch: 666 pg[2.4( v 666'634 (0'0,666'634] local-lis/les=71/72 n=3 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,0] r=0 lpr=71 luod=658'632 crt=666'634 lcod 654'630 mlcod 654'630 active+clean+snaptrim trimq=[225~1] ps=[230~1,245~1,247~1,249~1]] removing snap head 2020-11-16T22:11:35.095 INFO:tasks.rados.rados.2.smithi057.stdout:2559: done (1 left) 2020-11-16T22:11:35.095 INFO:tasks.rados.rados.2.smithi057.stdout:2560: rollback oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 296 2020-11-16T22:11:35.096 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 289 2020-11-16T22:11:35.096 INFO:tasks.rados.rados.2.smithi057.stdout:2557: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:35.096 INFO:tasks.rados.rados.2.smithi057.stdout:2557: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:35.096 INFO:tasks.rados.rados.2.smithi057.stdout:2557: finishing write tid 4 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:35.096 INFO:tasks.rados.rados.2.smithi057.stdout:2557: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:35.097 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2121 (ObjNum 863 snap 296 seq_num 863) dirty exists 2020-11-16T22:11:35.097 INFO:tasks.rados.rados.2.smithi057.stdout:2557: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 863 snap 296 seq_num 863) 2020-11-16T22:11:35.097 INFO:tasks.rados.rados.2.smithi057.stdout:2557: done (1 left) 2020-11-16T22:11:35.097 INFO:tasks.rados.rados.2.smithi057.stdout:2561: snap_remove snap 293 2020-11-16T22:11:35.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:35 smithi057 bash[10301]: cluster 2020-11-16T22:11:33.772193+0000 mgr.x (mgr.24115) 568 : cluster [DBG] pgmap v1163: 17 pgs: 17 active+clean; 179 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 7 op/s 2020-11-16T22:11:35.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:35 smithi057 bash[10301]: cluster 2020-11-16T22:11:34.194094+0000 mon.a (mon.0) 1336 : cluster [DBG] osdmap e666: 12 total, 12 up, 12 in 2020-11-16T22:11:35.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:35 smithi057 bash[10301]: cluster 2020-11-16T22:11:35.098761+0000 mon.a (mon.0) 1337 : cluster [DBG] osdmap e667: 12 total, 12 up, 12 in 2020-11-16T22:11:35.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:35 smithi016 bash[10302]: cluster 2020-11-16T22:11:33.772193+0000 mgr.x (mgr.24115) 568 : cluster [DBG] pgmap v1163: 17 pgs: 17 active+clean; 179 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 7 op/s 2020-11-16T22:11:35.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:35 smithi016 bash[10302]: cluster 2020-11-16T22:11:34.194094+0000 mon.a (mon.0) 1336 : cluster [DBG] osdmap e666: 12 total, 12 up, 12 in 2020-11-16T22:11:35.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:35 smithi016 bash[10302]: cluster 2020-11-16T22:11:35.098761+0000 mon.a (mon.0) 1337 : cluster [DBG] osdmap e667: 12 total, 12 up, 12 in 2020-11-16T22:11:35.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:35 smithi195 bash[10218]: cluster 2020-11-16T22:11:33.772193+0000 mgr.x (mgr.24115) 568 : cluster [DBG] pgmap v1163: 17 pgs: 17 active+clean; 179 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 7 op/s 2020-11-16T22:11:35.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:35 smithi195 bash[10218]: cluster 2020-11-16T22:11:34.194094+0000 mon.a (mon.0) 1336 : cluster [DBG] osdmap e666: 12 total, 12 up, 12 in 2020-11-16T22:11:35.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:35 smithi195 bash[10218]: cluster 2020-11-16T22:11:35.098761+0000 mon.a (mon.0) 1337 : cluster [DBG] osdmap e667: 12 total, 12 up, 12 in 2020-11-16T22:11:36.109 INFO:tasks.rados.rados.2.smithi057.stdout:2561: done (1 left) 2020-11-16T22:11:36.109 INFO:tasks.rados.rados.2.smithi057.stdout:2562: read oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 289 2020-11-16T22:11:36.110 INFO:tasks.rados.rados.2.smithi057.stdout:2562: expect (ObjNum 818 snap 279 seq_num 818) 2020-11-16T22:11:36.110 INFO:tasks.rados.rados.2.smithi057.stdout:2563: copy_from oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 296 2020-11-16T22:11:36.110 INFO:tasks.rados.rados.2.smithi057.stdout:2560: finishing rollback tid 0 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:36.110 INFO:tasks.rados.rados.2.smithi057.stdout:2560: finishing rollback tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:36.110 INFO:tasks.rados.rados.2.smithi057.stdout:2560: finishing rollback tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:36.110 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1735 (ObjNum 819 snap 280 seq_num 819) dirty exists 2020-11-16T22:11:36.111 INFO:tasks.rados.rados.2.smithi057.stdout:2560: done (2 left) 2020-11-16T22:11:36.111 INFO:tasks.rados.rados.2.smithi057.stdout:2564: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 289 2020-11-16T22:11:36.111 INFO:tasks.rados.rados.2.smithi057.stdout:2564: expect (ObjNum 850 snap 289 seq_num 850) 2020-11-16T22:11:36.111 INFO:tasks.rados.rados.2.smithi057.stdout:2565: rollback oid 40 current snap is 296 2020-11-16T22:11:36.111 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 40 to 289 2020-11-16T22:11:36.111 INFO:tasks.rados.rados.2.smithi057.stdout:2566: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:36.112 INFO:tasks.rados.rados.2.smithi057.stdout:2566: expect (ObjNum 837 snap 289 seq_num 837) 2020-11-16T22:11:36.112 INFO:tasks.rados.rados.2.smithi057.stdout:2567: read oid 26 snap -1 2020-11-16T22:11:36.112 INFO:tasks.rados.rados.2.smithi057.stdout:2567: expect (ObjNum 845 snap 289 seq_num 845) 2020-11-16T22:11:36.112 INFO:tasks.rados.rados.2.smithi057.stdout:2568: copy_from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 30 current snap is 296 2020-11-16T22:11:36.112 INFO:tasks.rados.rados.2.smithi057.stdout:2569: write (excl) oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 296 2020-11-16T22:11:36.112 INFO:tasks.rados.rados.2.smithi057.stdout:2569: seq_num 864 ranges {521248=563025,1809501=596300} 2020-11-16T22:11:36.122 INFO:tasks.rados.rados.2.smithi057.stdout:2569: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 521248 to 1084273 tid 1 2020-11-16T22:11:36.130 INFO:tasks.rados.rados.2.smithi057.stdout:2569: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1809501 to 2405801 tid 2 2020-11-16T22:11:36.130 INFO:tasks.rados.rados.2.smithi057.stdout:2570: write (excl) oid 34 current snap is 296 2020-11-16T22:11:36.130 INFO:tasks.rados.rados.2.smithi057.stdout:2570: seq_num 865 ranges {538055=638274,1867983=670072} 2020-11-16T22:11:36.137 INFO:tasks.rados.rados.2.smithi057.stdout:2570: writing smithi05720651-34 from 538055 to 1176329 tid 1 2020-11-16T22:11:36.145 INFO:tasks.rados.rados.2.smithi057.stdout:2570: writing smithi05720651-34 from 1867983 to 2538055 tid 2 2020-11-16T22:11:36.145 INFO:tasks.rados.rados.2.smithi057.stdout:2571: write (excl) oid 16 current snap is 296 2020-11-16T22:11:36.145 INFO:tasks.rados.rados.2.smithi057.stdout:2571: seq_num 866 ranges {554862=713523,1926465=599969} 2020-11-16T22:11:36.152 INFO:tasks.rados.rados.2.smithi057.stdout:2571: writing smithi05720651-16 from 554862 to 1268385 tid 1 2020-11-16T22:11:36.159 INFO:tasks.rados.rados.2.smithi057.stdout:2571: writing smithi05720651-16 from 1926465 to 2526434 tid 2 2020-11-16T22:11:36.159 INFO:tasks.rados.rados.2.smithi057.stdout:2572: copy_from oid 36 from oid 12 current snap is 296 2020-11-16T22:11:36.160 INFO:tasks.rados.rados.2.smithi057.stdout:2563: finishing copy_from to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:36.160 INFO:tasks.rados.rados.2.smithi057.stdout:2563: got expected ENOENT (src dne) 2020-11-16T22:11:36.160 INFO:tasks.rados.rados.2.smithi057.stdout:2563: finishing copy_from racing read to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:36.160 INFO:tasks.rados.rados.2.smithi057.stdout:2563: done (10 left) 2020-11-16T22:11:36.160 INFO:tasks.rados.rados.2.smithi057.stdout:2573: rollback oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 296 2020-11-16T22:11:36.160 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 289 2020-11-16T22:11:36.161 INFO:tasks.rados.rados.2.smithi057.stdout:2564: expect (ObjNum 850 snap 289 seq_num 850) 2020-11-16T22:11:36.268 INFO:tasks.rados.rados.2.smithi057.stdout:2567: expect (ObjNum 845 snap 289 seq_num 845) 2020-11-16T22:11:36.356 INFO:tasks.rados.rados.2.smithi057.stdout:2565: finishing rollback tid 0 to smithi05720651-40 2020-11-16T22:11:36.357 INFO:tasks.rados.rados.2.smithi057.stdout:2565: finishing rollback tid 1 to smithi05720651-40 2020-11-16T22:11:36.357 INFO:tasks.rados.rados.2.smithi057.stdout:2565: finishing rollback tid 2 to smithi05720651-40 2020-11-16T22:11:36.357 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 2137 (ObjNum 841 snap 289 seq_num 841) dirty exists 2020-11-16T22:11:36.357 INFO:tasks.rados.rados.2.smithi057.stdout:2562: expect (ObjNum 818 snap 279 seq_num 818) 2020-11-16T22:11:36.574 INFO:tasks.rados.rados.2.smithi057.stdout:2566: expect (ObjNum 837 snap 289 seq_num 837) 2020-11-16T22:11:36.659 INFO:tasks.rados.rados.2.smithi057.stdout:2568: finishing copy_from to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:36.659 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1732 (ObjNum 852 snap 289 seq_num 852) dirty exists 2020-11-16T22:11:36.659 INFO:tasks.rados.rados.2.smithi057.stdout:2568: finishing copy_from racing read to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:36.659 INFO:tasks.rados.rados.2.smithi057.stdout:2569: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:36.660 INFO:tasks.rados.rados.2.smithi057.stdout:2570: finishing write tid 1 to smithi05720651-34 2020-11-16T22:11:36.660 INFO:tasks.rados.rados.2.smithi057.stdout:2569: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:36.660 INFO:tasks.rados.rados.2.smithi057.stdout:2569: finishing write tid 4 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:36.660 INFO:tasks.rados.rados.2.smithi057.stdout:2569: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:36.660 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1779 (ObjNum 864 snap 296 seq_num 864) dirty exists 2020-11-16T22:11:36.660 INFO:tasks.rados.rados.2.smithi057.stdout:2569: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 864 snap 296 seq_num 864) 2020-11-16T22:11:36.660 INFO:tasks.rados.rados.2.smithi057.stdout:2570: finishing write tid 2 to smithi05720651-34 2020-11-16T22:11:36.661 INFO:tasks.rados.rados.2.smithi057.stdout:2570: finishing write tid 4 to smithi05720651-34 2020-11-16T22:11:36.661 INFO:tasks.rados.rados.2.smithi057.stdout:2570: finishing write tid 5 to smithi05720651-34 2020-11-16T22:11:36.661 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 1780 (ObjNum 865 snap 296 seq_num 865) dirty exists 2020-11-16T22:11:36.661 INFO:tasks.rados.rados.2.smithi057.stdout:2570: left oid 34 (ObjNum 865 snap 296 seq_num 865) 2020-11-16T22:11:36.661 INFO:tasks.rados.rados.2.smithi057.stdout:2571: finishing write tid 1 to smithi05720651-16 2020-11-16T22:11:36.661 INFO:tasks.rados.rados.2.smithi057.stdout:2562: done (10 left) 2020-11-16T22:11:36.661 INFO:tasks.rados.rados.2.smithi057.stdout:2564: done (9 left) 2020-11-16T22:11:36.662 INFO:tasks.rados.rados.2.smithi057.stdout:2565: done (8 left) 2020-11-16T22:11:36.662 INFO:tasks.rados.rados.2.smithi057.stdout:2566: done (7 left) 2020-11-16T22:11:36.662 INFO:tasks.rados.rados.2.smithi057.stdout:2567: done (6 left) 2020-11-16T22:11:36.662 INFO:tasks.rados.rados.2.smithi057.stdout:2568: done (5 left) 2020-11-16T22:11:36.662 INFO:tasks.rados.rados.2.smithi057.stdout:2569: done (4 left) 2020-11-16T22:11:36.662 INFO:tasks.rados.rados.2.smithi057.stdout:2570: done (3 left) 2020-11-16T22:11:36.662 INFO:tasks.rados.rados.2.smithi057.stdout:2574: copy_from oid 40 from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 296 2020-11-16T22:11:36.663 INFO:tasks.rados.rados.2.smithi057.stdout:2573: finishing rollback tid 0 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:36.663 INFO:tasks.rados.rados.2.smithi057.stdout:2571: finishing write tid 2 to smithi05720651-16 2020-11-16T22:11:36.663 INFO:tasks.rados.rados.2.smithi057.stdout:2573: finishing rollback tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:36.663 INFO:tasks.rados.rados.2.smithi057.stdout:2571: finishing write tid 4 to smithi05720651-16 2020-11-16T22:11:36.663 INFO:tasks.rados.rados.2.smithi057.stdout:2571: finishing write tid 5 to smithi05720651-16 2020-11-16T22:11:36.663 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 2060 (ObjNum 866 snap 296 seq_num 866) dirty exists 2020-11-16T22:11:36.664 INFO:tasks.rados.rados.2.smithi057.stdout:2571: left oid 16 (ObjNum 866 snap 296 seq_num 866) 2020-11-16T22:11:36.664 INFO:tasks.rados.rados.2.smithi057.stdout:2573: finishing rollback tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:36.664 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2146 (ObjNum 810 snap 276 seq_num 810) dirty exists 2020-11-16T22:11:36.664 INFO:tasks.rados.rados.2.smithi057.stdout:2572: finishing copy_from to smithi05720651-36 2020-11-16T22:11:36.664 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 1515 (ObjNum 831 snap 285 seq_num 831) dirty exists 2020-11-16T22:11:36.664 INFO:tasks.rados.rados.2.smithi057.stdout:2572: finishing copy_from racing read to smithi05720651-36 2020-11-16T22:11:36.665 INFO:tasks.rados.rados.2.smithi057.stdout:2571: done (3 left) 2020-11-16T22:11:36.665 INFO:tasks.rados.rados.2.smithi057.stdout:2572: done (2 left) 2020-11-16T22:11:36.665 INFO:tasks.rados.rados.2.smithi057.stdout:2573: done (1 left) 2020-11-16T22:11:36.665 INFO:tasks.rados.rados.2.smithi057.stdout:2575: copy_from oid 14 from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 296 2020-11-16T22:11:36.665 INFO:tasks.rados.rados.2.smithi057.stdout:2576: snap_remove snap 289 2020-11-16T22:11:37.190 INFO:tasks.rados.rados.2.smithi057.stdout:2576: done (2 left) 2020-11-16T22:11:37.190 INFO:tasks.rados.rados.2.smithi057.stdout:2577: write (excl) oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 296 2020-11-16T22:11:37.191 INFO:tasks.rados.rados.2.smithi057.stdout:2577: seq_num 867 ranges {571669=505125,1701300=743627} 2020-11-16T22:11:37.204 INFO:tasks.rados.rados.2.smithi057.stdout:2577: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 571669 to 1076794 tid 1 2020-11-16T22:11:37.212 INFO:tasks.rados.rados.2.smithi057.stdout:2577: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1701300 to 2444927 tid 2 2020-11-16T22:11:37.212 INFO:tasks.rados.rados.2.smithi057.stdout:2578: read oid 44 snap -1 2020-11-16T22:11:37.212 INFO:tasks.rados.rados.2.smithi057.stdout:2578: expect deleted 2020-11-16T22:11:37.212 INFO:tasks.rados.rados.2.smithi057.stdout:2579: delete oid 2 current snap is 296 2020-11-16T22:11:37.213 INFO:tasks.rados.rados.2.smithi057.stdout:2575: finishing copy_from to smithi05720651-14 2020-11-16T22:11:37.213 INFO:tasks.rados.rados.2.smithi057.stdout:2575: got expected ENOENT (src dne) 2020-11-16T22:11:37.213 INFO:tasks.rados.rados.2.smithi057.stdout:2575: finishing copy_from racing read to smithi05720651-14 2020-11-16T22:11:37.213 INFO:tasks.rados.rados.2.smithi057.stdout:2574: finishing copy_from to smithi05720651-40 2020-11-16T22:11:37.213 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 1570 (ObjNum 816 snap 279 seq_num 816) dirty exists 2020-11-16T22:11:37.213 INFO:tasks.rados.rados.2.smithi057.stdout:2574: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:11:37.213 INFO:tasks.rados.rados.2.smithi057.stdout:2577: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:37.219 INFO:tasks.rados.rados.2.smithi057.stdout:2577: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:37.220 INFO:tasks.rados.rados.2.smithi057.stdout:2577: finishing write tid 4 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:37.221 INFO:tasks.rados.rados.2.smithi057.stdout:2577: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:37.221 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2158 (ObjNum 867 snap 296 seq_num 867) dirty exists 2020-11-16T22:11:37.221 INFO:tasks.rados.rados.2.smithi057.stdout:2577: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 867 snap 296 seq_num 867) 2020-11-16T22:11:37.222 INFO:tasks.rados.rados.2.smithi057.stdout:2574: done (4 left) 2020-11-16T22:11:37.222 INFO:tasks.rados.rados.2.smithi057.stdout:2575: done (3 left) 2020-11-16T22:11:37.222 INFO:tasks.rados.rados.2.smithi057.stdout:2577: done (2 left) 2020-11-16T22:11:37.222 INFO:tasks.rados.rados.2.smithi057.stdout:2578: done (1 left) 2020-11-16T22:11:37.222 INFO:tasks.rados.rados.2.smithi057.stdout:2579: done (0 left) 2020-11-16T22:11:37.222 INFO:tasks.rados.rados.2.smithi057.stdout:2580: delete oid 20 current snap is 296 2020-11-16T22:11:37.224 INFO:tasks.rados.rados.2.smithi057.stdout:2580: done (0 left) 2020-11-16T22:11:37.224 INFO:tasks.rados.rados.2.smithi057.stdout:2581: rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 296 2020-11-16T22:11:37.224 INFO:tasks.rados.rados.2.smithi057.stdout:2581: done (0 left) 2020-11-16T22:11:37.224 INFO:tasks.rados.rados.2.smithi057.stdout:2582: delete oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 296 2020-11-16T22:11:37.226 INFO:tasks.rados.rados.2.smithi057.stdout:2582: done (0 left) 2020-11-16T22:11:37.226 INFO:tasks.rados.rados.2.smithi057.stdout:2583: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:37.227 INFO:tasks.rados.rados.2.smithi057.stdout:2583: expect deleted 2020-11-16T22:11:37.227 INFO:tasks.rados.rados.2.smithi057.stdout:2584: delete oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 296 2020-11-16T22:11:37.234 INFO:tasks.rados.rados.2.smithi057.stdout:2583: done (1 left) 2020-11-16T22:11:37.234 INFO:tasks.rados.rados.2.smithi057.stdout:2584: done (0 left) 2020-11-16T22:11:37.234 INFO:tasks.rados.rados.2.smithi057.stdout:2585: write oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 296 2020-11-16T22:11:37.234 INFO:tasks.rados.rados.2.smithi057.stdout:2585: seq_num 872 ranges {655704=481370,1761004=494623} 2020-11-16T22:11:37.245 INFO:tasks.rados.rados.2.smithi057.stdout:2585: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 655704 to 1137074 tid 1 2020-11-16T22:11:37.252 INFO:tasks.rados.rados.2.smithi057.stdout:2585: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1761004 to 2255627 tid 2 2020-11-16T22:11:37.252 INFO:tasks.rados.rados.2.smithi057.stdout:2586: read oid 6 snap -1 2020-11-16T22:11:37.253 INFO:tasks.rados.rados.2.smithi057.stdout:2586: expect (ObjNum 737 snap 256 seq_num 737) 2020-11-16T22:11:37.253 INFO:tasks.rados.rados.2.smithi057.stdout:2587: write (excl) oid 18 current snap is 296 2020-11-16T22:11:37.253 INFO:tasks.rados.rados.2.smithi057.stdout:2587: seq_num 873 ranges {672511=556619,1819486=754634} 2020-11-16T22:11:37.259 INFO:tasks.rados.rados.2.smithi057.stdout:2587: writing smithi05720651-18 from 672511 to 1229130 tid 1 2020-11-16T22:11:37.267 INFO:tasks.rados.rados.2.smithi057.stdout:2587: writing smithi05720651-18 from 1819486 to 2574120 tid 2 2020-11-16T22:11:37.267 INFO:tasks.rados.rados.2.smithi057.stdout:2588: copy_from oid 42 from oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 296 2020-11-16T22:11:37.267 INFO:tasks.rados.rados.2.smithi057.stdout:2585: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:37.267 INFO:tasks.rados.rados.2.smithi057.stdout:2589: rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 296 2020-11-16T22:11:37.268 INFO:tasks.rados.rados.2.smithi057.stdout:2589: done (4 left) 2020-11-16T22:11:37.268 INFO:tasks.rados.rados.2.smithi057.stdout:2590: write oid 48 current snap is 296 2020-11-16T22:11:37.268 INFO:tasks.rados.rados.2.smithi057.stdout:2590: seq_num 874 ranges {689318=631868,1877968=498292} 2020-11-16T22:11:37.274 INFO:tasks.rados.rados.2.smithi057.stdout:2590: writing smithi05720651-48 from 689318 to 1321186 tid 1 2020-11-16T22:11:37.282 INFO:tasks.rados.rados.2.smithi057.stdout:2590: writing smithi05720651-48 from 1877968 to 2376260 tid 2 2020-11-16T22:11:37.282 INFO:tasks.rados.rados.2.smithi057.stdout:2591: read oid 40 snap -1 2020-11-16T22:11:37.283 INFO:tasks.rados.rados.2.smithi057.stdout:2591: expect (ObjNum 816 snap 279 seq_num 816) 2020-11-16T22:11:37.283 INFO:tasks.rados.rados.2.smithi057.stdout:2592: delete oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 296 2020-11-16T22:11:37.283 INFO:tasks.rados.rados.2.smithi057.stdout:2587: finishing write tid 1 to smithi05720651-18 2020-11-16T22:11:37.283 INFO:tasks.rados.rados.2.smithi057.stdout:2585: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:37.283 INFO:tasks.rados.rados.2.smithi057.stdout:2585: finishing write tid 4 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:37.283 INFO:tasks.rados.rados.2.smithi057.stdout:2585: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:37.283 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1954 (ObjNum 872 snap 296 seq_num 872) dirty exists 2020-11-16T22:11:37.284 INFO:tasks.rados.rados.2.smithi057.stdout:2585: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 872 snap 296 seq_num 872) 2020-11-16T22:11:37.284 INFO:tasks.rados.rados.2.smithi057.stdout:2586: expect (ObjNum 737 snap 256 seq_num 737) 2020-11-16T22:11:37.423 INFO:tasks.rados.rados.2.smithi057.stdout:2587: finishing write tid 2 to smithi05720651-18 2020-11-16T22:11:37.424 INFO:tasks.rados.rados.2.smithi057.stdout:2587: finishing write tid 4 to smithi05720651-18 2020-11-16T22:11:37.424 INFO:tasks.rados.rados.2.smithi057.stdout:2587: finishing write tid 5 to smithi05720651-18 2020-11-16T22:11:37.424 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 1738 (ObjNum 873 snap 296 seq_num 873) dirty exists 2020-11-16T22:11:37.424 INFO:tasks.rados.rados.2.smithi057.stdout:2587: left oid 18 (ObjNum 873 snap 296 seq_num 873) 2020-11-16T22:11:37.424 INFO:tasks.rados.rados.2.smithi057.stdout:2590: finishing write tid 1 to smithi05720651-48 2020-11-16T22:11:37.424 INFO:tasks.rados.rados.2.smithi057.stdout:2590: finishing write tid 2 to smithi05720651-48 2020-11-16T22:11:37.425 INFO:tasks.rados.rados.2.smithi057.stdout:2585: done (6 left) 2020-11-16T22:11:37.425 INFO:tasks.rados.rados.2.smithi057.stdout:2586: done (5 left) 2020-11-16T22:11:37.425 INFO:tasks.rados.rados.2.smithi057.stdout:2587: done (4 left) 2020-11-16T22:11:37.425 INFO:tasks.rados.rados.2.smithi057.stdout:2592: done (3 left) 2020-11-16T22:11:37.425 INFO:tasks.rados.rados.2.smithi057.stdout:2593: write (excl) oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 296 2020-11-16T22:11:37.425 INFO:tasks.rados.rados.2.smithi057.stdout:2593: seq_num 876 ranges {722932=498719,1994932=501961} 2020-11-16T22:11:37.436 INFO:tasks.rados.rados.2.smithi057.stdout:2593: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 722932 to 1221651 tid 1 2020-11-16T22:11:37.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:37 smithi057 bash[10301]: cluster 2020-11-16T22:11:35.772892+0000 mgr.x (mgr.24115) 569 : cluster [DBG] pgmap v1166: 17 pgs: 17 active+clean; 155 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:11:37.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:37 smithi057 bash[10301]: cluster 2020-11-16T22:11:36.114946+0000 mon.a (mon.0) 1338 : cluster [DBG] osdmap e668: 12 total, 12 up, 12 in 2020-11-16T22:11:37.445 INFO:tasks.rados.rados.2.smithi057.stdout:2593: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1994932 to 2496893 tid 2 2020-11-16T22:11:37.445 INFO:tasks.rados.rados.2.smithi057.stdout:2594: write oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 296 2020-11-16T22:11:37.445 INFO:tasks.rados.rados.2.smithi057.stdout:2594: seq_num 877 ranges {739739=573968,2053414=686325} 2020-11-16T22:11:37.452 INFO:tasks.rados.rados.2.smithi057.stdout:2594: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 739739 to 1313707 tid 1 2020-11-16T22:11:37.460 INFO:tasks.rados.rados.2.smithi057.stdout:2594: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2053414 to 2739739 tid 2 2020-11-16T22:11:37.461 INFO:tasks.rados.rados.2.smithi057.stdout:2595: write (excl) oid 16 current snap is 296 2020-11-16T22:11:37.461 INFO:tasks.rados.rados.2.smithi057.stdout:2595: seq_num 878 ranges {756546=649217,2111896=505630} 2020-11-16T22:11:37.468 INFO:tasks.rados.rados.2.smithi057.stdout:2595: writing smithi05720651-16 from 756546 to 1405763 tid 1 2020-11-16T22:11:37.475 INFO:tasks.rados.rados.2.smithi057.stdout:2595: writing smithi05720651-16 from 2111896 to 2617526 tid 2 2020-11-16T22:11:37.476 INFO:tasks.rados.rados.2.smithi057.stdout:2596: snap_create 2020-11-16T22:11:37.476 INFO:tasks.rados.rados.2.smithi057.stdout:2588: finishing copy_from to smithi05720651-42 2020-11-16T22:11:37.476 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 1899 (ObjNum 850 snap 289 seq_num 850) dirty exists 2020-11-16T22:11:37.476 INFO:tasks.rados.rados.2.smithi057.stdout:2588: finishing copy_from racing read to smithi05720651-42 2020-11-16T22:11:37.476 INFO:tasks.rados.rados.2.smithi057.stdout:2591: expect (ObjNum 816 snap 279 seq_num 816) 2020-11-16T22:11:37.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:37 smithi016 bash[10302]: cluster 2020-11-16T22:11:35.772892+0000 mgr.x (mgr.24115) 569 : cluster [DBG] pgmap v1166: 17 pgs: 17 active+clean; 155 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:11:37.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:37 smithi016 bash[10302]: cluster 2020-11-16T22:11:36.114946+0000 mon.a (mon.0) 1338 : cluster [DBG] osdmap e668: 12 total, 12 up, 12 in 2020-11-16T22:11:37.599 INFO:journalctl@ceph.osd.2.smithi195.stdout:Nov 16 22:11:37 smithi195 bash[21024]: debug 2020-11-16T22:11:37.241+0000 7f3c18734700 -1 osd.2 pg_epoch: 669 pg[2.1( v 669'424 (0'0,669'424] local-lis/les=71/72 n=3 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [2,3] r=0 lpr=71 crt=669'424 lcod 666'423 mlcod 666'423 active+clean+snaptrim trimq=[240~1] ps=[225~1,245~1,247~3,24d~1]] removing snap head 2020-11-16T22:11:37.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:37 smithi195 bash[10218]: cluster 2020-11-16T22:11:35.772892+0000 mgr.x (mgr.24115) 569 : cluster [DBG] pgmap v1166: 17 pgs: 17 active+clean; 155 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:11:37.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:37 smithi195 bash[10218]: cluster 2020-11-16T22:11:36.114946+0000 mon.a (mon.0) 1338 : cluster [DBG] osdmap e668: 12 total, 12 up, 12 in 2020-11-16T22:11:37.747 INFO:tasks.rados.rados.2.smithi057.stdout:2590: finishing write tid 4 to smithi05720651-48 2020-11-16T22:11:37.747 INFO:tasks.rados.rados.2.smithi057.stdout:2590: finishing write tid 5 to smithi05720651-48 2020-11-16T22:11:37.748 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 1521 (ObjNum 874 snap 296 seq_num 874) dirty exists 2020-11-16T22:11:37.748 INFO:tasks.rados.rados.2.smithi057.stdout:2590: left oid 48 (ObjNum 874 snap 296 seq_num 874) 2020-11-16T22:11:37.748 INFO:tasks.rados.rados.2.smithi057.stdout:2593: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:37.748 INFO:tasks.rados.rados.2.smithi057.stdout:2593: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:37.748 INFO:tasks.rados.rados.2.smithi057.stdout:2593: finishing write tid 4 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:37.748 INFO:tasks.rados.rados.2.smithi057.stdout:2593: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:37.748 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2162 (ObjNum 876 snap 296 seq_num 876) dirty exists 2020-11-16T22:11:37.749 INFO:tasks.rados.rados.2.smithi057.stdout:2593: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 876 snap 296 seq_num 876) 2020-11-16T22:11:37.749 INFO:tasks.rados.rados.2.smithi057.stdout:2594: finishing write tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:37.749 INFO:tasks.rados.rados.2.smithi057.stdout:2594: finishing write tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:37.749 INFO:tasks.rados.rados.2.smithi057.stdout:2594: finishing write tid 4 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:37.749 INFO:tasks.rados.rados.2.smithi057.stdout:2594: finishing write tid 5 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:37.749 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2063 (ObjNum 877 snap 296 seq_num 877) dirty exists 2020-11-16T22:11:37.749 INFO:tasks.rados.rados.2.smithi057.stdout:2594: left oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 877 snap 296 seq_num 877) 2020-11-16T22:11:37.750 INFO:tasks.rados.rados.2.smithi057.stdout:2595: finishing write tid 1 to smithi05720651-16 2020-11-16T22:11:37.750 INFO:tasks.rados.rados.2.smithi057.stdout:2595: finishing write tid 2 to smithi05720651-16 2020-11-16T22:11:37.750 INFO:tasks.rados.rados.2.smithi057.stdout:2595: finishing write tid 4 to smithi05720651-16 2020-11-16T22:11:38.048 INFO:tasks.rados.rados.2.smithi057.stdout:2595: finishing write tid 5 to smithi05720651-16 2020-11-16T22:11:38.048 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 2066 (ObjNum 878 snap 296 seq_num 878) dirty exists 2020-11-16T22:11:38.048 INFO:tasks.rados.rados.2.smithi057.stdout:2595: left oid 16 (ObjNum 878 snap 296 seq_num 878) 2020-11-16T22:11:38.207 INFO:tasks.rados.rados.2.smithi057.stdout:2588: done (6 left) 2020-11-16T22:11:38.207 INFO:tasks.rados.rados.2.smithi057.stdout:2590: done (5 left) 2020-11-16T22:11:38.208 INFO:tasks.rados.rados.2.smithi057.stdout:2591: done (4 left) 2020-11-16T22:11:38.208 INFO:tasks.rados.rados.2.smithi057.stdout:2593: done (3 left) 2020-11-16T22:11:38.208 INFO:tasks.rados.rados.2.smithi057.stdout:2594: done (2 left) 2020-11-16T22:11:38.208 INFO:tasks.rados.rados.2.smithi057.stdout:2595: done (1 left) 2020-11-16T22:11:38.208 INFO:tasks.rados.rados.2.smithi057.stdout:2596: done (0 left) 2020-11-16T22:11:38.208 INFO:tasks.rados.rados.2.smithi057.stdout:2597: write (excl) oid 6 current snap is 297 2020-11-16T22:11:38.208 INFO:tasks.rados.rados.2.smithi057.stdout:2597: seq_num 879 ranges {773353=724466,2170378=602975} 2020-11-16T22:11:38.224 INFO:tasks.rados.rados.2.smithi057.stdout:2597: writing smithi05720651-6 from 773353 to 1497819 tid 1 2020-11-16T22:11:38.232 INFO:tasks.rados.rados.2.smithi057.stdout:2597: writing smithi05720651-6 from 2170378 to 2773353 tid 2 2020-11-16T22:11:38.232 INFO:tasks.rados.rados.2.smithi057.stdout:2598: snap_remove snap 296 2020-11-16T22:11:38.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:38 smithi016 bash[10302]: cluster 2020-11-16T22:11:37.200962+0000 mon.a (mon.0) 1339 : cluster [DBG] osdmap e669: 12 total, 12 up, 12 in 2020-11-16T22:11:38.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:38 smithi195 bash[10218]: cluster 2020-11-16T22:11:37.200962+0000 mon.a (mon.0) 1339 : cluster [DBG] osdmap e669: 12 total, 12 up, 12 in 2020-11-16T22:11:38.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:38 smithi057 bash[10301]: cluster 2020-11-16T22:11:37.200962+0000 mon.a (mon.0) 1339 : cluster [DBG] osdmap e669: 12 total, 12 up, 12 in 2020-11-16T22:11:39.208 INFO:tasks.rados.rados.2.smithi057.stdout:2598: done (1 left) 2020-11-16T22:11:39.208 INFO:tasks.rados.rados.2.smithi057.stdout:2599: write (excl) oid 48 current snap is 297 2020-11-16T22:11:39.208 INFO:tasks.rados.rados.2.smithi057.stdout:2599: seq_num 880 ranges {790160=799715,2112507=509299} 2020-11-16T22:11:39.222 INFO:tasks.rados.rados.2.smithi057.stdout:2599: writing smithi05720651-48 from 790160 to 1589875 tid 1 2020-11-16T22:11:39.229 INFO:tasks.rados.rados.2.smithi057.stdout:2599: writing smithi05720651-48 from 2112507 to 2621806 tid 2 2020-11-16T22:11:39.229 INFO:tasks.rados.rados.2.smithi057.stdout:2600: delete oid 24 current snap is 297 2020-11-16T22:11:39.229 INFO:tasks.rados.rados.2.smithi057.stdout:2597: finishing write tid 1 to smithi05720651-6 2020-11-16T22:11:39.229 INFO:tasks.rados.rados.2.smithi057.stdout:2597: finishing write tid 2 to smithi05720651-6 2020-11-16T22:11:39.230 INFO:tasks.rados.rados.2.smithi057.stdout:2597: finishing write tid 4 to smithi05720651-6 2020-11-16T22:11:39.230 INFO:tasks.rados.rados.2.smithi057.stdout:2597: finishing write tid 5 to smithi05720651-6 2020-11-16T22:11:39.230 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 1958 (ObjNum 879 snap 297 seq_num 879) dirty exists 2020-11-16T22:11:39.230 INFO:tasks.rados.rados.2.smithi057.stdout:2597: left oid 6 (ObjNum 879 snap 297 seq_num 879) 2020-11-16T22:11:39.232 INFO:tasks.rados.rados.2.smithi057.stdout:2599: finishing write tid 1 to smithi05720651-48 2020-11-16T22:11:39.234 INFO:tasks.rados.rados.2.smithi057.stdout:2597: done (2 left) 2020-11-16T22:11:39.234 INFO:tasks.rados.rados.2.smithi057.stdout:2600: done (1 left) 2020-11-16T22:11:39.234 INFO:tasks.rados.rados.2.smithi057.stdout:2601: snap_create 2020-11-16T22:11:39.237 INFO:tasks.rados.rados.2.smithi057.stdout:2599: finishing write tid 2 to smithi05720651-48 2020-11-16T22:11:39.237 INFO:tasks.rados.rados.2.smithi057.stdout:2599: finishing write tid 4 to smithi05720651-48 2020-11-16T22:11:39.238 INFO:tasks.rados.rados.2.smithi057.stdout:2599: finishing write tid 5 to smithi05720651-48 2020-11-16T22:11:39.238 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 1524 (ObjNum 880 snap 297 seq_num 880) dirty exists 2020-11-16T22:11:39.238 INFO:tasks.rados.rados.2.smithi057.stdout:2599: left oid 48 (ObjNum 880 snap 297 seq_num 880) 2020-11-16T22:11:39.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:39 smithi016 bash[10302]: cluster 2020-11-16T22:11:37.773646+0000 mgr.x (mgr.24115) 570 : cluster [DBG] pgmap v1169: 17 pgs: 17 active+clean; 134 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 895 KiB/s wr, 8 op/s 2020-11-16T22:11:39.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:39 smithi016 bash[10302]: cluster 2020-11-16T22:11:38.210501+0000 mon.a (mon.0) 1340 : cluster [DBG] osdmap e670: 12 total, 12 up, 12 in 2020-11-16T22:11:39.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:39 smithi195 bash[10218]: cluster 2020-11-16T22:11:37.773646+0000 mgr.x (mgr.24115) 570 : cluster [DBG] pgmap v1169: 17 pgs: 17 active+clean; 134 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 895 KiB/s wr, 8 op/s 2020-11-16T22:11:39.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:39 smithi195 bash[10218]: cluster 2020-11-16T22:11:38.210501+0000 mon.a (mon.0) 1340 : cluster [DBG] osdmap e670: 12 total, 12 up, 12 in 2020-11-16T22:11:39.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:39 smithi057 bash[10301]: cluster 2020-11-16T22:11:37.773646+0000 mgr.x (mgr.24115) 570 : cluster [DBG] pgmap v1169: 17 pgs: 17 active+clean; 134 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 895 KiB/s wr, 8 op/s 2020-11-16T22:11:39.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:39 smithi057 bash[10301]: cluster 2020-11-16T22:11:38.210501+0000 mon.a (mon.0) 1340 : cluster [DBG] osdmap e670: 12 total, 12 up, 12 in 2020-11-16T22:11:40.093 INFO:tasks.rados.rados.2.smithi057.stdout:2599: done (1 left) 2020-11-16T22:11:40.093 INFO:tasks.rados.rados.2.smithi057.stdout:2601: done (0 left) 2020-11-16T22:11:40.094 INFO:tasks.rados.rados.2.smithi057.stdout:2602: snap_remove snap 297 2020-11-16T22:11:40.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:40 smithi016 bash[10302]: cluster 2020-11-16T22:11:39.213296+0000 mon.a (mon.0) 1341 : cluster [DBG] osdmap e671: 12 total, 12 up, 12 in 2020-11-16T22:11:40.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:40 smithi016 bash[10302]: cluster 2020-11-16T22:11:40.099499+0000 mon.a (mon.0) 1342 : cluster [DBG] osdmap e672: 12 total, 12 up, 12 in 2020-11-16T22:11:40.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:40 smithi195 bash[10218]: cluster 2020-11-16T22:11:39.213296+0000 mon.a (mon.0) 1341 : cluster [DBG] osdmap e671: 12 total, 12 up, 12 in 2020-11-16T22:11:40.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:40 smithi195 bash[10218]: cluster 2020-11-16T22:11:40.099499+0000 mon.a (mon.0) 1342 : cluster [DBG] osdmap e672: 12 total, 12 up, 12 in 2020-11-16T22:11:40.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:40 smithi057 bash[10301]: cluster 2020-11-16T22:11:39.213296+0000 mon.a (mon.0) 1341 : cluster [DBG] osdmap e671: 12 total, 12 up, 12 in 2020-11-16T22:11:40.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:40 smithi057 bash[10301]: cluster 2020-11-16T22:11:40.099499+0000 mon.a (mon.0) 1342 : cluster [DBG] osdmap e672: 12 total, 12 up, 12 in 2020-11-16T22:11:41.114 INFO:tasks.rados.rados.2.smithi057.stdout:2602: done (0 left) 2020-11-16T22:11:41.114 INFO:tasks.rados.rados.2.smithi057.stdout:2603: read oid 20 snap -1 2020-11-16T22:11:41.114 INFO:tasks.rados.rados.2.smithi057.stdout:2603: expect deleted 2020-11-16T22:11:41.115 INFO:tasks.rados.rados.2.smithi057.stdout:2604: snap_create 2020-11-16T22:11:41.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:41 smithi016 bash[10302]: cluster 2020-11-16T22:11:39.774463+0000 mgr.x (mgr.24115) 571 : cluster [DBG] pgmap v1172: 17 pgs: 17 active+clean; 127 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 9 op/s 2020-11-16T22:11:41.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:41 smithi016 bash[10302]: cluster 2020-11-16T22:11:41.119200+0000 mon.a (mon.0) 1343 : cluster [DBG] osdmap e673: 12 total, 12 up, 12 in 2020-11-16T22:11:41.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:41 smithi195 bash[10218]: cluster 2020-11-16T22:11:39.774463+0000 mgr.x (mgr.24115) 571 : cluster [DBG] pgmap v1172: 17 pgs: 17 active+clean; 127 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 9 op/s 2020-11-16T22:11:41.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:41 smithi195 bash[10218]: cluster 2020-11-16T22:11:41.119200+0000 mon.a (mon.0) 1343 : cluster [DBG] osdmap e673: 12 total, 12 up, 12 in 2020-11-16T22:11:41.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:41 smithi057 bash[10301]: cluster 2020-11-16T22:11:39.774463+0000 mgr.x (mgr.24115) 571 : cluster [DBG] pgmap v1172: 17 pgs: 17 active+clean; 127 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 9 op/s 2020-11-16T22:11:41.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:41 smithi057 bash[10301]: cluster 2020-11-16T22:11:41.119200+0000 mon.a (mon.0) 1343 : cluster [DBG] osdmap e673: 12 total, 12 up, 12 in 2020-11-16T22:11:42.114 INFO:tasks.rados.rados.2.smithi057.stdout:2603: done (1 left) 2020-11-16T22:11:42.114 INFO:tasks.rados.rados.2.smithi057.stdout:2604: done (0 left) 2020-11-16T22:11:42.114 INFO:tasks.rados.rados.2.smithi057.stdout:2605: read oid 38 snap -1 2020-11-16T22:11:42.114 INFO:tasks.rados.rados.2.smithi057.stdout:2605: expect (ObjNum 820 snap 281 seq_num 820) 2020-11-16T22:11:42.114 INFO:tasks.rados.rados.2.smithi057.stdout:2606: snap_create 2020-11-16T22:11:42.134 INFO:tasks.rados.rados.2.smithi057.stdout:2605: expect (ObjNum 820 snap 281 seq_num 820) 2020-11-16T22:11:43.121 INFO:tasks.rados.rados.2.smithi057.stdout:2605: done (1 left) 2020-11-16T22:11:43.121 INFO:tasks.rados.rados.2.smithi057.stdout:2606: done (0 left) 2020-11-16T22:11:43.121 INFO:tasks.rados.rados.2.smithi057.stdout:2607: write oid 14 current snap is 300 2020-11-16T22:11:43.122 INFO:tasks.rados.rados.2.smithi057.stdout:2607: seq_num 882 ranges {423774=666566,1545824=512968,2704609=119165} 2020-11-16T22:11:43.130 INFO:tasks.rados.rados.2.smithi057.stdout:2607: writing smithi05720651-14 from 423774 to 1090340 tid 1 2020-11-16T22:11:43.138 INFO:tasks.rados.rados.2.smithi057.stdout:2607: writing smithi05720651-14 from 1545824 to 2058792 tid 2 2020-11-16T22:11:43.141 INFO:tasks.rados.rados.2.smithi057.stdout:2607: writing smithi05720651-14 from 2704609 to 2823774 tid 3 2020-11-16T22:11:43.141 INFO:tasks.rados.rados.2.smithi057.stdout:2608: snap_create 2020-11-16T22:11:43.145 INFO:tasks.rados.rados.2.smithi057.stdout:2607: finishing write tid 1 to smithi05720651-14 2020-11-16T22:11:43.148 INFO:tasks.rados.rados.2.smithi057.stdout:2607: finishing write tid 2 to smithi05720651-14 2020-11-16T22:11:43.149 INFO:tasks.rados.rados.2.smithi057.stdout:2607: finishing write tid 3 to smithi05720651-14 2020-11-16T22:11:43.149 INFO:tasks.rados.rados.2.smithi057.stdout:2607: finishing write tid 5 to smithi05720651-14 2020-11-16T22:11:43.150 INFO:tasks.rados.rados.2.smithi057.stdout:2607: finishing write tid 6 to smithi05720651-14 2020-11-16T22:11:43.150 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 2167 (ObjNum 882 snap 300 seq_num 882) dirty exists 2020-11-16T22:11:43.150 INFO:tasks.rados.rados.2.smithi057.stdout:2607: left oid 14 (ObjNum 882 snap 300 seq_num 882) 2020-11-16T22:11:43.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:43 smithi057 bash[10301]: cluster 2020-11-16T22:11:41.775238+0000 mgr.x (mgr.24115) 572 : cluster [DBG] pgmap v1175: 17 pgs: 17 active+clean; 107 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 5.5 MiB/s wr, 28 op/s 2020-11-16T22:11:43.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:43 smithi057 bash[10301]: cluster 2020-11-16T22:11:42.121551+0000 mon.a (mon.0) 1344 : cluster [DBG] osdmap e674: 12 total, 12 up, 12 in 2020-11-16T22:11:43.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:43 smithi016 bash[10302]: cluster 2020-11-16T22:11:41.775238+0000 mgr.x (mgr.24115) 572 : cluster [DBG] pgmap v1175: 17 pgs: 17 active+clean; 107 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 5.5 MiB/s wr, 28 op/s 2020-11-16T22:11:43.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:43 smithi016 bash[10302]: cluster 2020-11-16T22:11:42.121551+0000 mon.a (mon.0) 1344 : cluster [DBG] osdmap e674: 12 total, 12 up, 12 in 2020-11-16T22:11:43.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:43 smithi195 bash[10218]: cluster 2020-11-16T22:11:41.775238+0000 mgr.x (mgr.24115) 572 : cluster [DBG] pgmap v1175: 17 pgs: 17 active+clean; 107 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 5.5 MiB/s wr, 28 op/s 2020-11-16T22:11:43.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:43 smithi195 bash[10218]: cluster 2020-11-16T22:11:42.121551+0000 mon.a (mon.0) 1344 : cluster [DBG] osdmap e674: 12 total, 12 up, 12 in 2020-11-16T22:11:44.138 INFO:tasks.rados.rados.2.smithi057.stdout:2607: done (1 left) 2020-11-16T22:11:44.138 INFO:tasks.rados.rados.2.smithi057.stdout:2608: done (0 left) 2020-11-16T22:11:44.138 INFO:tasks.rados.rados.2.smithi057.stdout:2609: snap_remove snap 298 2020-11-16T22:11:44.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:44 smithi057 bash[10301]: cluster 2020-11-16T22:11:43.131659+0000 mon.a (mon.0) 1345 : cluster [DBG] osdmap e675: 12 total, 12 up, 12 in 2020-11-16T22:11:44.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:44 smithi016 bash[10302]: cluster 2020-11-16T22:11:43.131659+0000 mon.a (mon.0) 1345 : cluster [DBG] osdmap e675: 12 total, 12 up, 12 in 2020-11-16T22:11:44.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:44 smithi195 bash[10218]: cluster 2020-11-16T22:11:43.131659+0000 mon.a (mon.0) 1345 : cluster [DBG] osdmap e675: 12 total, 12 up, 12 in 2020-11-16T22:11:45.095 INFO:tasks.rados.rados.2.smithi057.stdout:2609: done (0 left) 2020-11-16T22:11:45.095 INFO:tasks.rados.rados.2.smithi057.stdout:2610: snap_remove snap 300 2020-11-16T22:11:45.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:45 smithi057 bash[10301]: cluster 2020-11-16T22:11:43.775960+0000 mgr.x (mgr.24115) 573 : cluster [DBG] pgmap v1178: 17 pgs: 17 active+clean; 107 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 4.9 MiB/s wr, 28 op/s 2020-11-16T22:11:45.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:45 smithi057 bash[10301]: cluster 2020-11-16T22:11:44.143734+0000 mon.a (mon.0) 1346 : cluster [DBG] osdmap e676: 12 total, 12 up, 12 in 2020-11-16T22:11:45.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:45 smithi057 bash[10301]: cluster 2020-11-16T22:11:45.102015+0000 mon.a (mon.0) 1347 : cluster [DBG] osdmap e677: 12 total, 12 up, 12 in 2020-11-16T22:11:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:45 smithi016 bash[10302]: cluster 2020-11-16T22:11:43.775960+0000 mgr.x (mgr.24115) 573 : cluster [DBG] pgmap v1178: 17 pgs: 17 active+clean; 107 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 4.9 MiB/s wr, 28 op/s 2020-11-16T22:11:45.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:45 smithi016 bash[10302]: cluster 2020-11-16T22:11:44.143734+0000 mon.a (mon.0) 1346 : cluster [DBG] osdmap e676: 12 total, 12 up, 12 in 2020-11-16T22:11:45.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:45 smithi016 bash[10302]: cluster 2020-11-16T22:11:45.102015+0000 mon.a (mon.0) 1347 : cluster [DBG] osdmap e677: 12 total, 12 up, 12 in 2020-11-16T22:11:45.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:45 smithi195 bash[10218]: cluster 2020-11-16T22:11:43.775960+0000 mgr.x (mgr.24115) 573 : cluster [DBG] pgmap v1178: 17 pgs: 17 active+clean; 107 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 4.9 MiB/s wr, 28 op/s 2020-11-16T22:11:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:45 smithi195 bash[10218]: cluster 2020-11-16T22:11:44.143734+0000 mon.a (mon.0) 1346 : cluster [DBG] osdmap e676: 12 total, 12 up, 12 in 2020-11-16T22:11:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:45 smithi195 bash[10218]: cluster 2020-11-16T22:11:45.102015+0000 mon.a (mon.0) 1347 : cluster [DBG] osdmap e677: 12 total, 12 up, 12 in 2020-11-16T22:11:46.106 INFO:tasks.rados.rados.2.smithi057.stdout:2610: done (0 left) 2020-11-16T22:11:46.106 INFO:tasks.rados.rados.2.smithi057.stdout:2611: copy_from oid 12 from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 301 2020-11-16T22:11:46.107 INFO:tasks.rados.rados.2.smithi057.stdout:2612: snap_remove snap 299 2020-11-16T22:11:47.117 INFO:tasks.rados.rados.2.smithi057.stdout:2612: done (1 left) 2020-11-16T22:11:47.117 INFO:tasks.rados.rados.2.smithi057.stdout:2613: write (excl) oid 44 current snap is 301 2020-11-16T22:11:47.117 INFO:tasks.rados.rados.2.smithi057.stdout:2613: seq_num 883 ranges {440581=741815,1604306=656626,2732032=108549} 2020-11-16T22:11:47.130 INFO:tasks.rados.rados.2.smithi057.stdout:2613: writing smithi05720651-44 from 440581 to 1182396 tid 1 2020-11-16T22:11:47.136 INFO:tasks.rados.rados.2.smithi057.stdout:2613: writing smithi05720651-44 from 1604306 to 2260932 tid 2 2020-11-16T22:11:47.140 INFO:tasks.rados.rados.2.smithi057.stdout:2613: writing smithi05720651-44 from 2732032 to 2840581 tid 3 2020-11-16T22:11:47.141 INFO:tasks.rados.rados.2.smithi057.stdout:2614: read oid 10 snap -1 2020-11-16T22:11:47.141 INFO:tasks.rados.rados.2.smithi057.stdout:2614: expect (ObjNum 525 snap 188 seq_num 525) 2020-11-16T22:11:47.141 INFO:tasks.rados.rados.2.smithi057.stdout:2615: read oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:47.141 INFO:tasks.rados.rados.2.smithi057.stdout:2615: expect (ObjNum 805 snap 276 seq_num 805) 2020-11-16T22:11:47.142 INFO:tasks.rados.rados.2.smithi057.stdout:2616: read oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:47.142 INFO:tasks.rados.rados.2.smithi057.stdout:2616: expect (ObjNum 837 snap 289 seq_num 837) 2020-11-16T22:11:47.142 INFO:tasks.rados.rados.2.smithi057.stdout:2617: write oid 20 current snap is 301 2020-11-16T22:11:47.142 INFO:tasks.rados.rados.2.smithi057.stdout:2617: seq_num 884 ranges {457388=417064,1546435=516637,2643102=214286} 2020-11-16T22:11:47.146 INFO:tasks.rados.rados.2.smithi057.stdout:2617: writing smithi05720651-20 from 457388 to 874452 tid 1 2020-11-16T22:11:47.153 INFO:tasks.rados.rados.2.smithi057.stdout:2617: writing smithi05720651-20 from 1546435 to 2063072 tid 2 2020-11-16T22:11:47.159 INFO:tasks.rados.rados.2.smithi057.stdout:2617: writing smithi05720651-20 from 2643102 to 2857388 tid 3 2020-11-16T22:11:47.159 INFO:tasks.rados.rados.2.smithi057.stdout:2618: write oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 301 2020-11-16T22:11:47.159 INFO:tasks.rados.rados.2.smithi057.stdout:2618: seq_num 885 ranges {474195=492313,1604917=660295,2670525=203670} 2020-11-16T22:11:47.164 INFO:tasks.rados.rados.2.smithi057.stdout:2618: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 474195 to 966508 tid 1 2020-11-16T22:11:47.172 INFO:tasks.rados.rados.2.smithi057.stdout:2618: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1604917 to 2265212 tid 2 2020-11-16T22:11:47.175 INFO:tasks.rados.rados.2.smithi057.stdout:2618: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2670525 to 2874195 tid 3 2020-11-16T22:11:47.176 INFO:tasks.rados.rados.2.smithi057.stdout:2619: write oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 301 2020-11-16T22:11:47.176 INFO:tasks.rados.rados.2.smithi057.stdout:2619: seq_num 886 ranges {491002=567562,1663399=520306,2814301=76701} 2020-11-16T22:11:47.181 INFO:tasks.rados.rados.2.smithi057.stdout:2619: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 491002 to 1058564 tid 1 2020-11-16T22:11:47.188 INFO:tasks.rados.rados.2.smithi057.stdout:2619: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1663399 to 2183705 tid 2 2020-11-16T22:11:47.192 INFO:tasks.rados.rados.2.smithi057.stdout:2619: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2814301 to 2891002 tid 3 2020-11-16T22:11:47.192 INFO:tasks.rados.rados.2.smithi057.stdout:2620: delete oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 301 2020-11-16T22:11:47.193 INFO:tasks.rados.rados.2.smithi057.stdout:2611: finishing copy_from to smithi05720651-12 2020-11-16T22:11:47.193 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 1570 (ObjNum 816 snap 279 seq_num 816) dirty exists 2020-11-16T22:11:47.193 INFO:tasks.rados.rados.2.smithi057.stdout:2611: finishing copy_from racing read to smithi05720651-12 2020-11-16T22:11:47.193 INFO:tasks.rados.rados.2.smithi057.stdout:2613: finishing write tid 1 to smithi05720651-44 2020-11-16T22:11:47.193 INFO:tasks.rados.rados.2.smithi057.stdout:2614: expect (ObjNum 525 snap 188 seq_num 525) 2020-11-16T22:11:47.392 INFO:tasks.rados.rados.2.smithi057.stdout:2613: finishing write tid 2 to smithi05720651-44 2020-11-16T22:11:47.392 INFO:tasks.rados.rados.2.smithi057.stdout:2613: finishing write tid 3 to smithi05720651-44 2020-11-16T22:11:47.392 INFO:tasks.rados.rados.2.smithi057.stdout:2613: finishing write tid 5 to smithi05720651-44 2020-11-16T22:11:47.393 INFO:tasks.rados.rados.2.smithi057.stdout:2613: finishing write tid 6 to smithi05720651-44 2020-11-16T22:11:47.393 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 1574 (ObjNum 883 snap 301 seq_num 883) dirty exists 2020-11-16T22:11:47.393 INFO:tasks.rados.rados.2.smithi057.stdout:2613: left oid 44 (ObjNum 883 snap 301 seq_num 883) 2020-11-16T22:11:47.393 INFO:tasks.rados.rados.2.smithi057.stdout:2616: expect (ObjNum 837 snap 289 seq_num 837) 2020-11-16T22:11:47.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:47 smithi057 bash[10301]: cluster 2020-11-16T22:11:45.776713+0000 mgr.x (mgr.24115) 574 : cluster [DBG] pgmap v1181: 17 pgs: 17 active+clean; 107 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 320 KiB/s wr, 1 op/s 2020-11-16T22:11:47.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:47 smithi057 bash[10301]: cluster 2020-11-16T22:11:46.115692+0000 mon.a (mon.0) 1348 : cluster [DBG] osdmap e678: 12 total, 12 up, 12 in 2020-11-16T22:11:47.478 INFO:tasks.rados.rados.2.smithi057.stdout:2615: expect (ObjNum 805 snap 276 seq_num 805) 2020-11-16T22:11:47.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:47 smithi016 bash[10302]: cluster 2020-11-16T22:11:45.776713+0000 mgr.x (mgr.24115) 574 : cluster [DBG] pgmap v1181: 17 pgs: 17 active+clean; 107 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 320 KiB/s wr, 1 op/s 2020-11-16T22:11:47.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:47 smithi016 bash[10302]: cluster 2020-11-16T22:11:46.115692+0000 mon.a (mon.0) 1348 : cluster [DBG] osdmap e678: 12 total, 12 up, 12 in 2020-11-16T22:11:47.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:47 smithi195 bash[10218]: cluster 2020-11-16T22:11:45.776713+0000 mgr.x (mgr.24115) 574 : cluster [DBG] pgmap v1181: 17 pgs: 17 active+clean; 107 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 320 KiB/s wr, 1 op/s 2020-11-16T22:11:47.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:47 smithi195 bash[10218]: cluster 2020-11-16T22:11:46.115692+0000 mon.a (mon.0) 1348 : cluster [DBG] osdmap e678: 12 total, 12 up, 12 in 2020-11-16T22:11:47.631 INFO:tasks.rados.rados.2.smithi057.stdout:2617: finishing write tid 1 to smithi05720651-20 2020-11-16T22:11:47.631 INFO:tasks.rados.rados.2.smithi057.stdout:2617: finishing write tid 2 to smithi05720651-20 2020-11-16T22:11:47.632 INFO:tasks.rados.rados.2.smithi057.stdout:2617: finishing write tid 3 to smithi05720651-20 2020-11-16T22:11:47.632 INFO:tasks.rados.rados.2.smithi057.stdout:2617: finishing write tid 5 to smithi05720651-20 2020-11-16T22:11:47.632 INFO:tasks.rados.rados.2.smithi057.stdout:2617: finishing write tid 6 to smithi05720651-20 2020-11-16T22:11:47.632 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1785 (ObjNum 884 snap 301 seq_num 884) dirty exists 2020-11-16T22:11:47.632 INFO:tasks.rados.rados.2.smithi057.stdout:2617: left oid 20 (ObjNum 884 snap 301 seq_num 884) 2020-11-16T22:11:47.632 INFO:tasks.rados.rados.2.smithi057.stdout:2618: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.632 INFO:tasks.rados.rados.2.smithi057.stdout:2618: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.633 INFO:tasks.rados.rados.2.smithi057.stdout:2618: finishing write tid 3 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.633 INFO:tasks.rados.rados.2.smithi057.stdout:2618: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.633 INFO:tasks.rados.rados.2.smithi057.stdout:2618: finishing write tid 6 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.633 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1719 (ObjNum 885 snap 301 seq_num 885) dirty exists 2020-11-16T22:11:47.633 INFO:tasks.rados.rados.2.smithi057.stdout:2618: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 885 snap 301 seq_num 885) 2020-11-16T22:11:47.633 INFO:tasks.rados.rados.2.smithi057.stdout:2611: done (8 left) 2020-11-16T22:11:47.633 INFO:tasks.rados.rados.2.smithi057.stdout:2613: done (7 left) 2020-11-16T22:11:47.634 INFO:tasks.rados.rados.2.smithi057.stdout:2614: done (6 left) 2020-11-16T22:11:47.634 INFO:tasks.rados.rados.2.smithi057.stdout:2615: done (5 left) 2020-11-16T22:11:47.634 INFO:tasks.rados.rados.2.smithi057.stdout:2616: done (4 left) 2020-11-16T22:11:47.634 INFO:tasks.rados.rados.2.smithi057.stdout:2617: done (3 left) 2020-11-16T22:11:47.634 INFO:tasks.rados.rados.2.smithi057.stdout:2618: done (2 left) 2020-11-16T22:11:47.634 INFO:tasks.rados.rados.2.smithi057.stdout:2620: done (1 left) 2020-11-16T22:11:47.634 INFO:tasks.rados.rados.2.smithi057.stdout:2621: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:47.635 INFO:tasks.rados.rados.2.smithi057.stdout:2621: expect deleted 2020-11-16T22:11:47.635 INFO:tasks.rados.rados.2.smithi057.stdout:2619: finishing write tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.635 INFO:tasks.rados.rados.2.smithi057.stdout:2619: finishing write tid 2 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.635 INFO:tasks.rados.rados.2.smithi057.stdout:2619: finishing write tid 3 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.635 INFO:tasks.rados.rados.2.smithi057.stdout:2619: finishing write tid 5 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.635 INFO:tasks.rados.rados.2.smithi057.stdout:2619: finishing write tid 6 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.635 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1783 (ObjNum 886 snap 301 seq_num 886) dirty exists 2020-11-16T22:11:47.636 INFO:tasks.rados.rados.2.smithi057.stdout:2619: left oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 886 snap 301 seq_num 886) 2020-11-16T22:11:47.636 INFO:tasks.rados.rados.2.smithi057.stdout:2622: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:47.636 INFO:tasks.rados.rados.2.smithi057.stdout:2622: expect deleted 2020-11-16T22:11:47.636 INFO:tasks.rados.rados.2.smithi057.stdout:2619: done (2 left) 2020-11-16T22:11:47.636 INFO:tasks.rados.rados.2.smithi057.stdout:2623: write oid 42 current snap is 301 2020-11-16T22:11:47.636 INFO:tasks.rados.rados.2.smithi057.stdout:2623: seq_num 888 ranges {524616=718060,1664010=523975,2752794=171822} 2020-11-16T22:11:47.638 INFO:tasks.rados.rados.2.smithi057.stdout:2623: writing smithi05720651-42 from 524616 to 1242676 tid 1 2020-11-16T22:11:47.643 INFO:tasks.rados.rados.2.smithi057.stdout:2623: writing smithi05720651-42 from 1664010 to 2187985 tid 2 2020-11-16T22:11:47.648 INFO:tasks.rados.rados.2.smithi057.stdout:2623: writing smithi05720651-42 from 2752794 to 2924616 tid 3 2020-11-16T22:11:47.648 INFO:tasks.rados.rados.2.smithi057.stdout:2624: copy_from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 16 current snap is 301 2020-11-16T22:11:47.648 INFO:tasks.rados.rados.2.smithi057.stdout:2621: done (3 left) 2020-11-16T22:11:47.648 INFO:tasks.rados.rados.2.smithi057.stdout:2625: write (excl) oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 301 2020-11-16T22:11:47.648 INFO:tasks.rados.rados.2.smithi057.stdout:2625: seq_num 889 ranges {541423=793309,2122492=667633} 2020-11-16T22:11:47.655 INFO:tasks.rados.rados.2.smithi057.stdout:2625: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 541423 to 1334732 tid 1 2020-11-16T22:11:47.663 INFO:tasks.rados.rados.2.smithi057.stdout:2625: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2122492 to 2790125 tid 2 2020-11-16T22:11:47.663 INFO:tasks.rados.rados.2.smithi057.stdout:2626: write (excl) oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 301 2020-11-16T22:11:47.664 INFO:tasks.rados.rados.2.smithi057.stdout:2626: seq_num 890 ranges {558230=584911,1897327=527644,2923993=34237} 2020-11-16T22:11:47.669 INFO:tasks.rados.rados.2.smithi057.stdout:2626: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 558230 to 1143141 tid 1 2020-11-16T22:11:47.676 INFO:tasks.rados.rados.2.smithi057.stdout:2626: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1897327 to 2424971 tid 2 2020-11-16T22:11:47.680 INFO:tasks.rados.rados.2.smithi057.stdout:2626: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2923993 to 2958230 tid 3 2020-11-16T22:11:47.680 INFO:tasks.rados.rados.2.smithi057.stdout:2627: copy_from oid 8 from oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 301 2020-11-16T22:11:47.681 INFO:tasks.rados.rados.2.smithi057.stdout:2623: finishing write tid 1 to smithi05720651-42 2020-11-16T22:11:47.681 INFO:tasks.rados.rados.2.smithi057.stdout:2628: copy_from oid 48 from oid 38 current snap is 301 2020-11-16T22:11:47.681 INFO:tasks.rados.rados.2.smithi057.stdout:2623: finishing write tid 2 to smithi05720651-42 2020-11-16T22:11:47.681 INFO:tasks.rados.rados.2.smithi057.stdout:2623: finishing write tid 3 to smithi05720651-42 2020-11-16T22:11:47.681 INFO:tasks.rados.rados.2.smithi057.stdout:2623: finishing write tid 5 to smithi05720651-42 2020-11-16T22:11:47.681 INFO:tasks.rados.rados.2.smithi057.stdout:2623: finishing write tid 6 to smithi05720651-42 2020-11-16T22:11:47.681 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 1903 (ObjNum 888 snap 301 seq_num 888) dirty exists 2020-11-16T22:11:47.682 INFO:tasks.rados.rados.2.smithi057.stdout:2623: left oid 42 (ObjNum 888 snap 301 seq_num 888) 2020-11-16T22:11:47.682 INFO:tasks.rados.rados.2.smithi057.stdout:2623: done (6 left) 2020-11-16T22:11:47.682 INFO:tasks.rados.rados.2.smithi057.stdout:2629: rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 301 2020-11-16T22:11:47.682 INFO:tasks.rados.rados.2.smithi057.stdout:2629: done (6 left) 2020-11-16T22:11:47.682 INFO:tasks.rados.rados.2.smithi057.stdout:2630: read oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:47.682 INFO:tasks.rados.rados.2.smithi057.stdout:2630: expect deleted 2020-11-16T22:11:47.682 INFO:tasks.rados.rados.2.smithi057.stdout:2631: read oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:47.683 INFO:tasks.rados.rados.2.smithi057.stdout:2631: expect (ObjNum 800 snap 276 seq_num 800) 2020-11-16T22:11:47.683 INFO:tasks.rados.rados.2.smithi057.stdout:2632: delete oid 40 current snap is 301 2020-11-16T22:11:47.683 INFO:tasks.rados.rados.2.smithi057.stdout:2625: finishing write tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.683 INFO:tasks.rados.rados.2.smithi057.stdout:2624: finishing copy_from to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.683 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2066 (ObjNum 878 snap 296 seq_num 878) dirty exists 2020-11-16T22:11:47.683 INFO:tasks.rados.rados.2.smithi057.stdout:2624: finishing copy_from racing read to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.683 INFO:tasks.rados.rados.2.smithi057.stdout:2625: finishing write tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.684 INFO:tasks.rados.rados.2.smithi057.stdout:2625: finishing write tid 4 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.684 INFO:tasks.rados.rados.2.smithi057.stdout:2625: finishing write tid 5 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.684 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1866 (ObjNum 889 snap 301 seq_num 889) dirty exists 2020-11-16T22:11:47.684 INFO:tasks.rados.rados.2.smithi057.stdout:2625: left oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 889 snap 301 seq_num 889) 2020-11-16T22:11:47.684 INFO:tasks.rados.rados.2.smithi057.stdout:2626: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.685 INFO:tasks.rados.rados.2.smithi057.stdout:2622: done (8 left) 2020-11-16T22:11:47.685 INFO:tasks.rados.rados.2.smithi057.stdout:2624: done (7 left) 2020-11-16T22:11:47.686 INFO:tasks.rados.rados.2.smithi057.stdout:2625: done (6 left) 2020-11-16T22:11:47.686 INFO:tasks.rados.rados.2.smithi057.stdout:2630: done (5 left) 2020-11-16T22:11:47.686 INFO:tasks.rados.rados.2.smithi057.stdout:2632: done (4 left) 2020-11-16T22:11:47.686 INFO:tasks.rados.rados.2.smithi057.stdout:2633: write (excl) oid 40 current snap is 301 2020-11-16T22:11:47.686 INFO:tasks.rados.rados.2.smithi057.stdout:2633: seq_num 892 ranges {591844=735409,1897938=531313,2862486=129358} 2020-11-16T22:11:47.700 INFO:tasks.rados.rados.2.smithi057.stdout:2633: writing smithi05720651-40 from 591844 to 1327253 tid 1 2020-11-16T22:11:47.707 INFO:tasks.rados.rados.2.smithi057.stdout:2633: writing smithi05720651-40 from 1897938 to 2429251 tid 2 2020-11-16T22:11:47.710 INFO:tasks.rados.rados.2.smithi057.stdout:2633: writing smithi05720651-40 from 2862486 to 2991844 tid 3 2020-11-16T22:11:47.710 INFO:tasks.rados.rados.2.smithi057.stdout:2634: rollback oid 24 current snap is 301 2020-11-16T22:11:47.710 INFO:tasks.rados.rados.2.smithi057.stdout:2634: done (5 left) 2020-11-16T22:11:47.711 INFO:tasks.rados.rados.2.smithi057.stdout:2635: delete oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 301 2020-11-16T22:11:47.711 INFO:tasks.rados.rados.2.smithi057.stdout:2626: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.711 INFO:tasks.rados.rados.2.smithi057.stdout:2626: finishing write tid 3 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.711 INFO:tasks.rados.rados.2.smithi057.stdout:2626: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:47.711 INFO:tasks.rados.rados.2.smithi057.stdout:2631: expect (ObjNum 800 snap 276 seq_num 800) 2020-11-16T22:11:47.873 INFO:tasks.rados.rados.2.smithi057.stdout:2627: finishing copy_from to smithi05720651-8 2020-11-16T22:11:47.873 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 1561 (ObjNum 780 snap 271 seq_num 780) dirty exists 2020-11-16T22:11:47.874 INFO:tasks.rados.rados.2.smithi057.stdout:2627: finishing copy_from racing read to smithi05720651-8 2020-11-16T22:11:47.874 INFO:tasks.rados.rados.2.smithi057.stdout:2628: finishing copy_from to smithi05720651-48 2020-11-16T22:11:47.874 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 1768 (ObjNum 820 snap 281 seq_num 820) dirty exists 2020-11-16T22:11:47.874 INFO:tasks.rados.rados.2.smithi057.stdout:2628: finishing copy_from racing read to smithi05720651-48 2020-11-16T22:11:47.874 INFO:tasks.rados.rados.2.smithi057.stdout:2633: finishing write tid 1 to smithi05720651-40 2020-11-16T22:11:47.874 INFO:tasks.rados.rados.2.smithi057.stdout:2633: finishing write tid 2 to smithi05720651-40 2020-11-16T22:11:47.874 INFO:tasks.rados.rados.2.smithi057.stdout:2633: finishing write tid 3 to smithi05720651-40 2020-11-16T22:11:47.875 INFO:tasks.rados.rados.2.smithi057.stdout:2633: finishing write tid 5 to smithi05720651-40 2020-11-16T22:11:47.875 INFO:tasks.rados.rados.2.smithi057.stdout:2633: finishing write tid 6 to smithi05720651-40 2020-11-16T22:11:47.875 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 2176 (ObjNum 892 snap 301 seq_num 892) dirty exists 2020-11-16T22:11:47.875 INFO:tasks.rados.rados.2.smithi057.stdout:2633: left oid 40 (ObjNum 892 snap 301 seq_num 892) 2020-11-16T22:11:47.875 INFO:tasks.rados.rados.2.smithi057.stdout:2627: done (5 left) 2020-11-16T22:11:47.875 INFO:tasks.rados.rados.2.smithi057.stdout:2628: done (4 left) 2020-11-16T22:11:47.875 INFO:tasks.rados.rados.2.smithi057.stdout:2631: done (3 left) 2020-11-16T22:11:47.876 INFO:tasks.rados.rados.2.smithi057.stdout:2633: done (2 left) 2020-11-16T22:11:47.876 INFO:tasks.rados.rados.2.smithi057.stdout:2635: done (1 left) 2020-11-16T22:11:47.876 INFO:tasks.rados.rados.2.smithi057.stdout:2636: copy_from oid 44 from oid 38 current snap is 301 2020-11-16T22:11:47.876 INFO:tasks.rados.rados.2.smithi057.stdout:2637: read oid 12 snap -1 2020-11-16T22:11:47.876 INFO:tasks.rados.rados.2.smithi057.stdout:2637: expect (ObjNum 816 snap 279 seq_num 816) 2020-11-16T22:11:47.876 INFO:tasks.rados.rados.2.smithi057.stdout:2638: snap_create 2020-11-16T22:11:47.884 INFO:tasks.rados.rados.2.smithi057.stdout:2637: expect (ObjNum 816 snap 279 seq_num 816) 2020-11-16T22:11:48.148 INFO:tasks.rados.rados.2.smithi057.stdout:2636: finishing copy_from to smithi05720651-44 2020-11-16T22:11:48.149 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 1768 (ObjNum 820 snap 281 seq_num 820) dirty exists 2020-11-16T22:11:48.149 INFO:tasks.rados.rados.2.smithi057.stdout:2636: finishing copy_from racing read to smithi05720651-44 2020-11-16T22:11:48.149 INFO:tasks.rados.rados.2.smithi057.stdout:2626: finishing write tid 6 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:48.149 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1764 (ObjNum 890 snap 301 seq_num 890) dirty exists 2020-11-16T22:11:48.149 INFO:tasks.rados.rados.2.smithi057.stdout:2626: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 890 snap 301 seq_num 890) 2020-11-16T22:11:48.150 INFO:tasks.rados.rados.2.smithi057.stdout:2626: done (3 left) 2020-11-16T22:11:48.150 INFO:tasks.rados.rados.2.smithi057.stdout:2636: done (2 left) 2020-11-16T22:11:48.150 INFO:tasks.rados.rados.2.smithi057.stdout:2637: done (1 left) 2020-11-16T22:11:48.150 INFO:tasks.rados.rados.2.smithi057.stdout:2638: done (0 left) 2020-11-16T22:11:48.150 INFO:tasks.rados.rados.2.smithi057.stdout:2639: read oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:48.150 INFO:tasks.rados.rados.2.smithi057.stdout:2639: expect deleted 2020-11-16T22:11:48.150 INFO:tasks.rados.rados.2.smithi057.stdout:2640: read oid 38 snap -1 2020-11-16T22:11:48.151 INFO:tasks.rados.rados.2.smithi057.stdout:2640: expect (ObjNum 820 snap 281 seq_num 820) 2020-11-16T22:11:48.151 INFO:tasks.rados.rados.2.smithi057.stdout:2641: snap_create 2020-11-16T22:11:48.166 INFO:tasks.rados.rados.2.smithi057.stdout:2640: expect (ObjNum 820 snap 281 seq_num 820) 2020-11-16T22:11:48.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:48 smithi057 bash[10301]: cluster 2020-11-16T22:11:47.125340+0000 mon.a (mon.0) 1349 : cluster [DBG] osdmap e679: 12 total, 12 up, 12 in 2020-11-16T22:11:48.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:48 smithi016 bash[10302]: cluster 2020-11-16T22:11:47.125340+0000 mon.a (mon.0) 1349 : cluster [DBG] osdmap e679: 12 total, 12 up, 12 in 2020-11-16T22:11:48.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:48 smithi195 bash[10218]: cluster 2020-11-16T22:11:47.125340+0000 mon.a (mon.0) 1349 : cluster [DBG] osdmap e679: 12 total, 12 up, 12 in 2020-11-16T22:11:49.135 INFO:tasks.rados.rados.2.smithi057.stdout:2639: done (2 left) 2020-11-16T22:11:49.135 INFO:tasks.rados.rados.2.smithi057.stdout:2640: done (1 left) 2020-11-16T22:11:49.135 INFO:tasks.rados.rados.2.smithi057.stdout:2641: done (0 left) 2020-11-16T22:11:49.135 INFO:tasks.rados.rados.2.smithi057.stdout:2642: delete oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 303 2020-11-16T22:11:49.142 INFO:tasks.rados.rados.2.smithi057.stdout:2642: done (0 left) 2020-11-16T22:11:49.142 INFO:tasks.rados.rados.2.smithi057.stdout:2643: write oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 303 2020-11-16T22:11:49.143 INFO:tasks.rados.rados.2.smithi057.stdout:2643: seq_num 895 ranges {642265=561156,1673384=678640,2828402=213863} 2020-11-16T22:11:49.157 INFO:tasks.rados.rados.2.smithi057.stdout:2643: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 642265 to 1203421 tid 1 2020-11-16T22:11:49.164 INFO:tasks.rados.rados.2.smithi057.stdout:2643: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1673384 to 2352024 tid 2 2020-11-16T22:11:49.168 INFO:tasks.rados.rados.2.smithi057.stdout:2643: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2828402 to 3042265 tid 3 2020-11-16T22:11:49.169 INFO:tasks.rados.rados.2.smithi057.stdout:2644: snap_remove snap 301 2020-11-16T22:11:49.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:49 smithi057 bash[10301]: cluster 2020-11-16T22:11:47.777463+0000 mgr.x (mgr.24115) 575 : cluster [DBG] pgmap v1184: 17 pgs: 17 active+clean; 108 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 598 KiB/s wr, 5 op/s 2020-11-16T22:11:49.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:49 smithi057 bash[10301]: cluster 2020-11-16T22:11:48.134665+0000 mon.a (mon.0) 1350 : cluster [DBG] osdmap e680: 12 total, 12 up, 12 in 2020-11-16T22:11:49.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:49 smithi016 bash[10302]: cluster 2020-11-16T22:11:47.777463+0000 mgr.x (mgr.24115) 575 : cluster [DBG] pgmap v1184: 17 pgs: 17 active+clean; 108 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 598 KiB/s wr, 5 op/s 2020-11-16T22:11:49.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:49 smithi016 bash[10302]: cluster 2020-11-16T22:11:48.134665+0000 mon.a (mon.0) 1350 : cluster [DBG] osdmap e680: 12 total, 12 up, 12 in 2020-11-16T22:11:49.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:49 smithi195 bash[10218]: cluster 2020-11-16T22:11:47.777463+0000 mgr.x (mgr.24115) 575 : cluster [DBG] pgmap v1184: 17 pgs: 17 active+clean; 108 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 598 KiB/s wr, 5 op/s 2020-11-16T22:11:49.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:49 smithi195 bash[10218]: cluster 2020-11-16T22:11:48.134665+0000 mon.a (mon.0) 1350 : cluster [DBG] osdmap e680: 12 total, 12 up, 12 in 2020-11-16T22:11:50.094 INFO:tasks.rados.rados.2.smithi057.stdout:2644: done (1 left) 2020-11-16T22:11:50.095 INFO:tasks.rados.rados.2.smithi057.stdout:2645: write (excl) oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 303 2020-11-16T22:11:50.095 INFO:tasks.rados.rados.2.smithi057.stdout:2645: seq_num 896 ranges {659072=636405,1731866=422298,2855825=203247} 2020-11-16T22:11:50.108 INFO:tasks.rados.rados.2.smithi057.stdout:2645: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 659072 to 1295477 tid 1 2020-11-16T22:11:50.114 INFO:tasks.rados.rados.2.smithi057.stdout:2645: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1731866 to 2154164 tid 2 2020-11-16T22:11:50.119 INFO:tasks.rados.rados.2.smithi057.stdout:2645: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2855825 to 3059072 tid 3 2020-11-16T22:11:50.120 INFO:tasks.rados.rados.2.smithi057.stdout:2646: delete oid 34 current snap is 303 2020-11-16T22:11:50.120 INFO:tasks.rados.rados.2.smithi057.stdout:2643: finishing write tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:50.120 INFO:tasks.rados.rados.2.smithi057.stdout:2643: finishing write tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:50.120 INFO:tasks.rados.rados.2.smithi057.stdout:2643: finishing write tid 3 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:50.120 INFO:tasks.rados.rados.2.smithi057.stdout:2643: finishing write tid 5 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:50.120 INFO:tasks.rados.rados.2.smithi057.stdout:2643: finishing write tid 6 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:50.121 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1574 (ObjNum 895 snap 303 seq_num 895) dirty exists 2020-11-16T22:11:50.121 INFO:tasks.rados.rados.2.smithi057.stdout:2643: left oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 895 snap 303 seq_num 895) 2020-11-16T22:11:50.121 INFO:tasks.rados.rados.2.smithi057.stdout:2645: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:50.121 INFO:tasks.rados.rados.2.smithi057.stdout:2645: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:50.124 INFO:tasks.rados.rados.2.smithi057.stdout:2645: finishing write tid 3 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:50.125 INFO:tasks.rados.rados.2.smithi057.stdout:2645: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:50.125 INFO:tasks.rados.rados.2.smithi057.stdout:2645: finishing write tid 6 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:50.125 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1768 (ObjNum 896 snap 303 seq_num 896) dirty exists 2020-11-16T22:11:50.125 INFO:tasks.rados.rados.2.smithi057.stdout:2645: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 896 snap 303 seq_num 896) 2020-11-16T22:11:50.127 INFO:tasks.rados.rados.2.smithi057.stdout:2643: done (2 left) 2020-11-16T22:11:50.127 INFO:tasks.rados.rados.2.smithi057.stdout:2645: done (1 left) 2020-11-16T22:11:50.127 INFO:tasks.rados.rados.2.smithi057.stdout:2646: done (0 left) 2020-11-16T22:11:50.128 INFO:tasks.rados.rados.2.smithi057.stdout:2647: read oid 16 snap -1 2020-11-16T22:11:50.128 INFO:tasks.rados.rados.2.smithi057.stdout:2647: expect (ObjNum 878 snap 296 seq_num 878) 2020-11-16T22:11:50.128 INFO:tasks.rados.rados.2.smithi057.stdout:2648: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:50.128 INFO:tasks.rados.rados.2.smithi057.stdout:2648: expect deleted 2020-11-16T22:11:50.128 INFO:tasks.rados.rados.2.smithi057.stdout:2649: copy_from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 303 2020-11-16T22:11:50.128 INFO:tasks.rados.rados.2.smithi057.stdout:2650: write oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 303 2020-11-16T22:11:50.128 INFO:tasks.rados.rados.2.smithi057.stdout:2650: seq_num 898 ranges {692686=503256,1848830=425967,2910671=182015} 2020-11-16T22:11:50.134 INFO:tasks.rados.rados.2.smithi057.stdout:2650: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 692686 to 1195942 tid 1 2020-11-16T22:11:50.141 INFO:tasks.rados.rados.2.smithi057.stdout:2650: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1848830 to 2274797 tid 2 2020-11-16T22:11:50.146 INFO:tasks.rados.rados.2.smithi057.stdout:2650: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2910671 to 3092686 tid 3 2020-11-16T22:11:50.146 INFO:tasks.rados.rados.2.smithi057.stdout:2651: snap_remove snap 302 2020-11-16T22:11:50.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:50 smithi057 bash[10301]: cluster 2020-11-16T22:11:49.144674+0000 mon.a (mon.0) 1351 : cluster [DBG] osdmap e681: 12 total, 12 up, 12 in 2020-11-16T22:11:50.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:50 smithi057 bash[10301]: cluster 2020-11-16T22:11:50.103242+0000 mon.a (mon.0) 1352 : cluster [DBG] osdmap e682: 12 total, 12 up, 12 in 2020-11-16T22:11:50.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:50 smithi016 bash[10302]: cluster 2020-11-16T22:11:49.144674+0000 mon.a (mon.0) 1351 : cluster [DBG] osdmap e681: 12 total, 12 up, 12 in 2020-11-16T22:11:50.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:50 smithi016 bash[10302]: cluster 2020-11-16T22:11:50.103242+0000 mon.a (mon.0) 1352 : cluster [DBG] osdmap e682: 12 total, 12 up, 12 in 2020-11-16T22:11:50.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:50 smithi195 bash[10218]: cluster 2020-11-16T22:11:49.144674+0000 mon.a (mon.0) 1351 : cluster [DBG] osdmap e681: 12 total, 12 up, 12 in 2020-11-16T22:11:50.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:50 smithi195 bash[10218]: cluster 2020-11-16T22:11:50.103242+0000 mon.a (mon.0) 1352 : cluster [DBG] osdmap e682: 12 total, 12 up, 12 in 2020-11-16T22:11:51.162 INFO:tasks.rados.rados.2.smithi057.stdout:2651: done (4 left) 2020-11-16T22:11:51.163 INFO:tasks.rados.rados.2.smithi057.stdout:2652: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:51.163 INFO:tasks.rados.rados.2.smithi057.stdout:2652: expect (ObjNum 895 snap 303 seq_num 895) 2020-11-16T22:11:51.163 INFO:tasks.rados.rados.2.smithi057.stdout:2653: write oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 303 2020-11-16T22:11:51.163 INFO:tasks.rados.rados.2.smithi057.stdout:2653: seq_num 899 ranges {709493=578505,1907312=685978} 2020-11-16T22:11:51.178 INFO:tasks.rados.rados.2.smithi057.stdout:2653: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 709493 to 1287998 tid 1 2020-11-16T22:11:51.186 INFO:tasks.rados.rados.2.smithi057.stdout:2653: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1907312 to 2593290 tid 2 2020-11-16T22:11:51.186 INFO:tasks.rados.rados.2.smithi057.stdout:2654: rollback oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 303 2020-11-16T22:11:51.186 INFO:tasks.rados.rados.2.smithi057.stdout:2654: done (6 left) 2020-11-16T22:11:51.186 INFO:tasks.rados.rados.2.smithi057.stdout:2655: delete oid 18 current snap is 303 2020-11-16T22:11:51.187 INFO:tasks.rados.rados.2.smithi057.stdout:2647: expect (ObjNum 878 snap 296 seq_num 878) 2020-11-16T22:11:51.380 INFO:tasks.rados.rados.2.smithi057.stdout:2650: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:51.380 INFO:tasks.rados.rados.2.smithi057.stdout:2650: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:51.381 INFO:tasks.rados.rados.2.smithi057.stdout:2650: finishing write tid 3 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:51.381 INFO:tasks.rados.rados.2.smithi057.stdout:2650: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:51.381 INFO:tasks.rados.rados.2.smithi057.stdout:2650: finishing write tid 6 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:51.381 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1723 (ObjNum 898 snap 303 seq_num 898) dirty exists 2020-11-16T22:11:51.381 INFO:tasks.rados.rados.2.smithi057.stdout:2650: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 898 snap 303 seq_num 898) 2020-11-16T22:11:51.381 INFO:tasks.rados.rados.2.smithi057.stdout:2649: finishing copy_from to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:51.382 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2066 (ObjNum 878 snap 296 seq_num 878) dirty exists 2020-11-16T22:11:51.382 INFO:tasks.rados.rados.2.smithi057.stdout:2649: finishing copy_from racing read to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:51.382 INFO:tasks.rados.rados.2.smithi057.stdout:2652: expect (ObjNum 895 snap 303 seq_num 895) 2020-11-16T22:11:51.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:51 smithi057 bash[10301]: cluster 2020-11-16T22:11:49.778165+0000 mgr.x (mgr.24115) 576 : cluster [DBG] pgmap v1187: 17 pgs: 17 active+clean; 110 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.1 MiB/s wr, 14 op/s 2020-11-16T22:11:51.511 INFO:tasks.rados.rados.2.smithi057.stdout:2653: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:51.512 INFO:tasks.rados.rados.2.smithi057.stdout:2653: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:51.512 INFO:tasks.rados.rados.2.smithi057.stdout:2653: finishing write tid 4 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:51.512 INFO:tasks.rados.rados.2.smithi057.stdout:2653: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:51.512 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1963 (ObjNum 899 snap 303 seq_num 899) dirty exists 2020-11-16T22:11:51.512 INFO:tasks.rados.rados.2.smithi057.stdout:2653: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 899 snap 303 seq_num 899) 2020-11-16T22:11:51.513 INFO:tasks.rados.rados.2.smithi057.stdout:2647: done (6 left) 2020-11-16T22:11:51.513 INFO:tasks.rados.rados.2.smithi057.stdout:2648: done (5 left) 2020-11-16T22:11:51.513 INFO:tasks.rados.rados.2.smithi057.stdout:2649: done (4 left) 2020-11-16T22:11:51.513 INFO:tasks.rados.rados.2.smithi057.stdout:2650: done (3 left) 2020-11-16T22:11:51.513 INFO:tasks.rados.rados.2.smithi057.stdout:2652: done (2 left) 2020-11-16T22:11:51.513 INFO:tasks.rados.rados.2.smithi057.stdout:2653: done (1 left) 2020-11-16T22:11:51.514 INFO:tasks.rados.rados.2.smithi057.stdout:2655: done (0 left) 2020-11-16T22:11:51.514 INFO:tasks.rados.rados.2.smithi057.stdout:2656: write (excl) oid 42 current snap is 303 2020-11-16T22:11:51.514 INFO:tasks.rados.rados.2.smithi057.stdout:2656: seq_num 901 ranges {743107=729003,1907923=689647} 2020-11-16T22:11:51.527 INFO:tasks.rados.rados.2.smithi057.stdout:2656: writing smithi05720651-42 from 743107 to 1472110 tid 1 2020-11-16T22:11:51.535 INFO:tasks.rados.rados.2.smithi057.stdout:2656: writing smithi05720651-42 from 1907923 to 2597570 tid 2 2020-11-16T22:11:51.535 INFO:tasks.rados.rados.2.smithi057.stdout:2657: snap_create 2020-11-16T22:11:51.537 INFO:tasks.rados.rados.2.smithi057.stdout:2656: finishing write tid 1 to smithi05720651-42 2020-11-16T22:11:51.541 INFO:tasks.rados.rados.2.smithi057.stdout:2656: finishing write tid 2 to smithi05720651-42 2020-11-16T22:11:51.542 INFO:tasks.rados.rados.2.smithi057.stdout:2656: finishing write tid 4 to smithi05720651-42 2020-11-16T22:11:51.542 INFO:tasks.rados.rados.2.smithi057.stdout:2656: finishing write tid 5 to smithi05720651-42 2020-11-16T22:11:51.542 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 1906 (ObjNum 901 snap 303 seq_num 901) dirty exists 2020-11-16T22:11:51.543 INFO:tasks.rados.rados.2.smithi057.stdout:2656: left oid 42 (ObjNum 901 snap 303 seq_num 901) 2020-11-16T22:11:51.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:51 smithi016 bash[10302]: cluster 2020-11-16T22:11:49.778165+0000 mgr.x (mgr.24115) 576 : cluster [DBG] pgmap v1187: 17 pgs: 17 active+clean; 110 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.1 MiB/s wr, 14 op/s 2020-11-16T22:11:51.587 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 22:11:51 smithi016 bash[17468]: debug 2020-11-16T22:11:51.197+0000 7fd65f6d4700 -1 osd.6 pg_epoch: 683 pg[2.7( v 682'859 (0'0,682'859] local-lis/les=71/72 n=4 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [6,10] r=0 lpr=71 crt=682'859 lcod 681'857 mlcod 681'857 active+clean+snaptrim trimq=[25d~1] ps=[256~3,25c~1]] removing snap head 2020-11-16T22:11:51.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:51 smithi195 bash[10218]: cluster 2020-11-16T22:11:49.778165+0000 mgr.x (mgr.24115) 576 : cluster [DBG] pgmap v1187: 17 pgs: 17 active+clean; 110 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.1 MiB/s wr, 14 op/s 2020-11-16T22:11:51.944 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:11:51 smithi057 bash[19569]: debug 2020-11-16T22:11:51.595+0000 7f5e12117700 -1 osd.11 pg_epoch: 683 pg[2.a( v 682'768 (0'0,682'768] local-lis/les=71/72 n=3 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [11,3] r=0 lpr=71 crt=682'768 lcod 679'766 mlcod 679'766 active+clean+snaptrim trimq=[25d~1] ps=[256~3,25c~1]] removing snap head 2020-11-16T22:11:52.172 INFO:tasks.rados.rados.2.smithi057.stdout:2656: done (1 left) 2020-11-16T22:11:52.172 INFO:tasks.rados.rados.2.smithi057.stdout:2657: done (0 left) 2020-11-16T22:11:52.173 INFO:tasks.rados.rados.2.smithi057.stdout:2658: read oid 8 snap -1 2020-11-16T22:11:52.173 INFO:tasks.rados.rados.2.smithi057.stdout:2658: expect (ObjNum 780 snap 271 seq_num 780) 2020-11-16T22:11:52.173 INFO:tasks.rados.rados.2.smithi057.stdout:2659: snap_create 2020-11-16T22:11:52.189 INFO:tasks.rados.rados.2.smithi057.stdout:2658: expect (ObjNum 780 snap 271 seq_num 780) 2020-11-16T22:11:52.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:52 smithi057 bash[10301]: cluster 2020-11-16T22:11:51.166340+0000 mon.a (mon.0) 1353 : cluster [DBG] osdmap e683: 12 total, 12 up, 12 in 2020-11-16T22:11:52.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:52 smithi016 bash[10302]: cluster 2020-11-16T22:11:51.166340+0000 mon.a (mon.0) 1353 : cluster [DBG] osdmap e683: 12 total, 12 up, 12 in 2020-11-16T22:11:52.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:52 smithi195 bash[10218]: cluster 2020-11-16T22:11:51.166340+0000 mon.a (mon.0) 1353 : cluster [DBG] osdmap e683: 12 total, 12 up, 12 in 2020-11-16T22:11:53.172 INFO:tasks.rados.rados.2.smithi057.stdout:2658: done (1 left) 2020-11-16T22:11:53.172 INFO:tasks.rados.rados.2.smithi057.stdout:2659: done (0 left) 2020-11-16T22:11:53.173 INFO:tasks.rados.rados.2.smithi057.stdout:2660: copy_from oid 2 from oid 46 current snap is 305 2020-11-16T22:11:53.173 INFO:tasks.rados.rados.2.smithi057.stdout:2661: copy_from oid 6 from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 305 2020-11-16T22:11:53.173 INFO:tasks.rados.rados.2.smithi057.stdout:2662: read oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:53.173 INFO:tasks.rados.rados.2.smithi057.stdout:2662: expect (ObjNum 860 snap 294 seq_num 860) 2020-11-16T22:11:53.173 INFO:tasks.rados.rados.2.smithi057.stdout:2663: write oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 305 2020-11-16T22:11:53.173 INFO:tasks.rados.rados.2.smithi057.stdout:2663: seq_num 902 ranges {759914=404252,1566405=433305,2504010=655904} 2020-11-16T22:11:53.185 INFO:tasks.rados.rados.2.smithi057.stdout:2663: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 759914 to 1164166 tid 1 2020-11-16T22:11:53.190 INFO:tasks.rados.rados.2.smithi057.stdout:2663: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1566405 to 1999710 tid 2 2020-11-16T22:11:53.197 INFO:tasks.rados.rados.2.smithi057.stdout:2663: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2504010 to 3159914 tid 3 2020-11-16T22:11:53.197 INFO:tasks.rados.rados.2.smithi057.stdout:2664: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:53.198 INFO:tasks.rados.rados.2.smithi057.stdout:2664: expect (ObjNum 837 snap 289 seq_num 837) 2020-11-16T22:11:53.198 INFO:tasks.rados.rados.2.smithi057.stdout:2665: write (excl) oid 40 current snap is 305 2020-11-16T22:11:53.198 INFO:tasks.rados.rados.2.smithi057.stdout:2665: seq_num 903 ranges {776721=479501,2024887=693316} 2020-11-16T22:11:53.205 INFO:tasks.rados.rados.2.smithi057.stdout:2665: writing smithi05720651-40 from 776721 to 1256222 tid 1 2020-11-16T22:11:53.213 INFO:tasks.rados.rados.2.smithi057.stdout:2665: writing smithi05720651-40 from 2024887 to 2718203 tid 2 2020-11-16T22:11:53.214 INFO:tasks.rados.rados.2.smithi057.stdout:2666: rollback oid 48 current snap is 305 2020-11-16T22:11:53.214 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 48 to 304 2020-11-16T22:11:53.214 INFO:tasks.rados.rados.2.smithi057.stdout:2662: expect (ObjNum 860 snap 294 seq_num 860) 2020-11-16T22:11:53.359 INFO:tasks.rados.rados.2.smithi057.stdout:2663: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:53.359 INFO:tasks.rados.rados.2.smithi057.stdout:2663: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:53.359 INFO:tasks.rados.rados.2.smithi057.stdout:2660: finishing copy_from to smithi05720651-2 2020-11-16T22:11:53.360 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 2054 (ObjNum 857 snap 289 seq_num 857) dirty exists 2020-11-16T22:11:53.360 INFO:tasks.rados.rados.2.smithi057.stdout:2663: finishing write tid 3 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:53.360 INFO:tasks.rados.rados.2.smithi057.stdout:2660: finishing copy_from racing read to smithi05720651-2 2020-11-16T22:11:53.360 INFO:tasks.rados.rados.2.smithi057.stdout:2663: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:53.360 INFO:tasks.rados.rados.2.smithi057.stdout:2660: done (6 left) 2020-11-16T22:11:53.361 INFO:tasks.rados.rados.2.smithi057.stdout:2662: done (5 left) 2020-11-16T22:11:53.361 INFO:tasks.rados.rados.2.smithi057.stdout:2667: rollback oid 24 current snap is 305 2020-11-16T22:11:53.361 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 24 to 303 2020-11-16T22:11:53.361 INFO:tasks.rados.rados.2.smithi057.stdout:2663: finishing write tid 6 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:53.361 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1772 (ObjNum 902 snap 305 seq_num 902) dirty exists 2020-11-16T22:11:53.362 INFO:tasks.rados.rados.2.smithi057.stdout:2663: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 902 snap 305 seq_num 902) 2020-11-16T22:11:53.362 INFO:tasks.rados.rados.2.smithi057.stdout:2664: expect (ObjNum 837 snap 289 seq_num 837) 2020-11-16T22:11:53.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:53 smithi057 bash[10301]: cluster 2020-11-16T22:11:51.778903+0000 mgr.x (mgr.24115) 577 : cluster [DBG] pgmap v1190: 17 pgs: 17 active+clean; 114 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 7.1 MiB/s wr, 35 op/s 2020-11-16T22:11:53.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:53 smithi057 bash[10301]: cluster 2020-11-16T22:11:52.175619+0000 mon.a (mon.0) 1354 : cluster [DBG] osdmap e684: 12 total, 12 up, 12 in 2020-11-16T22:11:53.445 INFO:tasks.rados.rados.2.smithi057.stdout:2661: finishing copy_from to smithi05720651-6 2020-11-16T22:11:53.446 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 2063 (ObjNum 877 snap 296 seq_num 877) dirty exists 2020-11-16T22:11:53.446 INFO:tasks.rados.rados.2.smithi057.stdout:2661: finishing copy_from racing read to smithi05720651-6 2020-11-16T22:11:53.446 INFO:tasks.rados.rados.2.smithi057.stdout:2665: finishing write tid 1 to smithi05720651-40 2020-11-16T22:11:53.446 INFO:tasks.rados.rados.2.smithi057.stdout:2666: finishing rollback tid 0 to smithi05720651-48 2020-11-16T22:11:53.446 INFO:tasks.rados.rados.2.smithi057.stdout:2666: finishing rollback tid 1 to smithi05720651-48 2020-11-16T22:11:53.446 INFO:tasks.rados.rados.2.smithi057.stdout:2666: finishing rollback tid 2 to smithi05720651-48 2020-11-16T22:11:53.447 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 1771 (ObjNum 820 snap 281 seq_num 820) dirty exists 2020-11-16T22:11:53.447 INFO:tasks.rados.rados.2.smithi057.stdout:2665: finishing write tid 2 to smithi05720651-40 2020-11-16T22:11:53.447 INFO:tasks.rados.rados.2.smithi057.stdout:2665: finishing write tid 4 to smithi05720651-40 2020-11-16T22:11:53.447 INFO:tasks.rados.rados.2.smithi057.stdout:2665: finishing write tid 5 to smithi05720651-40 2020-11-16T22:11:53.447 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 2181 (ObjNum 903 snap 305 seq_num 903) dirty exists 2020-11-16T22:11:53.447 INFO:tasks.rados.rados.2.smithi057.stdout:2665: left oid 40 (ObjNum 903 snap 305 seq_num 903) 2020-11-16T22:11:53.447 INFO:tasks.rados.rados.2.smithi057.stdout:2667: finishing rollback tid 1 to smithi05720651-24 2020-11-16T22:11:53.447 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 0 (ObjNum 353 snap 0 seq_num 1953066355) dirty dne 2020-11-16T22:11:53.448 INFO:tasks.rados.rados.2.smithi057.stdout:2661: done (5 left) 2020-11-16T22:11:53.448 INFO:tasks.rados.rados.2.smithi057.stdout:2663: done (4 left) 2020-11-16T22:11:53.448 INFO:tasks.rados.rados.2.smithi057.stdout:2664: done (3 left) 2020-11-16T22:11:53.448 INFO:tasks.rados.rados.2.smithi057.stdout:2665: done (2 left) 2020-11-16T22:11:53.448 INFO:tasks.rados.rados.2.smithi057.stdout:2666: done (1 left) 2020-11-16T22:11:53.448 INFO:tasks.rados.rados.2.smithi057.stdout:2667: done (0 left) 2020-11-16T22:11:53.448 INFO:tasks.rados.rados.2.smithi057.stdout:2668: copy_from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 305 2020-11-16T22:11:53.449 INFO:tasks.rados.rados.2.smithi057.stdout:2669: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 304 2020-11-16T22:11:53.449 INFO:tasks.rados.rados.2.smithi057.stdout:2669: expect (ObjNum 804 snap 276 seq_num 804) 2020-11-16T22:11:53.449 INFO:tasks.rados.rados.2.smithi057.stdout:2670: rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 305 2020-11-16T22:11:53.449 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 304 2020-11-16T22:11:53.449 INFO:tasks.rados.rados.2.smithi057.stdout:2671: snap_create 2020-11-16T22:11:53.455 INFO:tasks.rados.rados.2.smithi057.stdout:2670: finishing rollback tid 0 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:53.455 INFO:tasks.rados.rados.2.smithi057.stdout:2670: finishing rollback tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:53.456 INFO:tasks.rados.rados.2.smithi057.stdout:2670: finishing rollback tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:53.456 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2069 (ObjNum 877 snap 296 seq_num 877) dirty exists 2020-11-16T22:11:53.468 INFO:tasks.rados.rados.2.smithi057.stdout:2669: expect (ObjNum 804 snap 276 seq_num 804) 2020-11-16T22:11:53.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:53 smithi016 bash[10302]: cluster 2020-11-16T22:11:51.778903+0000 mgr.x (mgr.24115) 577 : cluster [DBG] pgmap v1190: 17 pgs: 17 active+clean; 114 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 7.1 MiB/s wr, 35 op/s 2020-11-16T22:11:53.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:53 smithi016 bash[10302]: cluster 2020-11-16T22:11:52.175619+0000 mon.a (mon.0) 1354 : cluster [DBG] osdmap e684: 12 total, 12 up, 12 in 2020-11-16T22:11:53.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:53 smithi195 bash[10218]: cluster 2020-11-16T22:11:51.778903+0000 mgr.x (mgr.24115) 577 : cluster [DBG] pgmap v1190: 17 pgs: 17 active+clean; 114 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 7.1 MiB/s wr, 35 op/s 2020-11-16T22:11:53.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:53 smithi195 bash[10218]: cluster 2020-11-16T22:11:52.175619+0000 mon.a (mon.0) 1354 : cluster [DBG] osdmap e684: 12 total, 12 up, 12 in 2020-11-16T22:11:53.626 INFO:tasks.rados.rados.2.smithi057.stdout:2668: finishing copy_from to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:53.626 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2162 (ObjNum 876 snap 296 seq_num 876) dirty exists 2020-11-16T22:11:53.627 INFO:tasks.rados.rados.2.smithi057.stdout:2668: finishing copy_from racing read to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:54.190 INFO:tasks.rados.rados.2.smithi057.stdout:2668: done (3 left) 2020-11-16T22:11:54.191 INFO:tasks.rados.rados.2.smithi057.stdout:2669: done (2 left) 2020-11-16T22:11:54.191 INFO:tasks.rados.rados.2.smithi057.stdout:2670: done (1 left) 2020-11-16T22:11:54.191 INFO:tasks.rados.rados.2.smithi057.stdout:2671: done (0 left) 2020-11-16T22:11:54.191 INFO:tasks.rados.rados.2.smithi057.stdout:2672: read oid 28 snap -1 2020-11-16T22:11:54.191 INFO:tasks.rados.rados.2.smithi057.stdout:2672: expect deleted 2020-11-16T22:11:54.191 INFO:tasks.rados.rados.2.smithi057.stdout:2673: copy_from oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 306 2020-11-16T22:11:54.192 INFO:tasks.rados.rados.2.smithi057.stdout:2674: snap_create 2020-11-16T22:11:54.197 INFO:tasks.rados.rados.2.smithi057.stdout:2673: finishing copy_from to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:54.197 INFO:tasks.rados.rados.2.smithi057.stdout:2673: got expected ENOENT (src dne) 2020-11-16T22:11:54.198 INFO:tasks.rados.rados.2.smithi057.stdout:2673: finishing copy_from racing read to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:54.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:54 smithi057 bash[10301]: cluster 2020-11-16T22:11:53.177711+0000 mon.a (mon.0) 1355 : cluster [DBG] osdmap e685: 12 total, 12 up, 12 in 2020-11-16T22:11:54.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:54 smithi016 bash[10302]: cluster 2020-11-16T22:11:53.177711+0000 mon.a (mon.0) 1355 : cluster [DBG] osdmap e685: 12 total, 12 up, 12 in 2020-11-16T22:11:54.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:54 smithi195 bash[10218]: cluster 2020-11-16T22:11:53.177711+0000 mon.a (mon.0) 1355 : cluster [DBG] osdmap e685: 12 total, 12 up, 12 in 2020-11-16T22:11:55.096 INFO:tasks.rados.rados.2.smithi057.stdout:2672: done (2 left) 2020-11-16T22:11:55.097 INFO:tasks.rados.rados.2.smithi057.stdout:2673: done (1 left) 2020-11-16T22:11:55.097 INFO:tasks.rados.rados.2.smithi057.stdout:2674: done (0 left) 2020-11-16T22:11:55.097 INFO:tasks.rados.rados.2.smithi057.stdout:2675: snap_create 2020-11-16T22:11:55.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:55 smithi057 bash[10301]: cluster 2020-11-16T22:11:53.779587+0000 mgr.x (mgr.24115) 578 : cluster [DBG] pgmap v1193: 17 pgs: 17 active+clean; 113 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 5.5 MiB/s wr, 27 op/s 2020-11-16T22:11:55.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:55 smithi057 bash[10301]: cluster 2020-11-16T22:11:54.200089+0000 mon.a (mon.0) 1356 : cluster [DBG] osdmap e686: 12 total, 12 up, 12 in 2020-11-16T22:11:55.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:55 smithi057 bash[10301]: cluster 2020-11-16T22:11:55.104862+0000 mon.a (mon.0) 1357 : cluster [DBG] osdmap e687: 12 total, 12 up, 12 in 2020-11-16T22:11:55.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:55 smithi016 bash[10302]: cluster 2020-11-16T22:11:53.779587+0000 mgr.x (mgr.24115) 578 : cluster [DBG] pgmap v1193: 17 pgs: 17 active+clean; 113 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 5.5 MiB/s wr, 27 op/s 2020-11-16T22:11:55.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:55 smithi016 bash[10302]: cluster 2020-11-16T22:11:54.200089+0000 mon.a (mon.0) 1356 : cluster [DBG] osdmap e686: 12 total, 12 up, 12 in 2020-11-16T22:11:55.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:55 smithi016 bash[10302]: cluster 2020-11-16T22:11:55.104862+0000 mon.a (mon.0) 1357 : cluster [DBG] osdmap e687: 12 total, 12 up, 12 in 2020-11-16T22:11:55.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:55 smithi195 bash[10218]: cluster 2020-11-16T22:11:53.779587+0000 mgr.x (mgr.24115) 578 : cluster [DBG] pgmap v1193: 17 pgs: 17 active+clean; 113 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 5.5 MiB/s wr, 27 op/s 2020-11-16T22:11:55.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:55 smithi195 bash[10218]: cluster 2020-11-16T22:11:54.200089+0000 mon.a (mon.0) 1356 : cluster [DBG] osdmap e686: 12 total, 12 up, 12 in 2020-11-16T22:11:55.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:55 smithi195 bash[10218]: cluster 2020-11-16T22:11:55.104862+0000 mon.a (mon.0) 1357 : cluster [DBG] osdmap e687: 12 total, 12 up, 12 in 2020-11-16T22:11:56.105 INFO:tasks.rados.rados.2.smithi057.stdout:2675: done (0 left) 2020-11-16T22:11:56.106 INFO:tasks.rados.rados.2.smithi057.stdout:2676: write (excl) oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 308 2020-11-16T22:11:56.106 INFO:tasks.rados.rados.2.smithi057.stdout:2676: seq_num 904 ranges {793528=554750,2083369=436974,2958856=234672} 2020-11-16T22:11:56.122 INFO:tasks.rados.rados.2.smithi057.stdout:2676: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 793528 to 1348278 tid 1 2020-11-16T22:11:56.129 INFO:tasks.rados.rados.2.smithi057.stdout:2676: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2083369 to 2520343 tid 2 2020-11-16T22:11:56.133 INFO:tasks.rados.rados.2.smithi057.stdout:2676: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2958856 to 3193528 tid 3 2020-11-16T22:11:56.133 INFO:tasks.rados.rados.2.smithi057.stdout:2677: rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 308 2020-11-16T22:11:56.133 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 304 2020-11-16T22:11:56.133 INFO:tasks.rados.rados.2.smithi057.stdout:2676: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:56.134 INFO:tasks.rados.rados.2.smithi057.stdout:2678: snap_remove snap 307 2020-11-16T22:11:57.117 INFO:tasks.rados.rados.2.smithi057.stdout:2678: done (2 left) 2020-11-16T22:11:57.117 INFO:tasks.rados.rados.2.smithi057.stdout:2679: snap_remove snap 303 2020-11-16T22:11:57.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:57 smithi057 bash[10301]: cluster 2020-11-16T22:11:55.780350+0000 mgr.x (mgr.24115) 579 : cluster [DBG] pgmap v1196: 17 pgs: 17 active+clean; 114 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.8 MiB/s wr, 11 op/s 2020-11-16T22:11:57.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:57 smithi057 bash[10301]: cluster 2020-11-16T22:11:56.116087+0000 mon.a (mon.0) 1358 : cluster [DBG] osdmap e688: 12 total, 12 up, 12 in 2020-11-16T22:11:57.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:57 smithi016 bash[10302]: cluster 2020-11-16T22:11:55.780350+0000 mgr.x (mgr.24115) 579 : cluster [DBG] pgmap v1196: 17 pgs: 17 active+clean; 114 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.8 MiB/s wr, 11 op/s 2020-11-16T22:11:57.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:57 smithi016 bash[10302]: cluster 2020-11-16T22:11:56.116087+0000 mon.a (mon.0) 1358 : cluster [DBG] osdmap e688: 12 total, 12 up, 12 in 2020-11-16T22:11:57.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:57 smithi195 bash[10218]: cluster 2020-11-16T22:11:55.780350+0000 mgr.x (mgr.24115) 579 : cluster [DBG] pgmap v1196: 17 pgs: 17 active+clean; 114 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.8 MiB/s wr, 11 op/s 2020-11-16T22:11:57.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:57 smithi195 bash[10218]: cluster 2020-11-16T22:11:56.116087+0000 mon.a (mon.0) 1358 : cluster [DBG] osdmap e688: 12 total, 12 up, 12 in 2020-11-16T22:11:58.127 INFO:tasks.rados.rados.2.smithi057.stdout:2679: done (2 left) 2020-11-16T22:11:58.127 INFO:tasks.rados.rados.2.smithi057.stdout:2680: rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 308 2020-11-16T22:11:58.127 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 306 2020-11-16T22:11:58.127 INFO:tasks.rados.rados.2.smithi057.stdout:2676: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:58.128 INFO:tasks.rados.rados.2.smithi057.stdout:2676: finishing write tid 3 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:58.128 INFO:tasks.rados.rados.2.smithi057.stdout:2676: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:58.128 INFO:tasks.rados.rados.2.smithi057.stdout:2676: finishing write tid 6 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:58.128 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1788 (ObjNum 904 snap 308 seq_num 904) dirty exists 2020-11-16T22:11:58.128 INFO:tasks.rados.rados.2.smithi057.stdout:2676: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 904 snap 308 seq_num 904) 2020-11-16T22:11:58.128 INFO:tasks.rados.rados.2.smithi057.stdout:2677: finishing rollback tid 0 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:58.128 INFO:tasks.rados.rados.2.smithi057.stdout:2677: finishing rollback tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:58.129 INFO:tasks.rados.rados.2.smithi057.stdout:2677: finishing rollback tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:58.129 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1577 (ObjNum 895 snap 303 seq_num 895) dirty exists 2020-11-16T22:11:58.129 INFO:tasks.rados.rados.2.smithi057.stdout:2676: done (2 left) 2020-11-16T22:11:58.129 INFO:tasks.rados.rados.2.smithi057.stdout:2677: done (1 left) 2020-11-16T22:11:58.129 INFO:tasks.rados.rados.2.smithi057.stdout:2681: read oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:58.129 INFO:tasks.rados.rados.2.smithi057.stdout:2681: expect (ObjNum 851 snap 289 seq_num 851) 2020-11-16T22:11:58.129 INFO:tasks.rados.rados.2.smithi057.stdout:2682: read oid 44 snap -1 2020-11-16T22:11:58.130 INFO:tasks.rados.rados.2.smithi057.stdout:2682: expect (ObjNum 820 snap 281 seq_num 820) 2020-11-16T22:11:58.130 INFO:tasks.rados.rados.2.smithi057.stdout:2683: delete oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 308 2020-11-16T22:11:58.134 INFO:tasks.rados.rados.2.smithi057.stdout:2683: done (3 left) 2020-11-16T22:11:58.135 INFO:tasks.rados.rados.2.smithi057.stdout:2684: write (excl) oid 12 current snap is 308 2020-11-16T22:11:58.135 INFO:tasks.rados.rados.2.smithi057.stdout:2684: seq_num 906 ranges {427142=421601,1400333=440643,2613702=450326} 2020-11-16T22:11:58.140 INFO:tasks.rados.rados.2.smithi057.stdout:2684: writing smithi05720651-12 from 427142 to 848743 tid 1 2020-11-16T22:11:58.148 INFO:tasks.rados.rados.2.smithi057.stdout:2684: writing smithi05720651-12 from 1400333 to 1840976 tid 2 2020-11-16T22:11:58.155 INFO:tasks.rados.rados.2.smithi057.stdout:2684: writing smithi05720651-12 from 2613702 to 3064028 tid 3 2020-11-16T22:11:58.155 INFO:tasks.rados.rados.2.smithi057.stdout:2685: read oid 28 snap -1 2020-11-16T22:11:58.155 INFO:tasks.rados.rados.2.smithi057.stdout:2685: expect deleted 2020-11-16T22:11:58.156 INFO:tasks.rados.rados.2.smithi057.stdout:2686: delete oid 46 current snap is 308 2020-11-16T22:11:58.156 INFO:tasks.rados.rados.2.smithi057.stdout:2680: finishing rollback tid 0 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:58.156 INFO:tasks.rados.rados.2.smithi057.stdout:2680: finishing rollback tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:58.156 INFO:tasks.rados.rados.2.smithi057.stdout:2680: finishing rollback tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:11:58.156 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1909 (ObjNum 816 snap 279 seq_num 816) dirty exists 2020-11-16T22:11:58.156 INFO:tasks.rados.rados.2.smithi057.stdout:2682: expect (ObjNum 820 snap 281 seq_num 820) 2020-11-16T22:11:58.397 INFO:tasks.rados.rados.2.smithi057.stdout:2681: expect (ObjNum 851 snap 289 seq_num 851) 2020-11-16T22:11:58.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:58 smithi057 bash[10301]: cluster 2020-11-16T22:11:57.125917+0000 mon.a (mon.0) 1359 : cluster [DBG] osdmap e689: 12 total, 12 up, 12 in 2020-11-16T22:11:58.503 INFO:tasks.rados.rados.2.smithi057.stdout:2684: finishing write tid 1 to smithi05720651-12 2020-11-16T22:11:58.503 INFO:tasks.rados.rados.2.smithi057.stdout:2684: finishing write tid 2 to smithi05720651-12 2020-11-16T22:11:58.503 INFO:tasks.rados.rados.2.smithi057.stdout:2684: finishing write tid 3 to smithi05720651-12 2020-11-16T22:11:58.503 INFO:tasks.rados.rados.2.smithi057.stdout:2684: finishing write tid 5 to smithi05720651-12 2020-11-16T22:11:58.503 INFO:tasks.rados.rados.2.smithi057.stdout:2684: finishing write tid 6 to smithi05720651-12 2020-11-16T22:11:58.503 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 1772 (ObjNum 906 snap 308 seq_num 906) dirty exists 2020-11-16T22:11:58.504 INFO:tasks.rados.rados.2.smithi057.stdout:2684: left oid 12 (ObjNum 906 snap 308 seq_num 906) 2020-11-16T22:11:58.504 INFO:tasks.rados.rados.2.smithi057.stdout:2680: done (5 left) 2020-11-16T22:11:58.504 INFO:tasks.rados.rados.2.smithi057.stdout:2681: done (4 left) 2020-11-16T22:11:58.504 INFO:tasks.rados.rados.2.smithi057.stdout:2682: done (3 left) 2020-11-16T22:11:58.504 INFO:tasks.rados.rados.2.smithi057.stdout:2684: done (2 left) 2020-11-16T22:11:58.504 INFO:tasks.rados.rados.2.smithi057.stdout:2685: done (1 left) 2020-11-16T22:11:58.504 INFO:tasks.rados.rados.2.smithi057.stdout:2686: done (0 left) 2020-11-16T22:11:58.505 INFO:tasks.rados.rados.2.smithi057.stdout:2687: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:11:58.505 INFO:tasks.rados.rados.2.smithi057.stdout:2687: expect (ObjNum 876 snap 296 seq_num 876) 2020-11-16T22:11:58.505 INFO:tasks.rados.rados.2.smithi057.stdout:2688: delete oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 308 2020-11-16T22:11:58.507 INFO:tasks.rados.rados.2.smithi057.stdout:2688: done (1 left) 2020-11-16T22:11:58.507 INFO:tasks.rados.rados.2.smithi057.stdout:2689: snap_create 2020-11-16T22:11:58.511 INFO:tasks.rados.rados.2.smithi057.stdout:2687: expect (ObjNum 876 snap 296 seq_num 876) 2020-11-16T22:11:58.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:58 smithi016 bash[10302]: cluster 2020-11-16T22:11:57.125917+0000 mon.a (mon.0) 1359 : cluster [DBG] osdmap e689: 12 total, 12 up, 12 in 2020-11-16T22:11:58.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:58 smithi195 bash[10218]: cluster 2020-11-16T22:11:57.125917+0000 mon.a (mon.0) 1359 : cluster [DBG] osdmap e689: 12 total, 12 up, 12 in 2020-11-16T22:11:59.135 INFO:tasks.rados.rados.2.smithi057.stdout:2687: done (1 left) 2020-11-16T22:11:59.135 INFO:tasks.rados.rados.2.smithi057.stdout:2689: done (0 left) 2020-11-16T22:11:59.136 INFO:tasks.rados.rados.2.smithi057.stdout:2690: read oid 22 snap -1 2020-11-16T22:11:59.136 INFO:tasks.rados.rados.2.smithi057.stdout:2690: expect (ObjNum 786 snap 272 seq_num 786) 2020-11-16T22:11:59.136 INFO:tasks.rados.rados.2.smithi057.stdout:2691: snap_create 2020-11-16T22:11:59.148 INFO:tasks.rados.rados.2.smithi057.stdout:2690: expect (ObjNum 786 snap 272 seq_num 786) 2020-11-16T22:11:59.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:59 smithi057 bash[10301]: cluster 2020-11-16T22:11:57.781046+0000 mgr.x (mgr.24115) 580 : cluster [DBG] pgmap v1199: 17 pgs: 17 active+clean; 117 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 3.1 MiB/s wr, 18 op/s 2020-11-16T22:11:59.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:11:59 smithi057 bash[10301]: cluster 2020-11-16T22:11:58.135512+0000 mon.a (mon.0) 1360 : cluster [DBG] osdmap e690: 12 total, 12 up, 12 in 2020-11-16T22:11:59.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:59 smithi016 bash[10302]: cluster 2020-11-16T22:11:57.781046+0000 mgr.x (mgr.24115) 580 : cluster [DBG] pgmap v1199: 17 pgs: 17 active+clean; 117 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 3.1 MiB/s wr, 18 op/s 2020-11-16T22:11:59.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:11:59 smithi016 bash[10302]: cluster 2020-11-16T22:11:58.135512+0000 mon.a (mon.0) 1360 : cluster [DBG] osdmap e690: 12 total, 12 up, 12 in 2020-11-16T22:11:59.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:59 smithi195 bash[10218]: cluster 2020-11-16T22:11:57.781046+0000 mgr.x (mgr.24115) 580 : cluster [DBG] pgmap v1199: 17 pgs: 17 active+clean; 117 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 3.1 MiB/s wr, 18 op/s 2020-11-16T22:11:59.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:11:59 smithi195 bash[10218]: cluster 2020-11-16T22:11:58.135512+0000 mon.a (mon.0) 1360 : cluster [DBG] osdmap e690: 12 total, 12 up, 12 in 2020-11-16T22:12:00.095 INFO:tasks.rados.rados.2.smithi057.stdout:2690: done (1 left) 2020-11-16T22:12:00.095 INFO:tasks.rados.rados.2.smithi057.stdout:2691: done (0 left) 2020-11-16T22:12:00.095 INFO:tasks.rados.rados.2.smithi057.stdout:2692: snap_remove snap 306 2020-11-16T22:12:00.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:00 smithi057 bash[10301]: cluster 2020-11-16T22:11:59.146224+0000 mon.a (mon.0) 1361 : cluster [DBG] osdmap e691: 12 total, 12 up, 12 in 2020-11-16T22:12:00.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:00 smithi057 bash[10301]: cluster 2020-11-16T22:12:00.106182+0000 mon.a (mon.0) 1362 : cluster [DBG] osdmap e692: 12 total, 12 up, 12 in 2020-11-16T22:12:00.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:00 smithi016 bash[10302]: cluster 2020-11-16T22:11:59.146224+0000 mon.a (mon.0) 1361 : cluster [DBG] osdmap e691: 12 total, 12 up, 12 in 2020-11-16T22:12:00.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:00 smithi016 bash[10302]: cluster 2020-11-16T22:12:00.106182+0000 mon.a (mon.0) 1362 : cluster [DBG] osdmap e692: 12 total, 12 up, 12 in 2020-11-16T22:12:00.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:00 smithi195 bash[10218]: cluster 2020-11-16T22:11:59.146224+0000 mon.a (mon.0) 1361 : cluster [DBG] osdmap e691: 12 total, 12 up, 12 in 2020-11-16T22:12:00.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:00 smithi195 bash[10218]: cluster 2020-11-16T22:12:00.106182+0000 mon.a (mon.0) 1362 : cluster [DBG] osdmap e692: 12 total, 12 up, 12 in 2020-11-16T22:12:01.113 INFO:tasks.rados.rados.2.smithi057.stdout:2692: done (0 left) 2020-11-16T22:12:01.113 INFO:tasks.rados.rados.2.smithi057.stdout:2693: copy_from oid 40 from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 310 2020-11-16T22:12:01.113 INFO:tasks.rados.rados.2.smithi057.stdout:2694: write oid 50 current snap is 310 2020-11-16T22:12:01.114 INFO:tasks.rados.rados.2.smithi057.stdout:2694: seq_num 909 ranges {477563=647348,1859426=587970,2979618=297945} 2020-11-16T22:12:01.123 INFO:tasks.rados.rados.2.smithi057.stdout:2694: writing smithi05720651-50 from 477563 to 1124911 tid 1 2020-11-16T22:12:01.130 INFO:tasks.rados.rados.2.smithi057.stdout:2694: writing smithi05720651-50 from 1859426 to 2447396 tid 2 2020-11-16T22:12:01.135 INFO:tasks.rados.rados.2.smithi057.stdout:2694: writing smithi05720651-50 from 2979618 to 3277563 tid 3 2020-11-16T22:12:01.136 INFO:tasks.rados.rados.2.smithi057.stdout:2695: write oid 10 current snap is 310 2020-11-16T22:12:01.136 INFO:tasks.rados.rados.2.smithi057.stdout:2695: seq_num 910 ranges {494370=722597,1917908=447981,3007041=287329} 2020-11-16T22:12:01.142 INFO:tasks.rados.rados.2.smithi057.stdout:2695: writing smithi05720651-10 from 494370 to 1216967 tid 1 2020-11-16T22:12:01.149 INFO:tasks.rados.rados.2.smithi057.stdout:2695: writing smithi05720651-10 from 1917908 to 2365889 tid 2 2020-11-16T22:12:01.154 INFO:tasks.rados.rados.2.smithi057.stdout:2695: writing smithi05720651-10 from 3007041 to 3294370 tid 3 2020-11-16T22:12:01.154 INFO:tasks.rados.rados.2.smithi057.stdout:2696: snap_remove snap 308 2020-11-16T22:12:01.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:01 smithi057 bash[10301]: cluster 2020-11-16T22:11:59.781763+0000 mgr.x (mgr.24115) 581 : cluster [DBG] pgmap v1202: 17 pgs: 17 active+clean; 118 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2020-11-16T22:12:01.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:01 smithi057 bash[10301]: cluster 2020-11-16T22:12:01.118356+0000 mon.a (mon.0) 1363 : cluster [DBG] osdmap e693: 12 total, 12 up, 12 in 2020-11-16T22:12:01.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:01 smithi016 bash[10302]: cluster 2020-11-16T22:11:59.781763+0000 mgr.x (mgr.24115) 581 : cluster [DBG] pgmap v1202: 17 pgs: 17 active+clean; 118 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2020-11-16T22:12:01.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:01 smithi016 bash[10302]: cluster 2020-11-16T22:12:01.118356+0000 mon.a (mon.0) 1363 : cluster [DBG] osdmap e693: 12 total, 12 up, 12 in 2020-11-16T22:12:01.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:01 smithi195 bash[10218]: cluster 2020-11-16T22:11:59.781763+0000 mgr.x (mgr.24115) 581 : cluster [DBG] pgmap v1202: 17 pgs: 17 active+clean; 118 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 1.5 MiB/s wr, 14 op/s 2020-11-16T22:12:01.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:01 smithi195 bash[10218]: cluster 2020-11-16T22:12:01.118356+0000 mon.a (mon.0) 1363 : cluster [DBG] osdmap e693: 12 total, 12 up, 12 in 2020-11-16T22:12:02.159 INFO:tasks.rados.rados.2.smithi057.stdout:2696: done (3 left) 2020-11-16T22:12:02.159 INFO:tasks.rados.rados.2.smithi057.stdout:2697: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:02.160 INFO:tasks.rados.rados.2.smithi057.stdout:2697: expect (ObjNum 850 snap 289 seq_num 850) 2020-11-16T22:12:02.160 INFO:tasks.rados.rados.2.smithi057.stdout:2698: write oid 6 current snap is 310 2020-11-16T22:12:02.160 INFO:tasks.rados.rados.2.smithi057.stdout:2698: seq_num 911 ranges {511177=797846,1976390=591639,3034464=276713} 2020-11-16T22:12:02.175 INFO:tasks.rados.rados.2.smithi057.stdout:2698: writing smithi05720651-6 from 511177 to 1309023 tid 1 2020-11-16T22:12:02.182 INFO:tasks.rados.rados.2.smithi057.stdout:2698: writing smithi05720651-6 from 1976390 to 2568029 tid 2 2020-11-16T22:12:02.186 INFO:tasks.rados.rados.2.smithi057.stdout:2698: writing smithi05720651-6 from 3034464 to 3311177 tid 3 2020-11-16T22:12:02.187 INFO:tasks.rados.rados.2.smithi057.stdout:2699: write (excl) oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 310 2020-11-16T22:12:02.187 INFO:tasks.rados.rados.2.smithi057.stdout:2699: seq_num 912 ranges {527984=473095,1634872=451650,2661887=634311} 2020-11-16T22:12:02.192 INFO:tasks.rados.rados.2.smithi057.stdout:2699: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 527984 to 1001079 tid 1 2020-11-16T22:12:02.198 INFO:tasks.rados.rados.2.smithi057.stdout:2699: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1634872 to 2086522 tid 2 2020-11-16T22:12:02.205 INFO:tasks.rados.rados.2.smithi057.stdout:2699: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2661887 to 3296198 tid 3 2020-11-16T22:12:02.205 INFO:tasks.rados.rados.2.smithi057.stdout:2700: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 304 2020-11-16T22:12:02.205 INFO:tasks.rados.rados.2.smithi057.stdout:2700: expect (ObjNum 886 snap 301 seq_num 886) 2020-11-16T22:12:02.206 INFO:tasks.rados.rados.2.smithi057.stdout:2701: snap_remove snap 309 2020-11-16T22:12:03.166 INFO:tasks.rados.rados.2.smithi057.stdout:2701: done (7 left) 2020-11-16T22:12:03.166 INFO:tasks.rados.rados.2.smithi057.stdout:2702: rollback oid 12 current snap is 310 2020-11-16T22:12:03.167 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 12 to 305 2020-11-16T22:12:03.167 INFO:tasks.rados.rados.2.smithi057.stdout:2694: finishing write tid 1 to smithi05720651-50 2020-11-16T22:12:03.167 INFO:tasks.rados.rados.2.smithi057.stdout:2694: finishing write tid 2 to smithi05720651-50 2020-11-16T22:12:03.167 INFO:tasks.rados.rados.2.smithi057.stdout:2693: finishing copy_from to smithi05720651-40 2020-11-16T22:12:03.167 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 1909 (ObjNum 816 snap 279 seq_num 816) dirty exists 2020-11-16T22:12:03.167 INFO:tasks.rados.rados.2.smithi057.stdout:2693: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:12:03.168 INFO:tasks.rados.rados.2.smithi057.stdout:2695: finishing write tid 1 to smithi05720651-10 2020-11-16T22:12:03.168 INFO:tasks.rados.rados.2.smithi057.stdout:2694: finishing write tid 3 to smithi05720651-50 2020-11-16T22:12:03.168 INFO:tasks.rados.rados.2.smithi057.stdout:2693: done (7 left) 2020-11-16T22:12:03.168 INFO:tasks.rados.rados.2.smithi057.stdout:2703: write (excl) oid 20 current snap is 310 2020-11-16T22:12:03.168 INFO:tasks.rados.rados.2.smithi057.stdout:2703: seq_num 913 ranges {544791=664697,1693354=595308,2689310=445583} 2020-11-16T22:12:03.177 INFO:tasks.rados.rados.2.smithi057.stdout:2703: writing smithi05720651-20 from 544791 to 1209488 tid 1 2020-11-16T22:12:03.184 INFO:tasks.rados.rados.2.smithi057.stdout:2703: writing smithi05720651-20 from 1693354 to 2288662 tid 2 2020-11-16T22:12:03.189 INFO:tasks.rados.rados.2.smithi057.stdout:2703: writing smithi05720651-20 from 2689310 to 3134893 tid 3 2020-11-16T22:12:03.189 INFO:tasks.rados.rados.2.smithi057.stdout:2704: read oid 28 snap -1 2020-11-16T22:12:03.190 INFO:tasks.rados.rados.2.smithi057.stdout:2704: expect deleted 2020-11-16T22:12:03.190 INFO:tasks.rados.rados.2.smithi057.stdout:2705: copy_from oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 310 2020-11-16T22:12:03.190 INFO:tasks.rados.rados.2.smithi057.stdout:2694: finishing write tid 5 to smithi05720651-50 2020-11-16T22:12:03.190 INFO:tasks.rados.rados.2.smithi057.stdout:2694: finishing write tid 6 to smithi05720651-50 2020-11-16T22:12:03.190 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 2067 (ObjNum 909 snap 310 seq_num 909) dirty exists 2020-11-16T22:12:03.190 INFO:tasks.rados.rados.2.smithi057.stdout:2694: left oid 50 (ObjNum 909 snap 310 seq_num 909) 2020-11-16T22:12:03.190 INFO:tasks.rados.rados.2.smithi057.stdout:2695: finishing write tid 2 to smithi05720651-10 2020-11-16T22:12:03.191 INFO:tasks.rados.rados.2.smithi057.stdout:2695: finishing write tid 3 to smithi05720651-10 2020-11-16T22:12:03.191 INFO:tasks.rados.rados.2.smithi057.stdout:2695: finishing write tid 5 to smithi05720651-10 2020-11-16T22:12:03.191 INFO:tasks.rados.rados.2.smithi057.stdout:2694: done (9 left) 2020-11-16T22:12:03.191 INFO:tasks.rados.rados.2.smithi057.stdout:2706: snap_create 2020-11-16T22:12:03.191 INFO:tasks.rados.rados.2.smithi057.stdout:2695: finishing write tid 6 to smithi05720651-10 2020-11-16T22:12:03.191 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 1727 (ObjNum 910 snap 310 seq_num 910) dirty exists 2020-11-16T22:12:03.191 INFO:tasks.rados.rados.2.smithi057.stdout:2695: left oid 10 (ObjNum 910 snap 310 seq_num 910) 2020-11-16T22:12:03.192 INFO:tasks.rados.rados.2.smithi057.stdout:2697: expect (ObjNum 850 snap 289 seq_num 850) 2020-11-16T22:12:03.300 INFO:tasks.rados.rados.2.smithi057.stdout:2698: finishing write tid 1 to smithi05720651-6 2020-11-16T22:12:03.300 INFO:tasks.rados.rados.2.smithi057.stdout:2698: finishing write tid 2 to smithi05720651-6 2020-11-16T22:12:03.300 INFO:tasks.rados.rados.2.smithi057.stdout:2698: finishing write tid 3 to smithi05720651-6 2020-11-16T22:12:03.300 INFO:tasks.rados.rados.2.smithi057.stdout:2698: finishing write tid 5 to smithi05720651-6 2020-11-16T22:12:03.300 INFO:tasks.rados.rados.2.smithi057.stdout:2698: finishing write tid 6 to smithi05720651-6 2020-11-16T22:12:03.301 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 2071 (ObjNum 911 snap 310 seq_num 911) dirty exists 2020-11-16T22:12:03.301 INFO:tasks.rados.rados.2.smithi057.stdout:2698: left oid 6 (ObjNum 911 snap 310 seq_num 911) 2020-11-16T22:12:03.301 INFO:tasks.rados.rados.2.smithi057.stdout:2699: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:03.301 INFO:tasks.rados.rados.2.smithi057.stdout:2699: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:03.301 INFO:tasks.rados.rados.2.smithi057.stdout:2699: finishing write tid 3 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:03.301 INFO:tasks.rados.rados.2.smithi057.stdout:2699: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:03.302 INFO:tasks.rados.rados.2.smithi057.stdout:2699: finishing write tid 6 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:03.302 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2192 (ObjNum 912 snap 310 seq_num 912) dirty exists 2020-11-16T22:12:03.302 INFO:tasks.rados.rados.2.smithi057.stdout:2699: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 912 snap 310 seq_num 912) 2020-11-16T22:12:03.302 INFO:tasks.rados.rados.2.smithi057.stdout:2700: expect (ObjNum 886 snap 301 seq_num 886) 2020-11-16T22:12:03.422 INFO:tasks.rados.rados.2.smithi057.stdout:2702: finishing rollback tid 0 to smithi05720651-12 2020-11-16T22:12:03.423 INFO:tasks.rados.rados.2.smithi057.stdout:2702: finishing rollback tid 1 to smithi05720651-12 2020-11-16T22:12:03.423 INFO:tasks.rados.rados.2.smithi057.stdout:2702: finishing rollback tid 2 to smithi05720651-12 2020-11-16T22:12:03.423 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 1775 (ObjNum 816 snap 279 seq_num 816) dirty exists 2020-11-16T22:12:03.423 INFO:tasks.rados.rados.2.smithi057.stdout:2703: finishing write tid 1 to smithi05720651-20 2020-11-16T22:12:03.423 INFO:tasks.rados.rados.2.smithi057.stdout:2703: finishing write tid 2 to smithi05720651-20 2020-11-16T22:12:03.424 INFO:tasks.rados.rados.2.smithi057.stdout:2703: finishing write tid 3 to smithi05720651-20 2020-11-16T22:12:03.424 INFO:tasks.rados.rados.2.smithi057.stdout:2703: finishing write tid 5 to smithi05720651-20 2020-11-16T22:12:03.424 INFO:tasks.rados.rados.2.smithi057.stdout:2703: finishing write tid 6 to smithi05720651-20 2020-11-16T22:12:03.424 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1790 (ObjNum 913 snap 310 seq_num 913) dirty exists 2020-11-16T22:12:03.424 INFO:tasks.rados.rados.2.smithi057.stdout:2703: left oid 20 (ObjNum 913 snap 310 seq_num 913) 2020-11-16T22:12:03.424 INFO:tasks.rados.rados.2.smithi057.stdout:2705: finishing copy_from to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:03.425 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2066 (ObjNum 878 snap 296 seq_num 878) dirty exists 2020-11-16T22:12:03.425 INFO:tasks.rados.rados.2.smithi057.stdout:2705: finishing copy_from racing read to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:03.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:03 smithi057 bash[10301]: cluster 2020-11-16T22:12:01.782479+0000 mgr.x (mgr.24115) 582 : cluster [DBG] pgmap v1205: 17 pgs: 17 active+clean; 121 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2020-11-16T22:12:03.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:03 smithi057 bash[10301]: cluster 2020-11-16T22:12:02.166012+0000 mon.a (mon.0) 1364 : cluster [DBG] osdmap e694: 12 total, 12 up, 12 in 2020-11-16T22:12:03.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:03 smithi016 bash[10302]: cluster 2020-11-16T22:12:01.782479+0000 mgr.x (mgr.24115) 582 : cluster [DBG] pgmap v1205: 17 pgs: 17 active+clean; 121 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2020-11-16T22:12:03.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:03 smithi016 bash[10302]: cluster 2020-11-16T22:12:02.166012+0000 mon.a (mon.0) 1364 : cluster [DBG] osdmap e694: 12 total, 12 up, 12 in 2020-11-16T22:12:03.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:03 smithi195 bash[10218]: cluster 2020-11-16T22:12:01.782479+0000 mgr.x (mgr.24115) 582 : cluster [DBG] pgmap v1205: 17 pgs: 17 active+clean; 121 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 1.5 MiB/s wr, 15 op/s 2020-11-16T22:12:03.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:03 smithi195 bash[10218]: cluster 2020-11-16T22:12:02.166012+0000 mon.a (mon.0) 1364 : cluster [DBG] osdmap e694: 12 total, 12 up, 12 in 2020-11-16T22:12:04.178 INFO:tasks.rados.rados.2.smithi057.stdout:2695: done (9 left) 2020-11-16T22:12:04.178 INFO:tasks.rados.rados.2.smithi057.stdout:2697: done (8 left) 2020-11-16T22:12:04.178 INFO:tasks.rados.rados.2.smithi057.stdout:2698: done (7 left) 2020-11-16T22:12:04.179 INFO:tasks.rados.rados.2.smithi057.stdout:2699: done (6 left) 2020-11-16T22:12:04.179 INFO:tasks.rados.rados.2.smithi057.stdout:2700: done (5 left) 2020-11-16T22:12:04.179 INFO:tasks.rados.rados.2.smithi057.stdout:2702: done (4 left) 2020-11-16T22:12:04.179 INFO:tasks.rados.rados.2.smithi057.stdout:2703: done (3 left) 2020-11-16T22:12:04.179 INFO:tasks.rados.rados.2.smithi057.stdout:2704: done (2 left) 2020-11-16T22:12:04.179 INFO:tasks.rados.rados.2.smithi057.stdout:2705: done (1 left) 2020-11-16T22:12:04.179 INFO:tasks.rados.rados.2.smithi057.stdout:2706: done (0 left) 2020-11-16T22:12:04.180 INFO:tasks.rados.rados.2.smithi057.stdout:2707: delete oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 311 2020-11-16T22:12:04.186 INFO:tasks.rados.rados.2.smithi057.stdout:2707: done (0 left) 2020-11-16T22:12:04.186 INFO:tasks.rados.rados.2.smithi057.stdout:2708: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 310 2020-11-16T22:12:04.186 INFO:tasks.rados.rados.2.smithi057.stdout:2708: expect (ObjNum 850 snap 289 seq_num 850) 2020-11-16T22:12:04.187 INFO:tasks.rados.rados.2.smithi057.stdout:2709: rollback oid 10 current snap is 311 2020-11-16T22:12:04.187 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 10 to 304 2020-11-16T22:12:04.187 INFO:tasks.rados.rados.2.smithi057.stdout:2710: snap_create 2020-11-16T22:12:04.194 INFO:tasks.rados.rados.2.smithi057.stdout:2709: finishing rollback tid 0 to smithi05720651-10 2020-11-16T22:12:04.194 INFO:tasks.rados.rados.2.smithi057.stdout:2708: expect (ObjNum 850 snap 289 seq_num 850) 2020-11-16T22:12:04.300 INFO:tasks.rados.rados.2.smithi057.stdout:2709: finishing rollback tid 1 to smithi05720651-10 2020-11-16T22:12:04.301 INFO:tasks.rados.rados.2.smithi057.stdout:2709: finishing rollback tid 2 to smithi05720651-10 2020-11-16T22:12:04.301 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 1730 (ObjNum 525 snap 188 seq_num 525) dirty exists 2020-11-16T22:12:04.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:04 smithi057 bash[10301]: cluster 2020-11-16T22:12:03.176424+0000 mon.a (mon.0) 1365 : cluster [DBG] osdmap e695: 12 total, 12 up, 12 in 2020-11-16T22:12:04.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:04 smithi016 bash[10302]: cluster 2020-11-16T22:12:03.176424+0000 mon.a (mon.0) 1365 : cluster [DBG] osdmap e695: 12 total, 12 up, 12 in 2020-11-16T22:12:04.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:04 smithi195 bash[10218]: cluster 2020-11-16T22:12:03.176424+0000 mon.a (mon.0) 1365 : cluster [DBG] osdmap e695: 12 total, 12 up, 12 in 2020-11-16T22:12:05.100 INFO:tasks.rados.rados.2.smithi057.stdout:2708: done (2 left) 2020-11-16T22:12:05.101 INFO:tasks.rados.rados.2.smithi057.stdout:2709: done (1 left) 2020-11-16T22:12:05.101 INFO:tasks.rados.rados.2.smithi057.stdout:2710: done (0 left) 2020-11-16T22:12:05.101 INFO:tasks.rados.rados.2.smithi057.stdout:2711: snap_create 2020-11-16T22:12:05.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:05 smithi057 bash[10301]: cluster 2020-11-16T22:12:03.783132+0000 mgr.x (mgr.24115) 583 : cluster [DBG] pgmap v1208: 17 pgs: 17 active+clean; 121 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2020-11-16T22:12:05.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:05 smithi057 bash[10301]: cluster 2020-11-16T22:12:04.186211+0000 mon.a (mon.0) 1366 : cluster [DBG] osdmap e696: 12 total, 12 up, 12 in 2020-11-16T22:12:05.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:05 smithi057 bash[10301]: cluster 2020-11-16T22:12:05.109022+0000 mon.a (mon.0) 1367 : cluster [DBG] osdmap e697: 12 total, 12 up, 12 in 2020-11-16T22:12:05.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:05 smithi016 bash[10302]: cluster 2020-11-16T22:12:03.783132+0000 mgr.x (mgr.24115) 583 : cluster [DBG] pgmap v1208: 17 pgs: 17 active+clean; 121 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2020-11-16T22:12:05.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:05 smithi016 bash[10302]: cluster 2020-11-16T22:12:04.186211+0000 mon.a (mon.0) 1366 : cluster [DBG] osdmap e696: 12 total, 12 up, 12 in 2020-11-16T22:12:05.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:05 smithi016 bash[10302]: cluster 2020-11-16T22:12:05.109022+0000 mon.a (mon.0) 1367 : cluster [DBG] osdmap e697: 12 total, 12 up, 12 in 2020-11-16T22:12:05.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:05 smithi195 bash[10218]: cluster 2020-11-16T22:12:03.783132+0000 mgr.x (mgr.24115) 583 : cluster [DBG] pgmap v1208: 17 pgs: 17 active+clean; 121 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2020-11-16T22:12:05.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:05 smithi195 bash[10218]: cluster 2020-11-16T22:12:04.186211+0000 mon.a (mon.0) 1366 : cluster [DBG] osdmap e696: 12 total, 12 up, 12 in 2020-11-16T22:12:05.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:05 smithi195 bash[10218]: cluster 2020-11-16T22:12:05.109022+0000 mon.a (mon.0) 1367 : cluster [DBG] osdmap e697: 12 total, 12 up, 12 in 2020-11-16T22:12:06.111 INFO:tasks.rados.rados.2.smithi057.stdout:2711: done (0 left) 2020-11-16T22:12:06.112 INFO:tasks.rados.rados.2.smithi057.stdout:2712: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:06.112 INFO:tasks.rados.rados.2.smithi057.stdout:2712: expect (ObjNum 852 snap 289 seq_num 852) 2020-11-16T22:12:06.112 INFO:tasks.rados.rados.2.smithi057.stdout:2713: write oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 313 2020-11-16T22:12:06.112 INFO:tasks.rados.rados.2.smithi057.stdout:2713: seq_num 915 ranges {578405=415195,1410318=598977,2744156=584480} 2020-11-16T22:12:06.123 INFO:tasks.rados.rados.2.smithi057.stdout:2713: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 578405 to 993600 tid 1 2020-11-16T22:12:06.131 INFO:tasks.rados.rados.2.smithi057.stdout:2713: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1410318 to 2009295 tid 2 2020-11-16T22:12:06.138 INFO:tasks.rados.rados.2.smithi057.stdout:2713: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2744156 to 3328636 tid 3 2020-11-16T22:12:06.138 INFO:tasks.rados.rados.2.smithi057.stdout:2714: write (excl) oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 313 2020-11-16T22:12:06.139 INFO:tasks.rados.rados.2.smithi057.stdout:2714: seq_num 916 ranges {595212=490444,1868800=458988,2887932=507280} 2020-11-16T22:12:06.145 INFO:tasks.rados.rados.2.smithi057.stdout:2714: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 595212 to 1085656 tid 1 2020-11-16T22:12:06.151 INFO:tasks.rados.rados.2.smithi057.stdout:2714: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1868800 to 2327788 tid 2 2020-11-16T22:12:06.158 INFO:tasks.rados.rados.2.smithi057.stdout:2714: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2887932 to 3395212 tid 3 2020-11-16T22:12:06.158 INFO:tasks.rados.rados.2.smithi057.stdout:2715: write (excl) oid 22 current snap is 313 2020-11-16T22:12:06.158 INFO:tasks.rados.rados.2.smithi057.stdout:2715: seq_num 917 ranges {612019=565693,1810929=602646,3082649=329370} 2020-11-16T22:12:06.164 INFO:tasks.rados.rados.2.smithi057.stdout:2715: writing smithi05720651-22 from 612019 to 1177712 tid 1 2020-11-16T22:12:06.172 INFO:tasks.rados.rados.2.smithi057.stdout:2715: writing smithi05720651-22 from 1810929 to 2413575 tid 2 2020-11-16T22:12:06.178 INFO:tasks.rados.rados.2.smithi057.stdout:2715: writing smithi05720651-22 from 3082649 to 3412019 tid 3 2020-11-16T22:12:06.178 INFO:tasks.rados.rados.2.smithi057.stdout:2716: copy_from oid 2 from oid 38 current snap is 313 2020-11-16T22:12:06.178 INFO:tasks.rados.rados.2.smithi057.stdout:2712: expect (ObjNum 852 snap 289 seq_num 852) 2020-11-16T22:12:06.321 INFO:tasks.rados.rados.2.smithi057.stdout:2713: finishing write tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:06.321 INFO:tasks.rados.rados.2.smithi057.stdout:2713: finishing write tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:06.321 INFO:tasks.rados.rados.2.smithi057.stdout:2713: finishing write tid 3 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:06.322 INFO:tasks.rados.rados.2.smithi057.stdout:2714: finishing write tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:06.322 INFO:tasks.rados.rados.2.smithi057.stdout:2714: finishing write tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:06.322 INFO:tasks.rados.rados.2.smithi057.stdout:2714: finishing write tid 3 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:06.322 INFO:tasks.rados.rados.2.smithi057.stdout:2714: finishing write tid 5 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:06.322 INFO:tasks.rados.rados.2.smithi057.stdout:2714: finishing write tid 6 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:06.322 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2167 (ObjNum 916 snap 313 seq_num 916) dirty exists 2020-11-16T22:12:06.322 INFO:tasks.rados.rados.2.smithi057.stdout:2714: left oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 916 snap 313 seq_num 916) 2020-11-16T22:12:06.323 INFO:tasks.rados.rados.2.smithi057.stdout:2715: finishing write tid 1 to smithi05720651-22 2020-11-16T22:12:06.323 INFO:tasks.rados.rados.2.smithi057.stdout:2715: finishing write tid 2 to smithi05720651-22 2020-11-16T22:12:06.323 INFO:tasks.rados.rados.2.smithi057.stdout:2712: done (4 left) 2020-11-16T22:12:06.323 INFO:tasks.rados.rados.2.smithi057.stdout:2714: done (3 left) 2020-11-16T22:12:06.323 INFO:tasks.rados.rados.2.smithi057.stdout:2717: write oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 313 2020-11-16T22:12:06.323 INFO:tasks.rados.rados.2.smithi057.stdout:2717: seq_num 918 ranges {628826=640942,1869411=462657,2826425=534649} 2020-11-16T22:12:06.335 INFO:tasks.rados.rados.2.smithi057.stdout:2717: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 628826 to 1269768 tid 1 2020-11-16T22:12:06.341 INFO:tasks.rados.rados.2.smithi057.stdout:2717: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1869411 to 2332068 tid 2 2020-11-16T22:12:06.347 INFO:tasks.rados.rados.2.smithi057.stdout:2717: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2826425 to 3361074 tid 3 2020-11-16T22:12:06.347 INFO:tasks.rados.rados.2.smithi057.stdout:2718: delete oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 313 2020-11-16T22:12:06.348 INFO:tasks.rados.rados.2.smithi057.stdout:2715: finishing write tid 3 to smithi05720651-22 2020-11-16T22:12:06.348 INFO:tasks.rados.rados.2.smithi057.stdout:2715: finishing write tid 5 to smithi05720651-22 2020-11-16T22:12:06.348 INFO:tasks.rados.rados.2.smithi057.stdout:2715: finishing write tid 6 to smithi05720651-22 2020-11-16T22:12:06.348 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 1779 (ObjNum 917 snap 313 seq_num 917) dirty exists 2020-11-16T22:12:06.348 INFO:tasks.rados.rados.2.smithi057.stdout:2715: left oid 22 (ObjNum 917 snap 313 seq_num 917) 2020-11-16T22:12:06.348 INFO:tasks.rados.rados.2.smithi057.stdout:2716: finishing copy_from to smithi05720651-2 2020-11-16T22:12:06.349 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 1768 (ObjNum 820 snap 281 seq_num 820) dirty exists 2020-11-16T22:12:06.349 INFO:tasks.rados.rados.2.smithi057.stdout:2716: finishing copy_from racing read to smithi05720651-2 2020-11-16T22:12:06.349 INFO:tasks.rados.rados.2.smithi057.stdout:2717: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:06.349 INFO:tasks.rados.rados.2.smithi057.stdout:2717: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:06.355 INFO:tasks.rados.rados.2.smithi057.stdout:2717: finishing write tid 3 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:06.356 INFO:tasks.rados.rados.2.smithi057.stdout:2717: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:06.356 INFO:tasks.rados.rados.2.smithi057.stdout:2717: finishing write tid 6 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:06.356 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2075 (ObjNum 918 snap 313 seq_num 918) dirty exists 2020-11-16T22:12:06.356 INFO:tasks.rados.rados.2.smithi057.stdout:2717: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 918 snap 313 seq_num 918) 2020-11-16T22:12:06.681 INFO:tasks.rados.rados.2.smithi057.stdout:2713: finishing write tid 5 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:06.681 INFO:tasks.rados.rados.2.smithi057.stdout:2713: finishing write tid 6 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:06.682 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1734 (ObjNum 915 snap 313 seq_num 915) dirty exists 2020-11-16T22:12:06.682 INFO:tasks.rados.rados.2.smithi057.stdout:2713: left oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 915 snap 313 seq_num 915) 2020-11-16T22:12:06.870 INFO:tasks.rados.rados.2.smithi057.stdout:2713: done (4 left) 2020-11-16T22:12:06.871 INFO:tasks.rados.rados.2.smithi057.stdout:2715: done (3 left) 2020-11-16T22:12:06.871 INFO:tasks.rados.rados.2.smithi057.stdout:2716: done (2 left) 2020-11-16T22:12:06.871 INFO:tasks.rados.rados.2.smithi057.stdout:2717: done (1 left) 2020-11-16T22:12:06.871 INFO:tasks.rados.rados.2.smithi057.stdout:2718: done (0 left) 2020-11-16T22:12:06.871 INFO:tasks.rados.rados.2.smithi057.stdout:2719: read oid 38 snap -1 2020-11-16T22:12:06.871 INFO:tasks.rados.rados.2.smithi057.stdout:2719: expect (ObjNum 820 snap 281 seq_num 820) 2020-11-16T22:12:06.872 INFO:tasks.rados.rados.2.smithi057.stdout:2720: snap_remove snap 311 2020-11-16T22:12:07.184 INFO:tasks.rados.rados.2.smithi057.stdout:2720: done (1 left) 2020-11-16T22:12:07.184 INFO:tasks.rados.rados.2.smithi057.stdout:2721: copy_from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 313 2020-11-16T22:12:07.185 INFO:tasks.rados.rados.2.smithi057.stdout:2719: expect (ObjNum 820 snap 281 seq_num 820) 2020-11-16T22:12:07.427 INFO:tasks.rados.rados.2.smithi057.stdout:2721: finishing copy_from to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:07.428 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2162 (ObjNum 876 snap 296 seq_num 876) dirty exists 2020-11-16T22:12:07.428 INFO:tasks.rados.rados.2.smithi057.stdout:2721: finishing copy_from racing read to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:07.428 INFO:tasks.rados.rados.2.smithi057.stdout:2719: done (1 left) 2020-11-16T22:12:07.428 INFO:tasks.rados.rados.2.smithi057.stdout:2721: done (0 left) 2020-11-16T22:12:07.428 INFO:tasks.rados.rados.2.smithi057.stdout:2722: snap_remove snap 305 2020-11-16T22:12:07.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:07 smithi057 bash[10301]: cluster 2020-11-16T22:12:05.783858+0000 mgr.x (mgr.24115) 584 : cluster [DBG] pgmap v1211: 17 pgs: 17 active+clean; 128 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2020-11-16T22:12:07.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:07 smithi057 bash[10301]: cluster 2020-11-16T22:12:06.119898+0000 mon.a (mon.0) 1368 : cluster [DBG] osdmap e698: 12 total, 12 up, 12 in 2020-11-16T22:12:07.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:07 smithi016 bash[10302]: cluster 2020-11-16T22:12:05.783858+0000 mgr.x (mgr.24115) 584 : cluster [DBG] pgmap v1211: 17 pgs: 17 active+clean; 128 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2020-11-16T22:12:07.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:07 smithi016 bash[10302]: cluster 2020-11-16T22:12:06.119898+0000 mon.a (mon.0) 1368 : cluster [DBG] osdmap e698: 12 total, 12 up, 12 in 2020-11-16T22:12:07.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:07 smithi195 bash[10218]: cluster 2020-11-16T22:12:05.783858+0000 mgr.x (mgr.24115) 584 : cluster [DBG] pgmap v1211: 17 pgs: 17 active+clean; 128 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2020-11-16T22:12:07.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:07 smithi195 bash[10218]: cluster 2020-11-16T22:12:06.119898+0000 mon.a (mon.0) 1368 : cluster [DBG] osdmap e698: 12 total, 12 up, 12 in 2020-11-16T22:12:08.201 INFO:tasks.rados.rados.2.smithi057.stdout:2722: done (0 left) 2020-11-16T22:12:08.201 INFO:tasks.rados.rados.2.smithi057.stdout:2723: copy_from oid 36 from oid 32 current snap is 313 2020-11-16T22:12:08.201 INFO:tasks.rados.rados.2.smithi057.stdout:2724: write oid 46 current snap is 313 2020-11-16T22:12:08.202 INFO:tasks.rados.rados.2.smithi057.stdout:2724: seq_num 920 ranges {662440=507793,1702728=749973,2881271=557193} 2020-11-16T22:12:08.208 INFO:tasks.rados.rados.2.smithi057.stdout:2724: writing smithi05720651-46 from 662440 to 1170233 tid 1 2020-11-16T22:12:08.216 INFO:tasks.rados.rados.2.smithi057.stdout:2724: writing smithi05720651-46 from 1702728 to 2452701 tid 2 2020-11-16T22:12:08.221 INFO:tasks.rados.rados.2.smithi057.stdout:2724: writing smithi05720651-46 from 2881271 to 3438464 tid 3 2020-11-16T22:12:08.222 INFO:tasks.rados.rados.2.smithi057.stdout:2725: write (excl) oid 30 current snap is 313 2020-11-16T22:12:08.222 INFO:tasks.rados.rados.2.smithi057.stdout:2725: seq_num 921 ranges {679247=583042,2044857=609984,3192341=286906} 2020-11-16T22:12:08.229 INFO:tasks.rados.rados.2.smithi057.stdout:2725: writing smithi05720651-30 from 679247 to 1262289 tid 1 2020-11-16T22:12:08.237 INFO:tasks.rados.rados.2.smithi057.stdout:2725: writing smithi05720651-30 from 2044857 to 2654841 tid 2 2020-11-16T22:12:08.242 INFO:tasks.rados.rados.2.smithi057.stdout:2725: writing smithi05720651-30 from 3192341 to 3479247 tid 3 2020-11-16T22:12:08.242 INFO:tasks.rados.rados.2.smithi057.stdout:2726: snap_create 2020-11-16T22:12:08.242 INFO:tasks.rados.rados.2.smithi057.stdout:2723: finishing copy_from to smithi05720651-36 2020-11-16T22:12:08.242 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 2085 (ObjNum 856 snap 289 seq_num 856) dirty exists 2020-11-16T22:12:08.242 INFO:tasks.rados.rados.2.smithi057.stdout:2723: finishing copy_from racing read to smithi05720651-36 2020-11-16T22:12:08.242 INFO:tasks.rados.rados.2.smithi057.stdout:2724: finishing write tid 1 to smithi05720651-46 2020-11-16T22:12:08.243 INFO:tasks.rados.rados.2.smithi057.stdout:2724: finishing write tid 2 to smithi05720651-46 2020-11-16T22:12:08.243 INFO:tasks.rados.rados.2.smithi057.stdout:2724: finishing write tid 3 to smithi05720651-46 2020-11-16T22:12:08.243 INFO:tasks.rados.rados.2.smithi057.stdout:2724: finishing write tid 5 to smithi05720651-46 2020-11-16T22:12:08.243 INFO:tasks.rados.rados.2.smithi057.stdout:2724: finishing write tid 6 to smithi05720651-46 2020-11-16T22:12:08.243 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 2171 (ObjNum 920 snap 313 seq_num 920) dirty exists 2020-11-16T22:12:08.243 INFO:tasks.rados.rados.2.smithi057.stdout:2724: left oid 46 (ObjNum 920 snap 313 seq_num 920) 2020-11-16T22:12:08.243 INFO:tasks.rados.rados.2.smithi057.stdout:2725: finishing write tid 1 to smithi05720651-30 2020-11-16T22:12:08.244 INFO:tasks.rados.rados.2.smithi057.stdout:2725: finishing write tid 2 to smithi05720651-30 2020-11-16T22:12:08.246 INFO:tasks.rados.rados.2.smithi057.stdout:2725: finishing write tid 3 to smithi05720651-30 2020-11-16T22:12:08.246 INFO:tasks.rados.rados.2.smithi057.stdout:2725: finishing write tid 5 to smithi05720651-30 2020-11-16T22:12:08.247 INFO:tasks.rados.rados.2.smithi057.stdout:2725: finishing write tid 6 to smithi05720651-30 2020-11-16T22:12:08.247 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 2175 (ObjNum 921 snap 313 seq_num 921) dirty exists 2020-11-16T22:12:08.247 INFO:tasks.rados.rados.2.smithi057.stdout:2725: left oid 30 (ObjNum 921 snap 313 seq_num 921) 2020-11-16T22:12:08.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:08 smithi057 bash[10301]: cluster 2020-11-16T22:12:07.194334+0000 mon.a (mon.0) 1369 : cluster [DBG] osdmap e699: 12 total, 12 up, 12 in 2020-11-16T22:12:08.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:08 smithi016 bash[10302]: cluster 2020-11-16T22:12:07.194334+0000 mon.a (mon.0) 1369 : cluster [DBG] osdmap e699: 12 total, 12 up, 12 in 2020-11-16T22:12:08.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:08 smithi195 bash[10218]: cluster 2020-11-16T22:12:07.194334+0000 mon.a (mon.0) 1369 : cluster [DBG] osdmap e699: 12 total, 12 up, 12 in 2020-11-16T22:12:09.205 INFO:tasks.rados.rados.2.smithi057.stdout:2723: done (3 left) 2020-11-16T22:12:09.205 INFO:tasks.rados.rados.2.smithi057.stdout:2724: done (2 left) 2020-11-16T22:12:09.205 INFO:tasks.rados.rados.2.smithi057.stdout:2725: done (1 left) 2020-11-16T22:12:09.206 INFO:tasks.rados.rados.2.smithi057.stdout:2726: done (0 left) 2020-11-16T22:12:09.206 INFO:tasks.rados.rados.2.smithi057.stdout:2727: snap_remove snap 312 2020-11-16T22:12:09.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:09 smithi057 bash[10301]: cluster 2020-11-16T22:12:07.784582+0000 mgr.x (mgr.24115) 585 : cluster [DBG] pgmap v1214: 17 pgs: 17 active+clean; 138 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.4 MiB/s wr, 15 op/s 2020-11-16T22:12:09.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:09 smithi057 bash[10301]: cluster 2020-11-16T22:12:08.204861+0000 mon.a (mon.0) 1370 : cluster [DBG] osdmap e700: 12 total, 12 up, 12 in 2020-11-16T22:12:09.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:09 smithi016 bash[10302]: cluster 2020-11-16T22:12:07.784582+0000 mgr.x (mgr.24115) 585 : cluster [DBG] pgmap v1214: 17 pgs: 17 active+clean; 138 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.4 MiB/s wr, 15 op/s 2020-11-16T22:12:09.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:09 smithi016 bash[10302]: cluster 2020-11-16T22:12:08.204861+0000 mon.a (mon.0) 1370 : cluster [DBG] osdmap e700: 12 total, 12 up, 12 in 2020-11-16T22:12:09.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:09 smithi195 bash[10218]: cluster 2020-11-16T22:12:07.784582+0000 mgr.x (mgr.24115) 585 : cluster [DBG] pgmap v1214: 17 pgs: 17 active+clean; 138 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.4 MiB/s wr, 15 op/s 2020-11-16T22:12:09.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:09 smithi195 bash[10218]: cluster 2020-11-16T22:12:08.204861+0000 mon.a (mon.0) 1370 : cluster [DBG] osdmap e700: 12 total, 12 up, 12 in 2020-11-16T22:12:10.099 INFO:tasks.rados.rados.2.smithi057.stdout:2727: done (0 left) 2020-11-16T22:12:10.100 INFO:tasks.rados.rados.2.smithi057.stdout:2728: copy_from oid 30 from oid 4 current snap is 314 2020-11-16T22:12:10.100 INFO:tasks.rados.rados.2.smithi057.stdout:2729: write (excl) oid 28 current snap is 314 2020-11-16T22:12:10.100 INFO:tasks.rados.rados.2.smithi057.stdout:2729: seq_num 922 ranges {696054=658291,2103339=753642} 2020-11-16T22:12:10.112 INFO:tasks.rados.rados.2.smithi057.stdout:2729: writing smithi05720651-28 from 696054 to 1354345 tid 1 2020-11-16T22:12:10.121 INFO:tasks.rados.rados.2.smithi057.stdout:2729: writing smithi05720651-28 from 2103339 to 2856981 tid 2 2020-11-16T22:12:10.121 INFO:tasks.rados.rados.2.smithi057.stdout:2730: copy_from oid 8 from oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 314 2020-11-16T22:12:10.122 INFO:tasks.rados.rados.2.smithi057.stdout:2728: finishing copy_from to smithi05720651-30 2020-11-16T22:12:10.122 INFO:tasks.rados.rados.2.smithi057.stdout:2728: got expected ENOENT (src dne) 2020-11-16T22:12:10.122 INFO:tasks.rados.rados.2.smithi057.stdout:2728: finishing copy_from racing read to smithi05720651-30 2020-11-16T22:12:10.122 INFO:tasks.rados.rados.2.smithi057.stdout:2729: finishing write tid 1 to smithi05720651-28 2020-11-16T22:12:10.122 INFO:tasks.rados.rados.2.smithi057.stdout:2728: done (2 left) 2020-11-16T22:12:10.122 INFO:tasks.rados.rados.2.smithi057.stdout:2731: delete oid 48 current snap is 314 2020-11-16T22:12:10.125 INFO:tasks.rados.rados.2.smithi057.stdout:2731: done (2 left) 2020-11-16T22:12:10.125 INFO:tasks.rados.rados.2.smithi057.stdout:2732: delete oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 314 2020-11-16T22:12:10.127 INFO:tasks.rados.rados.2.smithi057.stdout:2729: finishing write tid 2 to smithi05720651-28 2020-11-16T22:12:10.127 INFO:tasks.rados.rados.2.smithi057.stdout:2729: finishing write tid 4 to smithi05720651-28 2020-11-16T22:12:10.128 INFO:tasks.rados.rados.2.smithi057.stdout:2729: finishing write tid 5 to smithi05720651-28 2020-11-16T22:12:10.128 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 2088 (ObjNum 922 snap 314 seq_num 922) dirty exists 2020-11-16T22:12:10.128 INFO:tasks.rados.rados.2.smithi057.stdout:2729: left oid 28 (ObjNum 922 snap 314 seq_num 922) 2020-11-16T22:12:10.129 INFO:tasks.rados.rados.2.smithi057.stdout:2729: done (2 left) 2020-11-16T22:12:10.129 INFO:tasks.rados.rados.2.smithi057.stdout:2732: done (1 left) 2020-11-16T22:12:10.129 INFO:tasks.rados.rados.2.smithi057.stdout:2733: snap_remove snap 304 2020-11-16T22:12:10.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:10 smithi016 bash[10302]: cluster 2020-11-16T22:12:09.213967+0000 mon.a (mon.0) 1371 : cluster [DBG] osdmap e701: 12 total, 12 up, 12 in 2020-11-16T22:12:10.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:10 smithi016 bash[10302]: cluster 2020-11-16T22:12:10.110730+0000 mon.a (mon.0) 1372 : cluster [DBG] osdmap e702: 12 total, 12 up, 12 in 2020-11-16T22:12:10.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:10 smithi195 bash[10218]: cluster 2020-11-16T22:12:09.213967+0000 mon.a (mon.0) 1371 : cluster [DBG] osdmap e701: 12 total, 12 up, 12 in 2020-11-16T22:12:10.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:10 smithi195 bash[10218]: cluster 2020-11-16T22:12:10.110730+0000 mon.a (mon.0) 1372 : cluster [DBG] osdmap e702: 12 total, 12 up, 12 in 2020-11-16T22:12:10.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:10 smithi057 bash[10301]: cluster 2020-11-16T22:12:09.213967+0000 mon.a (mon.0) 1371 : cluster [DBG] osdmap e701: 12 total, 12 up, 12 in 2020-11-16T22:12:10.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:10 smithi057 bash[10301]: cluster 2020-11-16T22:12:10.110730+0000 mon.a (mon.0) 1372 : cluster [DBG] osdmap e702: 12 total, 12 up, 12 in 2020-11-16T22:12:11.112 INFO:tasks.rados.rados.2.smithi057.stdout:2733: done (1 left) 2020-11-16T22:12:11.113 INFO:tasks.rados.rados.2.smithi057.stdout:2734: write (excl) oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 314 2020-11-16T22:12:11.113 INFO:tasks.rados.rados.2.smithi057.stdout:2734: seq_num 925 ranges {746475=484038,1762432=617322,2785680=529906} 2020-11-16T22:12:11.120 INFO:tasks.rados.rados.2.smithi057.stdout:2734: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 746475 to 1230513 tid 1 2020-11-16T22:12:11.128 INFO:tasks.rados.rados.2.smithi057.stdout:2734: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1762432 to 2379754 tid 2 2020-11-16T22:12:11.133 INFO:tasks.rados.rados.2.smithi057.stdout:2734: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2785680 to 3315586 tid 3 2020-11-16T22:12:11.133 INFO:tasks.rados.rados.2.smithi057.stdout:2735: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:11.134 INFO:tasks.rados.rados.2.smithi057.stdout:2735: expect (ObjNum 896 snap 303 seq_num 896) 2020-11-16T22:12:11.134 INFO:tasks.rados.rados.2.smithi057.stdout:2736: read oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:11.134 INFO:tasks.rados.rados.2.smithi057.stdout:2736: expect (ObjNum 816 snap 279 seq_num 816) 2020-11-16T22:12:11.134 INFO:tasks.rados.rados.2.smithi057.stdout:2737: write oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 314 2020-11-16T22:12:11.134 INFO:tasks.rados.rados.2.smithi057.stdout:2737: seq_num 926 ranges {763282=559287,1820914=760980,3213103=350179} 2020-11-16T22:12:11.141 INFO:tasks.rados.rados.2.smithi057.stdout:2737: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 763282 to 1322569 tid 1 2020-11-16T22:12:11.150 INFO:tasks.rados.rados.2.smithi057.stdout:2737: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1820914 to 2581894 tid 2 2020-11-16T22:12:11.155 INFO:tasks.rados.rados.2.smithi057.stdout:2737: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3213103 to 3563282 tid 3 2020-11-16T22:12:11.156 INFO:tasks.rados.rados.2.smithi057.stdout:2738: copy_from oid 26 from oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 314 2020-11-16T22:12:11.156 INFO:tasks.rados.rados.2.smithi057.stdout:2730: finishing copy_from to smithi05720651-8 2020-11-16T22:12:11.156 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 1699 (ObjNum 760 snap 265 seq_num 760) dirty exists 2020-11-16T22:12:11.156 INFO:tasks.rados.rados.2.smithi057.stdout:2730: finishing copy_from racing read to smithi05720651-8 2020-11-16T22:12:11.156 INFO:tasks.rados.rados.2.smithi057.stdout:2734: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:11.156 INFO:tasks.rados.rados.2.smithi057.stdout:2734: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:11.156 INFO:tasks.rados.rados.2.smithi057.stdout:2734: finishing write tid 3 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:11.157 INFO:tasks.rados.rados.2.smithi057.stdout:2734: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:11.157 INFO:tasks.rados.rados.2.smithi057.stdout:2734: finishing write tid 6 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:11.157 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2167 (ObjNum 925 snap 314 seq_num 925) dirty exists 2020-11-16T22:12:11.157 INFO:tasks.rados.rados.2.smithi057.stdout:2734: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 925 snap 314 seq_num 925) 2020-11-16T22:12:11.157 INFO:tasks.rados.rados.2.smithi057.stdout:2735: expect (ObjNum 896 snap 303 seq_num 896) 2020-11-16T22:12:11.253 INFO:tasks.rados.rados.2.smithi057.stdout:2730: done (5 left) 2020-11-16T22:12:11.254 INFO:tasks.rados.rados.2.smithi057.stdout:2734: done (4 left) 2020-11-16T22:12:11.254 INFO:tasks.rados.rados.2.smithi057.stdout:2735: done (3 left) 2020-11-16T22:12:11.254 INFO:tasks.rados.rados.2.smithi057.stdout:2739: write oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 314 2020-11-16T22:12:11.254 INFO:tasks.rados.rados.2.smithi057.stdout:2739: seq_num 927 ranges {780089=634536,1879396=620991,3240526=339563} 2020-11-16T22:12:11.261 INFO:tasks.rados.rados.2.smithi057.stdout:2739: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 780089 to 1414625 tid 1 2020-11-16T22:12:11.268 INFO:tasks.rados.rados.2.smithi057.stdout:2739: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1879396 to 2500387 tid 2 2020-11-16T22:12:11.275 INFO:tasks.rados.rados.2.smithi057.stdout:2739: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3240526 to 3580089 tid 3 2020-11-16T22:12:11.275 INFO:tasks.rados.rados.2.smithi057.stdout:2740: delete oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 314 2020-11-16T22:12:11.275 INFO:tasks.rados.rados.2.smithi057.stdout:2737: finishing write tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:11.275 INFO:tasks.rados.rados.2.smithi057.stdout:2736: expect (ObjNum 816 snap 279 seq_num 816) 2020-11-16T22:12:11.547 INFO:tasks.rados.rados.2.smithi057.stdout:2737: finishing write tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:11.547 INFO:tasks.rados.rados.2.smithi057.stdout:2737: finishing write tid 3 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:11.547 INFO:tasks.rados.rados.2.smithi057.stdout:2737: finishing write tid 5 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:11.547 INFO:tasks.rados.rados.2.smithi057.stdout:2737: finishing write tid 6 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:11.547 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2179 (ObjNum 926 snap 314 seq_num 926) dirty exists 2020-11-16T22:12:11.547 INFO:tasks.rados.rados.2.smithi057.stdout:2737: left oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 926 snap 314 seq_num 926) 2020-11-16T22:12:11.548 INFO:tasks.rados.rados.2.smithi057.stdout:2738: finishing copy_from to smithi05720651-26 2020-11-16T22:12:11.548 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 1772 (ObjNum 902 snap 305 seq_num 902) dirty exists 2020-11-16T22:12:11.548 INFO:tasks.rados.rados.2.smithi057.stdout:2738: finishing copy_from racing read to smithi05720651-26 2020-11-16T22:12:11.548 INFO:tasks.rados.rados.2.smithi057.stdout:2739: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:11.548 INFO:tasks.rados.rados.2.smithi057.stdout:2739: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:11.548 INFO:tasks.rados.rados.2.smithi057.stdout:2739: finishing write tid 3 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:11.548 INFO:tasks.rados.rados.2.smithi057.stdout:2739: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:11.549 INFO:tasks.rados.rados.2.smithi057.stdout:2739: finishing write tid 6 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:11.549 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 176 (ObjNum 927 snap 314 seq_num 927) dirty exists 2020-11-16T22:12:11.549 INFO:tasks.rados.rados.2.smithi057.stdout:2739: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 927 snap 314 seq_num 927) 2020-11-16T22:12:11.549 INFO:tasks.rados.rados.2.smithi057.stdout:2736: done (4 left) 2020-11-16T22:12:11.549 INFO:tasks.rados.rados.2.smithi057.stdout:2737: done (3 left) 2020-11-16T22:12:11.549 INFO:tasks.rados.rados.2.smithi057.stdout:2738: done (2 left) 2020-11-16T22:12:11.549 INFO:tasks.rados.rados.2.smithi057.stdout:2739: done (1 left) 2020-11-16T22:12:11.550 INFO:tasks.rados.rados.2.smithi057.stdout:2740: done (0 left) 2020-11-16T22:12:11.550 INFO:tasks.rados.rados.2.smithi057.stdout:2741: copy_from oid 20 from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 314 2020-11-16T22:12:11.550 INFO:tasks.rados.rados.2.smithi057.stdout:2742: rollback oid 18 current snap is 314 2020-11-16T22:12:11.550 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 18 to 310 2020-11-16T22:12:11.550 INFO:tasks.rados.rados.2.smithi057.stdout:2743: snap_remove snap 313 2020-11-16T22:12:11.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:11 smithi016 bash[10302]: cluster 2020-11-16T22:12:09.785383+0000 mgr.x (mgr.24115) 586 : cluster [DBG] pgmap v1217: 17 pgs: 17 active+clean; 145 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 10 op/s 2020-11-16T22:12:11.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:11 smithi016 bash[10302]: cluster 2020-11-16T22:12:11.120967+0000 mon.a (mon.0) 1373 : cluster [DBG] osdmap e703: 12 total, 12 up, 12 in 2020-11-16T22:12:11.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:11 smithi195 bash[10218]: cluster 2020-11-16T22:12:09.785383+0000 mgr.x (mgr.24115) 586 : cluster [DBG] pgmap v1217: 17 pgs: 17 active+clean; 145 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 10 op/s 2020-11-16T22:12:11.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:11 smithi195 bash[10218]: cluster 2020-11-16T22:12:11.120967+0000 mon.a (mon.0) 1373 : cluster [DBG] osdmap e703: 12 total, 12 up, 12 in 2020-11-16T22:12:11.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:11 smithi057 bash[10301]: cluster 2020-11-16T22:12:09.785383+0000 mgr.x (mgr.24115) 586 : cluster [DBG] pgmap v1217: 17 pgs: 17 active+clean; 145 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 10 op/s 2020-11-16T22:12:11.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:11 smithi057 bash[10301]: cluster 2020-11-16T22:12:11.120967+0000 mon.a (mon.0) 1373 : cluster [DBG] osdmap e703: 12 total, 12 up, 12 in 2020-11-16T22:12:12.225 INFO:tasks.rados.rados.2.smithi057.stdout:2743: done (2 left) 2020-11-16T22:12:12.226 INFO:tasks.rados.rados.2.smithi057.stdout:2744: read oid 16 snap -1 2020-11-16T22:12:12.226 INFO:tasks.rados.rados.2.smithi057.stdout:2744: expect (ObjNum 878 snap 296 seq_num 878) 2020-11-16T22:12:12.226 INFO:tasks.rados.rados.2.smithi057.stdout:2745: snap_create 2020-11-16T22:12:12.226 INFO:tasks.rados.rados.2.smithi057.stdout:2741: finishing copy_from to smithi05720651-20 2020-11-16T22:12:12.226 INFO:tasks.rados.rados.2.smithi057.stdout:2741: got expected ENOENT (src dne) 2020-11-16T22:12:12.226 INFO:tasks.rados.rados.2.smithi057.stdout:2741: finishing copy_from racing read to smithi05720651-20 2020-11-16T22:12:12.227 INFO:tasks.rados.rados.2.smithi057.stdout:2742: finishing rollback tid 1 to smithi05720651-18 2020-11-16T22:12:12.227 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 0 (ObjNum 49 snap 0 seq_num 1) dirty dne 2020-11-16T22:12:12.239 INFO:tasks.rados.rados.2.smithi057.stdout:2744: expect (ObjNum 878 snap 296 seq_num 878) 2020-11-16T22:12:13.236 INFO:tasks.rados.rados.2.smithi057.stdout:2741: done (3 left) 2020-11-16T22:12:13.237 INFO:tasks.rados.rados.2.smithi057.stdout:2742: done (2 left) 2020-11-16T22:12:13.237 INFO:tasks.rados.rados.2.smithi057.stdout:2744: done (1 left) 2020-11-16T22:12:13.237 INFO:tasks.rados.rados.2.smithi057.stdout:2745: done (0 left) 2020-11-16T22:12:13.237 INFO:tasks.rados.rados.2.smithi057.stdout:2746: snap_remove snap 310 2020-11-16T22:12:13.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:13 smithi016 bash[10302]: cluster 2020-11-16T22:12:11.786143+0000 mgr.x (mgr.24115) 587 : cluster [DBG] pgmap v1220: 17 pgs: 17 active+clean; 147 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.2 MiB/s wr, 20 op/s 2020-11-16T22:12:13.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:13 smithi016 bash[10302]: cluster 2020-11-16T22:12:12.235353+0000 mon.a (mon.0) 1374 : cluster [DBG] osdmap e704: 12 total, 12 up, 12 in 2020-11-16T22:12:13.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:13 smithi195 bash[10218]: cluster 2020-11-16T22:12:11.786143+0000 mgr.x (mgr.24115) 587 : cluster [DBG] pgmap v1220: 17 pgs: 17 active+clean; 147 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.2 MiB/s wr, 20 op/s 2020-11-16T22:12:13.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:13 smithi195 bash[10218]: cluster 2020-11-16T22:12:12.235353+0000 mon.a (mon.0) 1374 : cluster [DBG] osdmap e704: 12 total, 12 up, 12 in 2020-11-16T22:12:13.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:13 smithi057 bash[10301]: cluster 2020-11-16T22:12:11.786143+0000 mgr.x (mgr.24115) 587 : cluster [DBG] pgmap v1220: 17 pgs: 17 active+clean; 147 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 4.2 MiB/s wr, 20 op/s 2020-11-16T22:12:13.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:13 smithi057 bash[10301]: cluster 2020-11-16T22:12:12.235353+0000 mon.a (mon.0) 1374 : cluster [DBG] osdmap e704: 12 total, 12 up, 12 in 2020-11-16T22:12:14.253 INFO:tasks.rados.rados.2.smithi057.stdout:2746: done (0 left) 2020-11-16T22:12:14.253 INFO:tasks.rados.rados.2.smithi057.stdout:2747: copy_from oid 18 from oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 315 2020-11-16T22:12:14.253 INFO:tasks.rados.rados.2.smithi057.stdout:2748: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:14.253 INFO:tasks.rados.rados.2.smithi057.stdout:2748: expect (ObjNum 925 snap 314 seq_num 925) 2020-11-16T22:12:14.253 INFO:tasks.rados.rados.2.smithi057.stdout:2749: copy_from oid 4 from oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 315 2020-11-16T22:12:14.254 INFO:tasks.rados.rados.2.smithi057.stdout:2750: delete oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 315 2020-11-16T22:12:14.260 INFO:tasks.rados.rados.2.smithi057.stdout:2749: finishing copy_from to smithi05720651-4 2020-11-16T22:12:14.260 INFO:tasks.rados.rados.2.smithi057.stdout:2749: got expected ENOENT (src dne) 2020-11-16T22:12:14.260 INFO:tasks.rados.rados.2.smithi057.stdout:2749: finishing copy_from racing read to smithi05720651-4 2020-11-16T22:12:14.263 INFO:tasks.rados.rados.2.smithi057.stdout:2747: finishing copy_from to smithi05720651-18 2020-11-16T22:12:14.263 INFO:tasks.rados.rados.2.smithi057.stdout:2747: got expected ENOENT (src dne) 2020-11-16T22:12:14.263 INFO:tasks.rados.rados.2.smithi057.stdout:2747: finishing copy_from racing read to smithi05720651-18 2020-11-16T22:12:14.264 INFO:tasks.rados.rados.2.smithi057.stdout:2747: done (3 left) 2020-11-16T22:12:14.264 INFO:tasks.rados.rados.2.smithi057.stdout:2749: done (2 left) 2020-11-16T22:12:14.264 INFO:tasks.rados.rados.2.smithi057.stdout:2750: done (1 left) 2020-11-16T22:12:14.264 INFO:tasks.rados.rados.2.smithi057.stdout:2751: snap_create 2020-11-16T22:12:14.268 INFO:tasks.rados.rados.2.smithi057.stdout:2748: expect (ObjNum 925 snap 314 seq_num 925) 2020-11-16T22:12:14.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:14 smithi016 bash[10302]: cluster 2020-11-16T22:12:13.245153+0000 mon.a (mon.0) 1375 : cluster [DBG] osdmap e705: 12 total, 12 up, 12 in 2020-11-16T22:12:14.588 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 22:12:14 smithi016 bash[15120]: debug 2020-11-16T22:12:14.281+0000 7f8fc2db1700 -1 osd.5 pg_epoch: 706 pg[2.3( v 706'2022 (0'0,706'2022] local-lis/les=71/72 n=8 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [5,2] r=0 lpr=71 crt=706'2022 lcod 706'2020 mlcod 706'2020 active+clean+snaptrim trimq=[26c~1] ps=[261~2,26d~2,271~1]] removing snap head 2020-11-16T22:12:14.588 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 22:12:14 smithi016 bash[17468]: debug 2020-11-16T22:12:14.305+0000 7fd6636dc700 -1 osd.6 pg_epoch: 706 pg[2.7( v 703'876 (0'0,703'876] local-lis/les=71/72 n=3 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [6,10] r=0 lpr=71 crt=703'876 lcod 702'874 mlcod 702'874 active+clean+snaptrim trimq=[26c~1] ps=[261~2,26d~2,271~1]] removing snap head 2020-11-16T22:12:14.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:14 smithi195 bash[10218]: cluster 2020-11-16T22:12:13.245153+0000 mon.a (mon.0) 1375 : cluster [DBG] osdmap e705: 12 total, 12 up, 12 in 2020-11-16T22:12:14.600 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:12:14 smithi195 bash[18679]: debug 2020-11-16T22:12:14.264+0000 7f9945603700 -1 osd.1 pg_epoch: 706 pg[2.9( v 704'2226 (0'0,704'2226] local-lis/les=71/72 n=11 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,7] r=0 lpr=71 crt=704'2226 lcod 704'2224 mlcod 704'2224 active+clean+snaptrim trimq=[26c~1] ps=[261~2,26d~2,271~1]] removing snap head 2020-11-16T22:12:14.600 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:12:14 smithi195 bash[18679]: debug 2020-11-16T22:12:14.268+0000 7f9946e06700 -1 osd.1 pg_epoch: 706 pg[2.6( v 703'520 (0'0,703'520] local-lis/les=71/72 n=2 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [1,8] r=0 lpr=71 crt=703'519 lcod 703'519 mlcod 703'519 active+clean+snaptrim trimq=[26c~1] ps=[261~2,26d~2,271~1]] removing snap head 2020-11-16T22:12:14.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:14 smithi057 bash[10301]: cluster 2020-11-16T22:12:13.245153+0000 mon.a (mon.0) 1375 : cluster [DBG] osdmap e705: 12 total, 12 up, 12 in 2020-11-16T22:12:14.694 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:12:14 smithi057 bash[19569]: debug 2020-11-16T22:12:14.266+0000 7f5e11115700 -1 osd.11 pg_epoch: 706 pg[2.c( v 704'476 (0'0,704'476] local-lis/les=71/72 n=2 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [11,0] r=0 lpr=71 crt=704'476 lcod 703'474 mlcod 703'474 active+clean+snaptrim trimq=[26c~1] ps=[261~2,26d~2,271~1]] removing snap head 2020-11-16T22:12:15.105 INFO:tasks.rados.rados.2.smithi057.stdout:2748: done (1 left) 2020-11-16T22:12:15.105 INFO:tasks.rados.rados.2.smithi057.stdout:2751: done (0 left) 2020-11-16T22:12:15.105 INFO:tasks.rados.rados.2.smithi057.stdout:2752: snap_create 2020-11-16T22:12:15.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:15 smithi016 bash[10302]: cluster 2020-11-16T22:12:13.786797+0000 mgr.x (mgr.24115) 588 : cluster [DBG] pgmap v1223: 17 pgs: 17 active+clean; 146 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2020-11-16T22:12:15.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:15 smithi016 bash[10302]: cluster 2020-11-16T22:12:14.255310+0000 mon.a (mon.0) 1376 : cluster [DBG] osdmap e706: 12 total, 12 up, 12 in 2020-11-16T22:12:15.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:15 smithi016 bash[10302]: cluster 2020-11-16T22:12:15.112531+0000 mon.a (mon.0) 1377 : cluster [DBG] osdmap e707: 12 total, 12 up, 12 in 2020-11-16T22:12:15.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:15 smithi195 bash[10218]: cluster 2020-11-16T22:12:13.786797+0000 mgr.x (mgr.24115) 588 : cluster [DBG] pgmap v1223: 17 pgs: 17 active+clean; 146 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2020-11-16T22:12:15.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:15 smithi195 bash[10218]: cluster 2020-11-16T22:12:14.255310+0000 mon.a (mon.0) 1376 : cluster [DBG] osdmap e706: 12 total, 12 up, 12 in 2020-11-16T22:12:15.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:15 smithi195 bash[10218]: cluster 2020-11-16T22:12:15.112531+0000 mon.a (mon.0) 1377 : cluster [DBG] osdmap e707: 12 total, 12 up, 12 in 2020-11-16T22:12:15.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:15 smithi057 bash[10301]: cluster 2020-11-16T22:12:13.786797+0000 mgr.x (mgr.24115) 588 : cluster [DBG] pgmap v1223: 17 pgs: 17 active+clean; 146 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2020-11-16T22:12:15.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:15 smithi057 bash[10301]: cluster 2020-11-16T22:12:14.255310+0000 mon.a (mon.0) 1376 : cluster [DBG] osdmap e706: 12 total, 12 up, 12 in 2020-11-16T22:12:15.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:15 smithi057 bash[10301]: cluster 2020-11-16T22:12:15.112531+0000 mon.a (mon.0) 1377 : cluster [DBG] osdmap e707: 12 total, 12 up, 12 in 2020-11-16T22:12:16.118 INFO:tasks.rados.rados.2.smithi057.stdout:2752: done (0 left) 2020-11-16T22:12:16.119 INFO:tasks.rados.rados.2.smithi057.stdout:2753: rollback oid 8 current snap is 317 2020-11-16T22:12:16.119 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 8 to 315 2020-11-16T22:12:16.119 INFO:tasks.rados.rados.2.smithi057.stdout:2754: snap_create 2020-11-16T22:12:16.128 INFO:tasks.rados.rados.2.smithi057.stdout:2753: finishing rollback tid 0 to smithi05720651-8 2020-11-16T22:12:16.129 INFO:tasks.rados.rados.2.smithi057.stdout:2753: finishing rollback tid 1 to smithi05720651-8 2020-11-16T22:12:16.129 INFO:tasks.rados.rados.2.smithi057.stdout:2753: finishing rollback tid 2 to smithi05720651-8 2020-11-16T22:12:16.130 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 1702 (ObjNum 760 snap 265 seq_num 760) dirty exists 2020-11-16T22:12:17.128 INFO:tasks.rados.rados.2.smithi057.stdout:2753: done (1 left) 2020-11-16T22:12:17.128 INFO:tasks.rados.rados.2.smithi057.stdout:2754: done (0 left) 2020-11-16T22:12:17.128 INFO:tasks.rados.rados.2.smithi057.stdout:2755: delete oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 318 2020-11-16T22:12:17.132 INFO:tasks.rados.rados.2.smithi057.stdout:2755: done (0 left) 2020-11-16T22:12:17.132 INFO:tasks.rados.rados.2.smithi057.stdout:2756: delete oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 318 2020-11-16T22:12:17.135 INFO:tasks.rados.rados.2.smithi057.stdout:2756: done (0 left) 2020-11-16T22:12:17.135 INFO:tasks.rados.rados.2.smithi057.stdout:2757: snap_create 2020-11-16T22:12:17.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:17 smithi057 bash[10301]: cluster 2020-11-16T22:12:15.787626+0000 mgr.x (mgr.24115) 589 : cluster [DBG] pgmap v1226: 17 pgs: 17 active+clean; 130 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2020-11-16T22:12:17.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:17 smithi057 bash[10301]: cluster 2020-11-16T22:12:16.124704+0000 mon.a (mon.0) 1378 : cluster [DBG] osdmap e708: 12 total, 12 up, 12 in 2020-11-16T22:12:17.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:17 smithi016 bash[10302]: cluster 2020-11-16T22:12:15.787626+0000 mgr.x (mgr.24115) 589 : cluster [DBG] pgmap v1226: 17 pgs: 17 active+clean; 130 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2020-11-16T22:12:17.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:17 smithi016 bash[10302]: cluster 2020-11-16T22:12:16.124704+0000 mon.a (mon.0) 1378 : cluster [DBG] osdmap e708: 12 total, 12 up, 12 in 2020-11-16T22:12:17.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:17 smithi195 bash[10218]: cluster 2020-11-16T22:12:15.787626+0000 mgr.x (mgr.24115) 589 : cluster [DBG] pgmap v1226: 17 pgs: 17 active+clean; 130 MiB data, 656 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2020-11-16T22:12:17.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:17 smithi195 bash[10218]: cluster 2020-11-16T22:12:16.124704+0000 mon.a (mon.0) 1378 : cluster [DBG] osdmap e708: 12 total, 12 up, 12 in 2020-11-16T22:12:18.135 INFO:tasks.rados.rados.2.smithi057.stdout:2757: done (0 left) 2020-11-16T22:12:18.136 INFO:tasks.rados.rados.2.smithi057.stdout:2758: delete oid 38 current snap is 319 2020-11-16T22:12:18.142 INFO:tasks.rados.rados.2.smithi057.stdout:2758: done (0 left) 2020-11-16T22:12:18.143 INFO:tasks.rados.rados.2.smithi057.stdout:2759: read oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:18.143 INFO:tasks.rados.rados.2.smithi057.stdout:2759: expect (ObjNum 899 snap 303 seq_num 899) 2020-11-16T22:12:18.143 INFO:tasks.rados.rados.2.smithi057.stdout:2760: snap_create 2020-11-16T22:12:18.155 INFO:tasks.rados.rados.2.smithi057.stdout:2759: expect (ObjNum 899 snap 303 seq_num 899) 2020-11-16T22:12:18.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:18 smithi057 bash[10301]: cluster 2020-11-16T22:12:17.134894+0000 mon.a (mon.0) 1379 : cluster [DBG] osdmap e709: 12 total, 12 up, 12 in 2020-11-16T22:12:18.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:18 smithi016 bash[10302]: cluster 2020-11-16T22:12:17.134894+0000 mon.a (mon.0) 1379 : cluster [DBG] osdmap e709: 12 total, 12 up, 12 in 2020-11-16T22:12:18.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:18 smithi195 bash[10218]: cluster 2020-11-16T22:12:17.134894+0000 mon.a (mon.0) 1379 : cluster [DBG] osdmap e709: 12 total, 12 up, 12 in 2020-11-16T22:12:19.141 INFO:tasks.rados.rados.2.smithi057.stdout:2759: done (1 left) 2020-11-16T22:12:19.141 INFO:tasks.rados.rados.2.smithi057.stdout:2760: done (0 left) 2020-11-16T22:12:19.141 INFO:tasks.rados.rados.2.smithi057.stdout:2761: snap_create 2020-11-16T22:12:19.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:19 smithi057 bash[10301]: cluster 2020-11-16T22:12:17.788352+0000 mgr.x (mgr.24115) 590 : cluster [DBG] pgmap v1229: 17 pgs: 17 active+clean; 113 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 2.2 MiB/s wr, 11 op/s 2020-11-16T22:12:19.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:19 smithi057 bash[10301]: cluster 2020-11-16T22:12:18.145018+0000 mon.a (mon.0) 1380 : cluster [DBG] osdmap e710: 12 total, 12 up, 12 in 2020-11-16T22:12:19.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:19 smithi016 bash[10302]: cluster 2020-11-16T22:12:17.788352+0000 mgr.x (mgr.24115) 590 : cluster [DBG] pgmap v1229: 17 pgs: 17 active+clean; 113 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 2.2 MiB/s wr, 11 op/s 2020-11-16T22:12:19.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:19 smithi016 bash[10302]: cluster 2020-11-16T22:12:18.145018+0000 mon.a (mon.0) 1380 : cluster [DBG] osdmap e710: 12 total, 12 up, 12 in 2020-11-16T22:12:19.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:19 smithi195 bash[10218]: cluster 2020-11-16T22:12:17.788352+0000 mgr.x (mgr.24115) 590 : cluster [DBG] pgmap v1229: 17 pgs: 17 active+clean; 113 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 2.2 MiB/s wr, 11 op/s 2020-11-16T22:12:19.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:19 smithi195 bash[10218]: cluster 2020-11-16T22:12:18.145018+0000 mon.a (mon.0) 1380 : cluster [DBG] osdmap e710: 12 total, 12 up, 12 in 2020-11-16T22:12:20.111 INFO:tasks.rados.rados.2.smithi057.stdout:2761: done (0 left) 2020-11-16T22:12:20.111 INFO:tasks.rados.rados.2.smithi057.stdout:2762: write oid 14 current snap is 321 2020-11-16T22:12:20.112 INFO:tasks.rados.rados.2.smithi057.stdout:2762: seq_num 933 ranges {480931=402383,1313935=515645,2488711=452788,3443230=237701} 2020-11-16T22:12:20.119 INFO:tasks.rados.rados.2.smithi057.stdout:2762: writing smithi05720651-14 from 480931 to 883314 tid 1 2020-11-16T22:12:20.124 INFO:tasks.rados.rados.2.smithi057.stdout:2762: writing smithi05720651-14 from 1313935 to 1829580 tid 2 2020-11-16T22:12:20.131 INFO:tasks.rados.rados.2.smithi057.stdout:2762: writing smithi05720651-14 from 2488711 to 2941499 tid 3 2020-11-16T22:12:20.135 INFO:tasks.rados.rados.2.smithi057.stdout:2762: writing smithi05720651-14 from 3443230 to 3680931 tid 4 2020-11-16T22:12:20.135 INFO:tasks.rados.rados.2.smithi057.stdout:2763: write oid 24 current snap is 321 2020-11-16T22:12:20.136 INFO:tasks.rados.rados.2.smithi057.stdout:2763: seq_num 934 ranges {497738=477632,1772417=775656,3316134=381604} 2020-11-16T22:12:20.141 INFO:tasks.rados.rados.2.smithi057.stdout:2763: writing smithi05720651-24 from 497738 to 975370 tid 1 2020-11-16T22:12:20.149 INFO:tasks.rados.rados.2.smithi057.stdout:2763: writing smithi05720651-24 from 1772417 to 2548073 tid 2 2020-11-16T22:12:20.156 INFO:tasks.rados.rados.2.smithi057.stdout:2763: writing smithi05720651-24 from 3316134 to 3697738 tid 3 2020-11-16T22:12:20.156 INFO:tasks.rados.rados.2.smithi057.stdout:2764: snap_create 2020-11-16T22:12:20.156 INFO:tasks.rados.rados.2.smithi057.stdout:2762: finishing write tid 1 to smithi05720651-14 2020-11-16T22:12:20.156 INFO:tasks.rados.rados.2.smithi057.stdout:2762: finishing write tid 2 to smithi05720651-14 2020-11-16T22:12:20.157 INFO:tasks.rados.rados.2.smithi057.stdout:2762: finishing write tid 3 to smithi05720651-14 2020-11-16T22:12:20.157 INFO:tasks.rados.rados.2.smithi057.stdout:2762: finishing write tid 4 to smithi05720651-14 2020-11-16T22:12:20.157 INFO:tasks.rados.rados.2.smithi057.stdout:2762: finishing write tid 6 to smithi05720651-14 2020-11-16T22:12:20.157 INFO:tasks.rados.rados.2.smithi057.stdout:2762: finishing write tid 7 to smithi05720651-14 2020-11-16T22:12:20.157 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 2238 (ObjNum 933 snap 321 seq_num 933) dirty exists 2020-11-16T22:12:20.157 INFO:tasks.rados.rados.2.smithi057.stdout:2762: left oid 14 (ObjNum 933 snap 321 seq_num 933) 2020-11-16T22:12:20.157 INFO:tasks.rados.rados.2.smithi057.stdout:2763: finishing write tid 1 to smithi05720651-24 2020-11-16T22:12:20.158 INFO:tasks.rados.rados.2.smithi057.stdout:2763: finishing write tid 2 to smithi05720651-24 2020-11-16T22:12:20.160 INFO:tasks.rados.rados.2.smithi057.stdout:2763: finishing write tid 3 to smithi05720651-24 2020-11-16T22:12:20.160 INFO:tasks.rados.rados.2.smithi057.stdout:2763: finishing write tid 5 to smithi05720651-24 2020-11-16T22:12:20.160 INFO:tasks.rados.rados.2.smithi057.stdout:2763: finishing write tid 6 to smithi05720651-24 2020-11-16T22:12:20.160 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 1706 (ObjNum 934 snap 321 seq_num 934) dirty exists 2020-11-16T22:12:20.160 INFO:tasks.rados.rados.2.smithi057.stdout:2763: left oid 24 (ObjNum 934 snap 321 seq_num 934) 2020-11-16T22:12:20.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:20 smithi057 bash[10301]: cluster 2020-11-16T22:12:19.146994+0000 mon.a (mon.0) 1381 : cluster [DBG] osdmap e711: 12 total, 12 up, 12 in 2020-11-16T22:12:20.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:20 smithi057 bash[10301]: cluster 2020-11-16T22:12:20.114263+0000 mon.a (mon.0) 1382 : cluster [DBG] osdmap e712: 12 total, 12 up, 12 in 2020-11-16T22:12:20.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:20 smithi016 bash[10302]: cluster 2020-11-16T22:12:19.146994+0000 mon.a (mon.0) 1381 : cluster [DBG] osdmap e711: 12 total, 12 up, 12 in 2020-11-16T22:12:20.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:20 smithi016 bash[10302]: cluster 2020-11-16T22:12:20.114263+0000 mon.a (mon.0) 1382 : cluster [DBG] osdmap e712: 12 total, 12 up, 12 in 2020-11-16T22:12:20.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:20 smithi195 bash[10218]: cluster 2020-11-16T22:12:19.146994+0000 mon.a (mon.0) 1381 : cluster [DBG] osdmap e711: 12 total, 12 up, 12 in 2020-11-16T22:12:20.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:20 smithi195 bash[10218]: cluster 2020-11-16T22:12:20.114263+0000 mon.a (mon.0) 1382 : cluster [DBG] osdmap e712: 12 total, 12 up, 12 in 2020-11-16T22:12:21.171 INFO:tasks.rados.rados.2.smithi057.stdout:2762: done (2 left) 2020-11-16T22:12:21.171 INFO:tasks.rados.rados.2.smithi057.stdout:2763: done (1 left) 2020-11-16T22:12:21.171 INFO:tasks.rados.rados.2.smithi057.stdout:2764: done (0 left) 2020-11-16T22:12:21.172 INFO:tasks.rados.rados.2.smithi057.stdout:2765: write oid 14 current snap is 322 2020-11-16T22:12:21.172 INFO:tasks.rados.rados.2.smithi057.stdout:2765: seq_num 935 ranges {514545=552881,1830899=519314,2943557=475332} 2020-11-16T22:12:21.182 INFO:tasks.rados.rados.2.smithi057.stdout:2765: writing smithi05720651-14 from 514545 to 1067426 tid 1 2020-11-16T22:12:21.191 INFO:tasks.rados.rados.2.smithi057.stdout:2765: writing smithi05720651-14 from 1830899 to 2350213 tid 2 2020-11-16T22:12:21.197 INFO:tasks.rados.rados.2.smithi057.stdout:2765: writing smithi05720651-14 from 2943557 to 3418889 tid 3 2020-11-16T22:12:21.197 INFO:tasks.rados.rados.2.smithi057.stdout:2766: snap_remove snap 317 2020-11-16T22:12:21.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:21 smithi057 bash[10301]: cluster 2020-11-16T22:12:19.789035+0000 mgr.x (mgr.24115) 591 : cluster [DBG] pgmap v1232: 17 pgs: 17 active+clean; 113 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:12:21.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:21 smithi016 bash[10302]: cluster 2020-11-16T22:12:19.789035+0000 mgr.x (mgr.24115) 591 : cluster [DBG] pgmap v1232: 17 pgs: 17 active+clean; 113 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:12:21.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:21 smithi195 bash[10218]: cluster 2020-11-16T22:12:19.789035+0000 mgr.x (mgr.24115) 591 : cluster [DBG] pgmap v1232: 17 pgs: 17 active+clean; 113 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail 2020-11-16T22:12:22.184 INFO:tasks.rados.rados.2.smithi057.stdout:2766: done (1 left) 2020-11-16T22:12:22.184 INFO:tasks.rados.rados.2.smithi057.stdout:2767: delete oid 8 current snap is 322 2020-11-16T22:12:22.185 INFO:tasks.rados.rados.2.smithi057.stdout:2765: finishing write tid 1 to smithi05720651-14 2020-11-16T22:12:22.185 INFO:tasks.rados.rados.2.smithi057.stdout:2765: finishing write tid 2 to smithi05720651-14 2020-11-16T22:12:22.185 INFO:tasks.rados.rados.2.smithi057.stdout:2765: finishing write tid 3 to smithi05720651-14 2020-11-16T22:12:22.185 INFO:tasks.rados.rados.2.smithi057.stdout:2765: finishing write tid 5 to smithi05720651-14 2020-11-16T22:12:22.185 INFO:tasks.rados.rados.2.smithi057.stdout:2765: finishing write tid 6 to smithi05720651-14 2020-11-16T22:12:22.185 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 2243 (ObjNum 935 snap 322 seq_num 935) dirty exists 2020-11-16T22:12:22.186 INFO:tasks.rados.rados.2.smithi057.stdout:2765: left oid 14 (ObjNum 935 snap 322 seq_num 935) 2020-11-16T22:12:22.191 INFO:tasks.rados.rados.2.smithi057.stdout:2765: done (1 left) 2020-11-16T22:12:22.191 INFO:tasks.rados.rados.2.smithi057.stdout:2767: done (0 left) 2020-11-16T22:12:22.191 INFO:tasks.rados.rados.2.smithi057.stdout:2768: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:22.192 INFO:tasks.rados.rados.2.smithi057.stdout:2768: expect deleted 2020-11-16T22:12:22.192 INFO:tasks.rados.rados.2.smithi057.stdout:2769: copy_from oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 48 current snap is 322 2020-11-16T22:12:22.192 INFO:tasks.rados.rados.2.smithi057.stdout:2770: snap_create 2020-11-16T22:12:22.197 INFO:tasks.rados.rados.2.smithi057.stdout:2769: finishing copy_from to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:22.198 INFO:tasks.rados.rados.2.smithi057.stdout:2769: got expected ENOENT (src dne) 2020-11-16T22:12:22.198 INFO:tasks.rados.rados.2.smithi057.stdout:2769: finishing copy_from racing read to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:22.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:22 smithi057 bash[10301]: cluster 2020-11-16T22:12:21.177374+0000 mon.a (mon.0) 1383 : cluster [DBG] osdmap e713: 12 total, 12 up, 12 in 2020-11-16T22:12:22.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:22 smithi016 bash[10302]: cluster 2020-11-16T22:12:21.177374+0000 mon.a (mon.0) 1383 : cluster [DBG] osdmap e713: 12 total, 12 up, 12 in 2020-11-16T22:12:22.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:22 smithi195 bash[10218]: cluster 2020-11-16T22:12:21.177374+0000 mon.a (mon.0) 1383 : cluster [DBG] osdmap e713: 12 total, 12 up, 12 in 2020-11-16T22:12:23.192 INFO:tasks.rados.rados.2.smithi057.stdout:2768: done (2 left) 2020-11-16T22:12:23.192 INFO:tasks.rados.rados.2.smithi057.stdout:2769: done (1 left) 2020-11-16T22:12:23.193 INFO:tasks.rados.rados.2.smithi057.stdout:2770: done (0 left) 2020-11-16T22:12:23.193 INFO:tasks.rados.rados.2.smithi057.stdout:2771: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:23.194 INFO:tasks.rados.rados.2.smithi057.stdout:2771: expect deleted 2020-11-16T22:12:23.194 INFO:tasks.rados.rados.2.smithi057.stdout:2772: write (excl) oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 323 2020-11-16T22:12:23.194 INFO:tasks.rados.rados.2.smithi057.stdout:2772: seq_num 937 ranges {548159=419732,1664216=522983,2714756=614229} 2020-11-16T22:12:23.204 INFO:tasks.rados.rados.2.smithi057.stdout:2772: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 548159 to 967891 tid 1 2020-11-16T22:12:23.211 INFO:tasks.rados.rados.2.smithi057.stdout:2772: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1664216 to 2187199 tid 2 2020-11-16T22:12:23.218 INFO:tasks.rados.rados.2.smithi057.stdout:2772: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2714756 to 3328985 tid 3 2020-11-16T22:12:23.218 INFO:tasks.rados.rados.2.smithi057.stdout:2773: write (excl) oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 323 2020-11-16T22:12:23.218 INFO:tasks.rados.rados.2.smithi057.stdout:2773: seq_num 938 ranges {564966=494981,1606345=782994,3025826=425501} 2020-11-16T22:12:23.224 INFO:tasks.rados.rados.2.smithi057.stdout:2773: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 564966 to 1059947 tid 1 2020-11-16T22:12:23.231 INFO:tasks.rados.rados.2.smithi057.stdout:2773: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1606345 to 2389339 tid 2 2020-11-16T22:12:23.237 INFO:tasks.rados.rados.2.smithi057.stdout:2773: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3025826 to 3451327 tid 3 2020-11-16T22:12:23.238 INFO:tasks.rados.rados.2.smithi057.stdout:2774: snap_create 2020-11-16T22:12:23.238 INFO:tasks.rados.rados.2.smithi057.stdout:2772: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:23.238 INFO:tasks.rados.rados.2.smithi057.stdout:2772: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:23.238 INFO:tasks.rados.rados.2.smithi057.stdout:2772: finishing write tid 3 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:23.238 INFO:tasks.rados.rados.2.smithi057.stdout:2772: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:23.238 INFO:tasks.rados.rados.2.smithi057.stdout:2772: finishing write tid 6 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:23.239 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2171 (ObjNum 937 snap 323 seq_num 937) dirty exists 2020-11-16T22:12:23.239 INFO:tasks.rados.rados.2.smithi057.stdout:2772: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 937 snap 323 seq_num 937) 2020-11-16T22:12:23.239 INFO:tasks.rados.rados.2.smithi057.stdout:2773: finishing write tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:23.239 INFO:tasks.rados.rados.2.smithi057.stdout:2773: finishing write tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:23.242 INFO:tasks.rados.rados.2.smithi057.stdout:2773: finishing write tid 3 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:23.243 INFO:tasks.rados.rados.2.smithi057.stdout:2773: finishing write tid 5 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:23.243 INFO:tasks.rados.rados.2.smithi057.stdout:2773: finishing write tid 6 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:23.243 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1711 (ObjNum 938 snap 323 seq_num 938) dirty exists 2020-11-16T22:12:23.243 INFO:tasks.rados.rados.2.smithi057.stdout:2773: left oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 938 snap 323 seq_num 938) 2020-11-16T22:12:23.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:23 smithi057 bash[10301]: cluster 2020-11-16T22:12:21.789849+0000 mgr.x (mgr.24115) 592 : cluster [DBG] pgmap v1235: 17 pgs: 17 active+clean; 117 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 771 KiB/s wr, 6 op/s 2020-11-16T22:12:23.470 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:23 smithi057 bash[10301]: cluster 2020-11-16T22:12:22.189902+0000 mon.a (mon.0) 1384 : cluster [DBG] osdmap e714: 12 total, 12 up, 12 in 2020-11-16T22:12:23.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:23 smithi016 bash[10302]: cluster 2020-11-16T22:12:21.789849+0000 mgr.x (mgr.24115) 592 : cluster [DBG] pgmap v1235: 17 pgs: 17 active+clean; 117 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 771 KiB/s wr, 6 op/s 2020-11-16T22:12:23.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:23 smithi016 bash[10302]: cluster 2020-11-16T22:12:22.189902+0000 mon.a (mon.0) 1384 : cluster [DBG] osdmap e714: 12 total, 12 up, 12 in 2020-11-16T22:12:23.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:23 smithi195 bash[10218]: cluster 2020-11-16T22:12:21.789849+0000 mgr.x (mgr.24115) 592 : cluster [DBG] pgmap v1235: 17 pgs: 17 active+clean; 117 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 771 KiB/s wr, 6 op/s 2020-11-16T22:12:23.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:23 smithi195 bash[10218]: cluster 2020-11-16T22:12:22.189902+0000 mon.a (mon.0) 1384 : cluster [DBG] osdmap e714: 12 total, 12 up, 12 in 2020-11-16T22:12:24.200 INFO:tasks.rados.rados.2.smithi057.stdout:2771: done (3 left) 2020-11-16T22:12:24.201 INFO:tasks.rados.rados.2.smithi057.stdout:2772: done (2 left) 2020-11-16T22:12:24.201 INFO:tasks.rados.rados.2.smithi057.stdout:2773: done (1 left) 2020-11-16T22:12:24.201 INFO:tasks.rados.rados.2.smithi057.stdout:2774: done (0 left) 2020-11-16T22:12:24.201 INFO:tasks.rados.rados.2.smithi057.stdout:2775: delete oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 324 2020-11-16T22:12:24.225 INFO:tasks.rados.rados.2.smithi057.stdout:2775: done (0 left) 2020-11-16T22:12:24.225 INFO:tasks.rados.rados.2.smithi057.stdout:2776: write (excl) oid 20 current snap is 324 2020-11-16T22:12:24.225 INFO:tasks.rados.rados.2.smithi057.stdout:2776: seq_num 940 ranges {598580=645479,1723309=786663,3080672=448045} 2020-11-16T22:12:24.241 INFO:tasks.rados.rados.2.smithi057.stdout:2776: writing smithi05720651-20 from 598580 to 1244059 tid 1 2020-11-16T22:12:24.248 INFO:tasks.rados.rados.2.smithi057.stdout:2776: writing smithi05720651-20 from 1723309 to 2509972 tid 2 2020-11-16T22:12:24.254 INFO:tasks.rados.rados.2.smithi057.stdout:2776: writing smithi05720651-20 from 3080672 to 3528717 tid 3 2020-11-16T22:12:24.255 INFO:tasks.rados.rados.2.smithi057.stdout:2777: write (excl) oid 38 current snap is 324 2020-11-16T22:12:24.255 INFO:tasks.rados.rados.2.smithi057.stdout:2777: seq_num 941 ranges {615387=720728,1781791=530321,3108095=707292} 2020-11-16T22:12:24.263 INFO:tasks.rados.rados.2.smithi057.stdout:2777: writing smithi05720651-38 from 615387 to 1336115 tid 1 2020-11-16T22:12:24.268 INFO:tasks.rados.rados.2.smithi057.stdout:2777: writing smithi05720651-38 from 1781791 to 2312112 tid 2 2020-11-16T22:12:24.277 INFO:tasks.rados.rados.2.smithi057.stdout:2777: writing smithi05720651-38 from 3108095 to 3815387 tid 3 2020-11-16T22:12:24.277 INFO:tasks.rados.rados.2.smithi057.stdout:2778: snap_remove snap 318 2020-11-16T22:12:24.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:24 smithi057 bash[10301]: cluster 2020-11-16T22:12:23.200296+0000 mon.a (mon.0) 1385 : cluster [DBG] osdmap e715: 12 total, 12 up, 12 in 2020-11-16T22:12:24.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:24 smithi016 bash[10302]: cluster 2020-11-16T22:12:23.200296+0000 mon.a (mon.0) 1385 : cluster [DBG] osdmap e715: 12 total, 12 up, 12 in 2020-11-16T22:12:24.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:24 smithi195 bash[10218]: cluster 2020-11-16T22:12:23.200296+0000 mon.a (mon.0) 1385 : cluster [DBG] osdmap e715: 12 total, 12 up, 12 in 2020-11-16T22:12:25.222 INFO:tasks.rados.rados.2.smithi057.stdout:2778: done (2 left) 2020-11-16T22:12:25.223 INFO:tasks.rados.rados.2.smithi057.stdout:2779: rollback oid 34 current snap is 324 2020-11-16T22:12:25.223 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 34 to 320 2020-11-16T22:12:25.223 INFO:tasks.rados.rados.2.smithi057.stdout:2776: finishing write tid 1 to smithi05720651-20 2020-11-16T22:12:25.223 INFO:tasks.rados.rados.2.smithi057.stdout:2776: finishing write tid 2 to smithi05720651-20 2020-11-16T22:12:25.223 INFO:tasks.rados.rados.2.smithi057.stdout:2776: finishing write tid 3 to smithi05720651-20 2020-11-16T22:12:25.223 INFO:tasks.rados.rados.2.smithi057.stdout:2776: finishing write tid 5 to smithi05720651-20 2020-11-16T22:12:25.224 INFO:tasks.rados.rados.2.smithi057.stdout:2776: finishing write tid 6 to smithi05720651-20 2020-11-16T22:12:25.224 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 1794 (ObjNum 940 snap 324 seq_num 940) dirty exists 2020-11-16T22:12:25.224 INFO:tasks.rados.rados.2.smithi057.stdout:2776: left oid 20 (ObjNum 940 snap 324 seq_num 940) 2020-11-16T22:12:25.224 INFO:tasks.rados.rados.2.smithi057.stdout:2777: finishing write tid 1 to smithi05720651-38 2020-11-16T22:12:25.224 INFO:tasks.rados.rados.2.smithi057.stdout:2776: done (2 left) 2020-11-16T22:12:25.224 INFO:tasks.rados.rados.2.smithi057.stdout:2780: copy_from oid 10 from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 324 2020-11-16T22:12:25.224 INFO:tasks.rados.rados.2.smithi057.stdout:2777: finishing write tid 2 to smithi05720651-38 2020-11-16T22:12:25.225 INFO:tasks.rados.rados.2.smithi057.stdout:2777: finishing write tid 3 to smithi05720651-38 2020-11-16T22:12:25.225 INFO:tasks.rados.rados.2.smithi057.stdout:2777: finishing write tid 5 to smithi05720651-38 2020-11-16T22:12:25.225 INFO:tasks.rados.rados.2.smithi057.stdout:2777: finishing write tid 6 to smithi05720651-38 2020-11-16T22:12:25.225 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 1795 (ObjNum 941 snap 324 seq_num 941) dirty exists 2020-11-16T22:12:25.225 INFO:tasks.rados.rados.2.smithi057.stdout:2777: left oid 38 (ObjNum 941 snap 324 seq_num 941) 2020-11-16T22:12:25.225 INFO:tasks.rados.rados.2.smithi057.stdout:2777: done (2 left) 2020-11-16T22:12:25.225 INFO:tasks.rados.rados.2.smithi057.stdout:2781: copy_from oid 2 from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 324 2020-11-16T22:12:25.225 INFO:tasks.rados.rados.2.smithi057.stdout:2782: snap_remove snap 323 2020-11-16T22:12:25.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:25 smithi016 bash[10302]: cluster 2020-11-16T22:12:23.790619+0000 mgr.x (mgr.24115) 593 : cluster [DBG] pgmap v1238: 17 pgs: 17 active+clean; 117 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 771 KiB/s wr, 6 op/s 2020-11-16T22:12:25.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:25 smithi016 bash[10302]: cluster 2020-11-16T22:12:24.209357+0000 mon.a (mon.0) 1386 : cluster [DBG] osdmap e716: 12 total, 12 up, 12 in 2020-11-16T22:12:25.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:25 smithi195 bash[10218]: cluster 2020-11-16T22:12:23.790619+0000 mgr.x (mgr.24115) 593 : cluster [DBG] pgmap v1238: 17 pgs: 17 active+clean; 117 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 771 KiB/s wr, 6 op/s 2020-11-16T22:12:25.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:25 smithi195 bash[10218]: cluster 2020-11-16T22:12:24.209357+0000 mon.a (mon.0) 1386 : cluster [DBG] osdmap e716: 12 total, 12 up, 12 in 2020-11-16T22:12:25.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:25 smithi057 bash[10301]: cluster 2020-11-16T22:12:23.790619+0000 mgr.x (mgr.24115) 593 : cluster [DBG] pgmap v1238: 17 pgs: 17 active+clean; 117 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 771 KiB/s wr, 6 op/s 2020-11-16T22:12:25.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:25 smithi057 bash[10301]: cluster 2020-11-16T22:12:24.209357+0000 mon.a (mon.0) 1386 : cluster [DBG] osdmap e716: 12 total, 12 up, 12 in 2020-11-16T22:12:26.224 INFO:tasks.rados.rados.2.smithi057.stdout:2782: done (3 left) 2020-11-16T22:12:26.225 INFO:tasks.rados.rados.2.smithi057.stdout:2783: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:26.225 INFO:tasks.rados.rados.2.smithi057.stdout:2783: expect (ObjNum 896 snap 303 seq_num 896) 2020-11-16T22:12:26.225 INFO:tasks.rados.rados.2.smithi057.stdout:2784: write (excl) oid 32 current snap is 324 2020-11-16T22:12:26.225 INFO:tasks.rados.rados.2.smithi057.stdout:2784: seq_num 942 ranges {632194=795977,2123920=790332,3419165=413029} 2020-11-16T22:12:26.239 INFO:tasks.rados.rados.2.smithi057.stdout:2784: writing smithi05720651-32 from 632194 to 1428171 tid 1 2020-11-16T22:12:26.247 INFO:tasks.rados.rados.2.smithi057.stdout:2784: writing smithi05720651-32 from 2123920 to 2914252 tid 2 2020-11-16T22:12:26.253 INFO:tasks.rados.rados.2.smithi057.stdout:2784: writing smithi05720651-32 from 3419165 to 3832194 tid 3 2020-11-16T22:12:26.253 INFO:tasks.rados.rados.2.smithi057.stdout:2785: delete oid 22 current snap is 324 2020-11-16T22:12:26.253 INFO:tasks.rados.rados.2.smithi057.stdout:2779: finishing rollback tid 1 to smithi05720651-34 2020-11-16T22:12:26.253 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 0 (ObjNum 145 snap 0 seq_num 2932544368) dirty dne 2020-11-16T22:12:26.253 INFO:tasks.rados.rados.2.smithi057.stdout:2780: finishing copy_from to smithi05720651-10 2020-11-16T22:12:26.253 INFO:tasks.rados.rados.2.smithi057.stdout:2780: got expected ENOENT (src dne) 2020-11-16T22:12:26.254 INFO:tasks.rados.rados.2.smithi057.stdout:2780: finishing copy_from racing read to smithi05720651-10 2020-11-16T22:12:26.254 INFO:tasks.rados.rados.2.smithi057.stdout:2781: finishing copy_from to smithi05720651-2 2020-11-16T22:12:26.254 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 2162 (ObjNum 876 snap 296 seq_num 876) dirty exists 2020-11-16T22:12:26.254 INFO:tasks.rados.rados.2.smithi057.stdout:2781: finishing copy_from racing read to smithi05720651-2 2020-11-16T22:12:26.254 INFO:tasks.rados.rados.2.smithi057.stdout:2783: expect (ObjNum 896 snap 303 seq_num 896) 2020-11-16T22:12:26.358 INFO:tasks.rados.rados.2.smithi057.stdout:2784: finishing write tid 1 to smithi05720651-32 2020-11-16T22:12:26.358 INFO:tasks.rados.rados.2.smithi057.stdout:2784: finishing write tid 2 to smithi05720651-32 2020-11-16T22:12:26.358 INFO:tasks.rados.rados.2.smithi057.stdout:2784: finishing write tid 3 to smithi05720651-32 2020-11-16T22:12:26.358 INFO:tasks.rados.rados.2.smithi057.stdout:2784: finishing write tid 5 to smithi05720651-32 2020-11-16T22:12:26.358 INFO:tasks.rados.rados.2.smithi057.stdout:2784: finishing write tid 6 to smithi05720651-32 2020-11-16T22:12:26.359 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 2256 (ObjNum 942 snap 324 seq_num 942) dirty exists 2020-11-16T22:12:26.359 INFO:tasks.rados.rados.2.smithi057.stdout:2784: left oid 32 (ObjNum 942 snap 324 seq_num 942) 2020-11-16T22:12:26.359 INFO:tasks.rados.rados.2.smithi057.stdout:2779: done (5 left) 2020-11-16T22:12:26.359 INFO:tasks.rados.rados.2.smithi057.stdout:2780: done (4 left) 2020-11-16T22:12:26.359 INFO:tasks.rados.rados.2.smithi057.stdout:2781: done (3 left) 2020-11-16T22:12:26.359 INFO:tasks.rados.rados.2.smithi057.stdout:2783: done (2 left) 2020-11-16T22:12:26.359 INFO:tasks.rados.rados.2.smithi057.stdout:2784: done (1 left) 2020-11-16T22:12:26.360 INFO:tasks.rados.rados.2.smithi057.stdout:2785: done (0 left) 2020-11-16T22:12:26.360 INFO:tasks.rados.rados.2.smithi057.stdout:2786: read oid 12 snap 320 2020-11-16T22:12:26.360 INFO:tasks.rados.rados.2.smithi057.stdout:2786: expect (ObjNum 816 snap 279 seq_num 816) 2020-11-16T22:12:26.360 INFO:tasks.rados.rados.2.smithi057.stdout:2787: delete oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 324 2020-11-16T22:12:26.363 INFO:tasks.rados.rados.2.smithi057.stdout:2787: done (1 left) 2020-11-16T22:12:26.363 INFO:tasks.rados.rados.2.smithi057.stdout:2788: read oid 46 snap 319 2020-11-16T22:12:26.364 INFO:tasks.rados.rados.2.smithi057.stdout:2788: expect (ObjNum 920 snap 313 seq_num 920) 2020-11-16T22:12:26.364 INFO:tasks.rados.rados.2.smithi057.stdout:2789: delete oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 324 2020-11-16T22:12:26.367 INFO:tasks.rados.rados.2.smithi057.stdout:2786: expect (ObjNum 816 snap 279 seq_num 816) 2020-11-16T22:12:26.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:26 smithi016 bash[10302]: cluster 2020-11-16T22:12:25.222723+0000 mon.a (mon.0) 1387 : cluster [DBG] osdmap e717: 12 total, 12 up, 12 in 2020-11-16T22:12:26.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:26 smithi195 bash[10218]: cluster 2020-11-16T22:12:25.222723+0000 mon.a (mon.0) 1387 : cluster [DBG] osdmap e717: 12 total, 12 up, 12 in 2020-11-16T22:12:26.631 INFO:tasks.rados.rados.2.smithi057.stdout:2788: expect (ObjNum 920 snap 313 seq_num 920) 2020-11-16T22:12:26.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:26 smithi057 bash[10301]: cluster 2020-11-16T22:12:25.222723+0000 mon.a (mon.0) 1387 : cluster [DBG] osdmap e717: 12 total, 12 up, 12 in 2020-11-16T22:12:26.731 INFO:tasks.rados.rados.2.smithi057.stdout:2786: done (2 left) 2020-11-16T22:12:26.732 INFO:tasks.rados.rados.2.smithi057.stdout:2788: done (1 left) 2020-11-16T22:12:26.732 INFO:tasks.rados.rados.2.smithi057.stdout:2789: done (0 left) 2020-11-16T22:12:26.732 INFO:tasks.rados.rados.2.smithi057.stdout:2790: snap_create 2020-11-16T22:12:27.227 INFO:tasks.rados.rados.2.smithi057.stdout:2790: done (0 left) 2020-11-16T22:12:27.228 INFO:tasks.rados.rados.2.smithi057.stdout:2791: snap_remove snap 324 2020-11-16T22:12:27.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:27 smithi016 bash[10302]: cluster 2020-11-16T22:12:25.791342+0000 mgr.x (mgr.24115) 594 : cluster [DBG] pgmap v1241: 17 pgs: 17 active+clean; 124 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.2 MiB/s wr, 5 op/s 2020-11-16T22:12:27.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:27 smithi016 bash[10302]: cluster 2020-11-16T22:12:26.232054+0000 mon.a (mon.0) 1388 : cluster [DBG] osdmap e718: 12 total, 12 up, 12 in 2020-11-16T22:12:27.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:27 smithi195 bash[10218]: cluster 2020-11-16T22:12:25.791342+0000 mgr.x (mgr.24115) 594 : cluster [DBG] pgmap v1241: 17 pgs: 17 active+clean; 124 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.2 MiB/s wr, 5 op/s 2020-11-16T22:12:27.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:27 smithi195 bash[10218]: cluster 2020-11-16T22:12:26.232054+0000 mon.a (mon.0) 1388 : cluster [DBG] osdmap e718: 12 total, 12 up, 12 in 2020-11-16T22:12:27.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:27 smithi057 bash[10301]: cluster 2020-11-16T22:12:25.791342+0000 mgr.x (mgr.24115) 594 : cluster [DBG] pgmap v1241: 17 pgs: 17 active+clean; 124 MiB data, 633 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.2 MiB/s wr, 5 op/s 2020-11-16T22:12:27.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:27 smithi057 bash[10301]: cluster 2020-11-16T22:12:26.232054+0000 mon.a (mon.0) 1388 : cluster [DBG] osdmap e718: 12 total, 12 up, 12 in 2020-11-16T22:12:28.248 INFO:tasks.rados.rados.2.smithi057.stdout:2791: done (0 left) 2020-11-16T22:12:28.248 INFO:tasks.rados.rados.2.smithi057.stdout:2792: snap_remove snap 320 2020-11-16T22:12:28.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:28 smithi016 bash[10302]: cluster 2020-11-16T22:12:27.234215+0000 mon.a (mon.0) 1389 : cluster [DBG] osdmap e719: 12 total, 12 up, 12 in 2020-11-16T22:12:28.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:28 smithi195 bash[10218]: cluster 2020-11-16T22:12:27.234215+0000 mon.a (mon.0) 1389 : cluster [DBG] osdmap e719: 12 total, 12 up, 12 in 2020-11-16T22:12:28.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:28 smithi057 bash[10301]: cluster 2020-11-16T22:12:27.234215+0000 mon.a (mon.0) 1389 : cluster [DBG] osdmap e719: 12 total, 12 up, 12 in 2020-11-16T22:12:29.248 INFO:tasks.rados.rados.2.smithi057.stdout:2792: done (0 left) 2020-11-16T22:12:29.248 INFO:tasks.rados.rados.2.smithi057.stdout:2793: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:29.249 INFO:tasks.rados.rados.2.smithi057.stdout:2793: expect deleted 2020-11-16T22:12:29.249 INFO:tasks.rados.rados.2.smithi057.stdout:2794: read oid 42 snap -1 2020-11-16T22:12:29.249 INFO:tasks.rados.rados.2.smithi057.stdout:2794: expect (ObjNum 901 snap 303 seq_num 901) 2020-11-16T22:12:29.249 INFO:tasks.rados.rados.2.smithi057.stdout:2795: snap_create 2020-11-16T22:12:29.264 INFO:tasks.rados.rados.2.smithi057.stdout:2794: expect (ObjNum 901 snap 303 seq_num 901) 2020-11-16T22:12:29.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:29 smithi016 bash[10302]: cluster 2020-11-16T22:12:27.792141+0000 mgr.x (mgr.24115) 595 : cluster [DBG] pgmap v1244: 17 pgs: 17 active+clean; 135 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 13 op/s 2020-11-16T22:12:29.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:29 smithi016 bash[10302]: cluster 2020-11-16T22:12:28.254230+0000 mon.a (mon.0) 1390 : cluster [DBG] osdmap e720: 12 total, 12 up, 12 in 2020-11-16T22:12:29.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:29 smithi195 bash[10218]: cluster 2020-11-16T22:12:27.792141+0000 mgr.x (mgr.24115) 595 : cluster [DBG] pgmap v1244: 17 pgs: 17 active+clean; 135 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 13 op/s 2020-11-16T22:12:29.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:29 smithi195 bash[10218]: cluster 2020-11-16T22:12:28.254230+0000 mon.a (mon.0) 1390 : cluster [DBG] osdmap e720: 12 total, 12 up, 12 in 2020-11-16T22:12:29.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:29 smithi057 bash[10301]: cluster 2020-11-16T22:12:27.792141+0000 mgr.x (mgr.24115) 595 : cluster [DBG] pgmap v1244: 17 pgs: 17 active+clean; 135 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 13 op/s 2020-11-16T22:12:29.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:29 smithi057 bash[10301]: cluster 2020-11-16T22:12:28.254230+0000 mon.a (mon.0) 1390 : cluster [DBG] osdmap e720: 12 total, 12 up, 12 in 2020-11-16T22:12:30.112 INFO:tasks.rados.rados.2.smithi057.stdout:2793: done (2 left) 2020-11-16T22:12:30.113 INFO:tasks.rados.rados.2.smithi057.stdout:2794: done (1 left) 2020-11-16T22:12:30.113 INFO:tasks.rados.rados.2.smithi057.stdout:2795: done (0 left) 2020-11-16T22:12:30.113 INFO:tasks.rados.rados.2.smithi057.stdout:2796: delete oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 326 2020-11-16T22:12:30.124 INFO:tasks.rados.rados.2.smithi057.stdout:2796: done (0 left) 2020-11-16T22:12:30.124 INFO:tasks.rados.rados.2.smithi057.stdout:2797: snap_create 2020-11-16T22:12:30.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:30 smithi016 bash[10302]: cluster 2020-11-16T22:12:29.257436+0000 mon.a (mon.0) 1391 : cluster [DBG] osdmap e721: 12 total, 12 up, 12 in 2020-11-16T22:12:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:30 smithi016 bash[10302]: audit 2020-11-16T22:12:29.785298+0000 mon.b (mon.1) 312 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:12:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:30 smithi016 bash[10302]: audit 2020-11-16T22:12:29.785930+0000 mon.b (mon.1) 313 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:12:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:30 smithi016 bash[10302]: audit 2020-11-16T22:12:29.786688+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:12:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:30 smithi016 bash[10302]: audit 2020-11-16T22:12:29.787316+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:12:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:30 smithi016 bash[10302]: cluster 2020-11-16T22:12:30.118346+0000 mon.a (mon.0) 1394 : cluster [DBG] osdmap e722: 12 total, 12 up, 12 in 2020-11-16T22:12:30.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:30 smithi195 bash[10218]: cluster 2020-11-16T22:12:29.257436+0000 mon.a (mon.0) 1391 : cluster [DBG] osdmap e721: 12 total, 12 up, 12 in 2020-11-16T22:12:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:30 smithi195 bash[10218]: audit 2020-11-16T22:12:29.785298+0000 mon.b (mon.1) 312 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:12:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:30 smithi195 bash[10218]: audit 2020-11-16T22:12:29.785930+0000 mon.b (mon.1) 313 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:12:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:30 smithi195 bash[10218]: audit 2020-11-16T22:12:29.786688+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:12:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:30 smithi195 bash[10218]: audit 2020-11-16T22:12:29.787316+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:12:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:30 smithi195 bash[10218]: cluster 2020-11-16T22:12:30.118346+0000 mon.a (mon.0) 1394 : cluster [DBG] osdmap e722: 12 total, 12 up, 12 in 2020-11-16T22:12:30.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:30 smithi057 bash[10301]: cluster 2020-11-16T22:12:29.257436+0000 mon.a (mon.0) 1391 : cluster [DBG] osdmap e721: 12 total, 12 up, 12 in 2020-11-16T22:12:30.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:30 smithi057 bash[10301]: audit 2020-11-16T22:12:29.785298+0000 mon.b (mon.1) 312 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:12:30.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:30 smithi057 bash[10301]: audit 2020-11-16T22:12:29.785930+0000 mon.b (mon.1) 313 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:12:30.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:30 smithi057 bash[10301]: audit 2020-11-16T22:12:29.786688+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:12:30.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:30 smithi057 bash[10301]: audit 2020-11-16T22:12:29.787316+0000 mon.a (mon.0) 1393 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:12:30.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:30 smithi057 bash[10301]: cluster 2020-11-16T22:12:30.118346+0000 mon.a (mon.0) 1394 : cluster [DBG] osdmap e722: 12 total, 12 up, 12 in 2020-11-16T22:12:31.126 INFO:tasks.rados.rados.2.smithi057.stdout:2797: done (0 left) 2020-11-16T22:12:31.126 INFO:tasks.rados.rados.2.smithi057.stdout:2798: copy_from oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 327 2020-11-16T22:12:31.127 INFO:tasks.rados.rados.2.smithi057.stdout:2799: delete oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 327 2020-11-16T22:12:31.136 INFO:tasks.rados.rados.2.smithi057.stdout:2799: done (1 left) 2020-11-16T22:12:31.137 INFO:tasks.rados.rados.2.smithi057.stdout:2800: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:31.137 INFO:tasks.rados.rados.2.smithi057.stdout:2800: expect (ObjNum 938 snap 323 seq_num 938) 2020-11-16T22:12:31.137 INFO:tasks.rados.rados.2.smithi057.stdout:2801: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:31.137 INFO:tasks.rados.rados.2.smithi057.stdout:2801: expect deleted 2020-11-16T22:12:31.138 INFO:tasks.rados.rados.2.smithi057.stdout:2802: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:31.138 INFO:tasks.rados.rados.2.smithi057.stdout:2802: expect deleted 2020-11-16T22:12:31.138 INFO:tasks.rados.rados.2.smithi057.stdout:2803: rollback oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 327 2020-11-16T22:12:31.138 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 326 2020-11-16T22:12:31.138 INFO:tasks.rados.rados.2.smithi057.stdout:2804: snap_create 2020-11-16T22:12:31.139 INFO:tasks.rados.rados.2.smithi057.stdout:2803: finishing rollback tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:31.139 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 353 snap 0 seq_num 1953066355) dirty dne 2020-11-16T22:12:31.153 INFO:tasks.rados.rados.2.smithi057.stdout:2798: finishing copy_from to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:31.153 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2179 (ObjNum 926 snap 314 seq_num 926) dirty exists 2020-11-16T22:12:31.154 INFO:tasks.rados.rados.2.smithi057.stdout:2798: finishing copy_from racing read to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:31.155 INFO:tasks.rados.rados.2.smithi057.stdout:2800: expect (ObjNum 938 snap 323 seq_num 938) 2020-11-16T22:12:31.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:31 smithi016 bash[10302]: cluster 2020-11-16T22:12:29.792651+0000 mgr.x (mgr.24115) 596 : cluster [DBG] pgmap v1247: 17 pgs: 17 active+clean; 135 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2020-11-16T22:12:31.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:31 smithi016 bash[10302]: cluster 2020-11-16T22:12:31.131950+0000 mon.a (mon.0) 1395 : cluster [DBG] osdmap e723: 12 total, 12 up, 12 in 2020-11-16T22:12:31.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:31 smithi195 bash[10218]: cluster 2020-11-16T22:12:29.792651+0000 mgr.x (mgr.24115) 596 : cluster [DBG] pgmap v1247: 17 pgs: 17 active+clean; 135 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2020-11-16T22:12:31.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:31 smithi195 bash[10218]: cluster 2020-11-16T22:12:31.131950+0000 mon.a (mon.0) 1395 : cluster [DBG] osdmap e723: 12 total, 12 up, 12 in 2020-11-16T22:12:31.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:31 smithi057 bash[10301]: cluster 2020-11-16T22:12:29.792651+0000 mgr.x (mgr.24115) 596 : cluster [DBG] pgmap v1247: 17 pgs: 17 active+clean; 135 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2020-11-16T22:12:31.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:31 smithi057 bash[10301]: cluster 2020-11-16T22:12:31.131950+0000 mon.a (mon.0) 1395 : cluster [DBG] osdmap e723: 12 total, 12 up, 12 in 2020-11-16T22:12:32.125 INFO:tasks.rados.rados.2.smithi057.stdout:2798: done (5 left) 2020-11-16T22:12:32.125 INFO:tasks.rados.rados.2.smithi057.stdout:2800: done (4 left) 2020-11-16T22:12:32.125 INFO:tasks.rados.rados.2.smithi057.stdout:2801: done (3 left) 2020-11-16T22:12:32.125 INFO:tasks.rados.rados.2.smithi057.stdout:2802: done (2 left) 2020-11-16T22:12:32.126 INFO:tasks.rados.rados.2.smithi057.stdout:2803: done (1 left) 2020-11-16T22:12:32.126 INFO:tasks.rados.rados.2.smithi057.stdout:2804: done (0 left) 2020-11-16T22:12:32.126 INFO:tasks.rados.rados.2.smithi057.stdout:2805: snap_remove snap 327 2020-11-16T22:12:33.134 INFO:tasks.rados.rados.2.smithi057.stdout:2805: done (0 left) 2020-11-16T22:12:33.135 INFO:tasks.rados.rados.2.smithi057.stdout:2806: copy_from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 328 2020-11-16T22:12:33.135 INFO:tasks.rados.rados.2.smithi057.stdout:2807: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:33.135 INFO:tasks.rados.rados.2.smithi057.stdout:2807: expect deleted 2020-11-16T22:12:33.135 INFO:tasks.rados.rados.2.smithi057.stdout:2808: copy_from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 30 current snap is 328 2020-11-16T22:12:33.135 INFO:tasks.rados.rados.2.smithi057.stdout:2809: read oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:33.135 INFO:tasks.rados.rados.2.smithi057.stdout:2809: expect (ObjNum 927 snap 314 seq_num 927) 2020-11-16T22:12:33.136 INFO:tasks.rados.rados.2.smithi057.stdout:2810: write oid 40 current snap is 328 2020-11-16T22:12:33.136 INFO:tasks.rados.rados.2.smithi057.stdout:2810: seq_num 948 ranges {733036=563824,2074812=684986,3183703=749333} 2020-11-16T22:12:33.150 INFO:tasks.rados.rados.2.smithi057.stdout:2810: writing smithi05720651-40 from 733036 to 1296860 tid 1 2020-11-16T22:12:33.158 INFO:tasks.rados.rados.2.smithi057.stdout:2810: writing smithi05720651-40 from 2074812 to 2759798 tid 2 2020-11-16T22:12:33.165 INFO:tasks.rados.rados.2.smithi057.stdout:2810: writing smithi05720651-40 from 3183703 to 3933036 tid 3 2020-11-16T22:12:33.165 INFO:tasks.rados.rados.2.smithi057.stdout:2811: copy_from oid 4 from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 328 2020-11-16T22:12:33.165 INFO:tasks.rados.rados.2.smithi057.stdout:2809: expect (ObjNum 927 snap 314 seq_num 927) 2020-11-16T22:12:33.276 INFO:tasks.rados.rados.2.smithi057.stdout:2810: finishing write tid 1 to smithi05720651-40 2020-11-16T22:12:33.276 INFO:tasks.rados.rados.2.smithi057.stdout:2808: finishing copy_from to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:33.277 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2175 (ObjNum 921 snap 313 seq_num 921) dirty exists 2020-11-16T22:12:33.277 INFO:tasks.rados.rados.2.smithi057.stdout:2806: finishing copy_from to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:33.277 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2167 (ObjNum 916 snap 313 seq_num 916) dirty exists 2020-11-16T22:12:33.277 INFO:tasks.rados.rados.2.smithi057.stdout:2808: finishing copy_from racing read to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:33.277 INFO:tasks.rados.rados.2.smithi057.stdout:2806: finishing copy_from racing read to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:33.277 INFO:tasks.rados.rados.2.smithi057.stdout:2810: finishing write tid 2 to smithi05720651-40 2020-11-16T22:12:33.278 INFO:tasks.rados.rados.2.smithi057.stdout:2806: done (5 left) 2020-11-16T22:12:33.278 INFO:tasks.rados.rados.2.smithi057.stdout:2807: done (4 left) 2020-11-16T22:12:33.278 INFO:tasks.rados.rados.2.smithi057.stdout:2808: done (3 left) 2020-11-16T22:12:33.278 INFO:tasks.rados.rados.2.smithi057.stdout:2809: done (2 left) 2020-11-16T22:12:33.278 INFO:tasks.rados.rados.2.smithi057.stdout:2812: write (excl) oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 328 2020-11-16T22:12:33.278 INFO:tasks.rados.rados.2.smithi057.stdout:2812: seq_num 949 ranges {749843=639073,2133294=544997,3211126=582199} 2020-11-16T22:12:33.284 INFO:tasks.rados.rados.2.smithi057.stdout:2812: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 749843 to 1388916 tid 1 2020-11-16T22:12:33.293 INFO:tasks.rados.rados.2.smithi057.stdout:2812: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2133294 to 2678291 tid 2 2020-11-16T22:12:33.299 INFO:tasks.rados.rados.2.smithi057.stdout:2812: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3211126 to 3793325 tid 3 2020-11-16T22:12:33.299 INFO:tasks.rados.rados.2.smithi057.stdout:2813: read oid 20 snap -1 2020-11-16T22:12:33.300 INFO:tasks.rados.rados.2.smithi057.stdout:2813: expect (ObjNum 940 snap 324 seq_num 940) 2020-11-16T22:12:33.300 INFO:tasks.rados.rados.2.smithi057.stdout:2814: rollback oid 8 current snap is 328 2020-11-16T22:12:33.300 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 8 to 326 2020-11-16T22:12:33.300 INFO:tasks.rados.rados.2.smithi057.stdout:2811: finishing copy_from to smithi05720651-4 2020-11-16T22:12:33.300 INFO:tasks.rados.rados.2.smithi057.stdout:2811: got expected ENOENT (src dne) 2020-11-16T22:12:33.300 INFO:tasks.rados.rados.2.smithi057.stdout:2811: finishing copy_from racing read to smithi05720651-4 2020-11-16T22:12:33.300 INFO:tasks.rados.rados.2.smithi057.stdout:2810: finishing write tid 3 to smithi05720651-40 2020-11-16T22:12:33.301 INFO:tasks.rados.rados.2.smithi057.stdout:2810: finishing write tid 5 to smithi05720651-40 2020-11-16T22:12:33.301 INFO:tasks.rados.rados.2.smithi057.stdout:2810: finishing write tid 6 to smithi05720651-40 2020-11-16T22:12:33.301 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 2267 (ObjNum 948 snap 328 seq_num 948) dirty exists 2020-11-16T22:12:33.301 INFO:tasks.rados.rados.2.smithi057.stdout:2810: left oid 40 (ObjNum 948 snap 328 seq_num 948) 2020-11-16T22:12:33.301 INFO:tasks.rados.rados.2.smithi057.stdout:2812: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:33.301 INFO:tasks.rados.rados.2.smithi057.stdout:2812: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:33.301 INFO:tasks.rados.rados.2.smithi057.stdout:2810: done (4 left) 2020-11-16T22:12:33.302 INFO:tasks.rados.rados.2.smithi057.stdout:2811: done (3 left) 2020-11-16T22:12:33.302 INFO:tasks.rados.rados.2.smithi057.stdout:2815: snap_remove snap 316 2020-11-16T22:12:33.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:33 smithi057 bash[10301]: cluster 2020-11-16T22:12:31.793372+0000 mgr.x (mgr.24115) 597 : cluster [DBG] pgmap v1250: 17 pgs: 17 active+clean; 139 MiB data, 651 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 870 KiB/s wr, 8 op/s 2020-11-16T22:12:33.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:33 smithi057 bash[10301]: cluster 2020-11-16T22:12:32.134775+0000 mon.a (mon.0) 1396 : cluster [DBG] osdmap e724: 12 total, 12 up, 12 in 2020-11-16T22:12:33.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:33 smithi016 bash[10302]: cluster 2020-11-16T22:12:31.793372+0000 mgr.x (mgr.24115) 597 : cluster [DBG] pgmap v1250: 17 pgs: 17 active+clean; 139 MiB data, 651 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 870 KiB/s wr, 8 op/s 2020-11-16T22:12:33.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:33 smithi016 bash[10302]: cluster 2020-11-16T22:12:32.134775+0000 mon.a (mon.0) 1396 : cluster [DBG] osdmap e724: 12 total, 12 up, 12 in 2020-11-16T22:12:33.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:33 smithi195 bash[10218]: cluster 2020-11-16T22:12:31.793372+0000 mgr.x (mgr.24115) 597 : cluster [DBG] pgmap v1250: 17 pgs: 17 active+clean; 139 MiB data, 651 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 870 KiB/s wr, 8 op/s 2020-11-16T22:12:33.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:33 smithi195 bash[10218]: cluster 2020-11-16T22:12:32.134775+0000 mon.a (mon.0) 1396 : cluster [DBG] osdmap e724: 12 total, 12 up, 12 in 2020-11-16T22:12:34.144 INFO:tasks.rados.rados.2.smithi057.stdout:2815: done (3 left) 2020-11-16T22:12:34.144 INFO:tasks.rados.rados.2.smithi057.stdout:2816: write (excl) oid 10 current snap is 328 2020-11-16T22:12:34.144 INFO:tasks.rados.rados.2.smithi057.stdout:2816: seq_num 950 ranges {766650=714322,2075423=688655,3522196=444454} 2020-11-16T22:12:34.159 INFO:tasks.rados.rados.2.smithi057.stdout:2816: writing smithi05720651-10 from 766650 to 1480972 tid 1 2020-11-16T22:12:34.167 INFO:tasks.rados.rados.2.smithi057.stdout:2816: writing smithi05720651-10 from 2075423 to 2764078 tid 2 2020-11-16T22:12:34.174 INFO:tasks.rados.rados.2.smithi057.stdout:2816: writing smithi05720651-10 from 3522196 to 3966650 tid 3 2020-11-16T22:12:34.174 INFO:tasks.rados.rados.2.smithi057.stdout:2817: delete oid 26 current snap is 328 2020-11-16T22:12:34.175 INFO:tasks.rados.rados.2.smithi057.stdout:2812: finishing write tid 3 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:34.175 INFO:tasks.rados.rados.2.smithi057.stdout:2814: finishing rollback tid 1 to smithi05720651-8 2020-11-16T22:12:34.175 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 1707 (ObjNum 385 snap 0 seq_num 2931900096) dirty dne 2020-11-16T22:12:34.175 INFO:tasks.rados.rados.2.smithi057.stdout:2812: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:34.175 INFO:tasks.rados.rados.2.smithi057.stdout:2812: finishing write tid 6 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:34.175 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2183 (ObjNum 949 snap 328 seq_num 949) dirty exists 2020-11-16T22:12:34.176 INFO:tasks.rados.rados.2.smithi057.stdout:2812: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 949 snap 328 seq_num 949) 2020-11-16T22:12:34.176 INFO:tasks.rados.rados.2.smithi057.stdout:2813: expect (ObjNum 940 snap 324 seq_num 940) 2020-11-16T22:12:34.387 INFO:tasks.rados.rados.2.smithi057.stdout:2816: finishing write tid 1 to smithi05720651-10 2020-11-16T22:12:34.387 INFO:tasks.rados.rados.2.smithi057.stdout:2812: done (4 left) 2020-11-16T22:12:34.388 INFO:tasks.rados.rados.2.smithi057.stdout:2813: done (3 left) 2020-11-16T22:12:34.388 INFO:tasks.rados.rados.2.smithi057.stdout:2814: done (2 left) 2020-11-16T22:12:34.388 INFO:tasks.rados.rados.2.smithi057.stdout:2817: done (1 left) 2020-11-16T22:12:34.388 INFO:tasks.rados.rados.2.smithi057.stdout:2818: read oid 20 snap 319 2020-11-16T22:12:34.388 INFO:tasks.rados.rados.2.smithi057.stdout:2818: expect (ObjNum 913 snap 310 seq_num 913) 2020-11-16T22:12:34.388 INFO:tasks.rados.rados.2.smithi057.stdout:2819: rollback oid 4 current snap is 328 2020-11-16T22:12:34.388 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 4 to 319 2020-11-16T22:12:34.389 INFO:tasks.rados.rados.2.smithi057.stdout:2816: finishing write tid 2 to smithi05720651-10 2020-11-16T22:12:34.389 INFO:tasks.rados.rados.2.smithi057.stdout:2816: finishing write tid 3 to smithi05720651-10 2020-11-16T22:12:34.389 INFO:tasks.rados.rados.2.smithi057.stdout:2816: finishing write tid 5 to smithi05720651-10 2020-11-16T22:12:34.389 INFO:tasks.rados.rados.2.smithi057.stdout:2816: finishing write tid 6 to smithi05720651-10 2020-11-16T22:12:34.389 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 2093 (ObjNum 950 snap 328 seq_num 950) dirty exists 2020-11-16T22:12:34.389 INFO:tasks.rados.rados.2.smithi057.stdout:2816: left oid 10 (ObjNum 950 snap 328 seq_num 950) 2020-11-16T22:12:34.389 INFO:tasks.rados.rados.2.smithi057.stdout:2816: done (2 left) 2020-11-16T22:12:34.389 INFO:tasks.rados.rados.2.smithi057.stdout:2820: read oid 38 snap -1 2020-11-16T22:12:34.390 INFO:tasks.rados.rados.2.smithi057.stdout:2820: expect (ObjNum 941 snap 324 seq_num 941) 2020-11-16T22:12:34.390 INFO:tasks.rados.rados.2.smithi057.stdout:2821: snap_create 2020-11-16T22:12:34.397 INFO:tasks.rados.rados.2.smithi057.stdout:2818: expect (ObjNum 913 snap 310 seq_num 913) 2020-11-16T22:12:34.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:34 smithi057 bash[10301]: cluster 2020-11-16T22:12:33.144974+0000 mon.a (mon.0) 1397 : cluster [DBG] osdmap e725: 12 total, 12 up, 12 in 2020-11-16T22:12:34.550 INFO:tasks.rados.rados.2.smithi057.stdout:2819: finishing rollback tid 1 to smithi05720651-4 2020-11-16T22:12:34.550 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 0 (ObjNum 385 snap 0 seq_num 2932424784) dirty dne 2020-11-16T22:12:34.551 INFO:tasks.rados.rados.2.smithi057.stdout:2820: expect (ObjNum 941 snap 324 seq_num 941) 2020-11-16T22:12:34.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:34 smithi016 bash[10302]: cluster 2020-11-16T22:12:33.144974+0000 mon.a (mon.0) 1397 : cluster [DBG] osdmap e725: 12 total, 12 up, 12 in 2020-11-16T22:12:34.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:34 smithi195 bash[10218]: cluster 2020-11-16T22:12:33.144974+0000 mon.a (mon.0) 1397 : cluster [DBG] osdmap e725: 12 total, 12 up, 12 in 2020-11-16T22:12:35.109 INFO:tasks.rados.rados.2.smithi057.stdout:2818: done (3 left) 2020-11-16T22:12:35.109 INFO:tasks.rados.rados.2.smithi057.stdout:2819: done (2 left) 2020-11-16T22:12:35.110 INFO:tasks.rados.rados.2.smithi057.stdout:2820: done (1 left) 2020-11-16T22:12:35.110 INFO:tasks.rados.rados.2.smithi057.stdout:2821: done (0 left) 2020-11-16T22:12:35.110 INFO:tasks.rados.rados.2.smithi057.stdout:2822: snap_remove snap 319 2020-11-16T22:12:35.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:35 smithi057 bash[10301]: cluster 2020-11-16T22:12:33.794086+0000 mgr.x (mgr.24115) 598 : cluster [DBG] pgmap v1253: 17 pgs: 17 active+clean; 139 MiB data, 651 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 870 KiB/s wr, 5 op/s 2020-11-16T22:12:35.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:35 smithi057 bash[10301]: cluster 2020-11-16T22:12:34.154712+0000 mon.a (mon.0) 1398 : cluster [DBG] osdmap e726: 12 total, 12 up, 12 in 2020-11-16T22:12:35.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:35 smithi057 bash[10301]: cluster 2020-11-16T22:12:35.120261+0000 mon.a (mon.0) 1399 : cluster [DBG] osdmap e727: 12 total, 12 up, 12 in 2020-11-16T22:12:35.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:35 smithi016 bash[10302]: cluster 2020-11-16T22:12:33.794086+0000 mgr.x (mgr.24115) 598 : cluster [DBG] pgmap v1253: 17 pgs: 17 active+clean; 139 MiB data, 651 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 870 KiB/s wr, 5 op/s 2020-11-16T22:12:35.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:35 smithi016 bash[10302]: cluster 2020-11-16T22:12:34.154712+0000 mon.a (mon.0) 1398 : cluster [DBG] osdmap e726: 12 total, 12 up, 12 in 2020-11-16T22:12:35.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:35 smithi016 bash[10302]: cluster 2020-11-16T22:12:35.120261+0000 mon.a (mon.0) 1399 : cluster [DBG] osdmap e727: 12 total, 12 up, 12 in 2020-11-16T22:12:35.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:35 smithi195 bash[10218]: cluster 2020-11-16T22:12:33.794086+0000 mgr.x (mgr.24115) 598 : cluster [DBG] pgmap v1253: 17 pgs: 17 active+clean; 139 MiB data, 651 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 870 KiB/s wr, 5 op/s 2020-11-16T22:12:35.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:35 smithi195 bash[10218]: cluster 2020-11-16T22:12:34.154712+0000 mon.a (mon.0) 1398 : cluster [DBG] osdmap e726: 12 total, 12 up, 12 in 2020-11-16T22:12:35.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:35 smithi195 bash[10218]: cluster 2020-11-16T22:12:35.120261+0000 mon.a (mon.0) 1399 : cluster [DBG] osdmap e727: 12 total, 12 up, 12 in 2020-11-16T22:12:36.121 INFO:tasks.rados.rados.2.smithi057.stdout:2822: done (0 left) 2020-11-16T22:12:36.122 INFO:tasks.rados.rados.2.smithi057.stdout:2823: read oid 34 snap 326 2020-11-16T22:12:36.122 INFO:tasks.rados.rados.2.smithi057.stdout:2823: expect deleted 2020-11-16T22:12:36.122 INFO:tasks.rados.rados.2.smithi057.stdout:2824: write oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 329 2020-11-16T22:12:36.122 INFO:tasks.rados.rados.2.smithi057.stdout:2824: seq_num 952 ranges {400264=581173,1508740=491524} 2020-11-16T22:12:36.130 INFO:tasks.rados.rados.2.smithi057.stdout:2824: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 400264 to 981437 tid 1 2020-11-16T22:12:36.136 INFO:tasks.rados.rados.2.smithi057.stdout:2824: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1508740 to 2000264 tid 2 2020-11-16T22:12:36.137 INFO:tasks.rados.rados.2.smithi057.stdout:2825: delete oid 30 current snap is 329 2020-11-16T22:12:36.138 INFO:tasks.rados.rados.2.smithi057.stdout:2824: finishing write tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:36.146 INFO:tasks.rados.rados.2.smithi057.stdout:2824: finishing write tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:36.146 INFO:tasks.rados.rados.2.smithi057.stdout:2824: finishing write tid 4 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:36.147 INFO:tasks.rados.rados.2.smithi057.stdout:2824: finishing write tid 5 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:36.147 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2183 (ObjNum 952 snap 329 seq_num 952) dirty exists 2020-11-16T22:12:36.148 INFO:tasks.rados.rados.2.smithi057.stdout:2824: left oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 952 snap 329 seq_num 952) 2020-11-16T22:12:36.148 INFO:tasks.rados.rados.2.smithi057.stdout:2823: done (2 left) 2020-11-16T22:12:36.148 INFO:tasks.rados.rados.2.smithi057.stdout:2824: done (1 left) 2020-11-16T22:12:36.148 INFO:tasks.rados.rados.2.smithi057.stdout:2825: done (0 left) 2020-11-16T22:12:36.148 INFO:tasks.rados.rados.2.smithi057.stdout:2826: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:36.148 INFO:tasks.rados.rados.2.smithi057.stdout:2826: expect (ObjNum 949 snap 328 seq_num 949) 2020-11-16T22:12:36.148 INFO:tasks.rados.rados.2.smithi057.stdout:2827: snap_remove snap 328 2020-11-16T22:12:37.151 INFO:tasks.rados.rados.2.smithi057.stdout:2827: done (1 left) 2020-11-16T22:12:37.152 INFO:tasks.rados.rados.2.smithi057.stdout:2828: read oid 42 snap 325 2020-11-16T22:12:37.152 INFO:tasks.rados.rados.2.smithi057.stdout:2828: expect (ObjNum 901 snap 303 seq_num 901) 2020-11-16T22:12:37.152 INFO:tasks.rados.rados.2.smithi057.stdout:2829: delete oid 2 current snap is 329 2020-11-16T22:12:37.152 INFO:tasks.rados.rados.2.smithi057.stdout:2826: expect (ObjNum 949 snap 328 seq_num 949) 2020-11-16T22:12:37.333 INFO:tasks.rados.rados.2.smithi057.stdout:2828: expect (ObjNum 901 snap 303 seq_num 901) 2020-11-16T22:12:37.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:37 smithi057 bash[10301]: cluster 2020-11-16T22:12:35.794790+0000 mgr.x (mgr.24115) 599 : cluster [DBG] pgmap v1256: 17 pgs: 17 active+clean; 148 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 2.1 MiB/s wr, 7 op/s 2020-11-16T22:12:37.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:37 smithi057 bash[10301]: cluster 2020-11-16T22:12:36.131016+0000 mon.a (mon.0) 1400 : cluster [DBG] osdmap e728: 12 total, 12 up, 12 in 2020-11-16T22:12:37.519 INFO:tasks.rados.rados.2.smithi057.stdout:2826: done (2 left) 2020-11-16T22:12:37.520 INFO:tasks.rados.rados.2.smithi057.stdout:2828: done (1 left) 2020-11-16T22:12:37.520 INFO:tasks.rados.rados.2.smithi057.stdout:2829: done (0 left) 2020-11-16T22:12:37.520 INFO:tasks.rados.rados.2.smithi057.stdout:2830: copy_from oid 38 from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 329 2020-11-16T22:12:37.520 INFO:tasks.rados.rados.2.smithi057.stdout:2831: write oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 329 2020-11-16T22:12:37.520 INFO:tasks.rados.rados.2.smithi057.stdout:2831: seq_num 955 ranges {450685=406920,1567833=482852} 2020-11-16T22:12:37.530 INFO:tasks.rados.rados.2.smithi057.stdout:2831: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 450685 to 857605 tid 1 2020-11-16T22:12:37.539 INFO:tasks.rados.rados.2.smithi057.stdout:2831: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1567833 to 2050685 tid 2 2020-11-16T22:12:37.539 INFO:tasks.rados.rados.2.smithi057.stdout:2832: write oid 2 current snap is 329 2020-11-16T22:12:37.539 INFO:tasks.rados.rados.2.smithi057.stdout:2832: seq_num 956 ranges {467492=482169,1626315=441177} 2020-11-16T22:12:37.545 INFO:tasks.rados.rados.2.smithi057.stdout:2832: writing smithi05720651-2 from 467492 to 949661 tid 1 2020-11-16T22:12:37.551 INFO:tasks.rados.rados.2.smithi057.stdout:2832: writing smithi05720651-2 from 1626315 to 2067492 tid 2 2020-11-16T22:12:37.552 INFO:tasks.rados.rados.2.smithi057.stdout:2833: copy_from oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 6 current snap is 329 2020-11-16T22:12:37.552 INFO:tasks.rados.rados.2.smithi057.stdout:2830: finishing copy_from to smithi05720651-38 2020-11-16T22:12:37.552 INFO:tasks.rados.rados.2.smithi057.stdout:2830: got expected ENOENT (src dne) 2020-11-16T22:12:37.552 INFO:tasks.rados.rados.2.smithi057.stdout:2830: finishing copy_from racing read to smithi05720651-38 2020-11-16T22:12:37.552 INFO:tasks.rados.rados.2.smithi057.stdout:2830: done (3 left) 2020-11-16T22:12:37.552 INFO:tasks.rados.rados.2.smithi057.stdout:2834: rollback oid 32 current snap is 329 2020-11-16T22:12:37.552 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 32 to 322 2020-11-16T22:12:37.553 INFO:tasks.rados.rados.2.smithi057.stdout:2831: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:37.553 INFO:tasks.rados.rados.2.smithi057.stdout:2831: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:37.553 INFO:tasks.rados.rados.2.smithi057.stdout:2831: finishing write tid 4 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:37.553 INFO:tasks.rados.rados.2.smithi057.stdout:2831: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:37.553 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 180 (ObjNum 955 snap 329 seq_num 955) dirty exists 2020-11-16T22:12:37.553 INFO:tasks.rados.rados.2.smithi057.stdout:2831: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 955 snap 329 seq_num 955) 2020-11-16T22:12:37.553 INFO:tasks.rados.rados.2.smithi057.stdout:2831: done (3 left) 2020-11-16T22:12:37.554 INFO:tasks.rados.rados.2.smithi057.stdout:2835: snap_remove snap 326 2020-11-16T22:12:37.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:37 smithi016 bash[10302]: cluster 2020-11-16T22:12:35.794790+0000 mgr.x (mgr.24115) 599 : cluster [DBG] pgmap v1256: 17 pgs: 17 active+clean; 148 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 2.1 MiB/s wr, 7 op/s 2020-11-16T22:12:37.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:37 smithi016 bash[10302]: cluster 2020-11-16T22:12:36.131016+0000 mon.a (mon.0) 1400 : cluster [DBG] osdmap e728: 12 total, 12 up, 12 in 2020-11-16T22:12:37.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:37 smithi195 bash[10218]: cluster 2020-11-16T22:12:35.794790+0000 mgr.x (mgr.24115) 599 : cluster [DBG] pgmap v1256: 17 pgs: 17 active+clean; 148 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 2.1 MiB/s wr, 7 op/s 2020-11-16T22:12:37.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:37 smithi195 bash[10218]: cluster 2020-11-16T22:12:36.131016+0000 mon.a (mon.0) 1400 : cluster [DBG] osdmap e728: 12 total, 12 up, 12 in 2020-11-16T22:12:38.168 INFO:tasks.rados.rados.2.smithi057.stdout:2835: done (3 left) 2020-11-16T22:12:38.168 INFO:tasks.rados.rados.2.smithi057.stdout:2836: read oid 24 snap 314 2020-11-16T22:12:38.168 INFO:tasks.rados.rados.2.smithi057.stdout:2836: expect deleted 2020-11-16T22:12:38.169 INFO:tasks.rados.rados.2.smithi057.stdout:2837: copy_from oid 26 from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 329 2020-11-16T22:12:38.169 INFO:tasks.rados.rados.2.smithi057.stdout:2838: write oid 14 current snap is 329 2020-11-16T22:12:38.169 INFO:tasks.rados.rados.2.smithi057.stdout:2838: seq_num 957 ranges {484299=557418,1684797=399502} 2020-11-16T22:12:38.178 INFO:tasks.rados.rados.2.smithi057.stdout:2838: writing smithi05720651-14 from 484299 to 1041717 tid 1 2020-11-16T22:12:38.184 INFO:tasks.rados.rados.2.smithi057.stdout:2838: writing smithi05720651-14 from 1684797 to 2084299 tid 2 2020-11-16T22:12:38.185 INFO:tasks.rados.rados.2.smithi057.stdout:2839: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:38.185 INFO:tasks.rados.rados.2.smithi057.stdout:2839: expect deleted 2020-11-16T22:12:38.185 INFO:tasks.rados.rados.2.smithi057.stdout:2840: write oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 329 2020-11-16T22:12:38.185 INFO:tasks.rados.rados.2.smithi057.stdout:2840: seq_num 958 ranges {501106=749020,1743279=357827} 2020-11-16T22:12:38.192 INFO:tasks.rados.rados.2.smithi057.stdout:2840: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 501106 to 1250126 tid 1 2020-11-16T22:12:38.197 INFO:tasks.rados.rados.2.smithi057.stdout:2840: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1743279 to 2101106 tid 2 2020-11-16T22:12:38.197 INFO:tasks.rados.rados.2.smithi057.stdout:2841: snap_create 2020-11-16T22:12:38.197 INFO:tasks.rados.rados.2.smithi057.stdout:2832: finishing write tid 1 to smithi05720651-2 2020-11-16T22:12:38.197 INFO:tasks.rados.rados.2.smithi057.stdout:2832: finishing write tid 2 to smithi05720651-2 2020-11-16T22:12:38.198 INFO:tasks.rados.rados.2.smithi057.stdout:2832: finishing write tid 4 to smithi05720651-2 2020-11-16T22:12:38.198 INFO:tasks.rados.rados.2.smithi057.stdout:2832: finishing write tid 5 to smithi05720651-2 2020-11-16T22:12:38.198 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 2292 (ObjNum 956 snap 329 seq_num 956) dirty exists 2020-11-16T22:12:38.198 INFO:tasks.rados.rados.2.smithi057.stdout:2832: left oid 2 (ObjNum 956 snap 329 seq_num 956) 2020-11-16T22:12:38.198 INFO:tasks.rados.rados.2.smithi057.stdout:2834: finishing rollback tid 0 to smithi05720651-32 2020-11-16T22:12:38.198 INFO:tasks.rados.rados.2.smithi057.stdout:2834: finishing rollback tid 1 to smithi05720651-32 2020-11-16T22:12:38.198 INFO:tasks.rados.rados.2.smithi057.stdout:2834: finishing rollback tid 2 to smithi05720651-32 2020-11-16T22:12:38.199 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 2296 (ObjNum 856 snap 289 seq_num 856) dirty exists 2020-11-16T22:12:38.199 INFO:tasks.rados.rados.2.smithi057.stdout:2833: finishing copy_from to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:38.199 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2071 (ObjNum 911 snap 310 seq_num 911) dirty exists 2020-11-16T22:12:38.199 INFO:tasks.rados.rados.2.smithi057.stdout:2833: finishing copy_from racing read to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:38.199 INFO:tasks.rados.rados.2.smithi057.stdout:2838: finishing write tid 1 to smithi05720651-14 2020-11-16T22:12:38.200 INFO:tasks.rados.rados.2.smithi057.stdout:2837: finishing copy_from to smithi05720651-26 2020-11-16T22:12:38.200 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 2183 (ObjNum 949 snap 328 seq_num 949) dirty exists 2020-11-16T22:12:38.200 INFO:tasks.rados.rados.2.smithi057.stdout:2837: finishing copy_from racing read to smithi05720651-26 2020-11-16T22:12:38.200 INFO:tasks.rados.rados.2.smithi057.stdout:2838: finishing write tid 2 to smithi05720651-14 2020-11-16T22:12:38.201 INFO:tasks.rados.rados.2.smithi057.stdout:2838: finishing write tid 4 to smithi05720651-14 2020-11-16T22:12:38.201 INFO:tasks.rados.rados.2.smithi057.stdout:2838: finishing write tid 5 to smithi05720651-14 2020-11-16T22:12:38.201 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 2308 (ObjNum 957 snap 329 seq_num 957) dirty exists 2020-11-16T22:12:38.202 INFO:tasks.rados.rados.2.smithi057.stdout:2838: left oid 14 (ObjNum 957 snap 329 seq_num 957) 2020-11-16T22:12:38.204 INFO:tasks.rados.rados.2.smithi057.stdout:2840: finishing write tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:38.204 INFO:tasks.rados.rados.2.smithi057.stdout:2840: finishing write tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:38.205 INFO:tasks.rados.rados.2.smithi057.stdout:2840: finishing write tid 4 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:38.205 INFO:tasks.rados.rados.2.smithi057.stdout:2840: finishing write tid 5 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:38.206 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2176 (ObjNum 958 snap 329 seq_num 958) dirty exists 2020-11-16T22:12:38.206 INFO:tasks.rados.rados.2.smithi057.stdout:2840: left oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 958 snap 329 seq_num 958) 2020-11-16T22:12:38.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:38 smithi057 bash[10301]: cluster 2020-11-16T22:12:37.160244+0000 mon.a (mon.0) 1401 : cluster [DBG] osdmap e729: 12 total, 12 up, 12 in 2020-11-16T22:12:38.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:38 smithi016 bash[10302]: cluster 2020-11-16T22:12:37.160244+0000 mon.a (mon.0) 1401 : cluster [DBG] osdmap e729: 12 total, 12 up, 12 in 2020-11-16T22:12:38.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:38 smithi195 bash[10218]: cluster 2020-11-16T22:12:37.160244+0000 mon.a (mon.0) 1401 : cluster [DBG] osdmap e729: 12 total, 12 up, 12 in 2020-11-16T22:12:39.166 INFO:tasks.rados.rados.2.smithi057.stdout:2832: done (8 left) 2020-11-16T22:12:39.167 INFO:tasks.rados.rados.2.smithi057.stdout:2833: done (7 left) 2020-11-16T22:12:39.167 INFO:tasks.rados.rados.2.smithi057.stdout:2834: done (6 left) 2020-11-16T22:12:39.167 INFO:tasks.rados.rados.2.smithi057.stdout:2836: done (5 left) 2020-11-16T22:12:39.167 INFO:tasks.rados.rados.2.smithi057.stdout:2837: done (4 left) 2020-11-16T22:12:39.167 INFO:tasks.rados.rados.2.smithi057.stdout:2838: done (3 left) 2020-11-16T22:12:39.168 INFO:tasks.rados.rados.2.smithi057.stdout:2839: done (2 left) 2020-11-16T22:12:39.168 INFO:tasks.rados.rados.2.smithi057.stdout:2840: done (1 left) 2020-11-16T22:12:39.168 INFO:tasks.rados.rados.2.smithi057.stdout:2841: done (0 left) 2020-11-16T22:12:39.168 INFO:tasks.rados.rados.2.smithi057.stdout:2842: rollback oid 16 current snap is 330 2020-11-16T22:12:39.168 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 16 to 329 2020-11-16T22:12:39.168 INFO:tasks.rados.rados.2.smithi057.stdout:2843: snap_remove snap 321 2020-11-16T22:12:39.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:39 smithi057 bash[10301]: cluster 2020-11-16T22:12:37.795500+0000 mgr.x (mgr.24115) 600 : cluster [DBG] pgmap v1259: 17 pgs: 17 active+clean; 151 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.0 MiB/s wr, 18 op/s 2020-11-16T22:12:39.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:39 smithi057 bash[10301]: cluster 2020-11-16T22:12:38.170229+0000 mon.a (mon.0) 1402 : cluster [DBG] osdmap e730: 12 total, 12 up, 12 in 2020-11-16T22:12:39.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:39 smithi016 bash[10302]: cluster 2020-11-16T22:12:37.795500+0000 mgr.x (mgr.24115) 600 : cluster [DBG] pgmap v1259: 17 pgs: 17 active+clean; 151 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.0 MiB/s wr, 18 op/s 2020-11-16T22:12:39.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:39 smithi016 bash[10302]: cluster 2020-11-16T22:12:38.170229+0000 mon.a (mon.0) 1402 : cluster [DBG] osdmap e730: 12 total, 12 up, 12 in 2020-11-16T22:12:39.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:39 smithi195 bash[10218]: cluster 2020-11-16T22:12:37.795500+0000 mgr.x (mgr.24115) 600 : cluster [DBG] pgmap v1259: 17 pgs: 17 active+clean; 151 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.0 MiB/s wr, 18 op/s 2020-11-16T22:12:39.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:39 smithi195 bash[10218]: cluster 2020-11-16T22:12:38.170229+0000 mon.a (mon.0) 1402 : cluster [DBG] osdmap e730: 12 total, 12 up, 12 in 2020-11-16T22:12:40.117 INFO:tasks.rados.rados.2.smithi057.stdout:2843: done (1 left) 2020-11-16T22:12:40.117 INFO:tasks.rados.rados.2.smithi057.stdout:2844: copy_from oid 48 from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 330 2020-11-16T22:12:40.117 INFO:tasks.rados.rados.2.smithi057.stdout:2842: finishing rollback tid 0 to smithi05720651-16 2020-11-16T22:12:40.118 INFO:tasks.rados.rados.2.smithi057.stdout:2842: finishing rollback tid 1 to smithi05720651-16 2020-11-16T22:12:40.118 INFO:tasks.rados.rados.2.smithi057.stdout:2842: finishing rollback tid 2 to smithi05720651-16 2020-11-16T22:12:40.118 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 2187 (ObjNum 878 snap 296 seq_num 878) dirty exists 2020-11-16T22:12:40.118 INFO:tasks.rados.rados.2.smithi057.stdout:2842: done (1 left) 2020-11-16T22:12:40.118 INFO:tasks.rados.rados.2.smithi057.stdout:2845: read oid 4 snap -1 2020-11-16T22:12:40.118 INFO:tasks.rados.rados.2.smithi057.stdout:2845: expect deleted 2020-11-16T22:12:40.119 INFO:tasks.rados.rados.2.smithi057.stdout:2846: write (excl) oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 330 2020-11-16T22:12:40.119 INFO:tasks.rados.rados.2.smithi057.stdout:2846: seq_num 959 ranges {517913=424269,1401761=446989} 2020-11-16T22:12:40.128 INFO:tasks.rados.rados.2.smithi057.stdout:2846: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 517913 to 942182 tid 1 2020-11-16T22:12:40.134 INFO:tasks.rados.rados.2.smithi057.stdout:2846: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1401761 to 1848750 tid 2 2020-11-16T22:12:40.134 INFO:tasks.rados.rados.2.smithi057.stdout:2847: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 330 2020-11-16T22:12:40.134 INFO:tasks.rados.rados.2.smithi057.stdout:2847: seq_num 960 ranges {534720=499518,1460243=674477} 2020-11-16T22:12:40.140 INFO:tasks.rados.rados.2.smithi057.stdout:2847: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 534720 to 1034238 tid 1 2020-11-16T22:12:40.147 INFO:tasks.rados.rados.2.smithi057.stdout:2847: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1460243 to 2134720 tid 2 2020-11-16T22:12:40.147 INFO:tasks.rados.rados.2.smithi057.stdout:2848: delete oid 30 current snap is 330 2020-11-16T22:12:40.147 INFO:tasks.rados.rados.2.smithi057.stdout:2844: finishing copy_from to smithi05720651-48 2020-11-16T22:12:40.147 INFO:tasks.rados.rados.2.smithi057.stdout:2844: got expected ENOENT (src dne) 2020-11-16T22:12:40.147 INFO:tasks.rados.rados.2.smithi057.stdout:2844: finishing copy_from racing read to smithi05720651-48 2020-11-16T22:12:40.147 INFO:tasks.rados.rados.2.smithi057.stdout:2846: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:40.148 INFO:tasks.rados.rados.2.smithi057.stdout:2846: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:40.148 INFO:tasks.rados.rados.2.smithi057.stdout:2846: finishing write tid 4 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:40.148 INFO:tasks.rados.rados.2.smithi057.stdout:2846: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:40.148 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1798 (ObjNum 959 snap 330 seq_num 959) dirty exists 2020-11-16T22:12:40.148 INFO:tasks.rados.rados.2.smithi057.stdout:2846: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 959 snap 330 seq_num 959) 2020-11-16T22:12:40.154 INFO:tasks.rados.rados.2.smithi057.stdout:2844: done (4 left) 2020-11-16T22:12:40.155 INFO:tasks.rados.rados.2.smithi057.stdout:2845: done (3 left) 2020-11-16T22:12:40.155 INFO:tasks.rados.rados.2.smithi057.stdout:2846: done (2 left) 2020-11-16T22:12:40.155 INFO:tasks.rados.rados.2.smithi057.stdout:2848: done (1 left) 2020-11-16T22:12:40.155 INFO:tasks.rados.rados.2.smithi057.stdout:2849: read oid 38 snap 329 2020-11-16T22:12:40.155 INFO:tasks.rados.rados.2.smithi057.stdout:2849: expect (ObjNum 941 snap 324 seq_num 941) 2020-11-16T22:12:40.155 INFO:tasks.rados.rados.2.smithi057.stdout:2850: snap_create 2020-11-16T22:12:40.155 INFO:tasks.rados.rados.2.smithi057.stdout:2847: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:40.161 INFO:tasks.rados.rados.2.smithi057.stdout:2847: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:40.161 INFO:tasks.rados.rados.2.smithi057.stdout:2847: finishing write tid 4 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:40.162 INFO:tasks.rados.rados.2.smithi057.stdout:2849: expect (ObjNum 941 snap 324 seq_num 941) 2020-11-16T22:12:40.281 INFO:tasks.rados.rados.2.smithi057.stdout:2847: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:40.281 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2318 (ObjNum 960 snap 330 seq_num 960) dirty exists 2020-11-16T22:12:40.281 INFO:tasks.rados.rados.2.smithi057.stdout:2847: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 960 snap 330 seq_num 960) 2020-11-16T22:12:40.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:40 smithi057 bash[10301]: cluster 2020-11-16T22:12:39.172685+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e731: 12 total, 12 up, 12 in 2020-11-16T22:12:40.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:40 smithi057 bash[10301]: cluster 2020-11-16T22:12:40.122826+0000 mon.a (mon.0) 1404 : cluster [DBG] osdmap e732: 12 total, 12 up, 12 in 2020-11-16T22:12:40.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:40 smithi016 bash[10302]: cluster 2020-11-16T22:12:39.172685+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e731: 12 total, 12 up, 12 in 2020-11-16T22:12:40.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:40 smithi016 bash[10302]: cluster 2020-11-16T22:12:40.122826+0000 mon.a (mon.0) 1404 : cluster [DBG] osdmap e732: 12 total, 12 up, 12 in 2020-11-16T22:12:40.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:40 smithi195 bash[10218]: cluster 2020-11-16T22:12:39.172685+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e731: 12 total, 12 up, 12 in 2020-11-16T22:12:40.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:40 smithi195 bash[10218]: cluster 2020-11-16T22:12:40.122826+0000 mon.a (mon.0) 1404 : cluster [DBG] osdmap e732: 12 total, 12 up, 12 in 2020-11-16T22:12:41.126 INFO:tasks.rados.rados.2.smithi057.stdout:2847: done (2 left) 2020-11-16T22:12:41.126 INFO:tasks.rados.rados.2.smithi057.stdout:2849: done (1 left) 2020-11-16T22:12:41.127 INFO:tasks.rados.rados.2.smithi057.stdout:2850: done (0 left) 2020-11-16T22:12:41.127 INFO:tasks.rados.rados.2.smithi057.stdout:2851: rollback oid 4 current snap is 331 2020-11-16T22:12:41.127 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 4 to 315 2020-11-16T22:12:41.127 INFO:tasks.rados.rados.2.smithi057.stdout:2852: snap_remove snap 314 2020-11-16T22:12:41.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:41 smithi057 bash[10301]: cluster 2020-11-16T22:12:39.796213+0000 mgr.x (mgr.24115) 601 : cluster [DBG] pgmap v1262: 17 pgs: 17 active+clean; 152 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2020-11-16T22:12:41.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:41 smithi057 bash[10301]: cluster 2020-11-16T22:12:41.135862+0000 mon.a (mon.0) 1405 : cluster [DBG] osdmap e733: 12 total, 12 up, 12 in 2020-11-16T22:12:41.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:41 smithi016 bash[10302]: cluster 2020-11-16T22:12:39.796213+0000 mgr.x (mgr.24115) 601 : cluster [DBG] pgmap v1262: 17 pgs: 17 active+clean; 152 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2020-11-16T22:12:41.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:41 smithi016 bash[10302]: cluster 2020-11-16T22:12:41.135862+0000 mon.a (mon.0) 1405 : cluster [DBG] osdmap e733: 12 total, 12 up, 12 in 2020-11-16T22:12:41.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:41 smithi195 bash[10218]: cluster 2020-11-16T22:12:39.796213+0000 mgr.x (mgr.24115) 601 : cluster [DBG] pgmap v1262: 17 pgs: 17 active+clean; 152 MiB data, 681 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2020-11-16T22:12:41.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:41 smithi195 bash[10218]: cluster 2020-11-16T22:12:41.135862+0000 mon.a (mon.0) 1405 : cluster [DBG] osdmap e733: 12 total, 12 up, 12 in 2020-11-16T22:12:42.128 INFO:tasks.rados.rados.2.smithi057.stdout:2852: done (1 left) 2020-11-16T22:12:42.128 INFO:tasks.rados.rados.2.smithi057.stdout:2853: rollback oid 8 current snap is 331 2020-11-16T22:12:42.129 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 8 to 322 2020-11-16T22:12:42.129 INFO:tasks.rados.rados.2.smithi057.stdout:2851: finishing rollback tid 1 to smithi05720651-4 2020-11-16T22:12:42.129 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 0 (ObjNum 305 snap 0 seq_num 2933945600) dirty dne 2020-11-16T22:12:42.129 INFO:tasks.rados.rados.2.smithi057.stdout:2851: done (1 left) 2020-11-16T22:12:42.129 INFO:tasks.rados.rados.2.smithi057.stdout:2854: write oid 12 current snap is 331 2020-11-16T22:12:42.129 INFO:tasks.rados.rados.2.smithi057.stdout:2854: seq_num 962 ranges {568334=650016,1860854=307480} 2020-11-16T22:12:42.141 INFO:tasks.rados.rados.2.smithi057.stdout:2854: writing smithi05720651-12 from 568334 to 1218350 tid 1 2020-11-16T22:12:42.148 INFO:tasks.rados.rados.2.smithi057.stdout:2854: writing smithi05720651-12 from 1860854 to 2168334 tid 2 2020-11-16T22:12:42.148 INFO:tasks.rados.rados.2.smithi057.stdout:2855: snap_create 2020-11-16T22:12:42.148 INFO:tasks.rados.rados.2.smithi057.stdout:2853: finishing rollback tid 1 to smithi05720651-8 2020-11-16T22:12:42.148 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 1707 (ObjNum 321 snap 0 seq_num 1864382257) dirty dne 2020-11-16T22:12:42.156 INFO:tasks.rados.rados.2.smithi057.stdout:2854: finishing write tid 1 to smithi05720651-12 2020-11-16T22:12:42.159 INFO:tasks.rados.rados.2.smithi057.stdout:2854: finishing write tid 2 to smithi05720651-12 2020-11-16T22:12:42.159 INFO:tasks.rados.rados.2.smithi057.stdout:2854: finishing write tid 4 to smithi05720651-12 2020-11-16T22:12:42.160 INFO:tasks.rados.rados.2.smithi057.stdout:2854: finishing write tid 5 to smithi05720651-12 2020-11-16T22:12:42.160 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 1783 (ObjNum 962 snap 331 seq_num 962) dirty exists 2020-11-16T22:12:42.160 INFO:tasks.rados.rados.2.smithi057.stdout:2854: left oid 12 (ObjNum 962 snap 331 seq_num 962) 2020-11-16T22:12:42.444 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:12:42 smithi057 bash[12595]: debug 2020-11-16T22:12:42.162+0000 7f737d1a4700 -1 osd.8 pg_epoch: 734 pg[2.5( v 732'1339 (0'0,732'1339] local-lis/les=71/72 n=7 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,0] r=0 lpr=71 crt=732'1339 lcod 730'1337 mlcod 730'1337 active+clean+snaptrim trimq=[275~1] ps=[27b~1,27d~1,287~1,28b~1]] removing snap head 2020-11-16T22:12:43.137 INFO:tasks.rados.rados.2.smithi057.stdout:2853: done (2 left) 2020-11-16T22:12:43.138 INFO:tasks.rados.rados.2.smithi057.stdout:2854: done (1 left) 2020-11-16T22:12:43.138 INFO:tasks.rados.rados.2.smithi057.stdout:2855: done (0 left) 2020-11-16T22:12:43.138 INFO:tasks.rados.rados.2.smithi057.stdout:2856: write oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 332 2020-11-16T22:12:43.138 INFO:tasks.rados.rados.2.smithi057.stdout:2856: seq_num 963 ranges {585141=725265,1919336=265805} 2020-11-16T22:12:43.153 INFO:tasks.rados.rados.2.smithi057.stdout:2856: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 585141 to 1310406 tid 1 2020-11-16T22:12:43.159 INFO:tasks.rados.rados.2.smithi057.stdout:2856: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1919336 to 2185141 tid 2 2020-11-16T22:12:43.159 INFO:tasks.rados.rados.2.smithi057.stdout:2857: write oid 40 current snap is 332 2020-11-16T22:12:43.159 INFO:tasks.rados.rados.2.smithi057.stdout:2857: seq_num 964 ranges {601948=400514,1577818=624130} 2020-11-16T22:12:43.164 INFO:tasks.rados.rados.2.smithi057.stdout:2857: writing smithi05720651-40 from 601948 to 1002462 tid 1 2020-11-16T22:12:43.171 INFO:tasks.rados.rados.2.smithi057.stdout:2857: writing smithi05720651-40 from 1577818 to 2201948 tid 2 2020-11-16T22:12:43.171 INFO:tasks.rados.rados.2.smithi057.stdout:2858: rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 332 2020-11-16T22:12:43.171 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 331 2020-11-16T22:12:43.171 INFO:tasks.rados.rados.2.smithi057.stdout:2859: snap_create 2020-11-16T22:12:43.177 INFO:tasks.rados.rados.2.smithi057.stdout:2856: finishing write tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:43.177 INFO:tasks.rados.rados.2.smithi057.stdout:2856: finishing write tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:43.178 INFO:tasks.rados.rados.2.smithi057.stdout:2856: finishing write tid 4 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:43.178 INFO:tasks.rados.rados.2.smithi057.stdout:2856: finishing write tid 5 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:43.179 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2338 (ObjNum 963 snap 332 seq_num 963) dirty exists 2020-11-16T22:12:43.179 INFO:tasks.rados.rados.2.smithi057.stdout:2856: left oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 963 snap 332 seq_num 963) 2020-11-16T22:12:43.179 INFO:tasks.rados.rados.2.smithi057.stdout:2857: finishing write tid 1 to smithi05720651-40 2020-11-16T22:12:43.180 INFO:tasks.rados.rados.2.smithi057.stdout:2857: finishing write tid 2 to smithi05720651-40 2020-11-16T22:12:43.180 INFO:tasks.rados.rados.2.smithi057.stdout:2858: finishing rollback tid 0 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:43.180 INFO:tasks.rados.rados.2.smithi057.stdout:2858: finishing rollback tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:43.180 INFO:tasks.rados.rados.2.smithi057.stdout:2857: finishing write tid 4 to smithi05720651-40 2020-11-16T22:12:43.181 INFO:tasks.rados.rados.2.smithi057.stdout:2858: finishing rollback tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:43.181 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1714 (ObjNum 938 snap 323 seq_num 938) dirty exists 2020-11-16T22:12:43.181 INFO:tasks.rados.rados.2.smithi057.stdout:2857: finishing write tid 5 to smithi05720651-40 2020-11-16T22:12:43.181 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 2342 (ObjNum 964 snap 332 seq_num 964) dirty exists 2020-11-16T22:12:43.182 INFO:tasks.rados.rados.2.smithi057.stdout:2857: left oid 40 (ObjNum 964 snap 332 seq_num 964) 2020-11-16T22:12:43.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:43 smithi057 bash[10301]: cluster 2020-11-16T22:12:41.796937+0000 mgr.x (mgr.24115) 602 : cluster [DBG] pgmap v1265: 17 pgs: 17 active+clean; 168 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.4 MiB/s wr, 15 op/s 2020-11-16T22:12:43.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:43 smithi057 bash[10301]: cluster 2020-11-16T22:12:42.138183+0000 mon.a (mon.0) 1406 : cluster [DBG] osdmap e734: 12 total, 12 up, 12 in 2020-11-16T22:12:43.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:43 smithi016 bash[10302]: cluster 2020-11-16T22:12:41.796937+0000 mgr.x (mgr.24115) 602 : cluster [DBG] pgmap v1265: 17 pgs: 17 active+clean; 168 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.4 MiB/s wr, 15 op/s 2020-11-16T22:12:43.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:43 smithi016 bash[10302]: cluster 2020-11-16T22:12:42.138183+0000 mon.a (mon.0) 1406 : cluster [DBG] osdmap e734: 12 total, 12 up, 12 in 2020-11-16T22:12:43.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:43 smithi195 bash[10218]: cluster 2020-11-16T22:12:41.796937+0000 mgr.x (mgr.24115) 602 : cluster [DBG] pgmap v1265: 17 pgs: 17 active+clean; 168 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.4 MiB/s wr, 15 op/s 2020-11-16T22:12:43.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:43 smithi195 bash[10218]: cluster 2020-11-16T22:12:42.138183+0000 mon.a (mon.0) 1406 : cluster [DBG] osdmap e734: 12 total, 12 up, 12 in 2020-11-16T22:12:44.159 INFO:tasks.rados.rados.2.smithi057.stdout:2856: done (3 left) 2020-11-16T22:12:44.160 INFO:tasks.rados.rados.2.smithi057.stdout:2857: done (2 left) 2020-11-16T22:12:44.160 INFO:tasks.rados.rados.2.smithi057.stdout:2858: done (1 left) 2020-11-16T22:12:44.160 INFO:tasks.rados.rados.2.smithi057.stdout:2859: done (0 left) 2020-11-16T22:12:44.160 INFO:tasks.rados.rados.2.smithi057.stdout:2860: write (excl) oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 333 2020-11-16T22:12:44.160 INFO:tasks.rados.rados.2.smithi057.stdout:2860: seq_num 965 ranges {618755=475763,1636300=457996} 2020-11-16T22:12:44.176 INFO:tasks.rados.rados.2.smithi057.stdout:2860: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 618755 to 1094518 tid 1 2020-11-16T22:12:44.181 INFO:tasks.rados.rados.2.smithi057.stdout:2860: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1636300 to 2094296 tid 2 2020-11-16T22:12:44.181 INFO:tasks.rados.rados.2.smithi057.stdout:2861: read oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:44.182 INFO:tasks.rados.rados.2.smithi057.stdout:2861: expect (ObjNum 760 snap 265 seq_num 760) 2020-11-16T22:12:44.182 INFO:tasks.rados.rados.2.smithi057.stdout:2862: delete oid 34 current snap is 333 2020-11-16T22:12:44.188 INFO:tasks.rados.rados.2.smithi057.stdout:2860: finishing write tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:44.194 INFO:tasks.rados.rados.2.smithi057.stdout:2861: expect (ObjNum 760 snap 265 seq_num 760) 2020-11-16T22:12:44.356 INFO:tasks.rados.rados.2.smithi057.stdout:2860: finishing write tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:44.356 INFO:tasks.rados.rados.2.smithi057.stdout:2860: finishing write tid 4 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:44.356 INFO:tasks.rados.rados.2.smithi057.stdout:2860: finishing write tid 5 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:44.356 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2096 (ObjNum 965 snap 333 seq_num 965) dirty exists 2020-11-16T22:12:44.357 INFO:tasks.rados.rados.2.smithi057.stdout:2860: left oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 965 snap 333 seq_num 965) 2020-11-16T22:12:44.357 INFO:tasks.rados.rados.2.smithi057.stdout:2860: done (2 left) 2020-11-16T22:12:44.357 INFO:tasks.rados.rados.2.smithi057.stdout:2861: done (1 left) 2020-11-16T22:12:44.357 INFO:tasks.rados.rados.2.smithi057.stdout:2862: done (0 left) 2020-11-16T22:12:44.357 INFO:tasks.rados.rados.2.smithi057.stdout:2863: write (excl) oid 10 current snap is 333 2020-11-16T22:12:44.357 INFO:tasks.rados.rados.2.smithi057.stdout:2863: seq_num 967 ranges {652369=742614,2153264=99105} 2020-11-16T22:12:44.373 INFO:tasks.rados.rados.2.smithi057.stdout:2863: writing smithi05720651-10 from 652369 to 1394983 tid 1 2020-11-16T22:12:44.378 INFO:tasks.rados.rados.2.smithi057.stdout:2863: writing smithi05720651-10 from 2153264 to 2252369 tid 2 2020-11-16T22:12:44.379 INFO:tasks.rados.rados.2.smithi057.stdout:2864: copy_from oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 333 2020-11-16T22:12:44.379 INFO:tasks.rados.rados.2.smithi057.stdout:2865: read oid 44 snap -1 2020-11-16T22:12:44.379 INFO:tasks.rados.rados.2.smithi057.stdout:2865: expect (ObjNum 820 snap 281 seq_num 820) 2020-11-16T22:12:44.379 INFO:tasks.rados.rados.2.smithi057.stdout:2866: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 332 2020-11-16T22:12:44.379 INFO:tasks.rados.rados.2.smithi057.stdout:2866: expect deleted 2020-11-16T22:12:44.379 INFO:tasks.rados.rados.2.smithi057.stdout:2867: rollback oid 28 current snap is 333 2020-11-16T22:12:44.380 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 28 to 325 2020-11-16T22:12:44.380 INFO:tasks.rados.rados.2.smithi057.stdout:2868: write (excl) oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 333 2020-11-16T22:12:44.380 INFO:tasks.rados.rados.2.smithi057.stdout:2868: seq_num 968 ranges {669176=417863,1811746=457430} 2020-11-16T22:12:44.385 INFO:tasks.rados.rados.2.smithi057.stdout:2868: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 669176 to 1087039 tid 1 2020-11-16T22:12:44.392 INFO:tasks.rados.rados.2.smithi057.stdout:2868: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1811746 to 2269176 tid 2 2020-11-16T22:12:44.393 INFO:tasks.rados.rados.2.smithi057.stdout:2864: finishing copy_from to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:44.393 INFO:tasks.rados.rados.2.smithi057.stdout:2864: got expected ENOENT (src dne) 2020-11-16T22:12:44.393 INFO:tasks.rados.rados.2.smithi057.stdout:2864: finishing copy_from racing read to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:44.393 INFO:tasks.rados.rados.2.smithi057.stdout:2864: done (5 left) 2020-11-16T22:12:44.393 INFO:tasks.rados.rados.2.smithi057.stdout:2866: done (4 left) 2020-11-16T22:12:44.394 INFO:tasks.rados.rados.2.smithi057.stdout:2869: snap_create 2020-11-16T22:12:44.394 INFO:tasks.rados.rados.2.smithi057.stdout:2863: finishing write tid 1 to smithi05720651-10 2020-11-16T22:12:44.394 INFO:tasks.rados.rados.2.smithi057.stdout:2868: finishing write tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:44.394 INFO:tasks.rados.rados.2.smithi057.stdout:2867: finishing rollback tid 0 to smithi05720651-28 2020-11-16T22:12:44.395 INFO:tasks.rados.rados.2.smithi057.stdout:2865: expect (ObjNum 820 snap 281 seq_num 820) 2020-11-16T22:12:44.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:44 smithi057 bash[10301]: cluster 2020-11-16T22:12:43.148183+0000 mon.a (mon.0) 1407 : cluster [DBG] osdmap e735: 12 total, 12 up, 12 in 2020-11-16T22:12:44.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:44 smithi016 bash[10302]: cluster 2020-11-16T22:12:43.148183+0000 mon.a (mon.0) 1407 : cluster [DBG] osdmap e735: 12 total, 12 up, 12 in 2020-11-16T22:12:44.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:44 smithi195 bash[10218]: cluster 2020-11-16T22:12:43.148183+0000 mon.a (mon.0) 1407 : cluster [DBG] osdmap e735: 12 total, 12 up, 12 in 2020-11-16T22:12:44.639 INFO:tasks.rados.rados.2.smithi057.stdout:2863: finishing write tid 2 to smithi05720651-10 2020-11-16T22:12:44.639 INFO:tasks.rados.rados.2.smithi057.stdout:2863: finishing write tid 4 to smithi05720651-10 2020-11-16T22:12:44.640 INFO:tasks.rados.rados.2.smithi057.stdout:2863: finishing write tid 5 to smithi05720651-10 2020-11-16T22:12:44.640 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 2100 (ObjNum 967 snap 333 seq_num 967) dirty exists 2020-11-16T22:12:44.640 INFO:tasks.rados.rados.2.smithi057.stdout:2863: left oid 10 (ObjNum 967 snap 333 seq_num 967) 2020-11-16T22:12:44.640 INFO:tasks.rados.rados.2.smithi057.stdout:2867: finishing rollback tid 1 to smithi05720651-28 2020-11-16T22:12:44.640 INFO:tasks.rados.rados.2.smithi057.stdout:2867: finishing rollback tid 2 to smithi05720651-28 2020-11-16T22:12:44.640 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 2102 (ObjNum 922 snap 314 seq_num 922) dirty exists 2020-11-16T22:12:44.640 INFO:tasks.rados.rados.2.smithi057.stdout:2868: finishing write tid 2 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:44.641 INFO:tasks.rados.rados.2.smithi057.stdout:2868: finishing write tid 4 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:44.641 INFO:tasks.rados.rados.2.smithi057.stdout:2868: finishing write tid 5 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:44.641 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1775 (ObjNum 968 snap 333 seq_num 968) dirty exists 2020-11-16T22:12:44.641 INFO:tasks.rados.rados.2.smithi057.stdout:2868: left oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 968 snap 333 seq_num 968) 2020-11-16T22:12:45.114 INFO:tasks.rados.rados.2.smithi057.stdout:2863: done (4 left) 2020-11-16T22:12:45.114 INFO:tasks.rados.rados.2.smithi057.stdout:2865: done (3 left) 2020-11-16T22:12:45.114 INFO:tasks.rados.rados.2.smithi057.stdout:2867: done (2 left) 2020-11-16T22:12:45.114 INFO:tasks.rados.rados.2.smithi057.stdout:2868: done (1 left) 2020-11-16T22:12:45.114 INFO:tasks.rados.rados.2.smithi057.stdout:2869: done (0 left) 2020-11-16T22:12:45.115 INFO:tasks.rados.rados.2.smithi057.stdout:2870: rollback oid 12 current snap is 334 2020-11-16T22:12:45.115 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 12 to 325 2020-11-16T22:12:45.115 INFO:tasks.rados.rados.2.smithi057.stdout:2871: snap_create 2020-11-16T22:12:45.127 INFO:tasks.rados.rados.2.smithi057.stdout:2870: finishing rollback tid 0 to smithi05720651-12 2020-11-16T22:12:45.127 INFO:tasks.rados.rados.2.smithi057.stdout:2870: finishing rollback tid 1 to smithi05720651-12 2020-11-16T22:12:45.127 INFO:tasks.rados.rados.2.smithi057.stdout:2870: finishing rollback tid 2 to smithi05720651-12 2020-11-16T22:12:45.128 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 1786 (ObjNum 816 snap 279 seq_num 816) dirty exists 2020-11-16T22:12:45.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:45 smithi057 bash[10301]: cluster 2020-11-16T22:12:43.797626+0000 mgr.x (mgr.24115) 603 : cluster [DBG] pgmap v1268: 17 pgs: 17 active+clean; 168 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.2 MiB/s wr, 14 op/s 2020-11-16T22:12:45.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:45 smithi057 bash[10301]: cluster 2020-11-16T22:12:44.169399+0000 mon.a (mon.0) 1408 : cluster [DBG] osdmap e736: 12 total, 12 up, 12 in 2020-11-16T22:12:45.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:45 smithi057 bash[10301]: cluster 2020-11-16T22:12:45.124388+0000 mon.a (mon.0) 1409 : cluster [DBG] osdmap e737: 12 total, 12 up, 12 in 2020-11-16T22:12:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:45 smithi016 bash[10302]: cluster 2020-11-16T22:12:43.797626+0000 mgr.x (mgr.24115) 603 : cluster [DBG] pgmap v1268: 17 pgs: 17 active+clean; 168 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.2 MiB/s wr, 14 op/s 2020-11-16T22:12:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:45 smithi016 bash[10302]: cluster 2020-11-16T22:12:44.169399+0000 mon.a (mon.0) 1408 : cluster [DBG] osdmap e736: 12 total, 12 up, 12 in 2020-11-16T22:12:45.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:45 smithi016 bash[10302]: cluster 2020-11-16T22:12:45.124388+0000 mon.a (mon.0) 1409 : cluster [DBG] osdmap e737: 12 total, 12 up, 12 in 2020-11-16T22:12:45.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:45 smithi195 bash[10218]: cluster 2020-11-16T22:12:43.797626+0000 mgr.x (mgr.24115) 603 : cluster [DBG] pgmap v1268: 17 pgs: 17 active+clean; 168 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 3.2 MiB/s wr, 14 op/s 2020-11-16T22:12:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:45 smithi195 bash[10218]: cluster 2020-11-16T22:12:44.169399+0000 mon.a (mon.0) 1408 : cluster [DBG] osdmap e736: 12 total, 12 up, 12 in 2020-11-16T22:12:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:45 smithi195 bash[10218]: cluster 2020-11-16T22:12:45.124388+0000 mon.a (mon.0) 1409 : cluster [DBG] osdmap e737: 12 total, 12 up, 12 in 2020-11-16T22:12:46.124 INFO:tasks.rados.rados.2.smithi057.stdout:2870: done (1 left) 2020-11-16T22:12:46.124 INFO:tasks.rados.rados.2.smithi057.stdout:2871: done (0 left) 2020-11-16T22:12:46.124 INFO:tasks.rados.rados.2.smithi057.stdout:2872: read oid 24 snap 315 2020-11-16T22:12:46.124 INFO:tasks.rados.rados.2.smithi057.stdout:2872: expect deleted 2020-11-16T22:12:46.124 INFO:tasks.rados.rados.2.smithi057.stdout:2873: snap_remove snap 330 2020-11-16T22:12:47.127 INFO:tasks.rados.rados.2.smithi057.stdout:2873: done (1 left) 2020-11-16T22:12:47.127 INFO:tasks.rados.rados.2.smithi057.stdout:2874: copy_from oid 34 from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 335 2020-11-16T22:12:47.128 INFO:tasks.rados.rados.2.smithi057.stdout:2872: done (1 left) 2020-11-16T22:12:47.128 INFO:tasks.rados.rados.2.smithi057.stdout:2875: read oid 24 snap -1 2020-11-16T22:12:47.128 INFO:tasks.rados.rados.2.smithi057.stdout:2875: expect (ObjNum 934 snap 321 seq_num 934) 2020-11-16T22:12:47.128 INFO:tasks.rados.rados.2.smithi057.stdout:2876: snap_create 2020-11-16T22:12:47.148 INFO:tasks.rados.rados.2.smithi057.stdout:2875: expect (ObjNum 934 snap 321 seq_num 934) 2020-11-16T22:12:47.269 INFO:tasks.rados.rados.2.smithi057.stdout:2874: finishing copy_from to smithi05720651-34 2020-11-16T22:12:47.270 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 2183 (ObjNum 949 snap 328 seq_num 949) dirty exists 2020-11-16T22:12:47.270 INFO:tasks.rados.rados.2.smithi057.stdout:2874: finishing copy_from racing read to smithi05720651-34 2020-11-16T22:12:47.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:47 smithi057 bash[10301]: cluster 2020-11-16T22:12:45.798347+0000 mgr.x (mgr.24115) 604 : cluster [DBG] pgmap v1271: 17 pgs: 17 active+clean; 168 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 668 KiB/s wr, 11 op/s 2020-11-16T22:12:47.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:47 smithi057 bash[10301]: cluster 2020-11-16T22:12:46.134114+0000 mon.a (mon.0) 1410 : cluster [DBG] osdmap e738: 12 total, 12 up, 12 in 2020-11-16T22:12:47.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:47 smithi016 bash[10302]: cluster 2020-11-16T22:12:45.798347+0000 mgr.x (mgr.24115) 604 : cluster [DBG] pgmap v1271: 17 pgs: 17 active+clean; 168 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 668 KiB/s wr, 11 op/s 2020-11-16T22:12:47.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:47 smithi016 bash[10302]: cluster 2020-11-16T22:12:46.134114+0000 mon.a (mon.0) 1410 : cluster [DBG] osdmap e738: 12 total, 12 up, 12 in 2020-11-16T22:12:47.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:47 smithi195 bash[10218]: cluster 2020-11-16T22:12:45.798347+0000 mgr.x (mgr.24115) 604 : cluster [DBG] pgmap v1271: 17 pgs: 17 active+clean; 168 MiB data, 716 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 668 KiB/s wr, 11 op/s 2020-11-16T22:12:47.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:47 smithi195 bash[10218]: cluster 2020-11-16T22:12:46.134114+0000 mon.a (mon.0) 1410 : cluster [DBG] osdmap e738: 12 total, 12 up, 12 in 2020-11-16T22:12:48.145 INFO:tasks.rados.rados.2.smithi057.stdout:2874: done (2 left) 2020-11-16T22:12:48.146 INFO:tasks.rados.rados.2.smithi057.stdout:2875: done (1 left) 2020-11-16T22:12:48.146 INFO:tasks.rados.rados.2.smithi057.stdout:2876: done (0 left) 2020-11-16T22:12:48.146 INFO:tasks.rados.rados.2.smithi057.stdout:2877: copy_from oid 50 from oid 38 current snap is 336 2020-11-16T22:12:48.146 INFO:tasks.rados.rados.2.smithi057.stdout:2878: read oid 44 snap -1 2020-11-16T22:12:48.146 INFO:tasks.rados.rados.2.smithi057.stdout:2878: expect (ObjNum 820 snap 281 seq_num 820) 2020-11-16T22:12:48.146 INFO:tasks.rados.rados.2.smithi057.stdout:2879: read oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:48.147 INFO:tasks.rados.rados.2.smithi057.stdout:2879: expect (ObjNum 916 snap 313 seq_num 916) 2020-11-16T22:12:48.147 INFO:tasks.rados.rados.2.smithi057.stdout:2880: read oid 32 snap -1 2020-11-16T22:12:48.147 INFO:tasks.rados.rados.2.smithi057.stdout:2880: expect (ObjNum 856 snap 289 seq_num 856) 2020-11-16T22:12:48.148 INFO:tasks.rados.rados.2.smithi057.stdout:2881: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:48.148 INFO:tasks.rados.rados.2.smithi057.stdout:2881: expect (ObjNum 963 snap 332 seq_num 963) 2020-11-16T22:12:48.148 INFO:tasks.rados.rados.2.smithi057.stdout:2882: read oid 46 snap -1 2020-11-16T22:12:48.148 INFO:tasks.rados.rados.2.smithi057.stdout:2882: expect (ObjNum 920 snap 313 seq_num 920) 2020-11-16T22:12:48.148 INFO:tasks.rados.rados.2.smithi057.stdout:2883: write oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 336 2020-11-16T22:12:48.149 INFO:tasks.rados.rados.2.smithi057.stdout:2883: seq_num 969 ranges {685983=493112,1870228=415755} 2020-11-16T22:12:48.160 INFO:tasks.rados.rados.2.smithi057.stdout:2883: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 685983 to 1179095 tid 1 2020-11-16T22:12:48.167 INFO:tasks.rados.rados.2.smithi057.stdout:2883: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1870228 to 2285983 tid 2 2020-11-16T22:12:48.168 INFO:tasks.rados.rados.2.smithi057.stdout:2884: write oid 8 current snap is 336 2020-11-16T22:12:48.168 INFO:tasks.rados.rados.2.smithi057.stdout:2884: seq_num 970 ranges {702790=568361,1812357=490433} 2020-11-16T22:12:48.175 INFO:tasks.rados.rados.2.smithi057.stdout:2884: writing smithi05720651-8 from 702790 to 1271151 tid 1 2020-11-16T22:12:48.181 INFO:tasks.rados.rados.2.smithi057.stdout:2884: writing smithi05720651-8 from 1812357 to 2302790 tid 2 2020-11-16T22:12:48.181 INFO:tasks.rados.rados.2.smithi057.stdout:2885: read oid 26 snap -1 2020-11-16T22:12:48.181 INFO:tasks.rados.rados.2.smithi057.stdout:2885: expect (ObjNum 949 snap 328 seq_num 949) 2020-11-16T22:12:48.182 INFO:tasks.rados.rados.2.smithi057.stdout:2886: rollback oid 48 current snap is 336 2020-11-16T22:12:48.182 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 48 to 322 2020-11-16T22:12:48.182 INFO:tasks.rados.rados.2.smithi057.stdout:2880: expect (ObjNum 856 snap 289 seq_num 856) 2020-11-16T22:12:48.294 INFO:tasks.rados.rados.2.smithi057.stdout:2878: expect (ObjNum 820 snap 281 seq_num 820) 2020-11-16T22:12:48.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:48 smithi057 bash[10301]: cluster 2020-11-16T22:12:47.136323+0000 mon.a (mon.0) 1411 : cluster [DBG] osdmap e739: 12 total, 12 up, 12 in 2020-11-16T22:12:48.530 INFO:tasks.rados.rados.2.smithi057.stdout:2879: expect (ObjNum 916 snap 313 seq_num 916) 2020-11-16T22:12:48.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:48 smithi016 bash[10302]: cluster 2020-11-16T22:12:47.136323+0000 mon.a (mon.0) 1411 : cluster [DBG] osdmap e739: 12 total, 12 up, 12 in 2020-11-16T22:12:48.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:48 smithi195 bash[10218]: cluster 2020-11-16T22:12:47.136323+0000 mon.a (mon.0) 1411 : cluster [DBG] osdmap e739: 12 total, 12 up, 12 in 2020-11-16T22:12:48.765 INFO:tasks.rados.rados.2.smithi057.stdout:2883: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:48.765 INFO:tasks.rados.rados.2.smithi057.stdout:2877: finishing copy_from to smithi05720651-50 2020-11-16T22:12:48.765 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 1795 (ObjNum 941 snap 324 seq_num 941) dirty exists 2020-11-16T22:12:48.765 INFO:tasks.rados.rados.2.smithi057.stdout:2883: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:48.766 INFO:tasks.rados.rados.2.smithi057.stdout:2883: finishing write tid 4 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:48.766 INFO:tasks.rados.rados.2.smithi057.stdout:2877: finishing copy_from racing read to smithi05720651-50 2020-11-16T22:12:48.766 INFO:tasks.rados.rados.2.smithi057.stdout:2883: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:48.766 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2186 (ObjNum 969 snap 336 seq_num 969) dirty exists 2020-11-16T22:12:48.766 INFO:tasks.rados.rados.2.smithi057.stdout:2883: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 969 snap 336 seq_num 969) 2020-11-16T22:12:48.766 INFO:tasks.rados.rados.2.smithi057.stdout:2882: expect (ObjNum 920 snap 313 seq_num 920) 2020-11-16T22:12:48.864 INFO:tasks.rados.rados.2.smithi057.stdout:2881: expect (ObjNum 963 snap 332 seq_num 963) 2020-11-16T22:12:48.987 INFO:tasks.rados.rados.2.smithi057.stdout:2884: finishing write tid 1 to smithi05720651-8 2020-11-16T22:12:48.987 INFO:tasks.rados.rados.2.smithi057.stdout:2886: finishing rollback tid 1 to smithi05720651-48 2020-11-16T22:12:48.987 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 0 (ObjNum 385 snap 0 seq_num 2932402144) dirty dne 2020-11-16T22:12:48.987 INFO:tasks.rados.rados.2.smithi057.stdout:2884: finishing write tid 2 to smithi05720651-8 2020-11-16T22:12:48.987 INFO:tasks.rados.rados.2.smithi057.stdout:2884: finishing write tid 4 to smithi05720651-8 2020-11-16T22:12:48.987 INFO:tasks.rados.rados.2.smithi057.stdout:2884: finishing write tid 5 to smithi05720651-8 2020-11-16T22:12:48.988 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 1717 (ObjNum 970 snap 336 seq_num 970) dirty exists 2020-11-16T22:12:48.988 INFO:tasks.rados.rados.2.smithi057.stdout:2884: left oid 8 (ObjNum 970 snap 336 seq_num 970) 2020-11-16T22:12:48.988 INFO:tasks.rados.rados.2.smithi057.stdout:2885: expect (ObjNum 949 snap 328 seq_num 949) 2020-11-16T22:12:49.158 INFO:tasks.rados.rados.2.smithi057.stdout:2877: done (9 left) 2020-11-16T22:12:49.159 INFO:tasks.rados.rados.2.smithi057.stdout:2878: done (8 left) 2020-11-16T22:12:49.159 INFO:tasks.rados.rados.2.smithi057.stdout:2879: done (7 left) 2020-11-16T22:12:49.159 INFO:tasks.rados.rados.2.smithi057.stdout:2880: done (6 left) 2020-11-16T22:12:49.159 INFO:tasks.rados.rados.2.smithi057.stdout:2881: done (5 left) 2020-11-16T22:12:49.159 INFO:tasks.rados.rados.2.smithi057.stdout:2882: done (4 left) 2020-11-16T22:12:49.159 INFO:tasks.rados.rados.2.smithi057.stdout:2883: done (3 left) 2020-11-16T22:12:49.159 INFO:tasks.rados.rados.2.smithi057.stdout:2884: done (2 left) 2020-11-16T22:12:49.160 INFO:tasks.rados.rados.2.smithi057.stdout:2885: done (1 left) 2020-11-16T22:12:49.160 INFO:tasks.rados.rados.2.smithi057.stdout:2886: done (0 left) 2020-11-16T22:12:49.160 INFO:tasks.rados.rados.2.smithi057.stdout:2887: rollback oid 12 current snap is 336 2020-11-16T22:12:49.160 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 12 to 333 2020-11-16T22:12:49.160 INFO:tasks.rados.rados.2.smithi057.stdout:2888: copy_from oid 42 from oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 336 2020-11-16T22:12:49.160 INFO:tasks.rados.rados.2.smithi057.stdout:2889: read oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 325 2020-11-16T22:12:49.160 INFO:tasks.rados.rados.2.smithi057.stdout:2889: expect (ObjNum 912 snap 310 seq_num 912) 2020-11-16T22:12:49.161 INFO:tasks.rados.rados.2.smithi057.stdout:2890: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:49.161 INFO:tasks.rados.rados.2.smithi057.stdout:2890: expect (ObjNum 916 snap 313 seq_num 916) 2020-11-16T22:12:49.161 INFO:tasks.rados.rados.2.smithi057.stdout:2891: read oid 16 snap -1 2020-11-16T22:12:49.161 INFO:tasks.rados.rados.2.smithi057.stdout:2891: expect (ObjNum 878 snap 296 seq_num 878) 2020-11-16T22:12:49.161 INFO:tasks.rados.rados.2.smithi057.stdout:2892: copy_from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 28 current snap is 336 2020-11-16T22:12:49.161 INFO:tasks.rados.rados.2.smithi057.stdout:2893: read oid 20 snap 335 2020-11-16T22:12:49.161 INFO:tasks.rados.rados.2.smithi057.stdout:2893: expect (ObjNum 940 snap 324 seq_num 940) 2020-11-16T22:12:49.162 INFO:tasks.rados.rados.2.smithi057.stdout:2894: snap_remove snap 331 2020-11-16T22:12:49.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:49 smithi057 bash[10301]: cluster 2020-11-16T22:12:47.799069+0000 mgr.x (mgr.24115) 605 : cluster [DBG] pgmap v1274: 17 pgs: 17 active+clean; 176 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.3 MiB/s wr, 16 op/s 2020-11-16T22:12:49.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:49 smithi057 bash[10301]: cluster 2020-11-16T22:12:48.151145+0000 mon.a (mon.0) 1412 : cluster [DBG] osdmap e740: 12 total, 12 up, 12 in 2020-11-16T22:12:49.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:49 smithi016 bash[10302]: cluster 2020-11-16T22:12:47.799069+0000 mgr.x (mgr.24115) 605 : cluster [DBG] pgmap v1274: 17 pgs: 17 active+clean; 176 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.3 MiB/s wr, 16 op/s 2020-11-16T22:12:49.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:49 smithi016 bash[10302]: cluster 2020-11-16T22:12:48.151145+0000 mon.a (mon.0) 1412 : cluster [DBG] osdmap e740: 12 total, 12 up, 12 in 2020-11-16T22:12:49.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:49 smithi195 bash[10218]: cluster 2020-11-16T22:12:47.799069+0000 mgr.x (mgr.24115) 605 : cluster [DBG] pgmap v1274: 17 pgs: 17 active+clean; 176 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.3 MiB/s wr, 16 op/s 2020-11-16T22:12:49.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:49 smithi195 bash[10218]: cluster 2020-11-16T22:12:48.151145+0000 mon.a (mon.0) 1412 : cluster [DBG] osdmap e740: 12 total, 12 up, 12 in 2020-11-16T22:12:50.115 INFO:tasks.rados.rados.2.smithi057.stdout:2894: done (7 left) 2020-11-16T22:12:50.116 INFO:tasks.rados.rados.2.smithi057.stdout:2895: write (excl) oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 336 2020-11-16T22:12:50.116 INFO:tasks.rados.rados.2.smithi057.stdout:2895: seq_num 971 ranges {719597=643610,1870839=448758} 2020-11-16T22:12:50.128 INFO:tasks.rados.rados.2.smithi057.stdout:2895: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 719597 to 1363207 tid 1 2020-11-16T22:12:50.133 INFO:tasks.rados.rados.2.smithi057.stdout:2895: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1870839 to 2319597 tid 2 2020-11-16T22:12:50.133 INFO:tasks.rados.rados.2.smithi057.stdout:2896: copy_from oid 18 from oid 4 current snap is 336 2020-11-16T22:12:50.134 INFO:tasks.rados.rados.2.smithi057.stdout:2893: expect (ObjNum 940 snap 324 seq_num 940) 2020-11-16T22:12:50.347 INFO:tasks.rados.rados.2.smithi057.stdout:2887: finishing rollback tid 0 to smithi05720651-12 2020-11-16T22:12:50.347 INFO:tasks.rados.rados.2.smithi057.stdout:2887: finishing rollback tid 1 to smithi05720651-12 2020-11-16T22:12:50.347 INFO:tasks.rados.rados.2.smithi057.stdout:2887: finishing rollback tid 2 to smithi05720651-12 2020-11-16T22:12:50.347 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 1789 (ObjNum 962 snap 331 seq_num 962) dirty exists 2020-11-16T22:12:50.347 INFO:tasks.rados.rados.2.smithi057.stdout:2889: expect (ObjNum 912 snap 310 seq_num 912) 2020-11-16T22:12:50.557 INFO:tasks.rados.rados.2.smithi057.stdout:2890: expect (ObjNum 916 snap 313 seq_num 916) 2020-11-16T22:12:50.794 INFO:tasks.rados.rados.2.smithi057.stdout:2888: finishing copy_from to smithi05720651-42 2020-11-16T22:12:50.794 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 1775 (ObjNum 968 snap 333 seq_num 968) dirty exists 2020-11-16T22:12:50.794 INFO:tasks.rados.rados.2.smithi057.stdout:2888: finishing copy_from racing read to smithi05720651-42 2020-11-16T22:12:50.794 INFO:tasks.rados.rados.2.smithi057.stdout:2891: expect (ObjNum 878 snap 296 seq_num 878) 2020-11-16T22:12:50.974 INFO:tasks.rados.rados.2.smithi057.stdout:2892: finishing copy_from to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:50.974 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2102 (ObjNum 922 snap 314 seq_num 922) dirty exists 2020-11-16T22:12:50.974 INFO:tasks.rados.rados.2.smithi057.stdout:2892: finishing copy_from racing read to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:50.975 INFO:tasks.rados.rados.2.smithi057.stdout:2895: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:50.975 INFO:tasks.rados.rados.2.smithi057.stdout:2887: done (8 left) 2020-11-16T22:12:50.975 INFO:tasks.rados.rados.2.smithi057.stdout:2888: done (7 left) 2020-11-16T22:12:50.975 INFO:tasks.rados.rados.2.smithi057.stdout:2889: done (6 left) 2020-11-16T22:12:50.975 INFO:tasks.rados.rados.2.smithi057.stdout:2890: done (5 left) 2020-11-16T22:12:50.975 INFO:tasks.rados.rados.2.smithi057.stdout:2891: done (4 left) 2020-11-16T22:12:50.975 INFO:tasks.rados.rados.2.smithi057.stdout:2892: done (3 left) 2020-11-16T22:12:50.976 INFO:tasks.rados.rados.2.smithi057.stdout:2893: done (2 left) 2020-11-16T22:12:50.976 INFO:tasks.rados.rados.2.smithi057.stdout:2897: read oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 335 2020-11-16T22:12:50.976 INFO:tasks.rados.rados.2.smithi057.stdout:2897: expect (ObjNum 952 snap 329 seq_num 952) 2020-11-16T22:12:50.976 INFO:tasks.rados.rados.2.smithi057.stdout:2898: snap_remove snap 322 2020-11-16T22:12:51.148 INFO:tasks.rados.rados.2.smithi057.stdout:2898: done (3 left) 2020-11-16T22:12:51.149 INFO:tasks.rados.rados.2.smithi057.stdout:2899: read oid 24 snap -1 2020-11-16T22:12:51.149 INFO:tasks.rados.rados.2.smithi057.stdout:2899: expect (ObjNum 934 snap 321 seq_num 934) 2020-11-16T22:12:51.149 INFO:tasks.rados.rados.2.smithi057.stdout:2900: copy_from oid 22 from oid 28 current snap is 336 2020-11-16T22:12:51.149 INFO:tasks.rados.rados.2.smithi057.stdout:2895: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:51.149 INFO:tasks.rados.rados.2.smithi057.stdout:2895: finishing write tid 4 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:51.149 INFO:tasks.rados.rados.2.smithi057.stdout:2895: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:51.149 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1912 (ObjNum 971 snap 336 seq_num 971) dirty exists 2020-11-16T22:12:51.150 INFO:tasks.rados.rados.2.smithi057.stdout:2895: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 971 snap 336 seq_num 971) 2020-11-16T22:12:51.150 INFO:tasks.rados.rados.2.smithi057.stdout:2896: finishing copy_from to smithi05720651-18 2020-11-16T22:12:51.150 INFO:tasks.rados.rados.2.smithi057.stdout:2896: got expected ENOENT (src dne) 2020-11-16T22:12:51.150 INFO:tasks.rados.rados.2.smithi057.stdout:2896: finishing copy_from racing read to smithi05720651-18 2020-11-16T22:12:51.150 INFO:tasks.rados.rados.2.smithi057.stdout:2897: expect (ObjNum 952 snap 329 seq_num 952) 2020-11-16T22:12:51.303 INFO:tasks.rados.rados.2.smithi057.stdout:2899: expect (ObjNum 934 snap 321 seq_num 934) 2020-11-16T22:12:51.413 INFO:tasks.rados.rados.2.smithi057.stdout:2900: finishing copy_from to smithi05720651-22 2020-11-16T22:12:51.414 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 2102 (ObjNum 922 snap 314 seq_num 922) dirty exists 2020-11-16T22:12:51.414 INFO:tasks.rados.rados.2.smithi057.stdout:2900: finishing copy_from racing read to smithi05720651-22 2020-11-16T22:12:51.414 INFO:tasks.rados.rados.2.smithi057.stdout:2895: done (4 left) 2020-11-16T22:12:51.414 INFO:tasks.rados.rados.2.smithi057.stdout:2896: done (3 left) 2020-11-16T22:12:51.414 INFO:tasks.rados.rados.2.smithi057.stdout:2897: done (2 left) 2020-11-16T22:12:51.415 INFO:tasks.rados.rados.2.smithi057.stdout:2899: done (1 left) 2020-11-16T22:12:51.415 INFO:tasks.rados.rados.2.smithi057.stdout:2900: done (0 left) 2020-11-16T22:12:51.415 INFO:tasks.rados.rados.2.smithi057.stdout:2901: snap_create 2020-11-16T22:12:51.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:51 smithi057 bash[10301]: cluster 2020-11-16T22:12:49.799759+0000 mgr.x (mgr.24115) 606 : cluster [DBG] pgmap v1276: 17 pgs: 17 active+clean; 179 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 1.4 MiB/s wr, 8 op/s 2020-11-16T22:12:51.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:51 smithi057 bash[10301]: cluster 2020-11-16T22:12:50.125809+0000 mon.a (mon.0) 1413 : cluster [DBG] osdmap e741: 12 total, 12 up, 12 in 2020-11-16T22:12:51.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:51 smithi016 bash[10302]: cluster 2020-11-16T22:12:49.799759+0000 mgr.x (mgr.24115) 606 : cluster [DBG] pgmap v1276: 17 pgs: 17 active+clean; 179 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 1.4 MiB/s wr, 8 op/s 2020-11-16T22:12:51.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:51 smithi016 bash[10302]: cluster 2020-11-16T22:12:50.125809+0000 mon.a (mon.0) 1413 : cluster [DBG] osdmap e741: 12 total, 12 up, 12 in 2020-11-16T22:12:51.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:51 smithi195 bash[10218]: cluster 2020-11-16T22:12:49.799759+0000 mgr.x (mgr.24115) 606 : cluster [DBG] pgmap v1276: 17 pgs: 17 active+clean; 179 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 1.4 MiB/s wr, 8 op/s 2020-11-16T22:12:51.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:51 smithi195 bash[10218]: cluster 2020-11-16T22:12:50.125809+0000 mon.a (mon.0) 1413 : cluster [DBG] osdmap e741: 12 total, 12 up, 12 in 2020-11-16T22:12:52.159 INFO:tasks.rados.rados.2.smithi057.stdout:2901: done (0 left) 2020-11-16T22:12:52.159 INFO:tasks.rados.rados.2.smithi057.stdout:2902: delete oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 337 2020-11-16T22:12:52.163 INFO:tasks.rados.rados.2.smithi057.stdout:2902: done (0 left) 2020-11-16T22:12:52.163 INFO:tasks.rados.rados.2.smithi057.stdout:2903: rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 337 2020-11-16T22:12:52.163 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 335 2020-11-16T22:12:52.164 INFO:tasks.rados.rados.2.smithi057.stdout:2904: snap_create 2020-11-16T22:12:52.165 INFO:tasks.rados.rados.2.smithi057.stdout:2903: finishing rollback tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:52.165 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 353 snap 0 seq_num 1953066355) dirty dne 2020-11-16T22:12:52.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:52 smithi057 bash[10301]: cluster 2020-11-16T22:12:51.159377+0000 mon.a (mon.0) 1414 : cluster [DBG] osdmap e742: 12 total, 12 up, 12 in 2020-11-16T22:12:52.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:52 smithi016 bash[10302]: cluster 2020-11-16T22:12:51.159377+0000 mon.a (mon.0) 1414 : cluster [DBG] osdmap e742: 12 total, 12 up, 12 in 2020-11-16T22:12:52.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:52 smithi195 bash[10218]: cluster 2020-11-16T22:12:51.159377+0000 mon.a (mon.0) 1414 : cluster [DBG] osdmap e742: 12 total, 12 up, 12 in 2020-11-16T22:12:53.168 INFO:tasks.rados.rados.2.smithi057.stdout:2903: done (1 left) 2020-11-16T22:12:53.169 INFO:tasks.rados.rados.2.smithi057.stdout:2904: done (0 left) 2020-11-16T22:12:53.169 INFO:tasks.rados.rados.2.smithi057.stdout:2905: rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 338 2020-11-16T22:12:53.169 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 325 2020-11-16T22:12:53.169 INFO:tasks.rados.rados.2.smithi057.stdout:2906: snap_create 2020-11-16T22:12:53.178 INFO:tasks.rados.rados.2.smithi057.stdout:2905: finishing rollback tid 0 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:53.180 INFO:tasks.rados.rados.2.smithi057.stdout:2905: finishing rollback tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:53.180 INFO:tasks.rados.rados.2.smithi057.stdout:2905: finishing rollback tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:53.180 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2190 (ObjNum 926 snap 314 seq_num 926) dirty exists 2020-11-16T22:12:53.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:53 smithi057 bash[10301]: cluster 2020-11-16T22:12:51.800457+0000 mgr.x (mgr.24115) 607 : cluster [DBG] pgmap v1279: 17 pgs: 17 active+clean; 192 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.6 MiB/s wr, 25 op/s 2020-11-16T22:12:53.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:53 smithi057 bash[10301]: cluster 2020-11-16T22:12:52.169568+0000 mon.a (mon.0) 1415 : cluster [DBG] osdmap e743: 12 total, 12 up, 12 in 2020-11-16T22:12:53.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:53 smithi016 bash[10302]: cluster 2020-11-16T22:12:51.800457+0000 mgr.x (mgr.24115) 607 : cluster [DBG] pgmap v1279: 17 pgs: 17 active+clean; 192 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.6 MiB/s wr, 25 op/s 2020-11-16T22:12:53.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:53 smithi016 bash[10302]: cluster 2020-11-16T22:12:52.169568+0000 mon.a (mon.0) 1415 : cluster [DBG] osdmap e743: 12 total, 12 up, 12 in 2020-11-16T22:12:53.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:53 smithi195 bash[10218]: cluster 2020-11-16T22:12:51.800457+0000 mgr.x (mgr.24115) 607 : cluster [DBG] pgmap v1279: 17 pgs: 17 active+clean; 192 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.6 MiB/s wr, 25 op/s 2020-11-16T22:12:53.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:53 smithi195 bash[10218]: cluster 2020-11-16T22:12:52.169568+0000 mon.a (mon.0) 1415 : cluster [DBG] osdmap e743: 12 total, 12 up, 12 in 2020-11-16T22:12:54.179 INFO:tasks.rados.rados.2.smithi057.stdout:2905: done (1 left) 2020-11-16T22:12:54.179 INFO:tasks.rados.rados.2.smithi057.stdout:2906: done (0 left) 2020-11-16T22:12:54.179 INFO:tasks.rados.rados.2.smithi057.stdout:2907: copy_from oid 24 from oid 44 current snap is 339 2020-11-16T22:12:54.179 INFO:tasks.rados.rados.2.smithi057.stdout:2908: delete oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 339 2020-11-16T22:12:54.187 INFO:tasks.rados.rados.2.smithi057.stdout:2908: done (1 left) 2020-11-16T22:12:54.188 INFO:tasks.rados.rados.2.smithi057.stdout:2909: read oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:54.188 INFO:tasks.rados.rados.2.smithi057.stdout:2909: expect (ObjNum 912 snap 310 seq_num 912) 2020-11-16T22:12:54.188 INFO:tasks.rados.rados.2.smithi057.stdout:2910: read oid 40 snap -1 2020-11-16T22:12:54.188 INFO:tasks.rados.rados.2.smithi057.stdout:2910: expect (ObjNum 964 snap 332 seq_num 964) 2020-11-16T22:12:54.188 INFO:tasks.rados.rados.2.smithi057.stdout:2911: delete oid 6 current snap is 339 2020-11-16T22:12:54.199 INFO:tasks.rados.rados.2.smithi057.stdout:2911: done (3 left) 2020-11-16T22:12:54.199 INFO:tasks.rados.rados.2.smithi057.stdout:2912: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 335 2020-11-16T22:12:54.199 INFO:tasks.rados.rados.2.smithi057.stdout:2912: expect deleted 2020-11-16T22:12:54.200 INFO:tasks.rados.rados.2.smithi057.stdout:2913: read oid 26 snap -1 2020-11-16T22:12:54.200 INFO:tasks.rados.rados.2.smithi057.stdout:2913: expect (ObjNum 949 snap 328 seq_num 949) 2020-11-16T22:12:54.200 INFO:tasks.rados.rados.2.smithi057.stdout:2914: snap_create 2020-11-16T22:12:54.203 INFO:tasks.rados.rados.2.smithi057.stdout:2909: expect (ObjNum 912 snap 310 seq_num 912) 2020-11-16T22:12:58.302 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:54 smithi195 bash[10218]: cluster 2020-11-16T22:12:53.179013+0000 mon.a (mon.0) 1416 : cluster [DBG] osdmap e744: 12 total, 12 up, 12 in 2020-11-16T22:12:58.302 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:55 smithi195 bash[10218]: cluster 2020-11-16T22:12:53.801121+0000 mgr.x (mgr.24115) 608 : cluster [DBG] pgmap v1282: 17 pgs: 17 active+clean; 192 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 31 MiB/s rd, 3.0 MiB/s wr, 26 op/s 2020-11-16T22:12:58.302 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:55 smithi195 bash[10218]: cluster 2020-11-16T22:12:54.188854+0000 mon.a (mon.0) 1417 : cluster [DBG] osdmap e745: 12 total, 12 up, 12 in 2020-11-16T22:12:58.303 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:55 smithi195 bash[10218]: cluster 2020-11-16T22:12:55.127403+0000 mon.a (mon.0) 1418 : cluster [DBG] osdmap e746: 12 total, 12 up, 12 in 2020-11-16T22:12:58.303 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:57 smithi195 bash[10218]: cluster 2020-11-16T22:12:55.801877+0000 mgr.x (mgr.24115) 609 : cluster [DBG] pgmap v1285: 17 pgs: 17 active+clean; 203 MiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 1.7 MiB/s wr, 8 op/s 2020-11-16T22:12:58.303 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:57 smithi195 bash[10218]: cluster 2020-11-16T22:12:56.136708+0000 mon.a (mon.0) 1419 : cluster [DBG] osdmap e747: 12 total, 12 up, 12 in 2020-11-16T22:12:58.303 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:54 smithi016 bash[10302]: cluster 2020-11-16T22:12:53.179013+0000 mon.a (mon.0) 1416 : cluster [DBG] osdmap e744: 12 total, 12 up, 12 in 2020-11-16T22:12:58.303 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:55 smithi016 bash[10302]: cluster 2020-11-16T22:12:53.801121+0000 mgr.x (mgr.24115) 608 : cluster [DBG] pgmap v1282: 17 pgs: 17 active+clean; 192 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 31 MiB/s rd, 3.0 MiB/s wr, 26 op/s 2020-11-16T22:12:58.303 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:55 smithi016 bash[10302]: cluster 2020-11-16T22:12:54.188854+0000 mon.a (mon.0) 1417 : cluster [DBG] osdmap e745: 12 total, 12 up, 12 in 2020-11-16T22:12:58.303 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:55 smithi016 bash[10302]: cluster 2020-11-16T22:12:55.127403+0000 mon.a (mon.0) 1418 : cluster [DBG] osdmap e746: 12 total, 12 up, 12 in 2020-11-16T22:12:58.304 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:57 smithi016 bash[10302]: cluster 2020-11-16T22:12:55.801877+0000 mgr.x (mgr.24115) 609 : cluster [DBG] pgmap v1285: 17 pgs: 17 active+clean; 203 MiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 1.7 MiB/s wr, 8 op/s 2020-11-16T22:12:58.304 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:57 smithi016 bash[10302]: cluster 2020-11-16T22:12:56.136708+0000 mon.a (mon.0) 1419 : cluster [DBG] osdmap e747: 12 total, 12 up, 12 in 2020-11-16T22:12:58.304 INFO:tasks.rados.rados.2.smithi057.stdout:2907: finishing copy_from to smithi05720651-24 2020-11-16T22:12:58.304 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 1768 (ObjNum 820 snap 281 seq_num 820) dirty exists 2020-11-16T22:12:58.304 INFO:tasks.rados.rados.2.smithi057.stdout:2907: finishing copy_from racing read to smithi05720651-24 2020-11-16T22:12:58.305 INFO:tasks.rados.rados.2.smithi057.stdout:2910: expect (ObjNum 964 snap 332 seq_num 964) 2020-11-16T22:12:58.305 INFO:tasks.rados.rados.2.smithi057.stdout:2913: expect (ObjNum 949 snap 328 seq_num 949) 2020-11-16T22:12:58.305 INFO:tasks.rados.rados.2.smithi057.stdout:2907: done (5 left) 2020-11-16T22:12:58.305 INFO:tasks.rados.rados.2.smithi057.stdout:2909: done (4 left) 2020-11-16T22:12:58.305 INFO:tasks.rados.rados.2.smithi057.stdout:2910: done (3 left) 2020-11-16T22:12:58.305 INFO:tasks.rados.rados.2.smithi057.stdout:2912: done (2 left) 2020-11-16T22:12:58.305 INFO:tasks.rados.rados.2.smithi057.stdout:2913: done (1 left) 2020-11-16T22:12:58.306 INFO:tasks.rados.rados.2.smithi057.stdout:2914: done (0 left) 2020-11-16T22:12:58.306 INFO:tasks.rados.rados.2.smithi057.stdout:2915: copy_from oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 30 current snap is 340 2020-11-16T22:12:58.306 INFO:tasks.rados.rados.2.smithi057.stdout:2916: write (excl) oid 40 current snap is 340 2020-11-16T22:12:58.306 INFO:tasks.rados.rados.2.smithi057.stdout:2916: seq_num 975 ranges {786825=660959,2104767=282058} 2020-11-16T22:12:58.306 INFO:tasks.rados.rados.2.smithi057.stdout:2916: writing smithi05720651-40 from 786825 to 1447784 tid 1 2020-11-16T22:12:58.306 INFO:tasks.rados.rados.2.smithi057.stdout:2916: writing smithi05720651-40 from 2104767 to 2386825 tid 2 2020-11-16T22:12:58.306 INFO:tasks.rados.rados.2.smithi057.stdout:2917: snap_remove snap 325 2020-11-16T22:12:58.307 INFO:tasks.rados.rados.2.smithi057.stdout:2917: done (2 left) 2020-11-16T22:12:58.307 INFO:tasks.rados.rados.2.smithi057.stdout:2918: copy_from oid 28 from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 340 2020-11-16T22:12:58.307 INFO:tasks.rados.rados.2.smithi057.stdout:2915: finishing copy_from to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:58.307 INFO:tasks.rados.rados.2.smithi057.stdout:2915: got expected ENOENT (src dne) 2020-11-16T22:12:58.307 INFO:tasks.rados.rados.2.smithi057.stdout:2915: finishing copy_from racing read to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:58.307 INFO:tasks.rados.rados.2.smithi057.stdout:2916: finishing write tid 1 to smithi05720651-40 2020-11-16T22:12:58.307 INFO:tasks.rados.rados.2.smithi057.stdout:2916: finishing write tid 2 to smithi05720651-40 2020-11-16T22:12:58.308 INFO:tasks.rados.rados.2.smithi057.stdout:2916: finishing write tid 4 to smithi05720651-40 2020-11-16T22:12:58.308 INFO:tasks.rados.rados.2.smithi057.stdout:2916: finishing write tid 5 to smithi05720651-40 2020-11-16T22:12:58.308 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 2366 (ObjNum 975 snap 340 seq_num 975) dirty exists 2020-11-16T22:12:58.308 INFO:tasks.rados.rados.2.smithi057.stdout:2916: left oid 40 (ObjNum 975 snap 340 seq_num 975) 2020-11-16T22:12:58.308 INFO:tasks.rados.rados.2.smithi057.stdout:2915: done (2 left) 2020-11-16T22:12:58.308 INFO:tasks.rados.rados.2.smithi057.stdout:2916: done (1 left) 2020-11-16T22:12:58.308 INFO:tasks.rados.rados.2.smithi057.stdout:2919: write oid 32 current snap is 340 2020-11-16T22:12:58.308 INFO:tasks.rados.rados.2.smithi057.stdout:2919: seq_num 976 ranges {403632=736208,1763249=619999} 2020-11-16T22:12:58.309 INFO:tasks.rados.rados.2.smithi057.stdout:2919: writing smithi05720651-32 from 403632 to 1139840 tid 1 2020-11-16T22:12:58.309 INFO:tasks.rados.rados.2.smithi057.stdout:2919: writing smithi05720651-32 from 1763249 to 2383248 tid 2 2020-11-16T22:12:58.309 INFO:tasks.rados.rados.2.smithi057.stdout:2920: write (excl) oid 30 current snap is 340 2020-11-16T22:12:58.309 INFO:tasks.rados.rados.2.smithi057.stdout:2920: seq_num 977 ranges {420439=411457,1421731=480010} 2020-11-16T22:12:58.309 INFO:tasks.rados.rados.2.smithi057.stdout:2920: writing smithi05720651-30 from 420439 to 831896 tid 1 2020-11-16T22:12:58.309 INFO:tasks.rados.rados.2.smithi057.stdout:2920: writing smithi05720651-30 from 1421731 to 1901741 tid 2 2020-11-16T22:12:58.309 INFO:tasks.rados.rados.2.smithi057.stdout:2921: rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 340 2020-11-16T22:12:58.310 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 336 2020-11-16T22:12:58.310 INFO:tasks.rados.rados.2.smithi057.stdout:2918: finishing copy_from to smithi05720651-28 2020-11-16T22:12:58.310 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 2186 (ObjNum 969 snap 336 seq_num 969) dirty exists 2020-11-16T22:12:58.310 INFO:tasks.rados.rados.2.smithi057.stdout:2922: rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 340 2020-11-16T22:12:58.310 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 336 2020-11-16T22:12:58.310 INFO:tasks.rados.rados.2.smithi057.stdout:2918: finishing copy_from racing read to smithi05720651-28 2020-11-16T22:12:58.310 INFO:tasks.rados.rados.2.smithi057.stdout:2918: done (4 left) 2020-11-16T22:12:58.311 INFO:tasks.rados.rados.2.smithi057.stdout:2923: snap_remove snap 335 2020-11-16T22:12:58.311 INFO:tasks.rados.rados.2.smithi057.stdout:2923: done (4 left) 2020-11-16T22:12:58.311 INFO:tasks.rados.rados.2.smithi057.stdout:2924: read oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:58.311 INFO:tasks.rados.rados.2.smithi057.stdout:2924: expect (ObjNum 959 snap 330 seq_num 959) 2020-11-16T22:12:58.311 INFO:tasks.rados.rados.2.smithi057.stdout:2925: write (excl) oid 36 current snap is 340 2020-11-16T22:12:58.311 INFO:tasks.rados.rados.2.smithi057.stdout:2925: seq_num 978 ranges {437246=486706,1363860=623668} 2020-11-16T22:12:58.311 INFO:tasks.rados.rados.2.smithi057.stdout:2925: writing smithi05720651-36 from 437246 to 923952 tid 1 2020-11-16T22:12:58.312 INFO:tasks.rados.rados.2.smithi057.stdout:2925: writing smithi05720651-36 from 1363860 to 1987528 tid 2 2020-11-16T22:12:58.312 INFO:tasks.rados.rados.2.smithi057.stdout:2926: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 334 2020-11-16T22:12:58.312 INFO:tasks.rados.rados.2.smithi057.stdout:2926: expect deleted 2020-11-16T22:12:58.312 INFO:tasks.rados.rados.2.smithi057.stdout:2927: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:12:58.312 INFO:tasks.rados.rados.2.smithi057.stdout:2927: expect (ObjNum 968 snap 333 seq_num 968) 2020-11-16T22:12:58.312 INFO:tasks.rados.rados.2.smithi057.stdout:2928: read oid 46 snap -1 2020-11-16T22:12:58.312 INFO:tasks.rados.rados.2.smithi057.stdout:2928: expect (ObjNum 920 snap 313 seq_num 920) 2020-11-16T22:12:58.312 INFO:tasks.rados.rados.2.smithi057.stdout:2929: snap_remove snap 315 2020-11-16T22:12:58.313 INFO:tasks.rados.rados.2.smithi057.stdout:2929: done (9 left) 2020-11-16T22:12:58.313 INFO:tasks.rados.rados.2.smithi057.stdout:2930: read oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 339 2020-11-16T22:12:58.313 INFO:tasks.rados.rados.2.smithi057.stdout:2930: expect (ObjNum 912 snap 310 seq_num 912) 2020-11-16T22:12:58.313 INFO:tasks.rados.rados.2.smithi057.stdout:2931: snap_create 2020-11-16T22:12:58.313 INFO:tasks.rados.rados.2.smithi057.stdout:2919: finishing write tid 1 to smithi05720651-32 2020-11-16T22:12:58.313 INFO:tasks.rados.rados.2.smithi057.stdout:2919: finishing write tid 2 to smithi05720651-32 2020-11-16T22:12:58.313 INFO:tasks.rados.rados.2.smithi057.stdout:2919: finishing write tid 4 to smithi05720651-32 2020-11-16T22:12:58.314 INFO:tasks.rados.rados.2.smithi057.stdout:2919: finishing write tid 5 to smithi05720651-32 2020-11-16T22:12:58.314 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 2374 (ObjNum 976 snap 340 seq_num 976) dirty exists 2020-11-16T22:12:58.314 INFO:tasks.rados.rados.2.smithi057.stdout:2919: left oid 32 (ObjNum 976 snap 340 seq_num 976) 2020-11-16T22:12:58.314 INFO:tasks.rados.rados.2.smithi057.stdout:2922: finishing rollback tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:58.314 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2173 (ObjNum 33 snap 0 seq_num 1131374913) dirty dne 2020-11-16T22:12:58.314 INFO:tasks.rados.rados.2.smithi057.stdout:2920: finishing write tid 1 to smithi05720651-30 2020-11-16T22:12:58.314 INFO:tasks.rados.rados.2.smithi057.stdout:2921: finishing rollback tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:58.315 INFO:tasks.rados.rados.2.smithi057.stdout:2921: finishing rollback tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:12:58.315 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2194 (ObjNum 922 snap 314 seq_num 922) dirty exists 2020-11-16T22:12:58.315 INFO:tasks.rados.rados.2.smithi057.stdout:2920: finishing write tid 2 to smithi05720651-30 2020-11-16T22:12:58.315 INFO:tasks.rados.rados.2.smithi057.stdout:2920: finishing write tid 4 to smithi05720651-30 2020-11-16T22:12:58.315 INFO:tasks.rados.rados.2.smithi057.stdout:2920: finishing write tid 5 to smithi05720651-30 2020-11-16T22:12:58.315 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 2196 (ObjNum 977 snap 340 seq_num 977) dirty exists 2020-11-16T22:12:58.315 INFO:tasks.rados.rados.2.smithi057.stdout:2920: left oid 30 (ObjNum 977 snap 340 seq_num 977) 2020-11-16T22:12:58.316 INFO:tasks.rados.rados.2.smithi057.stdout:2924: expect (ObjNum 959 snap 330 seq_num 959) 2020-11-16T22:12:58.316 INFO:tasks.rados.rados.2.smithi057.stdout:2925: finishing write tid 1 to smithi05720651-36 2020-11-16T22:12:58.316 INFO:tasks.rados.rados.2.smithi057.stdout:2927: expect (ObjNum 968 snap 333 seq_num 968) 2020-11-16T22:12:58.316 INFO:tasks.rados.rados.2.smithi057.stdout:2925: finishing write tid 2 to smithi05720651-36 2020-11-16T22:12:58.316 INFO:tasks.rados.rados.2.smithi057.stdout:2925: finishing write tid 4 to smithi05720651-36 2020-11-16T22:12:58.316 INFO:tasks.rados.rados.2.smithi057.stdout:2928: expect (ObjNum 920 snap 313 seq_num 920) 2020-11-16T22:12:58.316 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:54 smithi057 bash[10301]: cluster 2020-11-16T22:12:53.179013+0000 mon.a (mon.0) 1416 : cluster [DBG] osdmap e744: 12 total, 12 up, 12 in 2020-11-16T22:12:58.317 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:55 smithi057 bash[10301]: cluster 2020-11-16T22:12:53.801121+0000 mgr.x (mgr.24115) 608 : cluster [DBG] pgmap v1282: 17 pgs: 17 active+clean; 192 MiB data, 761 MiB used, 1.0 TiB / 1.0 TiB avail; 31 MiB/s rd, 3.0 MiB/s wr, 26 op/s 2020-11-16T22:12:58.317 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:55 smithi057 bash[10301]: cluster 2020-11-16T22:12:54.188854+0000 mon.a (mon.0) 1417 : cluster [DBG] osdmap e745: 12 total, 12 up, 12 in 2020-11-16T22:12:58.317 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:55 smithi057 bash[10301]: cluster 2020-11-16T22:12:55.127403+0000 mon.a (mon.0) 1418 : cluster [DBG] osdmap e746: 12 total, 12 up, 12 in 2020-11-16T22:12:58.317 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:57 smithi057 bash[10301]: cluster 2020-11-16T22:12:55.801877+0000 mgr.x (mgr.24115) 609 : cluster [DBG] pgmap v1285: 17 pgs: 17 active+clean; 203 MiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 1.7 MiB/s wr, 8 op/s 2020-11-16T22:12:58.317 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:57 smithi057 bash[10301]: cluster 2020-11-16T22:12:56.136708+0000 mon.a (mon.0) 1419 : cluster [DBG] osdmap e747: 12 total, 12 up, 12 in 2020-11-16T22:12:58.398 INFO:tasks.rados.rados.2.smithi057.stdout:2925: finishing write tid 5 to smithi05720651-36 2020-11-16T22:12:58.399 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 2189 (ObjNum 978 snap 340 seq_num 978) dirty exists 2020-11-16T22:12:58.399 INFO:tasks.rados.rados.2.smithi057.stdout:2925: left oid 36 (ObjNum 978 snap 340 seq_num 978) 2020-11-16T22:12:58.399 INFO:tasks.rados.rados.2.smithi057.stdout:2930: expect (ObjNum 912 snap 310 seq_num 912) 2020-11-16T22:12:58.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:58 smithi057 bash[10301]: cluster 2020-11-16T22:12:57.146935+0000 mon.a (mon.0) 1420 : cluster [DBG] osdmap e748: 12 total, 12 up, 12 in 2020-11-16T22:12:58.471 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:12:58 smithi016 bash[19825]: debug 2020-11-16T22:12:58.168+0000 7f0e12c1a700 -1 osd.7 pg_epoch: 749 pg[2.8( v 749'1880 (0'0,749'1880] local-lis/les=71/72 n=13 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [7,9] r=0 lpr=71 luod=748'1878 crt=749'1880 lcod 747'1876 mlcod 747'1876 active+clean+snaptrim trimq=[277~1] ps=[27f~1,286~1,293~1,298~1]] removing snap head 2020-11-16T22:12:58.501 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:58 smithi016 bash[10302]: cluster 2020-11-16T22:12:57.146935+0000 mon.a (mon.0) 1420 : cluster [DBG] osdmap e748: 12 total, 12 up, 12 in 2020-11-16T22:12:58.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:58 smithi195 bash[10218]: cluster 2020-11-16T22:12:57.146935+0000 mon.a (mon.0) 1420 : cluster [DBG] osdmap e748: 12 total, 12 up, 12 in 2020-11-16T22:12:58.837 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 22:12:58 smithi016 bash[15120]: debug 2020-11-16T22:12:58.480+0000 7f8fc6db9700 -1 osd.5 pg_epoch: 749 pg[2.3( v 749'2105 (0'0,749'2105] local-lis/les=71/72 n=12 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [5,2] r=0 lpr=71 luod=748'2103 crt=749'2105 lcod 748'2101 mlcod 748'2101 active+clean+snaptrim trimq=[277~1] ps=[27f~1,286~1,293~1,298~1]] removing snap head 2020-11-16T22:12:58.838 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 22:12:58 smithi016 bash[15120]: debug 2020-11-16T22:12:58.484+0000 7f8fc6db9700 -1 osd.5 pg_epoch: 749 pg[2.3( v 749'2107 (0'0,749'2107] local-lis/les=71/72 n=10 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [5,2] r=0 lpr=71 crt=749'2107 lcod 749'2105 mlcod 749'2105 active+clean+snaptrim trimq=[277~1] ps=[27f~1,286~1,293~1,298~1]] removing snap head 2020-11-16T22:12:59.150 INFO:tasks.rados.rados.2.smithi057.stdout:2919: done (10 left) 2020-11-16T22:12:59.151 INFO:tasks.rados.rados.2.smithi057.stdout:2920: done (9 left) 2020-11-16T22:12:59.151 INFO:tasks.rados.rados.2.smithi057.stdout:2921: done (8 left) 2020-11-16T22:12:59.151 INFO:tasks.rados.rados.2.smithi057.stdout:2922: done (7 left) 2020-11-16T22:12:59.151 INFO:tasks.rados.rados.2.smithi057.stdout:2924: done (6 left) 2020-11-16T22:12:59.151 INFO:tasks.rados.rados.2.smithi057.stdout:2925: done (5 left) 2020-11-16T22:12:59.151 INFO:tasks.rados.rados.2.smithi057.stdout:2926: done (4 left) 2020-11-16T22:12:59.152 INFO:tasks.rados.rados.2.smithi057.stdout:2927: done (3 left) 2020-11-16T22:12:59.152 INFO:tasks.rados.rados.2.smithi057.stdout:2928: done (2 left) 2020-11-16T22:12:59.152 INFO:tasks.rados.rados.2.smithi057.stdout:2930: done (1 left) 2020-11-16T22:12:59.152 INFO:tasks.rados.rados.2.smithi057.stdout:2931: done (0 left) 2020-11-16T22:12:59.152 INFO:tasks.rados.rados.2.smithi057.stdout:2932: delete oid 36 current snap is 341 2020-11-16T22:12:59.159 INFO:tasks.rados.rados.2.smithi057.stdout:2932: done (0 left) 2020-11-16T22:12:59.159 INFO:tasks.rados.rados.2.smithi057.stdout:2933: delete oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 341 2020-11-16T22:12:59.168 INFO:tasks.rados.rados.2.smithi057.stdout:2933: done (0 left) 2020-11-16T22:12:59.169 INFO:tasks.rados.rados.2.smithi057.stdout:2934: write (excl) oid 46 current snap is 341 2020-11-16T22:12:59.169 INFO:tasks.rados.rados.2.smithi057.stdout:2934: seq_num 981 ranges {487667=428806,1655659=770995} 2020-11-16T22:12:59.178 INFO:tasks.rados.rados.2.smithi057.stdout:2934: writing smithi05720651-46 from 487667 to 916473 tid 1 2020-11-16T22:12:59.188 INFO:tasks.rados.rados.2.smithi057.stdout:2934: writing smithi05720651-46 from 1655659 to 2426654 tid 2 2020-11-16T22:12:59.188 INFO:tasks.rados.rados.2.smithi057.stdout:2935: rollback oid 30 current snap is 341 2020-11-16T22:12:59.188 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 30 to 329 2020-11-16T22:12:59.189 INFO:tasks.rados.rados.2.smithi057.stdout:2934: finishing write tid 1 to smithi05720651-46 2020-11-16T22:12:59.189 INFO:tasks.rados.rados.2.smithi057.stdout:2936: copy_from oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 50 current snap is 341 2020-11-16T22:12:59.189 INFO:tasks.rados.rados.2.smithi057.stdout:2937: snap_remove snap 339 2020-11-16T22:12:59.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:59 smithi057 bash[10301]: cluster 2020-11-16T22:12:57.802601+0000 mgr.x (mgr.24115) 610 : cluster [DBG] pgmap v1288: 17 pgs: 17 active+clean; 198 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2020-11-16T22:12:59.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:12:59 smithi057 bash[10301]: cluster 2020-11-16T22:12:58.157857+0000 mon.a (mon.0) 1421 : cluster [DBG] osdmap e749: 12 total, 12 up, 12 in 2020-11-16T22:12:59.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:59 smithi016 bash[10302]: cluster 2020-11-16T22:12:57.802601+0000 mgr.x (mgr.24115) 610 : cluster [DBG] pgmap v1288: 17 pgs: 17 active+clean; 198 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2020-11-16T22:12:59.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:12:59 smithi016 bash[10302]: cluster 2020-11-16T22:12:58.157857+0000 mon.a (mon.0) 1421 : cluster [DBG] osdmap e749: 12 total, 12 up, 12 in 2020-11-16T22:12:59.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:59 smithi195 bash[10218]: cluster 2020-11-16T22:12:57.802601+0000 mgr.x (mgr.24115) 610 : cluster [DBG] pgmap v1288: 17 pgs: 17 active+clean; 198 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 2.3 MiB/s wr, 17 op/s 2020-11-16T22:12:59.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:12:59 smithi195 bash[10218]: cluster 2020-11-16T22:12:58.157857+0000 mon.a (mon.0) 1421 : cluster [DBG] osdmap e749: 12 total, 12 up, 12 in 2020-11-16T22:13:00.124 INFO:tasks.rados.rados.2.smithi057.stdout:2937: done (3 left) 2020-11-16T22:13:00.124 INFO:tasks.rados.rados.2.smithi057.stdout:2938: copy_from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 36 current snap is 341 2020-11-16T22:13:00.124 INFO:tasks.rados.rados.2.smithi057.stdout:2939: rollback oid 22 current snap is 341 2020-11-16T22:13:00.124 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 22 to 336 2020-11-16T22:13:00.125 INFO:tasks.rados.rados.2.smithi057.stdout:2940: write (excl) oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 341 2020-11-16T22:13:00.125 INFO:tasks.rados.rados.2.smithi057.stdout:2940: seq_num 982 ranges {504474=504055,1714141=631006} 2020-11-16T22:13:00.133 INFO:tasks.rados.rados.2.smithi057.stdout:2940: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 504474 to 1008529 tid 1 2020-11-16T22:13:00.141 INFO:tasks.rados.rados.2.smithi057.stdout:2940: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1714141 to 2345147 tid 2 2020-11-16T22:13:00.141 INFO:tasks.rados.rados.2.smithi057.stdout:2941: delete oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 341 2020-11-16T22:13:00.141 INFO:tasks.rados.rados.2.smithi057.stdout:2934: finishing write tid 2 to smithi05720651-46 2020-11-16T22:13:00.142 INFO:tasks.rados.rados.2.smithi057.stdout:2934: finishing write tid 4 to smithi05720651-46 2020-11-16T22:13:00.142 INFO:tasks.rados.rados.2.smithi057.stdout:2934: finishing write tid 5 to smithi05720651-46 2020-11-16T22:13:00.142 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 2200 (ObjNum 981 snap 341 seq_num 981) dirty exists 2020-11-16T22:13:00.142 INFO:tasks.rados.rados.2.smithi057.stdout:2934: left oid 46 (ObjNum 981 snap 341 seq_num 981) 2020-11-16T22:13:00.142 INFO:tasks.rados.rados.2.smithi057.stdout:2935: finishing rollback tid 0 to smithi05720651-30 2020-11-16T22:13:00.142 INFO:tasks.rados.rados.2.smithi057.stdout:2935: finishing rollback tid 1 to smithi05720651-30 2020-11-16T22:13:00.143 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 2202 (ObjNum 321 snap 0 seq_num 1864382258) dirty dne 2020-11-16T22:13:00.143 INFO:tasks.rados.rados.2.smithi057.stdout:2936: finishing copy_from to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:00.143 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1795 (ObjNum 941 snap 324 seq_num 941) dirty exists 2020-11-16T22:13:00.143 INFO:tasks.rados.rados.2.smithi057.stdout:2936: finishing copy_from racing read to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:00.143 INFO:tasks.rados.rados.2.smithi057.stdout:2938: finishing copy_from to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:00.143 INFO:tasks.rados.rados.2.smithi057.stdout:2938: got expected ENOENT (src dne) 2020-11-16T22:13:00.143 INFO:tasks.rados.rados.2.smithi057.stdout:2938: finishing copy_from racing read to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:00.143 INFO:tasks.rados.rados.2.smithi057.stdout:2939: finishing rollback tid 0 to smithi05720651-22 2020-11-16T22:13:00.144 INFO:tasks.rados.rados.2.smithi057.stdout:2939: finishing rollback tid 1 to smithi05720651-22 2020-11-16T22:13:00.144 INFO:tasks.rados.rados.2.smithi057.stdout:2939: finishing rollback tid 2 to smithi05720651-22 2020-11-16T22:13:00.144 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 2105 (ObjNum 922 snap 314 seq_num 922) dirty exists 2020-11-16T22:13:00.144 INFO:tasks.rados.rados.2.smithi057.stdout:2940: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:00.145 INFO:tasks.rados.rados.2.smithi057.stdout:2934: done (6 left) 2020-11-16T22:13:00.145 INFO:tasks.rados.rados.2.smithi057.stdout:2935: done (5 left) 2020-11-16T22:13:00.145 INFO:tasks.rados.rados.2.smithi057.stdout:2936: done (4 left) 2020-11-16T22:13:00.145 INFO:tasks.rados.rados.2.smithi057.stdout:2938: done (3 left) 2020-11-16T22:13:00.145 INFO:tasks.rados.rados.2.smithi057.stdout:2939: done (2 left) 2020-11-16T22:13:00.146 INFO:tasks.rados.rados.2.smithi057.stdout:2941: done (1 left) 2020-11-16T22:13:00.146 INFO:tasks.rados.rados.2.smithi057.stdout:2942: copy_from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 341 2020-11-16T22:13:00.146 INFO:tasks.rados.rados.2.smithi057.stdout:2943: rollback oid 42 current snap is 341 2020-11-16T22:13:00.146 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 42 to 329 2020-11-16T22:13:00.146 INFO:tasks.rados.rados.2.smithi057.stdout:2944: read oid 14 snap -1 2020-11-16T22:13:00.146 INFO:tasks.rados.rados.2.smithi057.stdout:2944: expect (ObjNum 957 snap 329 seq_num 957) 2020-11-16T22:13:00.146 INFO:tasks.rados.rados.2.smithi057.stdout:2945: snap_remove snap 332 2020-11-16T22:13:00.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:00 smithi057 bash[10301]: cluster 2020-11-16T22:12:59.159428+0000 mon.a (mon.0) 1422 : cluster [DBG] osdmap e750: 12 total, 12 up, 12 in 2020-11-16T22:13:00.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:00 smithi057 bash[10301]: cluster 2020-11-16T22:13:00.129691+0000 mon.a (mon.0) 1423 : cluster [DBG] osdmap e751: 12 total, 12 up, 12 in 2020-11-16T22:13:00.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:00 smithi016 bash[10302]: cluster 2020-11-16T22:12:59.159428+0000 mon.a (mon.0) 1422 : cluster [DBG] osdmap e750: 12 total, 12 up, 12 in 2020-11-16T22:13:00.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:00 smithi016 bash[10302]: cluster 2020-11-16T22:13:00.129691+0000 mon.a (mon.0) 1423 : cluster [DBG] osdmap e751: 12 total, 12 up, 12 in 2020-11-16T22:13:00.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:00 smithi195 bash[10218]: cluster 2020-11-16T22:12:59.159428+0000 mon.a (mon.0) 1422 : cluster [DBG] osdmap e750: 12 total, 12 up, 12 in 2020-11-16T22:13:00.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:00 smithi195 bash[10218]: cluster 2020-11-16T22:13:00.129691+0000 mon.a (mon.0) 1423 : cluster [DBG] osdmap e751: 12 total, 12 up, 12 in 2020-11-16T22:13:01.139 INFO:tasks.rados.rados.2.smithi057.stdout:2945: done (4 left) 2020-11-16T22:13:01.139 INFO:tasks.rados.rados.2.smithi057.stdout:2946: snap_remove snap 340 2020-11-16T22:13:01.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:01 smithi057 bash[10301]: cluster 2020-11-16T22:12:59.803318+0000 mgr.x (mgr.24115) 611 : cluster [DBG] pgmap v1291: 17 pgs: 17 active+clean; 194 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2020-11-16T22:13:01.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:01 smithi057 bash[10301]: cluster 2020-11-16T22:13:01.143155+0000 mon.a (mon.0) 1424 : cluster [DBG] osdmap e752: 12 total, 12 up, 12 in 2020-11-16T22:13:01.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:01 smithi016 bash[10302]: cluster 2020-11-16T22:12:59.803318+0000 mgr.x (mgr.24115) 611 : cluster [DBG] pgmap v1291: 17 pgs: 17 active+clean; 194 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2020-11-16T22:13:01.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:01 smithi016 bash[10302]: cluster 2020-11-16T22:13:01.143155+0000 mon.a (mon.0) 1424 : cluster [DBG] osdmap e752: 12 total, 12 up, 12 in 2020-11-16T22:13:01.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:01 smithi195 bash[10218]: cluster 2020-11-16T22:12:59.803318+0000 mgr.x (mgr.24115) 611 : cluster [DBG] pgmap v1291: 17 pgs: 17 active+clean; 194 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 13 op/s 2020-11-16T22:13:01.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:01 smithi195 bash[10218]: cluster 2020-11-16T22:13:01.143155+0000 mon.a (mon.0) 1424 : cluster [DBG] osdmap e752: 12 total, 12 up, 12 in 2020-11-16T22:13:02.137 INFO:tasks.rados.rados.2.smithi057.stdout:2946: done (4 left) 2020-11-16T22:13:02.137 INFO:tasks.rados.rados.2.smithi057.stdout:2947: snap_create 2020-11-16T22:13:02.137 INFO:tasks.rados.rados.2.smithi057.stdout:2942: finishing copy_from to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:02.137 INFO:tasks.rados.rados.2.smithi057.stdout:2942: got expected ENOENT (src dne) 2020-11-16T22:13:02.138 INFO:tasks.rados.rados.2.smithi057.stdout:2940: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:02.138 INFO:tasks.rados.rados.2.smithi057.stdout:2942: finishing copy_from racing read to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:02.138 INFO:tasks.rados.rados.2.smithi057.stdout:2944: expect (ObjNum 957 snap 329 seq_num 957) 2020-11-16T22:13:02.300 INFO:tasks.rados.rados.2.smithi057.stdout:2940: finishing write tid 4 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:02.301 INFO:tasks.rados.rados.2.smithi057.stdout:2940: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:02.301 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1915 (ObjNum 982 snap 341 seq_num 982) dirty exists 2020-11-16T22:13:02.301 INFO:tasks.rados.rados.2.smithi057.stdout:2940: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 982 snap 341 seq_num 982) 2020-11-16T22:13:02.301 INFO:tasks.rados.rados.2.smithi057.stdout:2943: finishing rollback tid 0 to smithi05720651-42 2020-11-16T22:13:02.301 INFO:tasks.rados.rados.2.smithi057.stdout:2943: finishing rollback tid 1 to smithi05720651-42 2020-11-16T22:13:02.301 INFO:tasks.rados.rados.2.smithi057.stdout:2943: finishing rollback tid 2 to smithi05720651-42 2020-11-16T22:13:02.302 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 1918 (ObjNum 901 snap 303 seq_num 901) dirty exists 2020-11-16T22:13:02.587 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:13:02 smithi016 bash[19825]: debug 2020-11-16T22:13:02.152+0000 7f0e16c22700 -1 osd.7 pg_epoch: 753 pg[2.8( v 753'1903 (0'0,753'1903] local-lis/les=71/72 n=12 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [7,9] r=0 lpr=71 luod=752'1901 crt=753'1903 lcod 752'1899 mlcod 752'1899 active+clean+snaptrim trimq=[2a2~1] ps=[277~1,286~1,294~1,298~1,29e~1]] removing snap head 2020-11-16T22:13:03.139 INFO:tasks.rados.rados.2.smithi057.stdout:2940: done (4 left) 2020-11-16T22:13:03.140 INFO:tasks.rados.rados.2.smithi057.stdout:2942: done (3 left) 2020-11-16T22:13:03.140 INFO:tasks.rados.rados.2.smithi057.stdout:2943: done (2 left) 2020-11-16T22:13:03.140 INFO:tasks.rados.rados.2.smithi057.stdout:2944: done (1 left) 2020-11-16T22:13:03.140 INFO:tasks.rados.rados.2.smithi057.stdout:2947: done (0 left) 2020-11-16T22:13:03.140 INFO:tasks.rados.rados.2.smithi057.stdout:2948: snap_create 2020-11-16T22:13:03.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:03 smithi057 bash[10301]: cluster 2020-11-16T22:13:01.804040+0000 mgr.x (mgr.24115) 612 : cluster [DBG] pgmap v1294: 17 pgs: 17 active+clean; 167 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.5 MiB/s wr, 17 op/s 2020-11-16T22:13:03.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:03 smithi057 bash[10301]: cluster 2020-11-16T22:13:02.146322+0000 mon.a (mon.0) 1425 : cluster [DBG] osdmap e753: 12 total, 12 up, 12 in 2020-11-16T22:13:03.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:03 smithi016 bash[10302]: cluster 2020-11-16T22:13:01.804040+0000 mgr.x (mgr.24115) 612 : cluster [DBG] pgmap v1294: 17 pgs: 17 active+clean; 167 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.5 MiB/s wr, 17 op/s 2020-11-16T22:13:03.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:03 smithi016 bash[10302]: cluster 2020-11-16T22:13:02.146322+0000 mon.a (mon.0) 1425 : cluster [DBG] osdmap e753: 12 total, 12 up, 12 in 2020-11-16T22:13:03.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:03 smithi195 bash[10218]: cluster 2020-11-16T22:13:01.804040+0000 mgr.x (mgr.24115) 612 : cluster [DBG] pgmap v1294: 17 pgs: 17 active+clean; 167 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.5 MiB/s wr, 17 op/s 2020-11-16T22:13:03.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:03 smithi195 bash[10218]: cluster 2020-11-16T22:13:02.146322+0000 mon.a (mon.0) 1425 : cluster [DBG] osdmap e753: 12 total, 12 up, 12 in 2020-11-16T22:13:04.162 INFO:tasks.rados.rados.2.smithi057.stdout:2948: done (0 left) 2020-11-16T22:13:04.162 INFO:tasks.rados.rados.2.smithi057.stdout:2949: delete oid 14 current snap is 343 2020-11-16T22:13:04.168 INFO:tasks.rados.rados.2.smithi057.stdout:2949: done (0 left) 2020-11-16T22:13:04.169 INFO:tasks.rados.rados.2.smithi057.stdout:2950: delete oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 343 2020-11-16T22:13:04.176 INFO:tasks.rados.rados.2.smithi057.stdout:2950: done (0 left) 2020-11-16T22:13:04.177 INFO:tasks.rados.rados.2.smithi057.stdout:2951: snap_create 2020-11-16T22:13:04.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:04 smithi057 bash[10301]: cluster 2020-11-16T22:13:03.148835+0000 mon.a (mon.0) 1426 : cluster [DBG] osdmap e754: 12 total, 12 up, 12 in 2020-11-16T22:13:04.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:04 smithi016 bash[10302]: cluster 2020-11-16T22:13:03.148835+0000 mon.a (mon.0) 1426 : cluster [DBG] osdmap e754: 12 total, 12 up, 12 in 2020-11-16T22:13:04.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:04 smithi195 bash[10218]: cluster 2020-11-16T22:13:03.148835+0000 mon.a (mon.0) 1426 : cluster [DBG] osdmap e754: 12 total, 12 up, 12 in 2020-11-16T22:13:05.123 INFO:tasks.rados.rados.2.smithi057.stdout:2951: done (0 left) 2020-11-16T22:13:05.123 INFO:tasks.rados.rados.2.smithi057.stdout:2952: snap_remove snap 338 2020-11-16T22:13:05.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:05 smithi057 bash[10301]: cluster 2020-11-16T22:13:03.804707+0000 mgr.x (mgr.24115) 613 : cluster [DBG] pgmap v1297: 17 pgs: 17 active+clean; 165 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2020-11-16T22:13:05.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:05 smithi057 bash[10301]: cluster 2020-11-16T22:13:04.171828+0000 mon.a (mon.0) 1427 : cluster [DBG] osdmap e755: 12 total, 12 up, 12 in 2020-11-16T22:13:05.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:05 smithi057 bash[10301]: cluster 2020-11-16T22:13:05.131563+0000 mon.a (mon.0) 1428 : cluster [DBG] osdmap e756: 12 total, 12 up, 12 in 2020-11-16T22:13:05.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:05 smithi016 bash[10302]: cluster 2020-11-16T22:13:03.804707+0000 mgr.x (mgr.24115) 613 : cluster [DBG] pgmap v1297: 17 pgs: 17 active+clean; 165 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2020-11-16T22:13:05.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:05 smithi016 bash[10302]: cluster 2020-11-16T22:13:04.171828+0000 mon.a (mon.0) 1427 : cluster [DBG] osdmap e755: 12 total, 12 up, 12 in 2020-11-16T22:13:05.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:05 smithi016 bash[10302]: cluster 2020-11-16T22:13:05.131563+0000 mon.a (mon.0) 1428 : cluster [DBG] osdmap e756: 12 total, 12 up, 12 in 2020-11-16T22:13:05.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:05 smithi195 bash[10218]: cluster 2020-11-16T22:13:03.804707+0000 mgr.x (mgr.24115) 613 : cluster [DBG] pgmap v1297: 17 pgs: 17 active+clean; 165 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.7 MiB/s wr, 15 op/s 2020-11-16T22:13:05.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:05 smithi195 bash[10218]: cluster 2020-11-16T22:13:04.171828+0000 mon.a (mon.0) 1427 : cluster [DBG] osdmap e755: 12 total, 12 up, 12 in 2020-11-16T22:13:05.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:05 smithi195 bash[10218]: cluster 2020-11-16T22:13:05.131563+0000 mon.a (mon.0) 1428 : cluster [DBG] osdmap e756: 12 total, 12 up, 12 in 2020-11-16T22:13:06.136 INFO:tasks.rados.rados.2.smithi057.stdout:2952: done (0 left) 2020-11-16T22:13:06.137 INFO:tasks.rados.rados.2.smithi057.stdout:2953: snap_remove snap 342 2020-11-16T22:13:07.147 INFO:tasks.rados.rados.2.smithi057.stdout:2953: done (0 left) 2020-11-16T22:13:07.147 INFO:tasks.rados.rados.2.smithi057.stdout:2954: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:07.148 INFO:tasks.rados.rados.2.smithi057.stdout:2954: expect deleted 2020-11-16T22:13:07.148 INFO:tasks.rados.rados.2.smithi057.stdout:2955: rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 344 2020-11-16T22:13:07.148 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 343 2020-11-16T22:13:07.148 INFO:tasks.rados.rados.2.smithi057.stdout:2956: delete oid 22 current snap is 344 2020-11-16T22:13:07.156 INFO:tasks.rados.rados.2.smithi057.stdout:2954: done (2 left) 2020-11-16T22:13:07.156 INFO:tasks.rados.rados.2.smithi057.stdout:2956: done (1 left) 2020-11-16T22:13:07.156 INFO:tasks.rados.rados.2.smithi057.stdout:2957: write (excl) oid 22 current snap is 344 2020-11-16T22:13:07.156 INFO:tasks.rados.rados.2.smithi057.stdout:2957: seq_num 987 ranges {588509=480300,1773845=782002} 2020-11-16T22:13:07.165 INFO:tasks.rados.rados.2.smithi057.stdout:2957: writing smithi05720651-22 from 588509 to 1068809 tid 1 2020-11-16T22:13:07.174 INFO:tasks.rados.rados.2.smithi057.stdout:2957: writing smithi05720651-22 from 1773845 to 2555847 tid 2 2020-11-16T22:13:07.175 INFO:tasks.rados.rados.2.smithi057.stdout:2958: rollback oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 344 2020-11-16T22:13:07.175 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 333 2020-11-16T22:13:07.175 INFO:tasks.rados.rados.2.smithi057.stdout:2955: finishing rollback tid 0 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.175 INFO:tasks.rados.rados.2.smithi057.stdout:2955: finishing rollback tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.175 INFO:tasks.rados.rados.2.smithi057.stdout:2955: finishing rollback tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.175 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1801 (ObjNum 959 snap 330 seq_num 959) dirty exists 2020-11-16T22:13:07.176 INFO:tasks.rados.rados.2.smithi057.stdout:2957: finishing write tid 1 to smithi05720651-22 2020-11-16T22:13:07.176 INFO:tasks.rados.rados.2.smithi057.stdout:2955: done (2 left) 2020-11-16T22:13:07.176 INFO:tasks.rados.rados.2.smithi057.stdout:2959: delete oid 48 current snap is 344 2020-11-16T22:13:07.179 INFO:tasks.rados.rados.2.smithi057.stdout:2959: done (2 left) 2020-11-16T22:13:07.179 INFO:tasks.rados.rados.2.smithi057.stdout:2960: copy_from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 46 current snap is 344 2020-11-16T22:13:07.180 INFO:tasks.rados.rados.2.smithi057.stdout:2961: rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 344 2020-11-16T22:13:07.180 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 343 2020-11-16T22:13:07.180 INFO:tasks.rados.rados.2.smithi057.stdout:2962: write (excl) oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 344 2020-11-16T22:13:07.180 INFO:tasks.rados.rados.2.smithi057.stdout:2962: seq_num 989 ranges {622123=747151,2007162=614961} 2020-11-16T22:13:07.187 INFO:tasks.rados.rados.2.smithi057.stdout:2962: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 622123 to 1369274 tid 1 2020-11-16T22:13:07.195 INFO:tasks.rados.rados.2.smithi057.stdout:2962: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2007162 to 2622123 tid 2 2020-11-16T22:13:07.195 INFO:tasks.rados.rados.2.smithi057.stdout:2963: rollback oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 344 2020-11-16T22:13:07.196 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 341 2020-11-16T22:13:07.196 INFO:tasks.rados.rados.2.smithi057.stdout:2958: finishing rollback tid 0 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.196 INFO:tasks.rados.rados.2.smithi057.stdout:2957: finishing write tid 2 to smithi05720651-22 2020-11-16T22:13:07.196 INFO:tasks.rados.rados.2.smithi057.stdout:2957: finishing write tid 4 to smithi05720651-22 2020-11-16T22:13:07.196 INFO:tasks.rados.rados.2.smithi057.stdout:2957: finishing write tid 5 to smithi05720651-22 2020-11-16T22:13:07.196 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 2109 (ObjNum 987 snap 344 seq_num 987) dirty exists 2020-11-16T22:13:07.196 INFO:tasks.rados.rados.2.smithi057.stdout:2957: left oid 22 (ObjNum 987 snap 344 seq_num 987) 2020-11-16T22:13:07.197 INFO:tasks.rados.rados.2.smithi057.stdout:2958: finishing rollback tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.197 INFO:tasks.rados.rados.2.smithi057.stdout:2958: finishing rollback tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.197 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 196 (ObjNum 955 snap 329 seq_num 955) dirty exists 2020-11-16T22:13:07.197 INFO:tasks.rados.rados.2.smithi057.stdout:2961: finishing rollback tid 0 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.197 INFO:tasks.rados.rados.2.smithi057.stdout:2961: finishing rollback tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.197 INFO:tasks.rados.rados.2.smithi057.stdout:2961: finishing rollback tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.197 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1804 (ObjNum 959 snap 330 seq_num 959) dirty exists 2020-11-16T22:13:07.198 INFO:tasks.rados.rados.2.smithi057.stdout:2957: done (5 left) 2020-11-16T22:13:07.198 INFO:tasks.rados.rados.2.smithi057.stdout:2958: done (4 left) 2020-11-16T22:13:07.198 INFO:tasks.rados.rados.2.smithi057.stdout:2961: done (3 left) 2020-11-16T22:13:07.198 INFO:tasks.rados.rados.2.smithi057.stdout:2964: read oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:07.198 INFO:tasks.rados.rados.2.smithi057.stdout:2964: expect (ObjNum 965 snap 333 seq_num 965) 2020-11-16T22:13:07.198 INFO:tasks.rados.rados.2.smithi057.stdout:2965: copy_from oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 344 2020-11-16T22:13:07.198 INFO:tasks.rados.rados.2.smithi057.stdout:2966: rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 344 2020-11-16T22:13:07.199 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 337 2020-11-16T22:13:07.199 INFO:tasks.rados.rados.2.smithi057.stdout:2962: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.199 INFO:tasks.rados.rados.2.smithi057.stdout:2967: read oid 22 snap -1 2020-11-16T22:13:07.199 INFO:tasks.rados.rados.2.smithi057.stdout:2967: expect (ObjNum 987 snap 344 seq_num 987) 2020-11-16T22:13:07.199 INFO:tasks.rados.rados.2.smithi057.stdout:2968: write oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 344 2020-11-16T22:13:07.199 INFO:tasks.rados.rados.2.smithi057.stdout:2968: seq_num 990 ranges {638930=422400,1665644=645682} 2020-11-16T22:13:07.205 INFO:tasks.rados.rados.2.smithi057.stdout:2968: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 638930 to 1061330 tid 1 2020-11-16T22:13:07.209 INFO:tasks.rados.rados.2.smithi057.stdout:2968: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1665644 to 2311326 tid 2 2020-11-16T22:13:07.209 INFO:tasks.rados.rados.2.smithi057.stdout:2969: snap_create 2020-11-16T22:13:07.209 INFO:tasks.rados.rados.2.smithi057.stdout:2966: finishing rollback tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.209 INFO:tasks.rados.rados.2.smithi057.stdout:2966: finishing rollback tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.209 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1771 (ObjNum 938 snap 323 seq_num 938) dirty exists 2020-11-16T22:13:07.209 INFO:tasks.rados.rados.2.smithi057.stdout:2963: finishing rollback tid 0 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.210 INFO:tasks.rados.rados.2.smithi057.stdout:2960: finishing copy_from to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.210 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2200 (ObjNum 981 snap 341 seq_num 981) dirty exists 2020-11-16T22:13:07.210 INFO:tasks.rados.rados.2.smithi057.stdout:2960: finishing copy_from racing read to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.210 INFO:tasks.rados.rados.2.smithi057.stdout:2967: expect (ObjNum 987 snap 344 seq_num 987) 2020-11-16T22:13:07.290 INFO:tasks.rados.rados.2.smithi057.stdout:2964: expect (ObjNum 965 snap 333 seq_num 965) 2020-11-16T22:13:07.383 INFO:tasks.rados.rados.2.smithi057.stdout:2962: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.384 INFO:tasks.rados.rados.2.smithi057.stdout:2962: finishing write tid 4 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.384 INFO:tasks.rados.rados.2.smithi057.stdout:2962: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.384 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2193 (ObjNum 989 snap 344 seq_num 989) dirty exists 2020-11-16T22:13:07.384 INFO:tasks.rados.rados.2.smithi057.stdout:2962: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 989 snap 344 seq_num 989) 2020-11-16T22:13:07.384 INFO:tasks.rados.rados.2.smithi057.stdout:2963: finishing rollback tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.384 INFO:tasks.rados.rados.2.smithi057.stdout:2963: finishing rollback tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.384 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2180 (ObjNum 958 snap 329 seq_num 958) dirty exists 2020-11-16T22:13:07.385 INFO:tasks.rados.rados.2.smithi057.stdout:2968: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.385 INFO:tasks.rados.rados.2.smithi057.stdout:2968: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.385 INFO:tasks.rados.rados.2.smithi057.stdout:2968: finishing write tid 4 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.385 INFO:tasks.rados.rados.2.smithi057.stdout:2968: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.385 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2183 (ObjNum 990 snap 344 seq_num 990) dirty exists 2020-11-16T22:13:07.385 INFO:tasks.rados.rados.2.smithi057.stdout:2968: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 990 snap 344 seq_num 990) 2020-11-16T22:13:07.385 INFO:tasks.rados.rados.2.smithi057.stdout:2965: finishing copy_from to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.386 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1795 (ObjNum 941 snap 324 seq_num 941) dirty exists 2020-11-16T22:13:07.386 INFO:tasks.rados.rados.2.smithi057.stdout:2965: finishing copy_from racing read to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:07.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:07 smithi057 bash[10301]: cluster 2020-11-16T22:13:05.805539+0000 mgr.x (mgr.24115) 614 : cluster [DBG] pgmap v1300: 17 pgs: 17 active+clean; 159 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2020-11-16T22:13:07.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:07 smithi057 bash[10301]: cluster 2020-11-16T22:13:06.145283+0000 mon.a (mon.0) 1429 : cluster [DBG] osdmap e757: 12 total, 12 up, 12 in 2020-11-16T22:13:07.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:07 smithi016 bash[10302]: cluster 2020-11-16T22:13:05.805539+0000 mgr.x (mgr.24115) 614 : cluster [DBG] pgmap v1300: 17 pgs: 17 active+clean; 159 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2020-11-16T22:13:07.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:07 smithi016 bash[10302]: cluster 2020-11-16T22:13:06.145283+0000 mon.a (mon.0) 1429 : cluster [DBG] osdmap e757: 12 total, 12 up, 12 in 2020-11-16T22:13:07.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:07 smithi195 bash[10218]: cluster 2020-11-16T22:13:05.805539+0000 mgr.x (mgr.24115) 614 : cluster [DBG] pgmap v1300: 17 pgs: 17 active+clean; 159 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2020-11-16T22:13:07.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:07 smithi195 bash[10218]: cluster 2020-11-16T22:13:06.145283+0000 mon.a (mon.0) 1429 : cluster [DBG] osdmap e757: 12 total, 12 up, 12 in 2020-11-16T22:13:08.156 INFO:tasks.rados.rados.2.smithi057.stdout:2960: done (8 left) 2020-11-16T22:13:08.157 INFO:tasks.rados.rados.2.smithi057.stdout:2962: done (7 left) 2020-11-16T22:13:08.157 INFO:tasks.rados.rados.2.smithi057.stdout:2963: done (6 left) 2020-11-16T22:13:08.157 INFO:tasks.rados.rados.2.smithi057.stdout:2964: done (5 left) 2020-11-16T22:13:08.157 INFO:tasks.rados.rados.2.smithi057.stdout:2965: done (4 left) 2020-11-16T22:13:08.157 INFO:tasks.rados.rados.2.smithi057.stdout:2966: done (3 left) 2020-11-16T22:13:08.157 INFO:tasks.rados.rados.2.smithi057.stdout:2967: done (2 left) 2020-11-16T22:13:08.157 INFO:tasks.rados.rados.2.smithi057.stdout:2968: done (1 left) 2020-11-16T22:13:08.158 INFO:tasks.rados.rados.2.smithi057.stdout:2969: done (0 left) 2020-11-16T22:13:08.158 INFO:tasks.rados.rados.2.smithi057.stdout:2970: snap_create 2020-11-16T22:13:08.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:08 smithi057 bash[10301]: cluster 2020-11-16T22:13:07.155533+0000 mon.a (mon.0) 1430 : cluster [DBG] osdmap e758: 12 total, 12 up, 12 in 2020-11-16T22:13:08.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:08 smithi016 bash[10302]: cluster 2020-11-16T22:13:07.155533+0000 mon.a (mon.0) 1430 : cluster [DBG] osdmap e758: 12 total, 12 up, 12 in 2020-11-16T22:13:08.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:08 smithi195 bash[10218]: cluster 2020-11-16T22:13:07.155533+0000 mon.a (mon.0) 1430 : cluster [DBG] osdmap e758: 12 total, 12 up, 12 in 2020-11-16T22:13:09.165 INFO:tasks.rados.rados.2.smithi057.stdout:2970: done (0 left) 2020-11-16T22:13:09.165 INFO:tasks.rados.rados.2.smithi057.stdout:2971: snap_create 2020-11-16T22:13:09.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:09 smithi057 bash[10301]: cluster 2020-11-16T22:13:07.806277+0000 mgr.x (mgr.24115) 615 : cluster [DBG] pgmap v1303: 17 pgs: 17 active+clean; 159 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 0 B/s wr, 1 op/s 2020-11-16T22:13:09.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:09 smithi057 bash[10301]: cluster 2020-11-16T22:13:08.165638+0000 mon.a (mon.0) 1431 : cluster [DBG] osdmap e759: 12 total, 12 up, 12 in 2020-11-16T22:13:09.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:09 smithi016 bash[10302]: cluster 2020-11-16T22:13:07.806277+0000 mgr.x (mgr.24115) 615 : cluster [DBG] pgmap v1303: 17 pgs: 17 active+clean; 159 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 0 B/s wr, 1 op/s 2020-11-16T22:13:09.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:09 smithi016 bash[10302]: cluster 2020-11-16T22:13:08.165638+0000 mon.a (mon.0) 1431 : cluster [DBG] osdmap e759: 12 total, 12 up, 12 in 2020-11-16T22:13:09.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:09 smithi195 bash[10218]: cluster 2020-11-16T22:13:07.806277+0000 mgr.x (mgr.24115) 615 : cluster [DBG] pgmap v1303: 17 pgs: 17 active+clean; 159 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 0 B/s wr, 1 op/s 2020-11-16T22:13:09.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:09 smithi195 bash[10218]: cluster 2020-11-16T22:13:08.165638+0000 mon.a (mon.0) 1431 : cluster [DBG] osdmap e759: 12 total, 12 up, 12 in 2020-11-16T22:13:10.123 INFO:tasks.rados.rados.2.smithi057.stdout:2971: done (0 left) 2020-11-16T22:13:10.124 INFO:tasks.rados.rados.2.smithi057.stdout:2972: rollback oid 44 current snap is 347 2020-11-16T22:13:10.124 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 44 to 329 2020-11-16T22:13:10.124 INFO:tasks.rados.rados.2.smithi057.stdout:2973: snap_create 2020-11-16T22:13:10.137 INFO:tasks.rados.rados.2.smithi057.stdout:2972: finishing rollback tid 0 to smithi05720651-44 2020-11-16T22:13:10.138 INFO:tasks.rados.rados.2.smithi057.stdout:2972: finishing rollback tid 1 to smithi05720651-44 2020-11-16T22:13:10.138 INFO:tasks.rados.rados.2.smithi057.stdout:2972: finishing rollback tid 2 to smithi05720651-44 2020-11-16T22:13:10.139 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 2112 (ObjNum 820 snap 281 seq_num 820) dirty exists 2020-11-16T22:13:10.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:10 smithi057 bash[10301]: cluster 2020-11-16T22:13:09.175264+0000 mon.a (mon.0) 1432 : cluster [DBG] osdmap e760: 12 total, 12 up, 12 in 2020-11-16T22:13:10.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:10 smithi057 bash[10301]: cluster 2020-11-16T22:13:10.132818+0000 mon.a (mon.0) 1433 : cluster [DBG] osdmap e761: 12 total, 12 up, 12 in 2020-11-16T22:13:10.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:10 smithi016 bash[10302]: cluster 2020-11-16T22:13:09.175264+0000 mon.a (mon.0) 1432 : cluster [DBG] osdmap e760: 12 total, 12 up, 12 in 2020-11-16T22:13:10.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:10 smithi016 bash[10302]: cluster 2020-11-16T22:13:10.132818+0000 mon.a (mon.0) 1433 : cluster [DBG] osdmap e761: 12 total, 12 up, 12 in 2020-11-16T22:13:10.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:10 smithi195 bash[10218]: cluster 2020-11-16T22:13:09.175264+0000 mon.a (mon.0) 1432 : cluster [DBG] osdmap e760: 12 total, 12 up, 12 in 2020-11-16T22:13:10.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:10 smithi195 bash[10218]: cluster 2020-11-16T22:13:10.132818+0000 mon.a (mon.0) 1433 : cluster [DBG] osdmap e761: 12 total, 12 up, 12 in 2020-11-16T22:13:11.133 INFO:tasks.rados.rados.2.smithi057.stdout:2972: done (1 left) 2020-11-16T22:13:11.134 INFO:tasks.rados.rados.2.smithi057.stdout:2973: done (0 left) 2020-11-16T22:13:11.134 INFO:tasks.rados.rados.2.smithi057.stdout:2974: copy_from oid 22 from oid 32 current snap is 348 2020-11-16T22:13:11.134 INFO:tasks.rados.rados.2.smithi057.stdout:2975: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:11.134 INFO:tasks.rados.rados.2.smithi057.stdout:2975: expect (ObjNum 990 snap 344 seq_num 990) 2020-11-16T22:13:11.134 INFO:tasks.rados.rados.2.smithi057.stdout:2976: read oid 26 snap 337 2020-11-16T22:13:11.134 INFO:tasks.rados.rados.2.smithi057.stdout:2976: expect (ObjNum 949 snap 328 seq_num 949) 2020-11-16T22:13:11.135 INFO:tasks.rados.rados.2.smithi057.stdout:2977: rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 348 2020-11-16T22:13:11.135 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 337 2020-11-16T22:13:11.135 INFO:tasks.rados.rados.2.smithi057.stdout:2978: read oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:11.135 INFO:tasks.rados.rados.2.smithi057.stdout:2978: expect (ObjNum 958 snap 329 seq_num 958) 2020-11-16T22:13:11.135 INFO:tasks.rados.rados.2.smithi057.stdout:2979: rollback oid 20 current snap is 348 2020-11-16T22:13:11.135 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 20 to 333 2020-11-16T22:13:11.135 INFO:tasks.rados.rados.2.smithi057.stdout:2980: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:11.136 INFO:tasks.rados.rados.2.smithi057.stdout:2980: expect deleted 2020-11-16T22:13:11.136 INFO:tasks.rados.rados.2.smithi057.stdout:2981: snap_remove snap 336 2020-11-16T22:13:11.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:11 smithi057 bash[10301]: cluster 2020-11-16T22:13:09.806968+0000 mgr.x (mgr.24115) 616 : cluster [DBG] pgmap v1306: 17 pgs: 17 active+clean; 167 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.5 MiB/s wr, 9 op/s 2020-11-16T22:13:11.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:11 smithi057 bash[10301]: cluster 2020-11-16T22:13:11.143291+0000 mon.a (mon.0) 1434 : cluster [DBG] osdmap e762: 12 total, 12 up, 12 in 2020-11-16T22:13:11.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:11 smithi016 bash[10302]: cluster 2020-11-16T22:13:09.806968+0000 mgr.x (mgr.24115) 616 : cluster [DBG] pgmap v1306: 17 pgs: 17 active+clean; 167 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.5 MiB/s wr, 9 op/s 2020-11-16T22:13:11.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:11 smithi016 bash[10302]: cluster 2020-11-16T22:13:11.143291+0000 mon.a (mon.0) 1434 : cluster [DBG] osdmap e762: 12 total, 12 up, 12 in 2020-11-16T22:13:11.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:11 smithi195 bash[10218]: cluster 2020-11-16T22:13:09.806968+0000 mgr.x (mgr.24115) 616 : cluster [DBG] pgmap v1306: 17 pgs: 17 active+clean; 167 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 1.5 MiB/s wr, 9 op/s 2020-11-16T22:13:11.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:11 smithi195 bash[10218]: cluster 2020-11-16T22:13:11.143291+0000 mon.a (mon.0) 1434 : cluster [DBG] osdmap e762: 12 total, 12 up, 12 in 2020-11-16T22:13:12.135 INFO:tasks.rados.rados.2.smithi057.stdout:2981: done (7 left) 2020-11-16T22:13:12.135 INFO:tasks.rados.rados.2.smithi057.stdout:2982: snap_remove snap 347 2020-11-16T22:13:13.140 INFO:tasks.rados.rados.2.smithi057.stdout:2982: done (7 left) 2020-11-16T22:13:13.140 INFO:tasks.rados.rados.2.smithi057.stdout:2983: read oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:13.140 INFO:tasks.rados.rados.2.smithi057.stdout:2983: expect deleted 2020-11-16T22:13:13.140 INFO:tasks.rados.rados.2.smithi057.stdout:2984: write oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 348 2020-11-16T22:13:13.140 INFO:tasks.rados.rados.2.smithi057.stdout:2984: seq_num 991 ranges {655737=497649,1607773=789340} 2020-11-16T22:13:13.150 INFO:tasks.rados.rados.2.smithi057.stdout:2984: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 655737 to 1153386 tid 1 2020-11-16T22:13:13.157 INFO:tasks.rados.rados.2.smithi057.stdout:2984: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1607773 to 2397113 tid 2 2020-11-16T22:13:13.157 INFO:tasks.rados.rados.2.smithi057.stdout:2985: snap_remove snap 346 2020-11-16T22:13:13.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:13 smithi057 bash[10301]: cluster 2020-11-16T22:13:11.807695+0000 mgr.x (mgr.24115) 617 : cluster [DBG] pgmap v1309: 17 pgs: 17 active+clean; 172 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 2.4 MiB/s wr, 14 op/s 2020-11-16T22:13:13.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:13 smithi057 bash[10301]: cluster 2020-11-16T22:13:12.145505+0000 mon.a (mon.0) 1435 : cluster [DBG] osdmap e763: 12 total, 12 up, 12 in 2020-11-16T22:13:13.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:13 smithi016 bash[10302]: cluster 2020-11-16T22:13:11.807695+0000 mgr.x (mgr.24115) 617 : cluster [DBG] pgmap v1309: 17 pgs: 17 active+clean; 172 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 2.4 MiB/s wr, 14 op/s 2020-11-16T22:13:13.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:13 smithi016 bash[10302]: cluster 2020-11-16T22:13:12.145505+0000 mon.a (mon.0) 1435 : cluster [DBG] osdmap e763: 12 total, 12 up, 12 in 2020-11-16T22:13:13.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:13 smithi195 bash[10218]: cluster 2020-11-16T22:13:11.807695+0000 mgr.x (mgr.24115) 617 : cluster [DBG] pgmap v1309: 17 pgs: 17 active+clean; 172 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 2.4 MiB/s wr, 14 op/s 2020-11-16T22:13:13.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:13 smithi195 bash[10218]: cluster 2020-11-16T22:13:12.145505+0000 mon.a (mon.0) 1435 : cluster [DBG] osdmap e763: 12 total, 12 up, 12 in 2020-11-16T22:13:14.157 INFO:tasks.rados.rados.2.smithi057.stdout:2985: done (9 left) 2020-11-16T22:13:14.157 INFO:tasks.rados.rados.2.smithi057.stdout:2986: write oid 18 current snap is 348 2020-11-16T22:13:14.157 INFO:tasks.rados.rados.2.smithi057.stdout:2986: seq_num 992 ranges {672544=572898,1666255=532998} 2020-11-16T22:13:14.166 INFO:tasks.rados.rados.2.smithi057.stdout:2986: writing smithi05720651-18 from 672544 to 1245442 tid 1 2020-11-16T22:13:14.172 INFO:tasks.rados.rados.2.smithi057.stdout:2986: writing smithi05720651-18 from 1666255 to 2199253 tid 2 2020-11-16T22:13:14.172 INFO:tasks.rados.rados.2.smithi057.stdout:2987: write oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 348 2020-11-16T22:13:14.172 INFO:tasks.rados.rados.2.smithi057.stdout:2987: seq_num 993 ranges {689351=648147,2124737=564614} 2020-11-16T22:13:14.179 INFO:tasks.rados.rados.2.smithi057.stdout:2987: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 689351 to 1337498 tid 1 2020-11-16T22:13:14.187 INFO:tasks.rados.rados.2.smithi057.stdout:2987: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2124737 to 2689351 tid 2 2020-11-16T22:13:14.187 INFO:tasks.rados.rados.2.smithi057.stdout:2988: delete oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 348 2020-11-16T22:13:14.188 INFO:tasks.rados.rados.2.smithi057.stdout:2979: finishing rollback tid 0 to smithi05720651-20 2020-11-16T22:13:14.188 INFO:tasks.rados.rados.2.smithi057.stdout:2979: finishing rollback tid 1 to smithi05720651-20 2020-11-16T22:13:14.188 INFO:tasks.rados.rados.2.smithi057.stdout:2979: finishing rollback tid 2 to smithi05720651-20 2020-11-16T22:13:14.188 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 2186 (ObjNum 940 snap 324 seq_num 940) dirty exists 2020-11-16T22:13:14.188 INFO:tasks.rados.rados.2.smithi057.stdout:2975: expect (ObjNum 990 snap 344 seq_num 990) 2020-11-16T22:13:14.278 INFO:tasks.rados.rados.2.smithi057.stdout:2977: finishing rollback tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:14.278 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 385 snap 0 seq_num 2932425680) dirty dne 2020-11-16T22:13:14.278 INFO:tasks.rados.rados.2.smithi057.stdout:2976: expect (ObjNum 949 snap 328 seq_num 949) 2020-11-16T22:13:14.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:14 smithi057 bash[10301]: cluster 2020-11-16T22:13:13.148021+0000 mon.a (mon.0) 1436 : cluster [DBG] osdmap e764: 12 total, 12 up, 12 in 2020-11-16T22:13:14.454 INFO:tasks.rados.rados.2.smithi057.stdout:2978: expect (ObjNum 958 snap 329 seq_num 958) 2020-11-16T22:13:14.516 INFO:tasks.rados.rados.2.smithi057.stdout:2974: finishing copy_from to smithi05720651-22 2020-11-16T22:13:14.516 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 2374 (ObjNum 976 snap 340 seq_num 976) dirty exists 2020-11-16T22:13:14.516 INFO:tasks.rados.rados.2.smithi057.stdout:2974: finishing copy_from racing read to smithi05720651-22 2020-11-16T22:13:14.516 INFO:tasks.rados.rados.2.smithi057.stdout:2984: finishing write tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:14.517 INFO:tasks.rados.rados.2.smithi057.stdout:2984: finishing write tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:14.517 INFO:tasks.rados.rados.2.smithi057.stdout:2984: finishing write tid 4 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:14.517 INFO:tasks.rados.rados.2.smithi057.stdout:2984: finishing write tid 5 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:14.517 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2205 (ObjNum 991 snap 348 seq_num 991) dirty exists 2020-11-16T22:13:14.517 INFO:tasks.rados.rados.2.smithi057.stdout:2984: left oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 991 snap 348 seq_num 991) 2020-11-16T22:13:14.517 INFO:tasks.rados.rados.2.smithi057.stdout:2986: finishing write tid 1 to smithi05720651-18 2020-11-16T22:13:14.518 INFO:tasks.rados.rados.2.smithi057.stdout:2986: finishing write tid 2 to smithi05720651-18 2020-11-16T22:13:14.518 INFO:tasks.rados.rados.2.smithi057.stdout:2986: finishing write tid 4 to smithi05720651-18 2020-11-16T22:13:14.518 INFO:tasks.rados.rados.2.smithi057.stdout:2986: finishing write tid 5 to smithi05720651-18 2020-11-16T22:13:14.518 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 1743 (ObjNum 992 snap 348 seq_num 992) dirty exists 2020-11-16T22:13:14.518 INFO:tasks.rados.rados.2.smithi057.stdout:2986: left oid 18 (ObjNum 992 snap 348 seq_num 992) 2020-11-16T22:13:14.518 INFO:tasks.rados.rados.2.smithi057.stdout:2987: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:14.518 INFO:tasks.rados.rados.2.smithi057.stdout:2974: done (11 left) 2020-11-16T22:13:14.519 INFO:tasks.rados.rados.2.smithi057.stdout:2975: done (10 left) 2020-11-16T22:13:14.519 INFO:tasks.rados.rados.2.smithi057.stdout:2976: done (9 left) 2020-11-16T22:13:14.519 INFO:tasks.rados.rados.2.smithi057.stdout:2977: done (8 left) 2020-11-16T22:13:14.519 INFO:tasks.rados.rados.2.smithi057.stdout:2978: done (7 left) 2020-11-16T22:13:14.519 INFO:tasks.rados.rados.2.smithi057.stdout:2979: done (6 left) 2020-11-16T22:13:14.519 INFO:tasks.rados.rados.2.smithi057.stdout:2980: done (5 left) 2020-11-16T22:13:14.519 INFO:tasks.rados.rados.2.smithi057.stdout:2983: done (4 left) 2020-11-16T22:13:14.519 INFO:tasks.rados.rados.2.smithi057.stdout:2984: done (3 left) 2020-11-16T22:13:14.520 INFO:tasks.rados.rados.2.smithi057.stdout:2986: done (2 left) 2020-11-16T22:13:14.520 INFO:tasks.rados.rados.2.smithi057.stdout:2988: done (1 left) 2020-11-16T22:13:14.520 INFO:tasks.rados.rados.2.smithi057.stdout:2989: rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 348 2020-11-16T22:13:14.520 INFO:tasks.rados.rados.2.smithi057.stdout:2987: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:14.520 INFO:tasks.rados.rados.2.smithi057.stdout:2987: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:14.520 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 329 2020-11-16T22:13:14.520 INFO:tasks.rados.rados.2.smithi057.stdout:2987: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:14.521 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1746 (ObjNum 993 snap 348 seq_num 993) dirty exists 2020-11-16T22:13:14.521 INFO:tasks.rados.rados.2.smithi057.stdout:2987: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 993 snap 348 seq_num 993) 2020-11-16T22:13:14.521 INFO:tasks.rados.rados.2.smithi057.stdout:2987: done (1 left) 2020-11-16T22:13:14.521 INFO:tasks.rados.rados.2.smithi057.stdout:2990: rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 348 2020-11-16T22:13:14.521 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 333 2020-11-16T22:13:14.521 INFO:tasks.rados.rados.2.smithi057.stdout:2991: write (excl) oid 42 current snap is 348 2020-11-16T22:13:14.521 INFO:tasks.rados.rados.2.smithi057.stdout:2991: seq_num 995 ranges {722965=798645,2125348=597617} 2020-11-16T22:13:14.531 INFO:tasks.rados.rados.2.smithi057.stdout:2991: writing smithi05720651-42 from 722965 to 1521610 tid 1 2020-11-16T22:13:14.539 INFO:tasks.rados.rados.2.smithi057.stdout:2991: writing smithi05720651-42 from 2125348 to 2722965 tid 2 2020-11-16T22:13:14.539 INFO:tasks.rados.rados.2.smithi057.stdout:2992: read oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:14.539 INFO:tasks.rados.rados.2.smithi057.stdout:2992: expect (ObjNum 958 snap 329 seq_num 958) 2020-11-16T22:13:14.539 INFO:tasks.rados.rados.2.smithi057.stdout:2993: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 343 2020-11-16T22:13:14.539 INFO:tasks.rados.rados.2.smithi057.stdout:2993: expect (ObjNum 968 snap 333 seq_num 968) 2020-11-16T22:13:14.539 INFO:tasks.rados.rados.2.smithi057.stdout:2994: delete oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 348 2020-11-16T22:13:14.540 INFO:tasks.rados.rados.2.smithi057.stdout:2990: finishing rollback tid 0 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:14.540 INFO:tasks.rados.rados.2.smithi057.stdout:2990: finishing rollback tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:14.540 INFO:tasks.rados.rados.2.smithi057.stdout:2990: finishing rollback tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:14.540 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2189 (ObjNum 926 snap 314 seq_num 926) dirty exists 2020-11-16T22:13:14.540 INFO:tasks.rados.rados.2.smithi057.stdout:2989: finishing rollback tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:14.540 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 33 snap 0 seq_num 0) dirty dne 2020-11-16T22:13:14.541 INFO:tasks.rados.rados.2.smithi057.stdout:2991: finishing write tid 1 to smithi05720651-42 2020-11-16T22:13:14.543 INFO:tasks.rados.rados.2.smithi057.stdout:2993: expect (ObjNum 968 snap 333 seq_num 968) 2020-11-16T22:13:14.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:14 smithi016 bash[10302]: cluster 2020-11-16T22:13:13.148021+0000 mon.a (mon.0) 1436 : cluster [DBG] osdmap e764: 12 total, 12 up, 12 in 2020-11-16T22:13:14.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:14 smithi195 bash[10218]: cluster 2020-11-16T22:13:13.148021+0000 mon.a (mon.0) 1436 : cluster [DBG] osdmap e764: 12 total, 12 up, 12 in 2020-11-16T22:13:14.614 INFO:tasks.rados.rados.2.smithi057.stdout:2991: finishing write tid 2 to smithi05720651-42 2020-11-16T22:13:14.614 INFO:tasks.rados.rados.2.smithi057.stdout:2992: expect (ObjNum 958 snap 329 seq_num 958) 2020-11-16T22:13:14.676 INFO:tasks.rados.rados.2.smithi057.stdout:2991: finishing write tid 4 to smithi05720651-42 2020-11-16T22:13:14.676 INFO:tasks.rados.rados.2.smithi057.stdout:2991: finishing write tid 5 to smithi05720651-42 2020-11-16T22:13:14.676 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 1921 (ObjNum 995 snap 348 seq_num 995) dirty exists 2020-11-16T22:13:14.676 INFO:tasks.rados.rados.2.smithi057.stdout:2991: left oid 42 (ObjNum 995 snap 348 seq_num 995) 2020-11-16T22:13:14.676 INFO:tasks.rados.rados.2.smithi057.stdout:2989: done (5 left) 2020-11-16T22:13:14.677 INFO:tasks.rados.rados.2.smithi057.stdout:2990: done (4 left) 2020-11-16T22:13:14.677 INFO:tasks.rados.rados.2.smithi057.stdout:2991: done (3 left) 2020-11-16T22:13:14.677 INFO:tasks.rados.rados.2.smithi057.stdout:2992: done (2 left) 2020-11-16T22:13:14.677 INFO:tasks.rados.rados.2.smithi057.stdout:2993: done (1 left) 2020-11-16T22:13:14.677 INFO:tasks.rados.rados.2.smithi057.stdout:2994: done (0 left) 2020-11-16T22:13:14.677 INFO:tasks.rados.rados.2.smithi057.stdout:2995: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:14.677 INFO:tasks.rados.rados.2.smithi057.stdout:2995: expect (ObjNum 926 snap 314 seq_num 926) 2020-11-16T22:13:14.678 INFO:tasks.rados.rados.2.smithi057.stdout:2996: read oid 20 snap -1 2020-11-16T22:13:14.678 INFO:tasks.rados.rados.2.smithi057.stdout:2996: expect (ObjNum 940 snap 324 seq_num 940) 2020-11-16T22:13:14.678 INFO:tasks.rados.rados.2.smithi057.stdout:2997: write oid 40 current snap is 348 2020-11-16T22:13:14.678 INFO:tasks.rados.rados.2.smithi057.stdout:2997: seq_num 997 ranges {756579=665496,1958665=400347} 2020-11-16T22:13:14.684 INFO:tasks.rados.rados.2.smithi057.stdout:2997: writing smithi05720651-40 from 756579 to 1422075 tid 1 2020-11-16T22:13:14.690 INFO:tasks.rados.rados.2.smithi057.stdout:2997: writing smithi05720651-40 from 1958665 to 2359012 tid 2 2020-11-16T22:13:14.690 INFO:tasks.rados.rados.2.smithi057.stdout:2998: write oid 18 current snap is 348 2020-11-16T22:13:14.690 INFO:tasks.rados.rados.2.smithi057.stdout:2998: seq_num 998 ranges {773386=740745,2017147=544005} 2020-11-16T22:13:14.699 INFO:tasks.rados.rados.2.smithi057.stdout:2998: writing smithi05720651-18 from 773386 to 1514131 tid 1 2020-11-16T22:13:14.705 INFO:tasks.rados.rados.2.smithi057.stdout:2998: writing smithi05720651-18 from 2017147 to 2561152 tid 2 2020-11-16T22:13:14.705 INFO:tasks.rados.rados.2.smithi057.stdout:2999: read oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:14.705 INFO:tasks.rados.rados.2.smithi057.stdout:2999: expect (ObjNum 981 snap 341 seq_num 981) 2020-11-16T22:13:14.705 INFO:tasks.rados.rados.2.smithi057.stdout:3000: copy_from oid 42 from oid 28 current snap is 348 2020-11-16T22:13:14.706 INFO:tasks.rados.rados.2.smithi057.stdout:2996: expect (ObjNum 940 snap 324 seq_num 940) 2020-11-16T22:13:14.930 INFO:tasks.rados.rados.2.smithi057.stdout:2995: expect (ObjNum 926 snap 314 seq_num 926) 2020-11-16T22:13:15.191 INFO:tasks.rados.rados.2.smithi057.stdout:2997: finishing write tid 1 to smithi05720651-40 2020-11-16T22:13:15.191 INFO:tasks.rados.rados.2.smithi057.stdout:2997: finishing write tid 2 to smithi05720651-40 2020-11-16T22:13:15.191 INFO:tasks.rados.rados.2.smithi057.stdout:2997: finishing write tid 4 to smithi05720651-40 2020-11-16T22:13:15.192 INFO:tasks.rados.rados.2.smithi057.stdout:2997: finishing write tid 5 to smithi05720651-40 2020-11-16T22:13:15.192 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 2438 (ObjNum 997 snap 348 seq_num 997) dirty exists 2020-11-16T22:13:15.192 INFO:tasks.rados.rados.2.smithi057.stdout:2997: left oid 40 (ObjNum 997 snap 348 seq_num 997) 2020-11-16T22:13:15.192 INFO:tasks.rados.rados.2.smithi057.stdout:2998: finishing write tid 1 to smithi05720651-18 2020-11-16T22:13:15.192 INFO:tasks.rados.rados.2.smithi057.stdout:2998: finishing write tid 2 to smithi05720651-18 2020-11-16T22:13:15.192 INFO:tasks.rados.rados.2.smithi057.stdout:2998: finishing write tid 4 to smithi05720651-18 2020-11-16T22:13:15.192 INFO:tasks.rados.rados.2.smithi057.stdout:2998: finishing write tid 5 to smithi05720651-18 2020-11-16T22:13:15.193 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 1749 (ObjNum 998 snap 348 seq_num 998) dirty exists 2020-11-16T22:13:15.193 INFO:tasks.rados.rados.2.smithi057.stdout:2998: left oid 18 (ObjNum 998 snap 348 seq_num 998) 2020-11-16T22:13:15.193 INFO:tasks.rados.rados.2.smithi057.stdout:2999: expect (ObjNum 981 snap 341 seq_num 981) 2020-11-16T22:13:15.301 INFO:tasks.rados.rados.2.smithi057.stdout:3000: finishing copy_from to smithi05720651-42 2020-11-16T22:13:15.302 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 2186 (ObjNum 969 snap 336 seq_num 969) dirty exists 2020-11-16T22:13:15.302 INFO:tasks.rados.rados.2.smithi057.stdout:3000: finishing copy_from racing read to smithi05720651-42 2020-11-16T22:13:15.302 INFO:tasks.rados.rados.2.smithi057.stdout:2995: done (5 left) 2020-11-16T22:13:15.302 INFO:tasks.rados.rados.2.smithi057.stdout:2996: done (4 left) 2020-11-16T22:13:15.302 INFO:tasks.rados.rados.2.smithi057.stdout:2997: done (3 left) 2020-11-16T22:13:15.302 INFO:tasks.rados.rados.2.smithi057.stdout:2998: done (2 left) 2020-11-16T22:13:15.303 INFO:tasks.rados.rados.2.smithi057.stdout:2999: done (1 left) 2020-11-16T22:13:15.303 INFO:tasks.rados.rados.2.smithi057.stdout:3000: done (0 left) 2020-11-16T22:13:15.303 INFO:tasks.rados.rados.2.smithi057.stdout:3001: write (excl) oid 22 current snap is 348 2020-11-16T22:13:15.303 INFO:tasks.rados.rados.2.smithi057.stdout:3001: seq_num 999 ranges {790193=415994,1959276=404016} 2020-11-16T22:13:15.317 INFO:tasks.rados.rados.2.smithi057.stdout:3001: writing smithi05720651-22 from 790193 to 1206187 tid 1 2020-11-16T22:13:15.324 INFO:tasks.rados.rados.2.smithi057.stdout:3001: writing smithi05720651-22 from 1959276 to 2363292 tid 2 2020-11-16T22:13:15.324 INFO:tasks.rados.rados.2.smithi057.stdout:3002: copy_from oid 14 from oid 42 current snap is 348 2020-11-16T22:13:15.324 INFO:tasks.rados.rados.2.smithi057.stdout:3001: finishing write tid 1 to smithi05720651-22 2020-11-16T22:13:15.324 INFO:tasks.rados.rados.2.smithi057.stdout:3003: copy_from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 348 2020-11-16T22:13:15.324 INFO:tasks.rados.rados.2.smithi057.stdout:3004: write (excl) oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 348 2020-11-16T22:13:15.324 INFO:tasks.rados.rados.2.smithi057.stdout:3004: seq_num 1000 ranges {407000=491243,1617758=547674,2595228=211772} 2020-11-16T22:13:15.329 INFO:tasks.rados.rados.2.smithi057.stdout:3004: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 407000 to 898243 tid 1 2020-11-16T22:13:15.336 INFO:tasks.rados.rados.2.smithi057.stdout:3004: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1617758 to 2165432 tid 2 2020-11-16T22:13:15.340 INFO:tasks.rados.rados.2.smithi057.stdout:3004: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2595228 to 2807000 tid 3 2020-11-16T22:13:15.340 INFO:tasks.rados.rados.2.smithi057.stdout:3005: delete oid 10 current snap is 348 2020-11-16T22:13:15.340 INFO:tasks.rados.rados.2.smithi057.stdout:3001: finishing write tid 2 to smithi05720651-22 2020-11-16T22:13:15.340 INFO:tasks.rados.rados.2.smithi057.stdout:3001: finishing write tid 4 to smithi05720651-22 2020-11-16T22:13:15.340 INFO:tasks.rados.rados.2.smithi057.stdout:3001: finishing write tid 5 to smithi05720651-22 2020-11-16T22:13:15.341 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 2377 (ObjNum 999 snap 348 seq_num 999) dirty exists 2020-11-16T22:13:15.341 INFO:tasks.rados.rados.2.smithi057.stdout:3001: left oid 22 (ObjNum 999 snap 348 seq_num 999) 2020-11-16T22:13:15.341 INFO:tasks.rados.rados.2.smithi057.stdout:3004: finishing write tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:15.343 INFO:tasks.rados.rados.2.smithi057.stdout:3003: finishing copy_from to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:15.343 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2192 (ObjNum 912 snap 310 seq_num 912) dirty exists 2020-11-16T22:13:15.344 INFO:tasks.rados.rados.2.smithi057.stdout:3003: finishing copy_from racing read to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:15.344 INFO:tasks.rados.rados.2.smithi057.stdout:3001: done (4 left) 2020-11-16T22:13:15.344 INFO:tasks.rados.rados.2.smithi057.stdout:3003: done (3 left) 2020-11-16T22:13:15.344 INFO:tasks.rados.rados.2.smithi057.stdout:3005: done (2 left) 2020-11-16T22:13:15.345 INFO:tasks.rados.rados.2.smithi057.stdout:3006: snap_create 2020-11-16T22:13:15.350 INFO:tasks.rados.rados.2.smithi057.stdout:3002: finishing copy_from to smithi05720651-14 2020-11-16T22:13:15.351 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 2186 (ObjNum 969 snap 336 seq_num 969) dirty exists 2020-11-16T22:13:15.351 INFO:tasks.rados.rados.2.smithi057.stdout:3002: finishing copy_from racing read to smithi05720651-14 2020-11-16T22:13:15.351 INFO:tasks.rados.rados.2.smithi057.stdout:3004: finishing write tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:15.351 INFO:tasks.rados.rados.2.smithi057.stdout:3004: finishing write tid 3 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:15.351 INFO:tasks.rados.rados.2.smithi057.stdout:3004: finishing write tid 5 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:15.352 INFO:tasks.rados.rados.2.smithi057.stdout:3004: finishing write tid 6 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:15.352 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2444 (ObjNum 1000 snap 348 seq_num 1000) dirty exists 2020-11-16T22:13:15.352 INFO:tasks.rados.rados.2.smithi057.stdout:3004: left oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1000 snap 348 seq_num 1000) 2020-11-16T22:13:15.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:15 smithi057 bash[10301]: cluster 2020-11-16T22:13:13.808365+0000 mgr.x (mgr.24115) 618 : cluster [DBG] pgmap v1312: 17 pgs: 17 active+clean; 172 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 868 KiB/s wr, 5 op/s 2020-11-16T22:13:15.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:15 smithi057 bash[10301]: cluster 2020-11-16T22:13:14.168072+0000 mon.a (mon.0) 1437 : cluster [DBG] osdmap e765: 12 total, 12 up, 12 in 2020-11-16T22:13:15.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:15 smithi057 bash[10301]: cluster 2020-11-16T22:13:15.147012+0000 mon.a (mon.0) 1438 : cluster [DBG] osdmap e766: 12 total, 12 up, 12 in 2020-11-16T22:13:15.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:15 smithi016 bash[10302]: cluster 2020-11-16T22:13:13.808365+0000 mgr.x (mgr.24115) 618 : cluster [DBG] pgmap v1312: 17 pgs: 17 active+clean; 172 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 868 KiB/s wr, 5 op/s 2020-11-16T22:13:15.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:15 smithi016 bash[10302]: cluster 2020-11-16T22:13:14.168072+0000 mon.a (mon.0) 1437 : cluster [DBG] osdmap e765: 12 total, 12 up, 12 in 2020-11-16T22:13:15.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:15 smithi016 bash[10302]: cluster 2020-11-16T22:13:15.147012+0000 mon.a (mon.0) 1438 : cluster [DBG] osdmap e766: 12 total, 12 up, 12 in 2020-11-16T22:13:15.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:15 smithi195 bash[10218]: cluster 2020-11-16T22:13:13.808365+0000 mgr.x (mgr.24115) 618 : cluster [DBG] pgmap v1312: 17 pgs: 17 active+clean; 172 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 868 KiB/s wr, 5 op/s 2020-11-16T22:13:15.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:15 smithi195 bash[10218]: cluster 2020-11-16T22:13:14.168072+0000 mon.a (mon.0) 1437 : cluster [DBG] osdmap e765: 12 total, 12 up, 12 in 2020-11-16T22:13:15.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:15 smithi195 bash[10218]: cluster 2020-11-16T22:13:15.147012+0000 mon.a (mon.0) 1438 : cluster [DBG] osdmap e766: 12 total, 12 up, 12 in 2020-11-16T22:13:16.178 INFO:tasks.rados.rados.2.smithi057.stdout:3002: done (2 left) 2020-11-16T22:13:16.179 INFO:tasks.rados.rados.2.smithi057.stdout:3004: done (1 left) 2020-11-16T22:13:16.179 INFO:tasks.rados.rados.2.smithi057.stdout:3006: done (0 left) 2020-11-16T22:13:16.179 INFO:tasks.rados.rados.2.smithi057.stdout:3007: delete oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 349 2020-11-16T22:13:16.185 INFO:tasks.rados.rados.2.smithi057.stdout:3007: done (0 left) 2020-11-16T22:13:16.186 INFO:tasks.rados.rados.2.smithi057.stdout:3008: write oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 349 2020-11-16T22:13:16.186 INFO:tasks.rados.rados.2.smithi057.stdout:3008: seq_num 1003 ranges {457421=716990,1676851=411354,2677497=179924} 2020-11-16T22:13:16.197 INFO:tasks.rados.rados.2.smithi057.stdout:3008: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 457421 to 1174411 tid 1 2020-11-16T22:13:16.202 INFO:tasks.rados.rados.2.smithi057.stdout:3008: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1676851 to 2088205 tid 2 2020-11-16T22:13:16.207 INFO:tasks.rados.rados.2.smithi057.stdout:3008: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2677497 to 2857421 tid 3 2020-11-16T22:13:16.207 INFO:tasks.rados.rados.2.smithi057.stdout:3009: copy_from oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 34 current snap is 349 2020-11-16T22:13:16.207 INFO:tasks.rados.rados.2.smithi057.stdout:3008: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:16.207 INFO:tasks.rados.rados.2.smithi057.stdout:3010: copy_from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 12 current snap is 349 2020-11-16T22:13:16.207 INFO:tasks.rados.rados.2.smithi057.stdout:3011: snap_remove snap 337 2020-11-16T22:13:17.181 INFO:tasks.rados.rados.2.smithi057.stdout:3011: done (3 left) 2020-11-16T22:13:17.182 INFO:tasks.rados.rados.2.smithi057.stdout:3012: copy_from oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 349 2020-11-16T22:13:17.182 INFO:tasks.rados.rados.2.smithi057.stdout:3008: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:17.182 INFO:tasks.rados.rados.2.smithi057.stdout:3008: finishing write tid 3 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:17.182 INFO:tasks.rados.rados.2.smithi057.stdout:3008: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:17.182 INFO:tasks.rados.rados.2.smithi057.stdout:3008: finishing write tid 6 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:17.183 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1800 (ObjNum 1003 snap 349 seq_num 1003) dirty exists 2020-11-16T22:13:17.183 INFO:tasks.rados.rados.2.smithi057.stdout:3008: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1003 snap 349 seq_num 1003) 2020-11-16T22:13:17.183 INFO:tasks.rados.rados.2.smithi057.stdout:3010: finishing copy_from to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:17.183 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1789 (ObjNum 962 snap 331 seq_num 962) dirty exists 2020-11-16T22:13:17.183 INFO:tasks.rados.rados.2.smithi057.stdout:3010: finishing copy_from racing read to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:17.183 INFO:tasks.rados.rados.2.smithi057.stdout:3009: finishing copy_from to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:17.184 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2183 (ObjNum 949 snap 328 seq_num 949) dirty exists 2020-11-16T22:13:17.184 INFO:tasks.rados.rados.2.smithi057.stdout:3009: finishing copy_from racing read to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:17.184 INFO:tasks.rados.rados.2.smithi057.stdout:3008: done (3 left) 2020-11-16T22:13:17.184 INFO:tasks.rados.rados.2.smithi057.stdout:3009: done (2 left) 2020-11-16T22:13:17.184 INFO:tasks.rados.rados.2.smithi057.stdout:3010: done (1 left) 2020-11-16T22:13:17.184 INFO:tasks.rados.rados.2.smithi057.stdout:3013: write (excl) oid 22 current snap is 349 2020-11-16T22:13:17.184 INFO:tasks.rados.rados.2.smithi057.stdout:3013: seq_num 1004 ranges {474228=508592,1451686=555012,2704920=169308} 2020-11-16T22:13:17.193 INFO:tasks.rados.rados.2.smithi057.stdout:3013: writing smithi05720651-22 from 474228 to 982820 tid 1 2020-11-16T22:13:17.199 INFO:tasks.rados.rados.2.smithi057.stdout:3013: writing smithi05720651-22 from 1451686 to 2006698 tid 2 2020-11-16T22:13:17.204 INFO:tasks.rados.rados.2.smithi057.stdout:3013: writing smithi05720651-22 from 2704920 to 2874228 tid 3 2020-11-16T22:13:17.204 INFO:tasks.rados.rados.2.smithi057.stdout:3014: snap_create 2020-11-16T22:13:17.205 INFO:tasks.rados.rados.2.smithi057.stdout:3013: finishing write tid 1 to smithi05720651-22 2020-11-16T22:13:17.205 INFO:tasks.rados.rados.2.smithi057.stdout:3013: finishing write tid 2 to smithi05720651-22 2020-11-16T22:13:17.207 INFO:tasks.rados.rados.2.smithi057.stdout:3013: finishing write tid 3 to smithi05720651-22 2020-11-16T22:13:17.207 INFO:tasks.rados.rados.2.smithi057.stdout:3012: finishing copy_from to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:17.207 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2205 (ObjNum 991 snap 348 seq_num 991) dirty exists 2020-11-16T22:13:17.208 INFO:tasks.rados.rados.2.smithi057.stdout:3012: finishing copy_from racing read to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:17.208 INFO:tasks.rados.rados.2.smithi057.stdout:3013: finishing write tid 5 to smithi05720651-22 2020-11-16T22:13:17.208 INFO:tasks.rados.rados.2.smithi057.stdout:3013: finishing write tid 6 to smithi05720651-22 2020-11-16T22:13:17.208 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 2381 (ObjNum 1004 snap 349 seq_num 1004) dirty exists 2020-11-16T22:13:17.208 INFO:tasks.rados.rados.2.smithi057.stdout:3013: left oid 22 (ObjNum 1004 snap 349 seq_num 1004) 2020-11-16T22:13:17.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:17 smithi057 bash[10301]: cluster 2020-11-16T22:13:15.809195+0000 mgr.x (mgr.24115) 619 : cluster [DBG] pgmap v1315: 17 pgs: 17 active+clean; 176 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 901 KiB/s wr, 11 op/s 2020-11-16T22:13:17.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:17 smithi057 bash[10301]: cluster 2020-11-16T22:13:16.188259+0000 mon.a (mon.0) 1439 : cluster [DBG] osdmap e767: 12 total, 12 up, 12 in 2020-11-16T22:13:17.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:17 smithi016 bash[10302]: cluster 2020-11-16T22:13:15.809195+0000 mgr.x (mgr.24115) 619 : cluster [DBG] pgmap v1315: 17 pgs: 17 active+clean; 176 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 901 KiB/s wr, 11 op/s 2020-11-16T22:13:17.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:17 smithi016 bash[10302]: cluster 2020-11-16T22:13:16.188259+0000 mon.a (mon.0) 1439 : cluster [DBG] osdmap e767: 12 total, 12 up, 12 in 2020-11-16T22:13:17.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:17 smithi195 bash[10218]: cluster 2020-11-16T22:13:15.809195+0000 mgr.x (mgr.24115) 619 : cluster [DBG] pgmap v1315: 17 pgs: 17 active+clean; 176 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 901 KiB/s wr, 11 op/s 2020-11-16T22:13:17.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:17 smithi195 bash[10218]: cluster 2020-11-16T22:13:16.188259+0000 mon.a (mon.0) 1439 : cluster [DBG] osdmap e767: 12 total, 12 up, 12 in 2020-11-16T22:13:18.204 INFO:tasks.rados.rados.2.smithi057.stdout:3012: done (2 left) 2020-11-16T22:13:18.204 INFO:tasks.rados.rados.2.smithi057.stdout:3013: done (1 left) 2020-11-16T22:13:18.204 INFO:tasks.rados.rados.2.smithi057.stdout:3014: done (0 left) 2020-11-16T22:13:18.205 INFO:tasks.rados.rados.2.smithi057.stdout:3015: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:18.205 INFO:tasks.rados.rados.2.smithi057.stdout:3015: expect (ObjNum 916 snap 313 seq_num 916) 2020-11-16T22:13:18.205 INFO:tasks.rados.rados.2.smithi057.stdout:3016: rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 350 2020-11-16T22:13:18.205 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 334 2020-11-16T22:13:18.205 INFO:tasks.rados.rados.2.smithi057.stdout:3017: snap_create 2020-11-16T22:13:18.207 INFO:tasks.rados.rados.2.smithi057.stdout:3016: finishing rollback tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:18.208 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 49 snap 0 seq_num 1953066355) dirty dne 2020-11-16T22:13:18.219 INFO:tasks.rados.rados.2.smithi057.stdout:3015: expect (ObjNum 916 snap 313 seq_num 916) 2020-11-16T22:13:18.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:18 smithi016 bash[10302]: cluster 2020-11-16T22:13:17.192108+0000 mon.a (mon.0) 1440 : cluster [DBG] osdmap e768: 12 total, 12 up, 12 in 2020-11-16T22:13:18.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:18 smithi195 bash[10218]: cluster 2020-11-16T22:13:17.192108+0000 mon.a (mon.0) 1440 : cluster [DBG] osdmap e768: 12 total, 12 up, 12 in 2020-11-16T22:13:18.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:18 smithi057 bash[10301]: cluster 2020-11-16T22:13:17.192108+0000 mon.a (mon.0) 1440 : cluster [DBG] osdmap e768: 12 total, 12 up, 12 in 2020-11-16T22:13:19.209 INFO:tasks.rados.rados.2.smithi057.stdout:3015: done (2 left) 2020-11-16T22:13:19.210 INFO:tasks.rados.rados.2.smithi057.stdout:3016: done (1 left) 2020-11-16T22:13:19.210 INFO:tasks.rados.rados.2.smithi057.stdout:3017: done (0 left) 2020-11-16T22:13:19.210 INFO:tasks.rados.rados.2.smithi057.stdout:3018: write (excl) oid 6 current snap is 351 2020-11-16T22:13:19.210 INFO:tasks.rados.rados.2.smithi057.stdout:3018: seq_num 1005 ranges {491035=583841,1510168=698670,2732343=158692} 2020-11-16T22:13:19.219 INFO:tasks.rados.rados.2.smithi057.stdout:3018: writing smithi05720651-6 from 491035 to 1074876 tid 1 2020-11-16T22:13:19.227 INFO:tasks.rados.rados.2.smithi057.stdout:3018: writing smithi05720651-6 from 1510168 to 2208838 tid 2 2020-11-16T22:13:19.231 INFO:tasks.rados.rados.2.smithi057.stdout:3018: writing smithi05720651-6 from 2732343 to 2891035 tid 3 2020-11-16T22:13:19.231 INFO:tasks.rados.rados.2.smithi057.stdout:3019: delete oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 351 2020-11-16T22:13:19.231 INFO:tasks.rados.rados.2.smithi057.stdout:3018: finishing write tid 1 to smithi05720651-6 2020-11-16T22:13:19.238 INFO:tasks.rados.rados.2.smithi057.stdout:3019: done (1 left) 2020-11-16T22:13:19.238 INFO:tasks.rados.rados.2.smithi057.stdout:3020: copy_from oid 22 from oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 351 2020-11-16T22:13:19.238 INFO:tasks.rados.rados.2.smithi057.stdout:3021: write (excl) oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 351 2020-11-16T22:13:19.238 INFO:tasks.rados.rados.2.smithi057.stdout:3021: seq_num 1007 ranges {524649=734339,1910779=702339} 2020-11-16T22:13:19.251 INFO:tasks.rados.rados.2.smithi057.stdout:3021: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 524649 to 1258988 tid 1 2020-11-16T22:13:19.259 INFO:tasks.rados.rados.2.smithi057.stdout:3021: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1910779 to 2613118 tid 2 2020-11-16T22:13:19.259 INFO:tasks.rados.rados.2.smithi057.stdout:3022: snap_remove snap 334 2020-11-16T22:13:19.590 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:19 smithi016 bash[10302]: cluster 2020-11-16T22:13:17.809921+0000 mgr.x (mgr.24115) 620 : cluster [DBG] pgmap v1318: 17 pgs: 17 active+clean; 191 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 4.5 MiB/s wr, 28 op/s 2020-11-16T22:13:19.590 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:19 smithi016 bash[10302]: cluster 2020-11-16T22:13:18.214356+0000 mon.a (mon.0) 1441 : cluster [DBG] osdmap e769: 12 total, 12 up, 12 in 2020-11-16T22:13:19.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:19 smithi195 bash[10218]: cluster 2020-11-16T22:13:17.809921+0000 mgr.x (mgr.24115) 620 : cluster [DBG] pgmap v1318: 17 pgs: 17 active+clean; 191 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 4.5 MiB/s wr, 28 op/s 2020-11-16T22:13:19.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:19 smithi195 bash[10218]: cluster 2020-11-16T22:13:18.214356+0000 mon.a (mon.0) 1441 : cluster [DBG] osdmap e769: 12 total, 12 up, 12 in 2020-11-16T22:13:19.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:19 smithi057 bash[10301]: cluster 2020-11-16T22:13:17.809921+0000 mgr.x (mgr.24115) 620 : cluster [DBG] pgmap v1318: 17 pgs: 17 active+clean; 191 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 4.5 MiB/s wr, 28 op/s 2020-11-16T22:13:19.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:19 smithi057 bash[10301]: cluster 2020-11-16T22:13:18.214356+0000 mon.a (mon.0) 1441 : cluster [DBG] osdmap e769: 12 total, 12 up, 12 in 2020-11-16T22:13:20.128 INFO:tasks.rados.rados.2.smithi057.stdout:3022: done (3 left) 2020-11-16T22:13:20.128 INFO:tasks.rados.rados.2.smithi057.stdout:3023: read oid 18 snap -1 2020-11-16T22:13:20.128 INFO:tasks.rados.rados.2.smithi057.stdout:3023: expect (ObjNum 998 snap 348 seq_num 998) 2020-11-16T22:13:20.128 INFO:tasks.rados.rados.2.smithi057.stdout:3024: read oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:20.128 INFO:tasks.rados.rados.2.smithi057.stdout:3024: expect (ObjNum 981 snap 341 seq_num 981) 2020-11-16T22:13:20.129 INFO:tasks.rados.rados.2.smithi057.stdout:3025: snap_create 2020-11-16T22:13:20.129 INFO:tasks.rados.rados.2.smithi057.stdout:3018: finishing write tid 2 to smithi05720651-6 2020-11-16T22:13:20.129 INFO:tasks.rados.rados.2.smithi057.stdout:3018: finishing write tid 3 to smithi05720651-6 2020-11-16T22:13:20.129 INFO:tasks.rados.rados.2.smithi057.stdout:3018: finishing write tid 5 to smithi05720651-6 2020-11-16T22:13:20.129 INFO:tasks.rados.rados.2.smithi057.stdout:3018: finishing write tid 6 to smithi05720651-6 2020-11-16T22:13:20.129 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 2187 (ObjNum 1005 snap 351 seq_num 1005) dirty exists 2020-11-16T22:13:20.129 INFO:tasks.rados.rados.2.smithi057.stdout:3018: left oid 6 (ObjNum 1005 snap 351 seq_num 1005) 2020-11-16T22:13:20.130 INFO:tasks.rados.rados.2.smithi057.stdout:3020: finishing copy_from to smithi05720651-22 2020-11-16T22:13:20.130 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 2180 (ObjNum 958 snap 329 seq_num 958) dirty exists 2020-11-16T22:13:20.130 INFO:tasks.rados.rados.2.smithi057.stdout:3020: finishing copy_from racing read to smithi05720651-22 2020-11-16T22:13:20.130 INFO:tasks.rados.rados.2.smithi057.stdout:3021: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:20.130 INFO:tasks.rados.rados.2.smithi057.stdout:3021: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:20.130 INFO:tasks.rados.rados.2.smithi057.stdout:3021: finishing write tid 4 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:20.130 INFO:tasks.rados.rados.2.smithi057.stdout:3021: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:20.131 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2190 (ObjNum 1007 snap 351 seq_num 1007) dirty exists 2020-11-16T22:13:20.131 INFO:tasks.rados.rados.2.smithi057.stdout:3021: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1007 snap 351 seq_num 1007) 2020-11-16T22:13:20.139 INFO:tasks.rados.rados.2.smithi057.stdout:3024: expect (ObjNum 981 snap 341 seq_num 981) 2020-11-16T22:13:20.261 INFO:tasks.rados.rados.2.smithi057.stdout:3023: expect (ObjNum 998 snap 348 seq_num 998) 2020-11-16T22:13:20.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:20 smithi016 bash[10302]: cluster 2020-11-16T22:13:19.216892+0000 mon.a (mon.0) 1442 : cluster [DBG] osdmap e770: 12 total, 12 up, 12 in 2020-11-16T22:13:20.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:20 smithi016 bash[10302]: cluster 2020-11-16T22:13:20.136632+0000 mon.a (mon.0) 1443 : cluster [DBG] osdmap e771: 12 total, 12 up, 12 in 2020-11-16T22:13:20.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:20 smithi195 bash[10218]: cluster 2020-11-16T22:13:19.216892+0000 mon.a (mon.0) 1442 : cluster [DBG] osdmap e770: 12 total, 12 up, 12 in 2020-11-16T22:13:20.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:20 smithi195 bash[10218]: cluster 2020-11-16T22:13:20.136632+0000 mon.a (mon.0) 1443 : cluster [DBG] osdmap e771: 12 total, 12 up, 12 in 2020-11-16T22:13:20.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:20 smithi057 bash[10301]: cluster 2020-11-16T22:13:19.216892+0000 mon.a (mon.0) 1442 : cluster [DBG] osdmap e770: 12 total, 12 up, 12 in 2020-11-16T22:13:20.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:20 smithi057 bash[10301]: cluster 2020-11-16T22:13:20.136632+0000 mon.a (mon.0) 1443 : cluster [DBG] osdmap e771: 12 total, 12 up, 12 in 2020-11-16T22:13:21.139 INFO:tasks.rados.rados.2.smithi057.stdout:3018: done (5 left) 2020-11-16T22:13:21.139 INFO:tasks.rados.rados.2.smithi057.stdout:3020: done (4 left) 2020-11-16T22:13:21.139 INFO:tasks.rados.rados.2.smithi057.stdout:3021: done (3 left) 2020-11-16T22:13:21.139 INFO:tasks.rados.rados.2.smithi057.stdout:3023: done (2 left) 2020-11-16T22:13:21.140 INFO:tasks.rados.rados.2.smithi057.stdout:3024: done (1 left) 2020-11-16T22:13:21.140 INFO:tasks.rados.rados.2.smithi057.stdout:3025: done (0 left) 2020-11-16T22:13:21.140 INFO:tasks.rados.rados.2.smithi057.stdout:3026: copy_from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 38 current snap is 352 2020-11-16T22:13:21.140 INFO:tasks.rados.rados.2.smithi057.stdout:3027: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:21.140 INFO:tasks.rados.rados.2.smithi057.stdout:3027: expect (ObjNum 926 snap 314 seq_num 926) 2020-11-16T22:13:21.140 INFO:tasks.rados.rados.2.smithi057.stdout:3028: snap_create 2020-11-16T22:13:21.146 INFO:tasks.rados.rados.2.smithi057.stdout:3027: expect (ObjNum 926 snap 314 seq_num 926) 2020-11-16T22:13:21.411 INFO:tasks.rados.rados.2.smithi057.stdout:3026: finishing copy_from to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:21.411 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1795 (ObjNum 941 snap 324 seq_num 941) dirty exists 2020-11-16T22:13:21.412 INFO:tasks.rados.rados.2.smithi057.stdout:3026: finishing copy_from racing read to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:21.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:21 smithi016 bash[10302]: cluster 2020-11-16T22:13:19.810588+0000 mgr.x (mgr.24115) 621 : cluster [DBG] pgmap v1321: 17 pgs: 17 active+clean; 197 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 4.9 MiB/s wr, 23 op/s 2020-11-16T22:13:21.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:21 smithi016 bash[10302]: cluster 2020-11-16T22:13:21.146327+0000 mon.a (mon.0) 1444 : cluster [DBG] osdmap e772: 12 total, 12 up, 12 in 2020-11-16T22:13:21.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:21 smithi195 bash[10218]: cluster 2020-11-16T22:13:19.810588+0000 mgr.x (mgr.24115) 621 : cluster [DBG] pgmap v1321: 17 pgs: 17 active+clean; 197 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 4.9 MiB/s wr, 23 op/s 2020-11-16T22:13:21.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:21 smithi195 bash[10218]: cluster 2020-11-16T22:13:21.146327+0000 mon.a (mon.0) 1444 : cluster [DBG] osdmap e772: 12 total, 12 up, 12 in 2020-11-16T22:13:21.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:21 smithi057 bash[10301]: cluster 2020-11-16T22:13:19.810588+0000 mgr.x (mgr.24115) 621 : cluster [DBG] pgmap v1321: 17 pgs: 17 active+clean; 197 MiB data, 750 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 4.9 MiB/s wr, 23 op/s 2020-11-16T22:13:21.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:21 smithi057 bash[10301]: cluster 2020-11-16T22:13:21.146327+0000 mon.a (mon.0) 1444 : cluster [DBG] osdmap e772: 12 total, 12 up, 12 in 2020-11-16T22:13:22.139 INFO:tasks.rados.rados.2.smithi057.stdout:3026: done (2 left) 2020-11-16T22:13:22.140 INFO:tasks.rados.rados.2.smithi057.stdout:3027: done (1 left) 2020-11-16T22:13:22.140 INFO:tasks.rados.rados.2.smithi057.stdout:3028: done (0 left) 2020-11-16T22:13:22.140 INFO:tasks.rados.rados.2.smithi057.stdout:3029: write (excl) oid 8 current snap is 353 2020-11-16T22:13:22.140 INFO:tasks.rados.rados.2.smithi057.stdout:3029: seq_num 1008 ranges {541456=409588,1569261=562350,2814612=126844} 2020-11-16T22:13:22.152 INFO:tasks.rados.rados.2.smithi057.stdout:3029: writing smithi05720651-8 from 541456 to 951044 tid 1 2020-11-16T22:13:22.160 INFO:tasks.rados.rados.2.smithi057.stdout:3029: writing smithi05720651-8 from 1569261 to 2131611 tid 2 2020-11-16T22:13:22.164 INFO:tasks.rados.rados.2.smithi057.stdout:3029: writing smithi05720651-8 from 2814612 to 2941456 tid 3 2020-11-16T22:13:22.165 INFO:tasks.rados.rados.2.smithi057.stdout:3030: write (excl) oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 353 2020-11-16T22:13:22.165 INFO:tasks.rados.rados.2.smithi057.stdout:3030: seq_num 1009 ranges {558263=484837,1627743=706008} 2020-11-16T22:13:22.171 INFO:tasks.rados.rados.2.smithi057.stdout:3030: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 558263 to 1043100 tid 1 2020-11-16T22:13:22.179 INFO:tasks.rados.rados.2.smithi057.stdout:3030: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1627743 to 2333751 tid 2 2020-11-16T22:13:22.179 INFO:tasks.rados.rados.2.smithi057.stdout:3031: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:22.179 INFO:tasks.rados.rados.2.smithi057.stdout:3031: expect (ObjNum 969 snap 336 seq_num 969) 2020-11-16T22:13:22.179 INFO:tasks.rados.rados.2.smithi057.stdout:3032: snap_remove snap 349 2020-11-16T22:13:23.148 INFO:tasks.rados.rados.2.smithi057.stdout:3032: done (3 left) 2020-11-16T22:13:23.149 INFO:tasks.rados.rados.2.smithi057.stdout:3033: write oid 42 current snap is 353 2020-11-16T22:13:23.149 INFO:tasks.rados.rados.2.smithi057.stdout:3033: seq_num 1010 ranges {575070=560086,1686225=566019,2869458=105612} 2020-11-16T22:13:23.159 INFO:tasks.rados.rados.2.smithi057.stdout:3033: writing smithi05720651-42 from 575070 to 1135156 tid 1 2020-11-16T22:13:23.165 INFO:tasks.rados.rados.2.smithi057.stdout:3033: writing smithi05720651-42 from 1686225 to 2252244 tid 2 2020-11-16T22:13:23.169 INFO:tasks.rados.rados.2.smithi057.stdout:3033: writing smithi05720651-42 from 2869458 to 2975070 tid 3 2020-11-16T22:13:23.169 INFO:tasks.rados.rados.2.smithi057.stdout:3034: snap_remove snap 329 2020-11-16T22:13:23.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:23 smithi057 bash[10301]: cluster 2020-11-16T22:13:21.811302+0000 mgr.x (mgr.24115) 622 : cluster [DBG] pgmap v1324: 17 pgs: 17 active+clean; 207 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 5.0 MiB/s wr, 17 op/s 2020-11-16T22:13:23.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:23 smithi057 bash[10301]: cluster 2020-11-16T22:13:22.149159+0000 mon.a (mon.0) 1445 : cluster [DBG] osdmap e773: 12 total, 12 up, 12 in 2020-11-16T22:13:23.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:23 smithi016 bash[10302]: cluster 2020-11-16T22:13:21.811302+0000 mgr.x (mgr.24115) 622 : cluster [DBG] pgmap v1324: 17 pgs: 17 active+clean; 207 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 5.0 MiB/s wr, 17 op/s 2020-11-16T22:13:23.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:23 smithi016 bash[10302]: cluster 2020-11-16T22:13:22.149159+0000 mon.a (mon.0) 1445 : cluster [DBG] osdmap e773: 12 total, 12 up, 12 in 2020-11-16T22:13:23.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:23 smithi195 bash[10218]: cluster 2020-11-16T22:13:21.811302+0000 mgr.x (mgr.24115) 622 : cluster [DBG] pgmap v1324: 17 pgs: 17 active+clean; 207 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 5.0 MiB/s wr, 17 op/s 2020-11-16T22:13:23.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:23 smithi195 bash[10218]: cluster 2020-11-16T22:13:22.149159+0000 mon.a (mon.0) 1445 : cluster [DBG] osdmap e773: 12 total, 12 up, 12 in 2020-11-16T22:13:24.160 INFO:tasks.rados.rados.2.smithi057.stdout:3034: done (4 left) 2020-11-16T22:13:24.160 INFO:tasks.rados.rados.2.smithi057.stdout:3035: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 344 2020-11-16T22:13:24.161 INFO:tasks.rados.rados.2.smithi057.stdout:3035: expect (ObjNum 916 snap 313 seq_num 916) 2020-11-16T22:13:24.161 INFO:tasks.rados.rados.2.smithi057.stdout:3036: delete oid 28 current snap is 353 2020-11-16T22:13:24.161 INFO:tasks.rados.rados.2.smithi057.stdout:3029: finishing write tid 1 to smithi05720651-8 2020-11-16T22:13:24.161 INFO:tasks.rados.rados.2.smithi057.stdout:3029: finishing write tid 2 to smithi05720651-8 2020-11-16T22:13:24.161 INFO:tasks.rados.rados.2.smithi057.stdout:3029: finishing write tid 3 to smithi05720651-8 2020-11-16T22:13:24.161 INFO:tasks.rados.rados.2.smithi057.stdout:3029: finishing write tid 5 to smithi05720651-8 2020-11-16T22:13:24.161 INFO:tasks.rados.rados.2.smithi057.stdout:3029: finishing write tid 6 to smithi05720651-8 2020-11-16T22:13:24.162 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 1775 (ObjNum 1008 snap 353 seq_num 1008) dirty exists 2020-11-16T22:13:24.162 INFO:tasks.rados.rados.2.smithi057.stdout:3029: left oid 8 (ObjNum 1008 snap 353 seq_num 1008) 2020-11-16T22:13:24.162 INFO:tasks.rados.rados.2.smithi057.stdout:3030: finishing write tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:24.162 INFO:tasks.rados.rados.2.smithi057.stdout:3031: expect (ObjNum 969 snap 336 seq_num 969) 2020-11-16T22:13:24.293 INFO:tasks.rados.rados.2.smithi057.stdout:3030: finishing write tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:24.293 INFO:tasks.rados.rados.2.smithi057.stdout:3030: finishing write tid 4 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:24.293 INFO:tasks.rados.rados.2.smithi057.stdout:3030: finishing write tid 5 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:24.293 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2208 (ObjNum 1009 snap 353 seq_num 1009) dirty exists 2020-11-16T22:13:24.293 INFO:tasks.rados.rados.2.smithi057.stdout:3030: left oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1009 snap 353 seq_num 1009) 2020-11-16T22:13:24.294 INFO:tasks.rados.rados.2.smithi057.stdout:3033: finishing write tid 1 to smithi05720651-42 2020-11-16T22:13:24.294 INFO:tasks.rados.rados.2.smithi057.stdout:3033: finishing write tid 2 to smithi05720651-42 2020-11-16T22:13:24.294 INFO:tasks.rados.rados.2.smithi057.stdout:3033: finishing write tid 3 to smithi05720651-42 2020-11-16T22:13:24.294 INFO:tasks.rados.rados.2.smithi057.stdout:3033: finishing write tid 5 to smithi05720651-42 2020-11-16T22:13:24.294 INFO:tasks.rados.rados.2.smithi057.stdout:3033: finishing write tid 6 to smithi05720651-42 2020-11-16T22:13:24.294 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 2196 (ObjNum 1010 snap 353 seq_num 1010) dirty exists 2020-11-16T22:13:24.294 INFO:tasks.rados.rados.2.smithi057.stdout:3033: left oid 42 (ObjNum 1010 snap 353 seq_num 1010) 2020-11-16T22:13:24.295 INFO:tasks.rados.rados.2.smithi057.stdout:3029: done (5 left) 2020-11-16T22:13:24.295 INFO:tasks.rados.rados.2.smithi057.stdout:3030: done (4 left) 2020-11-16T22:13:24.295 INFO:tasks.rados.rados.2.smithi057.stdout:3031: done (3 left) 2020-11-16T22:13:24.295 INFO:tasks.rados.rados.2.smithi057.stdout:3033: done (2 left) 2020-11-16T22:13:24.295 INFO:tasks.rados.rados.2.smithi057.stdout:3036: done (1 left) 2020-11-16T22:13:24.295 INFO:tasks.rados.rados.2.smithi057.stdout:3037: read oid 16 snap -1 2020-11-16T22:13:24.295 INFO:tasks.rados.rados.2.smithi057.stdout:3037: expect (ObjNum 878 snap 296 seq_num 878) 2020-11-16T22:13:24.296 INFO:tasks.rados.rados.2.smithi057.stdout:3038: snap_remove snap 345 2020-11-16T22:13:24.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:24 smithi057 bash[10301]: cluster 2020-11-16T22:13:23.159061+0000 mon.a (mon.0) 1446 : cluster [DBG] osdmap e774: 12 total, 12 up, 12 in 2020-11-16T22:13:24.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:24 smithi016 bash[10302]: cluster 2020-11-16T22:13:23.159061+0000 mon.a (mon.0) 1446 : cluster [DBG] osdmap e774: 12 total, 12 up, 12 in 2020-11-16T22:13:24.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:24 smithi195 bash[10218]: cluster 2020-11-16T22:13:23.159061+0000 mon.a (mon.0) 1446 : cluster [DBG] osdmap e774: 12 total, 12 up, 12 in 2020-11-16T22:13:25.129 INFO:tasks.rados.rados.2.smithi057.stdout:3038: done (2 left) 2020-11-16T22:13:25.129 INFO:tasks.rados.rados.2.smithi057.stdout:3039: read oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 350 2020-11-16T22:13:25.129 INFO:tasks.rados.rados.2.smithi057.stdout:3039: expect (ObjNum 899 snap 303 seq_num 899) 2020-11-16T22:13:25.130 INFO:tasks.rados.rados.2.smithi057.stdout:3040: rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 353 2020-11-16T22:13:25.130 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 333 2020-11-16T22:13:25.130 INFO:tasks.rados.rados.2.smithi057.stdout:3041: rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 353 2020-11-16T22:13:25.130 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 343 2020-11-16T22:13:25.130 INFO:tasks.rados.rados.2.smithi057.stdout:3042: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:25.130 INFO:tasks.rados.rados.2.smithi057.stdout:3042: expect deleted 2020-11-16T22:13:25.131 INFO:tasks.rados.rados.2.smithi057.stdout:3043: snap_remove snap 348 2020-11-16T22:13:25.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:25 smithi057 bash[10301]: cluster 2020-11-16T22:13:23.811969+0000 mgr.x (mgr.24115) 623 : cluster [DBG] pgmap v1327: 17 pgs: 17 active+clean; 207 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 3.7 MiB/s wr, 11 op/s 2020-11-16T22:13:25.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:25 smithi057 bash[10301]: cluster 2020-11-16T22:13:24.169878+0000 mon.a (mon.0) 1447 : cluster [DBG] osdmap e775: 12 total, 12 up, 12 in 2020-11-16T22:13:25.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:25 smithi057 bash[10301]: cluster 2020-11-16T22:13:25.138145+0000 mon.a (mon.0) 1448 : cluster [DBG] osdmap e776: 12 total, 12 up, 12 in 2020-11-16T22:13:25.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:25 smithi016 bash[10302]: cluster 2020-11-16T22:13:23.811969+0000 mgr.x (mgr.24115) 623 : cluster [DBG] pgmap v1327: 17 pgs: 17 active+clean; 207 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 3.7 MiB/s wr, 11 op/s 2020-11-16T22:13:25.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:25 smithi016 bash[10302]: cluster 2020-11-16T22:13:24.169878+0000 mon.a (mon.0) 1447 : cluster [DBG] osdmap e775: 12 total, 12 up, 12 in 2020-11-16T22:13:25.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:25 smithi016 bash[10302]: cluster 2020-11-16T22:13:25.138145+0000 mon.a (mon.0) 1448 : cluster [DBG] osdmap e776: 12 total, 12 up, 12 in 2020-11-16T22:13:25.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:25 smithi195 bash[10218]: cluster 2020-11-16T22:13:23.811969+0000 mgr.x (mgr.24115) 623 : cluster [DBG] pgmap v1327: 17 pgs: 17 active+clean; 207 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 3.7 MiB/s wr, 11 op/s 2020-11-16T22:13:25.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:25 smithi195 bash[10218]: cluster 2020-11-16T22:13:24.169878+0000 mon.a (mon.0) 1447 : cluster [DBG] osdmap e775: 12 total, 12 up, 12 in 2020-11-16T22:13:25.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:25 smithi195 bash[10218]: cluster 2020-11-16T22:13:25.138145+0000 mon.a (mon.0) 1448 : cluster [DBG] osdmap e776: 12 total, 12 up, 12 in 2020-11-16T22:13:26.143 INFO:tasks.rados.rados.2.smithi057.stdout:3043: done (6 left) 2020-11-16T22:13:26.143 INFO:tasks.rados.rados.2.smithi057.stdout:3044: read oid 10 snap 344 2020-11-16T22:13:26.143 INFO:tasks.rados.rados.2.smithi057.stdout:3044: expect (ObjNum 967 snap 333 seq_num 967) 2020-11-16T22:13:26.143 INFO:tasks.rados.rados.2.smithi057.stdout:3045: copy_from oid 28 from oid 24 current snap is 353 2020-11-16T22:13:26.144 INFO:tasks.rados.rados.2.smithi057.stdout:3035: expect (ObjNum 916 snap 313 seq_num 916) 2020-11-16T22:13:26.386 INFO:tasks.rados.rados.2.smithi057.stdout:3037: expect (ObjNum 878 snap 296 seq_num 878) 2020-11-16T22:13:26.566 INFO:tasks.rados.rados.2.smithi057.stdout:3040: finishing rollback tid 0 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:26.566 INFO:tasks.rados.rados.2.smithi057.stdout:3040: finishing rollback tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:26.566 INFO:tasks.rados.rados.2.smithi057.stdout:3040: finishing rollback tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:26.567 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1778 (ObjNum 938 snap 323 seq_num 938) dirty exists 2020-11-16T22:13:26.567 INFO:tasks.rados.rados.2.smithi057.stdout:3041: finishing rollback tid 0 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:26.567 INFO:tasks.rados.rados.2.smithi057.stdout:3041: finishing rollback tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:26.567 INFO:tasks.rados.rados.2.smithi057.stdout:3039: expect (ObjNum 899 snap 303 seq_num 899) 2020-11-16T22:13:26.880 INFO:tasks.rados.rados.2.smithi057.stdout:3041: finishing rollback tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:26.880 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2198 (ObjNum 965 snap 333 seq_num 965) dirty exists 2020-11-16T22:13:26.880 INFO:tasks.rados.rados.2.smithi057.stdout:3044: expect (ObjNum 967 snap 333 seq_num 967) 2020-11-16T22:13:27.069 INFO:tasks.rados.rados.2.smithi057.stdout:3045: finishing copy_from to smithi05720651-28 2020-11-16T22:13:27.069 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 1768 (ObjNum 820 snap 281 seq_num 820) dirty exists 2020-11-16T22:13:27.070 INFO:tasks.rados.rados.2.smithi057.stdout:3045: finishing copy_from racing read to smithi05720651-28 2020-11-16T22:13:27.070 INFO:tasks.rados.rados.2.smithi057.stdout:3035: done (7 left) 2020-11-16T22:13:27.070 INFO:tasks.rados.rados.2.smithi057.stdout:3037: done (6 left) 2020-11-16T22:13:27.070 INFO:tasks.rados.rados.2.smithi057.stdout:3039: done (5 left) 2020-11-16T22:13:27.070 INFO:tasks.rados.rados.2.smithi057.stdout:3040: done (4 left) 2020-11-16T22:13:27.070 INFO:tasks.rados.rados.2.smithi057.stdout:3041: done (3 left) 2020-11-16T22:13:27.071 INFO:tasks.rados.rados.2.smithi057.stdout:3042: done (2 left) 2020-11-16T22:13:27.071 INFO:tasks.rados.rados.2.smithi057.stdout:3044: done (1 left) 2020-11-16T22:13:27.071 INFO:tasks.rados.rados.2.smithi057.stdout:3045: done (0 left) 2020-11-16T22:13:27.071 INFO:tasks.rados.rados.2.smithi057.stdout:3046: snap_create 2020-11-16T22:13:27.165 INFO:tasks.rados.rados.2.smithi057.stdout:3046: done (0 left) 2020-11-16T22:13:27.166 INFO:tasks.rados.rados.2.smithi057.stdout:3047: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:27.166 INFO:tasks.rados.rados.2.smithi057.stdout:3047: expect (ObjNum 916 snap 313 seq_num 916) 2020-11-16T22:13:27.166 INFO:tasks.rados.rados.2.smithi057.stdout:3048: snap_create 2020-11-16T22:13:27.179 INFO:tasks.rados.rados.2.smithi057.stdout:3047: expect (ObjNum 916 snap 313 seq_num 916) 2020-11-16T22:13:27.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:27 smithi057 bash[10301]: cluster 2020-11-16T22:13:25.812669+0000 mgr.x (mgr.24115) 624 : cluster [DBG] pgmap v1330: 17 pgs: 17 active+clean; 203 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 559 KiB/s wr, 11 op/s 2020-11-16T22:13:27.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:27 smithi057 bash[10301]: cluster 2020-11-16T22:13:26.152153+0000 mon.a (mon.0) 1449 : cluster [DBG] osdmap e777: 12 total, 12 up, 12 in 2020-11-16T22:13:27.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:27 smithi016 bash[10302]: cluster 2020-11-16T22:13:25.812669+0000 mgr.x (mgr.24115) 624 : cluster [DBG] pgmap v1330: 17 pgs: 17 active+clean; 203 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 559 KiB/s wr, 11 op/s 2020-11-16T22:13:27.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:27 smithi016 bash[10302]: cluster 2020-11-16T22:13:26.152153+0000 mon.a (mon.0) 1449 : cluster [DBG] osdmap e777: 12 total, 12 up, 12 in 2020-11-16T22:13:27.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:27 smithi195 bash[10218]: cluster 2020-11-16T22:13:25.812669+0000 mgr.x (mgr.24115) 624 : cluster [DBG] pgmap v1330: 17 pgs: 17 active+clean; 203 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 559 KiB/s wr, 11 op/s 2020-11-16T22:13:27.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:27 smithi195 bash[10218]: cluster 2020-11-16T22:13:26.152153+0000 mon.a (mon.0) 1449 : cluster [DBG] osdmap e777: 12 total, 12 up, 12 in 2020-11-16T22:13:28.176 INFO:tasks.rados.rados.2.smithi057.stdout:3047: done (1 left) 2020-11-16T22:13:28.176 INFO:tasks.rados.rados.2.smithi057.stdout:3048: done (0 left) 2020-11-16T22:13:28.176 INFO:tasks.rados.rados.2.smithi057.stdout:3049: write oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 355 2020-11-16T22:13:28.176 INFO:tasks.rados.rados.2.smithi057.stdout:3049: seq_num 1012 ranges {608684=426937,1803189=569688,2924304=84380} 2020-11-16T22:13:28.188 INFO:tasks.rados.rados.2.smithi057.stdout:3049: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 608684 to 1035621 tid 1 2020-11-16T22:13:28.197 INFO:tasks.rados.rados.2.smithi057.stdout:3049: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1803189 to 2372877 tid 2 2020-11-16T22:13:28.201 INFO:tasks.rados.rados.2.smithi057.stdout:3049: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2924304 to 3008684 tid 3 2020-11-16T22:13:28.201 INFO:tasks.rados.rados.2.smithi057.stdout:3050: rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 355 2020-11-16T22:13:28.201 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 343 2020-11-16T22:13:28.201 INFO:tasks.rados.rados.2.smithi057.stdout:3049: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:28.201 INFO:tasks.rados.rados.2.smithi057.stdout:3051: write (excl) oid 32 current snap is 355 2020-11-16T22:13:28.202 INFO:tasks.rados.rados.2.smithi057.stdout:3051: seq_num 1013 ranges {625491=502186,1861671=713346} 2020-11-16T22:13:28.207 INFO:tasks.rados.rados.2.smithi057.stdout:3051: writing smithi05720651-32 from 625491 to 1127677 tid 1 2020-11-16T22:13:28.216 INFO:tasks.rados.rados.2.smithi057.stdout:3051: writing smithi05720651-32 from 1861671 to 2575017 tid 2 2020-11-16T22:13:28.216 INFO:tasks.rados.rados.2.smithi057.stdout:3052: read oid 12 snap -1 2020-11-16T22:13:28.217 INFO:tasks.rados.rados.2.smithi057.stdout:3052: expect (ObjNum 962 snap 331 seq_num 962) 2020-11-16T22:13:28.217 INFO:tasks.rados.rados.2.smithi057.stdout:3053: copy_from oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 48 current snap is 355 2020-11-16T22:13:28.217 INFO:tasks.rados.rados.2.smithi057.stdout:3049: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:28.217 INFO:tasks.rados.rados.2.smithi057.stdout:3049: finishing write tid 3 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:28.217 INFO:tasks.rados.rados.2.smithi057.stdout:3049: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:28.217 INFO:tasks.rados.rados.2.smithi057.stdout:3054: snap_create 2020-11-16T22:13:28.217 INFO:tasks.rados.rados.2.smithi057.stdout:3049: finishing write tid 6 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:28.218 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2193 (ObjNum 1012 snap 355 seq_num 1012) dirty exists 2020-11-16T22:13:28.218 INFO:tasks.rados.rados.2.smithi057.stdout:3049: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1012 snap 355 seq_num 1012) 2020-11-16T22:13:28.218 INFO:tasks.rados.rados.2.smithi057.stdout:3050: finishing rollback tid 0 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:28.218 INFO:tasks.rados.rados.2.smithi057.stdout:3050: finishing rollback tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:28.218 INFO:tasks.rados.rados.2.smithi057.stdout:3050: finishing rollback tid 2 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:28.218 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1778 (ObjNum 968 snap 333 seq_num 968) dirty exists 2020-11-16T22:13:28.219 INFO:tasks.rados.rados.2.smithi057.stdout:3051: finishing write tid 1 to smithi05720651-32 2020-11-16T22:13:28.219 INFO:tasks.rados.rados.2.smithi057.stdout:3052: expect (ObjNum 962 snap 331 seq_num 962) 2020-11-16T22:13:28.404 INFO:tasks.rados.rados.2.smithi057.stdout:3051: finishing write tid 2 to smithi05720651-32 2020-11-16T22:13:28.404 INFO:tasks.rados.rados.2.smithi057.stdout:3051: finishing write tid 4 to smithi05720651-32 2020-11-16T22:13:28.405 INFO:tasks.rados.rados.2.smithi057.stdout:3051: finishing write tid 5 to smithi05720651-32 2020-11-16T22:13:28.405 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 2478 (ObjNum 1013 snap 355 seq_num 1013) dirty exists 2020-11-16T22:13:28.405 INFO:tasks.rados.rados.2.smithi057.stdout:3051: left oid 32 (ObjNum 1013 snap 355 seq_num 1013) 2020-11-16T22:13:28.405 INFO:tasks.rados.rados.2.smithi057.stdout:3053: finishing copy_from to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:28.405 INFO:tasks.rados.rados.2.smithi057.stdout:3053: got expected ENOENT (src dne) 2020-11-16T22:13:28.405 INFO:tasks.rados.rados.2.smithi057.stdout:3053: finishing copy_from racing read to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:28.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:28 smithi057 bash[10301]: cluster 2020-11-16T22:13:27.175181+0000 mon.a (mon.0) 1450 : cluster [DBG] osdmap e778: 12 total, 12 up, 12 in 2020-11-16T22:13:28.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:28 smithi016 bash[10302]: cluster 2020-11-16T22:13:27.175181+0000 mon.a (mon.0) 1450 : cluster [DBG] osdmap e778: 12 total, 12 up, 12 in 2020-11-16T22:13:28.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:28 smithi195 bash[10218]: cluster 2020-11-16T22:13:27.175181+0000 mon.a (mon.0) 1450 : cluster [DBG] osdmap e778: 12 total, 12 up, 12 in 2020-11-16T22:13:29.185 INFO:tasks.rados.rados.2.smithi057.stdout:3049: done (5 left) 2020-11-16T22:13:29.186 INFO:tasks.rados.rados.2.smithi057.stdout:3050: done (4 left) 2020-11-16T22:13:29.186 INFO:tasks.rados.rados.2.smithi057.stdout:3051: done (3 left) 2020-11-16T22:13:29.186 INFO:tasks.rados.rados.2.smithi057.stdout:3052: done (2 left) 2020-11-16T22:13:29.186 INFO:tasks.rados.rados.2.smithi057.stdout:3053: done (1 left) 2020-11-16T22:13:29.186 INFO:tasks.rados.rados.2.smithi057.stdout:3054: done (0 left) 2020-11-16T22:13:29.186 INFO:tasks.rados.rados.2.smithi057.stdout:3055: write oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 356 2020-11-16T22:13:29.187 INFO:tasks.rados.rados.2.smithi057.stdout:3055: seq_num 1014 ranges {642298=577435,1920153=573357,2979150=63148} 2020-11-16T22:13:29.198 INFO:tasks.rados.rados.2.smithi057.stdout:3055: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 642298 to 1219733 tid 1 2020-11-16T22:13:29.206 INFO:tasks.rados.rados.2.smithi057.stdout:3055: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1920153 to 2493510 tid 2 2020-11-16T22:13:29.210 INFO:tasks.rados.rados.2.smithi057.stdout:3055: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2979150 to 3042298 tid 3 2020-11-16T22:13:29.210 INFO:tasks.rados.rados.2.smithi057.stdout:3056: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 344 2020-11-16T22:13:29.210 INFO:tasks.rados.rados.2.smithi057.stdout:3056: expect (ObjNum 960 snap 330 seq_num 960) 2020-11-16T22:13:29.210 INFO:tasks.rados.rados.2.smithi057.stdout:3057: read oid 20 snap -1 2020-11-16T22:13:29.210 INFO:tasks.rados.rados.2.smithi057.stdout:3057: expect (ObjNum 940 snap 324 seq_num 940) 2020-11-16T22:13:29.211 INFO:tasks.rados.rados.2.smithi057.stdout:3058: read oid 38 snap 354 2020-11-16T22:13:29.211 INFO:tasks.rados.rados.2.smithi057.stdout:3058: expect (ObjNum 941 snap 324 seq_num 941) 2020-11-16T22:13:29.211 INFO:tasks.rados.rados.2.smithi057.stdout:3059: copy_from oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 14 current snap is 356 2020-11-16T22:13:29.211 INFO:tasks.rados.rados.2.smithi057.stdout:3055: finishing write tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:29.211 INFO:tasks.rados.rados.2.smithi057.stdout:3060: snap_create 2020-11-16T22:13:29.217 INFO:tasks.rados.rados.2.smithi057.stdout:3055: finishing write tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:29.220 INFO:tasks.rados.rados.2.smithi057.stdout:3057: expect (ObjNum 940 snap 324 seq_num 940) 2020-11-16T22:13:29.435 INFO:tasks.rados.rados.2.smithi057.stdout:3055: finishing write tid 3 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:29.435 INFO:tasks.rados.rados.2.smithi057.stdout:3055: finishing write tid 5 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:29.436 INFO:tasks.rados.rados.2.smithi057.stdout:3055: finishing write tid 6 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:29.436 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2212 (ObjNum 1014 snap 356 seq_num 1014) dirty exists 2020-11-16T22:13:29.436 INFO:tasks.rados.rados.2.smithi057.stdout:3055: left oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1014 snap 356 seq_num 1014) 2020-11-16T22:13:29.436 INFO:tasks.rados.rados.2.smithi057.stdout:3056: expect (ObjNum 960 snap 330 seq_num 960) 2020-11-16T22:13:29.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:29 smithi057 bash[10301]: cluster 2020-11-16T22:13:27.813430+0000 mgr.x (mgr.24115) 625 : cluster [DBG] pgmap v1333: 17 pgs: 17 active+clean; 195 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 860 KiB/s wr, 15 op/s 2020-11-16T22:13:29.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:29 smithi057 bash[10301]: cluster 2020-11-16T22:13:28.185674+0000 mon.a (mon.0) 1451 : cluster [DBG] osdmap e779: 12 total, 12 up, 12 in 2020-11-16T22:13:29.536 INFO:tasks.rados.rados.2.smithi057.stdout:3058: expect (ObjNum 941 snap 324 seq_num 941) 2020-11-16T22:13:29.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:29 smithi016 bash[10302]: cluster 2020-11-16T22:13:27.813430+0000 mgr.x (mgr.24115) 625 : cluster [DBG] pgmap v1333: 17 pgs: 17 active+clean; 195 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 860 KiB/s wr, 15 op/s 2020-11-16T22:13:29.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:29 smithi016 bash[10302]: cluster 2020-11-16T22:13:28.185674+0000 mon.a (mon.0) 1451 : cluster [DBG] osdmap e779: 12 total, 12 up, 12 in 2020-11-16T22:13:29.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:29 smithi195 bash[10218]: cluster 2020-11-16T22:13:27.813430+0000 mgr.x (mgr.24115) 625 : cluster [DBG] pgmap v1333: 17 pgs: 17 active+clean; 195 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 860 KiB/s wr, 15 op/s 2020-11-16T22:13:29.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:29 smithi195 bash[10218]: cluster 2020-11-16T22:13:28.185674+0000 mon.a (mon.0) 1451 : cluster [DBG] osdmap e779: 12 total, 12 up, 12 in 2020-11-16T22:13:29.648 INFO:tasks.rados.rados.2.smithi057.stdout:3059: finishing copy_from to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:29.648 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2186 (ObjNum 969 snap 336 seq_num 969) dirty exists 2020-11-16T22:13:29.648 INFO:tasks.rados.rados.2.smithi057.stdout:3059: finishing copy_from racing read to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:30.130 INFO:tasks.rados.rados.2.smithi057.stdout:3055: done (5 left) 2020-11-16T22:13:30.131 INFO:tasks.rados.rados.2.smithi057.stdout:3056: done (4 left) 2020-11-16T22:13:30.131 INFO:tasks.rados.rados.2.smithi057.stdout:3057: done (3 left) 2020-11-16T22:13:30.131 INFO:tasks.rados.rados.2.smithi057.stdout:3058: done (2 left) 2020-11-16T22:13:30.131 INFO:tasks.rados.rados.2.smithi057.stdout:3059: done (1 left) 2020-11-16T22:13:30.131 INFO:tasks.rados.rados.2.smithi057.stdout:3060: done (0 left) 2020-11-16T22:13:30.131 INFO:tasks.rados.rados.2.smithi057.stdout:3061: snap_remove snap 356 2020-11-16T22:13:30.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:30 smithi057 bash[10301]: cluster 2020-11-16T22:13:29.194727+0000 mon.a (mon.0) 1452 : cluster [DBG] osdmap e780: 12 total, 12 up, 12 in 2020-11-16T22:13:30.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:30 smithi057 bash[10301]: audit 2020-11-16T22:13:29.793229+0000 mon.b (mon.1) 314 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:13:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:30 smithi057 bash[10301]: audit 2020-11-16T22:13:29.794495+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:13:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:30 smithi057 bash[10301]: audit 2020-11-16T22:13:29.794992+0000 mon.b (mon.1) 315 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:13:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:30 smithi057 bash[10301]: audit 2020-11-16T22:13:29.796190+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:13:30.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:30 smithi057 bash[10301]: cluster 2020-11-16T22:13:30.140664+0000 mon.a (mon.0) 1455 : cluster [DBG] osdmap e781: 12 total, 12 up, 12 in 2020-11-16T22:13:30.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:30 smithi016 bash[10302]: cluster 2020-11-16T22:13:29.194727+0000 mon.a (mon.0) 1452 : cluster [DBG] osdmap e780: 12 total, 12 up, 12 in 2020-11-16T22:13:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:30 smithi016 bash[10302]: audit 2020-11-16T22:13:29.793229+0000 mon.b (mon.1) 314 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:13:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:30 smithi016 bash[10302]: audit 2020-11-16T22:13:29.794495+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:13:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:30 smithi016 bash[10302]: audit 2020-11-16T22:13:29.794992+0000 mon.b (mon.1) 315 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:13:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:30 smithi016 bash[10302]: audit 2020-11-16T22:13:29.796190+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:13:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:30 smithi016 bash[10302]: cluster 2020-11-16T22:13:30.140664+0000 mon.a (mon.0) 1455 : cluster [DBG] osdmap e781: 12 total, 12 up, 12 in 2020-11-16T22:13:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:30 smithi195 bash[10218]: cluster 2020-11-16T22:13:29.194727+0000 mon.a (mon.0) 1452 : cluster [DBG] osdmap e780: 12 total, 12 up, 12 in 2020-11-16T22:13:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:30 smithi195 bash[10218]: audit 2020-11-16T22:13:29.793229+0000 mon.b (mon.1) 314 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:13:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:30 smithi195 bash[10218]: audit 2020-11-16T22:13:29.794495+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:13:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:30 smithi195 bash[10218]: audit 2020-11-16T22:13:29.794992+0000 mon.b (mon.1) 315 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:13:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:30 smithi195 bash[10218]: audit 2020-11-16T22:13:29.796190+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:13:30.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:30 smithi195 bash[10218]: cluster 2020-11-16T22:13:30.140664+0000 mon.a (mon.0) 1455 : cluster [DBG] osdmap e781: 12 total, 12 up, 12 in 2020-11-16T22:13:31.140 INFO:tasks.rados.rados.2.smithi057.stdout:3061: done (0 left) 2020-11-16T22:13:31.141 INFO:tasks.rados.rados.2.smithi057.stdout:3062: snap_remove snap 355 2020-11-16T22:13:31.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:31 smithi057 bash[10301]: cluster 2020-11-16T22:13:29.813974+0000 mgr.x (mgr.24115) 626 : cluster [DBG] pgmap v1336: 17 pgs: 17 active+clean; 197 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.2 MiB/s wr, 8 op/s 2020-11-16T22:13:31.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:31 smithi057 bash[10301]: cluster 2020-11-16T22:13:31.151337+0000 mon.a (mon.0) 1456 : cluster [DBG] osdmap e782: 12 total, 12 up, 12 in 2020-11-16T22:13:31.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:31 smithi016 bash[10302]: cluster 2020-11-16T22:13:29.813974+0000 mgr.x (mgr.24115) 626 : cluster [DBG] pgmap v1336: 17 pgs: 17 active+clean; 197 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.2 MiB/s wr, 8 op/s 2020-11-16T22:13:31.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:31 smithi016 bash[10302]: cluster 2020-11-16T22:13:31.151337+0000 mon.a (mon.0) 1456 : cluster [DBG] osdmap e782: 12 total, 12 up, 12 in 2020-11-16T22:13:31.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:31 smithi195 bash[10218]: cluster 2020-11-16T22:13:29.813974+0000 mgr.x (mgr.24115) 626 : cluster [DBG] pgmap v1336: 17 pgs: 17 active+clean; 197 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.2 MiB/s wr, 8 op/s 2020-11-16T22:13:31.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:31 smithi195 bash[10218]: cluster 2020-11-16T22:13:31.151337+0000 mon.a (mon.0) 1456 : cluster [DBG] osdmap e782: 12 total, 12 up, 12 in 2020-11-16T22:13:32.143 INFO:tasks.rados.rados.2.smithi057.stdout:3062: done (0 left) 2020-11-16T22:13:32.144 INFO:tasks.rados.rados.2.smithi057.stdout:3063: rollback oid 34 current snap is 357 2020-11-16T22:13:32.144 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 34 to 351 2020-11-16T22:13:32.144 INFO:tasks.rados.rados.2.smithi057.stdout:3064: snap_create 2020-11-16T22:13:32.154 INFO:tasks.rados.rados.2.smithi057.stdout:3063: finishing rollback tid 0 to smithi05720651-34 2020-11-16T22:13:32.154 INFO:tasks.rados.rados.2.smithi057.stdout:3063: finishing rollback tid 1 to smithi05720651-34 2020-11-16T22:13:32.155 INFO:tasks.rados.rados.2.smithi057.stdout:3063: finishing rollback tid 2 to smithi05720651-34 2020-11-16T22:13:32.155 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 2189 (ObjNum 949 snap 328 seq_num 949) dirty exists 2020-11-16T22:13:33.146 INFO:tasks.rados.rados.2.smithi057.stdout:3063: done (1 left) 2020-11-16T22:13:33.147 INFO:tasks.rados.rados.2.smithi057.stdout:3064: done (0 left) 2020-11-16T22:13:33.147 INFO:tasks.rados.rados.2.smithi057.stdout:3065: write (excl) oid 48 current snap is 358 2020-11-16T22:13:33.147 INFO:tasks.rados.rados.2.smithi057.stdout:3065: seq_num 1015 ranges {659105=652684,1862282=717015} 2020-11-16T22:13:33.161 INFO:tasks.rados.rados.2.smithi057.stdout:3065: writing smithi05720651-48 from 659105 to 1311789 tid 1 2020-11-16T22:13:33.169 INFO:tasks.rados.rados.2.smithi057.stdout:3065: writing smithi05720651-48 from 1862282 to 2579297 tid 2 2020-11-16T22:13:33.170 INFO:tasks.rados.rados.2.smithi057.stdout:3066: rollback oid 8 current snap is 358 2020-11-16T22:13:33.170 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 8 to 341 2020-11-16T22:13:33.170 INFO:tasks.rados.rados.2.smithi057.stdout:3067: read oid 32 snap -1 2020-11-16T22:13:33.170 INFO:tasks.rados.rados.2.smithi057.stdout:3067: expect (ObjNum 1013 snap 355 seq_num 1013) 2020-11-16T22:13:33.170 INFO:tasks.rados.rados.2.smithi057.stdout:3068: copy_from oid 24 from oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 358 2020-11-16T22:13:33.170 INFO:tasks.rados.rados.2.smithi057.stdout:3069: delete oid 40 current snap is 358 2020-11-16T22:13:33.171 INFO:tasks.rados.rados.2.smithi057.stdout:3065: finishing write tid 1 to smithi05720651-48 2020-11-16T22:13:33.176 INFO:tasks.rados.rados.2.smithi057.stdout:3065: finishing write tid 2 to smithi05720651-48 2020-11-16T22:13:33.176 INFO:tasks.rados.rados.2.smithi057.stdout:3065: finishing write tid 4 to smithi05720651-48 2020-11-16T22:13:33.177 INFO:tasks.rados.rados.2.smithi057.stdout:3065: finishing write tid 5 to smithi05720651-48 2020-11-16T22:13:33.177 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 1781 (ObjNum 1015 snap 358 seq_num 1015) dirty exists 2020-11-16T22:13:33.177 INFO:tasks.rados.rados.2.smithi057.stdout:3065: left oid 48 (ObjNum 1015 snap 358 seq_num 1015) 2020-11-16T22:13:33.181 INFO:tasks.rados.rados.2.smithi057.stdout:3066: finishing rollback tid 0 to smithi05720651-8 2020-11-16T22:13:33.181 INFO:tasks.rados.rados.2.smithi057.stdout:3066: finishing rollback tid 1 to smithi05720651-8 2020-11-16T22:13:33.182 INFO:tasks.rados.rados.2.smithi057.stdout:3066: finishing rollback tid 2 to smithi05720651-8 2020-11-16T22:13:33.182 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 1781 (ObjNum 970 snap 336 seq_num 970) dirty exists 2020-11-16T22:13:33.182 INFO:tasks.rados.rados.2.smithi057.stdout:3067: expect (ObjNum 1013 snap 355 seq_num 1013) 2020-11-16T22:13:33.362 INFO:tasks.rados.rados.2.smithi057.stdout:3068: finishing copy_from to smithi05720651-24 2020-11-16T22:13:33.362 INFO:tasks.rados.rados.2.smithi057.stdout:3068: got expected ENOENT (src dne) 2020-11-16T22:13:33.362 INFO:tasks.rados.rados.2.smithi057.stdout:3068: finishing copy_from racing read to smithi05720651-24 2020-11-16T22:13:33.362 INFO:tasks.rados.rados.2.smithi057.stdout:3065: done (4 left) 2020-11-16T22:13:33.362 INFO:tasks.rados.rados.2.smithi057.stdout:3066: done (3 left) 2020-11-16T22:13:33.363 INFO:tasks.rados.rados.2.smithi057.stdout:3067: done (2 left) 2020-11-16T22:13:33.363 INFO:tasks.rados.rados.2.smithi057.stdout:3068: done (1 left) 2020-11-16T22:13:33.363 INFO:tasks.rados.rados.2.smithi057.stdout:3069: done (0 left) 2020-11-16T22:13:33.363 INFO:tasks.rados.rados.2.smithi057.stdout:3070: delete oid 4 current snap is 358 2020-11-16T22:13:33.366 INFO:tasks.rados.rados.2.smithi057.stdout:3070: done (0 left) 2020-11-16T22:13:33.367 INFO:tasks.rados.rados.2.smithi057.stdout:3071: delete oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 358 2020-11-16T22:13:33.373 INFO:tasks.rados.rados.2.smithi057.stdout:3071: done (0 left) 2020-11-16T22:13:33.374 INFO:tasks.rados.rados.2.smithi057.stdout:3072: read oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:33.374 INFO:tasks.rados.rados.2.smithi057.stdout:3072: expect (ObjNum 958 snap 329 seq_num 958) 2020-11-16T22:13:33.374 INFO:tasks.rados.rados.2.smithi057.stdout:3073: write oid 12 current snap is 358 2020-11-16T22:13:33.374 INFO:tasks.rados.rados.2.smithi057.stdout:3073: seq_num 1019 ranges {726333=670033,2096210=724353} 2020-11-16T22:13:33.390 INFO:tasks.rados.rados.2.smithi057.stdout:3073: writing smithi05720651-12 from 726333 to 1396366 tid 1 2020-11-16T22:13:33.398 INFO:tasks.rados.rados.2.smithi057.stdout:3073: writing smithi05720651-12 from 2096210 to 2820563 tid 2 2020-11-16T22:13:33.398 INFO:tasks.rados.rados.2.smithi057.stdout:3074: rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 358 2020-11-16T22:13:33.399 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 353 2020-11-16T22:13:33.399 INFO:tasks.rados.rados.2.smithi057.stdout:3073: finishing write tid 1 to smithi05720651-12 2020-11-16T22:13:33.399 INFO:tasks.rados.rados.2.smithi057.stdout:3072: expect (ObjNum 958 snap 329 seq_num 958) 2020-11-16T22:13:33.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:33 smithi057 bash[10301]: cluster 2020-11-16T22:13:31.814706+0000 mgr.x (mgr.24115) 627 : cluster [DBG] pgmap v1339: 17 pgs: 17 active+clean; 207 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.3 MiB/s wr, 16 op/s 2020-11-16T22:13:33.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:33 smithi057 bash[10301]: cluster 2020-11-16T22:13:32.153511+0000 mon.a (mon.0) 1457 : cluster [DBG] osdmap e783: 12 total, 12 up, 12 in 2020-11-16T22:13:33.468 INFO:tasks.rados.rados.2.smithi057.stdout:3074: finishing rollback tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:33.469 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 0 (ObjNum 385 snap 0 seq_num 2932425680) dirty dne 2020-11-16T22:13:33.469 INFO:tasks.rados.rados.2.smithi057.stdout:3073: finishing write tid 2 to smithi05720651-12 2020-11-16T22:13:33.469 INFO:tasks.rados.rados.2.smithi057.stdout:3073: finishing write tid 4 to smithi05720651-12 2020-11-16T22:13:33.469 INFO:tasks.rados.rados.2.smithi057.stdout:3073: finishing write tid 5 to smithi05720651-12 2020-11-16T22:13:33.469 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 2384 (ObjNum 1019 snap 358 seq_num 1019) dirty exists 2020-11-16T22:13:33.469 INFO:tasks.rados.rados.2.smithi057.stdout:3073: left oid 12 (ObjNum 1019 snap 358 seq_num 1019) 2020-11-16T22:13:33.470 INFO:tasks.rados.rados.2.smithi057.stdout:3072: done (2 left) 2020-11-16T22:13:33.470 INFO:tasks.rados.rados.2.smithi057.stdout:3073: done (1 left) 2020-11-16T22:13:33.470 INFO:tasks.rados.rados.2.smithi057.stdout:3074: done (0 left) 2020-11-16T22:13:33.470 INFO:tasks.rados.rados.2.smithi057.stdout:3075: copy_from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 4 current snap is 358 2020-11-16T22:13:33.470 INFO:tasks.rados.rados.2.smithi057.stdout:3076: rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 358 2020-11-16T22:13:33.470 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 344 2020-11-16T22:13:33.470 INFO:tasks.rados.rados.2.smithi057.stdout:3077: write (excl) oid 18 current snap is 358 2020-11-16T22:13:33.471 INFO:tasks.rados.rados.2.smithi057.stdout:3077: seq_num 1020 ranges {743140=745282,2154692=468011} 2020-11-16T22:13:33.485 INFO:tasks.rados.rados.2.smithi057.stdout:3077: writing smithi05720651-18 from 743140 to 1488422 tid 1 2020-11-16T22:13:33.492 INFO:tasks.rados.rados.2.smithi057.stdout:3077: writing smithi05720651-18 from 2154692 to 2622703 tid 2 2020-11-16T22:13:33.492 INFO:tasks.rados.rados.2.smithi057.stdout:3078: write oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 358 2020-11-16T22:13:33.493 INFO:tasks.rados.rados.2.smithi057.stdout:3078: seq_num 1021 ranges {759947=420531,1813174=728022} 2020-11-16T22:13:33.499 INFO:tasks.rados.rados.2.smithi057.stdout:3078: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 759947 to 1180478 tid 1 2020-11-16T22:13:33.507 INFO:tasks.rados.rados.2.smithi057.stdout:3078: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1813174 to 2541196 tid 2 2020-11-16T22:13:33.507 INFO:tasks.rados.rados.2.smithi057.stdout:3079: snap_remove snap 354 2020-11-16T22:13:33.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:33 smithi016 bash[10302]: cluster 2020-11-16T22:13:31.814706+0000 mgr.x (mgr.24115) 627 : cluster [DBG] pgmap v1339: 17 pgs: 17 active+clean; 207 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.3 MiB/s wr, 16 op/s 2020-11-16T22:13:33.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:33 smithi016 bash[10302]: cluster 2020-11-16T22:13:32.153511+0000 mon.a (mon.0) 1457 : cluster [DBG] osdmap e783: 12 total, 12 up, 12 in 2020-11-16T22:13:33.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:33 smithi195 bash[10218]: cluster 2020-11-16T22:13:31.814706+0000 mgr.x (mgr.24115) 627 : cluster [DBG] pgmap v1339: 17 pgs: 17 active+clean; 207 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.3 MiB/s wr, 16 op/s 2020-11-16T22:13:33.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:33 smithi195 bash[10218]: cluster 2020-11-16T22:13:32.153511+0000 mon.a (mon.0) 1457 : cluster [DBG] osdmap e783: 12 total, 12 up, 12 in 2020-11-16T22:13:34.165 INFO:tasks.rados.rados.2.smithi057.stdout:3079: done (4 left) 2020-11-16T22:13:34.166 INFO:tasks.rados.rados.2.smithi057.stdout:3080: write oid 10 current snap is 358 2020-11-16T22:13:34.166 INFO:tasks.rados.rados.2.smithi057.stdout:3080: seq_num 1022 ranges {776754=495780,1871656=471680,2965828=210926} 2020-11-16T22:13:34.175 INFO:tasks.rados.rados.2.smithi057.stdout:3080: writing smithi05720651-10 from 776754 to 1272534 tid 1 2020-11-16T22:13:34.181 INFO:tasks.rados.rados.2.smithi057.stdout:3080: writing smithi05720651-10 from 1871656 to 2343336 tid 2 2020-11-16T22:13:34.187 INFO:tasks.rados.rados.2.smithi057.stdout:3080: writing smithi05720651-10 from 2965828 to 3176754 tid 3 2020-11-16T22:13:34.187 INFO:tasks.rados.rados.2.smithi057.stdout:3081: snap_create 2020-11-16T22:13:34.187 INFO:tasks.rados.rados.2.smithi057.stdout:3075: finishing copy_from to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:34.187 INFO:tasks.rados.rados.2.smithi057.stdout:3075: got expected ENOENT (src dne) 2020-11-16T22:13:34.188 INFO:tasks.rados.rados.2.smithi057.stdout:3075: finishing copy_from racing read to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:34.188 INFO:tasks.rados.rados.2.smithi057.stdout:3076: finishing rollback tid 0 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:34.188 INFO:tasks.rados.rados.2.smithi057.stdout:3076: finishing rollback tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:34.188 INFO:tasks.rados.rados.2.smithi057.stdout:3076: finishing rollback tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:34.188 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2193 (ObjNum 990 snap 344 seq_num 990) dirty exists 2020-11-16T22:13:34.188 INFO:tasks.rados.rados.2.smithi057.stdout:3077: finishing write tid 1 to smithi05720651-18 2020-11-16T22:13:34.188 INFO:tasks.rados.rados.2.smithi057.stdout:3077: finishing write tid 2 to smithi05720651-18 2020-11-16T22:13:34.189 INFO:tasks.rados.rados.2.smithi057.stdout:3077: finishing write tid 4 to smithi05720651-18 2020-11-16T22:13:34.189 INFO:tasks.rados.rados.2.smithi057.stdout:3077: finishing write tid 5 to smithi05720651-18 2020-11-16T22:13:34.189 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 2209 (ObjNum 1020 snap 358 seq_num 1020) dirty exists 2020-11-16T22:13:34.189 INFO:tasks.rados.rados.2.smithi057.stdout:3077: left oid 18 (ObjNum 1020 snap 358 seq_num 1020) 2020-11-16T22:13:34.189 INFO:tasks.rados.rados.2.smithi057.stdout:3078: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:34.189 INFO:tasks.rados.rados.2.smithi057.stdout:3078: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:34.189 INFO:tasks.rados.rados.2.smithi057.stdout:3078: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:34.190 INFO:tasks.rados.rados.2.smithi057.stdout:3078: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:34.190 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2212 (ObjNum 1021 snap 358 seq_num 1021) dirty exists 2020-11-16T22:13:34.190 INFO:tasks.rados.rados.2.smithi057.stdout:3078: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1021 snap 358 seq_num 1021) 2020-11-16T22:13:34.190 INFO:tasks.rados.rados.2.smithi057.stdout:3080: finishing write tid 1 to smithi05720651-10 2020-11-16T22:13:34.190 INFO:tasks.rados.rados.2.smithi057.stdout:3080: finishing write tid 2 to smithi05720651-10 2020-11-16T22:13:34.191 INFO:tasks.rados.rados.2.smithi057.stdout:3080: finishing write tid 3 to smithi05720651-10 2020-11-16T22:13:34.191 INFO:tasks.rados.rados.2.smithi057.stdout:3080: finishing write tid 5 to smithi05720651-10 2020-11-16T22:13:34.192 INFO:tasks.rados.rados.2.smithi057.stdout:3080: finishing write tid 6 to smithi05720651-10 2020-11-16T22:13:34.192 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 2202 (ObjNum 1022 snap 358 seq_num 1022) dirty exists 2020-11-16T22:13:34.192 INFO:tasks.rados.rados.2.smithi057.stdout:3080: left oid 10 (ObjNum 1022 snap 358 seq_num 1022) 2020-11-16T22:13:34.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:34 smithi057 bash[10301]: cluster 2020-11-16T22:13:33.155644+0000 mon.a (mon.0) 1458 : cluster [DBG] osdmap e784: 12 total, 12 up, 12 in 2020-11-16T22:13:34.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:34 smithi016 bash[10302]: cluster 2020-11-16T22:13:33.155644+0000 mon.a (mon.0) 1458 : cluster [DBG] osdmap e784: 12 total, 12 up, 12 in 2020-11-16T22:13:34.604 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:34 smithi195 bash[10218]: cluster 2020-11-16T22:13:33.155644+0000 mon.a (mon.0) 1458 : cluster [DBG] osdmap e784: 12 total, 12 up, 12 in 2020-11-16T22:13:35.150 INFO:tasks.rados.rados.2.smithi057.stdout:3075: done (5 left) 2020-11-16T22:13:35.150 INFO:tasks.rados.rados.2.smithi057.stdout:3076: done (4 left) 2020-11-16T22:13:35.150 INFO:tasks.rados.rados.2.smithi057.stdout:3077: done (3 left) 2020-11-16T22:13:35.150 INFO:tasks.rados.rados.2.smithi057.stdout:3078: done (2 left) 2020-11-16T22:13:35.151 INFO:tasks.rados.rados.2.smithi057.stdout:3080: done (1 left) 2020-11-16T22:13:35.151 INFO:tasks.rados.rados.2.smithi057.stdout:3081: done (0 left) 2020-11-16T22:13:35.151 INFO:tasks.rados.rados.2.smithi057.stdout:3082: snap_remove snap 333 2020-11-16T22:13:35.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:35 smithi057 bash[10301]: cluster 2020-11-16T22:13:33.815388+0000 mgr.x (mgr.24115) 628 : cluster [DBG] pgmap v1342: 17 pgs: 17 active+clean; 207 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2020-11-16T22:13:35.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:35 smithi057 bash[10301]: cluster 2020-11-16T22:13:34.174529+0000 mon.a (mon.0) 1459 : cluster [DBG] osdmap e785: 12 total, 12 up, 12 in 2020-11-16T22:13:35.445 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:35 smithi057 bash[10301]: cluster 2020-11-16T22:13:35.159797+0000 mon.a (mon.0) 1460 : cluster [DBG] osdmap e786: 12 total, 12 up, 12 in 2020-11-16T22:13:35.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:35 smithi016 bash[10302]: cluster 2020-11-16T22:13:33.815388+0000 mgr.x (mgr.24115) 628 : cluster [DBG] pgmap v1342: 17 pgs: 17 active+clean; 207 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2020-11-16T22:13:35.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:35 smithi016 bash[10302]: cluster 2020-11-16T22:13:34.174529+0000 mon.a (mon.0) 1459 : cluster [DBG] osdmap e785: 12 total, 12 up, 12 in 2020-11-16T22:13:35.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:35 smithi016 bash[10302]: cluster 2020-11-16T22:13:35.159797+0000 mon.a (mon.0) 1460 : cluster [DBG] osdmap e786: 12 total, 12 up, 12 in 2020-11-16T22:13:35.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:35 smithi195 bash[10218]: cluster 2020-11-16T22:13:33.815388+0000 mgr.x (mgr.24115) 628 : cluster [DBG] pgmap v1342: 17 pgs: 17 active+clean; 207 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 14 op/s 2020-11-16T22:13:35.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:35 smithi195 bash[10218]: cluster 2020-11-16T22:13:34.174529+0000 mon.a (mon.0) 1459 : cluster [DBG] osdmap e785: 12 total, 12 up, 12 in 2020-11-16T22:13:35.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:35 smithi195 bash[10218]: cluster 2020-11-16T22:13:35.159797+0000 mon.a (mon.0) 1460 : cluster [DBG] osdmap e786: 12 total, 12 up, 12 in 2020-11-16T22:13:36.172 INFO:tasks.rados.rados.2.smithi057.stdout:3082: done (0 left) 2020-11-16T22:13:36.172 INFO:tasks.rados.rados.2.smithi057.stdout:3083: copy_from oid 26 from oid 14 current snap is 359 2020-11-16T22:13:36.172 INFO:tasks.rados.rados.2.smithi057.stdout:3084: rollback oid 40 current snap is 359 2020-11-16T22:13:36.172 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 40 to 351 2020-11-16T22:13:36.173 INFO:tasks.rados.rados.2.smithi057.stdout:3085: copy_from oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 359 2020-11-16T22:13:36.173 INFO:tasks.rados.rados.2.smithi057.stdout:3086: write (excl) oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 359 2020-11-16T22:13:36.173 INFO:tasks.rados.rados.2.smithi057.stdout:3086: seq_num 1023 ranges {793561=571029,1813785=731691,2993251=200310} 2020-11-16T22:13:36.186 INFO:tasks.rados.rados.2.smithi057.stdout:3086: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 793561 to 1364590 tid 1 2020-11-16T22:13:36.194 INFO:tasks.rados.rados.2.smithi057.stdout:3086: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1813785 to 2545476 tid 2 2020-11-16T22:13:36.198 INFO:tasks.rados.rados.2.smithi057.stdout:3086: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2993251 to 3193561 tid 3 2020-11-16T22:13:36.199 INFO:tasks.rados.rados.2.smithi057.stdout:3087: copy_from oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 359 2020-11-16T22:13:36.199 INFO:tasks.rados.rados.2.smithi057.stdout:3084: finishing rollback tid 1 to smithi05720651-40 2020-11-16T22:13:36.199 INFO:tasks.rados.rados.2.smithi057.stdout:3084: finishing rollback tid 2 to smithi05720651-40 2020-11-16T22:13:36.199 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 2500 (ObjNum 997 snap 348 seq_num 997) dirty exists 2020-11-16T22:13:36.199 INFO:tasks.rados.rados.2.smithi057.stdout:3083: finishing copy_from to smithi05720651-26 2020-11-16T22:13:36.199 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 2186 (ObjNum 969 snap 336 seq_num 969) dirty exists 2020-11-16T22:13:36.200 INFO:tasks.rados.rados.2.smithi057.stdout:3083: finishing copy_from racing read to smithi05720651-26 2020-11-16T22:13:36.200 INFO:tasks.rados.rados.2.smithi057.stdout:3085: finishing copy_from to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:36.200 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1778 (ObjNum 968 snap 333 seq_num 968) dirty exists 2020-11-16T22:13:36.200 INFO:tasks.rados.rados.2.smithi057.stdout:3085: finishing copy_from racing read to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:36.200 INFO:tasks.rados.rados.2.smithi057.stdout:3086: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:36.200 INFO:tasks.rados.rados.2.smithi057.stdout:3083: done (4 left) 2020-11-16T22:13:36.200 INFO:tasks.rados.rados.2.smithi057.stdout:3084: done (3 left) 2020-11-16T22:13:36.200 INFO:tasks.rados.rados.2.smithi057.stdout:3085: done (2 left) 2020-11-16T22:13:36.201 INFO:tasks.rados.rados.2.smithi057.stdout:3088: snap_create 2020-11-16T22:13:36.202 INFO:tasks.rados.rados.2.smithi057.stdout:3086: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:36.202 INFO:tasks.rados.rados.2.smithi057.stdout:3086: finishing write tid 3 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:36.204 INFO:tasks.rados.rados.2.smithi057.stdout:3086: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:36.204 INFO:tasks.rados.rados.2.smithi057.stdout:3086: finishing write tid 6 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:36.204 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1804 (ObjNum 1023 snap 359 seq_num 1023) dirty exists 2020-11-16T22:13:36.205 INFO:tasks.rados.rados.2.smithi057.stdout:3086: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1023 snap 359 seq_num 1023) 2020-11-16T22:13:36.213 INFO:tasks.rados.rados.2.smithi057.stdout:3087: finishing copy_from to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:36.213 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2180 (ObjNum 958 snap 329 seq_num 958) dirty exists 2020-11-16T22:13:36.214 INFO:tasks.rados.rados.2.smithi057.stdout:3087: finishing copy_from racing read to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:36.444 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:13:36 smithi057 bash[12595]: debug 2020-11-16T22:13:36.205+0000 7f737d1a4700 -1 osd.8 pg_epoch: 787 pg[2.5( v 787'1466 (0'0,787'1466] local-lis/les=71/72 n=9 ec=71/71 lis/c=71/71 les/c/f=72/72/0 sis=71) [8,0] r=0 lpr=71 luod=785'1464 crt=787'1466 lcod 785'1463 mlcod 785'1463 active+clean+snaptrim trimq=[295~1] ps=[2be~3]] removing snap head 2020-11-16T22:13:37.180 INFO:tasks.rados.rados.2.smithi057.stdout:3086: done (2 left) 2020-11-16T22:13:37.181 INFO:tasks.rados.rados.2.smithi057.stdout:3087: done (1 left) 2020-11-16T22:13:37.181 INFO:tasks.rados.rados.2.smithi057.stdout:3088: done (0 left) 2020-11-16T22:13:37.181 INFO:tasks.rados.rados.2.smithi057.stdout:3089: rollback oid 36 current snap is 360 2020-11-16T22:13:37.181 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 36 to 353 2020-11-16T22:13:37.181 INFO:tasks.rados.rados.2.smithi057.stdout:3090: write oid 50 current snap is 360 2020-11-16T22:13:37.181 INFO:tasks.rados.rados.2.smithi057.stdout:3090: seq_num 1024 ranges {410368=646278,1472267=475349,2504321=405600} 2020-11-16T22:13:37.194 INFO:tasks.rados.rados.2.smithi057.stdout:3090: writing smithi05720651-50 from 410368 to 1056646 tid 1 2020-11-16T22:13:37.199 INFO:tasks.rados.rados.2.smithi057.stdout:3090: writing smithi05720651-50 from 1472267 to 1947616 tid 2 2020-11-16T22:13:37.205 INFO:tasks.rados.rados.2.smithi057.stdout:3090: writing smithi05720651-50 from 2504321 to 2909921 tid 3 2020-11-16T22:13:37.205 INFO:tasks.rados.rados.2.smithi057.stdout:3091: write (excl) oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 360 2020-11-16T22:13:37.205 INFO:tasks.rados.rados.2.smithi057.stdout:3091: seq_num 1025 ranges {427175=721527,1930749=735360} 2020-11-16T22:13:37.211 INFO:tasks.rados.rados.2.smithi057.stdout:3091: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 427175 to 1148702 tid 1 2020-11-16T22:13:37.220 INFO:tasks.rados.rados.2.smithi057.stdout:3091: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1930749 to 2666109 tid 2 2020-11-16T22:13:37.220 INFO:tasks.rados.rados.2.smithi057.stdout:3092: write oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 360 2020-11-16T22:13:37.220 INFO:tasks.rados.rados.2.smithi057.stdout:3092: seq_num 1026 ranges {443982=796776,1989231=479018,2959167=284815} 2020-11-16T22:13:37.227 INFO:tasks.rados.rados.2.smithi057.stdout:3092: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 443982 to 1240758 tid 1 2020-11-16T22:13:37.234 INFO:tasks.rados.rados.2.smithi057.stdout:3092: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1989231 to 2468249 tid 2 2020-11-16T22:13:37.239 INFO:tasks.rados.rados.2.smithi057.stdout:3092: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2959167 to 3243982 tid 3 2020-11-16T22:13:37.239 INFO:tasks.rados.rados.2.smithi057.stdout:3093: read oid 18 snap -1 2020-11-16T22:13:37.239 INFO:tasks.rados.rados.2.smithi057.stdout:3093: expect (ObjNum 1020 snap 358 seq_num 1020) 2020-11-16T22:13:37.240 INFO:tasks.rados.rados.2.smithi057.stdout:3094: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:37.240 INFO:tasks.rados.rados.2.smithi057.stdout:3094: expect (ObjNum 1012 snap 355 seq_num 1012) 2020-11-16T22:13:37.240 INFO:tasks.rados.rados.2.smithi057.stdout:3095: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 358 2020-11-16T22:13:37.240 INFO:tasks.rados.rados.2.smithi057.stdout:3095: expect deleted 2020-11-16T22:13:37.240 INFO:tasks.rados.rados.2.smithi057.stdout:3096: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:37.240 INFO:tasks.rados.rados.2.smithi057.stdout:3096: expect (ObjNum 1000 snap 348 seq_num 1000) 2020-11-16T22:13:37.240 INFO:tasks.rados.rados.2.smithi057.stdout:3097: snap_create 2020-11-16T22:13:37.241 INFO:tasks.rados.rados.2.smithi057.stdout:3089: finishing rollback tid 1 to smithi05720651-36 2020-11-16T22:13:37.241 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 0 (ObjNum 385 snap 0 seq_num 2931949680) dirty dne 2020-11-16T22:13:37.241 INFO:tasks.rados.rados.2.smithi057.stdout:3090: finishing write tid 1 to smithi05720651-50 2020-11-16T22:13:37.241 INFO:tasks.rados.rados.2.smithi057.stdout:3090: finishing write tid 2 to smithi05720651-50 2020-11-16T22:13:37.241 INFO:tasks.rados.rados.2.smithi057.stdout:3090: finishing write tid 3 to smithi05720651-50 2020-11-16T22:13:37.241 INFO:tasks.rados.rados.2.smithi057.stdout:3090: finishing write tid 5 to smithi05720651-50 2020-11-16T22:13:37.241 INFO:tasks.rados.rados.2.smithi057.stdout:3090: finishing write tid 6 to smithi05720651-50 2020-11-16T22:13:37.242 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 2197 (ObjNum 1024 snap 360 seq_num 1024) dirty exists 2020-11-16T22:13:37.242 INFO:tasks.rados.rados.2.smithi057.stdout:3090: left oid 50 (ObjNum 1024 snap 360 seq_num 1024) 2020-11-16T22:13:37.242 INFO:tasks.rados.rados.2.smithi057.stdout:3091: finishing write tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:37.242 INFO:tasks.rados.rados.2.smithi057.stdout:3091: finishing write tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:37.242 INFO:tasks.rados.rados.2.smithi057.stdout:3091: finishing write tid 4 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:37.242 INFO:tasks.rados.rados.2.smithi057.stdout:3091: finishing write tid 5 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:37.242 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2205 (ObjNum 1025 snap 360 seq_num 1025) dirty exists 2020-11-16T22:13:37.243 INFO:tasks.rados.rados.2.smithi057.stdout:3091: left oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1025 snap 360 seq_num 1025) 2020-11-16T22:13:37.243 INFO:tasks.rados.rados.2.smithi057.stdout:3092: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:37.243 INFO:tasks.rados.rados.2.smithi057.stdout:3092: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:37.244 INFO:tasks.rados.rados.2.smithi057.stdout:3092: finishing write tid 3 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:37.248 INFO:tasks.rados.rados.2.smithi057.stdout:3094: expect (ObjNum 1012 snap 355 seq_num 1012) 2020-11-16T22:13:37.439 INFO:tasks.rados.rados.2.smithi057.stdout:3096: expect (ObjNum 1000 snap 348 seq_num 1000) 2020-11-16T22:13:37.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:37 smithi057 bash[10301]: cluster 2020-11-16T22:13:35.816102+0000 mgr.x (mgr.24115) 629 : cluster [DBG] pgmap v1345: 17 pgs: 17 active+clean; 215 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 629 KiB/s wr, 9 op/s 2020-11-16T22:13:37.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:37 smithi057 bash[10301]: cluster 2020-11-16T22:13:36.180062+0000 mon.a (mon.0) 1461 : cluster [DBG] osdmap e787: 12 total, 12 up, 12 in 2020-11-16T22:13:37.556 INFO:tasks.rados.rados.2.smithi057.stdout:3092: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:37.556 INFO:tasks.rados.rados.2.smithi057.stdout:3092: finishing write tid 6 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:37.556 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2216 (ObjNum 1026 snap 360 seq_num 1026) dirty exists 2020-11-16T22:13:41.674 INFO:tasks.rados.rados.2.smithi057.stdout:3092: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1026 snap 360 seq_num 1026) 2020-11-16T22:13:41.674 INFO:tasks.rados.rados.2.smithi057.stdout:3093: expect (ObjNum 1020 snap 358 seq_num 1020) 2020-11-16T22:13:41.680 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:37 smithi195 bash[10218]: cluster 2020-11-16T22:13:35.816102+0000 mgr.x (mgr.24115) 629 : cluster [DBG] pgmap v1345: 17 pgs: 17 active+clean; 215 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 629 KiB/s wr, 9 op/s 2020-11-16T22:13:41.680 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:37 smithi195 bash[10218]: cluster 2020-11-16T22:13:36.180062+0000 mon.a (mon.0) 1461 : cluster [DBG] osdmap e787: 12 total, 12 up, 12 in 2020-11-16T22:13:41.680 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:38 smithi195 bash[10218]: cluster 2020-11-16T22:13:37.189885+0000 mon.a (mon.0) 1462 : cluster [DBG] osdmap e788: 12 total, 12 up, 12 in 2020-11-16T22:13:41.680 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:39 smithi195 bash[10218]: cluster 2020-11-16T22:13:37.816889+0000 mgr.x (mgr.24115) 630 : cluster [DBG] pgmap v1348: 17 pgs: 17 active+clean; 217 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2020-11-16T22:13:41.680 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:39 smithi195 bash[10218]: cluster 2020-11-16T22:13:38.200558+0000 mon.a (mon.0) 1463 : cluster [DBG] osdmap e789: 12 total, 12 up, 12 in 2020-11-16T22:13:41.680 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:40 smithi195 bash[10218]: cluster 2020-11-16T22:13:39.203262+0000 mon.a (mon.0) 1464 : cluster [DBG] osdmap e790: 12 total, 12 up, 12 in 2020-11-16T22:13:41.681 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:40 smithi195 bash[10218]: cluster 2020-11-16T22:13:40.162641+0000 mon.a (mon.0) 1465 : cluster [DBG] osdmap e791: 12 total, 12 up, 12 in 2020-11-16T22:13:41.681 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:41 smithi195 bash[10218]: cluster 2020-11-16T22:13:39.817617+0000 mgr.x (mgr.24115) 631 : cluster [DBG] pgmap v1351: 17 pgs: 17 active+clean; 216 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 12 op/s 2020-11-16T22:13:41.681 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:41 smithi195 bash[10218]: cluster 2020-11-16T22:13:41.171956+0000 mon.a (mon.0) 1466 : cluster [DBG] osdmap e792: 12 total, 12 up, 12 in 2020-11-16T22:13:41.681 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:37 smithi016 bash[10302]: cluster 2020-11-16T22:13:35.816102+0000 mgr.x (mgr.24115) 629 : cluster [DBG] pgmap v1345: 17 pgs: 17 active+clean; 215 MiB data, 772 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 629 KiB/s wr, 9 op/s 2020-11-16T22:13:41.681 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:37 smithi016 bash[10302]: cluster 2020-11-16T22:13:36.180062+0000 mon.a (mon.0) 1461 : cluster [DBG] osdmap e787: 12 total, 12 up, 12 in 2020-11-16T22:13:41.681 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:38 smithi016 bash[10302]: cluster 2020-11-16T22:13:37.189885+0000 mon.a (mon.0) 1462 : cluster [DBG] osdmap e788: 12 total, 12 up, 12 in 2020-11-16T22:13:41.681 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:39 smithi016 bash[10302]: cluster 2020-11-16T22:13:37.816889+0000 mgr.x (mgr.24115) 630 : cluster [DBG] pgmap v1348: 17 pgs: 17 active+clean; 217 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2020-11-16T22:13:41.682 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:39 smithi016 bash[10302]: cluster 2020-11-16T22:13:38.200558+0000 mon.a (mon.0) 1463 : cluster [DBG] osdmap e789: 12 total, 12 up, 12 in 2020-11-16T22:13:41.682 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:40 smithi016 bash[10302]: cluster 2020-11-16T22:13:39.203262+0000 mon.a (mon.0) 1464 : cluster [DBG] osdmap e790: 12 total, 12 up, 12 in 2020-11-16T22:13:41.682 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:40 smithi016 bash[10302]: cluster 2020-11-16T22:13:40.162641+0000 mon.a (mon.0) 1465 : cluster [DBG] osdmap e791: 12 total, 12 up, 12 in 2020-11-16T22:13:41.682 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:41 smithi016 bash[10302]: cluster 2020-11-16T22:13:39.817617+0000 mgr.x (mgr.24115) 631 : cluster [DBG] pgmap v1351: 17 pgs: 17 active+clean; 216 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 12 op/s 2020-11-16T22:13:41.682 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:41 smithi016 bash[10302]: cluster 2020-11-16T22:13:41.171956+0000 mon.a (mon.0) 1466 : cluster [DBG] osdmap e792: 12 total, 12 up, 12 in 2020-11-16T22:13:41.682 INFO:tasks.rados.rados.2.smithi057.stdout:3089: done (8 left) 2020-11-16T22:13:41.683 INFO:tasks.rados.rados.2.smithi057.stdout:3090: done (7 left) 2020-11-16T22:13:41.683 INFO:tasks.rados.rados.2.smithi057.stdout:3091: done (6 left) 2020-11-16T22:13:41.683 INFO:tasks.rados.rados.2.smithi057.stdout:3092: done (5 left) 2020-11-16T22:13:41.683 INFO:tasks.rados.rados.2.smithi057.stdout:3093: done (4 left) 2020-11-16T22:13:41.683 INFO:tasks.rados.rados.2.smithi057.stdout:3094: done (3 left) 2020-11-16T22:13:41.683 INFO:tasks.rados.rados.2.smithi057.stdout:3095: done (2 left) 2020-11-16T22:13:41.683 INFO:tasks.rados.rados.2.smithi057.stdout:3096: done (1 left) 2020-11-16T22:13:41.684 INFO:tasks.rados.rados.2.smithi057.stdout:3097: done (0 left) 2020-11-16T22:13:41.684 INFO:tasks.rados.rados.2.smithi057.stdout:3098: read oid 32 snap -1 2020-11-16T22:13:41.684 INFO:tasks.rados.rados.2.smithi057.stdout:3098: expect (ObjNum 1013 snap 355 seq_num 1013) 2020-11-16T22:13:41.684 INFO:tasks.rados.rados.2.smithi057.stdout:3099: rollback oid 30 current snap is 361 2020-11-16T22:13:41.684 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 30 to 351 2020-11-16T22:13:41.684 INFO:tasks.rados.rados.2.smithi057.stdout:3100: write oid 26 current snap is 361 2020-11-16T22:13:41.684 INFO:tasks.rados.rados.2.smithi057.stdout:3100: seq_num 1027 ranges {460789=588378,1764066=739029,3219296=41493} 2020-11-16T22:13:41.684 INFO:tasks.rados.rados.2.smithi057.stdout:3100: writing smithi05720651-26 from 460789 to 1049167 tid 1 2020-11-16T22:13:41.685 INFO:tasks.rados.rados.2.smithi057.stdout:3100: writing smithi05720651-26 from 1764066 to 2503095 tid 2 2020-11-16T22:13:41.685 INFO:tasks.rados.rados.2.smithi057.stdout:3100: writing smithi05720651-26 from 3219296 to 3260789 tid 3 2020-11-16T22:13:41.685 INFO:tasks.rados.rados.2.smithi057.stdout:3101: write oid 10 current snap is 361 2020-11-16T22:13:41.685 INFO:tasks.rados.rados.2.smithi057.stdout:3101: seq_num 1028 ranges {477596=663627,1706195=482687,2614013=567041} 2020-11-16T22:13:41.685 INFO:tasks.rados.rados.2.smithi057.stdout:3101: writing smithi05720651-10 from 477596 to 1141223 tid 1 2020-11-16T22:13:41.685 INFO:tasks.rados.rados.2.smithi057.stdout:3101: writing smithi05720651-10 from 1706195 to 2188882 tid 2 2020-11-16T22:13:41.685 INFO:tasks.rados.rados.2.smithi057.stdout:3101: writing smithi05720651-10 from 2614013 to 3181054 tid 3 2020-11-16T22:13:41.686 INFO:tasks.rados.rados.2.smithi057.stdout:3102: snap_create 2020-11-16T22:13:41.686 INFO:tasks.rados.rados.2.smithi057.stdout:3099: finishing rollback tid 1 to smithi05720651-30 2020-11-16T22:13:41.686 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 0 (ObjNum 2385 snap 0 seq_num 2932251968) dirty dne 2020-11-16T22:13:41.686 INFO:tasks.rados.rados.2.smithi057.stdout:3098: expect (ObjNum 1013 snap 355 seq_num 1013) 2020-11-16T22:13:41.686 INFO:tasks.rados.rados.2.smithi057.stdout:3100: finishing write tid 1 to smithi05720651-26 2020-11-16T22:13:41.686 INFO:tasks.rados.rados.2.smithi057.stdout:3100: finishing write tid 2 to smithi05720651-26 2020-11-16T22:13:41.686 INFO:tasks.rados.rados.2.smithi057.stdout:3100: finishing write tid 3 to smithi05720651-26 2020-11-16T22:13:41.687 INFO:tasks.rados.rados.2.smithi057.stdout:3100: finishing write tid 5 to smithi05720651-26 2020-11-16T22:13:41.687 INFO:tasks.rados.rados.2.smithi057.stdout:3100: finishing write tid 6 to smithi05720651-26 2020-11-16T22:13:41.687 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 2515 (ObjNum 1027 snap 361 seq_num 1027) dirty exists 2020-11-16T22:13:41.687 INFO:tasks.rados.rados.2.smithi057.stdout:3100: left oid 26 (ObjNum 1027 snap 361 seq_num 1027) 2020-11-16T22:13:41.687 INFO:tasks.rados.rados.2.smithi057.stdout:3101: finishing write tid 1 to smithi05720651-10 2020-11-16T22:13:41.687 INFO:tasks.rados.rados.2.smithi057.stdout:3101: finishing write tid 2 to smithi05720651-10 2020-11-16T22:13:41.687 INFO:tasks.rados.rados.2.smithi057.stdout:3101: finishing write tid 3 to smithi05720651-10 2020-11-16T22:13:41.687 INFO:tasks.rados.rados.2.smithi057.stdout:3101: finishing write tid 5 to smithi05720651-10 2020-11-16T22:13:41.688 INFO:tasks.rados.rados.2.smithi057.stdout:3101: finishing write tid 6 to smithi05720651-10 2020-11-16T22:13:41.688 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 2209 (ObjNum 1028 snap 361 seq_num 1028) dirty exists 2020-11-16T22:13:41.688 INFO:tasks.rados.rados.2.smithi057.stdout:3101: left oid 10 (ObjNum 1028 snap 361 seq_num 1028) 2020-11-16T22:13:41.688 INFO:tasks.rados.rados.2.smithi057.stdout:3098: done (4 left) 2020-11-16T22:13:41.688 INFO:tasks.rados.rados.2.smithi057.stdout:3099: done (3 left) 2020-11-16T22:13:41.688 INFO:tasks.rados.rados.2.smithi057.stdout:3100: done (2 left) 2020-11-16T22:13:41.688 INFO:tasks.rados.rados.2.smithi057.stdout:3101: done (1 left) 2020-11-16T22:13:41.689 INFO:tasks.rados.rados.2.smithi057.stdout:3102: done (0 left) 2020-11-16T22:13:41.689 INFO:tasks.rados.rados.2.smithi057.stdout:3103: delete oid 40 current snap is 362 2020-11-16T22:13:41.689 INFO:tasks.rados.rados.2.smithi057.stdout:3103: done (0 left) 2020-11-16T22:13:41.689 INFO:tasks.rados.rados.2.smithi057.stdout:3104: snap_create 2020-11-16T22:13:41.689 INFO:tasks.rados.rados.2.smithi057.stdout:3104: done (0 left) 2020-11-16T22:13:41.689 INFO:tasks.rados.rados.2.smithi057.stdout:3105: delete oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 363 2020-11-16T22:13:41.689 INFO:tasks.rados.rados.2.smithi057.stdout:3105: done (0 left) 2020-11-16T22:13:41.689 INFO:tasks.rados.rados.2.smithi057.stdout:3106: delete oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 363 2020-11-16T22:13:41.690 INFO:tasks.rados.rados.2.smithi057.stdout:3106: done (0 left) 2020-11-16T22:13:41.690 INFO:tasks.rados.rados.2.smithi057.stdout:3107: delete oid 14 current snap is 363 2020-11-16T22:13:41.690 INFO:tasks.rados.rados.2.smithi057.stdout:3107: done (0 left) 2020-11-16T22:13:41.690 INFO:tasks.rados.rados.2.smithi057.stdout:3108: copy_from oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 10 current snap is 363 2020-11-16T22:13:41.690 INFO:tasks.rados.rados.2.smithi057.stdout:3109: snap_create 2020-11-16T22:13:41.690 INFO:tasks.rados.rados.2.smithi057.stdout:3108: finishing copy_from to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:41.690 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2209 (ObjNum 1028 snap 361 seq_num 1028) dirty exists 2020-11-16T22:13:41.691 INFO:tasks.rados.rados.2.smithi057.stdout:3108: finishing copy_from racing read to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:41.691 INFO:tasks.rados.rados.2.smithi057.stdout:3108: done (1 left) 2020-11-16T22:13:41.691 INFO:tasks.rados.rados.2.smithi057.stdout:3109: done (0 left) 2020-11-16T22:13:41.691 INFO:tasks.rados.rados.2.smithi057.stdout:3110: write (excl) oid 46 current snap is 364 2020-11-16T22:13:41.691 INFO:tasks.rados.rados.2.smithi057.stdout:3110: seq_num 1033 ranges {561631=639872,1882252=633683,3034775=326856} 2020-11-16T22:13:41.691 INFO:tasks.rados.rados.2.smithi057.stdout:3110: writing smithi05720651-46 from 561631 to 1201503 tid 1 2020-11-16T22:13:41.691 INFO:tasks.rados.rados.2.smithi057.stdout:3110: writing smithi05720651-46 from 1882252 to 2515935 tid 2 2020-11-16T22:13:41.692 INFO:tasks.rados.rados.2.smithi057.stdout:3110: writing smithi05720651-46 from 3034775 to 3361631 tid 3 2020-11-16T22:13:41.692 INFO:tasks.rados.rados.2.smithi057.stdout:3111: read oid 2 snap -1 2020-11-16T22:13:41.692 INFO:tasks.rados.rados.2.smithi057.stdout:3111: expect (ObjNum 956 snap 329 seq_num 956) 2020-11-16T22:13:41.692 INFO:tasks.rados.rados.2.smithi057.stdout:3112: write (excl) oid 24 current snap is 364 2020-11-16T22:13:41.692 INFO:tasks.rados.rados.2.smithi057.stdout:3112: seq_num 1034 ranges {578438=431474,1657087=493694,2778551=599887} 2020-11-16T22:13:41.692 INFO:tasks.rados.rados.2.smithi057.stdout:3112: writing smithi05720651-24 from 578438 to 1009912 tid 1 2020-11-16T22:13:41.692 INFO:tasks.rados.rados.2.smithi057.stdout:3112: writing smithi05720651-24 from 1657087 to 2150781 tid 2 2020-11-16T22:13:41.692 INFO:tasks.rados.rados.2.smithi057.stdout:3112: writing smithi05720651-24 from 2778551 to 3378438 tid 3 2020-11-16T22:13:41.693 INFO:tasks.rados.rados.2.smithi057.stdout:3113: write (excl) oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 364 2020-11-16T22:13:41.693 INFO:tasks.rados.rados.2.smithi057.stdout:3113: seq_num 1035 ranges {595245=506723,1715569=637352,2805974=562298} 2020-11-16T22:13:41.693 INFO:tasks.rados.rados.2.smithi057.stdout:3113: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 595245 to 1101968 tid 1 2020-11-16T22:13:41.693 INFO:tasks.rados.rados.2.smithi057.stdout:3113: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1715569 to 2352921 tid 2 2020-11-16T22:13:41.693 INFO:tasks.rados.rados.2.smithi057.stdout:3113: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2805974 to 3368272 tid 3 2020-11-16T22:13:41.693 INFO:tasks.rados.rados.2.smithi057.stdout:3114: read oid 20 snap -1 2020-11-16T22:13:41.693 INFO:tasks.rados.rados.2.smithi057.stdout:3114: expect (ObjNum 940 snap 324 seq_num 940) 2020-11-16T22:13:41.694 INFO:tasks.rados.rados.2.smithi057.stdout:3115: write oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 364 2020-11-16T22:13:41.694 INFO:tasks.rados.rados.2.smithi057.stdout:3115: seq_num 1036 ranges {612052=581972,1657698=497363,2717044=695008} 2020-11-16T22:13:41.694 INFO:tasks.rados.rados.2.smithi057.stdout:3115: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 612052 to 1194024 tid 1 2020-11-16T22:13:41.694 INFO:tasks.rados.rados.2.smithi057.stdout:3115: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1657698 to 2155061 tid 2 2020-11-16T22:13:41.694 INFO:tasks.rados.rados.2.smithi057.stdout:3115: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2717044 to 3412052 tid 3 2020-11-16T22:13:41.694 INFO:tasks.rados.rados.2.smithi057.stdout:3116: rollback oid 36 current snap is 364 2020-11-16T22:13:41.694 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 36 to 341 2020-11-16T22:13:41.695 INFO:tasks.rados.rados.2.smithi057.stdout:3110: finishing write tid 1 to smithi05720651-46 2020-11-16T22:13:41.695 INFO:tasks.rados.rados.2.smithi057.stdout:3117: snap_create 2020-11-16T22:13:41.695 INFO:tasks.rados.rados.2.smithi057.stdout:3110: finishing write tid 2 to smithi05720651-46 2020-11-16T22:13:41.695 INFO:tasks.rados.rados.2.smithi057.stdout:3110: finishing write tid 3 to smithi05720651-46 2020-11-16T22:13:41.695 INFO:tasks.rados.rados.2.smithi057.stdout:3110: finishing write tid 5 to smithi05720651-46 2020-11-16T22:13:41.695 INFO:tasks.rados.rados.2.smithi057.stdout:3111: expect (ObjNum 956 snap 329 seq_num 956) 2020-11-16T22:13:41.695 INFO:tasks.rados.rados.2.smithi057.stdout:3110: finishing write tid 6 to smithi05720651-46 2020-11-16T22:13:41.696 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 2216 (ObjNum 1033 snap 364 seq_num 1033) dirty exists 2020-11-16T22:13:41.696 INFO:tasks.rados.rados.2.smithi057.stdout:3110: left oid 46 (ObjNum 1033 snap 364 seq_num 1033) 2020-11-16T22:13:41.696 INFO:tasks.rados.rados.2.smithi057.stdout:3112: finishing write tid 1 to smithi05720651-24 2020-11-16T22:13:41.696 INFO:tasks.rados.rados.2.smithi057.stdout:3112: finishing write tid 2 to smithi05720651-24 2020-11-16T22:13:41.696 INFO:tasks.rados.rados.2.smithi057.stdout:3112: finishing write tid 3 to smithi05720651-24 2020-11-16T22:13:41.696 INFO:tasks.rados.rados.2.smithi057.stdout:3112: finishing write tid 5 to smithi05720651-24 2020-11-16T22:13:41.696 INFO:tasks.rados.rados.2.smithi057.stdout:3112: finishing write tid 6 to smithi05720651-24 2020-11-16T22:13:41.696 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 1785 (ObjNum 1034 snap 364 seq_num 1034) dirty exists 2020-11-16T22:13:41.697 INFO:tasks.rados.rados.2.smithi057.stdout:3112: left oid 24 (ObjNum 1034 snap 364 seq_num 1034) 2020-11-16T22:13:41.697 INFO:tasks.rados.rados.2.smithi057.stdout:3113: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:41.697 INFO:tasks.rados.rados.2.smithi057.stdout:3113: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:41.697 INFO:tasks.rados.rados.2.smithi057.stdout:3113: finishing write tid 3 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:41.697 INFO:tasks.rados.rados.2.smithi057.stdout:3113: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:41.697 INFO:tasks.rados.rados.2.smithi057.stdout:3113: finishing write tid 6 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:41.697 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2204 (ObjNum 1035 snap 364 seq_num 1035) dirty exists 2020-11-16T22:13:41.698 INFO:tasks.rados.rados.2.smithi057.stdout:3113: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1035 snap 364 seq_num 1035) 2020-11-16T22:13:41.698 INFO:tasks.rados.rados.2.smithi057.stdout:3114: expect (ObjNum 940 snap 324 seq_num 940) 2020-11-16T22:13:41.698 INFO:tasks.rados.rados.2.smithi057.stdout:3115: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:41.698 INFO:tasks.rados.rados.2.smithi057.stdout:3115: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:41.698 INFO:tasks.rados.rados.2.smithi057.stdout:3116: finishing rollback tid 1 to smithi05720651-36 2020-11-16T22:13:41.698 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 0 (ObjNum 49 snap 0 seq_num 2909626040) dirty dne 2020-11-16T22:13:41.698 INFO:tasks.rados.rados.2.smithi057.stdout:3115: finishing write tid 3 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:41.699 INFO:tasks.rados.rados.2.smithi057.stdout:3115: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:41.699 INFO:tasks.rados.rados.2.smithi057.stdout:3115: finishing write tid 6 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:41.699 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2202 (ObjNum 1036 snap 364 seq_num 1036) dirty exists 2020-11-16T22:13:41.699 INFO:tasks.rados.rados.2.smithi057.stdout:3115: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1036 snap 364 seq_num 1036) 2020-11-16T22:13:41.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:38 smithi057 bash[10301]: cluster 2020-11-16T22:13:37.189885+0000 mon.a (mon.0) 1462 : cluster [DBG] osdmap e788: 12 total, 12 up, 12 in 2020-11-16T22:13:41.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:39 smithi057 bash[10301]: cluster 2020-11-16T22:13:37.816889+0000 mgr.x (mgr.24115) 630 : cluster [DBG] pgmap v1348: 17 pgs: 17 active+clean; 217 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2020-11-16T22:13:41.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:39 smithi057 bash[10301]: cluster 2020-11-16T22:13:38.200558+0000 mon.a (mon.0) 1463 : cluster [DBG] osdmap e789: 12 total, 12 up, 12 in 2020-11-16T22:13:41.700 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:40 smithi057 bash[10301]: cluster 2020-11-16T22:13:39.203262+0000 mon.a (mon.0) 1464 : cluster [DBG] osdmap e790: 12 total, 12 up, 12 in 2020-11-16T22:13:41.700 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:40 smithi057 bash[10301]: cluster 2020-11-16T22:13:40.162641+0000 mon.a (mon.0) 1465 : cluster [DBG] osdmap e791: 12 total, 12 up, 12 in 2020-11-16T22:13:41.700 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:41 smithi057 bash[10301]: cluster 2020-11-16T22:13:39.817617+0000 mgr.x (mgr.24115) 631 : cluster [DBG] pgmap v1351: 17 pgs: 17 active+clean; 216 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 12 op/s 2020-11-16T22:13:41.700 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:41 smithi057 bash[10301]: cluster 2020-11-16T22:13:41.171956+0000 mon.a (mon.0) 1466 : cluster [DBG] osdmap e792: 12 total, 12 up, 12 in 2020-11-16T22:13:42.223 INFO:tasks.rados.rados.2.smithi057.stdout:3110: done (7 left) 2020-11-16T22:13:42.223 INFO:tasks.rados.rados.2.smithi057.stdout:3111: done (6 left) 2020-11-16T22:13:42.224 INFO:tasks.rados.rados.2.smithi057.stdout:3112: done (5 left) 2020-11-16T22:13:42.224 INFO:tasks.rados.rados.2.smithi057.stdout:3113: done (4 left) 2020-11-16T22:13:42.224 INFO:tasks.rados.rados.2.smithi057.stdout:3114: done (3 left) 2020-11-16T22:13:42.224 INFO:tasks.rados.rados.2.smithi057.stdout:3115: done (2 left) 2020-11-16T22:13:42.224 INFO:tasks.rados.rados.2.smithi057.stdout:3116: done (1 left) 2020-11-16T22:13:42.224 INFO:tasks.rados.rados.2.smithi057.stdout:3117: done (0 left) 2020-11-16T22:13:42.224 INFO:tasks.rados.rados.2.smithi057.stdout:3118: delete oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 365 2020-11-16T22:13:42.232 INFO:tasks.rados.rados.2.smithi057.stdout:3118: done (0 left) 2020-11-16T22:13:42.232 INFO:tasks.rados.rados.2.smithi057.stdout:3119: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:42.233 INFO:tasks.rados.rados.2.smithi057.stdout:3119: expect (ObjNum 926 snap 314 seq_num 926) 2020-11-16T22:13:42.233 INFO:tasks.rados.rados.2.smithi057.stdout:3120: read oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:42.233 INFO:tasks.rados.rados.2.smithi057.stdout:3120: expect (ObjNum 1025 snap 360 seq_num 1025) 2020-11-16T22:13:42.233 INFO:tasks.rados.rados.2.smithi057.stdout:3121: rollback oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 365 2020-11-16T22:13:42.233 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 363 2020-11-16T22:13:42.233 INFO:tasks.rados.rados.2.smithi057.stdout:3122: snap_remove snap 358 2020-11-16T22:13:43.233 INFO:tasks.rados.rados.2.smithi057.stdout:3122: done (3 left) 2020-11-16T22:13:43.234 INFO:tasks.rados.rados.2.smithi057.stdout:3123: delete oid 30 current snap is 365 2020-11-16T22:13:43.234 INFO:tasks.rados.rados.2.smithi057.stdout:3119: expect (ObjNum 926 snap 314 seq_num 926) 2020-11-16T22:13:43.505 INFO:tasks.rados.rados.2.smithi057.stdout:3121: finishing rollback tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:43.505 INFO:tasks.rados.rados.2.smithi057.stdout:3120: expect (ObjNum 1025 snap 360 seq_num 1025) 2020-11-16T22:13:43.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:43 smithi016 bash[10302]: cluster 2020-11-16T22:13:41.818370+0000 mgr.x (mgr.24115) 632 : cluster [DBG] pgmap v1354: 17 pgs: 17 active+clean; 213 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.5 MiB/s wr, 20 op/s 2020-11-16T22:13:43.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:43 smithi016 bash[10302]: cluster 2020-11-16T22:13:42.233136+0000 mon.a (mon.0) 1467 : cluster [DBG] osdmap e793: 12 total, 12 up, 12 in 2020-11-16T22:13:43.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:43 smithi195 bash[10218]: cluster 2020-11-16T22:13:41.818370+0000 mgr.x (mgr.24115) 632 : cluster [DBG] pgmap v1354: 17 pgs: 17 active+clean; 213 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.5 MiB/s wr, 20 op/s 2020-11-16T22:13:43.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:43 smithi195 bash[10218]: cluster 2020-11-16T22:13:42.233136+0000 mon.a (mon.0) 1467 : cluster [DBG] osdmap e793: 12 total, 12 up, 12 in 2020-11-16T22:13:43.668 INFO:tasks.rados.rados.2.smithi057.stdout:3121: finishing rollback tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:43.668 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2523 (ObjNum 969 snap 336 seq_num 969) dirty exists 2020-11-16T22:13:43.668 INFO:tasks.rados.rados.2.smithi057.stdout:3119: done (3 left) 2020-11-16T22:13:43.668 INFO:tasks.rados.rados.2.smithi057.stdout:3120: done (2 left) 2020-11-16T22:13:43.669 INFO:tasks.rados.rados.2.smithi057.stdout:3121: done (1 left) 2020-11-16T22:13:43.669 INFO:tasks.rados.rados.2.smithi057.stdout:3123: done (0 left) 2020-11-16T22:13:43.669 INFO:tasks.rados.rados.2.smithi057.stdout:3124: delete oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 365 2020-11-16T22:13:43.674 INFO:tasks.rados.rados.2.smithi057.stdout:3124: done (0 left) 2020-11-16T22:13:43.674 INFO:tasks.rados.rados.2.smithi057.stdout:3125: rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 365 2020-11-16T22:13:43.674 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 364 2020-11-16T22:13:43.674 INFO:tasks.rados.rados.2.smithi057.stdout:3126: read oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:43.674 INFO:tasks.rados.rados.2.smithi057.stdout:3126: expect (ObjNum 958 snap 329 seq_num 958) 2020-11-16T22:13:43.674 INFO:tasks.rados.rados.2.smithi057.stdout:3127: rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 365 2020-11-16T22:13:43.675 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 364 2020-11-16T22:13:43.675 INFO:tasks.rados.rados.2.smithi057.stdout:3128: copy_from oid 30 from oid 26 current snap is 365 2020-11-16T22:13:43.675 INFO:tasks.rados.rados.2.smithi057.stdout:3129: copy_from oid 8 from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 365 2020-11-16T22:13:43.675 INFO:tasks.rados.rados.2.smithi057.stdout:3130: write oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 365 2020-11-16T22:13:43.675 INFO:tasks.rados.rados.2.smithi057.stdout:3130: seq_num 1040 ranges {679280=482968,1775273=788348,3110383=368897} 2020-11-16T22:13:43.686 INFO:tasks.rados.rados.2.smithi057.stdout:3130: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 679280 to 1162248 tid 1 2020-11-16T22:13:43.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:43 smithi057 bash[10301]: cluster 2020-11-16T22:13:41.818370+0000 mgr.x (mgr.24115) 632 : cluster [DBG] pgmap v1354: 17 pgs: 17 active+clean; 213 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.5 MiB/s wr, 20 op/s 2020-11-16T22:13:43.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:43 smithi057 bash[10301]: cluster 2020-11-16T22:13:42.233136+0000 mon.a (mon.0) 1467 : cluster [DBG] osdmap e793: 12 total, 12 up, 12 in 2020-11-16T22:13:43.694 INFO:tasks.rados.rados.2.smithi057.stdout:3130: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1775273 to 2563621 tid 2 2020-11-16T22:13:43.699 INFO:tasks.rados.rados.2.smithi057.stdout:3130: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3110383 to 3479280 tid 3 2020-11-16T22:13:43.699 INFO:tasks.rados.rados.2.smithi057.stdout:3131: write (excl) oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 365 2020-11-16T22:13:43.700 INFO:tasks.rados.rados.2.smithi057.stdout:3131: seq_num 1041 ranges {696087=558217,1833755=648359,3137806=358281} 2020-11-16T22:13:43.706 INFO:tasks.rados.rados.2.smithi057.stdout:3131: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 696087 to 1254304 tid 1 2020-11-16T22:13:43.713 INFO:tasks.rados.rados.2.smithi057.stdout:3131: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1833755 to 2482114 tid 2 2020-11-16T22:13:43.719 INFO:tasks.rados.rados.2.smithi057.stdout:3131: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3137806 to 3496087 tid 3 2020-11-16T22:13:43.720 INFO:tasks.rados.rados.2.smithi057.stdout:3132: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:43.720 INFO:tasks.rados.rados.2.smithi057.stdout:3132: expect deleted 2020-11-16T22:13:43.720 INFO:tasks.rados.rados.2.smithi057.stdout:3133: read oid 38 snap -1 2020-11-16T22:13:43.720 INFO:tasks.rados.rados.2.smithi057.stdout:3133: expect (ObjNum 941 snap 324 seq_num 941) 2020-11-16T22:13:43.720 INFO:tasks.rados.rados.2.smithi057.stdout:3134: snap_remove snap 352 2020-11-16T22:13:44.244 INFO:tasks.rados.rados.2.smithi057.stdout:3134: done (9 left) 2020-11-16T22:13:44.244 INFO:tasks.rados.rados.2.smithi057.stdout:3135: read oid 50 snap -1 2020-11-16T22:13:44.244 INFO:tasks.rados.rados.2.smithi057.stdout:3135: expect (ObjNum 1024 snap 360 seq_num 1024) 2020-11-16T22:13:44.244 INFO:tasks.rados.rados.2.smithi057.stdout:3136: snap_remove snap 343 2020-11-16T22:13:44.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:44 smithi016 bash[10302]: cluster 2020-11-16T22:13:43.243907+0000 mon.a (mon.0) 1468 : cluster [DBG] osdmap e794: 12 total, 12 up, 12 in 2020-11-16T22:13:44.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:44 smithi195 bash[10218]: cluster 2020-11-16T22:13:43.243907+0000 mon.a (mon.0) 1468 : cluster [DBG] osdmap e794: 12 total, 12 up, 12 in 2020-11-16T22:13:44.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:44 smithi057 bash[10301]: cluster 2020-11-16T22:13:43.243907+0000 mon.a (mon.0) 1468 : cluster [DBG] osdmap e794: 12 total, 12 up, 12 in 2020-11-16T22:13:45.156 INFO:tasks.rados.rados.2.smithi057.stdout:3136: done (10 left) 2020-11-16T22:13:45.156 INFO:tasks.rados.rados.2.smithi057.stdout:3137: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 344 2020-11-16T22:13:45.156 INFO:tasks.rados.rados.2.smithi057.stdout:3137: expect deleted 2020-11-16T22:13:45.157 INFO:tasks.rados.rados.2.smithi057.stdout:3138: snap_create 2020-11-16T22:13:45.157 INFO:tasks.rados.rados.2.smithi057.stdout:3127: finishing rollback tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:45.157 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1805 (ObjNum 753 snap 0 seq_num 2932310192) dirty dne 2020-11-16T22:13:45.157 INFO:tasks.rados.rados.2.smithi057.stdout:3129: finishing copy_from to smithi05720651-8 2020-11-16T22:13:45.157 INFO:tasks.rados.rados.2.smithi057.stdout:3129: got expected ENOENT (src dne) 2020-11-16T22:13:45.157 INFO:tasks.rados.rados.2.smithi057.stdout:3129: finishing copy_from racing read to smithi05720651-8 2020-11-16T22:13:45.158 INFO:tasks.rados.rados.2.smithi057.stdout:3126: expect (ObjNum 958 snap 329 seq_num 958) 2020-11-16T22:13:45.225 INFO:tasks.rados.rados.2.smithi057.stdout:3125: finishing rollback tid 0 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:45.225 INFO:tasks.rados.rados.2.smithi057.stdout:3125: finishing rollback tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:45.225 INFO:tasks.rados.rados.2.smithi057.stdout:3125: finishing rollback tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:45.225 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2220 (ObjNum 760 snap 265 seq_num 760) dirty exists 2020-11-16T22:13:45.226 INFO:tasks.rados.rados.2.smithi057.stdout:3130: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:45.226 INFO:tasks.rados.rados.2.smithi057.stdout:3130: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:45.226 INFO:tasks.rados.rados.2.smithi057.stdout:3128: finishing copy_from to smithi05720651-30 2020-11-16T22:13:45.226 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 2515 (ObjNum 1027 snap 361 seq_num 1027) dirty exists 2020-11-16T22:13:45.226 INFO:tasks.rados.rados.2.smithi057.stdout:3128: finishing copy_from racing read to smithi05720651-30 2020-11-16T22:13:45.226 INFO:tasks.rados.rados.2.smithi057.stdout:3130: finishing write tid 3 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:45.226 INFO:tasks.rados.rados.2.smithi057.stdout:3130: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:45.227 INFO:tasks.rados.rados.2.smithi057.stdout:3130: finishing write tid 6 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:45.227 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2206 (ObjNum 1040 snap 365 seq_num 1040) dirty exists 2020-11-16T22:13:45.227 INFO:tasks.rados.rados.2.smithi057.stdout:3130: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1040 snap 365 seq_num 1040) 2020-11-16T22:13:45.227 INFO:tasks.rados.rados.2.smithi057.stdout:3131: finishing write tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:45.227 INFO:tasks.rados.rados.2.smithi057.stdout:3131: finishing write tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:45.227 INFO:tasks.rados.rados.2.smithi057.stdout:3131: finishing write tid 3 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:45.227 INFO:tasks.rados.rados.2.smithi057.stdout:3131: finishing write tid 5 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:45.228 INFO:tasks.rados.rados.2.smithi057.stdout:3131: finishing write tid 6 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:45.228 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1789 (ObjNum 1041 snap 365 seq_num 1041) dirty exists 2020-11-16T22:13:45.228 INFO:tasks.rados.rados.2.smithi057.stdout:3131: left oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1041 snap 365 seq_num 1041) 2020-11-16T22:13:45.228 INFO:tasks.rados.rados.2.smithi057.stdout:3133: expect (ObjNum 941 snap 324 seq_num 941) 2020-11-16T22:13:45.338 INFO:tasks.rados.rados.2.smithi057.stdout:3135: expect (ObjNum 1024 snap 360 seq_num 1024) 2020-11-16T22:13:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:45 smithi016 bash[10302]: cluster 2020-11-16T22:13:43.819002+0000 mgr.x (mgr.24115) 633 : cluster [DBG] pgmap v1357: 17 pgs: 17 active+clean; 213 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2020-11-16T22:13:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:45 smithi016 bash[10302]: cluster 2020-11-16T22:13:44.254078+0000 mon.a (mon.0) 1469 : cluster [DBG] osdmap e795: 12 total, 12 up, 12 in 2020-11-16T22:13:45.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:45 smithi016 bash[10302]: cluster 2020-11-16T22:13:45.165030+0000 mon.a (mon.0) 1470 : cluster [DBG] osdmap e796: 12 total, 12 up, 12 in 2020-11-16T22:13:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:45 smithi195 bash[10218]: cluster 2020-11-16T22:13:43.819002+0000 mgr.x (mgr.24115) 633 : cluster [DBG] pgmap v1357: 17 pgs: 17 active+clean; 213 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2020-11-16T22:13:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:45 smithi195 bash[10218]: cluster 2020-11-16T22:13:44.254078+0000 mon.a (mon.0) 1469 : cluster [DBG] osdmap e795: 12 total, 12 up, 12 in 2020-11-16T22:13:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:45 smithi195 bash[10218]: cluster 2020-11-16T22:13:45.165030+0000 mon.a (mon.0) 1470 : cluster [DBG] osdmap e796: 12 total, 12 up, 12 in 2020-11-16T22:13:45.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:45 smithi057 bash[10301]: cluster 2020-11-16T22:13:43.819002+0000 mgr.x (mgr.24115) 633 : cluster [DBG] pgmap v1357: 17 pgs: 17 active+clean; 213 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 18 op/s 2020-11-16T22:13:45.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:45 smithi057 bash[10301]: cluster 2020-11-16T22:13:44.254078+0000 mon.a (mon.0) 1469 : cluster [DBG] osdmap e795: 12 total, 12 up, 12 in 2020-11-16T22:13:45.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:45 smithi057 bash[10301]: cluster 2020-11-16T22:13:45.165030+0000 mon.a (mon.0) 1470 : cluster [DBG] osdmap e796: 12 total, 12 up, 12 in 2020-11-16T22:13:46.167 INFO:tasks.rados.rados.2.smithi057.stdout:3125: done (11 left) 2020-11-16T22:13:46.168 INFO:tasks.rados.rados.2.smithi057.stdout:3126: done (10 left) 2020-11-16T22:13:46.168 INFO:tasks.rados.rados.2.smithi057.stdout:3127: done (9 left) 2020-11-16T22:13:46.168 INFO:tasks.rados.rados.2.smithi057.stdout:3128: done (8 left) 2020-11-16T22:13:46.168 INFO:tasks.rados.rados.2.smithi057.stdout:3129: done (7 left) 2020-11-16T22:13:46.168 INFO:tasks.rados.rados.2.smithi057.stdout:3130: done (6 left) 2020-11-16T22:13:46.168 INFO:tasks.rados.rados.2.smithi057.stdout:3131: done (5 left) 2020-11-16T22:13:46.169 INFO:tasks.rados.rados.2.smithi057.stdout:3132: done (4 left) 2020-11-16T22:13:46.169 INFO:tasks.rados.rados.2.smithi057.stdout:3133: done (3 left) 2020-11-16T22:13:46.169 INFO:tasks.rados.rados.2.smithi057.stdout:3135: done (2 left) 2020-11-16T22:13:46.169 INFO:tasks.rados.rados.2.smithi057.stdout:3137: done (1 left) 2020-11-16T22:13:46.169 INFO:tasks.rados.rados.2.smithi057.stdout:3138: done (0 left) 2020-11-16T22:13:46.169 INFO:tasks.rados.rados.2.smithi057.stdout:3139: read oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 344 2020-11-16T22:13:46.169 INFO:tasks.rados.rados.2.smithi057.stdout:3139: expect (ObjNum 916 snap 313 seq_num 916) 2020-11-16T22:13:46.170 INFO:tasks.rados.rados.2.smithi057.stdout:3140: copy_from oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 34 current snap is 366 2020-11-16T22:13:46.170 INFO:tasks.rados.rados.2.smithi057.stdout:3141: read oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:46.170 INFO:tasks.rados.rados.2.smithi057.stdout:3141: expect deleted 2020-11-16T22:13:46.170 INFO:tasks.rados.rados.2.smithi057.stdout:3142: delete oid 48 current snap is 366 2020-11-16T22:13:46.175 INFO:tasks.rados.rados.2.smithi057.stdout:3142: done (3 left) 2020-11-16T22:13:46.175 INFO:tasks.rados.rados.2.smithi057.stdout:3143: write (excl) oid 28 current snap is 366 2020-11-16T22:13:46.175 INFO:tasks.rados.rados.2.smithi057.stdout:3143: seq_num 1043 ranges {729701=425068,1667072=652028,2909005=485180} 2020-11-16T22:13:46.185 INFO:tasks.rados.rados.2.smithi057.stdout:3143: writing smithi05720651-28 from 729701 to 1154769 tid 1 2020-11-16T22:13:46.192 INFO:tasks.rados.rados.2.smithi057.stdout:3143: writing smithi05720651-28 from 1667072 to 2319100 tid 2 2020-11-16T22:13:46.198 INFO:tasks.rados.rados.2.smithi057.stdout:3143: writing smithi05720651-28 from 2909005 to 3394185 tid 3 2020-11-16T22:13:46.199 INFO:tasks.rados.rados.2.smithi057.stdout:3144: snap_create 2020-11-16T22:13:46.199 INFO:tasks.rados.rados.2.smithi057.stdout:3139: expect (ObjNum 916 snap 313 seq_num 916) 2020-11-16T22:13:46.433 INFO:tasks.rados.rados.2.smithi057.stdout:3143: finishing write tid 1 to smithi05720651-28 2020-11-16T22:13:46.433 INFO:tasks.rados.rados.2.smithi057.stdout:3140: finishing copy_from to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:46.433 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2189 (ObjNum 949 snap 328 seq_num 949) dirty exists 2020-11-16T22:13:46.433 INFO:tasks.rados.rados.2.smithi057.stdout:3140: finishing copy_from racing read to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:46.433 INFO:tasks.rados.rados.2.smithi057.stdout:3143: finishing write tid 2 to smithi05720651-28 2020-11-16T22:13:46.433 INFO:tasks.rados.rados.2.smithi057.stdout:3143: finishing write tid 3 to smithi05720651-28 2020-11-16T22:13:46.434 INFO:tasks.rados.rados.2.smithi057.stdout:3143: finishing write tid 5 to smithi05720651-28 2020-11-16T22:13:46.434 INFO:tasks.rados.rados.2.smithi057.stdout:3143: finishing write tid 6 to smithi05720651-28 2020-11-16T22:13:46.434 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 2213 (ObjNum 1043 snap 366 seq_num 1043) dirty exists 2020-11-16T22:13:46.434 INFO:tasks.rados.rados.2.smithi057.stdout:3143: left oid 28 (ObjNum 1043 snap 366 seq_num 1043) 2020-11-16T22:13:47.178 INFO:tasks.rados.rados.2.smithi057.stdout:3139: done (4 left) 2020-11-16T22:13:47.179 INFO:tasks.rados.rados.2.smithi057.stdout:3140: done (3 left) 2020-11-16T22:13:47.179 INFO:tasks.rados.rados.2.smithi057.stdout:3141: done (2 left) 2020-11-16T22:13:47.179 INFO:tasks.rados.rados.2.smithi057.stdout:3143: done (1 left) 2020-11-16T22:13:47.179 INFO:tasks.rados.rados.2.smithi057.stdout:3144: done (0 left) 2020-11-16T22:13:47.179 INFO:tasks.rados.rados.2.smithi057.stdout:3145: write (excl) oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 367 2020-11-16T22:13:47.179 INFO:tasks.rados.rados.2.smithi057.stdout:3145: seq_num 1044 ranges {746508=500317,2009201=795686,3220075=326433} 2020-11-16T22:13:47.193 INFO:tasks.rados.rados.2.smithi057.stdout:3145: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 746508 to 1246825 tid 1 2020-11-16T22:13:47.202 INFO:tasks.rados.rados.2.smithi057.stdout:3145: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2009201 to 2804887 tid 2 2020-11-16T22:13:47.207 INFO:tasks.rados.rados.2.smithi057.stdout:3145: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3220075 to 3546508 tid 3 2020-11-16T22:13:47.208 INFO:tasks.rados.rados.2.smithi057.stdout:3146: rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 367 2020-11-16T22:13:47.208 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 350 2020-11-16T22:13:47.208 INFO:tasks.rados.rados.2.smithi057.stdout:3145: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.208 INFO:tasks.rados.rados.2.smithi057.stdout:3147: copy_from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 367 2020-11-16T22:13:47.208 INFO:tasks.rados.rados.2.smithi057.stdout:3148: read oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:47.208 INFO:tasks.rados.rados.2.smithi057.stdout:3148: expect (ObjNum 969 snap 336 seq_num 969) 2020-11-16T22:13:47.209 INFO:tasks.rados.rados.2.smithi057.stdout:3149: copy_from oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 367 2020-11-16T22:13:47.209 INFO:tasks.rados.rados.2.smithi057.stdout:3150: read oid 30 snap -1 2020-11-16T22:13:47.209 INFO:tasks.rados.rados.2.smithi057.stdout:3150: expect (ObjNum 1027 snap 361 seq_num 1027) 2020-11-16T22:13:47.209 INFO:tasks.rados.rados.2.smithi057.stdout:3151: read oid 26 snap -1 2020-11-16T22:13:47.209 INFO:tasks.rados.rados.2.smithi057.stdout:3151: expect (ObjNum 1027 snap 361 seq_num 1027) 2020-11-16T22:13:47.209 INFO:tasks.rados.rados.2.smithi057.stdout:3152: write (excl) oid 42 current snap is 367 2020-11-16T22:13:47.209 INFO:tasks.rados.rados.2.smithi057.stdout:3152: seq_num 1045 ranges {763315=575566,2067683=655697,3247498=315817} 2020-11-16T22:13:47.214 INFO:tasks.rados.rados.2.smithi057.stdout:3152: writing smithi05720651-42 from 763315 to 1338881 tid 1 2020-11-16T22:13:47.222 INFO:tasks.rados.rados.2.smithi057.stdout:3152: writing smithi05720651-42 from 2067683 to 2723380 tid 2 2020-11-16T22:13:47.228 INFO:tasks.rados.rados.2.smithi057.stdout:3152: writing smithi05720651-42 from 3247498 to 3563315 tid 3 2020-11-16T22:13:47.228 INFO:tasks.rados.rados.2.smithi057.stdout:3153: read oid 50 snap -1 2020-11-16T22:13:47.228 INFO:tasks.rados.rados.2.smithi057.stdout:3153: expect (ObjNum 1024 snap 360 seq_num 1024) 2020-11-16T22:13:47.228 INFO:tasks.rados.rados.2.smithi057.stdout:3154: delete oid 8 current snap is 367 2020-11-16T22:13:47.229 INFO:tasks.rados.rados.2.smithi057.stdout:3145: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.229 INFO:tasks.rados.rados.2.smithi057.stdout:3145: finishing write tid 3 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.229 INFO:tasks.rados.rados.2.smithi057.stdout:3152: finishing write tid 1 to smithi05720651-42 2020-11-16T22:13:47.229 INFO:tasks.rados.rados.2.smithi057.stdout:3145: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.229 INFO:tasks.rados.rados.2.smithi057.stdout:3145: finishing write tid 6 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.229 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2222 (ObjNum 1044 snap 367 seq_num 1044) dirty exists 2020-11-16T22:13:47.229 INFO:tasks.rados.rados.2.smithi057.stdout:3145: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1044 snap 367 seq_num 1044) 2020-11-16T22:13:47.232 INFO:tasks.rados.rados.2.smithi057.stdout:3145: done (9 left) 2020-11-16T22:13:47.232 INFO:tasks.rados.rados.2.smithi057.stdout:3154: done (8 left) 2020-11-16T22:13:47.232 INFO:tasks.rados.rados.2.smithi057.stdout:3155: write oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 367 2020-11-16T22:13:47.232 INFO:tasks.rados.rados.2.smithi057.stdout:3155: seq_num 1047 ranges {796929=726064,2184647=659366,3302344=294585} 2020-11-16T22:13:47.241 INFO:tasks.rados.rados.2.smithi057.stdout:3155: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 796929 to 1522993 tid 1 2020-11-16T22:13:47.249 INFO:tasks.rados.rados.2.smithi057.stdout:3155: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2184647 to 2844013 tid 2 2020-11-16T22:13:47.254 INFO:tasks.rados.rados.2.smithi057.stdout:3155: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3302344 to 3596929 tid 3 2020-11-16T22:13:47.254 INFO:tasks.rados.rados.2.smithi057.stdout:3156: write (excl) oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 367 2020-11-16T22:13:47.254 INFO:tasks.rados.rados.2.smithi057.stdout:3156: seq_num 1048 ranges {413736=401313,1326776=403024,2413414=457893,3438716=175020} 2020-11-16T22:13:47.259 INFO:tasks.rados.rados.2.smithi057.stdout:3156: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 413736 to 815049 tid 1 2020-11-16T22:13:47.264 INFO:tasks.rados.rados.2.smithi057.stdout:3156: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1326776 to 1729800 tid 2 2020-11-16T22:13:47.270 INFO:tasks.rados.rados.2.smithi057.stdout:3156: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2413414 to 2871307 tid 3 2020-11-16T22:13:47.275 INFO:tasks.rados.rados.2.smithi057.stdout:3156: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3438716 to 3613736 tid 4 2020-11-16T22:13:47.275 INFO:tasks.rados.rados.2.smithi057.stdout:3157: write (excl) oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 367 2020-11-16T22:13:47.275 INFO:tasks.rados.rados.2.smithi057.stdout:3157: seq_num 1049 ranges {430543=476562,1385258=663035,2840837=669165} 2020-11-16T22:13:47.280 INFO:tasks.rados.rados.2.smithi057.stdout:3157: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 430543 to 907105 tid 1 2020-11-16T22:13:47.286 INFO:tasks.rados.rados.2.smithi057.stdout:3157: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1385258 to 2048293 tid 2 2020-11-16T22:13:47.295 INFO:tasks.rados.rados.2.smithi057.stdout:3157: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2840837 to 3510002 tid 3 2020-11-16T22:13:47.295 INFO:tasks.rados.rados.2.smithi057.stdout:3158: snap_create 2020-11-16T22:13:47.295 INFO:tasks.rados.rados.2.smithi057.stdout:3150: expect (ObjNum 1027 snap 361 seq_num 1027) 2020-11-16T22:13:47.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:47 smithi057 bash[10301]: cluster 2020-11-16T22:13:45.819758+0000 mgr.x (mgr.24115) 634 : cluster [DBG] pgmap v1360: 17 pgs: 17 active+clean; 228 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 3.1 MiB/s wr, 22 op/s 2020-11-16T22:13:47.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:47 smithi057 bash[10301]: cluster 2020-11-16T22:13:46.176153+0000 mon.a (mon.0) 1471 : cluster [DBG] osdmap e797: 12 total, 12 up, 12 in 2020-11-16T22:13:47.493 INFO:tasks.rados.rados.2.smithi057.stdout:3148: expect (ObjNum 969 snap 336 seq_num 969) 2020-11-16T22:13:47.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:47 smithi016 bash[10302]: cluster 2020-11-16T22:13:45.819758+0000 mgr.x (mgr.24115) 634 : cluster [DBG] pgmap v1360: 17 pgs: 17 active+clean; 228 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 3.1 MiB/s wr, 22 op/s 2020-11-16T22:13:47.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:47 smithi016 bash[10302]: cluster 2020-11-16T22:13:46.176153+0000 mon.a (mon.0) 1471 : cluster [DBG] osdmap e797: 12 total, 12 up, 12 in 2020-11-16T22:13:47.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:47 smithi195 bash[10218]: cluster 2020-11-16T22:13:45.819758+0000 mgr.x (mgr.24115) 634 : cluster [DBG] pgmap v1360: 17 pgs: 17 active+clean; 228 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 3.1 MiB/s wr, 22 op/s 2020-11-16T22:13:47.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:47 smithi195 bash[10218]: cluster 2020-11-16T22:13:46.176153+0000 mon.a (mon.0) 1471 : cluster [DBG] osdmap e797: 12 total, 12 up, 12 in 2020-11-16T22:13:47.611 INFO:tasks.rados.rados.2.smithi057.stdout:3149: finishing copy_from to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.611 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2200 (ObjNum 981 snap 341 seq_num 981) dirty exists 2020-11-16T22:13:47.612 INFO:tasks.rados.rados.2.smithi057.stdout:3149: finishing copy_from racing read to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.612 INFO:tasks.rados.rados.2.smithi057.stdout:3153: expect (ObjNum 1024 snap 360 seq_num 1024) 2020-11-16T22:13:47.749 INFO:tasks.rados.rados.2.smithi057.stdout:3155: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.749 INFO:tasks.rados.rados.2.smithi057.stdout:3151: expect (ObjNum 1027 snap 361 seq_num 1027) 2020-11-16T22:13:47.937 INFO:tasks.rados.rados.2.smithi057.stdout:3146: finishing rollback tid 0 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.937 INFO:tasks.rados.rados.2.smithi057.stdout:3146: finishing rollback tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.937 INFO:tasks.rados.rados.2.smithi057.stdout:3146: finishing rollback tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.937 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2557 (ObjNum 1000 snap 348 seq_num 1000) dirty exists 2020-11-16T22:13:47.937 INFO:tasks.rados.rados.2.smithi057.stdout:3152: finishing write tid 2 to smithi05720651-42 2020-11-16T22:13:47.937 INFO:tasks.rados.rados.2.smithi057.stdout:3152: finishing write tid 3 to smithi05720651-42 2020-11-16T22:13:47.938 INFO:tasks.rados.rados.2.smithi057.stdout:3152: finishing write tid 5 to smithi05720651-42 2020-11-16T22:13:47.938 INFO:tasks.rados.rados.2.smithi057.stdout:3152: finishing write tid 6 to smithi05720651-42 2020-11-16T22:13:47.938 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 2200 (ObjNum 1045 snap 367 seq_num 1045) dirty exists 2020-11-16T22:13:47.938 INFO:tasks.rados.rados.2.smithi057.stdout:3152: left oid 42 (ObjNum 1045 snap 367 seq_num 1045) 2020-11-16T22:13:47.938 INFO:tasks.rados.rados.2.smithi057.stdout:3155: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.938 INFO:tasks.rados.rados.2.smithi057.stdout:3155: finishing write tid 3 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.939 INFO:tasks.rados.rados.2.smithi057.stdout:3155: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.939 INFO:tasks.rados.rados.2.smithi057.stdout:3147: finishing copy_from to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.939 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2189 (ObjNum 949 snap 328 seq_num 949) dirty exists 2020-11-16T22:13:47.939 INFO:tasks.rados.rados.2.smithi057.stdout:3155: finishing write tid 6 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.939 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2226 (ObjNum 1047 snap 367 seq_num 1047) dirty exists 2020-11-16T22:13:47.939 INFO:tasks.rados.rados.2.smithi057.stdout:3155: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1047 snap 367 seq_num 1047) 2020-11-16T22:13:47.939 INFO:tasks.rados.rados.2.smithi057.stdout:3147: finishing copy_from racing read to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.940 INFO:tasks.rados.rados.2.smithi057.stdout:3156: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.940 INFO:tasks.rados.rados.2.smithi057.stdout:3156: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.940 INFO:tasks.rados.rados.2.smithi057.stdout:3156: finishing write tid 3 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.940 INFO:tasks.rados.rados.2.smithi057.stdout:3156: finishing write tid 4 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.940 INFO:tasks.rados.rados.2.smithi057.stdout:3156: finishing write tid 6 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.940 INFO:tasks.rados.rados.2.smithi057.stdout:3156: finishing write tid 7 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.940 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2231 (ObjNum 1048 snap 367 seq_num 1048) dirty exists 2020-11-16T22:13:47.940 INFO:tasks.rados.rados.2.smithi057.stdout:3156: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1048 snap 367 seq_num 1048) 2020-11-16T22:13:47.941 INFO:tasks.rados.rados.2.smithi057.stdout:3157: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.941 INFO:tasks.rados.rados.2.smithi057.stdout:3157: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.941 INFO:tasks.rados.rados.2.smithi057.stdout:3157: finishing write tid 3 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.941 INFO:tasks.rados.rados.2.smithi057.stdout:3157: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.941 INFO:tasks.rados.rados.2.smithi057.stdout:3157: finishing write tid 6 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:47.941 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2217 (ObjNum 1049 snap 367 seq_num 1049) dirty exists 2020-11-16T22:13:47.941 INFO:tasks.rados.rados.2.smithi057.stdout:3157: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1049 snap 367 seq_num 1049) 2020-11-16T22:13:48.191 INFO:tasks.rados.rados.2.smithi057.stdout:3146: done (11 left) 2020-11-16T22:13:48.191 INFO:tasks.rados.rados.2.smithi057.stdout:3147: done (10 left) 2020-11-16T22:13:48.191 INFO:tasks.rados.rados.2.smithi057.stdout:3148: done (9 left) 2020-11-16T22:13:48.191 INFO:tasks.rados.rados.2.smithi057.stdout:3149: done (8 left) 2020-11-16T22:13:48.192 INFO:tasks.rados.rados.2.smithi057.stdout:3150: done (7 left) 2020-11-16T22:13:48.192 INFO:tasks.rados.rados.2.smithi057.stdout:3151: done (6 left) 2020-11-16T22:13:48.192 INFO:tasks.rados.rados.2.smithi057.stdout:3152: done (5 left) 2020-11-16T22:13:48.192 INFO:tasks.rados.rados.2.smithi057.stdout:3153: done (4 left) 2020-11-16T22:13:48.192 INFO:tasks.rados.rados.2.smithi057.stdout:3155: done (3 left) 2020-11-16T22:13:48.192 INFO:tasks.rados.rados.2.smithi057.stdout:3156: done (2 left) 2020-11-16T22:13:48.192 INFO:tasks.rados.rados.2.smithi057.stdout:3157: done (1 left) 2020-11-16T22:13:48.193 INFO:tasks.rados.rados.2.smithi057.stdout:3158: done (0 left) 2020-11-16T22:13:48.193 INFO:tasks.rados.rados.2.smithi057.stdout:3159: snap_create 2020-11-16T22:13:48.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:48 smithi057 bash[10301]: cluster 2020-11-16T22:13:47.188915+0000 mon.a (mon.0) 1472 : cluster [DBG] osdmap e798: 12 total, 12 up, 12 in 2020-11-16T22:13:48.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:48 smithi016 bash[10302]: cluster 2020-11-16T22:13:47.188915+0000 mon.a (mon.0) 1472 : cluster [DBG] osdmap e798: 12 total, 12 up, 12 in 2020-11-16T22:13:48.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:48 smithi195 bash[10218]: cluster 2020-11-16T22:13:47.188915+0000 mon.a (mon.0) 1472 : cluster [DBG] osdmap e798: 12 total, 12 up, 12 in 2020-11-16T22:13:49.190 INFO:tasks.rados.rados.2.smithi057.stdout:3159: done (0 left) 2020-11-16T22:13:49.191 INFO:tasks.rados.rados.2.smithi057.stdout:3160: snap_create 2020-11-16T22:13:49.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:49 smithi057 bash[10301]: cluster 2020-11-16T22:13:47.820450+0000 mgr.x (mgr.24115) 635 : cluster [DBG] pgmap v1363: 17 pgs: 17 active+clean; 227 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 3.1 MiB/s wr, 23 op/s 2020-11-16T22:13:49.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:49 smithi057 bash[10301]: cluster 2020-11-16T22:13:48.198068+0000 mon.a (mon.0) 1473 : cluster [DBG] osdmap e799: 12 total, 12 up, 12 in 2020-11-16T22:13:49.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:49 smithi016 bash[10302]: cluster 2020-11-16T22:13:47.820450+0000 mgr.x (mgr.24115) 635 : cluster [DBG] pgmap v1363: 17 pgs: 17 active+clean; 227 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 3.1 MiB/s wr, 23 op/s 2020-11-16T22:13:49.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:49 smithi016 bash[10302]: cluster 2020-11-16T22:13:48.198068+0000 mon.a (mon.0) 1473 : cluster [DBG] osdmap e799: 12 total, 12 up, 12 in 2020-11-16T22:13:49.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:49 smithi195 bash[10218]: cluster 2020-11-16T22:13:47.820450+0000 mgr.x (mgr.24115) 635 : cluster [DBG] pgmap v1363: 17 pgs: 17 active+clean; 227 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 3.1 MiB/s wr, 23 op/s 2020-11-16T22:13:49.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:49 smithi195 bash[10218]: cluster 2020-11-16T22:13:48.198068+0000 mon.a (mon.0) 1473 : cluster [DBG] osdmap e799: 12 total, 12 up, 12 in 2020-11-16T22:13:50.156 INFO:tasks.rados.rados.2.smithi057.stdout:3160: done (0 left) 2020-11-16T22:13:50.157 INFO:tasks.rados.rados.2.smithi057.stdout:3161: read oid 12 snap 361 2020-11-16T22:13:50.157 INFO:tasks.rados.rados.2.smithi057.stdout:3161: expect (ObjNum 1019 snap 358 seq_num 1019) 2020-11-16T22:13:50.157 INFO:tasks.rados.rados.2.smithi057.stdout:3162: write oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 370 2020-11-16T22:13:50.157 INFO:tasks.rados.rados.2.smithi057.stdout:3162: seq_num 1050 ranges {447350=668164,1560093=406693,2584613=480437} 2020-11-16T22:13:50.168 INFO:tasks.rados.rados.2.smithi057.stdout:3162: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 447350 to 1115514 tid 1 2020-11-16T22:13:50.173 INFO:tasks.rados.rados.2.smithi057.stdout:3162: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1560093 to 1966786 tid 2 2020-11-16T22:13:50.180 INFO:tasks.rados.rados.2.smithi057.stdout:3162: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2584613 to 3065050 tid 3 2020-11-16T22:13:50.180 INFO:tasks.rados.rados.2.smithi057.stdout:3163: read oid 50 snap -1 2020-11-16T22:13:50.180 INFO:tasks.rados.rados.2.smithi057.stdout:3163: expect (ObjNum 1024 snap 360 seq_num 1024) 2020-11-16T22:13:50.180 INFO:tasks.rados.rados.2.smithi057.stdout:3164: delete oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 370 2020-11-16T22:13:50.180 INFO:tasks.rados.rados.2.smithi057.stdout:3161: expect (ObjNum 1019 snap 358 seq_num 1019) 2020-11-16T22:13:50.418 INFO:tasks.rados.rados.2.smithi057.stdout:3162: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:50.418 INFO:tasks.rados.rados.2.smithi057.stdout:3162: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:50.419 INFO:tasks.rados.rados.2.smithi057.stdout:3162: finishing write tid 3 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:50.419 INFO:tasks.rados.rados.2.smithi057.stdout:3162: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:50.419 INFO:tasks.rados.rados.2.smithi057.stdout:3162: finishing write tid 6 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:50.419 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2208 (ObjNum 1050 snap 370 seq_num 1050) dirty exists 2020-11-16T22:13:50.419 INFO:tasks.rados.rados.2.smithi057.stdout:3162: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1050 snap 370 seq_num 1050) 2020-11-16T22:13:50.419 INFO:tasks.rados.rados.2.smithi057.stdout:3163: expect (ObjNum 1024 snap 360 seq_num 1024) 2020-11-16T22:13:50.557 INFO:tasks.rados.rados.2.smithi057.stdout:3161: done (3 left) 2020-11-16T22:13:50.557 INFO:tasks.rados.rados.2.smithi057.stdout:3162: done (2 left) 2020-11-16T22:13:50.558 INFO:tasks.rados.rados.2.smithi057.stdout:3163: done (1 left) 2020-11-16T22:13:50.558 INFO:tasks.rados.rados.2.smithi057.stdout:3164: done (0 left) 2020-11-16T22:13:50.558 INFO:tasks.rados.rados.2.smithi057.stdout:3165: write oid 2 current snap is 370 2020-11-16T22:13:50.558 INFO:tasks.rados.rados.2.smithi057.stdout:3165: seq_num 1052 ranges {480964=418662,1560704=410362,2523106=619334} 2020-11-16T22:13:50.568 INFO:tasks.rados.rados.2.smithi057.stdout:3165: writing smithi05720651-2 from 480964 to 899626 tid 1 2020-11-16T22:13:50.574 INFO:tasks.rados.rados.2.smithi057.stdout:3165: writing smithi05720651-2 from 1560704 to 1971066 tid 2 2020-11-16T22:13:50.581 INFO:tasks.rados.rados.2.smithi057.stdout:3165: writing smithi05720651-2 from 2523106 to 3142440 tid 3 2020-11-16T22:13:50.581 INFO:tasks.rados.rados.2.smithi057.stdout:3166: read oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:50.582 INFO:tasks.rados.rados.2.smithi057.stdout:3166: expect deleted 2020-11-16T22:13:50.582 INFO:tasks.rados.rados.2.smithi057.stdout:3167: delete oid 34 current snap is 370 2020-11-16T22:13:50.582 INFO:tasks.rados.rados.2.smithi057.stdout:3165: finishing write tid 1 to smithi05720651-2 2020-11-16T22:13:50.582 INFO:tasks.rados.rados.2.smithi057.stdout:3165: finishing write tid 2 to smithi05720651-2 2020-11-16T22:13:50.587 INFO:tasks.rados.rados.2.smithi057.stdout:3167: done (2 left) 2020-11-16T22:13:50.587 INFO:tasks.rados.rados.2.smithi057.stdout:3168: rollback oid 22 current snap is 370 2020-11-16T22:13:50.587 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 22 to 364 2020-11-16T22:13:50.587 INFO:tasks.rados.rados.2.smithi057.stdout:3169: snap_create 2020-11-16T22:13:50.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:50 smithi016 bash[10302]: cluster 2020-11-16T22:13:49.199935+0000 mon.a (mon.0) 1474 : cluster [DBG] osdmap e800: 12 total, 12 up, 12 in 2020-11-16T22:13:50.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:50 smithi016 bash[10302]: cluster 2020-11-16T22:13:50.165973+0000 mon.a (mon.0) 1475 : cluster [DBG] osdmap e801: 12 total, 12 up, 12 in 2020-11-16T22:13:50.590 INFO:tasks.rados.rados.2.smithi057.stdout:3165: finishing write tid 3 to smithi05720651-2 2020-11-16T22:13:50.591 INFO:tasks.rados.rados.2.smithi057.stdout:3165: finishing write tid 5 to smithi05720651-2 2020-11-16T22:13:50.592 INFO:tasks.rados.rados.2.smithi057.stdout:3165: finishing write tid 6 to smithi05720651-2 2020-11-16T22:13:50.592 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 2562 (ObjNum 1052 snap 370 seq_num 1052) dirty exists 2020-11-16T22:13:50.592 INFO:tasks.rados.rados.2.smithi057.stdout:3165: left oid 2 (ObjNum 1052 snap 370 seq_num 1052) 2020-11-16T22:13:50.593 INFO:tasks.rados.rados.2.smithi057.stdout:3168: finishing rollback tid 0 to smithi05720651-22 2020-11-16T22:13:50.594 INFO:tasks.rados.rados.2.smithi057.stdout:3168: finishing rollback tid 1 to smithi05720651-22 2020-11-16T22:13:50.595 INFO:tasks.rados.rados.2.smithi057.stdout:3168: finishing rollback tid 2 to smithi05720651-22 2020-11-16T22:13:50.595 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 2387 (ObjNum 958 snap 329 seq_num 958) dirty exists 2020-11-16T22:13:50.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:50 smithi195 bash[10218]: cluster 2020-11-16T22:13:49.199935+0000 mon.a (mon.0) 1474 : cluster [DBG] osdmap e800: 12 total, 12 up, 12 in 2020-11-16T22:13:50.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:50 smithi195 bash[10218]: cluster 2020-11-16T22:13:50.165973+0000 mon.a (mon.0) 1475 : cluster [DBG] osdmap e801: 12 total, 12 up, 12 in 2020-11-16T22:13:50.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:50 smithi057 bash[10301]: cluster 2020-11-16T22:13:49.199935+0000 mon.a (mon.0) 1474 : cluster [DBG] osdmap e800: 12 total, 12 up, 12 in 2020-11-16T22:13:50.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:50 smithi057 bash[10301]: cluster 2020-11-16T22:13:50.165973+0000 mon.a (mon.0) 1475 : cluster [DBG] osdmap e801: 12 total, 12 up, 12 in 2020-11-16T22:13:51.216 INFO:tasks.rados.rados.2.smithi057.stdout:3165: done (3 left) 2020-11-16T22:13:51.217 INFO:tasks.rados.rados.2.smithi057.stdout:3166: done (2 left) 2020-11-16T22:13:51.217 INFO:tasks.rados.rados.2.smithi057.stdout:3168: done (1 left) 2020-11-16T22:13:51.217 INFO:tasks.rados.rados.2.smithi057.stdout:3169: done (0 left) 2020-11-16T22:13:51.217 INFO:tasks.rados.rados.2.smithi057.stdout:3170: delete oid 18 current snap is 371 2020-11-16T22:13:51.221 INFO:tasks.rados.rados.2.smithi057.stdout:3170: done (0 left) 2020-11-16T22:13:51.221 INFO:tasks.rados.rados.2.smithi057.stdout:3171: write (excl) oid 18 current snap is 371 2020-11-16T22:13:51.222 INFO:tasks.rados.rados.2.smithi057.stdout:3171: seq_num 1055 ranges {531385=644409,1736150=557689,3005375=569503} 2020-11-16T22:13:51.234 INFO:tasks.rados.rados.2.smithi057.stdout:3171: writing smithi05720651-18 from 531385 to 1175794 tid 1 2020-11-16T22:13:51.241 INFO:tasks.rados.rados.2.smithi057.stdout:3171: writing smithi05720651-18 from 1736150 to 2293839 tid 2 2020-11-16T22:13:51.248 INFO:tasks.rados.rados.2.smithi057.stdout:3171: writing smithi05720651-18 from 3005375 to 3574878 tid 3 2020-11-16T22:13:51.248 INFO:tasks.rados.rados.2.smithi057.stdout:3172: write (excl) oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 371 2020-11-16T22:13:51.249 INFO:tasks.rados.rados.2.smithi057.stdout:3172: seq_num 1056 ranges {548192=719658,1678279=417700,2516445=780775} 2020-11-16T22:13:51.255 INFO:tasks.rados.rados.2.smithi057.stdout:3172: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 548192 to 1267850 tid 1 2020-11-16T22:13:51.260 INFO:tasks.rados.rados.2.smithi057.stdout:3172: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1678279 to 2095979 tid 2 2020-11-16T22:13:51.267 INFO:tasks.rados.rados.2.smithi057.stdout:3172: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2516445 to 3297220 tid 3 2020-11-16T22:13:51.267 INFO:tasks.rados.rados.2.smithi057.stdout:3173: read oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:13:51.267 INFO:tasks.rados.rados.2.smithi057.stdout:3173: expect (ObjNum 949 snap 328 seq_num 949) 2020-11-16T22:13:51.268 INFO:tasks.rados.rados.2.smithi057.stdout:3174: snap_remove snap 365 2020-11-16T22:13:51.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:51 smithi016 bash[10302]: cluster 2020-11-16T22:13:49.821125+0000 mgr.x (mgr.24115) 636 : cluster [DBG] pgmap v1366: 17 pgs: 17 active+clean; 227 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 0 B/s wr, 3 op/s 2020-11-16T22:13:51.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:51 smithi195 bash[10218]: cluster 2020-11-16T22:13:49.821125+0000 mgr.x (mgr.24115) 636 : cluster [DBG] pgmap v1366: 17 pgs: 17 active+clean; 227 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 0 B/s wr, 3 op/s 2020-11-16T22:13:51.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:51 smithi057 bash[10301]: cluster 2020-11-16T22:13:49.821125+0000 mgr.x (mgr.24115) 636 : cluster [DBG] pgmap v1366: 17 pgs: 17 active+clean; 227 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 0 B/s wr, 3 op/s 2020-11-16T22:13:52.230 INFO:tasks.rados.rados.2.smithi057.stdout:3174: done (3 left) 2020-11-16T22:13:52.231 INFO:tasks.rados.rados.2.smithi057.stdout:3175: snap_remove snap 353 2020-11-16T22:13:52.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:52 smithi016 bash[10302]: cluster 2020-11-16T22:13:51.227116+0000 mon.a (mon.0) 1476 : cluster [DBG] osdmap e802: 12 total, 12 up, 12 in 2020-11-16T22:13:52.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:52 smithi195 bash[10218]: cluster 2020-11-16T22:13:51.227116+0000 mon.a (mon.0) 1476 : cluster [DBG] osdmap e802: 12 total, 12 up, 12 in 2020-11-16T22:13:52.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:52 smithi057 bash[10301]: cluster 2020-11-16T22:13:51.227116+0000 mon.a (mon.0) 1476 : cluster [DBG] osdmap e802: 12 total, 12 up, 12 in 2020-11-16T22:13:53.233 INFO:tasks.rados.rados.2.smithi057.stdout:3175: done (3 left) 2020-11-16T22:13:53.233 INFO:tasks.rados.rados.2.smithi057.stdout:3176: snap_create 2020-11-16T22:13:53.233 INFO:tasks.rados.rados.2.smithi057.stdout:3171: finishing write tid 1 to smithi05720651-18 2020-11-16T22:13:53.233 INFO:tasks.rados.rados.2.smithi057.stdout:3171: finishing write tid 2 to smithi05720651-18 2020-11-16T22:13:53.233 INFO:tasks.rados.rados.2.smithi057.stdout:3171: finishing write tid 3 to smithi05720651-18 2020-11-16T22:13:53.233 INFO:tasks.rados.rados.2.smithi057.stdout:3171: finishing write tid 5 to smithi05720651-18 2020-11-16T22:13:53.234 INFO:tasks.rados.rados.2.smithi057.stdout:3171: finishing write tid 6 to smithi05720651-18 2020-11-16T22:13:53.234 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 2221 (ObjNum 1055 snap 371 seq_num 1055) dirty exists 2020-11-16T22:13:53.234 INFO:tasks.rados.rados.2.smithi057.stdout:3171: left oid 18 (ObjNum 1055 snap 371 seq_num 1055) 2020-11-16T22:13:53.234 INFO:tasks.rados.rados.2.smithi057.stdout:3172: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:53.234 INFO:tasks.rados.rados.2.smithi057.stdout:3172: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:53.234 INFO:tasks.rados.rados.2.smithi057.stdout:3172: finishing write tid 3 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:53.235 INFO:tasks.rados.rados.2.smithi057.stdout:3172: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:53.235 INFO:tasks.rados.rados.2.smithi057.stdout:3172: finishing write tid 6 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:53.235 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1809 (ObjNum 1056 snap 371 seq_num 1056) dirty exists 2020-11-16T22:13:53.235 INFO:tasks.rados.rados.2.smithi057.stdout:3172: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1056 snap 371 seq_num 1056) 2020-11-16T22:13:53.235 INFO:tasks.rados.rados.2.smithi057.stdout:3173: expect (ObjNum 949 snap 328 seq_num 949) 2020-11-16T22:13:53.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:53 smithi016 bash[10302]: cluster 2020-11-16T22:13:51.821832+0000 mgr.x (mgr.24115) 637 : cluster [DBG] pgmap v1369: 17 pgs: 17 active+clean; 254 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 5.5 MiB/s wr, 29 op/s 2020-11-16T22:13:53.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:53 smithi016 bash[10302]: cluster 2020-11-16T22:13:52.239321+0000 mon.a (mon.0) 1477 : cluster [DBG] osdmap e803: 12 total, 12 up, 12 in 2020-11-16T22:13:53.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:53 smithi195 bash[10218]: cluster 2020-11-16T22:13:51.821832+0000 mgr.x (mgr.24115) 637 : cluster [DBG] pgmap v1369: 17 pgs: 17 active+clean; 254 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 5.5 MiB/s wr, 29 op/s 2020-11-16T22:13:53.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:53 smithi195 bash[10218]: cluster 2020-11-16T22:13:52.239321+0000 mon.a (mon.0) 1477 : cluster [DBG] osdmap e803: 12 total, 12 up, 12 in 2020-11-16T22:13:53.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:53 smithi057 bash[10301]: cluster 2020-11-16T22:13:51.821832+0000 mgr.x (mgr.24115) 637 : cluster [DBG] pgmap v1369: 17 pgs: 17 active+clean; 254 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 5.5 MiB/s wr, 29 op/s 2020-11-16T22:13:53.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:53 smithi057 bash[10301]: cluster 2020-11-16T22:13:52.239321+0000 mon.a (mon.0) 1477 : cluster [DBG] osdmap e803: 12 total, 12 up, 12 in 2020-11-16T22:13:54.255 INFO:tasks.rados.rados.2.smithi057.stdout:3171: done (3 left) 2020-11-16T22:13:54.255 INFO:tasks.rados.rados.2.smithi057.stdout:3172: done (2 left) 2020-11-16T22:13:54.255 INFO:tasks.rados.rados.2.smithi057.stdout:3173: done (1 left) 2020-11-16T22:13:54.255 INFO:tasks.rados.rados.2.smithi057.stdout:3176: done (0 left) 2020-11-16T22:13:54.256 INFO:tasks.rados.rados.2.smithi057.stdout:3177: snap_remove snap 344 2020-11-16T22:13:54.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:54 smithi016 bash[10302]: cluster 2020-11-16T22:13:53.241931+0000 mon.a (mon.0) 1478 : cluster [DBG] osdmap e804: 12 total, 12 up, 12 in 2020-11-16T22:13:54.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:54 smithi195 bash[10218]: cluster 2020-11-16T22:13:53.241931+0000 mon.a (mon.0) 1478 : cluster [DBG] osdmap e804: 12 total, 12 up, 12 in 2020-11-16T22:13:54.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:54 smithi057 bash[10301]: cluster 2020-11-16T22:13:53.241931+0000 mon.a (mon.0) 1478 : cluster [DBG] osdmap e804: 12 total, 12 up, 12 in 2020-11-16T22:13:55.158 INFO:tasks.rados.rados.2.smithi057.stdout:3177: done (0 left) 2020-11-16T22:13:55.158 INFO:tasks.rados.rados.2.smithi057.stdout:3178: delete oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 372 2020-11-16T22:13:55.169 INFO:tasks.rados.rados.2.smithi057.stdout:3178: done (0 left) 2020-11-16T22:13:55.169 INFO:tasks.rados.rados.2.smithi057.stdout:3179: write oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 372 2020-11-16T22:13:55.169 INFO:tasks.rados.rados.2.smithi057.stdout:3179: seq_num 1058 ranges {581806=586509,1911596=421369,3087644=403319} 2020-11-16T22:13:55.183 INFO:tasks.rados.rados.2.smithi057.stdout:3179: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 581806 to 1168315 tid 1 2020-11-16T22:13:55.192 INFO:tasks.rados.rados.2.smithi057.stdout:3179: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1911596 to 2332965 tid 2 2020-11-16T22:13:55.199 INFO:tasks.rados.rados.2.smithi057.stdout:3179: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3087644 to 3490963 tid 3 2020-11-16T22:13:55.199 INFO:tasks.rados.rados.2.smithi057.stdout:3180: copy_from oid 22 from oid 26 current snap is 372 2020-11-16T22:13:55.199 INFO:tasks.rados.rados.2.smithi057.stdout:3181: rollback oid 30 current snap is 372 2020-11-16T22:13:55.199 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 30 to 366 2020-11-16T22:13:55.199 INFO:tasks.rados.rados.2.smithi057.stdout:3182: copy_from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 372 2020-11-16T22:13:55.199 INFO:tasks.rados.rados.2.smithi057.stdout:3183: write (excl) oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 372 2020-11-16T22:13:55.200 INFO:tasks.rados.rados.2.smithi057.stdout:3183: seq_num 1059 ranges {598613=661758,1970078=565027,3115067=614591} 2020-11-16T22:13:55.210 INFO:tasks.rados.rados.2.smithi057.stdout:3183: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 598613 to 1260371 tid 1 2020-11-16T22:13:55.216 INFO:tasks.rados.rados.2.smithi057.stdout:3183: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1970078 to 2535105 tid 2 2020-11-16T22:13:55.223 INFO:tasks.rados.rados.2.smithi057.stdout:3183: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3115067 to 3729658 tid 3 2020-11-16T22:13:55.223 INFO:tasks.rados.rados.2.smithi057.stdout:3184: snap_remove snap 364 2020-11-16T22:13:55.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:55 smithi016 bash[10302]: cluster 2020-11-16T22:13:53.822546+0000 mgr.x (mgr.24115) 638 : cluster [DBG] pgmap v1372: 17 pgs: 17 active+clean; 254 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 5.5 MiB/s wr, 29 op/s 2020-11-16T22:13:55.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:55 smithi016 bash[10302]: cluster 2020-11-16T22:13:54.264204+0000 mon.a (mon.0) 1479 : cluster [DBG] osdmap e805: 12 total, 12 up, 12 in 2020-11-16T22:13:55.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:55 smithi016 bash[10302]: cluster 2020-11-16T22:13:55.166712+0000 mon.a (mon.0) 1480 : cluster [DBG] osdmap e806: 12 total, 12 up, 12 in 2020-11-16T22:13:55.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:55 smithi195 bash[10218]: cluster 2020-11-16T22:13:53.822546+0000 mgr.x (mgr.24115) 638 : cluster [DBG] pgmap v1372: 17 pgs: 17 active+clean; 254 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 5.5 MiB/s wr, 29 op/s 2020-11-16T22:13:55.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:55 smithi195 bash[10218]: cluster 2020-11-16T22:13:54.264204+0000 mon.a (mon.0) 1479 : cluster [DBG] osdmap e805: 12 total, 12 up, 12 in 2020-11-16T22:13:55.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:55 smithi195 bash[10218]: cluster 2020-11-16T22:13:55.166712+0000 mon.a (mon.0) 1480 : cluster [DBG] osdmap e806: 12 total, 12 up, 12 in 2020-11-16T22:13:55.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:55 smithi057 bash[10301]: cluster 2020-11-16T22:13:53.822546+0000 mgr.x (mgr.24115) 638 : cluster [DBG] pgmap v1372: 17 pgs: 17 active+clean; 254 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 5.5 MiB/s wr, 29 op/s 2020-11-16T22:13:55.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:55 smithi057 bash[10301]: cluster 2020-11-16T22:13:54.264204+0000 mon.a (mon.0) 1479 : cluster [DBG] osdmap e805: 12 total, 12 up, 12 in 2020-11-16T22:13:55.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:55 smithi057 bash[10301]: cluster 2020-11-16T22:13:55.166712+0000 mon.a (mon.0) 1480 : cluster [DBG] osdmap e806: 12 total, 12 up, 12 in 2020-11-16T22:13:56.171 INFO:tasks.rados.rados.2.smithi057.stdout:3184: done (5 left) 2020-11-16T22:13:56.171 INFO:tasks.rados.rados.2.smithi057.stdout:3185: rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 372 2020-11-16T22:13:56.172 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 371 2020-11-16T22:13:56.172 INFO:tasks.rados.rados.2.smithi057.stdout:3179: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:56.172 INFO:tasks.rados.rados.2.smithi057.stdout:3179: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:56.172 INFO:tasks.rados.rados.2.smithi057.stdout:3179: finishing write tid 3 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:56.172 INFO:tasks.rados.rados.2.smithi057.stdout:3181: finishing rollback tid 0 to smithi05720651-30 2020-11-16T22:13:56.172 INFO:tasks.rados.rados.2.smithi057.stdout:3179: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:56.173 INFO:tasks.rados.rados.2.smithi057.stdout:3179: finishing write tid 6 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:56.173 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1813 (ObjNum 1058 snap 372 seq_num 1058) dirty exists 2020-11-16T22:13:56.173 INFO:tasks.rados.rados.2.smithi057.stdout:3179: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1058 snap 372 seq_num 1058) 2020-11-16T22:13:56.173 INFO:tasks.rados.rados.2.smithi057.stdout:3182: finishing copy_from to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:56.173 INFO:tasks.rados.rados.2.smithi057.stdout:3182: got expected ENOENT (src dne) 2020-11-16T22:13:56.173 INFO:tasks.rados.rados.2.smithi057.stdout:3182: finishing copy_from racing read to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:56.173 INFO:tasks.rados.rados.2.smithi057.stdout:3181: finishing rollback tid 1 to smithi05720651-30 2020-11-16T22:13:56.174 INFO:tasks.rados.rados.2.smithi057.stdout:3181: finishing rollback tid 2 to smithi05720651-30 2020-11-16T22:13:56.174 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 2518 (ObjNum 1027 snap 361 seq_num 1027) dirty exists 2020-11-16T22:13:56.174 INFO:tasks.rados.rados.2.smithi057.stdout:3183: finishing write tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:56.174 INFO:tasks.rados.rados.2.smithi057.stdout:3183: finishing write tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:56.174 INFO:tasks.rados.rados.2.smithi057.stdout:3180: finishing copy_from to smithi05720651-22 2020-11-16T22:13:56.174 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 2515 (ObjNum 1027 snap 361 seq_num 1027) dirty exists 2020-11-16T22:13:56.174 INFO:tasks.rados.rados.2.smithi057.stdout:3180: finishing copy_from racing read to smithi05720651-22 2020-11-16T22:13:56.175 INFO:tasks.rados.rados.2.smithi057.stdout:3183: finishing write tid 3 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:56.175 INFO:tasks.rados.rados.2.smithi057.stdout:3183: finishing write tid 5 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:56.175 INFO:tasks.rados.rados.2.smithi057.stdout:3183: finishing write tid 6 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:56.175 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2522 (ObjNum 1059 snap 372 seq_num 1059) dirty exists 2020-11-16T22:13:56.175 INFO:tasks.rados.rados.2.smithi057.stdout:3183: left oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1059 snap 372 seq_num 1059) 2020-11-16T22:13:56.175 INFO:tasks.rados.rados.2.smithi057.stdout:3179: done (5 left) 2020-11-16T22:13:56.175 INFO:tasks.rados.rados.2.smithi057.stdout:3180: done (4 left) 2020-11-16T22:13:56.176 INFO:tasks.rados.rados.2.smithi057.stdout:3181: done (3 left) 2020-11-16T22:13:56.176 INFO:tasks.rados.rados.2.smithi057.stdout:3182: done (2 left) 2020-11-16T22:13:56.176 INFO:tasks.rados.rados.2.smithi057.stdout:3183: done (1 left) 2020-11-16T22:13:56.176 INFO:tasks.rados.rados.2.smithi057.stdout:3186: snap_create 2020-11-16T22:13:56.183 INFO:tasks.rados.rados.2.smithi057.stdout:3185: finishing rollback tid 0 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:56.185 INFO:tasks.rados.rados.2.smithi057.stdout:3185: finishing rollback tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:56.185 INFO:tasks.rados.rados.2.smithi057.stdout:3185: finishing rollback tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:13:56.186 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2257 (ObjNum 949 snap 328 seq_num 949) dirty exists 2020-11-16T22:13:57.174 INFO:tasks.rados.rados.2.smithi057.stdout:3185: done (1 left) 2020-11-16T22:13:57.174 INFO:tasks.rados.rados.2.smithi057.stdout:3186: done (0 left) 2020-11-16T22:13:57.174 INFO:tasks.rados.rados.2.smithi057.stdout:3187: delete oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 373 2020-11-16T22:13:57.184 INFO:tasks.rados.rados.2.smithi057.stdout:3187: done (0 left) 2020-11-16T22:13:57.184 INFO:tasks.rados.rados.2.smithi057.stdout:3188: read oid 36 snap -1 2020-11-16T22:13:57.184 INFO:tasks.rados.rados.2.smithi057.stdout:3188: expect deleted 2020-11-16T22:13:57.184 INFO:tasks.rados.rados.2.smithi057.stdout:3189: write (excl) oid 20 current snap is 373 2020-11-16T22:13:57.184 INFO:tasks.rados.rados.2.smithi057.stdout:3189: seq_num 1061 ranges {632227=412256,1570689=568696,2653560=753488} 2020-11-16T22:13:57.199 INFO:tasks.rados.rados.2.smithi057.stdout:3189: writing smithi05720651-20 from 632227 to 1044483 tid 1 2020-11-16T22:13:57.205 INFO:tasks.rados.rados.2.smithi057.stdout:3189: writing smithi05720651-20 from 1570689 to 2139385 tid 2 2020-11-16T22:13:57.213 INFO:tasks.rados.rados.2.smithi057.stdout:3189: writing smithi05720651-20 from 2653560 to 3407048 tid 3 2020-11-16T22:13:57.213 INFO:tasks.rados.rados.2.smithi057.stdout:3190: snap_remove snap 369 2020-11-16T22:13:57.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:57 smithi057 bash[10301]: cluster 2020-11-16T22:13:55.823249+0000 mgr.x (mgr.24115) 639 : cluster [DBG] pgmap v1375: 17 pgs: 17 active+clean; 258 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2020-11-16T22:13:57.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:57 smithi057 bash[10301]: cluster 2020-11-16T22:13:56.180604+0000 mon.a (mon.0) 1481 : cluster [DBG] osdmap e807: 12 total, 12 up, 12 in 2020-11-16T22:13:57.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:57 smithi016 bash[10302]: cluster 2020-11-16T22:13:55.823249+0000 mgr.x (mgr.24115) 639 : cluster [DBG] pgmap v1375: 17 pgs: 17 active+clean; 258 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2020-11-16T22:13:57.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:57 smithi016 bash[10302]: cluster 2020-11-16T22:13:56.180604+0000 mon.a (mon.0) 1481 : cluster [DBG] osdmap e807: 12 total, 12 up, 12 in 2020-11-16T22:13:57.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:57 smithi195 bash[10218]: cluster 2020-11-16T22:13:55.823249+0000 mgr.x (mgr.24115) 639 : cluster [DBG] pgmap v1375: 17 pgs: 17 active+clean; 258 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 1.6 MiB/s wr, 12 op/s 2020-11-16T22:13:57.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:57 smithi195 bash[10218]: cluster 2020-11-16T22:13:56.180604+0000 mon.a (mon.0) 1481 : cluster [DBG] osdmap e807: 12 total, 12 up, 12 in 2020-11-16T22:13:58.202 INFO:tasks.rados.rados.2.smithi057.stdout:3190: done (2 left) 2020-11-16T22:13:58.202 INFO:tasks.rados.rados.2.smithi057.stdout:3191: delete oid 48 current snap is 373 2020-11-16T22:13:58.203 INFO:tasks.rados.rados.2.smithi057.stdout:3189: finishing write tid 1 to smithi05720651-20 2020-11-16T22:13:58.203 INFO:tasks.rados.rados.2.smithi057.stdout:3189: finishing write tid 2 to smithi05720651-20 2020-11-16T22:13:58.203 INFO:tasks.rados.rados.2.smithi057.stdout:3189: finishing write tid 3 to smithi05720651-20 2020-11-16T22:13:58.203 INFO:tasks.rados.rados.2.smithi057.stdout:3189: finishing write tid 5 to smithi05720651-20 2020-11-16T22:13:58.203 INFO:tasks.rados.rados.2.smithi057.stdout:3189: finishing write tid 6 to smithi05720651-20 2020-11-16T22:13:58.204 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 2194 (ObjNum 1061 snap 373 seq_num 1061) dirty exists 2020-11-16T22:13:58.204 INFO:tasks.rados.rados.2.smithi057.stdout:3189: left oid 20 (ObjNum 1061 snap 373 seq_num 1061) 2020-11-16T22:13:58.210 INFO:tasks.rados.rados.2.smithi057.stdout:3188: done (2 left) 2020-11-16T22:13:58.211 INFO:tasks.rados.rados.2.smithi057.stdout:3189: done (1 left) 2020-11-16T22:13:58.211 INFO:tasks.rados.rados.2.smithi057.stdout:3191: done (0 left) 2020-11-16T22:13:58.211 INFO:tasks.rados.rados.2.smithi057.stdout:3192: snap_create 2020-11-16T22:13:58.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:58 smithi057 bash[10301]: cluster 2020-11-16T22:13:57.183557+0000 mon.a (mon.0) 1482 : cluster [DBG] osdmap e808: 12 total, 12 up, 12 in 2020-11-16T22:13:58.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:58 smithi016 bash[10302]: cluster 2020-11-16T22:13:57.183557+0000 mon.a (mon.0) 1482 : cluster [DBG] osdmap e808: 12 total, 12 up, 12 in 2020-11-16T22:13:58.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:58 smithi195 bash[10218]: cluster 2020-11-16T22:13:57.183557+0000 mon.a (mon.0) 1482 : cluster [DBG] osdmap e808: 12 total, 12 up, 12 in 2020-11-16T22:13:59.204 INFO:tasks.rados.rados.2.smithi057.stdout:3192: done (0 left) 2020-11-16T22:13:59.204 INFO:tasks.rados.rados.2.smithi057.stdout:3193: write (excl) oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 374 2020-11-16T22:13:59.205 INFO:tasks.rados.rados.2.smithi057.stdout:3193: seq_num 1063 ranges {665841=562754,1687653=572365,2708406=776032} 2020-11-16T22:13:59.216 INFO:tasks.rados.rados.2.smithi057.stdout:3193: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 665841 to 1228595 tid 1 2020-11-16T22:13:59.223 INFO:tasks.rados.rados.2.smithi057.stdout:3193: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1687653 to 2260018 tid 2 2020-11-16T22:13:59.230 INFO:tasks.rados.rados.2.smithi057.stdout:3193: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2708406 to 3484438 tid 3 2020-11-16T22:13:59.230 INFO:tasks.rados.rados.2.smithi057.stdout:3194: snap_remove snap 362 2020-11-16T22:13:59.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:59 smithi016 bash[10302]: cluster 2020-11-16T22:13:57.823969+0000 mgr.x (mgr.24115) 640 : cluster [DBG] pgmap v1378: 17 pgs: 17 active+clean; 260 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2020-11-16T22:13:59.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:13:59 smithi016 bash[10302]: cluster 2020-11-16T22:13:58.211894+0000 mon.a (mon.0) 1483 : cluster [DBG] osdmap e809: 12 total, 12 up, 12 in 2020-11-16T22:13:59.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:59 smithi195 bash[10218]: cluster 2020-11-16T22:13:57.823969+0000 mgr.x (mgr.24115) 640 : cluster [DBG] pgmap v1378: 17 pgs: 17 active+clean; 260 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2020-11-16T22:13:59.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:13:59 smithi195 bash[10218]: cluster 2020-11-16T22:13:58.211894+0000 mon.a (mon.0) 1483 : cluster [DBG] osdmap e809: 12 total, 12 up, 12 in 2020-11-16T22:13:59.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:59 smithi057 bash[10301]: cluster 2020-11-16T22:13:57.823969+0000 mgr.x (mgr.24115) 640 : cluster [DBG] pgmap v1378: 17 pgs: 17 active+clean; 260 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 2.0 MiB/s wr, 13 op/s 2020-11-16T22:13:59.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:13:59 smithi057 bash[10301]: cluster 2020-11-16T22:13:58.211894+0000 mon.a (mon.0) 1483 : cluster [DBG] osdmap e809: 12 total, 12 up, 12 in 2020-11-16T22:14:00.162 INFO:tasks.rados.rados.2.smithi057.stdout:3194: done (1 left) 2020-11-16T22:14:00.163 INFO:tasks.rados.rados.2.smithi057.stdout:3195: write (excl) oid 46 current snap is 374 2020-11-16T22:14:00.163 INFO:tasks.rados.rados.2.smithi057.stdout:3195: seq_num 1064 ranges {682648=638003,2029782=432376,3019476=587304} 2020-11-16T22:14:00.175 INFO:tasks.rados.rados.2.smithi057.stdout:3195: writing smithi05720651-46 from 682648 to 1320651 tid 1 2020-11-16T22:14:00.182 INFO:tasks.rados.rados.2.smithi057.stdout:3195: writing smithi05720651-46 from 2029782 to 2462158 tid 2 2020-11-16T22:14:00.189 INFO:tasks.rados.rados.2.smithi057.stdout:3195: writing smithi05720651-46 from 3019476 to 3606780 tid 3 2020-11-16T22:14:00.189 INFO:tasks.rados.rados.2.smithi057.stdout:3196: rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 374 2020-11-16T22:14:00.189 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 373 2020-11-16T22:14:00.189 INFO:tasks.rados.rados.2.smithi057.stdout:3193: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:00.190 INFO:tasks.rados.rados.2.smithi057.stdout:3193: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:00.190 INFO:tasks.rados.rados.2.smithi057.stdout:3193: finishing write tid 3 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:00.190 INFO:tasks.rados.rados.2.smithi057.stdout:3193: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:00.190 INFO:tasks.rados.rados.2.smithi057.stdout:3193: finishing write tid 6 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:00.190 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2221 (ObjNum 1063 snap 374 seq_num 1063) dirty exists 2020-11-16T22:14:00.190 INFO:tasks.rados.rados.2.smithi057.stdout:3193: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1063 snap 374 seq_num 1063) 2020-11-16T22:14:00.190 INFO:tasks.rados.rados.2.smithi057.stdout:3195: finishing write tid 1 to smithi05720651-46 2020-11-16T22:14:00.191 INFO:tasks.rados.rados.2.smithi057.stdout:3193: done (2 left) 2020-11-16T22:14:00.191 INFO:tasks.rados.rados.2.smithi057.stdout:3197: snap_create 2020-11-16T22:14:00.197 INFO:tasks.rados.rados.2.smithi057.stdout:3195: finishing write tid 2 to smithi05720651-46 2020-11-16T22:14:00.197 INFO:tasks.rados.rados.2.smithi057.stdout:3195: finishing write tid 3 to smithi05720651-46 2020-11-16T22:14:00.197 INFO:tasks.rados.rados.2.smithi057.stdout:3195: finishing write tid 5 to smithi05720651-46 2020-11-16T22:14:00.204 INFO:tasks.rados.rados.2.smithi057.stdout:3196: finishing rollback tid 0 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:00.205 INFO:tasks.rados.rados.2.smithi057.stdout:3196: finishing rollback tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:00.206 INFO:tasks.rados.rados.2.smithi057.stdout:3196: finishing rollback tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:00.206 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2271 (ObjNum 949 snap 328 seq_num 949) dirty exists 2020-11-16T22:14:00.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:00 smithi016 bash[10302]: cluster 2020-11-16T22:13:59.214668+0000 mon.a (mon.0) 1484 : cluster [DBG] osdmap e810: 12 total, 12 up, 12 in 2020-11-16T22:14:00.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:00 smithi016 bash[10302]: cluster 2020-11-16T22:14:00.169884+0000 mon.a (mon.0) 1485 : cluster [DBG] osdmap e811: 12 total, 12 up, 12 in 2020-11-16T22:14:00.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:00 smithi195 bash[10218]: cluster 2020-11-16T22:13:59.214668+0000 mon.a (mon.0) 1484 : cluster [DBG] osdmap e810: 12 total, 12 up, 12 in 2020-11-16T22:14:00.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:00 smithi195 bash[10218]: cluster 2020-11-16T22:14:00.169884+0000 mon.a (mon.0) 1485 : cluster [DBG] osdmap e811: 12 total, 12 up, 12 in 2020-11-16T22:14:00.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:00 smithi057 bash[10301]: cluster 2020-11-16T22:13:59.214668+0000 mon.a (mon.0) 1484 : cluster [DBG] osdmap e810: 12 total, 12 up, 12 in 2020-11-16T22:14:00.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:00 smithi057 bash[10301]: cluster 2020-11-16T22:14:00.169884+0000 mon.a (mon.0) 1485 : cluster [DBG] osdmap e811: 12 total, 12 up, 12 in 2020-11-16T22:14:01.174 INFO:tasks.rados.rados.2.smithi057.stdout:3196: done (2 left) 2020-11-16T22:14:01.174 INFO:tasks.rados.rados.2.smithi057.stdout:3197: done (1 left) 2020-11-16T22:14:01.175 INFO:tasks.rados.rados.2.smithi057.stdout:3198: rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 375 2020-11-16T22:14:01.175 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 350 2020-11-16T22:14:01.175 INFO:tasks.rados.rados.2.smithi057.stdout:3199: read oid 24 snap -1 2020-11-16T22:14:01.175 INFO:tasks.rados.rados.2.smithi057.stdout:3199: expect (ObjNum 1034 snap 364 seq_num 1034) 2020-11-16T22:14:01.175 INFO:tasks.rados.rados.2.smithi057.stdout:3200: write oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 375 2020-11-16T22:14:01.175 INFO:tasks.rados.rados.2.smithi057.stdout:3200: seq_num 1065 ranges {699455=429605,1804617=576034,3163252=514929} 2020-11-16T22:14:01.185 INFO:tasks.rados.rados.2.smithi057.stdout:3200: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 699455 to 1129060 tid 1 2020-11-16T22:14:01.193 INFO:tasks.rados.rados.2.smithi057.stdout:3200: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1804617 to 2380651 tid 2 2020-11-16T22:14:01.201 INFO:tasks.rados.rados.2.smithi057.stdout:3200: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3163252 to 3678181 tid 3 2020-11-16T22:14:01.201 INFO:tasks.rados.rados.2.smithi057.stdout:3201: read oid 50 snap 372 2020-11-16T22:14:01.201 INFO:tasks.rados.rados.2.smithi057.stdout:3201: expect (ObjNum 1024 snap 360 seq_num 1024) 2020-11-16T22:14:01.202 INFO:tasks.rados.rados.2.smithi057.stdout:3202: copy_from oid 40 from oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 375 2020-11-16T22:14:01.202 INFO:tasks.rados.rados.2.smithi057.stdout:3195: finishing write tid 6 to smithi05720651-46 2020-11-16T22:14:01.202 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 2526 (ObjNum 1064 snap 374 seq_num 1064) dirty exists 2020-11-16T22:14:01.202 INFO:tasks.rados.rados.2.smithi057.stdout:3195: left oid 46 (ObjNum 1064 snap 374 seq_num 1064) 2020-11-16T22:14:01.202 INFO:tasks.rados.rados.2.smithi057.stdout:3195: done (5 left) 2020-11-16T22:14:01.202 INFO:tasks.rados.rados.2.smithi057.stdout:3203: copy_from oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 12 current snap is 375 2020-11-16T22:14:01.203 INFO:tasks.rados.rados.2.smithi057.stdout:3198: finishing rollback tid 0 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.203 INFO:tasks.rados.rados.2.smithi057.stdout:3198: finishing rollback tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.203 INFO:tasks.rados.rados.2.smithi057.stdout:3198: finishing rollback tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.203 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2529 (ObjNum 991 snap 348 seq_num 991) dirty exists 2020-11-16T22:14:01.203 INFO:tasks.rados.rados.2.smithi057.stdout:3199: expect (ObjNum 1034 snap 364 seq_num 1034) 2020-11-16T22:14:01.459 INFO:tasks.rados.rados.2.smithi057.stdout:3200: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.460 INFO:tasks.rados.rados.2.smithi057.stdout:3200: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.460 INFO:tasks.rados.rados.2.smithi057.stdout:3200: finishing write tid 3 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.460 INFO:tasks.rados.rados.2.smithi057.stdout:3200: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.460 INFO:tasks.rados.rados.2.smithi057.stdout:3200: finishing write tid 6 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.460 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2225 (ObjNum 1065 snap 375 seq_num 1065) dirty exists 2020-11-16T22:14:01.460 INFO:tasks.rados.rados.2.smithi057.stdout:3200: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1065 snap 375 seq_num 1065) 2020-11-16T22:14:01.461 INFO:tasks.rados.rados.2.smithi057.stdout:3201: expect (ObjNum 1024 snap 360 seq_num 1024) 2020-11-16T22:14:01.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:01 smithi016 bash[10302]: cluster 2020-11-16T22:13:59.824672+0000 mgr.x (mgr.24115) 641 : cluster [DBG] pgmap v1381: 17 pgs: 17 active+clean; 259 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.6 MiB/s wr, 3 op/s 2020-11-16T22:14:01.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:01 smithi016 bash[10302]: cluster 2020-11-16T22:14:01.183617+0000 mon.a (mon.0) 1486 : cluster [DBG] osdmap e812: 12 total, 12 up, 12 in 2020-11-16T22:14:01.599 INFO:tasks.rados.rados.2.smithi057.stdout:3203: finishing copy_from to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.599 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2384 (ObjNum 1019 snap 358 seq_num 1019) dirty exists 2020-11-16T22:14:01.599 INFO:tasks.rados.rados.2.smithi057.stdout:3203: finishing copy_from racing read to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.599 INFO:tasks.rados.rados.2.smithi057.stdout:3202: finishing copy_from to smithi05720651-40 2020-11-16T22:14:01.599 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 2209 (ObjNum 1028 snap 361 seq_num 1028) dirty exists 2020-11-16T22:14:01.599 INFO:tasks.rados.rados.2.smithi057.stdout:3202: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:14:01.600 INFO:tasks.rados.rados.2.smithi057.stdout:3198: done (5 left) 2020-11-16T22:14:01.600 INFO:tasks.rados.rados.2.smithi057.stdout:3199: done (4 left) 2020-11-16T22:14:01.600 INFO:tasks.rados.rados.2.smithi057.stdout:3200: done (3 left) 2020-11-16T22:14:01.600 INFO:tasks.rados.rados.2.smithi057.stdout:3201: done (2 left) 2020-11-16T22:14:01.600 INFO:tasks.rados.rados.2.smithi057.stdout:3202: done (1 left) 2020-11-16T22:14:01.600 INFO:tasks.rados.rados.2.smithi057.stdout:3203: done (0 left) 2020-11-16T22:14:01.600 INFO:tasks.rados.rados.2.smithi057.stdout:3204: delete oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 375 2020-11-16T22:14:01.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:01 smithi195 bash[10218]: cluster 2020-11-16T22:13:59.824672+0000 mgr.x (mgr.24115) 641 : cluster [DBG] pgmap v1381: 17 pgs: 17 active+clean; 259 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.6 MiB/s wr, 3 op/s 2020-11-16T22:14:01.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:01 smithi195 bash[10218]: cluster 2020-11-16T22:14:01.183617+0000 mon.a (mon.0) 1486 : cluster [DBG] osdmap e812: 12 total, 12 up, 12 in 2020-11-16T22:14:01.603 INFO:tasks.rados.rados.2.smithi057.stdout:3204: done (0 left) 2020-11-16T22:14:01.604 INFO:tasks.rados.rados.2.smithi057.stdout:3205: delete oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 375 2020-11-16T22:14:01.609 INFO:tasks.rados.rados.2.smithi057.stdout:3205: done (0 left) 2020-11-16T22:14:01.609 INFO:tasks.rados.rados.2.smithi057.stdout:3206: read oid 48 snap -1 2020-11-16T22:14:01.609 INFO:tasks.rados.rados.2.smithi057.stdout:3206: expect deleted 2020-11-16T22:14:01.609 INFO:tasks.rados.rados.2.smithi057.stdout:3207: write (excl) oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 375 2020-11-16T22:14:01.609 INFO:tasks.rados.rados.2.smithi057.stdout:3207: seq_num 1068 ranges {749876=655352,1863710=723361,3012815=748745} 2020-11-16T22:14:01.625 INFO:tasks.rados.rados.2.smithi057.stdout:3207: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 749876 to 1405228 tid 1 2020-11-16T22:14:01.632 INFO:tasks.rados.rados.2.smithi057.stdout:3207: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1863710 to 2587071 tid 2 2020-11-16T22:14:01.639 INFO:tasks.rados.rados.2.smithi057.stdout:3207: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3012815 to 3761560 tid 3 2020-11-16T22:14:01.640 INFO:tasks.rados.rados.2.smithi057.stdout:3208: read oid 10 snap -1 2020-11-16T22:14:01.640 INFO:tasks.rados.rados.2.smithi057.stdout:3208: expect (ObjNum 1028 snap 361 seq_num 1028) 2020-11-16T22:14:01.640 INFO:tasks.rados.rados.2.smithi057.stdout:3209: rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 375 2020-11-16T22:14:01.640 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 374 2020-11-16T22:14:01.640 INFO:tasks.rados.rados.2.smithi057.stdout:3207: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.640 INFO:tasks.rados.rados.2.smithi057.stdout:3207: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.641 INFO:tasks.rados.rados.2.smithi057.stdout:3206: done (3 left) 2020-11-16T22:14:01.641 INFO:tasks.rados.rados.2.smithi057.stdout:3210: rollback oid 28 current snap is 375 2020-11-16T22:14:01.641 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 28 to 370 2020-11-16T22:14:01.641 INFO:tasks.rados.rados.2.smithi057.stdout:3211: write (excl) oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 375 2020-11-16T22:14:01.641 INFO:tasks.rados.rados.2.smithi057.stdout:3211: seq_num 1069 ranges {766683=730601,1922192=583372,3156591=676370} 2020-11-16T22:14:01.648 INFO:tasks.rados.rados.2.smithi057.stdout:3211: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 766683 to 1497284 tid 1 2020-11-16T22:14:01.654 INFO:tasks.rados.rados.2.smithi057.stdout:3211: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1922192 to 2505564 tid 2 2020-11-16T22:14:01.661 INFO:tasks.rados.rados.2.smithi057.stdout:3211: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3156591 to 3832961 tid 3 2020-11-16T22:14:01.662 INFO:tasks.rados.rados.2.smithi057.stdout:3212: write oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 375 2020-11-16T22:14:01.662 INFO:tasks.rados.rados.2.smithi057.stdout:3212: seq_num 1070 ranges {783490=405850,1980674=727030,3184014=487642} 2020-11-16T22:14:01.668 INFO:tasks.rados.rados.2.smithi057.stdout:3212: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 783490 to 1189340 tid 1 2020-11-16T22:14:01.677 INFO:tasks.rados.rados.2.smithi057.stdout:3212: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1980674 to 2707704 tid 2 2020-11-16T22:14:01.682 INFO:tasks.rados.rados.2.smithi057.stdout:3212: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3184014 to 3671656 tid 3 2020-11-16T22:14:01.683 INFO:tasks.rados.rados.2.smithi057.stdout:3213: snap_create 2020-11-16T22:14:01.683 INFO:tasks.rados.rados.2.smithi057.stdout:3209: finishing rollback tid 0 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.683 INFO:tasks.rados.rados.2.smithi057.stdout:3209: finishing rollback tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.683 INFO:tasks.rados.rados.2.smithi057.stdout:3207: finishing write tid 3 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.683 INFO:tasks.rados.rados.2.smithi057.stdout:3207: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.683 INFO:tasks.rados.rados.2.smithi057.stdout:3207: finishing write tid 6 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.684 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2229 (ObjNum 1068 snap 375 seq_num 1068) dirty exists 2020-11-16T22:14:01.684 INFO:tasks.rados.rados.2.smithi057.stdout:3207: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1068 snap 375 seq_num 1068) 2020-11-16T22:14:01.684 INFO:tasks.rados.rados.2.smithi057.stdout:3209: finishing rollback tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.684 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2532 (ObjNum 949 snap 328 seq_num 949) dirty exists 2020-11-16T22:14:01.684 INFO:tasks.rados.rados.2.smithi057.stdout:3208: expect (ObjNum 1028 snap 361 seq_num 1028) 2020-11-16T22:14:01.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:01 smithi057 bash[10301]: cluster 2020-11-16T22:13:59.824672+0000 mgr.x (mgr.24115) 641 : cluster [DBG] pgmap v1381: 17 pgs: 17 active+clean; 259 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.6 MiB/s wr, 3 op/s 2020-11-16T22:14:01.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:01 smithi057 bash[10301]: cluster 2020-11-16T22:14:01.183617+0000 mon.a (mon.0) 1486 : cluster [DBG] osdmap e812: 12 total, 12 up, 12 in 2020-11-16T22:14:01.838 INFO:tasks.rados.rados.2.smithi057.stdout:3211: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.838 INFO:tasks.rados.rados.2.smithi057.stdout:3210: finishing rollback tid 0 to smithi05720651-28 2020-11-16T22:14:01.838 INFO:tasks.rados.rados.2.smithi057.stdout:3210: finishing rollback tid 1 to smithi05720651-28 2020-11-16T22:14:01.838 INFO:tasks.rados.rados.2.smithi057.stdout:3210: finishing rollback tid 2 to smithi05720651-28 2020-11-16T22:14:01.839 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 2232 (ObjNum 1043 snap 366 seq_num 1043) dirty exists 2020-11-16T22:14:01.839 INFO:tasks.rados.rados.2.smithi057.stdout:3211: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.839 INFO:tasks.rados.rados.2.smithi057.stdout:3211: finishing write tid 3 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.839 INFO:tasks.rados.rados.2.smithi057.stdout:3211: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.839 INFO:tasks.rados.rados.2.smithi057.stdout:3211: finishing write tid 6 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.839 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2618 (ObjNum 1069 snap 375 seq_num 1069) dirty exists 2020-11-16T22:14:01.839 INFO:tasks.rados.rados.2.smithi057.stdout:3211: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1069 snap 375 seq_num 1069) 2020-11-16T22:14:01.840 INFO:tasks.rados.rados.2.smithi057.stdout:3212: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.840 INFO:tasks.rados.rados.2.smithi057.stdout:3212: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.840 INFO:tasks.rados.rados.2.smithi057.stdout:3212: finishing write tid 3 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.840 INFO:tasks.rados.rados.2.smithi057.stdout:3212: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.840 INFO:tasks.rados.rados.2.smithi057.stdout:3212: finishing write tid 6 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:01.840 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2284 (ObjNum 1070 snap 375 seq_num 1070) dirty exists 2020-11-16T22:14:01.840 INFO:tasks.rados.rados.2.smithi057.stdout:3212: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1070 snap 375 seq_num 1070) 2020-11-16T22:14:02.249 INFO:tasks.rados.rados.2.smithi057.stdout:3207: done (6 left) 2020-11-16T22:14:02.249 INFO:tasks.rados.rados.2.smithi057.stdout:3208: done (5 left) 2020-11-16T22:14:02.249 INFO:tasks.rados.rados.2.smithi057.stdout:3209: done (4 left) 2020-11-16T22:14:02.249 INFO:tasks.rados.rados.2.smithi057.stdout:3210: done (3 left) 2020-11-16T22:14:02.250 INFO:tasks.rados.rados.2.smithi057.stdout:3211: done (2 left) 2020-11-16T22:14:02.250 INFO:tasks.rados.rados.2.smithi057.stdout:3212: done (1 left) 2020-11-16T22:14:02.250 INFO:tasks.rados.rados.2.smithi057.stdout:3213: done (0 left) 2020-11-16T22:14:02.250 INFO:tasks.rados.rados.2.smithi057.stdout:3214: copy_from oid 24 from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 376 2020-11-16T22:14:02.250 INFO:tasks.rados.rados.2.smithi057.stdout:3215: read oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:02.250 INFO:tasks.rados.rados.2.smithi057.stdout:3215: expect (ObjNum 1023 snap 359 seq_num 1023) 2020-11-16T22:14:02.250 INFO:tasks.rados.rados.2.smithi057.stdout:3216: write (excl) oid 44 current snap is 376 2020-11-16T22:14:02.251 INFO:tasks.rados.rados.2.smithi057.stdout:3216: seq_num 1071 ranges {400297=481099,1639156=361141} 2020-11-16T22:14:02.259 INFO:tasks.rados.rados.2.smithi057.stdout:3216: writing smithi05720651-44 from 400297 to 881396 tid 1 2020-11-16T22:14:02.266 INFO:tasks.rados.rados.2.smithi057.stdout:3216: writing smithi05720651-44 from 1639156 to 2000297 tid 2 2020-11-16T22:14:02.267 INFO:tasks.rados.rados.2.smithi057.stdout:3217: read oid 6 snap -1 2020-11-16T22:14:02.267 INFO:tasks.rados.rados.2.smithi057.stdout:3217: expect (ObjNum 1005 snap 351 seq_num 1005) 2020-11-16T22:14:02.267 INFO:tasks.rados.rados.2.smithi057.stdout:3218: delete oid 26 current snap is 376 2020-11-16T22:14:02.267 INFO:tasks.rados.rados.2.smithi057.stdout:3215: expect (ObjNum 1023 snap 359 seq_num 1023) 2020-11-16T22:14:02.409 INFO:tasks.rados.rados.2.smithi057.stdout:3216: finishing write tid 1 to smithi05720651-44 2020-11-16T22:14:02.409 INFO:tasks.rados.rados.2.smithi057.stdout:3216: finishing write tid 2 to smithi05720651-44 2020-11-16T22:14:02.409 INFO:tasks.rados.rados.2.smithi057.stdout:3216: finishing write tid 4 to smithi05720651-44 2020-11-16T22:14:02.409 INFO:tasks.rados.rados.2.smithi057.stdout:3216: finishing write tid 5 to smithi05720651-44 2020-11-16T22:14:02.410 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 2518 (ObjNum 1071 snap 376 seq_num 1071) dirty exists 2020-11-16T22:14:02.410 INFO:tasks.rados.rados.2.smithi057.stdout:3216: left oid 44 (ObjNum 1071 snap 376 seq_num 1071) 2020-11-16T22:14:02.410 INFO:tasks.rados.rados.2.smithi057.stdout:3214: finishing copy_from to smithi05720651-24 2020-11-16T22:14:02.410 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 2193 (ObjNum 1012 snap 355 seq_num 1012) dirty exists 2020-11-16T22:14:02.410 INFO:tasks.rados.rados.2.smithi057.stdout:3214: finishing copy_from racing read to smithi05720651-24 2020-11-16T22:14:02.410 INFO:tasks.rados.rados.2.smithi057.stdout:3217: expect (ObjNum 1005 snap 351 seq_num 1005) 2020-11-16T22:14:02.496 INFO:tasks.rados.rados.2.smithi057.stdout:3214: done (4 left) 2020-11-16T22:14:02.496 INFO:tasks.rados.rados.2.smithi057.stdout:3215: done (3 left) 2020-11-16T22:14:02.496 INFO:tasks.rados.rados.2.smithi057.stdout:3216: done (2 left) 2020-11-16T22:14:02.496 INFO:tasks.rados.rados.2.smithi057.stdout:3217: done (1 left) 2020-11-16T22:14:02.496 INFO:tasks.rados.rados.2.smithi057.stdout:3218: done (0 left) 2020-11-16T22:14:02.496 INFO:tasks.rados.rados.2.smithi057.stdout:3219: snap_remove snap 373 2020-11-16T22:14:03.258 INFO:tasks.rados.rados.2.smithi057.stdout:3219: done (0 left) 2020-11-16T22:14:03.259 INFO:tasks.rados.rados.2.smithi057.stdout:3220: delete oid 32 current snap is 376 2020-11-16T22:14:03.265 INFO:tasks.rados.rados.2.smithi057.stdout:3220: done (0 left) 2020-11-16T22:14:03.266 INFO:tasks.rados.rados.2.smithi057.stdout:3221: rollback oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 376 2020-11-16T22:14:03.266 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 370 2020-11-16T22:14:03.266 INFO:tasks.rados.rados.2.smithi057.stdout:3222: snap_create 2020-11-16T22:14:03.272 INFO:tasks.rados.rados.2.smithi057.stdout:3221: finishing rollback tid 0 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:03.274 INFO:tasks.rados.rados.2.smithi057.stdout:3221: finishing rollback tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:03.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:03 smithi016 bash[10302]: cluster 2020-11-16T22:14:01.825388+0000 mgr.x (mgr.24115) 642 : cluster [DBG] pgmap v1384: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 264 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 2.4 MiB/s wr, 6 op/s 2020-11-16T22:14:03.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:03 smithi016 bash[10302]: cluster 2020-11-16T22:14:02.258148+0000 mon.a (mon.0) 1487 : cluster [DBG] osdmap e813: 12 total, 12 up, 12 in 2020-11-16T22:14:03.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:03 smithi195 bash[10218]: cluster 2020-11-16T22:14:01.825388+0000 mgr.x (mgr.24115) 642 : cluster [DBG] pgmap v1384: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 264 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 2.4 MiB/s wr, 6 op/s 2020-11-16T22:14:03.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:03 smithi195 bash[10218]: cluster 2020-11-16T22:14:02.258148+0000 mon.a (mon.0) 1487 : cluster [DBG] osdmap e813: 12 total, 12 up, 12 in 2020-11-16T22:14:03.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:03 smithi057 bash[10301]: cluster 2020-11-16T22:14:01.825388+0000 mgr.x (mgr.24115) 642 : cluster [DBG] pgmap v1384: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 264 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 2.4 MiB/s wr, 6 op/s 2020-11-16T22:14:03.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:03 smithi057 bash[10301]: cluster 2020-11-16T22:14:02.258148+0000 mon.a (mon.0) 1487 : cluster [DBG] osdmap e813: 12 total, 12 up, 12 in 2020-11-16T22:14:04.062 INFO:tasks.rados.rados.2.smithi057.stdout:3221: finishing rollback tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.062 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2224 (ObjNum 1028 snap 361 seq_num 1028) dirty exists 2020-11-16T22:14:04.270 INFO:tasks.rados.rados.2.smithi057.stdout:3221: done (1 left) 2020-11-16T22:14:04.270 INFO:tasks.rados.rados.2.smithi057.stdout:3222: done (0 left) 2020-11-16T22:14:04.270 INFO:tasks.rados.rados.2.smithi057.stdout:3223: copy_from oid 38 from oid 10 current snap is 377 2020-11-16T22:14:04.270 INFO:tasks.rados.rados.2.smithi057.stdout:3224: rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 377 2020-11-16T22:14:04.271 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 366 2020-11-16T22:14:04.271 INFO:tasks.rados.rados.2.smithi057.stdout:3225: rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 377 2020-11-16T22:14:04.271 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 357 2020-11-16T22:14:04.271 INFO:tasks.rados.rados.2.smithi057.stdout:3226: read oid 20 snap -1 2020-11-16T22:14:04.271 INFO:tasks.rados.rados.2.smithi057.stdout:3226: expect (ObjNum 1061 snap 373 seq_num 1061) 2020-11-16T22:14:04.271 INFO:tasks.rados.rados.2.smithi057.stdout:3227: rollback oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 377 2020-11-16T22:14:04.271 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 371 2020-11-16T22:14:04.272 INFO:tasks.rados.rados.2.smithi057.stdout:3228: copy_from oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 377 2020-11-16T22:14:04.272 INFO:tasks.rados.rados.2.smithi057.stdout:3229: write oid 12 current snap is 377 2020-11-16T22:14:04.272 INFO:tasks.rados.rados.2.smithi057.stdout:3229: seq_num 1074 ranges {450718=423199,1414602=636116} 2020-11-16T22:14:04.282 INFO:tasks.rados.rados.2.smithi057.stdout:3229: writing smithi05720651-12 from 450718 to 873917 tid 1 2020-11-16T22:14:04.289 INFO:tasks.rados.rados.2.smithi057.stdout:3229: writing smithi05720651-12 from 1414602 to 2050718 tid 2 2020-11-16T22:14:04.289 INFO:tasks.rados.rados.2.smithi057.stdout:3230: write (excl) oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 377 2020-11-16T22:14:04.289 INFO:tasks.rados.rados.2.smithi057.stdout:3230: seq_num 1075 ranges {467525=498448,1473084=594379} 2020-11-16T22:14:04.295 INFO:tasks.rados.rados.2.smithi057.stdout:3230: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 467525 to 965973 tid 1 2020-11-16T22:14:04.301 INFO:tasks.rados.rados.2.smithi057.stdout:3230: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1473084 to 2067463 tid 2 2020-11-16T22:14:04.302 INFO:tasks.rados.rados.2.smithi057.stdout:3231: rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 377 2020-11-16T22:14:04.302 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 350 2020-11-16T22:14:04.302 INFO:tasks.rados.rados.2.smithi057.stdout:3228: finishing copy_from to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.302 INFO:tasks.rados.rados.2.smithi057.stdout:3228: got expected ENOENT (src dne) 2020-11-16T22:14:04.302 INFO:tasks.rados.rados.2.smithi057.stdout:3228: finishing copy_from racing read to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.302 INFO:tasks.rados.rados.2.smithi057.stdout:3228: done (8 left) 2020-11-16T22:14:04.303 INFO:tasks.rados.rados.2.smithi057.stdout:3232: write (excl) oid 16 current snap is 377 2020-11-16T22:14:04.303 INFO:tasks.rados.rados.2.smithi057.stdout:3232: seq_num 1076 ranges {484332=573697,1531566=552766} 2020-11-16T22:14:04.307 INFO:tasks.rados.rados.2.smithi057.stdout:3232: writing smithi05720651-16 from 484332 to 1058029 tid 1 2020-11-16T22:14:04.313 INFO:tasks.rados.rados.2.smithi057.stdout:3232: writing smithi05720651-16 from 1531566 to 2084332 tid 2 2020-11-16T22:14:04.313 INFO:tasks.rados.rados.2.smithi057.stdout:3233: delete oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 377 2020-11-16T22:14:04.314 INFO:tasks.rados.rados.2.smithi057.stdout:3224: finishing rollback tid 0 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.314 INFO:tasks.rados.rados.2.smithi057.stdout:3224: finishing rollback tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.314 INFO:tasks.rados.rados.2.smithi057.stdout:3227: finishing rollback tid 0 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.314 INFO:tasks.rados.rados.2.smithi057.stdout:3227: finishing rollback tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.314 INFO:tasks.rados.rados.2.smithi057.stdout:3227: finishing rollback tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.314 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1807 (ObjNum 1023 snap 359 seq_num 1023) dirty exists 2020-11-16T22:14:04.315 INFO:tasks.rados.rados.2.smithi057.stdout:3226: expect (ObjNum 1061 snap 373 seq_num 1061) 2020-11-16T22:14:04.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:04 smithi016 bash[10302]: cluster 2020-11-16T22:14:03.269350+0000 mon.a (mon.0) 1488 : cluster [DBG] osdmap e814: 12 total, 12 up, 12 in 2020-11-16T22:14:04.596 INFO:tasks.rados.rados.2.smithi057.stdout:3224: finishing rollback tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.596 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2535 (ObjNum 991 snap 348 seq_num 991) dirty exists 2020-11-16T22:14:04.597 INFO:tasks.rados.rados.2.smithi057.stdout:3225: finishing rollback tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.597 INFO:tasks.rados.rados.2.smithi057.stdout:3229: finishing write tid 1 to smithi05720651-12 2020-11-16T22:14:04.597 INFO:tasks.rados.rados.2.smithi057.stdout:3229: finishing write tid 2 to smithi05720651-12 2020-11-16T22:14:04.597 INFO:tasks.rados.rados.2.smithi057.stdout:3229: finishing write tid 4 to smithi05720651-12 2020-11-16T22:14:04.597 INFO:tasks.rados.rados.2.smithi057.stdout:3223: finishing copy_from to smithi05720651-38 2020-11-16T22:14:04.597 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 2209 (ObjNum 1028 snap 361 seq_num 1028) dirty exists 2020-11-16T22:14:04.597 INFO:tasks.rados.rados.2.smithi057.stdout:3229: finishing write tid 5 to smithi05720651-12 2020-11-16T22:14:04.598 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 2521 (ObjNum 1074 snap 377 seq_num 1074) dirty exists 2020-11-16T22:14:04.598 INFO:tasks.rados.rados.2.smithi057.stdout:3229: left oid 12 (ObjNum 1074 snap 377 seq_num 1074) 2020-11-16T22:14:04.598 INFO:tasks.rados.rados.2.smithi057.stdout:3223: finishing copy_from racing read to smithi05720651-38 2020-11-16T22:14:04.598 INFO:tasks.rados.rados.2.smithi057.stdout:3230: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.598 INFO:tasks.rados.rados.2.smithi057.stdout:3230: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.598 INFO:tasks.rados.rados.2.smithi057.stdout:3230: finishing write tid 4 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.599 INFO:tasks.rados.rados.2.smithi057.stdout:3231: finishing rollback tid 0 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.599 INFO:tasks.rados.rados.2.smithi057.stdout:3223: done (9 left) 2020-11-16T22:14:04.599 INFO:tasks.rados.rados.2.smithi057.stdout:3224: done (8 left) 2020-11-16T22:14:04.599 INFO:tasks.rados.rados.2.smithi057.stdout:3226: done (7 left) 2020-11-16T22:14:04.599 INFO:tasks.rados.rados.2.smithi057.stdout:3227: done (6 left) 2020-11-16T22:14:04.599 INFO:tasks.rados.rados.2.smithi057.stdout:3229: done (5 left) 2020-11-16T22:14:04.599 INFO:tasks.rados.rados.2.smithi057.stdout:3233: done (4 left) 2020-11-16T22:14:04.599 INFO:tasks.rados.rados.2.smithi057.stdout:3234: delete oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 377 2020-11-16T22:14:04.600 INFO:tasks.rados.rados.2.smithi057.stdout:3230: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.600 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2292 (ObjNum 1075 snap 377 seq_num 1075) dirty exists 2020-11-16T22:14:04.600 INFO:tasks.rados.rados.2.smithi057.stdout:3230: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1075 snap 377 seq_num 1075) 2020-11-16T22:14:04.600 INFO:tasks.rados.rados.2.smithi057.stdout:3231: finishing rollback tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.600 INFO:tasks.rados.rados.2.smithi057.stdout:3231: finishing rollback tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.600 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2630 (ObjNum 1000 snap 348 seq_num 1000) dirty exists 2020-11-16T22:14:04.600 INFO:tasks.rados.rados.2.smithi057.stdout:3225: finishing rollback tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:04.601 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2537 (ObjNum 1014 snap 356 seq_num 1014) dirty exists 2020-11-16T22:14:04.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:04 smithi195 bash[10218]: cluster 2020-11-16T22:14:03.269350+0000 mon.a (mon.0) 1488 : cluster [DBG] osdmap e814: 12 total, 12 up, 12 in 2020-11-16T22:14:04.601 INFO:tasks.rados.rados.2.smithi057.stdout:3225: done (4 left) 2020-11-16T22:14:04.602 INFO:tasks.rados.rados.2.smithi057.stdout:3230: done (3 left) 2020-11-16T22:14:04.602 INFO:tasks.rados.rados.2.smithi057.stdout:3231: done (2 left) 2020-11-16T22:14:04.602 INFO:tasks.rados.rados.2.smithi057.stdout:3234: done (1 left) 2020-11-16T22:14:04.602 INFO:tasks.rados.rados.2.smithi057.stdout:3235: snap_remove snap 359 2020-11-16T22:14:04.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:04 smithi057 bash[10301]: cluster 2020-11-16T22:14:03.269350+0000 mon.a (mon.0) 1488 : cluster [DBG] osdmap e814: 12 total, 12 up, 12 in 2020-11-16T22:14:05.162 INFO:tasks.rados.rados.2.smithi057.stdout:3235: done (1 left) 2020-11-16T22:14:05.163 INFO:tasks.rados.rados.2.smithi057.stdout:3236: write oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 377 2020-11-16T22:14:05.163 INFO:tasks.rados.rados.2.smithi057.stdout:3236: seq_num 1079 ranges {534753=799444,1990659=144094} 2020-11-16T22:14:05.177 INFO:tasks.rados.rados.2.smithi057.stdout:3236: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 534753 to 1334197 tid 1 2020-11-16T22:14:05.182 INFO:tasks.rados.rados.2.smithi057.stdout:3236: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1990659 to 2134753 tid 2 2020-11-16T22:14:05.182 INFO:tasks.rados.rados.2.smithi057.stdout:3237: write (excl) oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 377 2020-11-16T22:14:05.182 INFO:tasks.rados.rados.2.smithi057.stdout:3237: seq_num 1080 ranges {551560=591046,1765494=386066} 2020-11-16T22:14:05.188 INFO:tasks.rados.rados.2.smithi057.stdout:3237: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 551560 to 1142606 tid 1 2020-11-16T22:14:05.194 INFO:tasks.rados.rados.2.smithi057.stdout:3237: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1765494 to 2151560 tid 2 2020-11-16T22:14:05.194 INFO:tasks.rados.rados.2.smithi057.stdout:3238: read oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:05.195 INFO:tasks.rados.rados.2.smithi057.stdout:3238: expect (ObjNum 1023 snap 359 seq_num 1023) 2020-11-16T22:14:05.195 INFO:tasks.rados.rados.2.smithi057.stdout:3239: delete oid 44 current snap is 377 2020-11-16T22:14:05.195 INFO:tasks.rados.rados.2.smithi057.stdout:3232: finishing write tid 1 to smithi05720651-16 2020-11-16T22:14:05.195 INFO:tasks.rados.rados.2.smithi057.stdout:3232: finishing write tid 2 to smithi05720651-16 2020-11-16T22:14:05.195 INFO:tasks.rados.rados.2.smithi057.stdout:3232: finishing write tid 4 to smithi05720651-16 2020-11-16T22:14:05.195 INFO:tasks.rados.rados.2.smithi057.stdout:3236: finishing write tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:05.196 INFO:tasks.rados.rados.2.smithi057.stdout:3236: finishing write tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:05.196 INFO:tasks.rados.rados.2.smithi057.stdout:3236: finishing write tid 4 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:05.196 INFO:tasks.rados.rados.2.smithi057.stdout:3236: finishing write tid 5 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:05.196 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2647 (ObjNum 1079 snap 377 seq_num 1079) dirty exists 2020-11-16T22:14:05.196 INFO:tasks.rados.rados.2.smithi057.stdout:3236: left oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1079 snap 377 seq_num 1079) 2020-11-16T22:14:05.198 INFO:tasks.rados.rados.2.smithi057.stdout:3238: expect (ObjNum 1023 snap 359 seq_num 1023) 2020-11-16T22:14:05.340 INFO:tasks.rados.rados.2.smithi057.stdout:3237: finishing write tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:05.341 INFO:tasks.rados.rados.2.smithi057.stdout:3237: finishing write tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:05.341 INFO:tasks.rados.rados.2.smithi057.stdout:3237: finishing write tid 4 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:05.341 INFO:tasks.rados.rados.2.smithi057.stdout:3237: finishing write tid 5 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:05.341 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2212 (ObjNum 1080 snap 377 seq_num 1080) dirty exists 2020-11-16T22:14:05.341 INFO:tasks.rados.rados.2.smithi057.stdout:3237: left oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1080 snap 377 seq_num 1080) 2020-11-16T22:14:05.341 INFO:tasks.rados.rados.2.smithi057.stdout:3236: done (4 left) 2020-11-16T22:14:05.342 INFO:tasks.rados.rados.2.smithi057.stdout:3237: done (3 left) 2020-11-16T22:14:05.342 INFO:tasks.rados.rados.2.smithi057.stdout:3238: done (2 left) 2020-11-16T22:14:05.342 INFO:tasks.rados.rados.2.smithi057.stdout:3239: done (1 left) 2020-11-16T22:14:05.342 INFO:tasks.rados.rados.2.smithi057.stdout:3240: delete oid 32 current snap is 377 2020-11-16T22:14:05.346 INFO:tasks.rados.rados.2.smithi057.stdout:3240: done (1 left) 2020-11-16T22:14:05.347 INFO:tasks.rados.rados.2.smithi057.stdout:3241: write oid 4 current snap is 377 2020-11-16T22:14:05.347 INFO:tasks.rados.rados.2.smithi057.stdout:3241: seq_num 1083 ranges {601981=416793,1424587=492702} 2020-11-16T22:14:05.360 INFO:tasks.rados.rados.2.smithi057.stdout:3241: writing smithi05720651-4 from 601981 to 1018774 tid 1 2020-11-16T22:14:05.365 INFO:tasks.rados.rados.2.smithi057.stdout:3241: writing smithi05720651-4 from 1424587 to 1917289 tid 2 2020-11-16T22:14:05.365 INFO:tasks.rados.rados.2.smithi057.stdout:3242: delete oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 377 2020-11-16T22:14:05.366 INFO:tasks.rados.rados.2.smithi057.stdout:3241: finishing write tid 1 to smithi05720651-4 2020-11-16T22:14:05.371 INFO:tasks.rados.rados.2.smithi057.stdout:3242: done (2 left) 2020-11-16T22:14:05.371 INFO:tasks.rados.rados.2.smithi057.stdout:3243: read oid 20 snap -1 2020-11-16T22:14:05.371 INFO:tasks.rados.rados.2.smithi057.stdout:3243: expect (ObjNum 1061 snap 373 seq_num 1061) 2020-11-16T22:14:05.372 INFO:tasks.rados.rados.2.smithi057.stdout:3244: read oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:05.372 INFO:tasks.rados.rados.2.smithi057.stdout:3244: expect (ObjNum 1059 snap 372 seq_num 1059) 2020-11-16T22:14:05.372 INFO:tasks.rados.rados.2.smithi057.stdout:3245: write (excl) oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 377 2020-11-16T22:14:05.372 INFO:tasks.rados.rados.2.smithi057.stdout:3245: seq_num 1085 ranges {635595=567291,1825198=410397} 2020-11-16T22:14:05.379 INFO:tasks.rados.rados.2.smithi057.stdout:3245: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 635595 to 1202886 tid 1 2020-11-16T22:14:05.386 INFO:tasks.rados.rados.2.smithi057.stdout:3245: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1825198 to 2235595 tid 2 2020-11-16T22:14:05.386 INFO:tasks.rados.rados.2.smithi057.stdout:3246: write oid 24 current snap is 377 2020-11-16T22:14:05.387 INFO:tasks.rados.rados.2.smithi057.stdout:3246: seq_num 1086 ranges {652402=642540,1883680=368722} 2020-11-16T22:14:05.394 INFO:tasks.rados.rados.2.smithi057.stdout:3246: writing smithi05720651-24 from 652402 to 1294942 tid 1 2020-11-16T22:14:05.399 INFO:tasks.rados.rados.2.smithi057.stdout:3246: writing smithi05720651-24 from 1883680 to 2252402 tid 2 2020-11-16T22:14:05.399 INFO:tasks.rados.rados.2.smithi057.stdout:3247: read oid 36 snap -1 2020-11-16T22:14:05.400 INFO:tasks.rados.rados.2.smithi057.stdout:3247: expect deleted 2020-11-16T22:14:05.400 INFO:tasks.rados.rados.2.smithi057.stdout:3248: delete oid 46 current snap is 377 2020-11-16T22:14:05.400 INFO:tasks.rados.rados.2.smithi057.stdout:3241: finishing write tid 2 to smithi05720651-4 2020-11-16T22:14:05.400 INFO:tasks.rados.rados.2.smithi057.stdout:3241: finishing write tid 4 to smithi05720651-4 2020-11-16T22:14:05.400 INFO:tasks.rados.rados.2.smithi057.stdout:3241: finishing write tid 5 to smithi05720651-4 2020-11-16T22:14:05.400 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 2197 (ObjNum 1083 snap 377 seq_num 1083) dirty exists 2020-11-16T22:14:05.401 INFO:tasks.rados.rados.2.smithi057.stdout:3241: left oid 4 (ObjNum 1083 snap 377 seq_num 1083) 2020-11-16T22:14:05.401 INFO:tasks.rados.rados.2.smithi057.stdout:3243: expect (ObjNum 1061 snap 373 seq_num 1061) 2020-11-16T22:14:05.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:05 smithi016 bash[10302]: cluster 2020-11-16T22:14:03.826032+0000 mgr.x (mgr.24115) 643 : cluster [DBG] pgmap v1387: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 264 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.2 MiB/s wr, 4 op/s 2020-11-16T22:14:05.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:05 smithi016 bash[10302]: cluster 2020-11-16T22:14:04.278517+0000 mon.a (mon.0) 1489 : cluster [DBG] osdmap e815: 12 total, 12 up, 12 in 2020-11-16T22:14:05.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:05 smithi016 bash[10302]: cluster 2020-11-16T22:14:05.172440+0000 mon.a (mon.0) 1490 : cluster [DBG] osdmap e816: 12 total, 12 up, 12 in 2020-11-16T22:14:05.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:05 smithi195 bash[10218]: cluster 2020-11-16T22:14:03.826032+0000 mgr.x (mgr.24115) 643 : cluster [DBG] pgmap v1387: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 264 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.2 MiB/s wr, 4 op/s 2020-11-16T22:14:05.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:05 smithi195 bash[10218]: cluster 2020-11-16T22:14:04.278517+0000 mon.a (mon.0) 1489 : cluster [DBG] osdmap e815: 12 total, 12 up, 12 in 2020-11-16T22:14:05.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:05 smithi195 bash[10218]: cluster 2020-11-16T22:14:05.172440+0000 mon.a (mon.0) 1490 : cluster [DBG] osdmap e816: 12 total, 12 up, 12 in 2020-11-16T22:14:05.683 INFO:tasks.rados.rados.2.smithi057.stdout:3232: finishing write tid 5 to smithi05720651-16 2020-11-16T22:14:05.683 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 2540 (ObjNum 1076 snap 377 seq_num 1076) dirty exists 2020-11-16T22:14:05.684 INFO:tasks.rados.rados.2.smithi057.stdout:3232: left oid 16 (ObjNum 1076 snap 377 seq_num 1076) 2020-11-16T22:14:05.684 INFO:tasks.rados.rados.2.smithi057.stdout:3245: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:05.684 INFO:tasks.rados.rados.2.smithi057.stdout:3245: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:05.684 INFO:tasks.rados.rados.2.smithi057.stdout:3245: finishing write tid 4 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:05.684 INFO:tasks.rados.rados.2.smithi057.stdout:3245: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:05.684 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2197 (ObjNum 1085 snap 377 seq_num 1085) dirty exists 2020-11-16T22:14:05.684 INFO:tasks.rados.rados.2.smithi057.stdout:3245: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1085 snap 377 seq_num 1085) 2020-11-16T22:14:05.685 INFO:tasks.rados.rados.2.smithi057.stdout:3246: finishing write tid 1 to smithi05720651-24 2020-11-16T22:14:05.685 INFO:tasks.rados.rados.2.smithi057.stdout:3244: expect (ObjNum 1059 snap 372 seq_num 1059) 2020-11-16T22:14:05.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:05 smithi057 bash[10301]: cluster 2020-11-16T22:14:03.826032+0000 mgr.x (mgr.24115) 643 : cluster [DBG] pgmap v1387: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 264 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.2 MiB/s wr, 4 op/s 2020-11-16T22:14:05.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:05 smithi057 bash[10301]: cluster 2020-11-16T22:14:04.278517+0000 mon.a (mon.0) 1489 : cluster [DBG] osdmap e815: 12 total, 12 up, 12 in 2020-11-16T22:14:05.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:05 smithi057 bash[10301]: cluster 2020-11-16T22:14:05.172440+0000 mon.a (mon.0) 1490 : cluster [DBG] osdmap e816: 12 total, 12 up, 12 in 2020-11-16T22:14:05.852 INFO:tasks.rados.rados.2.smithi057.stdout:3246: finishing write tid 2 to smithi05720651-24 2020-11-16T22:14:05.852 INFO:tasks.rados.rados.2.smithi057.stdout:3246: finishing write tid 4 to smithi05720651-24 2020-11-16T22:14:05.852 INFO:tasks.rados.rados.2.smithi057.stdout:3246: finishing write tid 5 to smithi05720651-24 2020-11-16T22:14:05.852 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 2196 (ObjNum 1086 snap 377 seq_num 1086) dirty exists 2020-11-16T22:14:05.852 INFO:tasks.rados.rados.2.smithi057.stdout:3246: left oid 24 (ObjNum 1086 snap 377 seq_num 1086) 2020-11-16T22:14:05.853 INFO:tasks.rados.rados.2.smithi057.stdout:3232: done (7 left) 2020-11-16T22:14:05.853 INFO:tasks.rados.rados.2.smithi057.stdout:3241: done (6 left) 2020-11-16T22:14:05.853 INFO:tasks.rados.rados.2.smithi057.stdout:3243: done (5 left) 2020-11-16T22:14:05.853 INFO:tasks.rados.rados.2.smithi057.stdout:3244: done (4 left) 2020-11-16T22:14:05.853 INFO:tasks.rados.rados.2.smithi057.stdout:3245: done (3 left) 2020-11-16T22:14:05.853 INFO:tasks.rados.rados.2.smithi057.stdout:3246: done (2 left) 2020-11-16T22:14:05.853 INFO:tasks.rados.rados.2.smithi057.stdout:3247: done (1 left) 2020-11-16T22:14:05.854 INFO:tasks.rados.rados.2.smithi057.stdout:3248: done (0 left) 2020-11-16T22:14:05.854 INFO:tasks.rados.rados.2.smithi057.stdout:3249: snap_create 2020-11-16T22:14:06.275 INFO:tasks.rados.rados.2.smithi057.stdout:3249: done (0 left) 2020-11-16T22:14:06.275 INFO:tasks.rados.rados.2.smithi057.stdout:3250: delete oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 378 2020-11-16T22:14:06.286 INFO:tasks.rados.rados.2.smithi057.stdout:3250: done (0 left) 2020-11-16T22:14:06.286 INFO:tasks.rados.rados.2.smithi057.stdout:3251: snap_create 2020-11-16T22:14:07.285 INFO:tasks.rados.rados.2.smithi057.stdout:3251: done (0 left) 2020-11-16T22:14:07.285 INFO:tasks.rados.rados.2.smithi057.stdout:3252: delete oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 379 2020-11-16T22:14:07.294 INFO:tasks.rados.rados.2.smithi057.stdout:3252: done (0 left) 2020-11-16T22:14:07.294 INFO:tasks.rados.rados.2.smithi057.stdout:3253: snap_remove snap 371 2020-11-16T22:14:07.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:07 smithi016 bash[10302]: cluster 2020-11-16T22:14:05.826769+0000 mgr.x (mgr.24115) 644 : cluster [DBG] pgmap v1390: 17 pgs: 17 active+clean; 284 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 4.5 MiB/s wr, 28 op/s 2020-11-16T22:14:07.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:07 smithi016 bash[10302]: cluster 2020-11-16T22:14:06.284761+0000 mon.a (mon.0) 1491 : cluster [DBG] osdmap e817: 12 total, 12 up, 12 in 2020-11-16T22:14:07.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:07 smithi195 bash[10218]: cluster 2020-11-16T22:14:05.826769+0000 mgr.x (mgr.24115) 644 : cluster [DBG] pgmap v1390: 17 pgs: 17 active+clean; 284 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 4.5 MiB/s wr, 28 op/s 2020-11-16T22:14:07.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:07 smithi195 bash[10218]: cluster 2020-11-16T22:14:06.284761+0000 mon.a (mon.0) 1491 : cluster [DBG] osdmap e817: 12 total, 12 up, 12 in 2020-11-16T22:14:07.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:07 smithi057 bash[10301]: cluster 2020-11-16T22:14:05.826769+0000 mgr.x (mgr.24115) 644 : cluster [DBG] pgmap v1390: 17 pgs: 17 active+clean; 284 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 4.5 MiB/s wr, 28 op/s 2020-11-16T22:14:07.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:07 smithi057 bash[10301]: cluster 2020-11-16T22:14:06.284761+0000 mon.a (mon.0) 1491 : cluster [DBG] osdmap e817: 12 total, 12 up, 12 in 2020-11-16T22:14:08.295 INFO:tasks.rados.rados.2.smithi057.stdout:3253: done (0 left) 2020-11-16T22:14:08.296 INFO:tasks.rados.rados.2.smithi057.stdout:3254: snap_remove snap 375 2020-11-16T22:14:08.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:08 smithi016 bash[10302]: cluster 2020-11-16T22:14:07.293918+0000 mon.a (mon.0) 1492 : cluster [DBG] osdmap e818: 12 total, 12 up, 12 in 2020-11-16T22:14:08.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:08 smithi195 bash[10218]: cluster 2020-11-16T22:14:07.293918+0000 mon.a (mon.0) 1492 : cluster [DBG] osdmap e818: 12 total, 12 up, 12 in 2020-11-16T22:14:08.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:08 smithi057 bash[10301]: cluster 2020-11-16T22:14:07.293918+0000 mon.a (mon.0) 1492 : cluster [DBG] osdmap e818: 12 total, 12 up, 12 in 2020-11-16T22:14:09.305 INFO:tasks.rados.rados.2.smithi057.stdout:3254: done (0 left) 2020-11-16T22:14:09.306 INFO:tasks.rados.rados.2.smithi057.stdout:3255: delete oid 16 current snap is 379 2020-11-16T22:14:09.316 INFO:tasks.rados.rados.2.smithi057.stdout:3255: done (0 left) 2020-11-16T22:14:09.316 INFO:tasks.rados.rados.2.smithi057.stdout:3256: snap_create 2020-11-16T22:14:09.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:09 smithi016 bash[10302]: cluster 2020-11-16T22:14:07.827477+0000 mgr.x (mgr.24115) 645 : cluster [DBG] pgmap v1393: 17 pgs: 17 active+clean; 290 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 5.6 MiB/s wr, 41 op/s 2020-11-16T22:14:09.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:09 smithi016 bash[10302]: cluster 2020-11-16T22:14:08.304838+0000 mon.a (mon.0) 1493 : cluster [DBG] osdmap e819: 12 total, 12 up, 12 in 2020-11-16T22:14:09.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:09 smithi195 bash[10218]: cluster 2020-11-16T22:14:07.827477+0000 mgr.x (mgr.24115) 645 : cluster [DBG] pgmap v1393: 17 pgs: 17 active+clean; 290 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 5.6 MiB/s wr, 41 op/s 2020-11-16T22:14:09.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:09 smithi195 bash[10218]: cluster 2020-11-16T22:14:08.304838+0000 mon.a (mon.0) 1493 : cluster [DBG] osdmap e819: 12 total, 12 up, 12 in 2020-11-16T22:14:09.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:09 smithi057 bash[10301]: cluster 2020-11-16T22:14:07.827477+0000 mgr.x (mgr.24115) 645 : cluster [DBG] pgmap v1393: 17 pgs: 17 active+clean; 290 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 5.6 MiB/s wr, 41 op/s 2020-11-16T22:14:09.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:09 smithi057 bash[10301]: cluster 2020-11-16T22:14:08.304838+0000 mon.a (mon.0) 1493 : cluster [DBG] osdmap e819: 12 total, 12 up, 12 in 2020-11-16T22:14:10.166 INFO:tasks.rados.rados.2.smithi057.stdout:3256: done (0 left) 2020-11-16T22:14:10.166 INFO:tasks.rados.rados.2.smithi057.stdout:3257: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:10.166 INFO:tasks.rados.rados.2.smithi057.stdout:3257: expect deleted 2020-11-16T22:14:10.166 INFO:tasks.rados.rados.2.smithi057.stdout:3258: write (excl) oid 6 current snap is 380 2020-11-16T22:14:10.166 INFO:tasks.rados.rados.2.smithi057.stdout:3258: seq_num 1091 ranges {736437=735138,2176090=160347} 2020-11-16T22:14:10.180 INFO:tasks.rados.rados.2.smithi057.stdout:3258: writing smithi05720651-6 from 736437 to 1471575 tid 1 2020-11-16T22:14:10.186 INFO:tasks.rados.rados.2.smithi057.stdout:3258: writing smithi05720651-6 from 2176090 to 2336437 tid 2 2020-11-16T22:14:10.186 INFO:tasks.rados.rados.2.smithi057.stdout:3259: write oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 380 2020-11-16T22:14:10.186 INFO:tasks.rados.rados.2.smithi057.stdout:3259: seq_num 1092 ranges {753244=410387,1834572=518672} 2020-11-16T22:14:10.192 INFO:tasks.rados.rados.2.smithi057.stdout:3259: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 753244 to 1163631 tid 1 2020-11-16T22:14:10.199 INFO:tasks.rados.rados.2.smithi057.stdout:3259: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1834572 to 2353244 tid 2 2020-11-16T22:14:10.200 INFO:tasks.rados.rados.2.smithi057.stdout:3260: write (excl) oid 42 current snap is 380 2020-11-16T22:14:10.200 INFO:tasks.rados.rados.2.smithi057.stdout:3260: seq_num 1093 ranges {770051=485636,1776701=511047} 2020-11-16T22:14:10.206 INFO:tasks.rados.rados.2.smithi057.stdout:3260: writing smithi05720651-42 from 770051 to 1255687 tid 1 2020-11-16T22:14:10.212 INFO:tasks.rados.rados.2.smithi057.stdout:3260: writing smithi05720651-42 from 1776701 to 2287748 tid 2 2020-11-16T22:14:10.212 INFO:tasks.rados.rados.2.smithi057.stdout:3261: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 380 2020-11-16T22:14:10.213 INFO:tasks.rados.rados.2.smithi057.stdout:3261: seq_num 1094 ranges {786858=560885,1835183=551675} 2020-11-16T22:14:10.220 INFO:tasks.rados.rados.2.smithi057.stdout:3261: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 786858 to 1347743 tid 1 2020-11-16T22:14:10.226 INFO:tasks.rados.rados.2.smithi057.stdout:3261: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1835183 to 2386858 tid 2 2020-11-16T22:14:10.226 INFO:tasks.rados.rados.2.smithi057.stdout:3262: snap_remove snap 374 2020-11-16T22:14:10.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:10 smithi016 bash[10302]: cluster 2020-11-16T22:14:09.315187+0000 mon.a (mon.0) 1494 : cluster [DBG] osdmap e820: 12 total, 12 up, 12 in 2020-11-16T22:14:10.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:10 smithi016 bash[10302]: cluster 2020-11-16T22:14:10.173550+0000 mon.a (mon.0) 1495 : cluster [DBG] osdmap e821: 12 total, 12 up, 12 in 2020-11-16T22:14:10.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:10 smithi195 bash[10218]: cluster 2020-11-16T22:14:09.315187+0000 mon.a (mon.0) 1494 : cluster [DBG] osdmap e820: 12 total, 12 up, 12 in 2020-11-16T22:14:10.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:10 smithi195 bash[10218]: cluster 2020-11-16T22:14:10.173550+0000 mon.a (mon.0) 1495 : cluster [DBG] osdmap e821: 12 total, 12 up, 12 in 2020-11-16T22:14:10.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:10 smithi057 bash[10301]: cluster 2020-11-16T22:14:09.315187+0000 mon.a (mon.0) 1494 : cluster [DBG] osdmap e820: 12 total, 12 up, 12 in 2020-11-16T22:14:10.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:10 smithi057 bash[10301]: cluster 2020-11-16T22:14:10.173550+0000 mon.a (mon.0) 1495 : cluster [DBG] osdmap e821: 12 total, 12 up, 12 in 2020-11-16T22:14:11.176 INFO:tasks.rados.rados.2.smithi057.stdout:3262: done (5 left) 2020-11-16T22:14:11.176 INFO:tasks.rados.rados.2.smithi057.stdout:3263: write (excl) oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 380 2020-11-16T22:14:11.176 INFO:tasks.rados.rados.2.smithi057.stdout:3263: seq_num 1095 ranges {403665=752487,1610018=514716} 2020-11-16T22:14:11.188 INFO:tasks.rados.rados.2.smithi057.stdout:3263: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 403665 to 1156152 tid 1 2020-11-16T22:14:11.193 INFO:tasks.rados.rados.2.smithi057.stdout:3263: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1610018 to 2124734 tid 2 2020-11-16T22:14:11.194 INFO:tasks.rados.rados.2.smithi057.stdout:3264: write oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 380 2020-11-16T22:14:11.194 INFO:tasks.rados.rados.2.smithi057.stdout:3264: seq_num 1096 ranges {420472=427736,1268500=658374,2347953=72519} 2020-11-16T22:14:11.198 INFO:tasks.rados.rados.2.smithi057.stdout:3264: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 420472 to 848208 tid 1 2020-11-16T22:14:11.204 INFO:tasks.rados.rados.2.smithi057.stdout:3264: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1268500 to 1926874 tid 2 2020-11-16T22:14:11.207 INFO:tasks.rados.rados.2.smithi057.stdout:3264: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2347953 to 2420472 tid 3 2020-11-16T22:14:11.207 INFO:tasks.rados.rados.2.smithi057.stdout:3265: write (excl) oid 16 current snap is 380 2020-11-16T22:14:11.208 INFO:tasks.rados.rados.2.smithi057.stdout:3265: seq_num 1097 ranges {437279=502985,1610629=518385} 2020-11-16T22:14:11.213 INFO:tasks.rados.rados.2.smithi057.stdout:3265: writing smithi05720651-16 from 437279 to 940264 tid 1 2020-11-16T22:14:11.220 INFO:tasks.rados.rados.2.smithi057.stdout:3265: writing smithi05720651-16 from 1610629 to 2129014 tid 2 2020-11-16T22:14:11.220 INFO:tasks.rados.rados.2.smithi057.stdout:3266: snap_create 2020-11-16T22:14:11.221 INFO:tasks.rados.rados.2.smithi057.stdout:3258: finishing write tid 1 to smithi05720651-6 2020-11-16T22:14:11.221 INFO:tasks.rados.rados.2.smithi057.stdout:3258: finishing write tid 2 to smithi05720651-6 2020-11-16T22:14:11.221 INFO:tasks.rados.rados.2.smithi057.stdout:3258: finishing write tid 4 to smithi05720651-6 2020-11-16T22:14:11.221 INFO:tasks.rados.rados.2.smithi057.stdout:3258: finishing write tid 5 to smithi05720651-6 2020-11-16T22:14:11.221 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 2315 (ObjNum 1091 snap 380 seq_num 1091) dirty exists 2020-11-16T22:14:11.221 INFO:tasks.rados.rados.2.smithi057.stdout:3258: left oid 6 (ObjNum 1091 snap 380 seq_num 1091) 2020-11-16T22:14:11.221 INFO:tasks.rados.rados.2.smithi057.stdout:3259: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:11.222 INFO:tasks.rados.rados.2.smithi057.stdout:3259: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:11.222 INFO:tasks.rados.rados.2.smithi057.stdout:3259: finishing write tid 4 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:11.222 INFO:tasks.rados.rados.2.smithi057.stdout:3259: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:11.222 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2318 (ObjNum 1092 snap 380 seq_num 1092) dirty exists 2020-11-16T22:14:11.222 INFO:tasks.rados.rados.2.smithi057.stdout:3259: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1092 snap 380 seq_num 1092) 2020-11-16T22:14:11.222 INFO:tasks.rados.rados.2.smithi057.stdout:3260: finishing write tid 1 to smithi05720651-42 2020-11-16T22:14:11.222 INFO:tasks.rados.rados.2.smithi057.stdout:3260: finishing write tid 2 to smithi05720651-42 2020-11-16T22:14:11.223 INFO:tasks.rados.rados.2.smithi057.stdout:3260: finishing write tid 4 to smithi05720651-42 2020-11-16T22:14:11.223 INFO:tasks.rados.rados.2.smithi057.stdout:3260: finishing write tid 5 to smithi05720651-42 2020-11-16T22:14:11.223 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 2204 (ObjNum 1093 snap 380 seq_num 1093) dirty exists 2020-11-16T22:14:11.223 INFO:tasks.rados.rados.2.smithi057.stdout:3260: left oid 42 (ObjNum 1093 snap 380 seq_num 1093) 2020-11-16T22:14:11.223 INFO:tasks.rados.rados.2.smithi057.stdout:3261: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:11.223 INFO:tasks.rados.rados.2.smithi057.stdout:3261: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:11.223 INFO:tasks.rados.rados.2.smithi057.stdout:3261: finishing write tid 4 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:11.224 INFO:tasks.rados.rados.2.smithi057.stdout:3261: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:11.224 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2665 (ObjNum 1094 snap 380 seq_num 1094) dirty exists 2020-11-16T22:14:11.224 INFO:tasks.rados.rados.2.smithi057.stdout:3261: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1094 snap 380 seq_num 1094) 2020-11-16T22:14:11.224 INFO:tasks.rados.rados.2.smithi057.stdout:3263: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:11.224 INFO:tasks.rados.rados.2.smithi057.stdout:3263: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:11.224 INFO:tasks.rados.rados.2.smithi057.stdout:3263: finishing write tid 4 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:11.224 INFO:tasks.rados.rados.2.smithi057.stdout:3263: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:11.225 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2324 (ObjNum 1095 snap 380 seq_num 1095) dirty exists 2020-11-16T22:14:11.225 INFO:tasks.rados.rados.2.smithi057.stdout:3263: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1095 snap 380 seq_num 1095) 2020-11-16T22:14:11.225 INFO:tasks.rados.rados.2.smithi057.stdout:3264: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:11.225 INFO:tasks.rados.rados.2.smithi057.stdout:3264: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:11.225 INFO:tasks.rados.rados.2.smithi057.stdout:3264: finishing write tid 3 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:11.225 INFO:tasks.rados.rados.2.smithi057.stdout:3265: finishing write tid 1 to smithi05720651-16 2020-11-16T22:14:11.226 INFO:tasks.rados.rados.2.smithi057.stdout:3265: finishing write tid 2 to smithi05720651-16 2020-11-16T22:14:11.227 INFO:tasks.rados.rados.2.smithi057.stdout:3265: finishing write tid 4 to smithi05720651-16 2020-11-16T22:14:11.228 INFO:tasks.rados.rados.2.smithi057.stdout:3265: finishing write tid 5 to smithi05720651-16 2020-11-16T22:14:11.228 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 2545 (ObjNum 1097 snap 380 seq_num 1097) dirty exists 2020-11-16T22:14:11.228 INFO:tasks.rados.rados.2.smithi057.stdout:3265: left oid 16 (ObjNum 1097 snap 380 seq_num 1097) 2020-11-16T22:14:11.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:11 smithi016 bash[10302]: cluster 2020-11-16T22:14:09.828275+0000 mgr.x (mgr.24115) 646 : cluster [DBG] pgmap v1396: 17 pgs: 17 active+clean; 290 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2020-11-16T22:14:11.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:11 smithi016 bash[10302]: cluster 2020-11-16T22:14:11.184860+0000 mon.a (mon.0) 1496 : cluster [DBG] osdmap e822: 12 total, 12 up, 12 in 2020-11-16T22:14:11.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:11 smithi195 bash[10218]: cluster 2020-11-16T22:14:09.828275+0000 mgr.x (mgr.24115) 646 : cluster [DBG] pgmap v1396: 17 pgs: 17 active+clean; 290 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2020-11-16T22:14:11.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:11 smithi195 bash[10218]: cluster 2020-11-16T22:14:11.184860+0000 mon.a (mon.0) 1496 : cluster [DBG] osdmap e822: 12 total, 12 up, 12 in 2020-11-16T22:14:11.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:11 smithi057 bash[10301]: cluster 2020-11-16T22:14:09.828275+0000 mgr.x (mgr.24115) 646 : cluster [DBG] pgmap v1396: 17 pgs: 17 active+clean; 290 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 1.1 MiB/s wr, 16 op/s 2020-11-16T22:14:11.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:11 smithi057 bash[10301]: cluster 2020-11-16T22:14:11.184860+0000 mon.a (mon.0) 1496 : cluster [DBG] osdmap e822: 12 total, 12 up, 12 in 2020-11-16T22:14:11.985 INFO:tasks.rados.rados.2.smithi057.stdout:3264: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:11.985 INFO:tasks.rados.rados.2.smithi057.stdout:3264: finishing write tid 6 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:11.986 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1811 (ObjNum 1096 snap 380 seq_num 1096) dirty exists 2020-11-16T22:14:11.986 INFO:tasks.rados.rados.2.smithi057.stdout:3264: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1096 snap 380 seq_num 1096) 2020-11-16T22:14:12.177 INFO:tasks.rados.rados.2.smithi057.stdout:3257: done (8 left) 2020-11-16T22:14:12.177 INFO:tasks.rados.rados.2.smithi057.stdout:3258: done (7 left) 2020-11-16T22:14:12.178 INFO:tasks.rados.rados.2.smithi057.stdout:3259: done (6 left) 2020-11-16T22:14:12.178 INFO:tasks.rados.rados.2.smithi057.stdout:3260: done (5 left) 2020-11-16T22:14:12.178 INFO:tasks.rados.rados.2.smithi057.stdout:3261: done (4 left) 2020-11-16T22:14:12.178 INFO:tasks.rados.rados.2.smithi057.stdout:3263: done (3 left) 2020-11-16T22:14:12.178 INFO:tasks.rados.rados.2.smithi057.stdout:3264: done (2 left) 2020-11-16T22:14:12.179 INFO:tasks.rados.rados.2.smithi057.stdout:3265: done (1 left) 2020-11-16T22:14:12.179 INFO:tasks.rados.rados.2.smithi057.stdout:3266: done (0 left) 2020-11-16T22:14:12.179 INFO:tasks.rados.rados.2.smithi057.stdout:3267: read oid 36 snap -1 2020-11-16T22:14:12.179 INFO:tasks.rados.rados.2.smithi057.stdout:3267: expect deleted 2020-11-16T22:14:12.179 INFO:tasks.rados.rados.2.smithi057.stdout:3268: snap_remove snap 376 2020-11-16T22:14:13.180 INFO:tasks.rados.rados.2.smithi057.stdout:3268: done (1 left) 2020-11-16T22:14:13.180 INFO:tasks.rados.rados.2.smithi057.stdout:3269: snap_remove snap 350 2020-11-16T22:14:13.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:13 smithi057 bash[10301]: cluster 2020-11-16T22:14:11.829076+0000 mgr.x (mgr.24115) 647 : cluster [DBG] pgmap v1399: 17 pgs: 17 active+clean; 298 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2020-11-16T22:14:13.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:13 smithi057 bash[10301]: cluster 2020-11-16T22:14:12.186977+0000 mon.a (mon.0) 1497 : cluster [DBG] osdmap e823: 12 total, 12 up, 12 in 2020-11-16T22:14:13.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:13 smithi016 bash[10302]: cluster 2020-11-16T22:14:11.829076+0000 mgr.x (mgr.24115) 647 : cluster [DBG] pgmap v1399: 17 pgs: 17 active+clean; 298 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2020-11-16T22:14:13.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:13 smithi016 bash[10302]: cluster 2020-11-16T22:14:12.186977+0000 mon.a (mon.0) 1497 : cluster [DBG] osdmap e823: 12 total, 12 up, 12 in 2020-11-16T22:14:13.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:13 smithi195 bash[10218]: cluster 2020-11-16T22:14:11.829076+0000 mgr.x (mgr.24115) 647 : cluster [DBG] pgmap v1399: 17 pgs: 17 active+clean; 298 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2020-11-16T22:14:13.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:13 smithi195 bash[10218]: cluster 2020-11-16T22:14:12.186977+0000 mon.a (mon.0) 1497 : cluster [DBG] osdmap e823: 12 total, 12 up, 12 in 2020-11-16T22:14:14.216 INFO:tasks.rados.rados.2.smithi057.stdout:3269: done (1 left) 2020-11-16T22:14:14.217 INFO:tasks.rados.rados.2.smithi057.stdout:3270: read oid 44 snap -1 2020-11-16T22:14:14.217 INFO:tasks.rados.rados.2.smithi057.stdout:3270: expect deleted 2020-11-16T22:14:14.217 INFO:tasks.rados.rados.2.smithi057.stdout:3271: write oid 40 current snap is 381 2020-11-16T22:14:14.217 INFO:tasks.rados.rados.2.smithi057.stdout:3271: seq_num 1098 ranges {454086=578234,1669111=662043} 2020-11-16T22:14:14.229 INFO:tasks.rados.rados.2.smithi057.stdout:3271: writing smithi05720651-40 from 454086 to 1032320 tid 1 2020-11-16T22:14:14.237 INFO:tasks.rados.rados.2.smithi057.stdout:3271: writing smithi05720651-40 from 1669111 to 2331154 tid 2 2020-11-16T22:14:14.237 INFO:tasks.rados.rados.2.smithi057.stdout:3272: read oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:14.237 INFO:tasks.rados.rados.2.smithi057.stdout:3272: expect (ObjNum 949 snap 328 seq_num 949) 2020-11-16T22:14:14.238 INFO:tasks.rados.rados.2.smithi057.stdout:3273: rollback oid 32 current snap is 381 2020-11-16T22:14:14.238 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 32 to 351 2020-11-16T22:14:14.238 INFO:tasks.rados.rados.2.smithi057.stdout:3267: done (4 left) 2020-11-16T22:14:14.238 INFO:tasks.rados.rados.2.smithi057.stdout:3270: done (3 left) 2020-11-16T22:14:14.238 INFO:tasks.rados.rados.2.smithi057.stdout:3274: read oid 34 snap -1 2020-11-16T22:14:14.238 INFO:tasks.rados.rados.2.smithi057.stdout:3274: expect deleted 2020-11-16T22:14:14.239 INFO:tasks.rados.rados.2.smithi057.stdout:3275: copy_from oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 10 current snap is 381 2020-11-16T22:14:14.239 INFO:tasks.rados.rados.2.smithi057.stdout:3276: write (excl) oid 16 current snap is 381 2020-11-16T22:14:14.239 INFO:tasks.rados.rados.2.smithi057.stdout:3276: seq_num 1099 ranges {470893=653483,1727593=522054} 2020-11-16T22:14:14.244 INFO:tasks.rados.rados.2.smithi057.stdout:3276: writing smithi05720651-16 from 470893 to 1124376 tid 1 2020-11-16T22:14:14.251 INFO:tasks.rados.rados.2.smithi057.stdout:3276: writing smithi05720651-16 from 1727593 to 2249647 tid 2 2020-11-16T22:14:14.251 INFO:tasks.rados.rados.2.smithi057.stdout:3277: write oid 6 current snap is 381 2020-11-16T22:14:14.251 INFO:tasks.rados.rados.2.smithi057.stdout:3277: seq_num 1100 ranges {487700=728732,1786075=665712} 2020-11-16T22:14:14.258 INFO:tasks.rados.rados.2.smithi057.stdout:3277: writing smithi05720651-6 from 487700 to 1216432 tid 1 2020-11-16T22:14:14.266 INFO:tasks.rados.rados.2.smithi057.stdout:3277: writing smithi05720651-6 from 1786075 to 2451787 tid 2 2020-11-16T22:14:14.266 INFO:tasks.rados.rados.2.smithi057.stdout:3278: write (excl) oid 46 current snap is 381 2020-11-16T22:14:14.266 INFO:tasks.rados.rados.2.smithi057.stdout:3278: seq_num 1101 ranges {504507=403981,1328204=409370,2252362=252145} 2020-11-16T22:14:14.271 INFO:tasks.rados.rados.2.smithi057.stdout:3278: writing smithi05720651-46 from 504507 to 908488 tid 1 2020-11-16T22:14:14.276 INFO:tasks.rados.rados.2.smithi057.stdout:3278: writing smithi05720651-46 from 1328204 to 1737574 tid 2 2020-11-16T22:14:14.280 INFO:tasks.rados.rados.2.smithi057.stdout:3278: writing smithi05720651-46 from 2252362 to 2504507 tid 3 2020-11-16T22:14:14.281 INFO:tasks.rados.rados.2.smithi057.stdout:3279: write (excl) oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 381 2020-11-16T22:14:14.281 INFO:tasks.rados.rados.2.smithi057.stdout:3279: seq_num 1102 ranges {521314=479230,1786686=669381} 2020-11-16T22:14:14.286 INFO:tasks.rados.rados.2.smithi057.stdout:3279: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 521314 to 1000544 tid 1 2020-11-16T22:14:14.294 INFO:tasks.rados.rados.2.smithi057.stdout:3279: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1786686 to 2456067 tid 2 2020-11-16T22:14:14.295 INFO:tasks.rados.rados.2.smithi057.stdout:3280: copy_from oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 14 current snap is 381 2020-11-16T22:14:14.295 INFO:tasks.rados.rados.2.smithi057.stdout:3271: finishing write tid 1 to smithi05720651-40 2020-11-16T22:14:14.295 INFO:tasks.rados.rados.2.smithi057.stdout:3272: expect (ObjNum 949 snap 328 seq_num 949) 2020-11-16T22:14:14.472 INFO:tasks.rados.rados.2.smithi057.stdout:3276: finishing write tid 1 to smithi05720651-16 2020-11-16T22:14:14.472 INFO:tasks.rados.rados.2.smithi057.stdout:3271: finishing write tid 2 to smithi05720651-40 2020-11-16T22:14:14.472 INFO:tasks.rados.rados.2.smithi057.stdout:3271: finishing write tid 4 to smithi05720651-40 2020-11-16T22:14:14.472 INFO:tasks.rados.rados.2.smithi057.stdout:3271: finishing write tid 5 to smithi05720651-40 2020-11-16T22:14:14.472 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 2679 (ObjNum 1098 snap 381 seq_num 1098) dirty exists 2020-11-16T22:14:14.473 INFO:tasks.rados.rados.2.smithi057.stdout:3271: left oid 40 (ObjNum 1098 snap 381 seq_num 1098) 2020-11-16T22:14:14.473 INFO:tasks.rados.rados.2.smithi057.stdout:3275: finishing copy_from to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:14.473 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2209 (ObjNum 1028 snap 361 seq_num 1028) dirty exists 2020-11-16T22:14:14.473 INFO:tasks.rados.rados.2.smithi057.stdout:3275: finishing copy_from racing read to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:14.473 INFO:tasks.rados.rados.2.smithi057.stdout:3276: finishing write tid 2 to smithi05720651-16 2020-11-16T22:14:14.473 INFO:tasks.rados.rados.2.smithi057.stdout:3277: finishing write tid 1 to smithi05720651-6 2020-11-16T22:14:14.473 INFO:tasks.rados.rados.2.smithi057.stdout:3276: finishing write tid 4 to smithi05720651-16 2020-11-16T22:14:14.474 INFO:tasks.rados.rados.2.smithi057.stdout:3276: finishing write tid 5 to smithi05720651-16 2020-11-16T22:14:14.474 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 2548 (ObjNum 1099 snap 381 seq_num 1099) dirty exists 2020-11-16T22:14:14.474 INFO:tasks.rados.rados.2.smithi057.stdout:3276: left oid 16 (ObjNum 1099 snap 381 seq_num 1099) 2020-11-16T22:14:14.474 INFO:tasks.rados.rados.2.smithi057.stdout:3273: finishing rollback tid 1 to smithi05720651-32 2020-11-16T22:14:14.474 INFO:tasks.rados.rados.2.smithi057.stdout:3273: finishing rollback tid 2 to smithi05720651-32 2020-11-16T22:14:14.474 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 2685 (ObjNum 976 snap 340 seq_num 976) dirty exists 2020-11-16T22:14:14.474 INFO:tasks.rados.rados.2.smithi057.stdout:3277: finishing write tid 2 to smithi05720651-6 2020-11-16T22:14:14.475 INFO:tasks.rados.rados.2.smithi057.stdout:3277: finishing write tid 4 to smithi05720651-6 2020-11-16T22:14:14.475 INFO:tasks.rados.rados.2.smithi057.stdout:3277: finishing write tid 5 to smithi05720651-6 2020-11-16T22:14:14.475 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 2344 (ObjNum 1100 snap 381 seq_num 1100) dirty exists 2020-11-16T22:14:14.475 INFO:tasks.rados.rados.2.smithi057.stdout:3277: left oid 6 (ObjNum 1100 snap 381 seq_num 1100) 2020-11-16T22:14:14.475 INFO:tasks.rados.rados.2.smithi057.stdout:3278: finishing write tid 1 to smithi05720651-46 2020-11-16T22:14:14.475 INFO:tasks.rados.rados.2.smithi057.stdout:3271: done (9 left) 2020-11-16T22:14:14.475 INFO:tasks.rados.rados.2.smithi057.stdout:3272: done (8 left) 2020-11-16T22:14:14.475 INFO:tasks.rados.rados.2.smithi057.stdout:3273: done (7 left) 2020-11-16T22:14:14.476 INFO:tasks.rados.rados.2.smithi057.stdout:3274: done (6 left) 2020-11-16T22:14:14.476 INFO:tasks.rados.rados.2.smithi057.stdout:3275: done (5 left) 2020-11-16T22:14:14.476 INFO:tasks.rados.rados.2.smithi057.stdout:3276: done (4 left) 2020-11-16T22:14:14.476 INFO:tasks.rados.rados.2.smithi057.stdout:3277: done (3 left) 2020-11-16T22:14:14.476 INFO:tasks.rados.rados.2.smithi057.stdout:3281: write oid 30 current snap is 381 2020-11-16T22:14:14.476 INFO:tasks.rados.rados.2.smithi057.stdout:3281: seq_num 1103 ranges {538121=670832,1961521=413039} 2020-11-16T22:14:14.478 INFO:tasks.rados.rados.2.smithi057.stdout:3281: writing smithi05720651-30 from 538121 to 1208953 tid 1 2020-11-16T22:14:14.485 INFO:tasks.rados.rados.2.smithi057.stdout:3281: writing smithi05720651-30 from 1961521 to 2374560 tid 2 2020-11-16T22:14:14.485 INFO:tasks.rados.rados.2.smithi057.stdout:3282: copy_from oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 381 2020-11-16T22:14:14.485 INFO:tasks.rados.rados.2.smithi057.stdout:3280: finishing copy_from to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:14.486 INFO:tasks.rados.rados.2.smithi057.stdout:3280: got expected ENOENT (src dne) 2020-11-16T22:14:14.486 INFO:tasks.rados.rados.2.smithi057.stdout:3280: finishing copy_from racing read to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:14.486 INFO:tasks.rados.rados.2.smithi057.stdout:3278: finishing write tid 2 to smithi05720651-46 2020-11-16T22:14:14.486 INFO:tasks.rados.rados.2.smithi057.stdout:3278: finishing write tid 3 to smithi05720651-46 2020-11-16T22:14:14.486 INFO:tasks.rados.rados.2.smithi057.stdout:3278: finishing write tid 5 to smithi05720651-46 2020-11-16T22:14:14.486 INFO:tasks.rados.rados.2.smithi057.stdout:3278: finishing write tid 6 to smithi05720651-46 2020-11-16T22:14:14.486 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 2552 (ObjNum 1101 snap 381 seq_num 1101) dirty exists 2020-11-16T22:14:14.487 INFO:tasks.rados.rados.2.smithi057.stdout:3278: left oid 46 (ObjNum 1101 snap 381 seq_num 1101) 2020-11-16T22:14:14.487 INFO:tasks.rados.rados.2.smithi057.stdout:3279: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:14.487 INFO:tasks.rados.rados.2.smithi057.stdout:3279: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:14.487 INFO:tasks.rados.rados.2.smithi057.stdout:3279: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:14.487 INFO:tasks.rados.rados.2.smithi057.stdout:3278: done (4 left) 2020-11-16T22:14:14.487 INFO:tasks.rados.rados.2.smithi057.stdout:3280: done (3 left) 2020-11-16T22:14:14.487 INFO:tasks.rados.rados.2.smithi057.stdout:3283: write (excl) oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 381 2020-11-16T22:14:14.488 INFO:tasks.rados.rados.2.smithi057.stdout:3283: seq_num 1104 ranges {554928=746081,2020003=534925} 2020-11-16T22:14:14.493 INFO:tasks.rados.rados.2.smithi057.stdout:3283: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 554928 to 1301009 tid 1 2020-11-16T22:14:14.501 INFO:tasks.rados.rados.2.smithi057.stdout:3283: writing smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2020003 to 2554928 tid 2 2020-11-16T22:14:14.501 INFO:tasks.rados.rados.2.smithi057.stdout:3284: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 378 2020-11-16T22:14:14.501 INFO:tasks.rados.rados.2.smithi057.stdout:3284: expect (ObjNum 1085 snap 377 seq_num 1085) 2020-11-16T22:14:14.501 INFO:tasks.rados.rados.2.smithi057.stdout:3285: rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 381 2020-11-16T22:14:14.501 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 351 2020-11-16T22:14:14.501 INFO:tasks.rados.rados.2.smithi057.stdout:3279: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:14.502 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2227 (ObjNum 1102 snap 381 seq_num 1102) dirty exists 2020-11-16T22:14:14.502 INFO:tasks.rados.rados.2.smithi057.stdout:3279: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1102 snap 381 seq_num 1102) 2020-11-16T22:14:14.502 INFO:tasks.rados.rados.2.smithi057.stdout:3279: done (5 left) 2020-11-16T22:14:14.502 INFO:tasks.rados.rados.2.smithi057.stdout:3286: delete oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 381 2020-11-16T22:14:14.502 INFO:tasks.rados.rados.2.smithi057.stdout:3281: finishing write tid 1 to smithi05720651-30 2020-11-16T22:14:14.502 INFO:tasks.rados.rados.2.smithi057.stdout:3281: finishing write tid 2 to smithi05720651-30 2020-11-16T22:14:14.502 INFO:tasks.rados.rados.2.smithi057.stdout:3281: finishing write tid 4 to smithi05720651-30 2020-11-16T22:14:14.503 INFO:tasks.rados.rados.2.smithi057.stdout:3281: finishing write tid 5 to smithi05720651-30 2020-11-16T22:14:14.503 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 2555 (ObjNum 1103 snap 381 seq_num 1103) dirty exists 2020-11-16T22:14:14.503 INFO:tasks.rados.rados.2.smithi057.stdout:3281: left oid 30 (ObjNum 1103 snap 381 seq_num 1103) 2020-11-16T22:14:14.503 INFO:tasks.rados.rados.2.smithi057.stdout:3283: finishing write tid 1 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:14.503 INFO:tasks.rados.rados.2.smithi057.stdout:3282: finishing copy_from to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:14.504 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2324 (ObjNum 1095 snap 380 seq_num 1095) dirty exists 2020-11-16T22:14:14.504 INFO:tasks.rados.rados.2.smithi057.stdout:3282: finishing copy_from racing read to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:14.505 INFO:tasks.rados.rados.2.smithi057.stdout:3284: expect (ObjNum 1085 snap 377 seq_num 1085) 2020-11-16T22:14:14.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:14 smithi016 bash[10302]: cluster 2020-11-16T22:14:13.190122+0000 mon.a (mon.0) 1498 : cluster [DBG] osdmap e824: 12 total, 12 up, 12 in 2020-11-16T22:14:14.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:14 smithi195 bash[10218]: cluster 2020-11-16T22:14:13.190122+0000 mon.a (mon.0) 1498 : cluster [DBG] osdmap e824: 12 total, 12 up, 12 in 2020-11-16T22:14:14.659 INFO:tasks.rados.rados.2.smithi057.stdout:3283: finishing write tid 2 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:14.659 INFO:tasks.rados.rados.2.smithi057.stdout:3283: finishing write tid 4 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:14.660 INFO:tasks.rados.rados.2.smithi057.stdout:3283: finishing write tid 5 to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:14.660 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 1786 (ObjNum 1104 snap 381 seq_num 1104) dirty exists 2020-11-16T22:14:14.660 INFO:tasks.rados.rados.2.smithi057.stdout:3283: left oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1104 snap 381 seq_num 1104) 2020-11-16T22:14:14.660 INFO:tasks.rados.rados.2.smithi057.stdout:3285: finishing rollback tid 0 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:14.660 INFO:tasks.rados.rados.2.smithi057.stdout:3285: finishing rollback tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:14.660 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2214 (ObjNum 33 snap 0 seq_num 1131374913) dirty dne 2020-11-16T22:14:14.661 INFO:tasks.rados.rados.2.smithi057.stdout:3281: done (5 left) 2020-11-16T22:14:14.661 INFO:tasks.rados.rados.2.smithi057.stdout:3282: done (4 left) 2020-11-16T22:14:14.661 INFO:tasks.rados.rados.2.smithi057.stdout:3283: done (3 left) 2020-11-16T22:14:14.661 INFO:tasks.rados.rados.2.smithi057.stdout:3284: done (2 left) 2020-11-16T22:14:14.661 INFO:tasks.rados.rados.2.smithi057.stdout:3285: done (1 left) 2020-11-16T22:14:14.661 INFO:tasks.rados.rados.2.smithi057.stdout:3286: done (0 left) 2020-11-16T22:14:14.661 INFO:tasks.rados.rados.2.smithi057.stdout:3287: rollback oid 38 current snap is 381 2020-11-16T22:14:14.662 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 38 to 372 2020-11-16T22:14:14.662 INFO:tasks.rados.rados.2.smithi057.stdout:3288: read oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:14.662 INFO:tasks.rados.rados.2.smithi057.stdout:3288: expect deleted 2020-11-16T22:14:14.662 INFO:tasks.rados.rados.2.smithi057.stdout:3289: write (excl) oid 32 current snap is 381 2020-11-16T22:14:14.662 INFO:tasks.rados.rados.2.smithi057.stdout:3289: seq_num 1106 ranges {588542=496579,1620614=676719} 2020-11-16T22:14:14.675 INFO:tasks.rados.rados.2.smithi057.stdout:3289: writing smithi05720651-32 from 588542 to 1085121 tid 1 2020-11-16T22:14:14.682 INFO:tasks.rados.rados.2.smithi057.stdout:3289: writing smithi05720651-32 from 1620614 to 2297333 tid 2 2020-11-16T22:14:14.682 INFO:tasks.rados.rados.2.smithi057.stdout:3290: snap_create 2020-11-16T22:14:14.682 INFO:tasks.rados.rados.2.smithi057.stdout:3287: finishing rollback tid 0 to smithi05720651-38 2020-11-16T22:14:14.682 INFO:tasks.rados.rados.2.smithi057.stdout:3287: finishing rollback tid 1 to smithi05720651-38 2020-11-16T22:14:14.683 INFO:tasks.rados.rados.2.smithi057.stdout:3287: finishing rollback tid 2 to smithi05720651-38 2020-11-16T22:14:14.683 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 2387 (ObjNum 941 snap 324 seq_num 941) dirty exists 2020-11-16T22:14:14.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:14 smithi057 bash[10301]: cluster 2020-11-16T22:14:13.190122+0000 mon.a (mon.0) 1498 : cluster [DBG] osdmap e824: 12 total, 12 up, 12 in 2020-11-16T22:14:15.015 INFO:tasks.rados.rados.2.smithi057.stdout:3289: finishing write tid 1 to smithi05720651-32 2020-11-16T22:14:15.023 INFO:tasks.rados.rados.2.smithi057.stdout:3289: finishing write tid 2 to smithi05720651-32 2020-11-16T22:14:15.024 INFO:tasks.rados.rados.2.smithi057.stdout:3289: finishing write tid 4 to smithi05720651-32 2020-11-16T22:14:15.024 INFO:tasks.rados.rados.2.smithi057.stdout:3289: finishing write tid 5 to smithi05720651-32 2020-11-16T22:14:15.024 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 2692 (ObjNum 1106 snap 381 seq_num 1106) dirty exists 2020-11-16T22:14:15.025 INFO:tasks.rados.rados.2.smithi057.stdout:3289: left oid 32 (ObjNum 1106 snap 381 seq_num 1106) 2020-11-16T22:14:15.166 INFO:tasks.rados.rados.2.smithi057.stdout:3287: done (3 left) 2020-11-16T22:14:15.166 INFO:tasks.rados.rados.2.smithi057.stdout:3288: done (2 left) 2020-11-16T22:14:15.166 INFO:tasks.rados.rados.2.smithi057.stdout:3289: done (1 left) 2020-11-16T22:14:15.166 INFO:tasks.rados.rados.2.smithi057.stdout:3290: done (0 left) 2020-11-16T22:14:15.167 INFO:tasks.rados.rados.2.smithi057.stdout:3291: write (excl) oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 382 2020-11-16T22:14:15.167 INFO:tasks.rados.rados.2.smithi057.stdout:3291: seq_num 1107 ranges {605349=571828,1679096=420377} 2020-11-16T22:14:15.179 INFO:tasks.rados.rados.2.smithi057.stdout:3291: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 605349 to 1177177 tid 1 2020-11-16T22:14:15.186 INFO:tasks.rados.rados.2.smithi057.stdout:3291: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1679096 to 2099473 tid 2 2020-11-16T22:14:15.186 INFO:tasks.rados.rados.2.smithi057.stdout:3292: rollback oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 382 2020-11-16T22:14:15.187 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 363 2020-11-16T22:14:15.187 INFO:tasks.rados.rados.2.smithi057.stdout:3293: write (excl) oid 42 current snap is 382 2020-11-16T22:14:15.187 INFO:tasks.rados.rados.2.smithi057.stdout:3293: seq_num 1108 ranges {622156=647077,1737578=680388} 2020-11-16T22:14:15.194 INFO:tasks.rados.rados.2.smithi057.stdout:3293: writing smithi05720651-42 from 622156 to 1269233 tid 1 2020-11-16T22:14:15.200 INFO:tasks.rados.rados.2.smithi057.stdout:3293: writing smithi05720651-42 from 1737578 to 2417966 tid 2 2020-11-16T22:14:15.201 INFO:tasks.rados.rados.2.smithi057.stdout:3294: read oid 8 snap -1 2020-11-16T22:14:15.201 INFO:tasks.rados.rados.2.smithi057.stdout:3294: expect deleted 2020-11-16T22:14:15.201 INFO:tasks.rados.rados.2.smithi057.stdout:3295: snap_create 2020-11-16T22:14:15.201 INFO:tasks.rados.rados.2.smithi057.stdout:3291: finishing write tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:15.201 INFO:tasks.rados.rados.2.smithi057.stdout:3291: finishing write tid 2 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:15.201 INFO:tasks.rados.rados.2.smithi057.stdout:3291: finishing write tid 4 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:15.202 INFO:tasks.rados.rados.2.smithi057.stdout:3291: finishing write tid 5 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:15.202 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2390 (ObjNum 1107 snap 382 seq_num 1107) dirty exists 2020-11-16T22:14:15.202 INFO:tasks.rados.rados.2.smithi057.stdout:3291: left oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1107 snap 382 seq_num 1107) 2020-11-16T22:14:15.202 INFO:tasks.rados.rados.2.smithi057.stdout:3292: finishing rollback tid 0 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:15.202 INFO:tasks.rados.rados.2.smithi057.stdout:3292: finishing rollback tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:15.202 INFO:tasks.rados.rados.2.smithi057.stdout:3292: finishing rollback tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:15.202 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2217 (ObjNum 981 snap 341 seq_num 981) dirty exists 2020-11-16T22:14:15.203 INFO:tasks.rados.rados.2.smithi057.stdout:3293: finishing write tid 1 to smithi05720651-42 2020-11-16T22:14:15.206 INFO:tasks.rados.rados.2.smithi057.stdout:3293: finishing write tid 2 to smithi05720651-42 2020-11-16T22:14:15.207 INFO:tasks.rados.rados.2.smithi057.stdout:3293: finishing write tid 4 to smithi05720651-42 2020-11-16T22:14:15.207 INFO:tasks.rados.rados.2.smithi057.stdout:3293: finishing write tid 5 to smithi05720651-42 2020-11-16T22:14:15.207 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 2207 (ObjNum 1108 snap 382 seq_num 1108) dirty exists 2020-11-16T22:14:15.207 INFO:tasks.rados.rados.2.smithi057.stdout:3293: left oid 42 (ObjNum 1108 snap 382 seq_num 1108) 2020-11-16T22:14:15.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:15 smithi016 bash[10302]: cluster 2020-11-16T22:14:13.829812+0000 mgr.x (mgr.24115) 648 : cluster [DBG] pgmap v1402: 17 pgs: 17 active+clean; 298 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1.4 MiB/s wr, 8 op/s 2020-11-16T22:14:15.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:15 smithi016 bash[10302]: cluster 2020-11-16T22:14:14.226051+0000 mon.a (mon.0) 1499 : cluster [DBG] osdmap e825: 12 total, 12 up, 12 in 2020-11-16T22:14:15.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:15 smithi016 bash[10302]: cluster 2020-11-16T22:14:15.176415+0000 mon.a (mon.0) 1500 : cluster [DBG] osdmap e826: 12 total, 12 up, 12 in 2020-11-16T22:14:15.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:15 smithi195 bash[10218]: cluster 2020-11-16T22:14:13.829812+0000 mgr.x (mgr.24115) 648 : cluster [DBG] pgmap v1402: 17 pgs: 17 active+clean; 298 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1.4 MiB/s wr, 8 op/s 2020-11-16T22:14:15.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:15 smithi195 bash[10218]: cluster 2020-11-16T22:14:14.226051+0000 mon.a (mon.0) 1499 : cluster [DBG] osdmap e825: 12 total, 12 up, 12 in 2020-11-16T22:14:15.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:15 smithi195 bash[10218]: cluster 2020-11-16T22:14:15.176415+0000 mon.a (mon.0) 1500 : cluster [DBG] osdmap e826: 12 total, 12 up, 12 in 2020-11-16T22:14:15.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:15 smithi057 bash[10301]: cluster 2020-11-16T22:14:13.829812+0000 mgr.x (mgr.24115) 648 : cluster [DBG] pgmap v1402: 17 pgs: 17 active+clean; 298 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 1.4 MiB/s wr, 8 op/s 2020-11-16T22:14:15.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:15 smithi057 bash[10301]: cluster 2020-11-16T22:14:14.226051+0000 mon.a (mon.0) 1499 : cluster [DBG] osdmap e825: 12 total, 12 up, 12 in 2020-11-16T22:14:15.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:15 smithi057 bash[10301]: cluster 2020-11-16T22:14:15.176415+0000 mon.a (mon.0) 1500 : cluster [DBG] osdmap e826: 12 total, 12 up, 12 in 2020-11-16T22:14:16.177 INFO:tasks.rados.rados.2.smithi057.stdout:3291: done (4 left) 2020-11-16T22:14:16.177 INFO:tasks.rados.rados.2.smithi057.stdout:3292: done (3 left) 2020-11-16T22:14:16.177 INFO:tasks.rados.rados.2.smithi057.stdout:3293: done (2 left) 2020-11-16T22:14:16.178 INFO:tasks.rados.rados.2.smithi057.stdout:3294: done (1 left) 2020-11-16T22:14:16.178 INFO:tasks.rados.rados.2.smithi057.stdout:3295: done (0 left) 2020-11-16T22:14:16.178 INFO:tasks.rados.rados.2.smithi057.stdout:3296: rollback oid 20 current snap is 383 2020-11-16T22:14:16.178 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 20 to 378 2020-11-16T22:14:16.178 INFO:tasks.rados.rados.2.smithi057.stdout:3297: delete oid 8 current snap is 383 2020-11-16T22:14:16.182 INFO:tasks.rados.rados.2.smithi057.stdout:3297: done (1 left) 2020-11-16T22:14:16.182 INFO:tasks.rados.rados.2.smithi057.stdout:3298: snap_create 2020-11-16T22:14:16.183 INFO:tasks.rados.rados.2.smithi057.stdout:3296: finishing rollback tid 0 to smithi05720651-20 2020-11-16T22:14:16.184 INFO:tasks.rados.rados.2.smithi057.stdout:3296: finishing rollback tid 1 to smithi05720651-20 2020-11-16T22:14:16.184 INFO:tasks.rados.rados.2.smithi057.stdout:3296: finishing rollback tid 2 to smithi05720651-20 2020-11-16T22:14:16.184 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 2200 (ObjNum 1061 snap 373 seq_num 1061) dirty exists 2020-11-16T22:14:17.179 INFO:tasks.rados.rados.2.smithi057.stdout:3296: done (1 left) 2020-11-16T22:14:17.180 INFO:tasks.rados.rados.2.smithi057.stdout:3298: done (0 left) 2020-11-16T22:14:17.180 INFO:tasks.rados.rados.2.smithi057.stdout:3299: write oid 14 current snap is 384 2020-11-16T22:14:17.180 INFO:tasks.rados.rados.2.smithi057.stdout:3299: seq_num 1110 ranges {655770=513928,1854542=684057} 2020-11-16T22:14:17.191 INFO:tasks.rados.rados.2.smithi057.stdout:3299: writing smithi05720651-14 from 655770 to 1169698 tid 1 2020-11-16T22:14:17.200 INFO:tasks.rados.rados.2.smithi057.stdout:3299: writing smithi05720651-14 from 1854542 to 2538599 tid 2 2020-11-16T22:14:17.200 INFO:tasks.rados.rados.2.smithi057.stdout:3300: rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 384 2020-11-16T22:14:17.201 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 368 2020-11-16T22:14:17.201 INFO:tasks.rados.rados.2.smithi057.stdout:3301: snap_create 2020-11-16T22:14:17.208 INFO:tasks.rados.rados.2.smithi057.stdout:3299: finishing write tid 1 to smithi05720651-14 2020-11-16T22:14:17.209 INFO:tasks.rados.rados.2.smithi057.stdout:3299: finishing write tid 2 to smithi05720651-14 2020-11-16T22:14:17.210 INFO:tasks.rados.rados.2.smithi057.stdout:3299: finishing write tid 4 to smithi05720651-14 2020-11-16T22:14:17.210 INFO:tasks.rados.rados.2.smithi057.stdout:3299: finishing write tid 5 to smithi05720651-14 2020-11-16T22:14:17.210 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 2703 (ObjNum 1110 snap 384 seq_num 1110) dirty exists 2020-11-16T22:14:17.211 INFO:tasks.rados.rados.2.smithi057.stdout:3299: left oid 14 (ObjNum 1110 snap 384 seq_num 1110) 2020-11-16T22:14:17.211 INFO:tasks.rados.rados.2.smithi057.stdout:3300: finishing rollback tid 0 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:17.211 INFO:tasks.rados.rados.2.smithi057.stdout:3300: finishing rollback tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:17.213 INFO:tasks.rados.rados.2.smithi057.stdout:3300: finishing rollback tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:17.213 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2558 (ObjNum 949 snap 328 seq_num 949) dirty exists 2020-11-16T22:14:17.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:17 smithi057 bash[10301]: cluster 2020-11-16T22:14:15.830591+0000 mgr.x (mgr.24115) 649 : cluster [DBG] pgmap v1405: 17 pgs: 17 active+clean; 306 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 15 op/s 2020-11-16T22:14:17.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:17 smithi057 bash[10301]: cluster 2020-11-16T22:14:16.186304+0000 mon.a (mon.0) 1501 : cluster [DBG] osdmap e827: 12 total, 12 up, 12 in 2020-11-16T22:14:17.596 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:17 smithi016 bash[10302]: cluster 2020-11-16T22:14:15.830591+0000 mgr.x (mgr.24115) 649 : cluster [DBG] pgmap v1405: 17 pgs: 17 active+clean; 306 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 15 op/s 2020-11-16T22:14:17.596 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:17 smithi016 bash[10302]: cluster 2020-11-16T22:14:16.186304+0000 mon.a (mon.0) 1501 : cluster [DBG] osdmap e827: 12 total, 12 up, 12 in 2020-11-16T22:14:17.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:17 smithi195 bash[10218]: cluster 2020-11-16T22:14:15.830591+0000 mgr.x (mgr.24115) 649 : cluster [DBG] pgmap v1405: 17 pgs: 17 active+clean; 306 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.5 MiB/s wr, 15 op/s 2020-11-16T22:14:17.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:17 smithi195 bash[10218]: cluster 2020-11-16T22:14:16.186304+0000 mon.a (mon.0) 1501 : cluster [DBG] osdmap e827: 12 total, 12 up, 12 in 2020-11-16T22:14:18.199 INFO:tasks.rados.rados.2.smithi057.stdout:3299: done (2 left) 2020-11-16T22:14:18.199 INFO:tasks.rados.rados.2.smithi057.stdout:3300: done (1 left) 2020-11-16T22:14:18.199 INFO:tasks.rados.rados.2.smithi057.stdout:3301: done (0 left) 2020-11-16T22:14:18.200 INFO:tasks.rados.rados.2.smithi057.stdout:3302: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:18.200 INFO:tasks.rados.rados.2.smithi057.stdout:3302: expect (ObjNum 1104 snap 381 seq_num 1104) 2020-11-16T22:14:18.200 INFO:tasks.rados.rados.2.smithi057.stdout:3303: write oid 14 current snap is 385 2020-11-16T22:14:18.200 INFO:tasks.rados.rados.2.smithi057.stdout:3303: seq_num 1111 ranges {672577=589177,1913024=427715} 2020-11-16T22:14:18.212 INFO:tasks.rados.rados.2.smithi057.stdout:3303: writing smithi05720651-14 from 672577 to 1261754 tid 1 2020-11-16T22:14:18.220 INFO:tasks.rados.rados.2.smithi057.stdout:3303: writing smithi05720651-14 from 1913024 to 2340739 tid 2 2020-11-16T22:14:18.220 INFO:tasks.rados.rados.2.smithi057.stdout:3304: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:18.220 INFO:tasks.rados.rados.2.smithi057.stdout:3304: expect deleted 2020-11-16T22:14:18.220 INFO:tasks.rados.rados.2.smithi057.stdout:3305: snap_remove snap 351 2020-11-16T22:14:18.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:18 smithi057 bash[10301]: cluster 2020-11-16T22:14:17.189130+0000 mon.a (mon.0) 1502 : cluster [DBG] osdmap e828: 12 total, 12 up, 12 in 2020-11-16T22:14:18.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:18 smithi016 bash[10302]: cluster 2020-11-16T22:14:17.189130+0000 mon.a (mon.0) 1502 : cluster [DBG] osdmap e828: 12 total, 12 up, 12 in 2020-11-16T22:14:18.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:18 smithi195 bash[10218]: cluster 2020-11-16T22:14:17.189130+0000 mon.a (mon.0) 1502 : cluster [DBG] osdmap e828: 12 total, 12 up, 12 in 2020-11-16T22:14:19.202 INFO:tasks.rados.rados.2.smithi057.stdout:3305: done (3 left) 2020-11-16T22:14:19.202 INFO:tasks.rados.rados.2.smithi057.stdout:3306: write oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 385 2020-11-16T22:14:19.205 INFO:tasks.rados.rados.2.smithi057.stdout:3306: seq_num 1112 ranges {689384=664426,1971506=687726} 2020-11-16T22:14:19.213 INFO:tasks.rados.rados.2.smithi057.stdout:3306: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 689384 to 1353810 tid 1 2020-11-16T22:14:19.222 INFO:tasks.rados.rados.2.smithi057.stdout:3306: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1971506 to 2659232 tid 2 2020-11-16T22:14:19.222 INFO:tasks.rados.rados.2.smithi057.stdout:3307: rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 385 2020-11-16T22:14:19.222 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 366 2020-11-16T22:14:19.222 INFO:tasks.rados.rados.2.smithi057.stdout:3302: expect (ObjNum 1104 snap 381 seq_num 1104) 2020-11-16T22:14:19.302 INFO:tasks.rados.rados.2.smithi057.stdout:3303: finishing write tid 1 to smithi05720651-14 2020-11-16T22:14:19.302 INFO:tasks.rados.rados.2.smithi057.stdout:3303: finishing write tid 2 to smithi05720651-14 2020-11-16T22:14:19.302 INFO:tasks.rados.rados.2.smithi057.stdout:3303: finishing write tid 4 to smithi05720651-14 2020-11-16T22:14:19.302 INFO:tasks.rados.rados.2.smithi057.stdout:3303: finishing write tid 5 to smithi05720651-14 2020-11-16T22:14:19.302 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 2707 (ObjNum 1111 snap 385 seq_num 1111) dirty exists 2020-11-16T22:14:19.303 INFO:tasks.rados.rados.2.smithi057.stdout:3303: left oid 14 (ObjNum 1111 snap 385 seq_num 1111) 2020-11-16T22:14:19.303 INFO:tasks.rados.rados.2.smithi057.stdout:3306: finishing write tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:19.303 INFO:tasks.rados.rados.2.smithi057.stdout:3306: finishing write tid 2 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:19.303 INFO:tasks.rados.rados.2.smithi057.stdout:3302: done (4 left) 2020-11-16T22:14:19.303 INFO:tasks.rados.rados.2.smithi057.stdout:3303: done (3 left) 2020-11-16T22:14:19.303 INFO:tasks.rados.rados.2.smithi057.stdout:3304: done (2 left) 2020-11-16T22:14:19.303 INFO:tasks.rados.rados.2.smithi057.stdout:3308: write oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 385 2020-11-16T22:14:19.304 INFO:tasks.rados.rados.2.smithi057.stdout:3308: seq_num 1113 ranges {706191=739675,1913635=431384} 2020-11-16T22:14:19.319 INFO:tasks.rados.rados.2.smithi057.stdout:3308: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 706191 to 1445866 tid 1 2020-11-16T22:14:19.324 INFO:tasks.rados.rados.2.smithi057.stdout:3308: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1913635 to 2345019 tid 2 2020-11-16T22:14:19.324 INFO:tasks.rados.rados.2.smithi057.stdout:3309: snap_create 2020-11-16T22:14:19.324 INFO:tasks.rados.rados.2.smithi057.stdout:3306: finishing write tid 4 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:19.324 INFO:tasks.rados.rados.2.smithi057.stdout:3306: finishing write tid 5 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:19.324 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2393 (ObjNum 1112 snap 385 seq_num 1112) dirty exists 2020-11-16T22:14:19.325 INFO:tasks.rados.rados.2.smithi057.stdout:3306: left oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1112 snap 385 seq_num 1112) 2020-11-16T22:14:19.325 INFO:tasks.rados.rados.2.smithi057.stdout:3307: finishing rollback tid 0 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:19.325 INFO:tasks.rados.rados.2.smithi057.stdout:3307: finishing rollback tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:19.325 INFO:tasks.rados.rados.2.smithi057.stdout:3307: finishing rollback tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:19.325 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2348 (ObjNum 1036 snap 364 seq_num 1036) dirty exists 2020-11-16T22:14:19.330 INFO:tasks.rados.rados.2.smithi057.stdout:3308: finishing write tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:19.331 INFO:tasks.rados.rados.2.smithi057.stdout:3308: finishing write tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:19.331 INFO:tasks.rados.rados.2.smithi057.stdout:3308: finishing write tid 4 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:19.332 INFO:tasks.rados.rados.2.smithi057.stdout:3308: finishing write tid 5 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:19.332 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2220 (ObjNum 1113 snap 385 seq_num 1113) dirty exists 2020-11-16T22:14:19.332 INFO:tasks.rados.rados.2.smithi057.stdout:3308: left oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1113 snap 385 seq_num 1113) 2020-11-16T22:14:19.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:19 smithi016 bash[10302]: cluster 2020-11-16T22:14:17.831309+0000 mgr.x (mgr.24115) 650 : cluster [DBG] pgmap v1408: 17 pgs: 17 active+clean; 312 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.0 MiB/s wr, 25 op/s 2020-11-16T22:14:19.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:19 smithi016 bash[10302]: cluster 2020-11-16T22:14:18.208759+0000 mon.a (mon.0) 1503 : cluster [DBG] osdmap e829: 12 total, 12 up, 12 in 2020-11-16T22:14:19.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:19 smithi195 bash[10218]: cluster 2020-11-16T22:14:17.831309+0000 mgr.x (mgr.24115) 650 : cluster [DBG] pgmap v1408: 17 pgs: 17 active+clean; 312 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.0 MiB/s wr, 25 op/s 2020-11-16T22:14:19.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:19 smithi195 bash[10218]: cluster 2020-11-16T22:14:18.208759+0000 mon.a (mon.0) 1503 : cluster [DBG] osdmap e829: 12 total, 12 up, 12 in 2020-11-16T22:14:19.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:19 smithi057 bash[10301]: cluster 2020-11-16T22:14:17.831309+0000 mgr.x (mgr.24115) 650 : cluster [DBG] pgmap v1408: 17 pgs: 17 active+clean; 312 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.0 MiB/s wr, 25 op/s 2020-11-16T22:14:19.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:19 smithi057 bash[10301]: cluster 2020-11-16T22:14:18.208759+0000 mon.a (mon.0) 1503 : cluster [DBG] osdmap e829: 12 total, 12 up, 12 in 2020-11-16T22:14:20.168 INFO:tasks.rados.rados.2.smithi057.stdout:3306: done (3 left) 2020-11-16T22:14:20.168 INFO:tasks.rados.rados.2.smithi057.stdout:3307: done (2 left) 2020-11-16T22:14:20.169 INFO:tasks.rados.rados.2.smithi057.stdout:3308: done (1 left) 2020-11-16T22:14:20.169 INFO:tasks.rados.rados.2.smithi057.stdout:3309: done (0 left) 2020-11-16T22:14:20.169 INFO:tasks.rados.rados.2.smithi057.stdout:3310: snap_create 2020-11-16T22:14:20.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:20 smithi016 bash[10302]: cluster 2020-11-16T22:14:19.212588+0000 mon.a (mon.0) 1504 : cluster [DBG] osdmap e830: 12 total, 12 up, 12 in 2020-11-16T22:14:20.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:20 smithi016 bash[10302]: cluster 2020-11-16T22:14:20.177746+0000 mon.a (mon.0) 1505 : cluster [DBG] osdmap e831: 12 total, 12 up, 12 in 2020-11-16T22:14:20.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:20 smithi195 bash[10218]: cluster 2020-11-16T22:14:19.212588+0000 mon.a (mon.0) 1504 : cluster [DBG] osdmap e830: 12 total, 12 up, 12 in 2020-11-16T22:14:20.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:20 smithi195 bash[10218]: cluster 2020-11-16T22:14:20.177746+0000 mon.a (mon.0) 1505 : cluster [DBG] osdmap e831: 12 total, 12 up, 12 in 2020-11-16T22:14:20.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:20 smithi057 bash[10301]: cluster 2020-11-16T22:14:19.212588+0000 mon.a (mon.0) 1504 : cluster [DBG] osdmap e830: 12 total, 12 up, 12 in 2020-11-16T22:14:20.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:20 smithi057 bash[10301]: cluster 2020-11-16T22:14:20.177746+0000 mon.a (mon.0) 1505 : cluster [DBG] osdmap e831: 12 total, 12 up, 12 in 2020-11-16T22:14:21.181 INFO:tasks.rados.rados.2.smithi057.stdout:3310: done (0 left) 2020-11-16T22:14:21.181 INFO:tasks.rados.rados.2.smithi057.stdout:3311: write (excl) oid 28 current snap is 387 2020-11-16T22:14:21.181 INFO:tasks.rados.rados.2.smithi057.stdout:3311: seq_num 1114 ranges {722998=414924,1572117=575042} 2020-11-16T22:14:21.196 INFO:tasks.rados.rados.2.smithi057.stdout:3311: writing smithi05720651-28 from 722998 to 1137922 tid 1 2020-11-16T22:14:21.202 INFO:tasks.rados.rados.2.smithi057.stdout:3311: writing smithi05720651-28 from 1572117 to 2147159 tid 2 2020-11-16T22:14:21.202 INFO:tasks.rados.rados.2.smithi057.stdout:3312: read oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:21.202 INFO:tasks.rados.rados.2.smithi057.stdout:3312: expect (ObjNum 1019 snap 358 seq_num 1019) 2020-11-16T22:14:21.203 INFO:tasks.rados.rados.2.smithi057.stdout:3313: rollback oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 387 2020-11-16T22:14:21.203 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 361 2020-11-16T22:14:21.203 INFO:tasks.rados.rados.2.smithi057.stdout:3314: snap_remove snap 379 2020-11-16T22:14:21.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:21 smithi016 bash[10302]: cluster 2020-11-16T22:14:19.832020+0000 mgr.x (mgr.24115) 651 : cluster [DBG] pgmap v1411: 17 pgs: 17 active+clean; 312 MiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2020-11-16T22:14:21.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:21 smithi016 bash[10302]: cluster 2020-11-16T22:14:21.190939+0000 mon.a (mon.0) 1506 : cluster [DBG] osdmap e832: 12 total, 12 up, 12 in 2020-11-16T22:14:21.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:21 smithi195 bash[10218]: cluster 2020-11-16T22:14:19.832020+0000 mgr.x (mgr.24115) 651 : cluster [DBG] pgmap v1411: 17 pgs: 17 active+clean; 312 MiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2020-11-16T22:14:21.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:21 smithi195 bash[10218]: cluster 2020-11-16T22:14:21.190939+0000 mon.a (mon.0) 1506 : cluster [DBG] osdmap e832: 12 total, 12 up, 12 in 2020-11-16T22:14:21.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:21 smithi057 bash[10301]: cluster 2020-11-16T22:14:19.832020+0000 mgr.x (mgr.24115) 651 : cluster [DBG] pgmap v1411: 17 pgs: 17 active+clean; 312 MiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 10 op/s 2020-11-16T22:14:21.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:21 smithi057 bash[10301]: cluster 2020-11-16T22:14:21.190939+0000 mon.a (mon.0) 1506 : cluster [DBG] osdmap e832: 12 total, 12 up, 12 in 2020-11-16T22:14:22.183 INFO:tasks.rados.rados.2.smithi057.stdout:3314: done (3 left) 2020-11-16T22:14:22.184 INFO:tasks.rados.rados.2.smithi057.stdout:3315: read oid 36 snap -1 2020-11-16T22:14:22.184 INFO:tasks.rados.rados.2.smithi057.stdout:3315: expect deleted 2020-11-16T22:14:22.184 INFO:tasks.rados.rados.2.smithi057.stdout:3316: write oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 387 2020-11-16T22:14:22.184 INFO:tasks.rados.rados.2.smithi057.stdout:3316: seq_num 1115 ranges {739805=490173,1630599=435053,2636284=103521} 2020-11-16T22:14:22.196 INFO:tasks.rados.rados.2.smithi057.stdout:3316: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 739805 to 1229978 tid 1 2020-11-16T22:14:22.201 INFO:tasks.rados.rados.2.smithi057.stdout:3316: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1630599 to 2065652 tid 2 2020-11-16T22:14:22.205 INFO:tasks.rados.rados.2.smithi057.stdout:3316: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2636284 to 2739805 tid 3 2020-11-16T22:14:22.205 INFO:tasks.rados.rados.2.smithi057.stdout:3317: copy_from oid 30 from oid 12 current snap is 387 2020-11-16T22:14:22.206 INFO:tasks.rados.rados.2.smithi057.stdout:3311: finishing write tid 1 to smithi05720651-28 2020-11-16T22:14:22.206 INFO:tasks.rados.rados.2.smithi057.stdout:3313: finishing rollback tid 0 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:22.206 INFO:tasks.rados.rados.2.smithi057.stdout:3313: finishing rollback tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:22.206 INFO:tasks.rados.rados.2.smithi057.stdout:3313: finishing rollback tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:22.206 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2327 (ObjNum 1023 snap 359 seq_num 1023) dirty exists 2020-11-16T22:14:22.206 INFO:tasks.rados.rados.2.smithi057.stdout:3311: finishing write tid 2 to smithi05720651-28 2020-11-16T22:14:22.207 INFO:tasks.rados.rados.2.smithi057.stdout:3311: finishing write tid 4 to smithi05720651-28 2020-11-16T22:14:22.207 INFO:tasks.rados.rados.2.smithi057.stdout:3313: done (5 left) 2020-11-16T22:14:22.207 INFO:tasks.rados.rados.2.smithi057.stdout:3318: snap_remove snap 380 2020-11-16T22:14:23.187 INFO:tasks.rados.rados.2.smithi057.stdout:3318: done (5 left) 2020-11-16T22:14:23.188 INFO:tasks.rados.rados.2.smithi057.stdout:3319: read oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:23.188 INFO:tasks.rados.rados.2.smithi057.stdout:3319: expect (ObjNum 1059 snap 372 seq_num 1059) 2020-11-16T22:14:23.188 INFO:tasks.rados.rados.2.smithi057.stdout:3320: delete oid 44 current snap is 387 2020-11-16T22:14:23.188 INFO:tasks.rados.rados.2.smithi057.stdout:3311: finishing write tid 5 to smithi05720651-28 2020-11-16T22:14:23.188 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 2236 (ObjNum 1114 snap 387 seq_num 1114) dirty exists 2020-11-16T22:14:23.188 INFO:tasks.rados.rados.2.smithi057.stdout:3311: left oid 28 (ObjNum 1114 snap 387 seq_num 1114) 2020-11-16T22:14:23.188 INFO:tasks.rados.rados.2.smithi057.stdout:3312: expect (ObjNum 1019 snap 358 seq_num 1019) 2020-11-16T22:14:23.427 INFO:tasks.rados.rados.2.smithi057.stdout:3311: done (6 left) 2020-11-16T22:14:23.428 INFO:tasks.rados.rados.2.smithi057.stdout:3312: done (5 left) 2020-11-16T22:14:23.428 INFO:tasks.rados.rados.2.smithi057.stdout:3315: done (4 left) 2020-11-16T22:14:23.428 INFO:tasks.rados.rados.2.smithi057.stdout:3320: done (3 left) 2020-11-16T22:14:23.428 INFO:tasks.rados.rados.2.smithi057.stdout:3321: snap_create 2020-11-16T22:14:23.428 INFO:tasks.rados.rados.2.smithi057.stdout:3316: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:23.428 INFO:tasks.rados.rados.2.smithi057.stdout:3316: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:23.429 INFO:tasks.rados.rados.2.smithi057.stdout:3316: finishing write tid 3 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:23.429 INFO:tasks.rados.rados.2.smithi057.stdout:3316: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:23.429 INFO:tasks.rados.rados.2.smithi057.stdout:3316: finishing write tid 6 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:23.429 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2730 (ObjNum 1115 snap 387 seq_num 1115) dirty exists 2020-11-16T22:14:23.429 INFO:tasks.rados.rados.2.smithi057.stdout:3316: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1115 snap 387 seq_num 1115) 2020-11-16T22:14:23.429 INFO:tasks.rados.rados.2.smithi057.stdout:3317: finishing copy_from to smithi05720651-30 2020-11-16T22:14:23.430 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 2521 (ObjNum 1074 snap 377 seq_num 1074) dirty exists 2020-11-16T22:14:23.430 INFO:tasks.rados.rados.2.smithi057.stdout:3317: finishing copy_from racing read to smithi05720651-30 2020-11-16T22:14:23.430 INFO:tasks.rados.rados.2.smithi057.stdout:3319: expect (ObjNum 1059 snap 372 seq_num 1059) 2020-11-16T22:14:23.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:23 smithi016 bash[10302]: cluster 2020-11-16T22:14:21.832742+0000 mgr.x (mgr.24115) 652 : cluster [DBG] pgmap v1414: 17 pgs: 17 active+clean; 316 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.1 MiB/s wr, 6 op/s 2020-11-16T22:14:23.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:23 smithi016 bash[10302]: cluster 2020-11-16T22:14:22.193140+0000 mon.a (mon.0) 1507 : cluster [DBG] osdmap e833: 12 total, 12 up, 12 in 2020-11-16T22:14:23.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:23 smithi195 bash[10218]: cluster 2020-11-16T22:14:21.832742+0000 mgr.x (mgr.24115) 652 : cluster [DBG] pgmap v1414: 17 pgs: 17 active+clean; 316 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.1 MiB/s wr, 6 op/s 2020-11-16T22:14:23.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:23 smithi195 bash[10218]: cluster 2020-11-16T22:14:22.193140+0000 mon.a (mon.0) 1507 : cluster [DBG] osdmap e833: 12 total, 12 up, 12 in 2020-11-16T22:14:23.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:23 smithi057 bash[10301]: cluster 2020-11-16T22:14:21.832742+0000 mgr.x (mgr.24115) 652 : cluster [DBG] pgmap v1414: 17 pgs: 17 active+clean; 316 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.1 MiB/s wr, 6 op/s 2020-11-16T22:14:23.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:23 smithi057 bash[10301]: cluster 2020-11-16T22:14:22.193140+0000 mon.a (mon.0) 1507 : cluster [DBG] osdmap e833: 12 total, 12 up, 12 in 2020-11-16T22:14:24.214 INFO:tasks.rados.rados.2.smithi057.stdout:3316: done (3 left) 2020-11-16T22:14:24.214 INFO:tasks.rados.rados.2.smithi057.stdout:3317: done (2 left) 2020-11-16T22:14:24.214 INFO:tasks.rados.rados.2.smithi057.stdout:3319: done (1 left) 2020-11-16T22:14:24.214 INFO:tasks.rados.rados.2.smithi057.stdout:3321: done (0 left) 2020-11-16T22:14:24.214 INFO:tasks.rados.rados.2.smithi057.stdout:3322: read oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:24.215 INFO:tasks.rados.rados.2.smithi057.stdout:3322: expect (ObjNum 958 snap 329 seq_num 958) 2020-11-16T22:14:24.215 INFO:tasks.rados.rados.2.smithi057.stdout:3323: delete oid 50 current snap is 388 2020-11-16T22:14:24.225 INFO:tasks.rados.rados.2.smithi057.stdout:3322: expect (ObjNum 958 snap 329 seq_num 958) 2020-11-16T22:14:24.293 INFO:tasks.rados.rados.2.smithi057.stdout:3322: done (1 left) 2020-11-16T22:14:24.293 INFO:tasks.rados.rados.2.smithi057.stdout:3323: done (0 left) 2020-11-16T22:14:24.294 INFO:tasks.rados.rados.2.smithi057.stdout:3324: rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 388 2020-11-16T22:14:24.294 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 370 2020-11-16T22:14:24.294 INFO:tasks.rados.rados.2.smithi057.stdout:3325: rollback oid 4 current snap is 388 2020-11-16T22:14:24.294 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 4 to 382 2020-11-16T22:14:24.294 INFO:tasks.rados.rados.2.smithi057.stdout:3326: delete oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 388 2020-11-16T22:14:24.299 INFO:tasks.rados.rados.2.smithi057.stdout:3324: finishing rollback tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:24.299 INFO:tasks.rados.rados.2.smithi057.stdout:3326: done (2 left) 2020-11-16T22:14:24.299 INFO:tasks.rados.rados.2.smithi057.stdout:3327: snap_remove snap 361 2020-11-16T22:14:24.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:24 smithi016 bash[10302]: cluster 2020-11-16T22:14:23.195584+0000 mon.a (mon.0) 1508 : cluster [DBG] osdmap e834: 12 total, 12 up, 12 in 2020-11-16T22:14:24.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:24 smithi195 bash[10218]: cluster 2020-11-16T22:14:23.195584+0000 mon.a (mon.0) 1508 : cluster [DBG] osdmap e834: 12 total, 12 up, 12 in 2020-11-16T22:14:24.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:24 smithi057 bash[10301]: cluster 2020-11-16T22:14:23.195584+0000 mon.a (mon.0) 1508 : cluster [DBG] osdmap e834: 12 total, 12 up, 12 in 2020-11-16T22:14:25.170 INFO:tasks.rados.rados.2.smithi057.stdout:3327: done (2 left) 2020-11-16T22:14:25.171 INFO:tasks.rados.rados.2.smithi057.stdout:3328: read oid 28 snap -1 2020-11-16T22:14:25.171 INFO:tasks.rados.rados.2.smithi057.stdout:3328: expect (ObjNum 1114 snap 387 seq_num 1114) 2020-11-16T22:14:25.171 INFO:tasks.rados.rados.2.smithi057.stdout:3329: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:25.171 INFO:tasks.rados.rados.2.smithi057.stdout:3329: expect deleted 2020-11-16T22:14:25.171 INFO:tasks.rados.rados.2.smithi057.stdout:3330: snap_remove snap 357 2020-11-16T22:14:25.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:25 smithi016 bash[10302]: cluster 2020-11-16T22:14:23.833435+0000 mgr.x (mgr.24115) 653 : cluster [DBG] pgmap v1417: 17 pgs: 17 active+clean; 316 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2020-11-16T22:14:25.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:25 smithi016 bash[10302]: cluster 2020-11-16T22:14:24.222649+0000 mon.a (mon.0) 1509 : cluster [DBG] osdmap e835: 12 total, 12 up, 12 in 2020-11-16T22:14:25.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:25 smithi016 bash[10302]: cluster 2020-11-16T22:14:25.180278+0000 mon.a (mon.0) 1510 : cluster [DBG] osdmap e836: 12 total, 12 up, 12 in 2020-11-16T22:14:25.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:25 smithi195 bash[10218]: cluster 2020-11-16T22:14:23.833435+0000 mgr.x (mgr.24115) 653 : cluster [DBG] pgmap v1417: 17 pgs: 17 active+clean; 316 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2020-11-16T22:14:25.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:25 smithi195 bash[10218]: cluster 2020-11-16T22:14:24.222649+0000 mon.a (mon.0) 1509 : cluster [DBG] osdmap e835: 12 total, 12 up, 12 in 2020-11-16T22:14:25.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:25 smithi195 bash[10218]: cluster 2020-11-16T22:14:25.180278+0000 mon.a (mon.0) 1510 : cluster [DBG] osdmap e836: 12 total, 12 up, 12 in 2020-11-16T22:14:25.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:25 smithi057 bash[10301]: cluster 2020-11-16T22:14:23.833435+0000 mgr.x (mgr.24115) 653 : cluster [DBG] pgmap v1417: 17 pgs: 17 active+clean; 316 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2020-11-16T22:14:25.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:25 smithi057 bash[10301]: cluster 2020-11-16T22:14:24.222649+0000 mon.a (mon.0) 1509 : cluster [DBG] osdmap e835: 12 total, 12 up, 12 in 2020-11-16T22:14:25.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:25 smithi057 bash[10301]: cluster 2020-11-16T22:14:25.180278+0000 mon.a (mon.0) 1510 : cluster [DBG] osdmap e836: 12 total, 12 up, 12 in 2020-11-16T22:14:26.180 INFO:tasks.rados.rados.2.smithi057.stdout:3330: done (4 left) 2020-11-16T22:14:26.181 INFO:tasks.rados.rados.2.smithi057.stdout:3331: delete oid 50 current snap is 388 2020-11-16T22:14:26.181 INFO:tasks.rados.rados.2.smithi057.stdout:3324: finishing rollback tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:26.181 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2199 (ObjNum 926 snap 314 seq_num 926) dirty exists 2020-11-16T22:14:26.181 INFO:tasks.rados.rados.2.smithi057.stdout:3325: finishing rollback tid 0 to smithi05720651-4 2020-11-16T22:14:26.181 INFO:tasks.rados.rados.2.smithi057.stdout:3325: finishing rollback tid 1 to smithi05720651-4 2020-11-16T22:14:26.181 INFO:tasks.rados.rados.2.smithi057.stdout:3325: finishing rollback tid 2 to smithi05720651-4 2020-11-16T22:14:26.182 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 2203 (ObjNum 1083 snap 377 seq_num 1083) dirty exists 2020-11-16T22:14:26.182 INFO:tasks.rados.rados.2.smithi057.stdout:3328: expect (ObjNum 1114 snap 387 seq_num 1114) 2020-11-16T22:14:26.462 INFO:tasks.rados.rados.2.smithi057.stdout:3324: done (4 left) 2020-11-16T22:14:26.462 INFO:tasks.rados.rados.2.smithi057.stdout:3325: done (3 left) 2020-11-16T22:14:26.462 INFO:tasks.rados.rados.2.smithi057.stdout:3328: done (2 left) 2020-11-16T22:14:26.462 INFO:tasks.rados.rados.2.smithi057.stdout:3329: done (1 left) 2020-11-16T22:14:26.463 INFO:tasks.rados.rados.2.smithi057.stdout:3331: done (0 left) 2020-11-16T22:14:26.463 INFO:tasks.rados.rados.2.smithi057.stdout:3332: read oid 50 snap -1 2020-11-16T22:14:26.463 INFO:tasks.rados.rados.2.smithi057.stdout:3332: expect deleted 2020-11-16T22:14:26.463 INFO:tasks.rados.rados.2.smithi057.stdout:3333: write oid 24 current snap is 388 2020-11-16T22:14:26.463 INFO:tasks.rados.rados.2.smithi057.stdout:3333: seq_num 1120 ranges {423840=582771,1523009=586049,2657046=166794} 2020-11-16T22:14:26.474 INFO:tasks.rados.rados.2.smithi057.stdout:3333: writing smithi05720651-24 from 423840 to 1006611 tid 1 2020-11-16T22:14:26.482 INFO:tasks.rados.rados.2.smithi057.stdout:3333: writing smithi05720651-24 from 1523009 to 2109058 tid 2 2020-11-16T22:14:26.487 INFO:tasks.rados.rados.2.smithi057.stdout:3333: writing smithi05720651-24 from 2657046 to 2823840 tid 3 2020-11-16T22:14:26.487 INFO:tasks.rados.rados.2.smithi057.stdout:3334: delete oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 388 2020-11-16T22:14:26.487 INFO:tasks.rados.rados.2.smithi057.stdout:3333: finishing write tid 1 to smithi05720651-24 2020-11-16T22:14:26.492 INFO:tasks.rados.rados.2.smithi057.stdout:3333: finishing write tid 2 to smithi05720651-24 2020-11-16T22:14:26.493 INFO:tasks.rados.rados.2.smithi057.stdout:3333: finishing write tid 3 to smithi05720651-24 2020-11-16T22:14:26.493 INFO:tasks.rados.rados.2.smithi057.stdout:3332: done (2 left) 2020-11-16T22:14:26.494 INFO:tasks.rados.rados.2.smithi057.stdout:3334: done (1 left) 2020-11-16T22:14:26.494 INFO:tasks.rados.rados.2.smithi057.stdout:3335: read oid 20 snap 368 2020-11-16T22:14:26.494 INFO:tasks.rados.rados.2.smithi057.stdout:3335: expect (ObjNum 940 snap 324 seq_num 940) 2020-11-16T22:14:26.494 INFO:tasks.rados.rados.2.smithi057.stdout:3336: snap_create 2020-11-16T22:14:26.494 INFO:tasks.rados.rados.2.smithi057.stdout:3333: finishing write tid 5 to smithi05720651-24 2020-11-16T22:14:26.495 INFO:tasks.rados.rados.2.smithi057.stdout:3333: finishing write tid 6 to smithi05720651-24 2020-11-16T22:14:26.495 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 2200 (ObjNum 1120 snap 388 seq_num 1120) dirty exists 2020-11-16T22:14:26.495 INFO:tasks.rados.rados.2.smithi057.stdout:3333: left oid 24 (ObjNum 1120 snap 388 seq_num 1120) 2020-11-16T22:14:26.500 INFO:tasks.rados.rados.2.smithi057.stdout:3335: expect (ObjNum 940 snap 324 seq_num 940) 2020-11-16T22:14:27.218 INFO:tasks.rados.rados.2.smithi057.stdout:3333: done (2 left) 2020-11-16T22:14:27.219 INFO:tasks.rados.rados.2.smithi057.stdout:3335: done (1 left) 2020-11-16T22:14:27.219 INFO:tasks.rados.rados.2.smithi057.stdout:3336: done (0 left) 2020-11-16T22:14:27.219 INFO:tasks.rados.rados.2.smithi057.stdout:3337: copy_from oid 40 from oid 42 current snap is 389 2020-11-16T22:14:27.219 INFO:tasks.rados.rados.2.smithi057.stdout:3338: write oid 8 current snap is 389 2020-11-16T22:14:27.219 INFO:tasks.rados.rados.2.smithi057.stdout:3338: seq_num 1122 ranges {457454=733269,1923620=589718} 2020-11-16T22:14:27.235 INFO:tasks.rados.rados.2.smithi057.stdout:3338: writing smithi05720651-8 from 457454 to 1190723 tid 1 2020-11-16T22:14:27.243 INFO:tasks.rados.rados.2.smithi057.stdout:3338: writing smithi05720651-8 from 1923620 to 2513338 tid 2 2020-11-16T22:14:27.243 INFO:tasks.rados.rados.2.smithi057.stdout:3339: copy_from oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 389 2020-11-16T22:14:27.243 INFO:tasks.rados.rados.2.smithi057.stdout:3337: finishing copy_from to smithi05720651-40 2020-11-16T22:14:27.243 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 2207 (ObjNum 1108 snap 382 seq_num 1108) dirty exists 2020-11-16T22:14:27.244 INFO:tasks.rados.rados.2.smithi057.stdout:3337: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:14:27.244 INFO:tasks.rados.rados.2.smithi057.stdout:3337: done (2 left) 2020-11-16T22:14:27.244 INFO:tasks.rados.rados.2.smithi057.stdout:3340: read oid 14 snap -1 2020-11-16T22:14:27.244 INFO:tasks.rados.rados.2.smithi057.stdout:3340: expect (ObjNum 1111 snap 385 seq_num 1111) 2020-11-16T22:14:27.244 INFO:tasks.rados.rados.2.smithi057.stdout:3341: write oid 32 current snap is 389 2020-11-16T22:14:27.244 INFO:tasks.rados.rados.2.smithi057.stdout:3341: seq_num 1123 ranges {474261=408518,1582102=449729,2739315=134946} 2020-11-16T22:14:27.248 INFO:tasks.rados.rados.2.smithi057.stdout:3341: writing smithi05720651-32 from 474261 to 882779 tid 1 2020-11-16T22:14:27.257 INFO:tasks.rados.rados.2.smithi057.stdout:3341: writing smithi05720651-32 from 1582102 to 2031831 tid 2 2020-11-16T22:14:27.262 INFO:tasks.rados.rados.2.smithi057.stdout:3341: writing smithi05720651-32 from 2739315 to 2874261 tid 3 2020-11-16T22:14:27.262 INFO:tasks.rados.rados.2.smithi057.stdout:3342: snap_create 2020-11-16T22:14:27.262 INFO:tasks.rados.rados.2.smithi057.stdout:3338: finishing write tid 1 to smithi05720651-8 2020-11-16T22:14:27.262 INFO:tasks.rados.rados.2.smithi057.stdout:3338: finishing write tid 2 to smithi05720651-8 2020-11-16T22:14:27.262 INFO:tasks.rados.rados.2.smithi057.stdout:3338: finishing write tid 4 to smithi05720651-8 2020-11-16T22:14:27.263 INFO:tasks.rados.rados.2.smithi057.stdout:3338: finishing write tid 5 to smithi05720651-8 2020-11-16T22:14:27.263 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 2203 (ObjNum 1122 snap 389 seq_num 1122) dirty exists 2020-11-16T22:14:27.263 INFO:tasks.rados.rados.2.smithi057.stdout:3338: left oid 8 (ObjNum 1122 snap 389 seq_num 1122) 2020-11-16T22:14:27.263 INFO:tasks.rados.rados.2.smithi057.stdout:3340: expect (ObjNum 1111 snap 385 seq_num 1111) 2020-11-16T22:14:27.394 INFO:tasks.rados.rados.2.smithi057.stdout:3341: finishing write tid 1 to smithi05720651-32 2020-11-16T22:14:27.394 INFO:tasks.rados.rados.2.smithi057.stdout:3339: finishing copy_from to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:27.394 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2324 (ObjNum 1095 snap 380 seq_num 1095) dirty exists 2020-11-16T22:14:27.395 INFO:tasks.rados.rados.2.smithi057.stdout:3341: finishing write tid 2 to smithi05720651-32 2020-11-16T22:14:27.395 INFO:tasks.rados.rados.2.smithi057.stdout:3339: finishing copy_from racing read to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:27.395 INFO:tasks.rados.rados.2.smithi057.stdout:3341: finishing write tid 3 to smithi05720651-32 2020-11-16T22:14:27.395 INFO:tasks.rados.rados.2.smithi057.stdout:3341: finishing write tid 5 to smithi05720651-32 2020-11-16T22:14:27.395 INFO:tasks.rados.rados.2.smithi057.stdout:3341: finishing write tid 6 to smithi05720651-32 2020-11-16T22:14:27.395 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 2773 (ObjNum 1123 snap 389 seq_num 1123) dirty exists 2020-11-16T22:14:27.396 INFO:tasks.rados.rados.2.smithi057.stdout:3341: left oid 32 (ObjNum 1123 snap 389 seq_num 1123) 2020-11-16T22:14:27.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:27 smithi057 bash[10301]: cluster 2020-11-16T22:14:25.834140+0000 mgr.x (mgr.24115) 654 : cluster [DBG] pgmap v1420: 17 pgs: 17 active+clean; 319 MiB data, 948 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 742 KiB/s wr, 11 op/s 2020-11-16T22:14:27.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:27 smithi057 bash[10301]: cluster 2020-11-16T22:14:26.190344+0000 mon.a (mon.0) 1511 : cluster [DBG] osdmap e837: 12 total, 12 up, 12 in 2020-11-16T22:14:27.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:27 smithi016 bash[10302]: cluster 2020-11-16T22:14:25.834140+0000 mgr.x (mgr.24115) 654 : cluster [DBG] pgmap v1420: 17 pgs: 17 active+clean; 319 MiB data, 948 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 742 KiB/s wr, 11 op/s 2020-11-16T22:14:27.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:27 smithi016 bash[10302]: cluster 2020-11-16T22:14:26.190344+0000 mon.a (mon.0) 1511 : cluster [DBG] osdmap e837: 12 total, 12 up, 12 in 2020-11-16T22:14:27.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:27 smithi195 bash[10218]: cluster 2020-11-16T22:14:25.834140+0000 mgr.x (mgr.24115) 654 : cluster [DBG] pgmap v1420: 17 pgs: 17 active+clean; 319 MiB data, 948 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 742 KiB/s wr, 11 op/s 2020-11-16T22:14:27.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:27 smithi195 bash[10218]: cluster 2020-11-16T22:14:26.190344+0000 mon.a (mon.0) 1511 : cluster [DBG] osdmap e837: 12 total, 12 up, 12 in 2020-11-16T22:14:28.229 INFO:tasks.rados.rados.2.smithi057.stdout:3338: done (4 left) 2020-11-16T22:14:28.229 INFO:tasks.rados.rados.2.smithi057.stdout:3339: done (3 left) 2020-11-16T22:14:28.229 INFO:tasks.rados.rados.2.smithi057.stdout:3340: done (2 left) 2020-11-16T22:14:28.229 INFO:tasks.rados.rados.2.smithi057.stdout:3341: done (1 left) 2020-11-16T22:14:28.229 INFO:tasks.rados.rados.2.smithi057.stdout:3342: done (0 left) 2020-11-16T22:14:28.230 INFO:tasks.rados.rados.2.smithi057.stdout:3343: snap_create 2020-11-16T22:14:28.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:28 smithi016 bash[10302]: cluster 2020-11-16T22:14:27.228356+0000 mon.a (mon.0) 1512 : cluster [DBG] osdmap e838: 12 total, 12 up, 12 in 2020-11-16T22:14:28.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:28 smithi195 bash[10218]: cluster 2020-11-16T22:14:27.228356+0000 mon.a (mon.0) 1512 : cluster [DBG] osdmap e838: 12 total, 12 up, 12 in 2020-11-16T22:14:28.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:28 smithi057 bash[10301]: cluster 2020-11-16T22:14:27.228356+0000 mon.a (mon.0) 1512 : cluster [DBG] osdmap e838: 12 total, 12 up, 12 in 2020-11-16T22:14:29.230 INFO:tasks.rados.rados.2.smithi057.stdout:3343: done (0 left) 2020-11-16T22:14:29.231 INFO:tasks.rados.rados.2.smithi057.stdout:3344: read oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:29.231 INFO:tasks.rados.rados.2.smithi057.stdout:3344: expect (ObjNum 1014 snap 356 seq_num 1014) 2020-11-16T22:14:29.231 INFO:tasks.rados.rados.2.smithi057.stdout:3345: write (excl) oid 50 current snap is 391 2020-11-16T22:14:29.231 INFO:tasks.rados.rados.2.smithi057.stdout:3345: seq_num 1124 ranges {491068=483767,1640584=593387,2650385=240683} 2020-11-16T22:14:29.241 INFO:tasks.rados.rados.2.smithi057.stdout:3345: writing smithi05720651-50 from 491068 to 974835 tid 1 2020-11-16T22:14:29.249 INFO:tasks.rados.rados.2.smithi057.stdout:3345: writing smithi05720651-50 from 1640584 to 2233971 tid 2 2020-11-16T22:14:29.253 INFO:tasks.rados.rados.2.smithi057.stdout:3345: writing smithi05720651-50 from 2650385 to 2891068 tid 3 2020-11-16T22:14:29.253 INFO:tasks.rados.rados.2.smithi057.stdout:3346: delete oid 12 current snap is 391 2020-11-16T22:14:29.253 INFO:tasks.rados.rados.2.smithi057.stdout:3344: expect (ObjNum 1014 snap 356 seq_num 1014) 2020-11-16T22:14:29.401 INFO:tasks.rados.rados.2.smithi057.stdout:3345: finishing write tid 1 to smithi05720651-50 2020-11-16T22:14:29.402 INFO:tasks.rados.rados.2.smithi057.stdout:3345: finishing write tid 2 to smithi05720651-50 2020-11-16T22:14:29.402 INFO:tasks.rados.rados.2.smithi057.stdout:3345: finishing write tid 3 to smithi05720651-50 2020-11-16T22:14:29.402 INFO:tasks.rados.rados.2.smithi057.stdout:3345: finishing write tid 5 to smithi05720651-50 2020-11-16T22:14:29.402 INFO:tasks.rados.rados.2.smithi057.stdout:3345: finishing write tid 6 to smithi05720651-50 2020-11-16T22:14:29.402 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 2401 (ObjNum 1124 snap 391 seq_num 1124) dirty exists 2020-11-16T22:14:29.402 INFO:tasks.rados.rados.2.smithi057.stdout:3345: left oid 50 (ObjNum 1124 snap 391 seq_num 1124) 2020-11-16T22:14:29.403 INFO:tasks.rados.rados.2.smithi057.stdout:3344: done (2 left) 2020-11-16T22:14:29.403 INFO:tasks.rados.rados.2.smithi057.stdout:3345: done (1 left) 2020-11-16T22:14:29.403 INFO:tasks.rados.rados.2.smithi057.stdout:3346: done (0 left) 2020-11-16T22:14:29.403 INFO:tasks.rados.rados.2.smithi057.stdout:3347: snap_remove snap 384 2020-11-16T22:14:29.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:29 smithi016 bash[10302]: cluster 2020-11-16T22:14:27.834861+0000 mgr.x (mgr.24115) 655 : cluster [DBG] pgmap v1423: 17 pgs: 17 active+clean; 321 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 994 KiB/s wr, 14 op/s 2020-11-16T22:14:29.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:29 smithi016 bash[10302]: cluster 2020-11-16T22:14:28.237805+0000 mon.a (mon.0) 1513 : cluster [DBG] osdmap e839: 12 total, 12 up, 12 in 2020-11-16T22:14:29.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:29 smithi195 bash[10218]: cluster 2020-11-16T22:14:27.834861+0000 mgr.x (mgr.24115) 655 : cluster [DBG] pgmap v1423: 17 pgs: 17 active+clean; 321 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 994 KiB/s wr, 14 op/s 2020-11-16T22:14:29.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:29 smithi195 bash[10218]: cluster 2020-11-16T22:14:28.237805+0000 mon.a (mon.0) 1513 : cluster [DBG] osdmap e839: 12 total, 12 up, 12 in 2020-11-16T22:14:29.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:29 smithi057 bash[10301]: cluster 2020-11-16T22:14:27.834861+0000 mgr.x (mgr.24115) 655 : cluster [DBG] pgmap v1423: 17 pgs: 17 active+clean; 321 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 994 KiB/s wr, 14 op/s 2020-11-16T22:14:29.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:29 smithi057 bash[10301]: cluster 2020-11-16T22:14:28.237805+0000 mon.a (mon.0) 1513 : cluster [DBG] osdmap e839: 12 total, 12 up, 12 in 2020-11-16T22:14:30.172 INFO:tasks.rados.rados.2.smithi057.stdout:3347: done (0 left) 2020-11-16T22:14:30.173 INFO:tasks.rados.rados.2.smithi057.stdout:3348: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:30.173 INFO:tasks.rados.rados.2.smithi057.stdout:3348: expect (ObjNum 1095 snap 380 seq_num 1095) 2020-11-16T22:14:30.173 INFO:tasks.rados.rados.2.smithi057.stdout:3349: read oid 20 snap -1 2020-11-16T22:14:30.173 INFO:tasks.rados.rados.2.smithi057.stdout:3349: expect (ObjNum 1061 snap 373 seq_num 1061) 2020-11-16T22:14:30.173 INFO:tasks.rados.rados.2.smithi057.stdout:3350: snap_create 2020-11-16T22:14:30.184 INFO:tasks.rados.rados.2.smithi057.stdout:3348: expect (ObjNum 1095 snap 380 seq_num 1095) 2020-11-16T22:14:30.338 INFO:tasks.rados.rados.2.smithi057.stdout:3349: expect (ObjNum 1061 snap 373 seq_num 1061) 2020-11-16T22:14:30.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:30 smithi016 bash[10302]: cluster 2020-11-16T22:14:29.240407+0000 mon.a (mon.0) 1514 : cluster [DBG] osdmap e840: 12 total, 12 up, 12 in 2020-11-16T22:14:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:30 smithi016 bash[10302]: audit 2020-11-16T22:14:29.803845+0000 mon.b (mon.1) 316 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:14:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:30 smithi016 bash[10302]: audit 2020-11-16T22:14:29.804366+0000 mon.b (mon.1) 317 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:14:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:30 smithi016 bash[10302]: audit 2020-11-16T22:14:29.804802+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:14:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:30 smithi016 bash[10302]: audit 2020-11-16T22:14:29.805544+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:14:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:30 smithi016 bash[10302]: cluster 2020-11-16T22:14:30.181723+0000 mon.a (mon.0) 1517 : cluster [DBG] osdmap e841: 12 total, 12 up, 12 in 2020-11-16T22:14:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:30 smithi195 bash[10218]: cluster 2020-11-16T22:14:29.240407+0000 mon.a (mon.0) 1514 : cluster [DBG] osdmap e840: 12 total, 12 up, 12 in 2020-11-16T22:14:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:30 smithi195 bash[10218]: audit 2020-11-16T22:14:29.803845+0000 mon.b (mon.1) 316 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:14:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:30 smithi195 bash[10218]: audit 2020-11-16T22:14:29.804366+0000 mon.b (mon.1) 317 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:14:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:30 smithi195 bash[10218]: audit 2020-11-16T22:14:29.804802+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:14:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:30 smithi195 bash[10218]: audit 2020-11-16T22:14:29.805544+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:14:30.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:30 smithi195 bash[10218]: cluster 2020-11-16T22:14:30.181723+0000 mon.a (mon.0) 1517 : cluster [DBG] osdmap e841: 12 total, 12 up, 12 in 2020-11-16T22:14:30.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:30 smithi057 bash[10301]: cluster 2020-11-16T22:14:29.240407+0000 mon.a (mon.0) 1514 : cluster [DBG] osdmap e840: 12 total, 12 up, 12 in 2020-11-16T22:14:30.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:30 smithi057 bash[10301]: audit 2020-11-16T22:14:29.803845+0000 mon.b (mon.1) 316 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:14:30.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:30 smithi057 bash[10301]: audit 2020-11-16T22:14:29.804366+0000 mon.b (mon.1) 317 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:14:30.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:30 smithi057 bash[10301]: audit 2020-11-16T22:14:29.804802+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:14:30.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:30 smithi057 bash[10301]: audit 2020-11-16T22:14:29.805544+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:14:30.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:30 smithi057 bash[10301]: cluster 2020-11-16T22:14:30.181723+0000 mon.a (mon.0) 1517 : cluster [DBG] osdmap e841: 12 total, 12 up, 12 in 2020-11-16T22:14:31.190 INFO:tasks.rados.rados.2.smithi057.stdout:3348: done (2 left) 2020-11-16T22:14:31.190 INFO:tasks.rados.rados.2.smithi057.stdout:3349: done (1 left) 2020-11-16T22:14:31.190 INFO:tasks.rados.rados.2.smithi057.stdout:3350: done (0 left) 2020-11-16T22:14:31.190 INFO:tasks.rados.rados.2.smithi057.stdout:3351: snap_remove snap 367 2020-11-16T22:14:31.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:31 smithi016 bash[10302]: cluster 2020-11-16T22:14:29.835561+0000 mgr.x (mgr.24115) 656 : cluster [DBG] pgmap v1426: 17 pgs: 17 active+clean; 320 MiB data, 932 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 251 KiB/s wr, 7 op/s 2020-11-16T22:14:31.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:31 smithi016 bash[10302]: cluster 2020-11-16T22:14:31.199493+0000 mon.a (mon.0) 1518 : cluster [DBG] osdmap e842: 12 total, 12 up, 12 in 2020-11-16T22:14:31.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:31 smithi195 bash[10218]: cluster 2020-11-16T22:14:29.835561+0000 mgr.x (mgr.24115) 656 : cluster [DBG] pgmap v1426: 17 pgs: 17 active+clean; 320 MiB data, 932 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 251 KiB/s wr, 7 op/s 2020-11-16T22:14:31.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:31 smithi195 bash[10218]: cluster 2020-11-16T22:14:31.199493+0000 mon.a (mon.0) 1518 : cluster [DBG] osdmap e842: 12 total, 12 up, 12 in 2020-11-16T22:14:31.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:31 smithi057 bash[10301]: cluster 2020-11-16T22:14:29.835561+0000 mgr.x (mgr.24115) 656 : cluster [DBG] pgmap v1426: 17 pgs: 17 active+clean; 320 MiB data, 932 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 251 KiB/s wr, 7 op/s 2020-11-16T22:14:31.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:31 smithi057 bash[10301]: cluster 2020-11-16T22:14:31.199493+0000 mon.a (mon.0) 1518 : cluster [DBG] osdmap e842: 12 total, 12 up, 12 in 2020-11-16T22:14:32.194 INFO:tasks.rados.rados.2.smithi057.stdout:3351: done (0 left) 2020-11-16T22:14:32.194 INFO:tasks.rados.rados.2.smithi057.stdout:3352: copy_from oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 14 current snap is 392 2020-11-16T22:14:32.195 INFO:tasks.rados.rados.2.smithi057.stdout:3353: copy_from oid 32 from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 392 2020-11-16T22:14:32.195 INFO:tasks.rados.rados.2.smithi057.stdout:3354: delete oid 48 current snap is 392 2020-11-16T22:14:32.206 INFO:tasks.rados.rados.2.smithi057.stdout:3354: done (2 left) 2020-11-16T22:14:32.206 INFO:tasks.rados.rados.2.smithi057.stdout:3355: read oid 18 snap -1 2020-11-16T22:14:32.206 INFO:tasks.rados.rados.2.smithi057.stdout:3355: expect (ObjNum 1055 snap 371 seq_num 1055) 2020-11-16T22:14:32.206 INFO:tasks.rados.rados.2.smithi057.stdout:3356: snap_create 2020-11-16T22:14:32.227 INFO:tasks.rados.rados.2.smithi057.stdout:3355: expect (ObjNum 1055 snap 371 seq_num 1055) 2020-11-16T22:14:32.339 INFO:tasks.rados.rados.2.smithi057.stdout:3353: finishing copy_from to smithi05720651-32 2020-11-16T22:14:32.339 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 2558 (ObjNum 949 snap 328 seq_num 949) dirty exists 2020-11-16T22:14:32.339 INFO:tasks.rados.rados.2.smithi057.stdout:3353: finishing copy_from racing read to smithi05720651-32 2020-11-16T22:14:32.339 INFO:tasks.rados.rados.2.smithi057.stdout:3352: finishing copy_from to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:32.340 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2707 (ObjNum 1111 snap 385 seq_num 1111) dirty exists 2020-11-16T22:14:32.340 INFO:tasks.rados.rados.2.smithi057.stdout:3352: finishing copy_from racing read to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:33.195 INFO:tasks.rados.rados.2.smithi057.stdout:3352: done (3 left) 2020-11-16T22:14:33.196 INFO:tasks.rados.rados.2.smithi057.stdout:3353: done (2 left) 2020-11-16T22:14:33.196 INFO:tasks.rados.rados.2.smithi057.stdout:3355: done (1 left) 2020-11-16T22:14:33.196 INFO:tasks.rados.rados.2.smithi057.stdout:3356: done (0 left) 2020-11-16T22:14:33.196 INFO:tasks.rados.rados.2.smithi057.stdout:3357: delete oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 393 2020-11-16T22:14:33.201 INFO:tasks.rados.rados.2.smithi057.stdout:3357: done (0 left) 2020-11-16T22:14:33.202 INFO:tasks.rados.rados.2.smithi057.stdout:3358: delete oid 14 current snap is 393 2020-11-16T22:14:33.210 INFO:tasks.rados.rados.2.smithi057.stdout:3358: done (0 left) 2020-11-16T22:14:33.210 INFO:tasks.rados.rados.2.smithi057.stdout:3359: snap_remove snap 390 2020-11-16T22:14:33.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:33 smithi016 bash[10302]: cluster 2020-11-16T22:14:31.836288+0000 mgr.x (mgr.24115) 657 : cluster [DBG] pgmap v1429: 17 pgs: 17 active+clean; 325 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2020-11-16T22:14:33.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:33 smithi016 bash[10302]: cluster 2020-11-16T22:14:32.202343+0000 mon.a (mon.0) 1519 : cluster [DBG] osdmap e843: 12 total, 12 up, 12 in 2020-11-16T22:14:33.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:33 smithi195 bash[10218]: cluster 2020-11-16T22:14:31.836288+0000 mgr.x (mgr.24115) 657 : cluster [DBG] pgmap v1429: 17 pgs: 17 active+clean; 325 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2020-11-16T22:14:33.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:33 smithi195 bash[10218]: cluster 2020-11-16T22:14:32.202343+0000 mon.a (mon.0) 1519 : cluster [DBG] osdmap e843: 12 total, 12 up, 12 in 2020-11-16T22:14:33.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:33 smithi057 bash[10301]: cluster 2020-11-16T22:14:31.836288+0000 mgr.x (mgr.24115) 657 : cluster [DBG] pgmap v1429: 17 pgs: 17 active+clean; 325 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2020-11-16T22:14:33.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:33 smithi057 bash[10301]: cluster 2020-11-16T22:14:32.202343+0000 mon.a (mon.0) 1519 : cluster [DBG] osdmap e843: 12 total, 12 up, 12 in 2020-11-16T22:14:34.214 INFO:tasks.rados.rados.2.smithi057.stdout:3359: done (0 left) 2020-11-16T22:14:34.214 INFO:tasks.rados.rados.2.smithi057.stdout:3360: read oid 30 snap 385 2020-11-16T22:14:34.214 INFO:tasks.rados.rados.2.smithi057.stdout:3360: expect (ObjNum 1103 snap 381 seq_num 1103) 2020-11-16T22:14:34.215 INFO:tasks.rados.rados.2.smithi057.stdout:3361: write oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 393 2020-11-16T22:14:34.215 INFO:tasks.rados.rados.2.smithi057.stdout:3361: seq_num 1129 ranges {575103=576365,1932994=744383} 2020-11-16T22:14:34.225 INFO:tasks.rados.rados.2.smithi057.stdout:3361: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 575103 to 1151468 tid 1 2020-11-16T22:14:34.234 INFO:tasks.rados.rados.2.smithi057.stdout:3361: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1932994 to 2677377 tid 2 2020-11-16T22:14:34.235 INFO:tasks.rados.rados.2.smithi057.stdout:3362: rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 393 2020-11-16T22:14:34.235 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 388 2020-11-16T22:14:34.235 INFO:tasks.rados.rados.2.smithi057.stdout:3360: expect (ObjNum 1103 snap 381 seq_num 1103) 2020-11-16T22:14:34.455 INFO:tasks.rados.rados.2.smithi057.stdout:3361: finishing write tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:34.455 INFO:tasks.rados.rados.2.smithi057.stdout:3361: finishing write tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:34.455 INFO:tasks.rados.rados.2.smithi057.stdout:3361: finishing write tid 4 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:34.456 INFO:tasks.rados.rados.2.smithi057.stdout:3361: finishing write tid 5 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:34.456 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2223 (ObjNum 1129 snap 393 seq_num 1129) dirty exists 2020-11-16T22:14:34.456 INFO:tasks.rados.rados.2.smithi057.stdout:3361: left oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1129 snap 393 seq_num 1129) 2020-11-16T22:14:34.456 INFO:tasks.rados.rados.2.smithi057.stdout:3362: finishing rollback tid 0 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:34.456 INFO:tasks.rados.rados.2.smithi057.stdout:3362: finishing rollback tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:34.456 INFO:tasks.rados.rados.2.smithi057.stdout:3362: finishing rollback tid 2 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:34.457 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2396 (ObjNum 1112 snap 385 seq_num 1112) dirty exists 2020-11-16T22:14:34.457 INFO:tasks.rados.rados.2.smithi057.stdout:3360: done (2 left) 2020-11-16T22:14:34.457 INFO:tasks.rados.rados.2.smithi057.stdout:3361: done (1 left) 2020-11-16T22:14:34.457 INFO:tasks.rados.rados.2.smithi057.stdout:3362: done (0 left) 2020-11-16T22:14:34.457 INFO:tasks.rados.rados.2.smithi057.stdout:3363: delete oid 32 current snap is 393 2020-11-16T22:14:34.461 INFO:tasks.rados.rados.2.smithi057.stdout:3363: done (0 left) 2020-11-16T22:14:34.462 INFO:tasks.rados.rados.2.smithi057.stdout:3364: delete oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 393 2020-11-16T22:14:34.467 INFO:tasks.rados.rados.2.smithi057.stdout:3364: done (0 left) 2020-11-16T22:14:34.468 INFO:tasks.rados.rados.2.smithi057.stdout:3365: read oid 4 snap -1 2020-11-16T22:14:34.468 INFO:tasks.rados.rados.2.smithi057.stdout:3365: expect (ObjNum 1083 snap 377 seq_num 1083) 2020-11-16T22:14:34.468 INFO:tasks.rados.rados.2.smithi057.stdout:3366: snap_remove snap 391 2020-11-16T22:14:34.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:34 smithi016 bash[10302]: cluster 2020-11-16T22:14:33.204981+0000 mon.a (mon.0) 1520 : cluster [DBG] osdmap e844: 12 total, 12 up, 12 in 2020-11-16T22:14:34.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:34 smithi195 bash[10218]: cluster 2020-11-16T22:14:33.204981+0000 mon.a (mon.0) 1520 : cluster [DBG] osdmap e844: 12 total, 12 up, 12 in 2020-11-16T22:14:34.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:34 smithi057 bash[10301]: cluster 2020-11-16T22:14:33.204981+0000 mon.a (mon.0) 1520 : cluster [DBG] osdmap e844: 12 total, 12 up, 12 in 2020-11-16T22:14:35.173 INFO:tasks.rados.rados.2.smithi057.stdout:3366: done (1 left) 2020-11-16T22:14:35.174 INFO:tasks.rados.rados.2.smithi057.stdout:3367: write oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 393 2020-11-16T22:14:35.174 INFO:tasks.rados.rados.2.smithi057.stdout:3367: seq_num 1132 ranges {625524=402112,1592087=608063,2869769=155755} 2020-11-16T22:14:35.182 INFO:tasks.rados.rados.2.smithi057.stdout:3367: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 625524 to 1027636 tid 1 2020-11-16T22:14:35.191 INFO:tasks.rados.rados.2.smithi057.stdout:3367: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1592087 to 2200150 tid 2 2020-11-16T22:14:35.196 INFO:tasks.rados.rados.2.smithi057.stdout:3367: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2869769 to 3025524 tid 3 2020-11-16T22:14:35.196 INFO:tasks.rados.rados.2.smithi057.stdout:3368: read oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 377 2020-11-16T22:14:35.197 INFO:tasks.rados.rados.2.smithi057.stdout:3368: expect (ObjNum 1023 snap 359 seq_num 1023) 2020-11-16T22:14:35.197 INFO:tasks.rados.rados.2.smithi057.stdout:3369: write (excl) oid 12 current snap is 393 2020-11-16T22:14:35.197 INFO:tasks.rados.rados.2.smithi057.stdout:3369: seq_num 1133 ranges {642331=593714,1766922=751721} 2020-11-16T22:14:35.204 INFO:tasks.rados.rados.2.smithi057.stdout:3369: writing smithi05720651-12 from 642331 to 1236045 tid 1 2020-11-16T22:14:35.211 INFO:tasks.rados.rados.2.smithi057.stdout:3369: writing smithi05720651-12 from 1766922 to 2518643 tid 2 2020-11-16T22:14:35.212 INFO:tasks.rados.rados.2.smithi057.stdout:3370: rollback oid 6 current snap is 393 2020-11-16T22:14:35.212 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 6 to 382 2020-11-16T22:14:35.212 INFO:tasks.rados.rados.2.smithi057.stdout:3365: expect (ObjNum 1083 snap 377 seq_num 1083) 2020-11-16T22:14:35.286 INFO:tasks.rados.rados.2.smithi057.stdout:3367: finishing write tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:35.286 INFO:tasks.rados.rados.2.smithi057.stdout:3367: finishing write tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:35.287 INFO:tasks.rados.rados.2.smithi057.stdout:3367: finishing write tid 3 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:35.287 INFO:tasks.rados.rados.2.smithi057.stdout:3367: finishing write tid 5 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:35.287 INFO:tasks.rados.rados.2.smithi057.stdout:3367: finishing write tid 6 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:35.287 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2562 (ObjNum 1132 snap 393 seq_num 1132) dirty exists 2020-11-16T22:14:35.287 INFO:tasks.rados.rados.2.smithi057.stdout:3367: left oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1132 snap 393 seq_num 1132) 2020-11-16T22:14:35.287 INFO:tasks.rados.rados.2.smithi057.stdout:3368: expect (ObjNum 1023 snap 359 seq_num 1023) 2020-11-16T22:14:35.424 INFO:tasks.rados.rados.2.smithi057.stdout:3369: finishing write tid 1 to smithi05720651-12 2020-11-16T22:14:35.424 INFO:tasks.rados.rados.2.smithi057.stdout:3369: finishing write tid 2 to smithi05720651-12 2020-11-16T22:14:35.425 INFO:tasks.rados.rados.2.smithi057.stdout:3369: finishing write tid 4 to smithi05720651-12 2020-11-16T22:14:35.425 INFO:tasks.rados.rados.2.smithi057.stdout:3369: finishing write tid 5 to smithi05720651-12 2020-11-16T22:14:35.425 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 2526 (ObjNum 1133 snap 393 seq_num 1133) dirty exists 2020-11-16T22:14:35.425 INFO:tasks.rados.rados.2.smithi057.stdout:3369: left oid 12 (ObjNum 1133 snap 393 seq_num 1133) 2020-11-16T22:14:35.425 INFO:tasks.rados.rados.2.smithi057.stdout:3370: finishing rollback tid 0 to smithi05720651-6 2020-11-16T22:14:35.425 INFO:tasks.rados.rados.2.smithi057.stdout:3370: finishing rollback tid 1 to smithi05720651-6 2020-11-16T22:14:35.426 INFO:tasks.rados.rados.2.smithi057.stdout:3370: finishing rollback tid 2 to smithi05720651-6 2020-11-16T22:14:35.426 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 2419 (ObjNum 1100 snap 381 seq_num 1100) dirty exists 2020-11-16T22:14:35.426 INFO:tasks.rados.rados.2.smithi057.stdout:3365: done (4 left) 2020-11-16T22:14:35.426 INFO:tasks.rados.rados.2.smithi057.stdout:3367: done (3 left) 2020-11-16T22:14:35.426 INFO:tasks.rados.rados.2.smithi057.stdout:3368: done (2 left) 2020-11-16T22:14:35.426 INFO:tasks.rados.rados.2.smithi057.stdout:3369: done (1 left) 2020-11-16T22:14:35.426 INFO:tasks.rados.rados.2.smithi057.stdout:3370: done (0 left) 2020-11-16T22:14:35.427 INFO:tasks.rados.rados.2.smithi057.stdout:3371: copy_from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 14 current snap is 393 2020-11-16T22:14:35.427 INFO:tasks.rados.rados.2.smithi057.stdout:3372: delete oid 4 current snap is 393 2020-11-16T22:14:35.427 INFO:tasks.rados.rados.2.smithi057.stdout:3371: finishing copy_from to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:35.427 INFO:tasks.rados.rados.2.smithi057.stdout:3371: got expected ENOENT (src dne) 2020-11-16T22:14:35.428 INFO:tasks.rados.rados.2.smithi057.stdout:3371: finishing copy_from racing read to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:35.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:35 smithi016 bash[10302]: cluster 2020-11-16T22:14:33.836845+0000 mgr.x (mgr.24115) 658 : cluster [DBG] pgmap v1432: 17 pgs: 17 active+clean; 325 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2020-11-16T22:14:35.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:35 smithi016 bash[10302]: cluster 2020-11-16T22:14:34.223875+0000 mon.a (mon.0) 1521 : cluster [DBG] osdmap e845: 12 total, 12 up, 12 in 2020-11-16T22:14:35.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:35 smithi016 bash[10302]: cluster 2020-11-16T22:14:35.183316+0000 mon.a (mon.0) 1522 : cluster [DBG] osdmap e846: 12 total, 12 up, 12 in 2020-11-16T22:14:35.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:35 smithi195 bash[10218]: cluster 2020-11-16T22:14:33.836845+0000 mgr.x (mgr.24115) 658 : cluster [DBG] pgmap v1432: 17 pgs: 17 active+clean; 325 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2020-11-16T22:14:35.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:35 smithi195 bash[10218]: cluster 2020-11-16T22:14:34.223875+0000 mon.a (mon.0) 1521 : cluster [DBG] osdmap e845: 12 total, 12 up, 12 in 2020-11-16T22:14:35.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:35 smithi195 bash[10218]: cluster 2020-11-16T22:14:35.183316+0000 mon.a (mon.0) 1522 : cluster [DBG] osdmap e846: 12 total, 12 up, 12 in 2020-11-16T22:14:35.660 INFO:tasks.rados.rados.2.smithi057.stdout:3371: done (1 left) 2020-11-16T22:14:35.660 INFO:tasks.rados.rados.2.smithi057.stdout:3372: done (0 left) 2020-11-16T22:14:35.660 INFO:tasks.rados.rados.2.smithi057.stdout:3373: delete oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 393 2020-11-16T22:14:35.665 INFO:tasks.rados.rados.2.smithi057.stdout:3373: done (0 left) 2020-11-16T22:14:35.666 INFO:tasks.rados.rados.2.smithi057.stdout:3374: copy_from oid 10 from oid 32 current snap is 393 2020-11-16T22:14:35.666 INFO:tasks.rados.rados.2.smithi057.stdout:3375: snap_create 2020-11-16T22:14:35.669 INFO:tasks.rados.rados.2.smithi057.stdout:3374: finishing copy_from to smithi05720651-10 2020-11-16T22:14:35.669 INFO:tasks.rados.rados.2.smithi057.stdout:3374: got expected ENOENT (src dne) 2020-11-16T22:14:35.669 INFO:tasks.rados.rados.2.smithi057.stdout:3374: finishing copy_from racing read to smithi05720651-10 2020-11-16T22:14:35.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:35 smithi057 bash[10301]: cluster 2020-11-16T22:14:33.836845+0000 mgr.x (mgr.24115) 658 : cluster [DBG] pgmap v1432: 17 pgs: 17 active+clean; 325 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 2.4 MiB/s wr, 13 op/s 2020-11-16T22:14:35.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:35 smithi057 bash[10301]: cluster 2020-11-16T22:14:34.223875+0000 mon.a (mon.0) 1521 : cluster [DBG] osdmap e845: 12 total, 12 up, 12 in 2020-11-16T22:14:35.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:35 smithi057 bash[10301]: cluster 2020-11-16T22:14:35.183316+0000 mon.a (mon.0) 1522 : cluster [DBG] osdmap e846: 12 total, 12 up, 12 in 2020-11-16T22:14:36.229 INFO:tasks.rados.rados.2.smithi057.stdout:3374: done (1 left) 2020-11-16T22:14:36.229 INFO:tasks.rados.rados.2.smithi057.stdout:3375: done (0 left) 2020-11-16T22:14:36.229 INFO:tasks.rados.rados.2.smithi057.stdout:3376: read oid 50 snap -1 2020-11-16T22:14:36.229 INFO:tasks.rados.rados.2.smithi057.stdout:3376: expect (ObjNum 1124 snap 391 seq_num 1124) 2020-11-16T22:14:36.229 INFO:tasks.rados.rados.2.smithi057.stdout:3377: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:36.230 INFO:tasks.rados.rados.2.smithi057.stdout:3377: expect (ObjNum 1112 snap 385 seq_num 1112) 2020-11-16T22:14:36.230 INFO:tasks.rados.rados.2.smithi057.stdout:3378: write (excl) oid 40 current snap is 394 2020-11-16T22:14:36.230 INFO:tasks.rados.rados.2.smithi057.stdout:3378: seq_num 1136 ranges {692752=419461,1826015=615401,2979461=113291} 2020-11-16T22:14:36.242 INFO:tasks.rados.rados.2.smithi057.stdout:3378: writing smithi05720651-40 from 692752 to 1112213 tid 1 2020-11-16T22:14:36.249 INFO:tasks.rados.rados.2.smithi057.stdout:3378: writing smithi05720651-40 from 1826015 to 2441416 tid 2 2020-11-16T22:14:36.253 INFO:tasks.rados.rados.2.smithi057.stdout:3378: writing smithi05720651-40 from 2979461 to 3092752 tid 3 2020-11-16T22:14:36.253 INFO:tasks.rados.rados.2.smithi057.stdout:3379: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:36.254 INFO:tasks.rados.rados.2.smithi057.stdout:3379: expect (ObjNum 1085 snap 377 seq_num 1085) 2020-11-16T22:14:36.254 INFO:tasks.rados.rados.2.smithi057.stdout:3380: snap_remove snap 392 2020-11-16T22:14:37.240 INFO:tasks.rados.rados.2.smithi057.stdout:3380: done (4 left) 2020-11-16T22:14:37.241 INFO:tasks.rados.rados.2.smithi057.stdout:3381: rollback oid 2 current snap is 394 2020-11-16T22:14:37.241 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 2 to 387 2020-11-16T22:14:37.241 INFO:tasks.rados.rados.2.smithi057.stdout:3376: expect (ObjNum 1124 snap 391 seq_num 1124) 2020-11-16T22:14:37.339 INFO:tasks.rados.rados.2.smithi057.stdout:3377: expect (ObjNum 1112 snap 385 seq_num 1112) 2020-11-16T22:14:37.468 INFO:tasks.rados.rados.2.smithi057.stdout:3378: finishing write tid 1 to smithi05720651-40 2020-11-16T22:14:37.469 INFO:tasks.rados.rados.2.smithi057.stdout:3378: finishing write tid 2 to smithi05720651-40 2020-11-16T22:14:37.469 INFO:tasks.rados.rados.2.smithi057.stdout:3378: finishing write tid 3 to smithi05720651-40 2020-11-16T22:14:37.469 INFO:tasks.rados.rados.2.smithi057.stdout:3379: expect (ObjNum 1085 snap 377 seq_num 1085) 2020-11-16T22:14:37.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:37 smithi016 bash[10302]: cluster 2020-11-16T22:14:35.837685+0000 mgr.x (mgr.24115) 659 : cluster [DBG] pgmap v1435: 17 pgs: 17 active+clean; 327 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 607 KiB/s wr, 10 op/s 2020-11-16T22:14:37.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:37 smithi016 bash[10302]: cluster 2020-11-16T22:14:36.238787+0000 mon.a (mon.0) 1523 : cluster [DBG] osdmap e847: 12 total, 12 up, 12 in 2020-11-16T22:14:37.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:37 smithi195 bash[10218]: cluster 2020-11-16T22:14:35.837685+0000 mgr.x (mgr.24115) 659 : cluster [DBG] pgmap v1435: 17 pgs: 17 active+clean; 327 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 607 KiB/s wr, 10 op/s 2020-11-16T22:14:37.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:37 smithi195 bash[10218]: cluster 2020-11-16T22:14:36.238787+0000 mon.a (mon.0) 1523 : cluster [DBG] osdmap e847: 12 total, 12 up, 12 in 2020-11-16T22:14:37.615 INFO:tasks.rados.rados.2.smithi057.stdout:3378: finishing write tid 5 to smithi05720651-40 2020-11-16T22:14:37.616 INFO:tasks.rados.rados.2.smithi057.stdout:3378: finishing write tid 6 to smithi05720651-40 2020-11-16T22:14:37.616 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 2810 (ObjNum 1136 snap 394 seq_num 1136) dirty exists 2020-11-16T22:14:37.616 INFO:tasks.rados.rados.2.smithi057.stdout:3378: left oid 40 (ObjNum 1136 snap 394 seq_num 1136) 2020-11-16T22:14:37.616 INFO:tasks.rados.rados.2.smithi057.stdout:3381: finishing rollback tid 0 to smithi05720651-2 2020-11-16T22:14:37.616 INFO:tasks.rados.rados.2.smithi057.stdout:3381: finishing rollback tid 1 to smithi05720651-2 2020-11-16T22:14:37.616 INFO:tasks.rados.rados.2.smithi057.stdout:3381: finishing rollback tid 2 to smithi05720651-2 2020-11-16T22:14:37.616 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 2814 (ObjNum 1052 snap 370 seq_num 1052) dirty exists 2020-11-16T22:14:37.617 INFO:tasks.rados.rados.2.smithi057.stdout:3376: done (4 left) 2020-11-16T22:14:37.617 INFO:tasks.rados.rados.2.smithi057.stdout:3377: done (3 left) 2020-11-16T22:14:37.617 INFO:tasks.rados.rados.2.smithi057.stdout:3378: done (2 left) 2020-11-16T22:14:37.617 INFO:tasks.rados.rados.2.smithi057.stdout:3379: done (1 left) 2020-11-16T22:14:37.617 INFO:tasks.rados.rados.2.smithi057.stdout:3381: done (0 left) 2020-11-16T22:14:37.617 INFO:tasks.rados.rados.2.smithi057.stdout:3382: copy_from oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 34 current snap is 394 2020-11-16T22:14:37.617 INFO:tasks.rados.rados.2.smithi057.stdout:3383: copy_from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 394 2020-11-16T22:14:37.618 INFO:tasks.rados.rados.2.smithi057.stdout:3384: copy_from oid 28 from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 394 2020-11-16T22:14:37.618 INFO:tasks.rados.rados.2.smithi057.stdout:3385: read oid 42 snap -1 2020-11-16T22:14:37.618 INFO:tasks.rados.rados.2.smithi057.stdout:3385: expect (ObjNum 1108 snap 382 seq_num 1108) 2020-11-16T22:14:37.618 INFO:tasks.rados.rados.2.smithi057.stdout:3386: read oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:37.618 INFO:tasks.rados.rados.2.smithi057.stdout:3386: expect deleted 2020-11-16T22:14:37.618 INFO:tasks.rados.rados.2.smithi057.stdout:3387: read oid 48 snap -1 2020-11-16T22:14:37.618 INFO:tasks.rados.rados.2.smithi057.stdout:3387: expect deleted 2020-11-16T22:14:37.619 INFO:tasks.rados.rados.2.smithi057.stdout:3388: read oid 26 snap -1 2020-11-16T22:14:37.619 INFO:tasks.rados.rados.2.smithi057.stdout:3388: expect deleted 2020-11-16T22:14:37.619 INFO:tasks.rados.rados.2.smithi057.stdout:3389: write (excl) oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 394 2020-11-16T22:14:37.619 INFO:tasks.rados.rados.2.smithi057.stdout:3389: seq_num 1137 ranges {709559=494710,1884497=759059} 2020-11-16T22:14:37.632 INFO:tasks.rados.rados.2.smithi057.stdout:3389: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 709559 to 1204269 tid 1 2020-11-16T22:14:37.640 INFO:tasks.rados.rados.2.smithi057.stdout:3389: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1884497 to 2643556 tid 2 2020-11-16T22:14:37.640 INFO:tasks.rados.rados.2.smithi057.stdout:3390: write (excl) oid 24 current snap is 394 2020-11-16T22:14:37.640 INFO:tasks.rados.rados.2.smithi057.stdout:3390: seq_num 1138 ranges {726366=569959,1826626=502717,2801601=324765} 2020-11-16T22:14:37.647 INFO:tasks.rados.rados.2.smithi057.stdout:3390: writing smithi05720651-24 from 726366 to 1296325 tid 1 2020-11-16T22:14:37.653 INFO:tasks.rados.rados.2.smithi057.stdout:3390: writing smithi05720651-24 from 1826626 to 2329343 tid 2 2020-11-16T22:14:37.658 INFO:tasks.rados.rados.2.smithi057.stdout:3390: writing smithi05720651-24 from 2801601 to 3126366 tid 3 2020-11-16T22:14:37.658 INFO:tasks.rados.rados.2.smithi057.stdout:3391: write (excl) oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 394 2020-11-16T22:14:37.658 INFO:tasks.rados.rados.2.smithi057.stdout:3391: seq_num 1139 ranges {743173=645208,1885108=762728} 2020-11-16T22:14:37.666 INFO:tasks.rados.rados.2.smithi057.stdout:3391: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 743173 to 1388381 tid 1 2020-11-16T22:14:37.673 INFO:tasks.rados.rados.2.smithi057.stdout:3391: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1885108 to 2647836 tid 2 2020-11-16T22:14:37.673 INFO:tasks.rados.rados.2.smithi057.stdout:3392: snap_create 2020-11-16T22:14:37.673 INFO:tasks.rados.rados.2.smithi057.stdout:3382: finishing copy_from to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:37.673 INFO:tasks.rados.rados.2.smithi057.stdout:3382: got expected ENOENT (src dne) 2020-11-16T22:14:37.674 INFO:tasks.rados.rados.2.smithi057.stdout:3382: finishing copy_from racing read to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:37.674 INFO:tasks.rados.rados.2.smithi057.stdout:3385: expect (ObjNum 1108 snap 382 seq_num 1108) 2020-11-16T22:14:37.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:37 smithi057 bash[10301]: cluster 2020-11-16T22:14:35.837685+0000 mgr.x (mgr.24115) 659 : cluster [DBG] pgmap v1435: 17 pgs: 17 active+clean; 327 MiB data, 954 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 607 KiB/s wr, 10 op/s 2020-11-16T22:14:37.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:37 smithi057 bash[10301]: cluster 2020-11-16T22:14:36.238787+0000 mon.a (mon.0) 1523 : cluster [DBG] osdmap e847: 12 total, 12 up, 12 in 2020-11-16T22:14:37.874 INFO:tasks.rados.rados.2.smithi057.stdout:3384: finishing copy_from to smithi05720651-28 2020-11-16T22:14:37.874 INFO:tasks.rados.rados.2.smithi057.stdout:3384: got expected ENOENT (src dne) 2020-11-16T22:14:37.875 INFO:tasks.rados.rados.2.smithi057.stdout:3384: finishing copy_from racing read to smithi05720651-28 2020-11-16T22:14:37.875 INFO:tasks.rados.rados.2.smithi057.stdout:3383: finishing copy_from to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:37.875 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2229 (ObjNum 1068 snap 375 seq_num 1068) dirty exists 2020-11-16T22:14:37.875 INFO:tasks.rados.rados.2.smithi057.stdout:3383: finishing copy_from racing read to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:37.875 INFO:tasks.rados.rados.2.smithi057.stdout:3389: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:37.875 INFO:tasks.rados.rados.2.smithi057.stdout:3389: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:37.875 INFO:tasks.rados.rados.2.smithi057.stdout:3389: finishing write tid 4 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:37.876 INFO:tasks.rados.rados.2.smithi057.stdout:3389: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:37.876 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2823 (ObjNum 1137 snap 394 seq_num 1137) dirty exists 2020-11-16T22:14:37.876 INFO:tasks.rados.rados.2.smithi057.stdout:3389: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1137 snap 394 seq_num 1137) 2020-11-16T22:14:37.876 INFO:tasks.rados.rados.2.smithi057.stdout:3390: finishing write tid 1 to smithi05720651-24 2020-11-16T22:14:37.876 INFO:tasks.rados.rados.2.smithi057.stdout:3390: finishing write tid 2 to smithi05720651-24 2020-11-16T22:14:37.876 INFO:tasks.rados.rados.2.smithi057.stdout:3390: finishing write tid 3 to smithi05720651-24 2020-11-16T22:14:37.876 INFO:tasks.rados.rados.2.smithi057.stdout:3390: finishing write tid 5 to smithi05720651-24 2020-11-16T22:14:37.877 INFO:tasks.rados.rados.2.smithi057.stdout:3390: finishing write tid 6 to smithi05720651-24 2020-11-16T22:14:37.877 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 2329 (ObjNum 1138 snap 394 seq_num 1138) dirty exists 2020-11-16T22:14:37.877 INFO:tasks.rados.rados.2.smithi057.stdout:3390: left oid 24 (ObjNum 1138 snap 394 seq_num 1138) 2020-11-16T22:14:37.877 INFO:tasks.rados.rados.2.smithi057.stdout:3391: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:37.877 INFO:tasks.rados.rados.2.smithi057.stdout:3391: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:37.877 INFO:tasks.rados.rados.2.smithi057.stdout:3391: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:37.877 INFO:tasks.rados.rados.2.smithi057.stdout:3391: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:37.877 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2710 (ObjNum 1139 snap 394 seq_num 1139) dirty exists 2020-11-16T22:14:37.878 INFO:tasks.rados.rados.2.smithi057.stdout:3391: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1139 snap 394 seq_num 1139) 2020-11-16T22:14:38.249 INFO:tasks.rados.rados.2.smithi057.stdout:3382: done (10 left) 2020-11-16T22:14:38.249 INFO:tasks.rados.rados.2.smithi057.stdout:3383: done (9 left) 2020-11-16T22:14:38.249 INFO:tasks.rados.rados.2.smithi057.stdout:3384: done (8 left) 2020-11-16T22:14:38.249 INFO:tasks.rados.rados.2.smithi057.stdout:3385: done (7 left) 2020-11-16T22:14:38.249 INFO:tasks.rados.rados.2.smithi057.stdout:3386: done (6 left) 2020-11-16T22:14:38.250 INFO:tasks.rados.rados.2.smithi057.stdout:3387: done (5 left) 2020-11-16T22:14:38.250 INFO:tasks.rados.rados.2.smithi057.stdout:3388: done (4 left) 2020-11-16T22:14:38.250 INFO:tasks.rados.rados.2.smithi057.stdout:3389: done (3 left) 2020-11-16T22:14:38.250 INFO:tasks.rados.rados.2.smithi057.stdout:3390: done (2 left) 2020-11-16T22:14:38.250 INFO:tasks.rados.rados.2.smithi057.stdout:3391: done (1 left) 2020-11-16T22:14:38.250 INFO:tasks.rados.rados.2.smithi057.stdout:3392: done (0 left) 2020-11-16T22:14:38.250 INFO:tasks.rados.rados.2.smithi057.stdout:3393: snap_create 2020-11-16T22:14:38.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:38 smithi016 bash[10302]: cluster 2020-11-16T22:14:37.248605+0000 mon.a (mon.0) 1524 : cluster [DBG] osdmap e848: 12 total, 12 up, 12 in 2020-11-16T22:14:38.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:38 smithi195 bash[10218]: cluster 2020-11-16T22:14:37.248605+0000 mon.a (mon.0) 1524 : cluster [DBG] osdmap e848: 12 total, 12 up, 12 in 2020-11-16T22:14:38.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:38 smithi057 bash[10301]: cluster 2020-11-16T22:14:37.248605+0000 mon.a (mon.0) 1524 : cluster [DBG] osdmap e848: 12 total, 12 up, 12 in 2020-11-16T22:14:39.260 INFO:tasks.rados.rados.2.smithi057.stdout:3393: done (0 left) 2020-11-16T22:14:39.260 INFO:tasks.rados.rados.2.smithi057.stdout:3394: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:39.260 INFO:tasks.rados.rados.2.smithi057.stdout:3394: expect (ObjNum 1085 snap 377 seq_num 1085) 2020-11-16T22:14:39.261 INFO:tasks.rados.rados.2.smithi057.stdout:3395: copy_from oid 40 from oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 396 2020-11-16T22:14:39.261 INFO:tasks.rados.rados.2.smithi057.stdout:3396: read oid 8 snap -1 2020-11-16T22:14:39.261 INFO:tasks.rados.rados.2.smithi057.stdout:3396: expect (ObjNum 1122 snap 389 seq_num 1122) 2020-11-16T22:14:39.261 INFO:tasks.rados.rados.2.smithi057.stdout:3397: write oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 396 2020-11-16T22:14:39.261 INFO:tasks.rados.rados.2.smithi057.stdout:3397: seq_num 1140 ranges {759980=720457,1943590=506386,2856447=303533} 2020-11-16T22:14:39.275 INFO:tasks.rados.rados.2.smithi057.stdout:3397: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 759980 to 1480437 tid 1 2020-11-16T22:14:39.281 INFO:tasks.rados.rados.2.smithi057.stdout:3397: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1943590 to 2449976 tid 2 2020-11-16T22:14:39.285 INFO:tasks.rados.rados.2.smithi057.stdout:3397: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2856447 to 3159980 tid 3 2020-11-16T22:14:39.285 INFO:tasks.rados.rados.2.smithi057.stdout:3398: write oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 396 2020-11-16T22:14:39.285 INFO:tasks.rados.rados.2.smithi057.stdout:3398: seq_num 1141 ranges {776787=512059,1718425=766397,3000223=176564} 2020-11-16T22:14:39.293 INFO:tasks.rados.rados.2.smithi057.stdout:3398: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 776787 to 1288846 tid 1 2020-11-16T22:14:39.299 INFO:tasks.rados.rados.2.smithi057.stdout:3398: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1718425 to 2484822 tid 2 2020-11-16T22:14:39.303 INFO:tasks.rados.rados.2.smithi057.stdout:3398: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3000223 to 3176787 tid 3 2020-11-16T22:14:39.304 INFO:tasks.rados.rados.2.smithi057.stdout:3399: write oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 396 2020-11-16T22:14:39.304 INFO:tasks.rados.rados.2.smithi057.stdout:3399: seq_num 1142 ranges {793594=587308,2060554=510055} 2020-11-16T22:14:39.311 INFO:tasks.rados.rados.2.smithi057.stdout:3399: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 793594 to 1380902 tid 1 2020-11-16T22:14:39.318 INFO:tasks.rados.rados.2.smithi057.stdout:3399: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2060554 to 2570609 tid 2 2020-11-16T22:14:39.318 INFO:tasks.rados.rados.2.smithi057.stdout:3400: rollback oid 46 current snap is 396 2020-11-16T22:14:39.318 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 46 to 382 2020-11-16T22:14:39.319 INFO:tasks.rados.rados.2.smithi057.stdout:3401: copy_from oid 32 from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 396 2020-11-16T22:14:39.319 INFO:tasks.rados.rados.2.smithi057.stdout:3396: expect (ObjNum 1122 snap 389 seq_num 1122) 2020-11-16T22:14:39.415 INFO:tasks.rados.rados.2.smithi057.stdout:3395: finishing copy_from to smithi05720651-40 2020-11-16T22:14:39.416 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 2665 (ObjNum 1094 snap 380 seq_num 1094) dirty exists 2020-11-16T22:14:39.416 INFO:tasks.rados.rados.2.smithi057.stdout:3395: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:14:39.416 INFO:tasks.rados.rados.2.smithi057.stdout:3397: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:39.416 INFO:tasks.rados.rados.2.smithi057.stdout:3397: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:39.416 INFO:tasks.rados.rados.2.smithi057.stdout:3397: finishing write tid 3 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:39.417 INFO:tasks.rados.rados.2.smithi057.stdout:3397: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:39.417 INFO:tasks.rados.rados.2.smithi057.stdout:3397: finishing write tid 6 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:39.417 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2401 (ObjNum 1140 snap 396 seq_num 1140) dirty exists 2020-11-16T22:14:39.417 INFO:tasks.rados.rados.2.smithi057.stdout:3397: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1140 snap 396 seq_num 1140) 2020-11-16T22:14:39.417 INFO:tasks.rados.rados.2.smithi057.stdout:3398: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:39.417 INFO:tasks.rados.rados.2.smithi057.stdout:3398: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:39.418 INFO:tasks.rados.rados.2.smithi057.stdout:3395: done (7 left) 2020-11-16T22:14:39.418 INFO:tasks.rados.rados.2.smithi057.stdout:3396: done (6 left) 2020-11-16T22:14:39.418 INFO:tasks.rados.rados.2.smithi057.stdout:3397: done (5 left) 2020-11-16T22:14:39.418 INFO:tasks.rados.rados.2.smithi057.stdout:3402: read oid 30 snap 387 2020-11-16T22:14:39.418 INFO:tasks.rados.rados.2.smithi057.stdout:3402: expect (ObjNum 1074 snap 377 seq_num 1074) 2020-11-16T22:14:39.418 INFO:tasks.rados.rados.2.smithi057.stdout:3403: snap_remove snap 388 2020-11-16T22:14:39.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:39 smithi016 bash[10302]: cluster 2020-11-16T22:14:37.838518+0000 mgr.x (mgr.24115) 660 : cluster [DBG] pgmap v1438: 17 pgs: 17 active+clean; 335 MiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.4 MiB/s wr, 19 op/s 2020-11-16T22:14:39.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:39 smithi016 bash[10302]: cluster 2020-11-16T22:14:38.258353+0000 mon.a (mon.0) 1525 : cluster [DBG] osdmap e849: 12 total, 12 up, 12 in 2020-11-16T22:14:39.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:39 smithi195 bash[10218]: cluster 2020-11-16T22:14:37.838518+0000 mgr.x (mgr.24115) 660 : cluster [DBG] pgmap v1438: 17 pgs: 17 active+clean; 335 MiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.4 MiB/s wr, 19 op/s 2020-11-16T22:14:39.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:39 smithi195 bash[10218]: cluster 2020-11-16T22:14:38.258353+0000 mon.a (mon.0) 1525 : cluster [DBG] osdmap e849: 12 total, 12 up, 12 in 2020-11-16T22:14:39.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:39 smithi057 bash[10301]: cluster 2020-11-16T22:14:37.838518+0000 mgr.x (mgr.24115) 660 : cluster [DBG] pgmap v1438: 17 pgs: 17 active+clean; 335 MiB data, 963 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.4 MiB/s wr, 19 op/s 2020-11-16T22:14:39.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:39 smithi057 bash[10301]: cluster 2020-11-16T22:14:38.258353+0000 mon.a (mon.0) 1525 : cluster [DBG] osdmap e849: 12 total, 12 up, 12 in 2020-11-16T22:14:40.176 INFO:tasks.rados.rados.2.smithi057.stdout:3403: done (6 left) 2020-11-16T22:14:40.176 INFO:tasks.rados.rados.2.smithi057.stdout:3404: snap_remove snap 389 2020-11-16T22:14:40.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:40 smithi016 bash[10302]: cluster 2020-11-16T22:14:39.260796+0000 mon.a (mon.0) 1526 : cluster [DBG] osdmap e850: 12 total, 12 up, 12 in 2020-11-16T22:14:40.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:40 smithi016 bash[10302]: cluster 2020-11-16T22:14:40.186350+0000 mon.a (mon.0) 1527 : cluster [DBG] osdmap e851: 12 total, 12 up, 12 in 2020-11-16T22:14:40.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:40 smithi195 bash[10218]: cluster 2020-11-16T22:14:39.260796+0000 mon.a (mon.0) 1526 : cluster [DBG] osdmap e850: 12 total, 12 up, 12 in 2020-11-16T22:14:40.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:40 smithi195 bash[10218]: cluster 2020-11-16T22:14:40.186350+0000 mon.a (mon.0) 1527 : cluster [DBG] osdmap e851: 12 total, 12 up, 12 in 2020-11-16T22:14:40.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:40 smithi057 bash[10301]: cluster 2020-11-16T22:14:39.260796+0000 mon.a (mon.0) 1526 : cluster [DBG] osdmap e850: 12 total, 12 up, 12 in 2020-11-16T22:14:40.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:40 smithi057 bash[10301]: cluster 2020-11-16T22:14:40.186350+0000 mon.a (mon.0) 1527 : cluster [DBG] osdmap e851: 12 total, 12 up, 12 in 2020-11-16T22:14:41.178 INFO:tasks.rados.rados.2.smithi057.stdout:3404: done (6 left) 2020-11-16T22:14:41.179 INFO:tasks.rados.rados.2.smithi057.stdout:3405: copy_from oid 6 from oid 22 current snap is 396 2020-11-16T22:14:41.179 INFO:tasks.rados.rados.2.smithi057.stdout:3398: finishing write tid 3 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:41.179 INFO:tasks.rados.rados.2.smithi057.stdout:3398: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:41.179 INFO:tasks.rados.rados.2.smithi057.stdout:3398: finishing write tid 6 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:41.179 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2228 (ObjNum 1141 snap 396 seq_num 1141) dirty exists 2020-11-16T22:14:41.180 INFO:tasks.rados.rados.2.smithi057.stdout:3398: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1141 snap 396 seq_num 1141) 2020-11-16T22:14:41.180 INFO:tasks.rados.rados.2.smithi057.stdout:3399: finishing write tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:41.180 INFO:tasks.rados.rados.2.smithi057.stdout:3399: finishing write tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:41.180 INFO:tasks.rados.rados.2.smithi057.stdout:3399: finishing write tid 4 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:41.180 INFO:tasks.rados.rados.2.smithi057.stdout:3399: finishing write tid 5 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:41.180 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2565 (ObjNum 1142 snap 396 seq_num 1142) dirty exists 2020-11-16T22:14:41.180 INFO:tasks.rados.rados.2.smithi057.stdout:3399: left oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1142 snap 396 seq_num 1142) 2020-11-16T22:14:41.181 INFO:tasks.rados.rados.2.smithi057.stdout:3400: finishing rollback tid 0 to smithi05720651-46 2020-11-16T22:14:41.181 INFO:tasks.rados.rados.2.smithi057.stdout:3400: finishing rollback tid 1 to smithi05720651-46 2020-11-16T22:14:41.181 INFO:tasks.rados.rados.2.smithi057.stdout:3400: finishing rollback tid 2 to smithi05720651-46 2020-11-16T22:14:41.181 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 2568 (ObjNum 1101 snap 381 seq_num 1101) dirty exists 2020-11-16T22:14:41.181 INFO:tasks.rados.rados.2.smithi057.stdout:3401: finishing copy_from to smithi05720651-32 2020-11-16T22:14:41.181 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 2229 (ObjNum 1068 snap 375 seq_num 1068) dirty exists 2020-11-16T22:14:41.181 INFO:tasks.rados.rados.2.smithi057.stdout:3401: finishing copy_from racing read to smithi05720651-32 2020-11-16T22:14:41.182 INFO:tasks.rados.rados.2.smithi057.stdout:3398: done (6 left) 2020-11-16T22:14:41.182 INFO:tasks.rados.rados.2.smithi057.stdout:3399: done (5 left) 2020-11-16T22:14:41.182 INFO:tasks.rados.rados.2.smithi057.stdout:3400: done (4 left) 2020-11-16T22:14:41.182 INFO:tasks.rados.rados.2.smithi057.stdout:3401: done (3 left) 2020-11-16T22:14:41.182 INFO:tasks.rados.rados.2.smithi057.stdout:3406: rollback oid 28 current snap is 396 2020-11-16T22:14:41.182 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 28 to 387 2020-11-16T22:14:41.182 INFO:tasks.rados.rados.2.smithi057.stdout:3402: expect (ObjNum 1074 snap 377 seq_num 1074) 2020-11-16T22:14:41.278 INFO:tasks.rados.rados.2.smithi057.stdout:3394: expect (ObjNum 1085 snap 377 seq_num 1085) 2020-11-16T22:14:41.427 INFO:tasks.rados.rados.2.smithi057.stdout:3406: finishing rollback tid 0 to smithi05720651-28 2020-11-16T22:14:41.428 INFO:tasks.rados.rados.2.smithi057.stdout:3406: finishing rollback tid 1 to smithi05720651-28 2020-11-16T22:14:41.428 INFO:tasks.rados.rados.2.smithi057.stdout:3406: finishing rollback tid 2 to smithi05720651-28 2020-11-16T22:14:41.428 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 2239 (ObjNum 1114 snap 387 seq_num 1114) dirty exists 2020-11-16T22:14:41.428 INFO:tasks.rados.rados.2.smithi057.stdout:3405: finishing copy_from to smithi05720651-6 2020-11-16T22:14:41.429 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 2515 (ObjNum 1027 snap 361 seq_num 1027) dirty exists 2020-11-16T22:14:41.429 INFO:tasks.rados.rados.2.smithi057.stdout:3405: finishing copy_from racing read to smithi05720651-6 2020-11-16T22:14:41.429 INFO:tasks.rados.rados.2.smithi057.stdout:3394: done (3 left) 2020-11-16T22:14:41.429 INFO:tasks.rados.rados.2.smithi057.stdout:3402: done (2 left) 2020-11-16T22:14:41.429 INFO:tasks.rados.rados.2.smithi057.stdout:3405: done (1 left) 2020-11-16T22:14:41.429 INFO:tasks.rados.rados.2.smithi057.stdout:3406: done (0 left) 2020-11-16T22:14:41.429 INFO:tasks.rados.rados.2.smithi057.stdout:3407: copy_from oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 40 current snap is 396 2020-11-16T22:14:41.430 INFO:tasks.rados.rados.2.smithi057.stdout:3408: copy_from oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 12 current snap is 396 2020-11-16T22:14:41.430 INFO:tasks.rados.rados.2.smithi057.stdout:3409: snap_create 2020-11-16T22:14:41.448 INFO:tasks.rados.rados.2.smithi057.stdout:3407: finishing copy_from to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:41.448 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2665 (ObjNum 1094 snap 380 seq_num 1094) dirty exists 2020-11-16T22:14:41.449 INFO:tasks.rados.rados.2.smithi057.stdout:3407: finishing copy_from racing read to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:41.449 INFO:tasks.rados.rados.2.smithi057.stdout:3408: finishing copy_from to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:41.450 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2526 (ObjNum 1133 snap 393 seq_num 1133) dirty exists 2020-11-16T22:14:41.450 INFO:tasks.rados.rados.2.smithi057.stdout:3408: finishing copy_from racing read to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:41.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:41 smithi016 bash[10302]: cluster 2020-11-16T22:14:39.839267+0000 mgr.x (mgr.24115) 661 : cluster [DBG] pgmap v1441: 17 pgs: 17 active+clean; 338 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2020-11-16T22:14:41.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:41 smithi016 bash[10302]: cluster 2020-11-16T22:14:41.188843+0000 mon.a (mon.0) 1528 : cluster [DBG] osdmap e852: 12 total, 12 up, 12 in 2020-11-16T22:14:41.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:41 smithi195 bash[10218]: cluster 2020-11-16T22:14:39.839267+0000 mgr.x (mgr.24115) 661 : cluster [DBG] pgmap v1441: 17 pgs: 17 active+clean; 338 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2020-11-16T22:14:41.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:41 smithi195 bash[10218]: cluster 2020-11-16T22:14:41.188843+0000 mon.a (mon.0) 1528 : cluster [DBG] osdmap e852: 12 total, 12 up, 12 in 2020-11-16T22:14:41.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:41 smithi057 bash[10301]: cluster 2020-11-16T22:14:39.839267+0000 mgr.x (mgr.24115) 661 : cluster [DBG] pgmap v1441: 17 pgs: 17 active+clean; 338 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2020-11-16T22:14:41.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:41 smithi057 bash[10301]: cluster 2020-11-16T22:14:41.188843+0000 mon.a (mon.0) 1528 : cluster [DBG] osdmap e852: 12 total, 12 up, 12 in 2020-11-16T22:14:42.278 INFO:tasks.rados.rados.2.smithi057.stdout:3407: done (2 left) 2020-11-16T22:14:42.278 INFO:tasks.rados.rados.2.smithi057.stdout:3408: done (1 left) 2020-11-16T22:14:42.278 INFO:tasks.rados.rados.2.smithi057.stdout:3409: done (0 left) 2020-11-16T22:14:42.278 INFO:tasks.rados.rados.2.smithi057.stdout:3410: write (excl) oid 2 current snap is 397 2020-11-16T22:14:42.278 INFO:tasks.rados.rados.2.smithi057.stdout:3410: seq_num 1143 ranges {410401=662557,1719036=770066,2938716=271685} 2020-11-16T22:14:42.292 INFO:tasks.rados.rados.2.smithi057.stdout:3410: writing smithi05720651-2 from 410401 to 1072958 tid 1 2020-11-16T22:14:42.300 INFO:tasks.rados.rados.2.smithi057.stdout:3410: writing smithi05720651-2 from 1719036 to 2489102 tid 2 2020-11-16T22:14:42.304 INFO:tasks.rados.rados.2.smithi057.stdout:3410: writing smithi05720651-2 from 2938716 to 3210401 tid 3 2020-11-16T22:14:42.304 INFO:tasks.rados.rados.2.smithi057.stdout:3411: snap_remove snap 395 2020-11-16T22:14:43.289 INFO:tasks.rados.rados.2.smithi057.stdout:3411: done (1 left) 2020-11-16T22:14:43.290 INFO:tasks.rados.rados.2.smithi057.stdout:3412: rollback oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 397 2020-11-16T22:14:43.290 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 370 2020-11-16T22:14:43.290 INFO:tasks.rados.rados.2.smithi057.stdout:3410: finishing write tid 1 to smithi05720651-2 2020-11-16T22:14:43.291 INFO:tasks.rados.rados.2.smithi057.stdout:3410: finishing write tid 2 to smithi05720651-2 2020-11-16T22:14:43.291 INFO:tasks.rados.rados.2.smithi057.stdout:3410: finishing write tid 3 to smithi05720651-2 2020-11-16T22:14:43.291 INFO:tasks.rados.rados.2.smithi057.stdout:3410: finishing write tid 5 to smithi05720651-2 2020-11-16T22:14:43.291 INFO:tasks.rados.rados.2.smithi057.stdout:3410: finishing write tid 6 to smithi05720651-2 2020-11-16T22:14:43.291 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 2847 (ObjNum 1143 snap 397 seq_num 1143) dirty exists 2020-11-16T22:14:43.291 INFO:tasks.rados.rados.2.smithi057.stdout:3410: left oid 2 (ObjNum 1143 snap 397 seq_num 1143) 2020-11-16T22:14:43.292 INFO:tasks.rados.rados.2.smithi057.stdout:3410: done (1 left) 2020-11-16T22:14:43.292 INFO:tasks.rados.rados.2.smithi057.stdout:3413: write oid 14 current snap is 397 2020-11-16T22:14:43.292 INFO:tasks.rados.rados.2.smithi057.stdout:3413: seq_num 1144 ranges {427208=737806,1777518=513724,2966139=261069} 2020-11-16T22:14:43.301 INFO:tasks.rados.rados.2.smithi057.stdout:3413: writing smithi05720651-14 from 427208 to 1165014 tid 1 2020-11-16T22:14:43.308 INFO:tasks.rados.rados.2.smithi057.stdout:3413: writing smithi05720651-14 from 1777518 to 2291242 tid 2 2020-11-16T22:14:43.314 INFO:tasks.rados.rados.2.smithi057.stdout:3413: writing smithi05720651-14 from 2966139 to 3227208 tid 3 2020-11-16T22:14:43.314 INFO:tasks.rados.rados.2.smithi057.stdout:3414: rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 397 2020-11-16T22:14:43.314 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 366 2020-11-16T22:14:43.314 INFO:tasks.rados.rados.2.smithi057.stdout:3412: finishing rollback tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:43.314 INFO:tasks.rados.rados.2.smithi057.stdout:3412: finishing rollback tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:43.315 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2230 (ObjNum 981 snap 341 seq_num 981) dirty exists 2020-11-16T22:14:43.315 INFO:tasks.rados.rados.2.smithi057.stdout:3413: finishing write tid 1 to smithi05720651-14 2020-11-16T22:14:43.315 INFO:tasks.rados.rados.2.smithi057.stdout:3413: finishing write tid 2 to smithi05720651-14 2020-11-16T22:14:43.315 INFO:tasks.rados.rados.2.smithi057.stdout:3412: done (2 left) 2020-11-16T22:14:43.315 INFO:tasks.rados.rados.2.smithi057.stdout:3415: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 363 2020-11-16T22:14:43.315 INFO:tasks.rados.rados.2.smithi057.stdout:3415: expect (ObjNum 968 snap 333 seq_num 968) 2020-11-16T22:14:43.315 INFO:tasks.rados.rados.2.smithi057.stdout:3416: snap_create 2020-11-16T22:14:43.319 INFO:tasks.rados.rados.2.smithi057.stdout:3414: finishing rollback tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:43.319 INFO:tasks.rados.rados.2.smithi057.stdout:3414: finishing rollback tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:43.319 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2241 (ObjNum 1025 snap 360 seq_num 1025) dirty exists 2020-11-16T22:14:43.320 INFO:tasks.rados.rados.2.smithi057.stdout:3413: finishing write tid 3 to smithi05720651-14 2020-11-16T22:14:43.320 INFO:tasks.rados.rados.2.smithi057.stdout:3413: finishing write tid 5 to smithi05720651-14 2020-11-16T22:14:43.320 INFO:tasks.rados.rados.2.smithi057.stdout:3413: finishing write tid 6 to smithi05720651-14 2020-11-16T22:14:43.320 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 2855 (ObjNum 1144 snap 397 seq_num 1144) dirty exists 2020-11-16T22:14:43.321 INFO:tasks.rados.rados.2.smithi057.stdout:3413: left oid 14 (ObjNum 1144 snap 397 seq_num 1144) 2020-11-16T22:14:43.323 INFO:tasks.rados.rados.2.smithi057.stdout:3415: expect (ObjNum 968 snap 333 seq_num 968) 2020-11-16T22:14:43.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:43 smithi016 bash[10302]: cluster 2020-11-16T22:14:41.840012+0000 mgr.x (mgr.24115) 662 : cluster [DBG] pgmap v1444: 17 pgs: 17 active+clean; 355 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 4.7 MiB/s wr, 27 op/s 2020-11-16T22:14:43.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:43 smithi016 bash[10302]: cluster 2020-11-16T22:14:42.288814+0000 mon.a (mon.0) 1529 : cluster [DBG] osdmap e853: 12 total, 12 up, 12 in 2020-11-16T22:14:43.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:43 smithi195 bash[10218]: cluster 2020-11-16T22:14:41.840012+0000 mgr.x (mgr.24115) 662 : cluster [DBG] pgmap v1444: 17 pgs: 17 active+clean; 355 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 4.7 MiB/s wr, 27 op/s 2020-11-16T22:14:43.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:43 smithi195 bash[10218]: cluster 2020-11-16T22:14:42.288814+0000 mon.a (mon.0) 1529 : cluster [DBG] osdmap e853: 12 total, 12 up, 12 in 2020-11-16T22:14:43.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:43 smithi057 bash[10301]: cluster 2020-11-16T22:14:41.840012+0000 mgr.x (mgr.24115) 662 : cluster [DBG] pgmap v1444: 17 pgs: 17 active+clean; 355 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 4.7 MiB/s wr, 27 op/s 2020-11-16T22:14:43.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:43 smithi057 bash[10301]: cluster 2020-11-16T22:14:42.288814+0000 mon.a (mon.0) 1529 : cluster [DBG] osdmap e853: 12 total, 12 up, 12 in 2020-11-16T22:14:44.299 INFO:tasks.rados.rados.2.smithi057.stdout:3413: done (3 left) 2020-11-16T22:14:44.299 INFO:tasks.rados.rados.2.smithi057.stdout:3414: done (2 left) 2020-11-16T22:14:44.300 INFO:tasks.rados.rados.2.smithi057.stdout:3415: done (1 left) 2020-11-16T22:14:44.300 INFO:tasks.rados.rados.2.smithi057.stdout:3416: done (0 left) 2020-11-16T22:14:44.300 INFO:tasks.rados.rados.2.smithi057.stdout:3417: delete oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 398 2020-11-16T22:14:44.310 INFO:tasks.rados.rados.2.smithi057.stdout:3417: done (0 left) 2020-11-16T22:14:44.310 INFO:tasks.rados.rados.2.smithi057.stdout:3418: write (excl) oid 46 current snap is 398 2020-11-16T22:14:44.310 INFO:tasks.rados.rados.2.smithi057.stdout:3418: seq_num 1146 ranges {460822=488304,1378129=517393,2504632=405962} 2020-11-16T22:14:44.319 INFO:tasks.rados.rados.2.smithi057.stdout:3418: writing smithi05720651-46 from 460822 to 949126 tid 1 2020-11-16T22:14:44.326 INFO:tasks.rados.rados.2.smithi057.stdout:3418: writing smithi05720651-46 from 1378129 to 1895522 tid 2 2020-11-16T22:14:44.332 INFO:tasks.rados.rados.2.smithi057.stdout:3418: writing smithi05720651-46 from 2504632 to 2910594 tid 3 2020-11-16T22:14:44.333 INFO:tasks.rados.rados.2.smithi057.stdout:3419: copy_from oid 10 from oid 8 current snap is 398 2020-11-16T22:14:44.333 INFO:tasks.rados.rados.2.smithi057.stdout:3418: finishing write tid 1 to smithi05720651-46 2020-11-16T22:14:44.333 INFO:tasks.rados.rados.2.smithi057.stdout:3420: snap_create 2020-11-16T22:14:44.338 INFO:tasks.rados.rados.2.smithi057.stdout:3418: finishing write tid 2 to smithi05720651-46 2020-11-16T22:14:44.338 INFO:tasks.rados.rados.2.smithi057.stdout:3418: finishing write tid 3 to smithi05720651-46 2020-11-16T22:14:44.339 INFO:tasks.rados.rados.2.smithi057.stdout:3418: finishing write tid 5 to smithi05720651-46 2020-11-16T22:14:44.340 INFO:tasks.rados.rados.2.smithi057.stdout:3418: finishing write tid 6 to smithi05720651-46 2020-11-16T22:14:44.340 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 2572 (ObjNum 1146 snap 398 seq_num 1146) dirty exists 2020-11-16T22:14:44.340 INFO:tasks.rados.rados.2.smithi057.stdout:3418: left oid 46 (ObjNum 1146 snap 398 seq_num 1146) 2020-11-16T22:14:44.360 INFO:tasks.rados.rados.2.smithi057.stdout:3419: finishing copy_from to smithi05720651-10 2020-11-16T22:14:44.360 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 2203 (ObjNum 1122 snap 389 seq_num 1122) dirty exists 2020-11-16T22:14:44.360 INFO:tasks.rados.rados.2.smithi057.stdout:3419: finishing copy_from racing read to smithi05720651-10 2020-11-16T22:14:44.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:44 smithi016 bash[10302]: cluster 2020-11-16T22:14:43.300240+0000 mon.a (mon.0) 1530 : cluster [DBG] osdmap e854: 12 total, 12 up, 12 in 2020-11-16T22:14:44.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:44 smithi195 bash[10218]: cluster 2020-11-16T22:14:43.300240+0000 mon.a (mon.0) 1530 : cluster [DBG] osdmap e854: 12 total, 12 up, 12 in 2020-11-16T22:14:44.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:44 smithi057 bash[10301]: cluster 2020-11-16T22:14:43.300240+0000 mon.a (mon.0) 1530 : cluster [DBG] osdmap e854: 12 total, 12 up, 12 in 2020-11-16T22:14:45.176 INFO:tasks.rados.rados.2.smithi057.stdout:3418: done (2 left) 2020-11-16T22:14:45.177 INFO:tasks.rados.rados.2.smithi057.stdout:3419: done (1 left) 2020-11-16T22:14:45.177 INFO:tasks.rados.rados.2.smithi057.stdout:3420: done (0 left) 2020-11-16T22:14:45.177 INFO:tasks.rados.rados.2.smithi057.stdout:3421: snap_remove snap 382 2020-11-16T22:14:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:45 smithi016 bash[10302]: cluster 2020-11-16T22:14:43.840639+0000 mgr.x (mgr.24115) 663 : cluster [DBG] pgmap v1447: 17 pgs: 17 active+clean; 355 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 4.4 MiB/s wr, 23 op/s 2020-11-16T22:14:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:45 smithi016 bash[10302]: cluster 2020-11-16T22:14:44.310336+0000 mon.a (mon.0) 1531 : cluster [DBG] osdmap e855: 12 total, 12 up, 12 in 2020-11-16T22:14:45.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:45 smithi016 bash[10302]: cluster 2020-11-16T22:14:45.187455+0000 mon.a (mon.0) 1532 : cluster [DBG] osdmap e856: 12 total, 12 up, 12 in 2020-11-16T22:14:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:45 smithi195 bash[10218]: cluster 2020-11-16T22:14:43.840639+0000 mgr.x (mgr.24115) 663 : cluster [DBG] pgmap v1447: 17 pgs: 17 active+clean; 355 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 4.4 MiB/s wr, 23 op/s 2020-11-16T22:14:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:45 smithi195 bash[10218]: cluster 2020-11-16T22:14:44.310336+0000 mon.a (mon.0) 1531 : cluster [DBG] osdmap e855: 12 total, 12 up, 12 in 2020-11-16T22:14:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:45 smithi195 bash[10218]: cluster 2020-11-16T22:14:45.187455+0000 mon.a (mon.0) 1532 : cluster [DBG] osdmap e856: 12 total, 12 up, 12 in 2020-11-16T22:14:45.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:45 smithi057 bash[10301]: cluster 2020-11-16T22:14:43.840639+0000 mgr.x (mgr.24115) 663 : cluster [DBG] pgmap v1447: 17 pgs: 17 active+clean; 355 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 4.4 MiB/s wr, 23 op/s 2020-11-16T22:14:45.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:45 smithi057 bash[10301]: cluster 2020-11-16T22:14:44.310336+0000 mon.a (mon.0) 1531 : cluster [DBG] osdmap e855: 12 total, 12 up, 12 in 2020-11-16T22:14:45.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:45 smithi057 bash[10301]: cluster 2020-11-16T22:14:45.187455+0000 mon.a (mon.0) 1532 : cluster [DBG] osdmap e856: 12 total, 12 up, 12 in 2020-11-16T22:14:46.179 INFO:tasks.rados.rados.2.smithi057.stdout:3421: done (0 left) 2020-11-16T22:14:46.179 INFO:tasks.rados.rados.2.smithi057.stdout:3422: read oid 48 snap -1 2020-11-16T22:14:46.179 INFO:tasks.rados.rados.2.smithi057.stdout:3422: expect deleted 2020-11-16T22:14:46.180 INFO:tasks.rados.rados.2.smithi057.stdout:3423: write oid 14 current snap is 399 2020-11-16T22:14:46.180 INFO:tasks.rados.rados.2.smithi057.stdout:3423: seq_num 1147 ranges {477629=563553,1836611=777404,3048408=229221} 2020-11-16T22:14:46.198 INFO:tasks.rados.rados.2.smithi057.stdout:3423: writing smithi05720651-14 from 477629 to 1041182 tid 1 2020-11-16T22:14:46.205 INFO:tasks.rados.rados.2.smithi057.stdout:3423: writing smithi05720651-14 from 1836611 to 2614015 tid 2 2020-11-16T22:14:46.209 INFO:tasks.rados.rados.2.smithi057.stdout:3423: writing smithi05720651-14 from 3048408 to 3277629 tid 3 2020-11-16T22:14:46.209 INFO:tasks.rados.rados.2.smithi057.stdout:3424: write oid 20 current snap is 399 2020-11-16T22:14:46.209 INFO:tasks.rados.rados.2.smithi057.stdout:3424: seq_num 1148 ranges {494436=755155,2011446=521062,3075831=218605} 2020-11-16T22:14:46.216 INFO:tasks.rados.rados.2.smithi057.stdout:3424: writing smithi05720651-20 from 494436 to 1249591 tid 1 2020-11-16T22:14:46.223 INFO:tasks.rados.rados.2.smithi057.stdout:3424: writing smithi05720651-20 from 2011446 to 2532508 tid 2 2020-11-16T22:14:46.228 INFO:tasks.rados.rados.2.smithi057.stdout:3424: writing smithi05720651-20 from 3075831 to 3294436 tid 3 2020-11-16T22:14:46.228 INFO:tasks.rados.rados.2.smithi057.stdout:3425: rollback oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 399 2020-11-16T22:14:46.228 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 396 2020-11-16T22:14:46.229 INFO:tasks.rados.rados.2.smithi057.stdout:3423: finishing write tid 1 to smithi05720651-14 2020-11-16T22:14:46.229 INFO:tasks.rados.rados.2.smithi057.stdout:3423: finishing write tid 2 to smithi05720651-14 2020-11-16T22:14:46.229 INFO:tasks.rados.rados.2.smithi057.stdout:3423: finishing write tid 3 to smithi05720651-14 2020-11-16T22:14:46.229 INFO:tasks.rados.rados.2.smithi057.stdout:3423: finishing write tid 5 to smithi05720651-14 2020-11-16T22:14:46.229 INFO:tasks.rados.rados.2.smithi057.stdout:3423: finishing write tid 6 to smithi05720651-14 2020-11-16T22:14:46.229 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 2864 (ObjNum 1147 snap 399 seq_num 1147) dirty exists 2020-11-16T22:14:46.229 INFO:tasks.rados.rados.2.smithi057.stdout:3423: left oid 14 (ObjNum 1147 snap 399 seq_num 1147) 2020-11-16T22:14:46.230 INFO:tasks.rados.rados.2.smithi057.stdout:3424: finishing write tid 1 to smithi05720651-20 2020-11-16T22:14:46.230 INFO:tasks.rados.rados.2.smithi057.stdout:3424: finishing write tid 2 to smithi05720651-20 2020-11-16T22:14:46.230 INFO:tasks.rados.rados.2.smithi057.stdout:3422: done (3 left) 2020-11-16T22:14:46.230 INFO:tasks.rados.rados.2.smithi057.stdout:3423: done (2 left) 2020-11-16T22:14:46.230 INFO:tasks.rados.rados.2.smithi057.stdout:3426: write (excl) oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 399 2020-11-16T22:14:46.230 INFO:tasks.rados.rados.2.smithi057.stdout:3426: seq_num 1149 ranges {511243=430404,1669928=664720,3103254=207989} 2020-11-16T22:14:46.234 INFO:tasks.rados.rados.2.smithi057.stdout:3426: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 511243 to 941647 tid 1 2020-11-16T22:14:46.242 INFO:tasks.rados.rados.2.smithi057.stdout:3426: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1669928 to 2334648 tid 2 2020-11-16T22:14:46.247 INFO:tasks.rados.rados.2.smithi057.stdout:3426: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3103254 to 3311243 tid 3 2020-11-16T22:14:46.248 INFO:tasks.rados.rados.2.smithi057.stdout:3427: write oid 46 current snap is 399 2020-11-16T22:14:46.248 INFO:tasks.rados.rados.2.smithi057.stdout:3427: seq_num 1150 ranges {528050=505653,1612057=524731,2614324=567403} 2020-11-16T22:14:46.253 INFO:tasks.rados.rados.2.smithi057.stdout:3427: writing smithi05720651-46 from 528050 to 1033703 tid 1 2020-11-16T22:14:46.259 INFO:tasks.rados.rados.2.smithi057.stdout:3427: writing smithi05720651-46 from 1612057 to 2136788 tid 2 2020-11-16T22:14:46.266 INFO:tasks.rados.rados.2.smithi057.stdout:3427: writing smithi05720651-46 from 2614324 to 3181727 tid 3 2020-11-16T22:14:46.266 INFO:tasks.rados.rados.2.smithi057.stdout:3428: snap_create 2020-11-16T22:14:46.266 INFO:tasks.rados.rados.2.smithi057.stdout:3424: finishing write tid 3 to smithi05720651-20 2020-11-16T22:14:46.266 INFO:tasks.rados.rados.2.smithi057.stdout:3424: finishing write tid 5 to smithi05720651-20 2020-11-16T22:14:46.267 INFO:tasks.rados.rados.2.smithi057.stdout:3424: finishing write tid 6 to smithi05720651-20 2020-11-16T22:14:46.267 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 2208 (ObjNum 1148 snap 399 seq_num 1148) dirty exists 2020-11-16T22:14:46.267 INFO:tasks.rados.rados.2.smithi057.stdout:3424: left oid 20 (ObjNum 1148 snap 399 seq_num 1148) 2020-11-16T22:14:46.267 INFO:tasks.rados.rados.2.smithi057.stdout:3425: finishing rollback tid 0 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:46.267 INFO:tasks.rados.rados.2.smithi057.stdout:3425: finishing rollback tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:46.267 INFO:tasks.rados.rados.2.smithi057.stdout:3425: finishing rollback tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:46.268 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2244 (ObjNum 1068 snap 375 seq_num 1068) dirty exists 2020-11-16T22:14:46.268 INFO:tasks.rados.rados.2.smithi057.stdout:3426: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:46.268 INFO:tasks.rados.rados.2.smithi057.stdout:3426: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:46.268 INFO:tasks.rados.rados.2.smithi057.stdout:3426: finishing write tid 3 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:46.268 INFO:tasks.rados.rados.2.smithi057.stdout:3426: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:46.268 INFO:tasks.rados.rados.2.smithi057.stdout:3426: finishing write tid 6 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:46.268 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2669 (ObjNum 1149 snap 399 seq_num 1149) dirty exists 2020-11-16T22:14:46.269 INFO:tasks.rados.rados.2.smithi057.stdout:3426: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1149 snap 399 seq_num 1149) 2020-11-16T22:14:46.269 INFO:tasks.rados.rados.2.smithi057.stdout:3427: finishing write tid 1 to smithi05720651-46 2020-11-16T22:14:46.269 INFO:tasks.rados.rados.2.smithi057.stdout:3427: finishing write tid 2 to smithi05720651-46 2020-11-16T22:14:46.272 INFO:tasks.rados.rados.2.smithi057.stdout:3427: finishing write tid 3 to smithi05720651-46 2020-11-16T22:14:46.272 INFO:tasks.rados.rados.2.smithi057.stdout:3427: finishing write tid 5 to smithi05720651-46 2020-11-16T22:14:46.273 INFO:tasks.rados.rados.2.smithi057.stdout:3427: finishing write tid 6 to smithi05720651-46 2020-11-16T22:14:46.273 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 2576 (ObjNum 1150 snap 399 seq_num 1150) dirty exists 2020-11-16T22:14:46.273 INFO:tasks.rados.rados.2.smithi057.stdout:3427: left oid 46 (ObjNum 1150 snap 399 seq_num 1150) 2020-11-16T22:14:47.201 INFO:tasks.rados.rados.2.smithi057.stdout:3424: done (4 left) 2020-11-16T22:14:47.201 INFO:tasks.rados.rados.2.smithi057.stdout:3425: done (3 left) 2020-11-16T22:14:47.202 INFO:tasks.rados.rados.2.smithi057.stdout:3426: done (2 left) 2020-11-16T22:14:47.202 INFO:tasks.rados.rados.2.smithi057.stdout:3427: done (1 left) 2020-11-16T22:14:47.202 INFO:tasks.rados.rados.2.smithi057.stdout:3428: done (0 left) 2020-11-16T22:14:47.202 INFO:tasks.rados.rados.2.smithi057.stdout:3429: rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 400 2020-11-16T22:14:47.202 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 385 2020-11-16T22:14:47.202 INFO:tasks.rados.rados.2.smithi057.stdout:3430: copy_from oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 2 current snap is 400 2020-11-16T22:14:47.203 INFO:tasks.rados.rados.2.smithi057.stdout:3431: write (excl) oid 6 current snap is 400 2020-11-16T22:14:47.203 INFO:tasks.rados.rados.2.smithi057.stdout:3431: seq_num 1151 ranges {544857=580902,1670539=668389,3041747=303110} 2020-11-16T22:14:47.212 INFO:tasks.rados.rados.2.smithi057.stdout:3431: writing smithi05720651-6 from 544857 to 1125759 tid 1 2020-11-16T22:14:47.222 INFO:tasks.rados.rados.2.smithi057.stdout:3431: writing smithi05720651-6 from 1670539 to 2338928 tid 2 2020-11-16T22:14:47.228 INFO:tasks.rados.rados.2.smithi057.stdout:3431: writing smithi05720651-6 from 3041747 to 3344857 tid 3 2020-11-16T22:14:47.228 INFO:tasks.rados.rados.2.smithi057.stdout:3432: copy_from oid 12 from oid 4 current snap is 400 2020-11-16T22:14:47.228 INFO:tasks.rados.rados.2.smithi057.stdout:3429: finishing rollback tid 0 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:47.228 INFO:tasks.rados.rados.2.smithi057.stdout:3433: read oid 20 snap 383 2020-11-16T22:14:47.228 INFO:tasks.rados.rados.2.smithi057.stdout:3433: expect (ObjNum 1061 snap 373 seq_num 1061) 2020-11-16T22:14:47.229 INFO:tasks.rados.rados.2.smithi057.stdout:3434: delete oid 48 current snap is 400 2020-11-16T22:14:47.229 INFO:tasks.rados.rados.2.smithi057.stdout:3429: finishing rollback tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:47.229 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2201 (ObjNum 1869573999 snap 28527 seq_num 336) dirty dne 2020-11-16T22:14:47.229 INFO:tasks.rados.rados.2.smithi057.stdout:3431: finishing write tid 1 to smithi05720651-6 2020-11-16T22:14:47.232 INFO:tasks.rados.rados.2.smithi057.stdout:3432: finishing copy_from to smithi05720651-12 2020-11-16T22:14:47.232 INFO:tasks.rados.rados.2.smithi057.stdout:3432: got expected ENOENT (src dne) 2020-11-16T22:14:47.233 INFO:tasks.rados.rados.2.smithi057.stdout:3432: finishing copy_from racing read to smithi05720651-12 2020-11-16T22:14:47.234 INFO:tasks.rados.rados.2.smithi057.stdout:3430: finishing copy_from to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:47.234 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2847 (ObjNum 1143 snap 397 seq_num 1143) dirty exists 2020-11-16T22:14:47.234 INFO:tasks.rados.rados.2.smithi057.stdout:3430: finishing copy_from racing read to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:47.234 INFO:tasks.rados.rados.2.smithi057.stdout:3433: expect (ObjNum 1061 snap 373 seq_num 1061) 2020-11-16T22:14:47.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:47 smithi057 bash[10301]: cluster 2020-11-16T22:14:45.841491+0000 mgr.x (mgr.24115) 664 : cluster [DBG] pgmap v1450: 17 pgs: 17 active+clean; 369 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 3.1 MiB/s wr, 4 op/s 2020-11-16T22:14:47.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:47 smithi057 bash[10301]: cluster 2020-11-16T22:14:46.190036+0000 mon.a (mon.0) 1533 : cluster [DBG] osdmap e857: 12 total, 12 up, 12 in 2020-11-16T22:14:47.508 INFO:tasks.rados.rados.2.smithi057.stdout:3431: finishing write tid 2 to smithi05720651-6 2020-11-16T22:14:47.508 INFO:tasks.rados.rados.2.smithi057.stdout:3431: finishing write tid 3 to smithi05720651-6 2020-11-16T22:14:47.508 INFO:tasks.rados.rados.2.smithi057.stdout:3431: finishing write tid 5 to smithi05720651-6 2020-11-16T22:14:47.508 INFO:tasks.rados.rados.2.smithi057.stdout:3431: finishing write tid 6 to smithi05720651-6 2020-11-16T22:14:47.509 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 2673 (ObjNum 1151 snap 400 seq_num 1151) dirty exists 2020-11-16T22:14:47.509 INFO:tasks.rados.rados.2.smithi057.stdout:3431: left oid 6 (ObjNum 1151 snap 400 seq_num 1151) 2020-11-16T22:14:47.509 INFO:tasks.rados.rados.2.smithi057.stdout:3429: done (5 left) 2020-11-16T22:14:47.509 INFO:tasks.rados.rados.2.smithi057.stdout:3430: done (4 left) 2020-11-16T22:14:47.509 INFO:tasks.rados.rados.2.smithi057.stdout:3431: done (3 left) 2020-11-16T22:14:47.509 INFO:tasks.rados.rados.2.smithi057.stdout:3432: done (2 left) 2020-11-16T22:14:47.509 INFO:tasks.rados.rados.2.smithi057.stdout:3433: done (1 left) 2020-11-16T22:14:47.510 INFO:tasks.rados.rados.2.smithi057.stdout:3434: done (0 left) 2020-11-16T22:14:47.510 INFO:tasks.rados.rados.2.smithi057.stdout:3435: rollback oid 40 current snap is 400 2020-11-16T22:14:47.510 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 40 to 383 2020-11-16T22:14:47.510 INFO:tasks.rados.rados.2.smithi057.stdout:3436: snap_create 2020-11-16T22:14:47.518 INFO:tasks.rados.rados.2.smithi057.stdout:3435: finishing rollback tid 0 to smithi05720651-40 2020-11-16T22:14:47.518 INFO:tasks.rados.rados.2.smithi057.stdout:3435: finishing rollback tid 1 to smithi05720651-40 2020-11-16T22:14:47.519 INFO:tasks.rados.rados.2.smithi057.stdout:3435: finishing rollback tid 2 to smithi05720651-40 2020-11-16T22:14:47.519 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 2872 (ObjNum 1098 snap 381 seq_num 1098) dirty exists 2020-11-16T22:14:47.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:47 smithi016 bash[10302]: cluster 2020-11-16T22:14:45.841491+0000 mgr.x (mgr.24115) 664 : cluster [DBG] pgmap v1450: 17 pgs: 17 active+clean; 369 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 3.1 MiB/s wr, 4 op/s 2020-11-16T22:14:47.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:47 smithi016 bash[10302]: cluster 2020-11-16T22:14:46.190036+0000 mon.a (mon.0) 1533 : cluster [DBG] osdmap e857: 12 total, 12 up, 12 in 2020-11-16T22:14:47.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:47 smithi195 bash[10218]: cluster 2020-11-16T22:14:45.841491+0000 mgr.x (mgr.24115) 664 : cluster [DBG] pgmap v1450: 17 pgs: 17 active+clean; 369 MiB data, 1012 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 3.1 MiB/s wr, 4 op/s 2020-11-16T22:14:47.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:47 smithi195 bash[10218]: cluster 2020-11-16T22:14:46.190036+0000 mon.a (mon.0) 1533 : cluster [DBG] osdmap e857: 12 total, 12 up, 12 in 2020-11-16T22:14:48.212 INFO:tasks.rados.rados.2.smithi057.stdout:3435: done (1 left) 2020-11-16T22:14:48.212 INFO:tasks.rados.rados.2.smithi057.stdout:3436: done (0 left) 2020-11-16T22:14:48.212 INFO:tasks.rados.rados.2.smithi057.stdout:3437: read oid 18 snap -1 2020-11-16T22:14:48.212 INFO:tasks.rados.rados.2.smithi057.stdout:3437: expect (ObjNum 1055 snap 371 seq_num 1055) 2020-11-16T22:14:48.213 INFO:tasks.rados.rados.2.smithi057.stdout:3438: delete oid 32 current snap is 401 2020-11-16T22:14:48.226 INFO:tasks.rados.rados.2.smithi057.stdout:3438: done (1 left) 2020-11-16T22:14:48.227 INFO:tasks.rados.rados.2.smithi057.stdout:3439: copy_from oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 34 current snap is 401 2020-11-16T22:14:48.227 INFO:tasks.rados.rados.2.smithi057.stdout:3440: snap_remove snap 387 2020-11-16T22:14:48.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:48 smithi016 bash[10302]: cluster 2020-11-16T22:14:47.212140+0000 mon.a (mon.0) 1534 : cluster [DBG] osdmap e858: 12 total, 12 up, 12 in 2020-11-16T22:14:48.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:48 smithi195 bash[10218]: cluster 2020-11-16T22:14:47.212140+0000 mon.a (mon.0) 1534 : cluster [DBG] osdmap e858: 12 total, 12 up, 12 in 2020-11-16T22:14:48.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:48 smithi057 bash[10301]: cluster 2020-11-16T22:14:47.212140+0000 mon.a (mon.0) 1534 : cluster [DBG] osdmap e858: 12 total, 12 up, 12 in 2020-11-16T22:14:49.223 INFO:tasks.rados.rados.2.smithi057.stdout:3440: done (2 left) 2020-11-16T22:14:49.224 INFO:tasks.rados.rados.2.smithi057.stdout:3441: read oid 22 snap -1 2020-11-16T22:14:49.224 INFO:tasks.rados.rados.2.smithi057.stdout:3441: expect (ObjNum 1027 snap 361 seq_num 1027) 2020-11-16T22:14:49.224 INFO:tasks.rados.rados.2.smithi057.stdout:3442: copy_from oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 30 current snap is 401 2020-11-16T22:14:49.224 INFO:tasks.rados.rados.2.smithi057.stdout:3437: expect (ObjNum 1055 snap 371 seq_num 1055) 2020-11-16T22:14:49.344 INFO:tasks.rados.rados.2.smithi057.stdout:3439: finishing copy_from to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:49.344 INFO:tasks.rados.rados.2.smithi057.stdout:3439: got expected ENOENT (src dne) 2020-11-16T22:14:49.344 INFO:tasks.rados.rados.2.smithi057.stdout:3439: finishing copy_from racing read to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:49.345 INFO:tasks.rados.rados.2.smithi057.stdout:3441: expect (ObjNum 1027 snap 361 seq_num 1027) 2020-11-16T22:14:49.535 INFO:tasks.rados.rados.2.smithi057.stdout:3442: finishing copy_from to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:49.536 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2521 (ObjNum 1074 snap 377 seq_num 1074) dirty exists 2020-11-16T22:14:49.536 INFO:tasks.rados.rados.2.smithi057.stdout:3442: finishing copy_from racing read to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:49.536 INFO:tasks.rados.rados.2.smithi057.stdout:3437: done (3 left) 2020-11-16T22:14:49.536 INFO:tasks.rados.rados.2.smithi057.stdout:3439: done (2 left) 2020-11-16T22:14:49.536 INFO:tasks.rados.rados.2.smithi057.stdout:3441: done (1 left) 2020-11-16T22:14:49.536 INFO:tasks.rados.rados.2.smithi057.stdout:3442: done (0 left) 2020-11-16T22:14:49.537 INFO:tasks.rados.rados.2.smithi057.stdout:3443: delete oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 401 2020-11-16T22:14:49.542 INFO:tasks.rados.rados.2.smithi057.stdout:3443: done (0 left) 2020-11-16T22:14:49.542 INFO:tasks.rados.rados.2.smithi057.stdout:3444: write oid 14 current snap is 401 2020-11-16T22:14:49.542 INFO:tasks.rados.rados.2.smithi057.stdout:3444: seq_num 1155 ranges {612085=481898,1788114=675727,3035086=376999} 2020-11-16T22:14:49.559 INFO:tasks.rados.rados.2.smithi057.stdout:3444: writing smithi05720651-14 from 612085 to 1093983 tid 1 2020-11-16T22:14:49.566 INFO:tasks.rados.rados.2.smithi057.stdout:3444: writing smithi05720651-14 from 1788114 to 2463841 tid 2 2020-11-16T22:14:49.572 INFO:tasks.rados.rados.2.smithi057.stdout:3444: writing smithi05720651-14 from 3035086 to 3412085 tid 3 2020-11-16T22:14:49.572 INFO:tasks.rados.rados.2.smithi057.stdout:3445: copy_from oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 401 2020-11-16T22:14:49.572 INFO:tasks.rados.rados.2.smithi057.stdout:3444: finishing write tid 1 to smithi05720651-14 2020-11-16T22:14:49.573 INFO:tasks.rados.rados.2.smithi057.stdout:3446: rollback oid 38 current snap is 401 2020-11-16T22:14:49.573 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 38 to 372 2020-11-16T22:14:49.573 INFO:tasks.rados.rados.2.smithi057.stdout:3447: snap_remove snap 393 2020-11-16T22:14:49.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:49 smithi016 bash[10302]: cluster 2020-11-16T22:14:47.842229+0000 mgr.x (mgr.24115) 665 : cluster [DBG] pgmap v1453: 17 pgs: 17 active+clean; 375 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 4.2 MiB/s wr, 9 op/s 2020-11-16T22:14:49.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:49 smithi016 bash[10302]: cluster 2020-11-16T22:14:48.223178+0000 mon.a (mon.0) 1535 : cluster [DBG] osdmap e859: 12 total, 12 up, 12 in 2020-11-16T22:14:49.599 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:49 smithi195 bash[10218]: cluster 2020-11-16T22:14:47.842229+0000 mgr.x (mgr.24115) 665 : cluster [DBG] pgmap v1453: 17 pgs: 17 active+clean; 375 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 4.2 MiB/s wr, 9 op/s 2020-11-16T22:14:49.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:49 smithi195 bash[10218]: cluster 2020-11-16T22:14:48.223178+0000 mon.a (mon.0) 1535 : cluster [DBG] osdmap e859: 12 total, 12 up, 12 in 2020-11-16T22:14:49.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:49 smithi057 bash[10301]: cluster 2020-11-16T22:14:47.842229+0000 mgr.x (mgr.24115) 665 : cluster [DBG] pgmap v1453: 17 pgs: 17 active+clean; 375 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 4.2 MiB/s wr, 9 op/s 2020-11-16T22:14:49.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:49 smithi057 bash[10301]: cluster 2020-11-16T22:14:48.223178+0000 mon.a (mon.0) 1535 : cluster [DBG] osdmap e859: 12 total, 12 up, 12 in 2020-11-16T22:14:50.179 INFO:tasks.rados.rados.2.smithi057.stdout:3447: done (3 left) 2020-11-16T22:14:50.179 INFO:tasks.rados.rados.2.smithi057.stdout:3448: copy_from oid 18 from oid 4 current snap is 401 2020-11-16T22:14:50.179 INFO:tasks.rados.rados.2.smithi057.stdout:3444: finishing write tid 2 to smithi05720651-14 2020-11-16T22:14:50.179 INFO:tasks.rados.rados.2.smithi057.stdout:3444: finishing write tid 3 to smithi05720651-14 2020-11-16T22:14:50.179 INFO:tasks.rados.rados.2.smithi057.stdout:3444: finishing write tid 5 to smithi05720651-14 2020-11-16T22:14:50.180 INFO:tasks.rados.rados.2.smithi057.stdout:3444: finishing write tid 6 to smithi05720651-14 2020-11-16T22:14:50.180 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 2891 (ObjNum 1155 snap 401 seq_num 1155) dirty exists 2020-11-16T22:14:50.180 INFO:tasks.rados.rados.2.smithi057.stdout:3444: left oid 14 (ObjNum 1155 snap 401 seq_num 1155) 2020-11-16T22:14:50.180 INFO:tasks.rados.rados.2.smithi057.stdout:3445: finishing copy_from to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:50.180 INFO:tasks.rados.rados.2.smithi057.stdout:3445: got expected ENOENT (src dne) 2020-11-16T22:14:50.180 INFO:tasks.rados.rados.2.smithi057.stdout:3445: finishing copy_from racing read to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:50.180 INFO:tasks.rados.rados.2.smithi057.stdout:3446: finishing rollback tid 0 to smithi05720651-38 2020-11-16T22:14:50.181 INFO:tasks.rados.rados.2.smithi057.stdout:3446: finishing rollback tid 1 to smithi05720651-38 2020-11-16T22:14:50.181 INFO:tasks.rados.rados.2.smithi057.stdout:3446: finishing rollback tid 2 to smithi05720651-38 2020-11-16T22:14:50.181 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 2404 (ObjNum 941 snap 324 seq_num 941) dirty exists 2020-11-16T22:14:50.181 INFO:tasks.rados.rados.2.smithi057.stdout:3444: done (3 left) 2020-11-16T22:14:50.181 INFO:tasks.rados.rados.2.smithi057.stdout:3445: done (2 left) 2020-11-16T22:14:50.181 INFO:tasks.rados.rados.2.smithi057.stdout:3446: done (1 left) 2020-11-16T22:14:50.181 INFO:tasks.rados.rados.2.smithi057.stdout:3449: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 386 2020-11-16T22:14:50.182 INFO:tasks.rados.rados.2.smithi057.stdout:3449: expect (ObjNum 1085 snap 377 seq_num 1085) 2020-11-16T22:14:50.182 INFO:tasks.rados.rados.2.smithi057.stdout:3450: read oid 14 snap -1 2020-11-16T22:14:50.182 INFO:tasks.rados.rados.2.smithi057.stdout:3450: expect (ObjNum 1155 snap 401 seq_num 1155) 2020-11-16T22:14:50.182 INFO:tasks.rados.rados.2.smithi057.stdout:3451: delete oid 8 current snap is 401 2020-11-16T22:14:50.187 INFO:tasks.rados.rados.2.smithi057.stdout:3451: done (3 left) 2020-11-16T22:14:50.188 INFO:tasks.rados.rados.2.smithi057.stdout:3452: delete oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 401 2020-11-16T22:14:50.190 INFO:tasks.rados.rados.2.smithi057.stdout:3449: expect (ObjNum 1085 snap 377 seq_num 1085) 2020-11-16T22:14:50.345 INFO:tasks.rados.rados.2.smithi057.stdout:3450: expect (ObjNum 1155 snap 401 seq_num 1155) 2020-11-16T22:14:50.537 INFO:tasks.rados.rados.2.smithi057.stdout:3448: finishing copy_from to smithi05720651-18 2020-11-16T22:14:50.537 INFO:tasks.rados.rados.2.smithi057.stdout:3448: got expected ENOENT (src dne) 2020-11-16T22:14:50.538 INFO:tasks.rados.rados.2.smithi057.stdout:3448: finishing copy_from racing read to smithi05720651-18 2020-11-16T22:14:50.538 INFO:tasks.rados.rados.2.smithi057.stdout:3448: done (3 left) 2020-11-16T22:14:50.538 INFO:tasks.rados.rados.2.smithi057.stdout:3449: done (2 left) 2020-11-16T22:14:50.538 INFO:tasks.rados.rados.2.smithi057.stdout:3450: done (1 left) 2020-11-16T22:14:50.538 INFO:tasks.rados.rados.2.smithi057.stdout:3452: done (0 left) 2020-11-16T22:14:50.538 INFO:tasks.rados.rados.2.smithi057.stdout:3453: write (excl) oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 401 2020-11-16T22:14:50.539 INFO:tasks.rados.rados.2.smithi057.stdout:3453: seq_num 1158 ranges {662506=423998,1563560=539407,2717355=490285} 2020-11-16T22:14:50.552 INFO:tasks.rados.rados.2.smithi057.stdout:3453: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 662506 to 1086504 tid 1 2020-11-16T22:14:50.558 INFO:tasks.rados.rados.2.smithi057.stdout:3453: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1563560 to 2102967 tid 2 2020-11-16T22:14:50.564 INFO:tasks.rados.rados.2.smithi057.stdout:3453: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2717355 to 3207640 tid 3 2020-11-16T22:14:50.564 INFO:tasks.rados.rados.2.smithi057.stdout:3454: rollback oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 401 2020-11-16T22:14:50.565 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 394 2020-11-16T22:14:50.565 INFO:tasks.rados.rados.2.smithi057.stdout:3453: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:50.565 INFO:tasks.rados.rados.2.smithi057.stdout:3453: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:50.565 INFO:tasks.rados.rados.2.smithi057.stdout:3455: write oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 401 2020-11-16T22:14:50.565 INFO:tasks.rados.rados.2.smithi057.stdout:3455: seq_num 1159 ranges {679313=499247,1622042=683065,2744778=701557} 2020-11-16T22:14:50.571 INFO:tasks.rados.rados.2.smithi057.stdout:3455: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 679313 to 1178560 tid 1 2020-11-16T22:14:50.577 INFO:tasks.rados.rados.2.smithi057.stdout:3455: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1622042 to 2305107 tid 2 2020-11-16T22:14:50.584 INFO:tasks.rados.rados.2.smithi057.stdout:3455: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2744778 to 3446335 tid 3 2020-11-16T22:14:50.584 INFO:tasks.rados.rados.2.smithi057.stdout:3456: snap_create 2020-11-16T22:14:50.584 INFO:tasks.rados.rados.2.smithi057.stdout:3454: finishing rollback tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:50.584 INFO:tasks.rados.rados.2.smithi057.stdout:3454: finishing rollback tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:50.584 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2247 (ObjNum 1068 snap 375 seq_num 1068) dirty exists 2020-11-16T22:14:50.585 INFO:tasks.rados.rados.2.smithi057.stdout:3453: finishing write tid 3 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:50.585 INFO:tasks.rados.rados.2.smithi057.stdout:3453: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:50.585 INFO:tasks.rados.rados.2.smithi057.stdout:3453: finishing write tid 6 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:50.585 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2234 (ObjNum 1158 snap 401 seq_num 1158) dirty exists 2020-11-16T22:14:50.585 INFO:tasks.rados.rados.2.smithi057.stdout:3453: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1158 snap 401 seq_num 1158) 2020-11-16T22:14:50.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:50 smithi016 bash[10302]: cluster 2020-11-16T22:14:49.234422+0000 mon.a (mon.0) 1536 : cluster [DBG] osdmap e860: 12 total, 12 up, 12 in 2020-11-16T22:14:50.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:50 smithi016 bash[10302]: cluster 2020-11-16T22:14:50.189357+0000 mon.a (mon.0) 1537 : cluster [DBG] osdmap e861: 12 total, 12 up, 12 in 2020-11-16T22:14:50.591 INFO:tasks.rados.rados.2.smithi057.stdout:3455: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:50.593 INFO:tasks.rados.rados.2.smithi057.stdout:3455: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:50.594 INFO:tasks.rados.rados.2.smithi057.stdout:3455: finishing write tid 3 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:50.595 INFO:tasks.rados.rados.2.smithi057.stdout:3455: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:50.596 INFO:tasks.rados.rados.2.smithi057.stdout:3455: finishing write tid 6 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:50.596 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2677 (ObjNum 1159 snap 401 seq_num 1159) dirty exists 2020-11-16T22:14:50.596 INFO:tasks.rados.rados.2.smithi057.stdout:3455: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1159 snap 401 seq_num 1159) 2020-11-16T22:14:50.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:50 smithi195 bash[10218]: cluster 2020-11-16T22:14:49.234422+0000 mon.a (mon.0) 1536 : cluster [DBG] osdmap e860: 12 total, 12 up, 12 in 2020-11-16T22:14:50.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:50 smithi195 bash[10218]: cluster 2020-11-16T22:14:50.189357+0000 mon.a (mon.0) 1537 : cluster [DBG] osdmap e861: 12 total, 12 up, 12 in 2020-11-16T22:14:50.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:50 smithi057 bash[10301]: cluster 2020-11-16T22:14:49.234422+0000 mon.a (mon.0) 1536 : cluster [DBG] osdmap e860: 12 total, 12 up, 12 in 2020-11-16T22:14:50.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:50 smithi057 bash[10301]: cluster 2020-11-16T22:14:50.189357+0000 mon.a (mon.0) 1537 : cluster [DBG] osdmap e861: 12 total, 12 up, 12 in 2020-11-16T22:14:51.239 INFO:tasks.rados.rados.2.smithi057.stdout:3453: done (3 left) 2020-11-16T22:14:51.240 INFO:tasks.rados.rados.2.smithi057.stdout:3454: done (2 left) 2020-11-16T22:14:51.240 INFO:tasks.rados.rados.2.smithi057.stdout:3455: done (1 left) 2020-11-16T22:14:51.240 INFO:tasks.rados.rados.2.smithi057.stdout:3456: done (0 left) 2020-11-16T22:14:51.240 INFO:tasks.rados.rados.2.smithi057.stdout:3457: write (excl) oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 402 2020-11-16T22:14:51.240 INFO:tasks.rados.rados.2.smithi057.stdout:3457: seq_num 1160 ranges {696120=574496,1680524=543076,2888554=512829} 2020-11-16T22:14:51.254 INFO:tasks.rados.rados.2.smithi057.stdout:3457: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 696120 to 1270616 tid 1 2020-11-16T22:14:51.259 INFO:tasks.rados.rados.2.smithi057.stdout:3457: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1680524 to 2223600 tid 2 2020-11-16T22:14:51.266 INFO:tasks.rados.rados.2.smithi057.stdout:3457: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2888554 to 3401383 tid 3 2020-11-16T22:14:51.266 INFO:tasks.rados.rados.2.smithi057.stdout:3458: delete oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 402 2020-11-16T22:14:51.266 INFO:tasks.rados.rados.2.smithi057.stdout:3457: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:51.275 INFO:tasks.rados.rados.2.smithi057.stdout:3458: done (1 left) 2020-11-16T22:14:51.275 INFO:tasks.rados.rados.2.smithi057.stdout:3459: write (excl) oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 402 2020-11-16T22:14:51.275 INFO:tasks.rados.rados.2.smithi057.stdout:3459: seq_num 1162 ranges {729734=724994,2197488=430392,3227047=302687} 2020-11-16T22:14:51.287 INFO:tasks.rados.rados.2.smithi057.stdout:3459: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 729734 to 1454728 tid 1 2020-11-16T22:14:51.293 INFO:tasks.rados.rados.2.smithi057.stdout:3459: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2197488 to 2627880 tid 2 2020-11-16T22:14:51.299 INFO:tasks.rados.rados.2.smithi057.stdout:3459: writing smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3227047 to 3529734 tid 3 2020-11-16T22:14:51.299 INFO:tasks.rados.rados.2.smithi057.stdout:3460: read oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:51.299 INFO:tasks.rados.rados.2.smithi057.stdout:3460: expect (ObjNum 1137 snap 394 seq_num 1137) 2020-11-16T22:14:51.299 INFO:tasks.rados.rados.2.smithi057.stdout:3461: read oid 28 snap 366 2020-11-16T22:14:51.300 INFO:tasks.rados.rados.2.smithi057.stdout:3461: expect (ObjNum 1043 snap 366 seq_num 1043) 2020-11-16T22:14:51.300 INFO:tasks.rados.rados.2.smithi057.stdout:3462: write (excl) oid 14 current snap is 402 2020-11-16T22:14:51.300 INFO:tasks.rados.rados.2.smithi057.stdout:3462: seq_num 1163 ranges {746541=400243,1739617=690403,3138117=408424} 2020-11-16T22:14:51.306 INFO:tasks.rados.rados.2.smithi057.stdout:3462: writing smithi05720651-14 from 746541 to 1146784 tid 1 2020-11-16T22:14:51.313 INFO:tasks.rados.rados.2.smithi057.stdout:3462: writing smithi05720651-14 from 1739617 to 2430020 tid 2 2020-11-16T22:14:51.319 INFO:tasks.rados.rados.2.smithi057.stdout:3462: writing smithi05720651-14 from 3138117 to 3546541 tid 3 2020-11-16T22:14:51.320 INFO:tasks.rados.rados.2.smithi057.stdout:3463: write (excl) oid 16 current snap is 402 2020-11-16T22:14:51.320 INFO:tasks.rados.rados.2.smithi057.stdout:3463: seq_num 1164 ranges {763348=591845,1914452=434061,2881893=674270} 2020-11-16T22:14:51.327 INFO:tasks.rados.rados.2.smithi057.stdout:3463: writing smithi05720651-16 from 763348 to 1355193 tid 1 2020-11-16T22:14:51.333 INFO:tasks.rados.rados.2.smithi057.stdout:3463: writing smithi05720651-16 from 1914452 to 2348513 tid 2 2020-11-16T22:14:51.340 INFO:tasks.rados.rados.2.smithi057.stdout:3463: writing smithi05720651-16 from 2881893 to 3556163 tid 3 2020-11-16T22:14:51.340 INFO:tasks.rados.rados.2.smithi057.stdout:3464: write (excl) oid 10 current snap is 402 2020-11-16T22:14:51.340 INFO:tasks.rados.rados.2.smithi057.stdout:3464: seq_num 1165 ranges {780155=667094,1972934=694072,3309316=270839} 2020-11-16T22:14:51.349 INFO:tasks.rados.rados.2.smithi057.stdout:3464: writing smithi05720651-10 from 780155 to 1447249 tid 1 2020-11-16T22:14:51.356 INFO:tasks.rados.rados.2.smithi057.stdout:3464: writing smithi05720651-10 from 1972934 to 2667006 tid 2 2020-11-16T22:14:51.361 INFO:tasks.rados.rados.2.smithi057.stdout:3464: writing smithi05720651-10 from 3309316 to 3580155 tid 3 2020-11-16T22:14:51.361 INFO:tasks.rados.rados.2.smithi057.stdout:3465: write oid 6 current snap is 402 2020-11-16T22:14:51.361 INFO:tasks.rados.rados.2.smithi057.stdout:3465: seq_num 1166 ranges {796962=742343,2031416=437730,2936739=413167} 2020-11-16T22:14:51.369 INFO:tasks.rados.rados.2.smithi057.stdout:3465: writing smithi05720651-6 from 796962 to 1539305 tid 1 2020-11-16T22:14:51.375 INFO:tasks.rados.rados.2.smithi057.stdout:3465: writing smithi05720651-6 from 2031416 to 2469146 tid 2 2020-11-16T22:14:51.380 INFO:tasks.rados.rados.2.smithi057.stdout:3465: writing smithi05720651-6 from 2936739 to 3349906 tid 3 2020-11-16T22:14:51.381 INFO:tasks.rados.rados.2.smithi057.stdout:3466: snap_create 2020-11-16T22:14:51.381 INFO:tasks.rados.rados.2.smithi057.stdout:3457: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:51.381 INFO:tasks.rados.rados.2.smithi057.stdout:3457: finishing write tid 3 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:51.381 INFO:tasks.rados.rados.2.smithi057.stdout:3457: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:51.381 INFO:tasks.rados.rados.2.smithi057.stdout:3457: finishing write tid 6 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:51.381 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2681 (ObjNum 1160 snap 402 seq_num 1160) dirty exists 2020-11-16T22:14:51.382 INFO:tasks.rados.rados.2.smithi057.stdout:3457: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1160 snap 402 seq_num 1160) 2020-11-16T22:14:51.382 INFO:tasks.rados.rados.2.smithi057.stdout:3459: finishing write tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:51.382 INFO:tasks.rados.rados.2.smithi057.stdout:3459: finishing write tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:51.382 INFO:tasks.rados.rados.2.smithi057.stdout:3459: finishing write tid 3 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:51.382 INFO:tasks.rados.rados.2.smithi057.stdout:3459: finishing write tid 5 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:51.382 INFO:tasks.rados.rados.2.smithi057.stdout:3459: finishing write tid 6 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:51.382 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2408 (ObjNum 1162 snap 402 seq_num 1162) dirty exists 2020-11-16T22:14:51.383 INFO:tasks.rados.rados.2.smithi057.stdout:3459: left oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1162 snap 402 seq_num 1162) 2020-11-16T22:14:51.383 INFO:tasks.rados.rados.2.smithi057.stdout:3461: expect (ObjNum 1043 snap 366 seq_num 1043) 2020-11-16T22:14:51.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:51 smithi016 bash[10302]: cluster 2020-11-16T22:14:49.842938+0000 mgr.x (mgr.24115) 666 : cluster [DBG] pgmap v1456: 17 pgs: 17 active+clean; 380 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 2.3 MiB/s wr, 14 op/s 2020-11-16T22:14:51.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:51 smithi195 bash[10218]: cluster 2020-11-16T22:14:49.842938+0000 mgr.x (mgr.24115) 666 : cluster [DBG] pgmap v1456: 17 pgs: 17 active+clean; 380 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 2.3 MiB/s wr, 14 op/s 2020-11-16T22:14:51.675 INFO:tasks.rados.rados.2.smithi057.stdout:3460: expect (ObjNum 1137 snap 394 seq_num 1137) 2020-11-16T22:14:51.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:51 smithi057 bash[10301]: cluster 2020-11-16T22:14:49.842938+0000 mgr.x (mgr.24115) 666 : cluster [DBG] pgmap v1456: 17 pgs: 17 active+clean; 380 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 2.3 MiB/s wr, 14 op/s 2020-11-16T22:14:51.770 INFO:tasks.rados.rados.2.smithi057.stdout:3462: finishing write tid 1 to smithi05720651-14 2020-11-16T22:14:51.770 INFO:tasks.rados.rados.2.smithi057.stdout:3462: finishing write tid 2 to smithi05720651-14 2020-11-16T22:14:51.770 INFO:tasks.rados.rados.2.smithi057.stdout:3462: finishing write tid 3 to smithi05720651-14 2020-11-16T22:14:51.770 INFO:tasks.rados.rados.2.smithi057.stdout:3462: finishing write tid 5 to smithi05720651-14 2020-11-16T22:14:51.770 INFO:tasks.rados.rados.2.smithi057.stdout:3462: finishing write tid 6 to smithi05720651-14 2020-11-16T22:14:51.770 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 2902 (ObjNum 1163 snap 402 seq_num 1163) dirty exists 2020-11-16T22:14:51.771 INFO:tasks.rados.rados.2.smithi057.stdout:3462: left oid 14 (ObjNum 1163 snap 402 seq_num 1163) 2020-11-16T22:14:51.771 INFO:tasks.rados.rados.2.smithi057.stdout:3463: finishing write tid 1 to smithi05720651-16 2020-11-16T22:14:51.771 INFO:tasks.rados.rados.2.smithi057.stdout:3463: finishing write tid 2 to smithi05720651-16 2020-11-16T22:14:51.771 INFO:tasks.rados.rados.2.smithi057.stdout:3463: finishing write tid 3 to smithi05720651-16 2020-11-16T22:14:51.771 INFO:tasks.rados.rados.2.smithi057.stdout:3463: finishing write tid 5 to smithi05720651-16 2020-11-16T22:14:51.771 INFO:tasks.rados.rados.2.smithi057.stdout:3463: finishing write tid 6 to smithi05720651-16 2020-11-16T22:14:51.771 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 2581 (ObjNum 1164 snap 402 seq_num 1164) dirty exists 2020-11-16T22:14:51.772 INFO:tasks.rados.rados.2.smithi057.stdout:3463: left oid 16 (ObjNum 1164 snap 402 seq_num 1164) 2020-11-16T22:14:51.772 INFO:tasks.rados.rados.2.smithi057.stdout:3464: finishing write tid 1 to smithi05720651-10 2020-11-16T22:14:51.772 INFO:tasks.rados.rados.2.smithi057.stdout:3464: finishing write tid 2 to smithi05720651-10 2020-11-16T22:14:51.772 INFO:tasks.rados.rados.2.smithi057.stdout:3464: finishing write tid 3 to smithi05720651-10 2020-11-16T22:14:51.772 INFO:tasks.rados.rados.2.smithi057.stdout:3464: finishing write tid 5 to smithi05720651-10 2020-11-16T22:14:51.772 INFO:tasks.rados.rados.2.smithi057.stdout:3464: finishing write tid 6 to smithi05720651-10 2020-11-16T22:14:51.772 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 2251 (ObjNum 1165 snap 402 seq_num 1165) dirty exists 2020-11-16T22:14:51.773 INFO:tasks.rados.rados.2.smithi057.stdout:3464: left oid 10 (ObjNum 1165 snap 402 seq_num 1165) 2020-11-16T22:14:51.773 INFO:tasks.rados.rados.2.smithi057.stdout:3465: finishing write tid 1 to smithi05720651-6 2020-11-16T22:14:51.773 INFO:tasks.rados.rados.2.smithi057.stdout:3465: finishing write tid 2 to smithi05720651-6 2020-11-16T22:14:51.773 INFO:tasks.rados.rados.2.smithi057.stdout:3465: finishing write tid 3 to smithi05720651-6 2020-11-16T22:14:51.773 INFO:tasks.rados.rados.2.smithi057.stdout:3465: finishing write tid 5 to smithi05720651-6 2020-11-16T22:14:51.773 INFO:tasks.rados.rados.2.smithi057.stdout:3465: finishing write tid 6 to smithi05720651-6 2020-11-16T22:14:51.773 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 2685 (ObjNum 1166 snap 402 seq_num 1166) dirty exists 2020-11-16T22:14:51.773 INFO:tasks.rados.rados.2.smithi057.stdout:3465: left oid 6 (ObjNum 1166 snap 402 seq_num 1166) 2020-11-16T22:14:52.250 INFO:tasks.rados.rados.2.smithi057.stdout:3457: done (8 left) 2020-11-16T22:14:52.251 INFO:tasks.rados.rados.2.smithi057.stdout:3459: done (7 left) 2020-11-16T22:14:52.251 INFO:tasks.rados.rados.2.smithi057.stdout:3460: done (6 left) 2020-11-16T22:14:52.251 INFO:tasks.rados.rados.2.smithi057.stdout:3461: done (5 left) 2020-11-16T22:14:52.251 INFO:tasks.rados.rados.2.smithi057.stdout:3462: done (4 left) 2020-11-16T22:14:52.251 INFO:tasks.rados.rados.2.smithi057.stdout:3463: done (3 left) 2020-11-16T22:14:52.251 INFO:tasks.rados.rados.2.smithi057.stdout:3464: done (2 left) 2020-11-16T22:14:52.252 INFO:tasks.rados.rados.2.smithi057.stdout:3465: done (1 left) 2020-11-16T22:14:52.252 INFO:tasks.rados.rados.2.smithi057.stdout:3466: done (0 left) 2020-11-16T22:14:52.252 INFO:tasks.rados.rados.2.smithi057.stdout:3467: read oid 42 snap -1 2020-11-16T22:14:52.252 INFO:tasks.rados.rados.2.smithi057.stdout:3467: expect (ObjNum 1108 snap 382 seq_num 1108) 2020-11-16T22:14:52.252 INFO:tasks.rados.rados.2.smithi057.stdout:3468: copy_from oid 30 from oid 32 current snap is 403 2020-11-16T22:14:52.252 INFO:tasks.rados.rados.2.smithi057.stdout:3469: delete oid 10 current snap is 403 2020-11-16T22:14:52.260 INFO:tasks.rados.rados.2.smithi057.stdout:3468: finishing copy_from to smithi05720651-30 2020-11-16T22:14:52.260 INFO:tasks.rados.rados.2.smithi057.stdout:3468: got expected ENOENT (src dne) 2020-11-16T22:14:52.260 INFO:tasks.rados.rados.2.smithi057.stdout:3468: finishing copy_from racing read to smithi05720651-30 2020-11-16T22:14:52.261 INFO:tasks.rados.rados.2.smithi057.stdout:3468: done (2 left) 2020-11-16T22:14:52.261 INFO:tasks.rados.rados.2.smithi057.stdout:3469: done (1 left) 2020-11-16T22:14:52.261 INFO:tasks.rados.rados.2.smithi057.stdout:3470: read oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:52.261 INFO:tasks.rados.rados.2.smithi057.stdout:3470: expect (ObjNum 1025 snap 360 seq_num 1025) 2020-11-16T22:14:52.261 INFO:tasks.rados.rados.2.smithi057.stdout:3471: rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 403 2020-11-16T22:14:52.262 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 368 2020-11-16T22:14:52.262 INFO:tasks.rados.rados.2.smithi057.stdout:3472: read oid 32 snap 396 2020-11-16T22:14:52.262 INFO:tasks.rados.rados.2.smithi057.stdout:3472: expect (ObjNum 1068 snap 375 seq_num 1068) 2020-11-16T22:14:52.262 INFO:tasks.rados.rados.2.smithi057.stdout:3473: read oid 22 snap -1 2020-11-16T22:14:52.262 INFO:tasks.rados.rados.2.smithi057.stdout:3473: expect (ObjNum 1027 snap 361 seq_num 1027) 2020-11-16T22:14:52.262 INFO:tasks.rados.rados.2.smithi057.stdout:3474: snap_create 2020-11-16T22:14:52.263 INFO:tasks.rados.rados.2.smithi057.stdout:3467: expect (ObjNum 1108 snap 382 seq_num 1108) 2020-11-16T22:14:52.457 INFO:tasks.rados.rados.2.smithi057.stdout:3471: finishing rollback tid 0 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:52.458 INFO:tasks.rados.rados.2.smithi057.stdout:3473: expect (ObjNum 1027 snap 361 seq_num 1027) 2020-11-16T22:14:52.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:52 smithi016 bash[10302]: cluster 2020-11-16T22:14:51.250809+0000 mon.a (mon.0) 1538 : cluster [DBG] osdmap e862: 12 total, 12 up, 12 in 2020-11-16T22:14:52.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:52 smithi195 bash[10218]: cluster 2020-11-16T22:14:51.250809+0000 mon.a (mon.0) 1538 : cluster [DBG] osdmap e862: 12 total, 12 up, 12 in 2020-11-16T22:14:52.645 INFO:tasks.rados.rados.2.smithi057.stdout:3470: expect (ObjNum 1025 snap 360 seq_num 1025) 2020-11-16T22:14:52.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:52 smithi057 bash[10301]: cluster 2020-11-16T22:14:51.250809+0000 mon.a (mon.0) 1538 : cluster [DBG] osdmap e862: 12 total, 12 up, 12 in 2020-11-16T22:14:52.805 INFO:tasks.rados.rados.2.smithi057.stdout:3472: expect (ObjNum 1068 snap 375 seq_num 1068) 2020-11-16T22:14:53.139 INFO:tasks.rados.rados.2.smithi057.stdout:3471: finishing rollback tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:53.139 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2583 (ObjNum 177 snap 0 seq_num 0) dirty dne 2020-11-16T22:14:53.266 INFO:tasks.rados.rados.2.smithi057.stdout:3467: done (5 left) 2020-11-16T22:14:53.266 INFO:tasks.rados.rados.2.smithi057.stdout:3470: done (4 left) 2020-11-16T22:14:53.266 INFO:tasks.rados.rados.2.smithi057.stdout:3471: done (3 left) 2020-11-16T22:14:53.266 INFO:tasks.rados.rados.2.smithi057.stdout:3472: done (2 left) 2020-11-16T22:14:53.266 INFO:tasks.rados.rados.2.smithi057.stdout:3473: done (1 left) 2020-11-16T22:14:53.267 INFO:tasks.rados.rados.2.smithi057.stdout:3474: done (0 left) 2020-11-16T22:14:53.267 INFO:tasks.rados.rados.2.smithi057.stdout:3475: write (excl) oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 404 2020-11-16T22:14:53.267 INFO:tasks.rados.rados.2.smithi057.stdout:3475: seq_num 1168 ranges {430576=492841,1632027=441399,2475232=435711,3365397=265179} 2020-11-16T22:14:53.279 INFO:tasks.rados.rados.2.smithi057.stdout:3475: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 430576 to 923417 tid 1 2020-11-16T22:14:53.286 INFO:tasks.rados.rados.2.smithi057.stdout:3475: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1632027 to 2073426 tid 2 2020-11-16T22:14:53.290 INFO:tasks.rados.rados.2.smithi057.stdout:3475: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2475232 to 2910943 tid 3 2020-11-16T22:14:53.295 INFO:tasks.rados.rados.2.smithi057.stdout:3475: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3365397 to 3630576 tid 4 2020-11-16T22:14:53.295 INFO:tasks.rados.rados.2.smithi057.stdout:3476: snap_remove snap 363 2020-11-16T22:14:53.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:53 smithi016 bash[10302]: cluster 2020-11-16T22:14:51.843743+0000 mgr.x (mgr.24115) 667 : cluster [DBG] pgmap v1459: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 392 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.4 MiB/s wr, 30 op/s 2020-11-16T22:14:53.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:53 smithi016 bash[10302]: cluster 2020-11-16T22:14:52.261352+0000 mon.a (mon.0) 1539 : cluster [DBG] osdmap e863: 12 total, 12 up, 12 in 2020-11-16T22:14:53.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:53 smithi195 bash[10218]: cluster 2020-11-16T22:14:51.843743+0000 mgr.x (mgr.24115) 667 : cluster [DBG] pgmap v1459: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 392 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.4 MiB/s wr, 30 op/s 2020-11-16T22:14:53.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:53 smithi195 bash[10218]: cluster 2020-11-16T22:14:52.261352+0000 mon.a (mon.0) 1539 : cluster [DBG] osdmap e863: 12 total, 12 up, 12 in 2020-11-16T22:14:53.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:53 smithi057 bash[10301]: cluster 2020-11-16T22:14:51.843743+0000 mgr.x (mgr.24115) 667 : cluster [DBG] pgmap v1459: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 392 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.4 MiB/s wr, 30 op/s 2020-11-16T22:14:53.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:53 smithi057 bash[10301]: cluster 2020-11-16T22:14:52.261352+0000 mon.a (mon.0) 1539 : cluster [DBG] osdmap e863: 12 total, 12 up, 12 in 2020-11-16T22:14:54.276 INFO:tasks.rados.rados.2.smithi057.stdout:3476: done (1 left) 2020-11-16T22:14:54.277 INFO:tasks.rados.rados.2.smithi057.stdout:3477: delete oid 4 current snap is 404 2020-11-16T22:14:54.277 INFO:tasks.rados.rados.2.smithi057.stdout:3475: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:54.277 INFO:tasks.rados.rados.2.smithi057.stdout:3475: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:54.277 INFO:tasks.rados.rados.2.smithi057.stdout:3475: finishing write tid 3 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:54.277 INFO:tasks.rados.rados.2.smithi057.stdout:3475: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:54.277 INFO:tasks.rados.rados.2.smithi057.stdout:3475: finishing write tid 6 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:54.278 INFO:tasks.rados.rados.2.smithi057.stdout:3475: finishing write tid 7 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:54.278 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2715 (ObjNum 1168 snap 404 seq_num 1168) dirty exists 2020-11-16T22:14:54.278 INFO:tasks.rados.rados.2.smithi057.stdout:3475: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1168 snap 404 seq_num 1168) 2020-11-16T22:14:54.287 INFO:tasks.rados.rados.2.smithi057.stdout:3475: done (1 left) 2020-11-16T22:14:54.287 INFO:tasks.rados.rados.2.smithi057.stdout:3477: done (0 left) 2020-11-16T22:14:54.287 INFO:tasks.rados.rados.2.smithi057.stdout:3478: delete oid 10 current snap is 404 2020-11-16T22:14:54.294 INFO:tasks.rados.rados.2.smithi057.stdout:3478: done (0 left) 2020-11-16T22:14:54.294 INFO:tasks.rados.rados.2.smithi057.stdout:3479: snap_remove snap 385 2020-11-16T22:14:54.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:54 smithi016 bash[10302]: cluster 2020-11-16T22:14:53.276833+0000 mon.a (mon.0) 1540 : cluster [DBG] osdmap e864: 12 total, 12 up, 12 in 2020-11-16T22:14:54.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:54 smithi195 bash[10218]: cluster 2020-11-16T22:14:53.276833+0000 mon.a (mon.0) 1540 : cluster [DBG] osdmap e864: 12 total, 12 up, 12 in 2020-11-16T22:14:54.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:54 smithi057 bash[10301]: cluster 2020-11-16T22:14:53.276833+0000 mon.a (mon.0) 1540 : cluster [DBG] osdmap e864: 12 total, 12 up, 12 in 2020-11-16T22:14:55.181 INFO:tasks.rados.rados.2.smithi057.stdout:3479: done (0 left) 2020-11-16T22:14:55.181 INFO:tasks.rados.rados.2.smithi057.stdout:3480: snap_create 2020-11-16T22:14:55.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:55 smithi016 bash[10302]: cluster 2020-11-16T22:14:53.844420+0000 mgr.x (mgr.24115) 668 : cluster [DBG] pgmap v1462: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 392 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 20 op/s 2020-11-16T22:14:55.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:55 smithi016 bash[10302]: cluster 2020-11-16T22:14:54.287114+0000 mon.a (mon.0) 1541 : cluster [DBG] osdmap e865: 12 total, 12 up, 12 in 2020-11-16T22:14:55.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:55 smithi016 bash[10302]: cluster 2020-11-16T22:14:55.191916+0000 mon.a (mon.0) 1542 : cluster [DBG] osdmap e866: 12 total, 12 up, 12 in 2020-11-16T22:14:55.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:55 smithi195 bash[10218]: cluster 2020-11-16T22:14:53.844420+0000 mgr.x (mgr.24115) 668 : cluster [DBG] pgmap v1462: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 392 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 20 op/s 2020-11-16T22:14:55.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:55 smithi195 bash[10218]: cluster 2020-11-16T22:14:54.287114+0000 mon.a (mon.0) 1541 : cluster [DBG] osdmap e865: 12 total, 12 up, 12 in 2020-11-16T22:14:55.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:55 smithi195 bash[10218]: cluster 2020-11-16T22:14:55.191916+0000 mon.a (mon.0) 1542 : cluster [DBG] osdmap e866: 12 total, 12 up, 12 in 2020-11-16T22:14:55.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:55 smithi057 bash[10301]: cluster 2020-11-16T22:14:53.844420+0000 mgr.x (mgr.24115) 668 : cluster [DBG] pgmap v1462: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 392 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.3 MiB/s wr, 20 op/s 2020-11-16T22:14:55.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:55 smithi057 bash[10301]: cluster 2020-11-16T22:14:54.287114+0000 mon.a (mon.0) 1541 : cluster [DBG] osdmap e865: 12 total, 12 up, 12 in 2020-11-16T22:14:55.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:55 smithi057 bash[10301]: cluster 2020-11-16T22:14:55.191916+0000 mon.a (mon.0) 1542 : cluster [DBG] osdmap e866: 12 total, 12 up, 12 in 2020-11-16T22:14:56.182 INFO:tasks.rados.rados.2.smithi057.stdout:3480: done (0 left) 2020-11-16T22:14:56.182 INFO:tasks.rados.rados.2.smithi057.stdout:3481: read oid 48 snap -1 2020-11-16T22:14:56.183 INFO:tasks.rados.rados.2.smithi057.stdout:3481: expect deleted 2020-11-16T22:14:56.183 INFO:tasks.rados.rados.2.smithi057.stdout:3482: copy_from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 36 current snap is 405 2020-11-16T22:14:56.183 INFO:tasks.rados.rados.2.smithi057.stdout:3483: snap_create 2020-11-16T22:14:56.190 INFO:tasks.rados.rados.2.smithi057.stdout:3482: finishing copy_from to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:56.190 INFO:tasks.rados.rados.2.smithi057.stdout:3482: got expected ENOENT (src dne) 2020-11-16T22:14:56.190 INFO:tasks.rados.rados.2.smithi057.stdout:3482: finishing copy_from racing read to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:57.186 INFO:tasks.rados.rados.2.smithi057.stdout:3481: done (2 left) 2020-11-16T22:14:57.187 INFO:tasks.rados.rados.2.smithi057.stdout:3482: done (1 left) 2020-11-16T22:14:57.187 INFO:tasks.rados.rados.2.smithi057.stdout:3483: done (0 left) 2020-11-16T22:14:57.187 INFO:tasks.rados.rados.2.smithi057.stdout:3484: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 381 2020-11-16T22:14:57.187 INFO:tasks.rados.rados.2.smithi057.stdout:3484: expect (ObjNum 1102 snap 381 seq_num 1102) 2020-11-16T22:14:57.187 INFO:tasks.rados.rados.2.smithi057.stdout:3485: rollback oid 16 current snap is 406 2020-11-16T22:14:57.187 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 16 to 341 2020-11-16T22:14:57.187 INFO:tasks.rados.rados.2.smithi057.stdout:3486: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:57.188 INFO:tasks.rados.rados.2.smithi057.stdout:3486: expect deleted 2020-11-16T22:14:57.188 INFO:tasks.rados.rados.2.smithi057.stdout:3487: rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 406 2020-11-16T22:14:57.188 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 386 2020-11-16T22:14:57.188 INFO:tasks.rados.rados.2.smithi057.stdout:3488: rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 406 2020-11-16T22:14:57.188 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 386 2020-11-16T22:14:57.188 INFO:tasks.rados.rados.2.smithi057.stdout:3489: write (excl) oid 26 current snap is 406 2020-11-16T22:14:57.188 INFO:tasks.rados.rados.2.smithi057.stdout:3489: seq_num 1171 ranges {480997=434941,1407473=705079,2557501=785880} 2020-11-16T22:14:57.197 INFO:tasks.rados.rados.2.smithi057.stdout:3489: writing smithi05720651-26 from 480997 to 915938 tid 1 2020-11-16T22:14:57.205 INFO:tasks.rados.rados.2.smithi057.stdout:3489: writing smithi05720651-26 from 1407473 to 2112552 tid 2 2020-11-16T22:14:57.212 INFO:tasks.rados.rados.2.smithi057.stdout:3489: writing smithi05720651-26 from 2557501 to 3343381 tid 3 2020-11-16T22:14:57.213 INFO:tasks.rados.rados.2.smithi057.stdout:3490: write (excl) oid 18 current snap is 406 2020-11-16T22:14:57.213 INFO:tasks.rados.rados.2.smithi057.stdout:3490: seq_num 1172 ranges {497804=510190,1465955=448737,2584924=597152} 2020-11-16T22:14:57.218 INFO:tasks.rados.rados.2.smithi057.stdout:3490: writing smithi05720651-18 from 497804 to 1007994 tid 1 2020-11-16T22:14:57.223 INFO:tasks.rados.rados.2.smithi057.stdout:3490: writing smithi05720651-18 from 1465955 to 1914692 tid 2 2020-11-16T22:14:57.230 INFO:tasks.rados.rados.2.smithi057.stdout:3490: writing smithi05720651-18 from 2584924 to 3182076 tid 3 2020-11-16T22:14:57.231 INFO:tasks.rados.rados.2.smithi057.stdout:3491: write (excl) oid 42 current snap is 406 2020-11-16T22:14:57.231 INFO:tasks.rados.rados.2.smithi057.stdout:3491: seq_num 1173 ranges {514611=585439,1524437=592395,2895994=408424} 2020-11-16T22:14:57.237 INFO:tasks.rados.rados.2.smithi057.stdout:3491: writing smithi05720651-42 from 514611 to 1100050 tid 1 2020-11-16T22:14:57.243 INFO:tasks.rados.rados.2.smithi057.stdout:3491: writing smithi05720651-42 from 1524437 to 2116832 tid 2 2020-11-16T22:14:57.249 INFO:tasks.rados.rados.2.smithi057.stdout:3491: writing smithi05720651-42 from 2895994 to 3304418 tid 3 2020-11-16T22:14:57.250 INFO:tasks.rados.rados.2.smithi057.stdout:3492: copy_from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 20 current snap is 406 2020-11-16T22:14:57.250 INFO:tasks.rados.rados.2.smithi057.stdout:3487: finishing rollback tid 0 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:57.250 INFO:tasks.rados.rados.2.smithi057.stdout:3487: finishing rollback tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:57.250 INFO:tasks.rados.rados.2.smithi057.stdout:3487: finishing rollback tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:57.250 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2688 (ObjNum 1048 snap 367 seq_num 1048) dirty exists 2020-11-16T22:14:57.250 INFO:tasks.rados.rados.2.smithi057.stdout:3485: finishing rollback tid 0 to smithi05720651-16 2020-11-16T22:14:57.250 INFO:tasks.rados.rados.2.smithi057.stdout:3486: done (8 left) 2020-11-16T22:14:57.251 INFO:tasks.rados.rados.2.smithi057.stdout:3487: done (7 left) 2020-11-16T22:14:57.251 INFO:tasks.rados.rados.2.smithi057.stdout:3493: read oid 12 snap 381 2020-11-16T22:14:57.251 INFO:tasks.rados.rados.2.smithi057.stdout:3493: expect (ObjNum 1074 snap 377 seq_num 1074) 2020-11-16T22:14:57.251 INFO:tasks.rados.rados.2.smithi057.stdout:3494: snap_create 2020-11-16T22:14:57.251 INFO:tasks.rados.rados.2.smithi057.stdout:3484: expect (ObjNum 1102 snap 381 seq_num 1102) 2020-11-16T22:14:57.382 INFO:tasks.rados.rados.2.smithi057.stdout:3488: finishing rollback tid 0 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:57.383 INFO:tasks.rados.rados.2.smithi057.stdout:3488: finishing rollback tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:57.383 INFO:tasks.rados.rados.2.smithi057.stdout:3488: finishing rollback tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:57.383 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2928 (ObjNum 1079 snap 377 seq_num 1079) dirty exists 2020-11-16T22:14:57.383 INFO:tasks.rados.rados.2.smithi057.stdout:3485: finishing rollback tid 1 to smithi05720651-16 2020-11-16T22:14:57.383 INFO:tasks.rados.rados.2.smithi057.stdout:3485: finishing rollback tid 2 to smithi05720651-16 2020-11-16T22:14:57.383 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 2586 (ObjNum 878 snap 296 seq_num 878) dirty exists 2020-11-16T22:14:57.384 INFO:tasks.rados.rados.2.smithi057.stdout:3489: finishing write tid 1 to smithi05720651-26 2020-11-16T22:14:57.384 INFO:tasks.rados.rados.2.smithi057.stdout:3489: finishing write tid 2 to smithi05720651-26 2020-11-16T22:14:57.384 INFO:tasks.rados.rados.2.smithi057.stdout:3489: finishing write tid 3 to smithi05720651-26 2020-11-16T22:14:57.384 INFO:tasks.rados.rados.2.smithi057.stdout:3489: finishing write tid 5 to smithi05720651-26 2020-11-16T22:14:57.384 INFO:tasks.rados.rados.2.smithi057.stdout:3489: finishing write tid 6 to smithi05720651-26 2020-11-16T22:14:57.384 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 2932 (ObjNum 1171 snap 406 seq_num 1171) dirty exists 2020-11-16T22:14:57.384 INFO:tasks.rados.rados.2.smithi057.stdout:3489: left oid 26 (ObjNum 1171 snap 406 seq_num 1171) 2020-11-16T22:14:57.385 INFO:tasks.rados.rados.2.smithi057.stdout:3490: finishing write tid 1 to smithi05720651-18 2020-11-16T22:14:57.385 INFO:tasks.rados.rados.2.smithi057.stdout:3490: finishing write tid 2 to smithi05720651-18 2020-11-16T22:14:57.385 INFO:tasks.rados.rados.2.smithi057.stdout:3490: finishing write tid 3 to smithi05720651-18 2020-11-16T22:14:57.385 INFO:tasks.rados.rados.2.smithi057.stdout:3490: finishing write tid 5 to smithi05720651-18 2020-11-16T22:14:57.385 INFO:tasks.rados.rados.2.smithi057.stdout:3490: finishing write tid 6 to smithi05720651-18 2020-11-16T22:14:57.385 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 2719 (ObjNum 1172 snap 406 seq_num 1172) dirty exists 2020-11-16T22:14:57.385 INFO:tasks.rados.rados.2.smithi057.stdout:3490: left oid 18 (ObjNum 1172 snap 406 seq_num 1172) 2020-11-16T22:14:57.385 INFO:tasks.rados.rados.2.smithi057.stdout:3491: finishing write tid 1 to smithi05720651-42 2020-11-16T22:14:57.386 INFO:tasks.rados.rados.2.smithi057.stdout:3491: finishing write tid 2 to smithi05720651-42 2020-11-16T22:14:57.386 INFO:tasks.rados.rados.2.smithi057.stdout:3493: expect (ObjNum 1074 snap 377 seq_num 1074) 2020-11-16T22:14:57.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:57 smithi057 bash[10301]: cluster 2020-11-16T22:14:55.845276+0000 mgr.x (mgr.24115) 669 : cluster [DBG] pgmap v1465: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 410 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 20 op/s 2020-11-16T22:14:57.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:57 smithi057 bash[10301]: cluster 2020-11-16T22:14:56.193280+0000 mon.a (mon.0) 1543 : cluster [DBG] osdmap e867: 12 total, 12 up, 12 in 2020-11-16T22:14:57.474 INFO:tasks.rados.rados.2.smithi057.stdout:3491: finishing write tid 3 to smithi05720651-42 2020-11-16T22:14:57.475 INFO:tasks.rados.rados.2.smithi057.stdout:3491: finishing write tid 5 to smithi05720651-42 2020-11-16T22:14:57.475 INFO:tasks.rados.rados.2.smithi057.stdout:3491: finishing write tid 6 to smithi05720651-42 2020-11-16T22:14:57.475 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 2211 (ObjNum 1173 snap 406 seq_num 1173) dirty exists 2020-11-16T22:14:57.475 INFO:tasks.rados.rados.2.smithi057.stdout:3491: left oid 42 (ObjNum 1173 snap 406 seq_num 1173) 2020-11-16T22:14:57.476 INFO:tasks.rados.rados.2.smithi057.stdout:3492: finishing copy_from to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:57.476 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2208 (ObjNum 1148 snap 399 seq_num 1148) dirty exists 2020-11-16T22:14:57.476 INFO:tasks.rados.rados.2.smithi057.stdout:3492: finishing copy_from racing read to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:57.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:57 smithi016 bash[10302]: cluster 2020-11-16T22:14:55.845276+0000 mgr.x (mgr.24115) 669 : cluster [DBG] pgmap v1465: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 410 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 20 op/s 2020-11-16T22:14:57.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:57 smithi016 bash[10302]: cluster 2020-11-16T22:14:56.193280+0000 mon.a (mon.0) 1543 : cluster [DBG] osdmap e867: 12 total, 12 up, 12 in 2020-11-16T22:14:57.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:57 smithi195 bash[10218]: cluster 2020-11-16T22:14:55.845276+0000 mgr.x (mgr.24115) 669 : cluster [DBG] pgmap v1465: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 410 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 20 op/s 2020-11-16T22:14:57.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:57 smithi195 bash[10218]: cluster 2020-11-16T22:14:56.193280+0000 mon.a (mon.0) 1543 : cluster [DBG] osdmap e867: 12 total, 12 up, 12 in 2020-11-16T22:14:58.205 INFO:tasks.rados.rados.2.smithi057.stdout:3484: done (8 left) 2020-11-16T22:14:58.205 INFO:tasks.rados.rados.2.smithi057.stdout:3485: done (7 left) 2020-11-16T22:14:58.205 INFO:tasks.rados.rados.2.smithi057.stdout:3488: done (6 left) 2020-11-16T22:14:58.205 INFO:tasks.rados.rados.2.smithi057.stdout:3489: done (5 left) 2020-11-16T22:14:58.205 INFO:tasks.rados.rados.2.smithi057.stdout:3490: done (4 left) 2020-11-16T22:14:58.206 INFO:tasks.rados.rados.2.smithi057.stdout:3491: done (3 left) 2020-11-16T22:14:58.206 INFO:tasks.rados.rados.2.smithi057.stdout:3492: done (2 left) 2020-11-16T22:14:58.206 INFO:tasks.rados.rados.2.smithi057.stdout:3493: done (1 left) 2020-11-16T22:14:58.206 INFO:tasks.rados.rados.2.smithi057.stdout:3494: done (0 left) 2020-11-16T22:14:58.206 INFO:tasks.rados.rados.2.smithi057.stdout:3495: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:58.206 INFO:tasks.rados.rados.2.smithi057.stdout:3495: expect (ObjNum 1048 snap 367 seq_num 1048) 2020-11-16T22:14:58.206 INFO:tasks.rados.rados.2.smithi057.stdout:3496: copy_from oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 407 2020-11-16T22:14:58.207 INFO:tasks.rados.rados.2.smithi057.stdout:3497: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 401 2020-11-16T22:14:58.207 INFO:tasks.rados.rados.2.smithi057.stdout:3497: expect deleted 2020-11-16T22:14:58.207 INFO:tasks.rados.rados.2.smithi057.stdout:3498: snap_remove snap 402 2020-11-16T22:14:58.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:58 smithi016 bash[10302]: cluster 2020-11-16T22:14:57.195950+0000 mon.a (mon.0) 1544 : cluster [DBG] osdmap e868: 12 total, 12 up, 12 in 2020-11-16T22:14:58.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:58 smithi195 bash[10218]: cluster 2020-11-16T22:14:57.195950+0000 mon.a (mon.0) 1544 : cluster [DBG] osdmap e868: 12 total, 12 up, 12 in 2020-11-16T22:14:58.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:58 smithi057 bash[10301]: cluster 2020-11-16T22:14:57.195950+0000 mon.a (mon.0) 1544 : cluster [DBG] osdmap e868: 12 total, 12 up, 12 in 2020-11-16T22:14:59.215 INFO:tasks.rados.rados.2.smithi057.stdout:3498: done (3 left) 2020-11-16T22:14:59.216 INFO:tasks.rados.rados.2.smithi057.stdout:3499: delete oid 28 current snap is 407 2020-11-16T22:14:59.216 INFO:tasks.rados.rados.2.smithi057.stdout:3495: expect (ObjNum 1048 snap 367 seq_num 1048) 2020-11-16T22:14:59.496 INFO:tasks.rados.rados.2.smithi057.stdout:3496: finishing copy_from to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:59.497 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2526 (ObjNum 1133 snap 393 seq_num 1133) dirty exists 2020-11-16T22:14:59.497 INFO:tasks.rados.rados.2.smithi057.stdout:3496: finishing copy_from racing read to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:59.497 INFO:tasks.rados.rados.2.smithi057.stdout:3495: done (3 left) 2020-11-16T22:14:59.497 INFO:tasks.rados.rados.2.smithi057.stdout:3496: done (2 left) 2020-11-16T22:14:59.497 INFO:tasks.rados.rados.2.smithi057.stdout:3497: done (1 left) 2020-11-16T22:14:59.497 INFO:tasks.rados.rados.2.smithi057.stdout:3499: done (0 left) 2020-11-16T22:14:59.498 INFO:tasks.rados.rados.2.smithi057.stdout:3500: copy_from oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 407 2020-11-16T22:14:59.498 INFO:tasks.rados.rados.2.smithi057.stdout:3501: write (excl) oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 407 2020-11-16T22:14:59.498 INFO:tasks.rados.rados.2.smithi057.stdout:3501: seq_num 1175 ranges {548225=735937,1925048=596064,2950840=547321} 2020-11-16T22:14:59.513 INFO:tasks.rados.rados.2.smithi057.stdout:3501: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 548225 to 1284162 tid 1 2020-11-16T22:14:59.521 INFO:tasks.rados.rados.2.smithi057.stdout:3501: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1925048 to 2521112 tid 2 2020-11-16T22:14:59.526 INFO:tasks.rados.rados.2.smithi057.stdout:3501: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2950840 to 3498161 tid 3 2020-11-16T22:14:59.527 INFO:tasks.rados.rados.2.smithi057.stdout:3502: delete oid 4 current snap is 407 2020-11-16T22:14:59.527 INFO:tasks.rados.rados.2.smithi057.stdout:3500: finishing copy_from to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:59.527 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2526 (ObjNum 1133 snap 393 seq_num 1133) dirty exists 2020-11-16T22:14:59.527 INFO:tasks.rados.rados.2.smithi057.stdout:3500: finishing copy_from racing read to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:59.529 INFO:tasks.rados.rados.2.smithi057.stdout:3501: finishing write tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:59.532 INFO:tasks.rados.rados.2.smithi057.stdout:3500: done (2 left) 2020-11-16T22:14:59.532 INFO:tasks.rados.rados.2.smithi057.stdout:3502: done (1 left) 2020-11-16T22:14:59.532 INFO:tasks.rados.rados.2.smithi057.stdout:3503: delete oid 14 current snap is 407 2020-11-16T22:14:59.538 INFO:tasks.rados.rados.2.smithi057.stdout:3501: finishing write tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:59.539 INFO:tasks.rados.rados.2.smithi057.stdout:3501: finishing write tid 3 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:59.539 INFO:tasks.rados.rados.2.smithi057.stdout:3501: finishing write tid 5 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:59.539 INFO:tasks.rados.rados.2.smithi057.stdout:3501: finishing write tid 6 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:14:59.540 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2590 (ObjNum 1175 snap 407 seq_num 1175) dirty exists 2020-11-16T22:14:59.540 INFO:tasks.rados.rados.2.smithi057.stdout:3501: left oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1175 snap 407 seq_num 1175) 2020-11-16T22:14:59.544 INFO:tasks.rados.rados.2.smithi057.stdout:3501: done (1 left) 2020-11-16T22:14:59.544 INFO:tasks.rados.rados.2.smithi057.stdout:3503: done (0 left) 2020-11-16T22:14:59.544 INFO:tasks.rados.rados.2.smithi057.stdout:3504: delete oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 407 2020-11-16T22:14:59.548 INFO:tasks.rados.rados.2.smithi057.stdout:3504: done (0 left) 2020-11-16T22:14:59.548 INFO:tasks.rados.rados.2.smithi057.stdout:3505: write oid 16 current snap is 407 2020-11-16T22:14:59.548 INFO:tasks.rados.rados.2.smithi057.stdout:3505: seq_num 1179 ranges {615453=753286,2158976=603402,3460532=354921} 2020-11-16T22:14:59.564 INFO:tasks.rados.rados.2.smithi057.stdout:3505: writing smithi05720651-16 from 615453 to 1368739 tid 1 2020-11-16T22:14:59.572 INFO:tasks.rados.rados.2.smithi057.stdout:3505: writing smithi05720651-16 from 2158976 to 2762378 tid 2 2020-11-16T22:14:59.578 INFO:tasks.rados.rados.2.smithi057.stdout:3505: writing smithi05720651-16 from 3460532 to 3815453 tid 3 2020-11-16T22:14:59.579 INFO:tasks.rados.rados.2.smithi057.stdout:3506: read oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:14:59.579 INFO:tasks.rados.rados.2.smithi057.stdout:3506: expect deleted 2020-11-16T22:14:59.579 INFO:tasks.rados.rados.2.smithi057.stdout:3507: write (excl) oid 30 current snap is 407 2020-11-16T22:14:59.579 INFO:tasks.rados.rados.2.smithi057.stdout:3507: seq_num 1180 ranges {632260=428535,1817458=463413,2687955=520034,3709324=122936} 2020-11-16T22:14:59.584 INFO:tasks.rados.rados.2.smithi057.stdout:3507: writing smithi05720651-30 from 632260 to 1060795 tid 1 2020-11-16T22:14:59.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:59 smithi016 bash[10302]: cluster 2020-11-16T22:14:57.846027+0000 mgr.x (mgr.24115) 670 : cluster [DBG] pgmap v1468: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 411 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 3.1 MiB/s wr, 26 op/s 2020-11-16T22:14:59.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:14:59 smithi016 bash[10302]: cluster 2020-11-16T22:14:58.215319+0000 mon.a (mon.0) 1545 : cluster [DBG] osdmap e869: 12 total, 12 up, 12 in 2020-11-16T22:14:59.591 INFO:tasks.rados.rados.2.smithi057.stdout:3507: writing smithi05720651-30 from 1817458 to 2280871 tid 2 2020-11-16T22:14:59.597 INFO:tasks.rados.rados.2.smithi057.stdout:3507: writing smithi05720651-30 from 2687955 to 3207989 tid 3 2020-11-16T22:14:59.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:59 smithi195 bash[10218]: cluster 2020-11-16T22:14:57.846027+0000 mgr.x (mgr.24115) 670 : cluster [DBG] pgmap v1468: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 411 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 3.1 MiB/s wr, 26 op/s 2020-11-16T22:14:59.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:14:59 smithi195 bash[10218]: cluster 2020-11-16T22:14:58.215319+0000 mon.a (mon.0) 1545 : cluster [DBG] osdmap e869: 12 total, 12 up, 12 in 2020-11-16T22:14:59.601 INFO:tasks.rados.rados.2.smithi057.stdout:3507: writing smithi05720651-30 from 3709324 to 3832260 tid 4 2020-11-16T22:14:59.601 INFO:tasks.rados.rados.2.smithi057.stdout:3508: delete oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 407 2020-11-16T22:14:59.601 INFO:tasks.rados.rados.2.smithi057.stdout:3505: finishing write tid 1 to smithi05720651-16 2020-11-16T22:14:59.601 INFO:tasks.rados.rados.2.smithi057.stdout:3505: finishing write tid 2 to smithi05720651-16 2020-11-16T22:14:59.601 INFO:tasks.rados.rados.2.smithi057.stdout:3505: finishing write tid 3 to smithi05720651-16 2020-11-16T22:14:59.601 INFO:tasks.rados.rados.2.smithi057.stdout:3505: finishing write tid 5 to smithi05720651-16 2020-11-16T22:14:59.602 INFO:tasks.rados.rados.2.smithi057.stdout:3505: finishing write tid 6 to smithi05720651-16 2020-11-16T22:14:59.602 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 2594 (ObjNum 1179 snap 407 seq_num 1179) dirty exists 2020-11-16T22:14:59.602 INFO:tasks.rados.rados.2.smithi057.stdout:3505: left oid 16 (ObjNum 1179 snap 407 seq_num 1179) 2020-11-16T22:14:59.602 INFO:tasks.rados.rados.2.smithi057.stdout:3507: finishing write tid 1 to smithi05720651-30 2020-11-16T22:14:59.602 INFO:tasks.rados.rados.2.smithi057.stdout:3507: finishing write tid 2 to smithi05720651-30 2020-11-16T22:14:59.605 INFO:tasks.rados.rados.2.smithi057.stdout:3507: finishing write tid 3 to smithi05720651-30 2020-11-16T22:14:59.606 INFO:tasks.rados.rados.2.smithi057.stdout:3507: finishing write tid 4 to smithi05720651-30 2020-11-16T22:14:59.609 INFO:tasks.rados.rados.2.smithi057.stdout:3507: finishing write tid 6 to smithi05720651-30 2020-11-16T22:14:59.609 INFO:tasks.rados.rados.2.smithi057.stdout:3507: finishing write tid 7 to smithi05720651-30 2020-11-16T22:14:59.609 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 2599 (ObjNum 1180 snap 407 seq_num 1180) dirty exists 2020-11-16T22:14:59.610 INFO:tasks.rados.rados.2.smithi057.stdout:3507: left oid 30 (ObjNum 1180 snap 407 seq_num 1180) 2020-11-16T22:14:59.610 INFO:tasks.rados.rados.2.smithi057.stdout:3505: done (3 left) 2020-11-16T22:14:59.610 INFO:tasks.rados.rados.2.smithi057.stdout:3506: done (2 left) 2020-11-16T22:14:59.610 INFO:tasks.rados.rados.2.smithi057.stdout:3507: done (1 left) 2020-11-16T22:14:59.610 INFO:tasks.rados.rados.2.smithi057.stdout:3508: done (0 left) 2020-11-16T22:14:59.611 INFO:tasks.rados.rados.2.smithi057.stdout:3509: snap_create 2020-11-16T22:14:59.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:59 smithi057 bash[10301]: cluster 2020-11-16T22:14:57.846027+0000 mgr.x (mgr.24115) 670 : cluster [DBG] pgmap v1468: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 411 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 3.1 MiB/s wr, 26 op/s 2020-11-16T22:14:59.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:14:59 smithi057 bash[10301]: cluster 2020-11-16T22:14:58.215319+0000 mon.a (mon.0) 1545 : cluster [DBG] osdmap e869: 12 total, 12 up, 12 in 2020-11-16T22:15:00.182 INFO:tasks.rados.rados.2.smithi057.stdout:3509: done (0 left) 2020-11-16T22:15:00.183 INFO:tasks.rados.rados.2.smithi057.stdout:3510: write oid 4 current snap is 408 2020-11-16T22:15:00.183 INFO:tasks.rados.rados.2.smithi057.stdout:3510: seq_num 1182 ranges {665874=579033,1934422=467082,3142801=542578} 2020-11-16T22:15:00.197 INFO:tasks.rados.rados.2.smithi057.stdout:3510: writing smithi05720651-4 from 665874 to 1244907 tid 1 2020-11-16T22:15:00.204 INFO:tasks.rados.rados.2.smithi057.stdout:3510: writing smithi05720651-4 from 1934422 to 2401504 tid 2 2020-11-16T22:15:00.211 INFO:tasks.rados.rados.2.smithi057.stdout:3510: writing smithi05720651-4 from 3142801 to 3685379 tid 3 2020-11-16T22:15:00.211 INFO:tasks.rados.rados.2.smithi057.stdout:3511: snap_remove snap 405 2020-11-16T22:15:00.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:00 smithi016 bash[10302]: cluster 2020-11-16T22:14:59.226284+0000 mon.a (mon.0) 1546 : cluster [DBG] osdmap e870: 12 total, 12 up, 12 in 2020-11-16T22:15:00.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:00 smithi016 bash[10302]: cluster 2020-11-16T22:15:00.193498+0000 mon.a (mon.0) 1547 : cluster [DBG] osdmap e871: 12 total, 12 up, 12 in 2020-11-16T22:15:00.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:00 smithi195 bash[10218]: cluster 2020-11-16T22:14:59.226284+0000 mon.a (mon.0) 1546 : cluster [DBG] osdmap e870: 12 total, 12 up, 12 in 2020-11-16T22:15:00.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:00 smithi195 bash[10218]: cluster 2020-11-16T22:15:00.193498+0000 mon.a (mon.0) 1547 : cluster [DBG] osdmap e871: 12 total, 12 up, 12 in 2020-11-16T22:15:00.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:00 smithi057 bash[10301]: cluster 2020-11-16T22:14:59.226284+0000 mon.a (mon.0) 1546 : cluster [DBG] osdmap e870: 12 total, 12 up, 12 in 2020-11-16T22:15:00.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:00 smithi057 bash[10301]: cluster 2020-11-16T22:15:00.193498+0000 mon.a (mon.0) 1547 : cluster [DBG] osdmap e871: 12 total, 12 up, 12 in 2020-11-16T22:15:01.220 INFO:tasks.rados.rados.2.smithi057.stdout:3511: done (1 left) 2020-11-16T22:15:01.220 INFO:tasks.rados.rados.2.smithi057.stdout:3512: delete oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 408 2020-11-16T22:15:01.221 INFO:tasks.rados.rados.2.smithi057.stdout:3510: finishing write tid 1 to smithi05720651-4 2020-11-16T22:15:01.221 INFO:tasks.rados.rados.2.smithi057.stdout:3510: finishing write tid 2 to smithi05720651-4 2020-11-16T22:15:01.221 INFO:tasks.rados.rados.2.smithi057.stdout:3510: finishing write tid 3 to smithi05720651-4 2020-11-16T22:15:01.221 INFO:tasks.rados.rados.2.smithi057.stdout:3510: finishing write tid 5 to smithi05720651-4 2020-11-16T22:15:01.221 INFO:tasks.rados.rados.2.smithi057.stdout:3510: finishing write tid 6 to smithi05720651-4 2020-11-16T22:15:01.221 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 2212 (ObjNum 1182 snap 408 seq_num 1182) dirty exists 2020-11-16T22:15:01.222 INFO:tasks.rados.rados.2.smithi057.stdout:3510: left oid 4 (ObjNum 1182 snap 408 seq_num 1182) 2020-11-16T22:15:01.232 INFO:tasks.rados.rados.2.smithi057.stdout:3510: done (1 left) 2020-11-16T22:15:01.232 INFO:tasks.rados.rados.2.smithi057.stdout:3512: done (0 left) 2020-11-16T22:15:01.232 INFO:tasks.rados.rados.2.smithi057.stdout:3513: write oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 408 2020-11-16T22:15:01.233 INFO:tasks.rados.rados.2.smithi057.stdout:3513: seq_num 1184 ranges {699488=729531,1935033=470751,3081294=681475} 2020-11-16T22:15:01.247 INFO:tasks.rados.rados.2.smithi057.stdout:3513: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 699488 to 1429019 tid 1 2020-11-16T22:15:01.253 INFO:tasks.rados.rados.2.smithi057.stdout:3513: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1935033 to 2405784 tid 2 2020-11-16T22:15:01.261 INFO:tasks.rados.rados.2.smithi057.stdout:3513: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3081294 to 3762769 tid 3 2020-11-16T22:15:01.262 INFO:tasks.rados.rados.2.smithi057.stdout:3514: read oid 32 snap -1 2020-11-16T22:15:01.262 INFO:tasks.rados.rados.2.smithi057.stdout:3514: expect deleted 2020-11-16T22:15:01.262 INFO:tasks.rados.rados.2.smithi057.stdout:3515: copy_from oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 16 current snap is 408 2020-11-16T22:15:01.262 INFO:tasks.rados.rados.2.smithi057.stdout:3513: finishing write tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:01.262 INFO:tasks.rados.rados.2.smithi057.stdout:3516: rollback oid 28 current snap is 408 2020-11-16T22:15:01.262 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 28 to 394 2020-11-16T22:15:01.263 INFO:tasks.rados.rados.2.smithi057.stdout:3513: finishing write tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:01.263 INFO:tasks.rados.rados.2.smithi057.stdout:3517: snap_create 2020-11-16T22:15:01.273 INFO:tasks.rados.rados.2.smithi057.stdout:3513: finishing write tid 3 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:01.274 INFO:tasks.rados.rados.2.smithi057.stdout:3513: finishing write tid 5 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:01.274 INFO:tasks.rados.rados.2.smithi057.stdout:3513: finishing write tid 6 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:01.274 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2604 (ObjNum 1184 snap 408 seq_num 1184) dirty exists 2020-11-16T22:15:01.274 INFO:tasks.rados.rados.2.smithi057.stdout:3513: left oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1184 snap 408 seq_num 1184) 2020-11-16T22:15:01.274 INFO:tasks.rados.rados.2.smithi057.stdout:3516: finishing rollback tid 1 to smithi05720651-28 2020-11-16T22:15:01.276 INFO:tasks.rados.rados.2.smithi057.stdout:3516: finishing rollback tid 2 to smithi05720651-28 2020-11-16T22:15:01.276 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 2528 (ObjNum 1114 snap 387 seq_num 1114) dirty exists 2020-11-16T22:15:01.288 INFO:tasks.rados.rados.2.smithi057.stdout:3515: finishing copy_from to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:01.289 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2594 (ObjNum 1179 snap 407 seq_num 1179) dirty exists 2020-11-16T22:15:01.289 INFO:tasks.rados.rados.2.smithi057.stdout:3515: finishing copy_from racing read to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:01.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:01 smithi016 bash[10302]: cluster 2020-11-16T22:14:59.846684+0000 mgr.x (mgr.24115) 671 : cluster [DBG] pgmap v1471: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 415 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 1.8 MiB/s wr, 9 op/s 2020-11-16T22:15:01.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:01 smithi195 bash[10218]: cluster 2020-11-16T22:14:59.846684+0000 mgr.x (mgr.24115) 671 : cluster [DBG] pgmap v1471: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 415 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 1.8 MiB/s wr, 9 op/s 2020-11-16T22:15:01.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:01 smithi057 bash[10301]: cluster 2020-11-16T22:14:59.846684+0000 mgr.x (mgr.24115) 671 : cluster [DBG] pgmap v1471: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 415 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 1.8 MiB/s wr, 9 op/s 2020-11-16T22:15:02.232 INFO:tasks.rados.rados.2.smithi057.stdout:3513: done (4 left) 2020-11-16T22:15:02.232 INFO:tasks.rados.rados.2.smithi057.stdout:3514: done (3 left) 2020-11-16T22:15:02.232 INFO:tasks.rados.rados.2.smithi057.stdout:3515: done (2 left) 2020-11-16T22:15:02.232 INFO:tasks.rados.rados.2.smithi057.stdout:3516: done (1 left) 2020-11-16T22:15:02.232 INFO:tasks.rados.rados.2.smithi057.stdout:3517: done (0 left) 2020-11-16T22:15:02.232 INFO:tasks.rados.rados.2.smithi057.stdout:3518: write oid 50 current snap is 409 2020-11-16T22:15:02.233 INFO:tasks.rados.rados.2.smithi057.stdout:3518: seq_num 1185 ranges {716295=404780,1593515=614409,2708717=492747,3640519=275776} 2020-11-16T22:15:02.245 INFO:tasks.rados.rados.2.smithi057.stdout:3518: writing smithi05720651-50 from 716295 to 1121075 tid 1 2020-11-16T22:15:02.252 INFO:tasks.rados.rados.2.smithi057.stdout:3518: writing smithi05720651-50 from 1593515 to 2207924 tid 2 2020-11-16T22:15:02.257 INFO:tasks.rados.rados.2.smithi057.stdout:3518: writing smithi05720651-50 from 2708717 to 3201464 tid 3 2020-11-16T22:15:02.262 INFO:tasks.rados.rados.2.smithi057.stdout:3518: writing smithi05720651-50 from 3640519 to 3916295 tid 4 2020-11-16T22:15:02.262 INFO:tasks.rados.rados.2.smithi057.stdout:3519: snap_remove snap 398 2020-11-16T22:15:02.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:02 smithi016 bash[10302]: cluster 2020-11-16T22:15:01.230638+0000 mon.a (mon.0) 1548 : cluster [DBG] osdmap e872: 12 total, 12 up, 12 in 2020-11-16T22:15:02.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:02 smithi195 bash[10218]: cluster 2020-11-16T22:15:01.230638+0000 mon.a (mon.0) 1548 : cluster [DBG] osdmap e872: 12 total, 12 up, 12 in 2020-11-16T22:15:02.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:02 smithi057 bash[10301]: cluster 2020-11-16T22:15:01.230638+0000 mon.a (mon.0) 1548 : cluster [DBG] osdmap e872: 12 total, 12 up, 12 in 2020-11-16T22:15:03.250 INFO:tasks.rados.rados.2.smithi057.stdout:3519: done (1 left) 2020-11-16T22:15:03.251 INFO:tasks.rados.rados.2.smithi057.stdout:3520: delete oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 409 2020-11-16T22:15:03.251 INFO:tasks.rados.rados.2.smithi057.stdout:3518: finishing write tid 1 to smithi05720651-50 2020-11-16T22:15:03.251 INFO:tasks.rados.rados.2.smithi057.stdout:3518: finishing write tid 2 to smithi05720651-50 2020-11-16T22:15:03.251 INFO:tasks.rados.rados.2.smithi057.stdout:3518: finishing write tid 3 to smithi05720651-50 2020-11-16T22:15:03.251 INFO:tasks.rados.rados.2.smithi057.stdout:3518: finishing write tid 4 to smithi05720651-50 2020-11-16T22:15:03.252 INFO:tasks.rados.rados.2.smithi057.stdout:3518: finishing write tid 6 to smithi05720651-50 2020-11-16T22:15:03.252 INFO:tasks.rados.rados.2.smithi057.stdout:3518: finishing write tid 7 to smithi05720651-50 2020-11-16T22:15:03.252 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 2693 (ObjNum 1185 snap 409 seq_num 1185) dirty exists 2020-11-16T22:15:03.252 INFO:tasks.rados.rados.2.smithi057.stdout:3518: left oid 50 (ObjNum 1185 snap 409 seq_num 1185) 2020-11-16T22:15:03.261 INFO:tasks.rados.rados.2.smithi057.stdout:3518: done (1 left) 2020-11-16T22:15:03.261 INFO:tasks.rados.rados.2.smithi057.stdout:3520: done (0 left) 2020-11-16T22:15:03.262 INFO:tasks.rados.rados.2.smithi057.stdout:3521: snap_create 2020-11-16T22:15:03.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:03 smithi016 bash[10302]: cluster 2020-11-16T22:15:01.847347+0000 mgr.x (mgr.24115) 672 : cluster [DBG] pgmap v1474: 17 pgs: 17 active+clean; 438 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 5.6 MiB/s wr, 21 op/s 2020-11-16T22:15:03.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:03 smithi016 bash[10302]: cluster 2020-11-16T22:15:02.242179+0000 mon.a (mon.0) 1549 : cluster [DBG] osdmap e873: 12 total, 12 up, 12 in 2020-11-16T22:15:03.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:03 smithi195 bash[10218]: cluster 2020-11-16T22:15:01.847347+0000 mgr.x (mgr.24115) 672 : cluster [DBG] pgmap v1474: 17 pgs: 17 active+clean; 438 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 5.6 MiB/s wr, 21 op/s 2020-11-16T22:15:03.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:03 smithi195 bash[10218]: cluster 2020-11-16T22:15:02.242179+0000 mon.a (mon.0) 1549 : cluster [DBG] osdmap e873: 12 total, 12 up, 12 in 2020-11-16T22:15:03.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:03 smithi057 bash[10301]: cluster 2020-11-16T22:15:01.847347+0000 mgr.x (mgr.24115) 672 : cluster [DBG] pgmap v1474: 17 pgs: 17 active+clean; 438 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 5.6 MiB/s wr, 21 op/s 2020-11-16T22:15:03.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:03 smithi057 bash[10301]: cluster 2020-11-16T22:15:02.242179+0000 mon.a (mon.0) 1549 : cluster [DBG] osdmap e873: 12 total, 12 up, 12 in 2020-11-16T22:15:04.252 INFO:tasks.rados.rados.2.smithi057.stdout:3521: done (0 left) 2020-11-16T22:15:04.252 INFO:tasks.rados.rados.2.smithi057.stdout:3522: write (excl) oid 16 current snap is 410 2020-11-16T22:15:04.252 INFO:tasks.rados.rados.2.smithi057.stdout:3522: seq_num 1187 ranges {749909=671631,2110479=618078,3163563=515291} 2020-11-16T22:15:04.264 INFO:tasks.rados.rados.2.smithi057.stdout:3522: writing smithi05720651-16 from 749909 to 1421540 tid 1 2020-11-16T22:15:04.273 INFO:tasks.rados.rados.2.smithi057.stdout:3522: writing smithi05720651-16 from 2110479 to 2728557 tid 2 2020-11-16T22:15:04.279 INFO:tasks.rados.rados.2.smithi057.stdout:3522: writing smithi05720651-16 from 3163563 to 3678854 tid 3 2020-11-16T22:15:04.279 INFO:tasks.rados.rados.2.smithi057.stdout:3523: read oid 20 snap 378 2020-11-16T22:15:04.279 INFO:tasks.rados.rados.2.smithi057.stdout:3523: expect (ObjNum 1061 snap 373 seq_num 1061) 2020-11-16T22:15:04.279 INFO:tasks.rados.rados.2.smithi057.stdout:3524: snap_remove snap 368 2020-11-16T22:15:04.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:04 smithi016 bash[10302]: cluster 2020-11-16T22:15:03.260891+0000 mon.a (mon.0) 1550 : cluster [DBG] osdmap e874: 12 total, 12 up, 12 in 2020-11-16T22:15:04.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:04 smithi195 bash[10218]: cluster 2020-11-16T22:15:03.260891+0000 mon.a (mon.0) 1550 : cluster [DBG] osdmap e874: 12 total, 12 up, 12 in 2020-11-16T22:15:04.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:04 smithi057 bash[10301]: cluster 2020-11-16T22:15:03.260891+0000 mon.a (mon.0) 1550 : cluster [DBG] osdmap e874: 12 total, 12 up, 12 in 2020-11-16T22:15:05.183 INFO:tasks.rados.rados.2.smithi057.stdout:3524: done (2 left) 2020-11-16T22:15:05.184 INFO:tasks.rados.rados.2.smithi057.stdout:3525: snap_remove snap 396 2020-11-16T22:15:05.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:05 smithi016 bash[10302]: cluster 2020-11-16T22:15:03.848004+0000 mgr.x (mgr.24115) 673 : cluster [DBG] pgmap v1477: 17 pgs: 17 active+clean; 442 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 4.5 MiB/s wr, 20 op/s 2020-11-16T22:15:05.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:05 smithi016 bash[10302]: cluster 2020-11-16T22:15:04.262281+0000 mon.a (mon.0) 1551 : cluster [DBG] osdmap e875: 12 total, 12 up, 12 in 2020-11-16T22:15:05.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:05 smithi016 bash[10302]: cluster 2020-11-16T22:15:05.194658+0000 mon.a (mon.0) 1552 : cluster [DBG] osdmap e876: 12 total, 12 up, 12 in 2020-11-16T22:15:05.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:05 smithi195 bash[10218]: cluster 2020-11-16T22:15:03.848004+0000 mgr.x (mgr.24115) 673 : cluster [DBG] pgmap v1477: 17 pgs: 17 active+clean; 442 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 4.5 MiB/s wr, 20 op/s 2020-11-16T22:15:05.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:05 smithi195 bash[10218]: cluster 2020-11-16T22:15:04.262281+0000 mon.a (mon.0) 1551 : cluster [DBG] osdmap e875: 12 total, 12 up, 12 in 2020-11-16T22:15:05.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:05 smithi195 bash[10218]: cluster 2020-11-16T22:15:05.194658+0000 mon.a (mon.0) 1552 : cluster [DBG] osdmap e876: 12 total, 12 up, 12 in 2020-11-16T22:15:05.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:05 smithi057 bash[10301]: cluster 2020-11-16T22:15:03.848004+0000 mgr.x (mgr.24115) 673 : cluster [DBG] pgmap v1477: 17 pgs: 17 active+clean; 442 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 4.5 MiB/s wr, 20 op/s 2020-11-16T22:15:05.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:05 smithi057 bash[10301]: cluster 2020-11-16T22:15:04.262281+0000 mon.a (mon.0) 1551 : cluster [DBG] osdmap e875: 12 total, 12 up, 12 in 2020-11-16T22:15:05.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:05 smithi057 bash[10301]: cluster 2020-11-16T22:15:05.194658+0000 mon.a (mon.0) 1552 : cluster [DBG] osdmap e876: 12 total, 12 up, 12 in 2020-11-16T22:15:06.186 INFO:tasks.rados.rados.2.smithi057.stdout:3525: done (2 left) 2020-11-16T22:15:06.187 INFO:tasks.rados.rados.2.smithi057.stdout:3526: copy_from oid 48 from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 410 2020-11-16T22:15:06.187 INFO:tasks.rados.rados.2.smithi057.stdout:3522: finishing write tid 1 to smithi05720651-16 2020-11-16T22:15:06.187 INFO:tasks.rados.rados.2.smithi057.stdout:3522: finishing write tid 2 to smithi05720651-16 2020-11-16T22:15:06.187 INFO:tasks.rados.rados.2.smithi057.stdout:3522: finishing write tid 3 to smithi05720651-16 2020-11-16T22:15:06.187 INFO:tasks.rados.rados.2.smithi057.stdout:3522: finishing write tid 5 to smithi05720651-16 2020-11-16T22:15:06.188 INFO:tasks.rados.rados.2.smithi057.stdout:3522: finishing write tid 6 to smithi05720651-16 2020-11-16T22:15:06.188 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 2608 (ObjNum 1187 snap 410 seq_num 1187) dirty exists 2020-11-16T22:15:06.188 INFO:tasks.rados.rados.2.smithi057.stdout:3522: left oid 16 (ObjNum 1187 snap 410 seq_num 1187) 2020-11-16T22:15:06.188 INFO:tasks.rados.rados.2.smithi057.stdout:3523: expect (ObjNum 1061 snap 373 seq_num 1061) 2020-11-16T22:15:06.469 INFO:tasks.rados.rados.2.smithi057.stdout:3522: done (2 left) 2020-11-16T22:15:06.470 INFO:tasks.rados.rados.2.smithi057.stdout:3523: done (1 left) 2020-11-16T22:15:06.470 INFO:tasks.rados.rados.2.smithi057.stdout:3527: write oid 6 current snap is 410 2020-11-16T22:15:06.470 INFO:tasks.rados.rados.2.smithi057.stdout:3527: seq_num 1188 ranges {766716=746880,2168961=761736,3474633=442916} 2020-11-16T22:15:06.478 INFO:tasks.rados.rados.2.smithi057.stdout:3527: writing smithi05720651-6 from 766716 to 1513596 tid 1 2020-11-16T22:15:06.485 INFO:tasks.rados.rados.2.smithi057.stdout:3527: writing smithi05720651-6 from 2168961 to 2930697 tid 2 2020-11-16T22:15:06.491 INFO:tasks.rados.rados.2.smithi057.stdout:3527: writing smithi05720651-6 from 3474633 to 3917549 tid 3 2020-11-16T22:15:06.492 INFO:tasks.rados.rados.2.smithi057.stdout:3528: copy_from oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 410 2020-11-16T22:15:06.492 INFO:tasks.rados.rados.2.smithi057.stdout:3526: finishing copy_from to smithi05720651-48 2020-11-16T22:15:06.492 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 2247 (ObjNum 1068 snap 375 seq_num 1068) dirty exists 2020-11-16T22:15:06.492 INFO:tasks.rados.rados.2.smithi057.stdout:3526: finishing copy_from racing read to smithi05720651-48 2020-11-16T22:15:06.492 INFO:tasks.rados.rados.2.smithi057.stdout:3526: done (2 left) 2020-11-16T22:15:06.492 INFO:tasks.rados.rados.2.smithi057.stdout:3529: read oid 26 snap 381 2020-11-16T22:15:06.493 INFO:tasks.rados.rados.2.smithi057.stdout:3529: expect deleted 2020-11-16T22:15:06.493 INFO:tasks.rados.rados.2.smithi057.stdout:3530: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:15:06.493 INFO:tasks.rados.rados.2.smithi057.stdout:3530: expect (ObjNum 1079 snap 377 seq_num 1079) 2020-11-16T22:15:06.493 INFO:tasks.rados.rados.2.smithi057.stdout:3531: snap_create 2020-11-16T22:15:06.498 INFO:tasks.rados.rados.2.smithi057.stdout:3527: finishing write tid 1 to smithi05720651-6 2020-11-16T22:15:06.505 INFO:tasks.rados.rados.2.smithi057.stdout:3527: finishing write tid 2 to smithi05720651-6 2020-11-16T22:15:06.505 INFO:tasks.rados.rados.2.smithi057.stdout:3530: expect (ObjNum 1079 snap 377 seq_num 1079) 2020-11-16T22:15:06.628 INFO:tasks.rados.rados.2.smithi057.stdout:3527: finishing write tid 3 to smithi05720651-6 2020-11-16T22:15:06.628 INFO:tasks.rados.rados.2.smithi057.stdout:3527: finishing write tid 5 to smithi05720651-6 2020-11-16T22:15:06.629 INFO:tasks.rados.rados.2.smithi057.stdout:3527: finishing write tid 6 to smithi05720651-6 2020-11-16T22:15:06.629 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 2697 (ObjNum 1188 snap 410 seq_num 1188) dirty exists 2020-11-16T22:15:06.629 INFO:tasks.rados.rados.2.smithi057.stdout:3527: left oid 6 (ObjNum 1188 snap 410 seq_num 1188) 2020-11-16T22:15:06.629 INFO:tasks.rados.rados.2.smithi057.stdout:3528: finishing copy_from to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:06.629 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2408 (ObjNum 1162 snap 402 seq_num 1162) dirty exists 2020-11-16T22:15:07.005 INFO:tasks.rados.rados.2.smithi057.stdout:3528: finishing copy_from racing read to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:07.266 INFO:tasks.rados.rados.2.smithi057.stdout:3527: done (4 left) 2020-11-16T22:15:07.266 INFO:tasks.rados.rados.2.smithi057.stdout:3528: done (3 left) 2020-11-16T22:15:07.266 INFO:tasks.rados.rados.2.smithi057.stdout:3529: done (2 left) 2020-11-16T22:15:07.267 INFO:tasks.rados.rados.2.smithi057.stdout:3530: done (1 left) 2020-11-16T22:15:07.267 INFO:tasks.rados.rados.2.smithi057.stdout:3531: done (0 left) 2020-11-16T22:15:07.267 INFO:tasks.rados.rados.2.smithi057.stdout:3532: snap_create 2020-11-16T22:15:07.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:07 smithi057 bash[10301]: cluster 2020-11-16T22:15:05.848663+0000 mgr.x (mgr.24115) 674 : cluster [DBG] pgmap v1480: 17 pgs: 17 active+clean; 451 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.7 MiB/s wr, 7 op/s 2020-11-16T22:15:07.444 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:07 smithi057 bash[10301]: cluster 2020-11-16T22:15:06.197620+0000 mon.a (mon.0) 1553 : cluster [DBG] osdmap e877: 12 total, 12 up, 12 in 2020-11-16T22:15:07.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:07 smithi016 bash[10302]: cluster 2020-11-16T22:15:05.848663+0000 mgr.x (mgr.24115) 674 : cluster [DBG] pgmap v1480: 17 pgs: 17 active+clean; 451 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.7 MiB/s wr, 7 op/s 2020-11-16T22:15:07.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:07 smithi016 bash[10302]: cluster 2020-11-16T22:15:06.197620+0000 mon.a (mon.0) 1553 : cluster [DBG] osdmap e877: 12 total, 12 up, 12 in 2020-11-16T22:15:07.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:07 smithi195 bash[10218]: cluster 2020-11-16T22:15:05.848663+0000 mgr.x (mgr.24115) 674 : cluster [DBG] pgmap v1480: 17 pgs: 17 active+clean; 451 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.7 MiB/s wr, 7 op/s 2020-11-16T22:15:07.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:07 smithi195 bash[10218]: cluster 2020-11-16T22:15:06.197620+0000 mon.a (mon.0) 1553 : cluster [DBG] osdmap e877: 12 total, 12 up, 12 in 2020-11-16T22:15:08.276 INFO:tasks.rados.rados.2.smithi057.stdout:3532: done (0 left) 2020-11-16T22:15:08.276 INFO:tasks.rados.rados.2.smithi057.stdout:3533: read oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:15:08.276 INFO:tasks.rados.rados.2.smithi057.stdout:3533: expect (ObjNum 1068 snap 375 seq_num 1068) 2020-11-16T22:15:08.276 INFO:tasks.rados.rados.2.smithi057.stdout:3534: read oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:15:08.277 INFO:tasks.rados.rados.2.smithi057.stdout:3534: expect (ObjNum 1162 snap 402 seq_num 1162) 2020-11-16T22:15:08.277 INFO:tasks.rados.rados.2.smithi057.stdout:3535: write (excl) oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 412 2020-11-16T22:15:08.277 INFO:tasks.rados.rados.2.smithi057.stdout:3535: seq_num 1189 ranges {783523=422129,1827443=621747,3218409=654188} 2020-11-16T22:15:08.290 INFO:tasks.rados.rados.2.smithi057.stdout:3535: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 783523 to 1205652 tid 1 2020-11-16T22:15:08.297 INFO:tasks.rados.rados.2.smithi057.stdout:3535: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1827443 to 2449190 tid 2 2020-11-16T22:15:08.305 INFO:tasks.rados.rados.2.smithi057.stdout:3535: writing smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3218409 to 3872597 tid 3 2020-11-16T22:15:08.305 INFO:tasks.rados.rados.2.smithi057.stdout:3536: write oid 20 current snap is 412 2020-11-16T22:15:08.305 INFO:tasks.rados.rados.2.smithi057.stdout:3536: seq_num 1190 ranges {400330=497378,1485925=514405} 2020-11-16T22:15:08.310 INFO:tasks.rados.rados.2.smithi057.stdout:3536: writing smithi05720651-20 from 400330 to 897708 tid 1 2020-11-16T22:15:08.316 INFO:tasks.rados.rados.2.smithi057.stdout:3536: writing smithi05720651-20 from 1485925 to 2000330 tid 2 2020-11-16T22:15:08.317 INFO:tasks.rados.rados.2.smithi057.stdout:3537: write (excl) oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 412 2020-11-16T22:15:08.317 INFO:tasks.rados.rados.2.smithi057.stdout:3537: seq_num 1191 ranges {417137=572627,1428054=589083} 2020-11-16T22:15:08.322 INFO:tasks.rados.rados.2.smithi057.stdout:3537: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 417137 to 989764 tid 1 2020-11-16T22:15:08.328 INFO:tasks.rados.rados.2.smithi057.stdout:3537: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1428054 to 2017137 tid 2 2020-11-16T22:15:08.328 INFO:tasks.rados.rados.2.smithi057.stdout:3538: rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 412 2020-11-16T22:15:08.328 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 372 2020-11-16T22:15:08.328 INFO:tasks.rados.rados.2.smithi057.stdout:3533: expect (ObjNum 1068 snap 375 seq_num 1068) 2020-11-16T22:15:08.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:08 smithi016 bash[10302]: cluster 2020-11-16T22:15:07.277185+0000 mon.a (mon.0) 1554 : cluster [DBG] osdmap e878: 12 total, 12 up, 12 in 2020-11-16T22:15:08.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:08 smithi195 bash[10218]: cluster 2020-11-16T22:15:07.277185+0000 mon.a (mon.0) 1554 : cluster [DBG] osdmap e878: 12 total, 12 up, 12 in 2020-11-16T22:15:08.678 INFO:tasks.rados.rados.2.smithi057.stdout:3534: expect (ObjNum 1162 snap 402 seq_num 1162) 2020-11-16T22:15:08.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:08 smithi057 bash[10301]: cluster 2020-11-16T22:15:07.277185+0000 mon.a (mon.0) 1554 : cluster [DBG] osdmap e878: 12 total, 12 up, 12 in 2020-11-16T22:15:08.830 INFO:tasks.rados.rados.2.smithi057.stdout:3535: finishing write tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:08.830 INFO:tasks.rados.rados.2.smithi057.stdout:3535: finishing write tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:08.830 INFO:tasks.rados.rados.2.smithi057.stdout:3535: finishing write tid 3 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:08.830 INFO:tasks.rados.rados.2.smithi057.stdout:3535: finishing write tid 5 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:08.830 INFO:tasks.rados.rados.2.smithi057.stdout:3535: finishing write tid 6 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:08.831 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2701 (ObjNum 1189 snap 412 seq_num 1189) dirty exists 2020-11-16T22:15:08.831 INFO:tasks.rados.rados.2.smithi057.stdout:3535: left oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1189 snap 412 seq_num 1189) 2020-11-16T22:15:08.831 INFO:tasks.rados.rados.2.smithi057.stdout:3536: finishing write tid 1 to smithi05720651-20 2020-11-16T22:15:08.831 INFO:tasks.rados.rados.2.smithi057.stdout:3536: finishing write tid 2 to smithi05720651-20 2020-11-16T22:15:08.831 INFO:tasks.rados.rados.2.smithi057.stdout:3536: finishing write tid 4 to smithi05720651-20 2020-11-16T22:15:08.831 INFO:tasks.rados.rados.2.smithi057.stdout:3536: finishing write tid 5 to smithi05720651-20 2020-11-16T22:15:08.831 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 2215 (ObjNum 1190 snap 412 seq_num 1190) dirty exists 2020-11-16T22:15:08.832 INFO:tasks.rados.rados.2.smithi057.stdout:3536: left oid 20 (ObjNum 1190 snap 412 seq_num 1190) 2020-11-16T22:15:08.832 INFO:tasks.rados.rados.2.smithi057.stdout:3537: finishing write tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:08.832 INFO:tasks.rados.rados.2.smithi057.stdout:3538: finishing rollback tid 0 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:08.832 INFO:tasks.rados.rados.2.smithi057.stdout:3538: finishing rollback tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:08.832 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2410 (ObjNum 33 snap 0 seq_num 0) dirty dne 2020-11-16T22:15:08.832 INFO:tasks.rados.rados.2.smithi057.stdout:3537: finishing write tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:08.832 INFO:tasks.rados.rados.2.smithi057.stdout:3537: finishing write tid 4 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:08.833 INFO:tasks.rados.rados.2.smithi057.stdout:3537: finishing write tid 5 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:08.833 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2704 (ObjNum 1191 snap 412 seq_num 1191) dirty exists 2020-11-16T22:15:08.833 INFO:tasks.rados.rados.2.smithi057.stdout:3537: left oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1191 snap 412 seq_num 1191) 2020-11-16T22:15:08.833 INFO:tasks.rados.rados.2.smithi057.stdout:3533: done (5 left) 2020-11-16T22:15:08.833 INFO:tasks.rados.rados.2.smithi057.stdout:3534: done (4 left) 2020-11-16T22:15:08.833 INFO:tasks.rados.rados.2.smithi057.stdout:3535: done (3 left) 2020-11-16T22:15:08.833 INFO:tasks.rados.rados.2.smithi057.stdout:3536: done (2 left) 2020-11-16T22:15:08.833 INFO:tasks.rados.rados.2.smithi057.stdout:3537: done (1 left) 2020-11-16T22:15:08.834 INFO:tasks.rados.rados.2.smithi057.stdout:3538: done (0 left) 2020-11-16T22:15:08.834 INFO:tasks.rados.rados.2.smithi057.stdout:3539: copy_from oid 42 from oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 412 2020-11-16T22:15:08.834 INFO:tasks.rados.rados.2.smithi057.stdout:3540: delete oid 6 current snap is 412 2020-11-16T22:15:08.834 INFO:tasks.rados.rados.2.smithi057.stdout:3539: finishing copy_from to smithi05720651-42 2020-11-16T22:15:08.835 INFO:tasks.rados.rados.2.smithi057.stdout:3539: got expected ENOENT (src dne) 2020-11-16T22:15:08.835 INFO:tasks.rados.rados.2.smithi057.stdout:3539: finishing copy_from racing read to smithi05720651-42 2020-11-16T22:15:08.836 INFO:tasks.rados.rados.2.smithi057.stdout:3539: done (1 left) 2020-11-16T22:15:08.836 INFO:tasks.rados.rados.2.smithi057.stdout:3540: done (0 left) 2020-11-16T22:15:08.837 INFO:tasks.rados.rados.2.smithi057.stdout:3541: snap_create 2020-11-16T22:15:09.279 INFO:tasks.rados.rados.2.smithi057.stdout:3541: done (0 left) 2020-11-16T22:15:09.280 INFO:tasks.rados.rados.2.smithi057.stdout:3542: delete oid 26 current snap is 413 2020-11-16T22:15:09.287 INFO:tasks.rados.rados.2.smithi057.stdout:3542: done (0 left) 2020-11-16T22:15:09.287 INFO:tasks.rados.rados.2.smithi057.stdout:3543: copy_from oid 46 from oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 413 2020-11-16T22:15:09.287 INFO:tasks.rados.rados.2.smithi057.stdout:3544: write (excl) oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 413 2020-11-16T22:15:09.287 INFO:tasks.rados.rados.2.smithi057.stdout:3544: seq_num 1194 ranges {467558=514727,1719853=347705} 2020-11-16T22:15:09.296 INFO:tasks.rados.rados.2.smithi057.stdout:3544: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 467558 to 982285 tid 1 2020-11-16T22:15:09.303 INFO:tasks.rados.rados.2.smithi057.stdout:3544: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1719853 to 2067558 tid 2 2020-11-16T22:15:09.304 INFO:tasks.rados.rados.2.smithi057.stdout:3545: write (excl) oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 413 2020-11-16T22:15:09.304 INFO:tasks.rados.rados.2.smithi057.stdout:3545: seq_num 1195 ranges {484365=589976,1661982=422383} 2020-11-16T22:15:09.309 INFO:tasks.rados.rados.2.smithi057.stdout:3545: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 484365 to 1074341 tid 1 2020-11-16T22:15:09.315 INFO:tasks.rados.rados.2.smithi057.stdout:3545: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1661982 to 2084365 tid 2 2020-11-16T22:15:09.316 INFO:tasks.rados.rados.2.smithi057.stdout:3546: copy_from oid 48 from oid 6 current snap is 413 2020-11-16T22:15:09.316 INFO:tasks.rados.rados.2.smithi057.stdout:3543: finishing copy_from to smithi05720651-46 2020-11-16T22:15:09.316 INFO:tasks.rados.rados.2.smithi057.stdout:3543: got expected ENOENT (src dne) 2020-11-16T22:15:09.316 INFO:tasks.rados.rados.2.smithi057.stdout:3547: copy_from oid 8 from oid 40 current snap is 413 2020-11-16T22:15:09.316 INFO:tasks.rados.rados.2.smithi057.stdout:3543: finishing copy_from racing read to smithi05720651-46 2020-11-16T22:15:09.316 INFO:tasks.rados.rados.2.smithi057.stdout:3543: done (4 left) 2020-11-16T22:15:09.316 INFO:tasks.rados.rados.2.smithi057.stdout:3548: delete oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 413 2020-11-16T22:15:09.317 INFO:tasks.rados.rados.2.smithi057.stdout:3544: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:09.317 INFO:tasks.rados.rados.2.smithi057.stdout:3545: finishing write tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:09.323 INFO:tasks.rados.rados.2.smithi057.stdout:3546: finishing copy_from to smithi05720651-48 2020-11-16T22:15:09.323 INFO:tasks.rados.rados.2.smithi057.stdout:3546: got expected ENOENT (src dne) 2020-11-16T22:15:09.323 INFO:tasks.rados.rados.2.smithi057.stdout:3546: finishing copy_from racing read to smithi05720651-48 2020-11-16T22:15:09.323 INFO:tasks.rados.rados.2.smithi057.stdout:3546: done (4 left) 2020-11-16T22:15:09.324 INFO:tasks.rados.rados.2.smithi057.stdout:3548: done (3 left) 2020-11-16T22:15:09.324 INFO:tasks.rados.rados.2.smithi057.stdout:3549: snap_create 2020-11-16T22:15:09.324 INFO:tasks.rados.rados.2.smithi057.stdout:3545: finishing write tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:09.325 INFO:tasks.rados.rados.2.smithi057.stdout:3545: finishing write tid 4 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:09.325 INFO:tasks.rados.rados.2.smithi057.stdout:3545: finishing write tid 5 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:09.325 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2611 (ObjNum 1195 snap 413 seq_num 1195) dirty exists 2020-11-16T22:15:09.325 INFO:tasks.rados.rados.2.smithi057.stdout:3545: left oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1195 snap 413 seq_num 1195) 2020-11-16T22:15:09.331 INFO:tasks.rados.rados.2.smithi057.stdout:3547: finishing copy_from to smithi05720651-8 2020-11-16T22:15:09.332 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 2872 (ObjNum 1098 snap 381 seq_num 1098) dirty exists 2020-11-16T22:15:09.332 INFO:tasks.rados.rados.2.smithi057.stdout:3547: finishing copy_from racing read to smithi05720651-8 2020-11-16T22:15:09.557 INFO:tasks.rados.rados.2.smithi057.stdout:3544: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:09.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:09 smithi016 bash[10302]: cluster 2020-11-16T22:15:07.849468+0000 mgr.x (mgr.24115) 675 : cluster [DBG] pgmap v1483: 17 pgs: 17 active+clean; 455 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.2 MiB/s wr, 10 op/s 2020-11-16T22:15:09.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:09 smithi016 bash[10302]: cluster 2020-11-16T22:15:08.286615+0000 mon.a (mon.0) 1555 : cluster [DBG] osdmap e879: 12 total, 12 up, 12 in 2020-11-16T22:15:09.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:09 smithi195 bash[10218]: cluster 2020-11-16T22:15:07.849468+0000 mgr.x (mgr.24115) 675 : cluster [DBG] pgmap v1483: 17 pgs: 17 active+clean; 455 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.2 MiB/s wr, 10 op/s 2020-11-16T22:15:09.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:09 smithi195 bash[10218]: cluster 2020-11-16T22:15:08.286615+0000 mon.a (mon.0) 1555 : cluster [DBG] osdmap e879: 12 total, 12 up, 12 in 2020-11-16T22:15:09.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:09 smithi057 bash[10301]: cluster 2020-11-16T22:15:07.849468+0000 mgr.x (mgr.24115) 675 : cluster [DBG] pgmap v1483: 17 pgs: 17 active+clean; 455 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.2 MiB/s wr, 10 op/s 2020-11-16T22:15:09.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:09 smithi057 bash[10301]: cluster 2020-11-16T22:15:08.286615+0000 mon.a (mon.0) 1555 : cluster [DBG] osdmap e879: 12 total, 12 up, 12 in 2020-11-16T22:15:09.869 INFO:tasks.rados.rados.2.smithi057.stdout:3544: finishing write tid 4 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:09.869 INFO:tasks.rados.rados.2.smithi057.stdout:3544: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:09.869 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2597 (ObjNum 1194 snap 413 seq_num 1194) dirty exists 2020-11-16T22:15:09.870 INFO:tasks.rados.rados.2.smithi057.stdout:3544: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1194 snap 413 seq_num 1194) 2020-11-16T22:15:10.186 INFO:tasks.rados.rados.2.smithi057.stdout:3544: done (3 left) 2020-11-16T22:15:10.186 INFO:tasks.rados.rados.2.smithi057.stdout:3545: done (2 left) 2020-11-16T22:15:10.186 INFO:tasks.rados.rados.2.smithi057.stdout:3547: done (1 left) 2020-11-16T22:15:10.186 INFO:tasks.rados.rados.2.smithi057.stdout:3549: done (0 left) 2020-11-16T22:15:10.187 INFO:tasks.rados.rados.2.smithi057.stdout:3550: snap_create 2020-11-16T22:15:10.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:10 smithi016 bash[10302]: cluster 2020-11-16T22:15:09.290029+0000 mon.a (mon.0) 1556 : cluster [DBG] osdmap e880: 12 total, 12 up, 12 in 2020-11-16T22:15:10.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:10 smithi016 bash[10302]: cluster 2020-11-16T22:15:10.196983+0000 mon.a (mon.0) 1557 : cluster [DBG] osdmap e881: 12 total, 12 up, 12 in 2020-11-16T22:15:10.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:10 smithi195 bash[10218]: cluster 2020-11-16T22:15:09.290029+0000 mon.a (mon.0) 1556 : cluster [DBG] osdmap e880: 12 total, 12 up, 12 in 2020-11-16T22:15:10.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:10 smithi195 bash[10218]: cluster 2020-11-16T22:15:10.196983+0000 mon.a (mon.0) 1557 : cluster [DBG] osdmap e881: 12 total, 12 up, 12 in 2020-11-16T22:15:10.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:10 smithi057 bash[10301]: cluster 2020-11-16T22:15:09.290029+0000 mon.a (mon.0) 1556 : cluster [DBG] osdmap e880: 12 total, 12 up, 12 in 2020-11-16T22:15:10.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:10 smithi057 bash[10301]: cluster 2020-11-16T22:15:10.196983+0000 mon.a (mon.0) 1557 : cluster [DBG] osdmap e881: 12 total, 12 up, 12 in 2020-11-16T22:15:11.188 INFO:tasks.rados.rados.2.smithi057.stdout:3550: done (0 left) 2020-11-16T22:15:11.189 INFO:tasks.rados.rados.2.smithi057.stdout:3551: snap_create 2020-11-16T22:15:11.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:11 smithi016 bash[10302]: cluster 2020-11-16T22:15:09.850232+0000 mgr.x (mgr.24115) 676 : cluster [DBG] pgmap v1486: 17 pgs: 17 active+clean; 455 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 964 KiB/s wr, 7 op/s 2020-11-16T22:15:11.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:11 smithi016 bash[10302]: cluster 2020-11-16T22:15:11.199260+0000 mon.a (mon.0) 1558 : cluster [DBG] osdmap e882: 12 total, 12 up, 12 in 2020-11-16T22:15:11.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:11 smithi195 bash[10218]: cluster 2020-11-16T22:15:09.850232+0000 mgr.x (mgr.24115) 676 : cluster [DBG] pgmap v1486: 17 pgs: 17 active+clean; 455 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 964 KiB/s wr, 7 op/s 2020-11-16T22:15:11.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:11 smithi195 bash[10218]: cluster 2020-11-16T22:15:11.199260+0000 mon.a (mon.0) 1558 : cluster [DBG] osdmap e882: 12 total, 12 up, 12 in 2020-11-16T22:15:11.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:11 smithi057 bash[10301]: cluster 2020-11-16T22:15:09.850232+0000 mgr.x (mgr.24115) 676 : cluster [DBG] pgmap v1486: 17 pgs: 17 active+clean; 455 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 964 KiB/s wr, 7 op/s 2020-11-16T22:15:11.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:11 smithi057 bash[10301]: cluster 2020-11-16T22:15:11.199260+0000 mon.a (mon.0) 1558 : cluster [DBG] osdmap e882: 12 total, 12 up, 12 in 2020-11-16T22:15:12.190 INFO:tasks.rados.rados.2.smithi057.stdout:3551: done (0 left) 2020-11-16T22:15:12.190 INFO:tasks.rados.rados.2.smithi057.stdout:3552: delete oid 50 current snap is 416 2020-11-16T22:15:12.196 INFO:tasks.rados.rados.2.smithi057.stdout:3552: done (0 left) 2020-11-16T22:15:12.196 INFO:tasks.rados.rados.2.smithi057.stdout:3553: snap_create 2020-11-16T22:15:13.194 INFO:tasks.rados.rados.2.smithi057.stdout:3553: done (0 left) 2020-11-16T22:15:13.194 INFO:tasks.rados.rados.2.smithi057.stdout:3554: write oid 40 current snap is 417 2020-11-16T22:15:13.194 INFO:tasks.rados.rados.2.smithi057.stdout:3554: seq_num 1198 ranges {534786=415723,1437428=697358} 2020-11-16T22:15:13.205 INFO:tasks.rados.rados.2.smithi057.stdout:3554: writing smithi05720651-40 from 534786 to 950509 tid 1 2020-11-16T22:15:13.213 INFO:tasks.rados.rados.2.smithi057.stdout:3554: writing smithi05720651-40 from 1437428 to 2134786 tid 2 2020-11-16T22:15:13.213 INFO:tasks.rados.rados.2.smithi057.stdout:3555: delete oid 36 current snap is 417 2020-11-16T22:15:13.216 INFO:tasks.rados.rados.2.smithi057.stdout:3554: finishing write tid 1 to smithi05720651-40 2020-11-16T22:15:13.221 INFO:tasks.rados.rados.2.smithi057.stdout:3555: done (1 left) 2020-11-16T22:15:13.221 INFO:tasks.rados.rados.2.smithi057.stdout:3556: rollback oid 26 current snap is 417 2020-11-16T22:15:13.221 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 26 to 401 2020-11-16T22:15:13.222 INFO:tasks.rados.rados.2.smithi057.stdout:3557: read oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 413 2020-11-16T22:15:13.222 INFO:tasks.rados.rados.2.smithi057.stdout:3557: expect (ObjNum 1195 snap 413 seq_num 1195) 2020-11-16T22:15:13.222 INFO:tasks.rados.rados.2.smithi057.stdout:3558: snap_create 2020-11-16T22:15:13.224 INFO:tasks.rados.rados.2.smithi057.stdout:3554: finishing write tid 2 to smithi05720651-40 2020-11-16T22:15:13.225 INFO:tasks.rados.rados.2.smithi057.stdout:3554: finishing write tid 4 to smithi05720651-40 2020-11-16T22:15:13.226 INFO:tasks.rados.rados.2.smithi057.stdout:3554: finishing write tid 5 to smithi05720651-40 2020-11-16T22:15:13.226 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 2976 (ObjNum 1198 snap 417 seq_num 1198) dirty exists 2020-11-16T22:15:13.226 INFO:tasks.rados.rados.2.smithi057.stdout:3554: left oid 40 (ObjNum 1198 snap 417 seq_num 1198) 2020-11-16T22:15:13.228 INFO:tasks.rados.rados.2.smithi057.stdout:3556: finishing rollback tid 1 to smithi05720651-26 2020-11-16T22:15:13.228 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 2972 (ObjNum 1869573999 snap 28527 seq_num 336) dirty dne 2020-11-16T22:15:13.228 INFO:tasks.rados.rados.2.smithi057.stdout:3557: expect (ObjNum 1195 snap 413 seq_num 1195) 2020-11-16T22:15:13.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:13 smithi016 bash[10302]: cluster 2020-11-16T22:15:11.850943+0000 mgr.x (mgr.24115) 677 : cluster [DBG] pgmap v1489: 17 pgs: 17 active+clean; 467 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 3.0 MiB/s wr, 15 op/s 2020-11-16T22:15:13.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:13 smithi016 bash[10302]: cluster 2020-11-16T22:15:12.201491+0000 mon.a (mon.0) 1559 : cluster [DBG] osdmap e883: 12 total, 12 up, 12 in 2020-11-16T22:15:13.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:13 smithi195 bash[10218]: cluster 2020-11-16T22:15:11.850943+0000 mgr.x (mgr.24115) 677 : cluster [DBG] pgmap v1489: 17 pgs: 17 active+clean; 467 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 3.0 MiB/s wr, 15 op/s 2020-11-16T22:15:13.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:13 smithi195 bash[10218]: cluster 2020-11-16T22:15:12.201491+0000 mon.a (mon.0) 1559 : cluster [DBG] osdmap e883: 12 total, 12 up, 12 in 2020-11-16T22:15:13.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:13 smithi057 bash[10301]: cluster 2020-11-16T22:15:11.850943+0000 mgr.x (mgr.24115) 677 : cluster [DBG] pgmap v1489: 17 pgs: 17 active+clean; 467 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 3.0 MiB/s wr, 15 op/s 2020-11-16T22:15:13.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:13 smithi057 bash[10301]: cluster 2020-11-16T22:15:12.201491+0000 mon.a (mon.0) 1559 : cluster [DBG] osdmap e883: 12 total, 12 up, 12 in 2020-11-16T22:15:14.213 INFO:tasks.rados.rados.2.smithi057.stdout:3554: done (3 left) 2020-11-16T22:15:14.213 INFO:tasks.rados.rados.2.smithi057.stdout:3556: done (2 left) 2020-11-16T22:15:14.213 INFO:tasks.rados.rados.2.smithi057.stdout:3557: done (1 left) 2020-11-16T22:15:14.213 INFO:tasks.rados.rados.2.smithi057.stdout:3558: done (0 left) 2020-11-16T22:15:14.214 INFO:tasks.rados.rados.2.smithi057.stdout:3559: delete oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 418 2020-11-16T22:15:14.218 INFO:tasks.rados.rados.2.smithi057.stdout:3559: done (0 left) 2020-11-16T22:15:14.218 INFO:tasks.rados.rados.2.smithi057.stdout:3560: snap_remove snap 416 2020-11-16T22:15:14.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:14 smithi016 bash[10302]: cluster 2020-11-16T22:15:13.204485+0000 mon.a (mon.0) 1560 : cluster [DBG] osdmap e884: 12 total, 12 up, 12 in 2020-11-16T22:15:14.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:14 smithi195 bash[10218]: cluster 2020-11-16T22:15:13.204485+0000 mon.a (mon.0) 1560 : cluster [DBG] osdmap e884: 12 total, 12 up, 12 in 2020-11-16T22:15:14.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:14 smithi057 bash[10301]: cluster 2020-11-16T22:15:13.204485+0000 mon.a (mon.0) 1560 : cluster [DBG] osdmap e884: 12 total, 12 up, 12 in 2020-11-16T22:15:15.187 INFO:tasks.rados.rados.2.smithi057.stdout:3560: done (0 left) 2020-11-16T22:15:15.188 INFO:tasks.rados.rados.2.smithi057.stdout:3561: write oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 418 2020-11-16T22:15:15.188 INFO:tasks.rados.rados.2.smithi057.stdout:3561: seq_num 1201 ranges {585207=641470,1896521=288686} 2020-11-16T22:15:15.200 INFO:tasks.rados.rados.2.smithi057.stdout:3561: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 585207 to 1226677 tid 1 2020-11-16T22:15:15.206 INFO:tasks.rados.rados.2.smithi057.stdout:3561: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1896521 to 2185207 tid 2 2020-11-16T22:15:15.206 INFO:tasks.rados.rados.2.smithi057.stdout:3562: copy_from oid 34 from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 418 2020-11-16T22:15:15.206 INFO:tasks.rados.rados.2.smithi057.stdout:3563: snap_create 2020-11-16T22:15:15.215 INFO:tasks.rados.rados.2.smithi057.stdout:3562: finishing copy_from to smithi05720651-34 2020-11-16T22:15:15.216 INFO:tasks.rados.rados.2.smithi057.stdout:3562: got expected ENOENT (src dne) 2020-11-16T22:15:15.216 INFO:tasks.rados.rados.2.smithi057.stdout:3561: finishing write tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:15.216 INFO:tasks.rados.rados.2.smithi057.stdout:3562: finishing copy_from racing read to smithi05720651-34 2020-11-16T22:15:15.218 INFO:tasks.rados.rados.2.smithi057.stdout:3561: finishing write tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:15.218 INFO:tasks.rados.rados.2.smithi057.stdout:3561: finishing write tid 4 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:15.218 INFO:tasks.rados.rados.2.smithi057.stdout:3561: finishing write tid 5 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:15.218 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2237 (ObjNum 1201 snap 418 seq_num 1201) dirty exists 2020-11-16T22:15:15.218 INFO:tasks.rados.rados.2.smithi057.stdout:3561: left oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1201 snap 418 seq_num 1201) 2020-11-16T22:15:15.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:15 smithi016 bash[10302]: cluster 2020-11-16T22:15:13.851619+0000 mgr.x (mgr.24115) 678 : cluster [DBG] pgmap v1492: 17 pgs: 17 active+clean; 468 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.3 MiB/s wr, 14 op/s 2020-11-16T22:15:15.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:15 smithi016 bash[10302]: cluster 2020-11-16T22:15:14.223649+0000 mon.a (mon.0) 1561 : cluster [DBG] osdmap e885: 12 total, 12 up, 12 in 2020-11-16T22:15:15.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:15 smithi016 bash[10302]: cluster 2020-11-16T22:15:15.198478+0000 mon.a (mon.0) 1562 : cluster [DBG] osdmap e886: 12 total, 12 up, 12 in 2020-11-16T22:15:15.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:15 smithi195 bash[10218]: cluster 2020-11-16T22:15:13.851619+0000 mgr.x (mgr.24115) 678 : cluster [DBG] pgmap v1492: 17 pgs: 17 active+clean; 468 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.3 MiB/s wr, 14 op/s 2020-11-16T22:15:15.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:15 smithi195 bash[10218]: cluster 2020-11-16T22:15:14.223649+0000 mon.a (mon.0) 1561 : cluster [DBG] osdmap e885: 12 total, 12 up, 12 in 2020-11-16T22:15:15.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:15 smithi195 bash[10218]: cluster 2020-11-16T22:15:15.198478+0000 mon.a (mon.0) 1562 : cluster [DBG] osdmap e886: 12 total, 12 up, 12 in 2020-11-16T22:15:15.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:15 smithi057 bash[10301]: cluster 2020-11-16T22:15:13.851619+0000 mgr.x (mgr.24115) 678 : cluster [DBG] pgmap v1492: 17 pgs: 17 active+clean; 468 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.3 MiB/s wr, 14 op/s 2020-11-16T22:15:15.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:15 smithi057 bash[10301]: cluster 2020-11-16T22:15:14.223649+0000 mon.a (mon.0) 1561 : cluster [DBG] osdmap e885: 12 total, 12 up, 12 in 2020-11-16T22:15:15.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:15 smithi057 bash[10301]: cluster 2020-11-16T22:15:15.198478+0000 mon.a (mon.0) 1562 : cluster [DBG] osdmap e886: 12 total, 12 up, 12 in 2020-11-16T22:15:16.199 INFO:tasks.rados.rados.2.smithi057.stdout:3561: done (2 left) 2020-11-16T22:15:16.199 INFO:tasks.rados.rados.2.smithi057.stdout:3562: done (1 left) 2020-11-16T22:15:16.199 INFO:tasks.rados.rados.2.smithi057.stdout:3563: done (0 left) 2020-11-16T22:15:16.199 INFO:tasks.rados.rados.2.smithi057.stdout:3564: rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 419 2020-11-16T22:15:16.199 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 381 2020-11-16T22:15:16.200 INFO:tasks.rados.rados.2.smithi057.stdout:3565: copy_from oid 38 from oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 419 2020-11-16T22:15:16.200 INFO:tasks.rados.rados.2.smithi057.stdout:3566: rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 419 2020-11-16T22:15:16.200 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 378 2020-11-16T22:15:16.200 INFO:tasks.rados.rados.2.smithi057.stdout:3567: copy_from oid 40 from oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 419 2020-11-16T22:15:16.200 INFO:tasks.rados.rados.2.smithi057.stdout:3568: read oid 8 snap -1 2020-11-16T22:15:16.200 INFO:tasks.rados.rados.2.smithi057.stdout:3568: expect (ObjNum 1098 snap 381 seq_num 1098) 2020-11-16T22:15:16.200 INFO:tasks.rados.rados.2.smithi057.stdout:3569: write (excl) oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 419 2020-11-16T22:15:16.201 INFO:tasks.rados.rados.2.smithi057.stdout:3569: seq_num 1202 ranges {602014=433072,1671356=530658} 2020-11-16T22:15:16.216 INFO:tasks.rados.rados.2.smithi057.stdout:3569: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 602014 to 1035086 tid 1 2020-11-16T22:15:16.224 INFO:tasks.rados.rados.2.smithi057.stdout:3569: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1671356 to 2202014 tid 2 2020-11-16T22:15:16.225 INFO:tasks.rados.rados.2.smithi057.stdout:3570: write (excl) oid 6 current snap is 419 2020-11-16T22:15:16.225 INFO:tasks.rados.rados.2.smithi057.stdout:3570: seq_num 1203 ranges {618821=508321,1613485=531077} 2020-11-16T22:15:16.231 INFO:tasks.rados.rados.2.smithi057.stdout:3570: writing smithi05720651-6 from 618821 to 1127142 tid 1 2020-11-16T22:15:16.237 INFO:tasks.rados.rados.2.smithi057.stdout:3570: writing smithi05720651-6 from 1613485 to 2144562 tid 2 2020-11-16T22:15:16.237 INFO:tasks.rados.rados.2.smithi057.stdout:3571: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:15:16.237 INFO:tasks.rados.rados.2.smithi057.stdout:3571: expect (ObjNum 1162 snap 402 seq_num 1162) 2020-11-16T22:15:16.237 INFO:tasks.rados.rados.2.smithi057.stdout:3572: read oid 26 snap -1 2020-11-16T22:15:16.238 INFO:tasks.rados.rados.2.smithi057.stdout:3572: expect deleted 2020-11-16T22:15:16.238 INFO:tasks.rados.rados.2.smithi057.stdout:3573: write oid 44 current snap is 419 2020-11-16T22:15:16.238 INFO:tasks.rados.rados.2.smithi057.stdout:3573: seq_num 1204 ranges {635628=583570,1671967=563661} 2020-11-16T22:15:16.244 INFO:tasks.rados.rados.2.smithi057.stdout:3573: writing smithi05720651-44 from 635628 to 1219198 tid 1 2020-11-16T22:15:16.250 INFO:tasks.rados.rados.2.smithi057.stdout:3573: writing smithi05720651-44 from 1671967 to 2235628 tid 2 2020-11-16T22:15:16.250 INFO:tasks.rados.rados.2.smithi057.stdout:3574: delete oid 46 current snap is 419 2020-11-16T22:15:16.250 INFO:tasks.rados.rados.2.smithi057.stdout:3565: finishing copy_from to smithi05720651-38 2020-11-16T22:15:16.251 INFO:tasks.rados.rados.2.smithi057.stdout:3565: got expected ENOENT (src dne) 2020-11-16T22:15:16.251 INFO:tasks.rados.rados.2.smithi057.stdout:3566: finishing rollback tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:16.251 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2529 (ObjNum 353 snap 0 seq_num 1953066355) dirty dne 2020-11-16T22:15:16.251 INFO:tasks.rados.rados.2.smithi057.stdout:3565: finishing copy_from racing read to smithi05720651-38 2020-11-16T22:15:16.251 INFO:tasks.rados.rados.2.smithi057.stdout:3568: expect (ObjNum 1098 snap 381 seq_num 1098) 2020-11-16T22:15:16.384 INFO:tasks.rados.rados.2.smithi057.stdout:3564: finishing rollback tid 0 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:16.385 INFO:tasks.rados.rados.2.smithi057.stdout:3564: finishing rollback tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:16.385 INFO:tasks.rados.rados.2.smithi057.stdout:3569: finishing write tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:16.385 INFO:tasks.rados.rados.2.smithi057.stdout:3569: finishing write tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:16.385 INFO:tasks.rados.rados.2.smithi057.stdout:3569: finishing write tid 4 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:16.385 INFO:tasks.rados.rados.2.smithi057.stdout:3569: finishing write tid 5 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:16.385 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2240 (ObjNum 1202 snap 419 seq_num 1202) dirty exists 2020-11-16T22:15:16.386 INFO:tasks.rados.rados.2.smithi057.stdout:3569: left oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1202 snap 419 seq_num 1202) 2020-11-16T22:15:16.386 INFO:tasks.rados.rados.2.smithi057.stdout:3564: finishing rollback tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:16.386 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2983 (ObjNum 1079 snap 377 seq_num 1079) dirty exists 2020-11-16T22:15:16.386 INFO:tasks.rados.rados.2.smithi057.stdout:3567: finishing copy_from to smithi05720651-40 2020-11-16T22:15:16.386 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 2594 (ObjNum 1179 snap 407 seq_num 1179) dirty exists 2020-11-16T22:15:16.386 INFO:tasks.rados.rados.2.smithi057.stdout:3567: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:15:16.387 INFO:tasks.rados.rados.2.smithi057.stdout:3570: finishing write tid 1 to smithi05720651-6 2020-11-16T22:15:16.387 INFO:tasks.rados.rados.2.smithi057.stdout:3573: finishing write tid 1 to smithi05720651-44 2020-11-16T22:15:16.387 INFO:tasks.rados.rados.2.smithi057.stdout:3564: done (10 left) 2020-11-16T22:15:16.387 INFO:tasks.rados.rados.2.smithi057.stdout:3565: done (9 left) 2020-11-16T22:15:16.387 INFO:tasks.rados.rados.2.smithi057.stdout:3566: done (8 left) 2020-11-16T22:15:16.387 INFO:tasks.rados.rados.2.smithi057.stdout:3567: done (7 left) 2020-11-16T22:15:16.387 INFO:tasks.rados.rados.2.smithi057.stdout:3568: done (6 left) 2020-11-16T22:15:16.387 INFO:tasks.rados.rados.2.smithi057.stdout:3569: done (5 left) 2020-11-16T22:15:16.388 INFO:tasks.rados.rados.2.smithi057.stdout:3574: done (4 left) 2020-11-16T22:15:16.388 INFO:tasks.rados.rados.2.smithi057.stdout:3575: snap_create 2020-11-16T22:15:16.388 INFO:tasks.rados.rados.2.smithi057.stdout:3570: finishing write tid 2 to smithi05720651-6 2020-11-16T22:15:16.388 INFO:tasks.rados.rados.2.smithi057.stdout:3570: finishing write tid 4 to smithi05720651-6 2020-11-16T22:15:16.388 INFO:tasks.rados.rados.2.smithi057.stdout:3570: finishing write tid 5 to smithi05720651-6 2020-11-16T22:15:16.388 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 2710 (ObjNum 1203 snap 419 seq_num 1203) dirty exists 2020-11-16T22:15:16.388 INFO:tasks.rados.rados.2.smithi057.stdout:3570: left oid 6 (ObjNum 1203 snap 419 seq_num 1203) 2020-11-16T22:15:16.389 INFO:tasks.rados.rados.2.smithi057.stdout:3573: finishing write tid 2 to smithi05720651-44 2020-11-16T22:15:16.389 INFO:tasks.rados.rados.2.smithi057.stdout:3573: finishing write tid 4 to smithi05720651-44 2020-11-16T22:15:16.389 INFO:tasks.rados.rados.2.smithi057.stdout:3573: finishing write tid 5 to smithi05720651-44 2020-11-16T22:15:16.389 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 2529 (ObjNum 1204 snap 419 seq_num 1204) dirty exists 2020-11-16T22:15:16.389 INFO:tasks.rados.rados.2.smithi057.stdout:3573: left oid 44 (ObjNum 1204 snap 419 seq_num 1204) 2020-11-16T22:15:16.389 INFO:tasks.rados.rados.2.smithi057.stdout:3571: expect (ObjNum 1162 snap 402 seq_num 1162) 2020-11-16T22:15:17.220 INFO:tasks.rados.rados.2.smithi057.stdout:3570: done (4 left) 2020-11-16T22:15:17.221 INFO:tasks.rados.rados.2.smithi057.stdout:3571: done (3 left) 2020-11-16T22:15:17.221 INFO:tasks.rados.rados.2.smithi057.stdout:3572: done (2 left) 2020-11-16T22:15:17.221 INFO:tasks.rados.rados.2.smithi057.stdout:3573: done (1 left) 2020-11-16T22:15:17.221 INFO:tasks.rados.rados.2.smithi057.stdout:3575: done (0 left) 2020-11-16T22:15:17.222 INFO:tasks.rados.rados.2.smithi057.stdout:3576: copy_from oid 46 from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 420 2020-11-16T22:15:17.222 INFO:tasks.rados.rados.2.smithi057.stdout:3577: copy_from oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 34 current snap is 420 2020-11-16T22:15:17.222 INFO:tasks.rados.rados.2.smithi057.stdout:3578: copy_from oid 8 from oid 48 current snap is 420 2020-11-16T22:15:17.222 INFO:tasks.rados.rados.2.smithi057.stdout:3579: read oid 32 snap -1 2020-11-16T22:15:17.222 INFO:tasks.rados.rados.2.smithi057.stdout:3579: expect deleted 2020-11-16T22:15:17.222 INFO:tasks.rados.rados.2.smithi057.stdout:3580: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 420 2020-11-16T22:15:17.222 INFO:tasks.rados.rados.2.smithi057.stdout:3580: seq_num 1206 ranges {669242=734068,2188931=80311} 2020-11-16T22:15:17.235 INFO:tasks.rados.rados.2.smithi057.stdout:3580: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 669242 to 1403310 tid 1 2020-11-16T22:15:17.241 INFO:tasks.rados.rados.2.smithi057.stdout:3580: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2188931 to 2269242 tid 2 2020-11-16T22:15:17.241 INFO:tasks.rados.rados.2.smithi057.stdout:3581: copy_from oid 42 from oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 420 2020-11-16T22:15:17.241 INFO:tasks.rados.rados.2.smithi057.stdout:3577: finishing copy_from to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:17.242 INFO:tasks.rados.rados.2.smithi057.stdout:3577: got expected ENOENT (src dne) 2020-11-16T22:15:17.242 INFO:tasks.rados.rados.2.smithi057.stdout:3582: delete oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 420 2020-11-16T22:15:17.242 INFO:tasks.rados.rados.2.smithi057.stdout:3577: finishing copy_from racing read to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:17.245 INFO:tasks.rados.rados.2.smithi057.stdout:3576: finishing copy_from to smithi05720651-46 2020-11-16T22:15:17.245 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 2558 (ObjNum 949 snap 328 seq_num 949) dirty exists 2020-11-16T22:15:17.245 INFO:tasks.rados.rados.2.smithi057.stdout:3576: finishing copy_from racing read to smithi05720651-46 2020-11-16T22:15:17.248 INFO:tasks.rados.rados.2.smithi057.stdout:3580: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:17.248 INFO:tasks.rados.rados.2.smithi057.stdout:3576: done (6 left) 2020-11-16T22:15:17.249 INFO:tasks.rados.rados.2.smithi057.stdout:3577: done (5 left) 2020-11-16T22:15:17.249 INFO:tasks.rados.rados.2.smithi057.stdout:3579: done (4 left) 2020-11-16T22:15:17.249 INFO:tasks.rados.rados.2.smithi057.stdout:3582: done (3 left) 2020-11-16T22:15:17.249 INFO:tasks.rados.rados.2.smithi057.stdout:3583: snap_create 2020-11-16T22:15:17.250 INFO:tasks.rados.rados.2.smithi057.stdout:3578: finishing copy_from to smithi05720651-8 2020-11-16T22:15:17.250 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 2247 (ObjNum 1068 snap 375 seq_num 1068) dirty exists 2020-11-16T22:15:17.250 INFO:tasks.rados.rados.2.smithi057.stdout:3580: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:17.251 INFO:tasks.rados.rados.2.smithi057.stdout:3578: finishing copy_from racing read to smithi05720651-8 2020-11-16T22:15:17.251 INFO:tasks.rados.rados.2.smithi057.stdout:3580: finishing write tid 4 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:17.251 INFO:tasks.rados.rados.2.smithi057.stdout:3580: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:17.251 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2988 (ObjNum 1206 snap 420 seq_num 1206) dirty exists 2020-11-16T22:15:17.252 INFO:tasks.rados.rados.2.smithi057.stdout:3580: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1206 snap 420 seq_num 1206) 2020-11-16T22:15:17.262 INFO:tasks.rados.rados.2.smithi057.stdout:3581: finishing copy_from to smithi05720651-42 2020-11-16T22:15:17.262 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 2408 (ObjNum 1162 snap 402 seq_num 1162) dirty exists 2020-11-16T22:15:17.262 INFO:tasks.rados.rados.2.smithi057.stdout:3581: finishing copy_from racing read to smithi05720651-42 2020-11-16T22:15:17.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:17 smithi016 bash[10302]: cluster 2020-11-16T22:15:15.852415+0000 mgr.x (mgr.24115) 679 : cluster [DBG] pgmap v1495: 17 pgs: 17 active+clean; 468 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 247 KiB/s wr, 3 op/s 2020-11-16T22:15:17.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:17 smithi016 bash[10302]: cluster 2020-11-16T22:15:16.209407+0000 mon.a (mon.0) 1563 : cluster [DBG] osdmap e887: 12 total, 12 up, 12 in 2020-11-16T22:15:17.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:17 smithi195 bash[10218]: cluster 2020-11-16T22:15:15.852415+0000 mgr.x (mgr.24115) 679 : cluster [DBG] pgmap v1495: 17 pgs: 17 active+clean; 468 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 247 KiB/s wr, 3 op/s 2020-11-16T22:15:17.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:17 smithi195 bash[10218]: cluster 2020-11-16T22:15:16.209407+0000 mon.a (mon.0) 1563 : cluster [DBG] osdmap e887: 12 total, 12 up, 12 in 2020-11-16T22:15:17.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:17 smithi057 bash[10301]: cluster 2020-11-16T22:15:15.852415+0000 mgr.x (mgr.24115) 679 : cluster [DBG] pgmap v1495: 17 pgs: 17 active+clean; 468 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 247 KiB/s wr, 3 op/s 2020-11-16T22:15:17.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:17 smithi057 bash[10301]: cluster 2020-11-16T22:15:16.209407+0000 mon.a (mon.0) 1563 : cluster [DBG] osdmap e887: 12 total, 12 up, 12 in 2020-11-16T22:15:18.233 INFO:tasks.rados.rados.2.smithi057.stdout:3578: done (3 left) 2020-11-16T22:15:18.233 INFO:tasks.rados.rados.2.smithi057.stdout:3580: done (2 left) 2020-11-16T22:15:18.233 INFO:tasks.rados.rados.2.smithi057.stdout:3581: done (1 left) 2020-11-16T22:15:18.233 INFO:tasks.rados.rados.2.smithi057.stdout:3583: done (0 left) 2020-11-16T22:15:18.234 INFO:tasks.rados.rados.2.smithi057.stdout:3584: snap_remove snap 386 2020-11-16T22:15:18.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:18 smithi016 bash[10302]: cluster 2020-11-16T22:15:17.231414+0000 mon.a (mon.0) 1564 : cluster [DBG] osdmap e888: 12 total, 12 up, 12 in 2020-11-16T22:15:18.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:18 smithi195 bash[10218]: cluster 2020-11-16T22:15:17.231414+0000 mon.a (mon.0) 1564 : cluster [DBG] osdmap e888: 12 total, 12 up, 12 in 2020-11-16T22:15:18.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:18 smithi057 bash[10301]: cluster 2020-11-16T22:15:17.231414+0000 mon.a (mon.0) 1564 : cluster [DBG] osdmap e888: 12 total, 12 up, 12 in 2020-11-16T22:15:19.236 INFO:tasks.rados.rados.2.smithi057.stdout:3584: done (0 left) 2020-11-16T22:15:19.237 INFO:tasks.rados.rados.2.smithi057.stdout:3585: read oid 10 snap -1 2020-11-16T22:15:19.237 INFO:tasks.rados.rados.2.smithi057.stdout:3585: expect deleted 2020-11-16T22:15:19.237 INFO:tasks.rados.rados.2.smithi057.stdout:3586: snap_remove snap 406 2020-11-16T22:15:19.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:19 smithi016 bash[10302]: cluster 2020-11-16T22:15:17.853173+0000 mgr.x (mgr.24115) 680 : cluster [DBG] pgmap v1498: 17 pgs: 17 active+clean; 473 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 1.2 MiB/s wr, 4 op/s 2020-11-16T22:15:19.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:19 smithi016 bash[10302]: cluster 2020-11-16T22:15:18.244006+0000 mon.a (mon.0) 1565 : cluster [DBG] osdmap e889: 12 total, 12 up, 12 in 2020-11-16T22:15:19.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:19 smithi195 bash[10218]: cluster 2020-11-16T22:15:17.853173+0000 mgr.x (mgr.24115) 680 : cluster [DBG] pgmap v1498: 17 pgs: 17 active+clean; 473 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 1.2 MiB/s wr, 4 op/s 2020-11-16T22:15:19.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:19 smithi195 bash[10218]: cluster 2020-11-16T22:15:18.244006+0000 mon.a (mon.0) 1565 : cluster [DBG] osdmap e889: 12 total, 12 up, 12 in 2020-11-16T22:15:19.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:19 smithi057 bash[10301]: cluster 2020-11-16T22:15:17.853173+0000 mgr.x (mgr.24115) 680 : cluster [DBG] pgmap v1498: 17 pgs: 17 active+clean; 473 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 1.2 MiB/s wr, 4 op/s 2020-11-16T22:15:19.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:19 smithi057 bash[10301]: cluster 2020-11-16T22:15:18.244006+0000 mon.a (mon.0) 1565 : cluster [DBG] osdmap e889: 12 total, 12 up, 12 in 2020-11-16T22:15:20.239 INFO:tasks.rados.rados.2.smithi057.stdout:3586: done (1 left) 2020-11-16T22:15:20.239 INFO:tasks.rados.rados.2.smithi057.stdout:3587: write (excl) oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 421 2020-11-16T22:15:20.239 INFO:tasks.rados.rados.2.smithi057.stdout:3587: seq_num 1208 ranges {702856=484566,1789542=513314} 2020-11-16T22:15:20.249 INFO:tasks.rados.rados.2.smithi057.stdout:3587: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 702856 to 1187422 tid 1 2020-11-16T22:15:20.256 INFO:tasks.rados.rados.2.smithi057.stdout:3587: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1789542 to 2302856 tid 2 2020-11-16T22:15:20.256 INFO:tasks.rados.rados.2.smithi057.stdout:3588: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:15:20.257 INFO:tasks.rados.rados.2.smithi057.stdout:3588: expect deleted 2020-11-16T22:15:20.257 INFO:tasks.rados.rados.2.smithi057.stdout:3589: copy_from oid 32 from oid 6 current snap is 421 2020-11-16T22:15:20.257 INFO:tasks.rados.rados.2.smithi057.stdout:3585: done (3 left) 2020-11-16T22:15:20.257 INFO:tasks.rados.rados.2.smithi057.stdout:3590: delete oid 50 current snap is 421 2020-11-16T22:15:20.260 INFO:tasks.rados.rados.2.smithi057.stdout:3587: finishing write tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:20.267 INFO:tasks.rados.rados.2.smithi057.stdout:3587: finishing write tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:20.267 INFO:tasks.rados.rados.2.smithi057.stdout:3587: finishing write tid 4 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:20.267 INFO:tasks.rados.rados.2.smithi057.stdout:3587: finishing write tid 5 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:20.268 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2532 (ObjNum 1208 snap 421 seq_num 1208) dirty exists 2020-11-16T22:15:20.268 INFO:tasks.rados.rados.2.smithi057.stdout:3587: left oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1208 snap 421 seq_num 1208) 2020-11-16T22:15:20.270 INFO:tasks.rados.rados.2.smithi057.stdout:3587: done (3 left) 2020-11-16T22:15:20.270 INFO:tasks.rados.rados.2.smithi057.stdout:3588: done (2 left) 2020-11-16T22:15:20.270 INFO:tasks.rados.rados.2.smithi057.stdout:3590: done (1 left) 2020-11-16T22:15:20.270 INFO:tasks.rados.rados.2.smithi057.stdout:3591: read oid 28 snap 408 2020-11-16T22:15:20.270 INFO:tasks.rados.rados.2.smithi057.stdout:3591: expect (ObjNum 1114 snap 387 seq_num 1114) 2020-11-16T22:15:20.271 INFO:tasks.rados.rados.2.smithi057.stdout:3592: snap_create 2020-11-16T22:15:20.274 INFO:tasks.rados.rados.2.smithi057.stdout:3591: expect (ObjNum 1114 snap 387 seq_num 1114) 2020-11-16T22:15:20.554 INFO:tasks.rados.rados.2.smithi057.stdout:3589: finishing copy_from to smithi05720651-32 2020-11-16T22:15:20.555 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 2710 (ObjNum 1203 snap 419 seq_num 1203) dirty exists 2020-11-16T22:15:20.555 INFO:tasks.rados.rados.2.smithi057.stdout:3589: finishing copy_from racing read to smithi05720651-32 2020-11-16T22:15:20.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:20 smithi016 bash[10302]: cluster 2020-11-16T22:15:19.246511+0000 mon.a (mon.0) 1566 : cluster [DBG] osdmap e890: 12 total, 12 up, 12 in 2020-11-16T22:15:20.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:20 smithi016 bash[10302]: cluster 2020-11-16T22:15:20.249837+0000 mon.a (mon.0) 1567 : cluster [DBG] osdmap e891: 12 total, 12 up, 12 in 2020-11-16T22:15:20.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:20 smithi195 bash[10218]: cluster 2020-11-16T22:15:19.246511+0000 mon.a (mon.0) 1566 : cluster [DBG] osdmap e890: 12 total, 12 up, 12 in 2020-11-16T22:15:20.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:20 smithi195 bash[10218]: cluster 2020-11-16T22:15:20.249837+0000 mon.a (mon.0) 1567 : cluster [DBG] osdmap e891: 12 total, 12 up, 12 in 2020-11-16T22:15:20.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:20 smithi057 bash[10301]: cluster 2020-11-16T22:15:19.246511+0000 mon.a (mon.0) 1566 : cluster [DBG] osdmap e890: 12 total, 12 up, 12 in 2020-11-16T22:15:20.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:20 smithi057 bash[10301]: cluster 2020-11-16T22:15:20.249837+0000 mon.a (mon.0) 1567 : cluster [DBG] osdmap e891: 12 total, 12 up, 12 in 2020-11-16T22:15:21.258 INFO:tasks.rados.rados.2.smithi057.stdout:3589: done (2 left) 2020-11-16T22:15:21.258 INFO:tasks.rados.rados.2.smithi057.stdout:3591: done (1 left) 2020-11-16T22:15:21.258 INFO:tasks.rados.rados.2.smithi057.stdout:3592: done (0 left) 2020-11-16T22:15:21.258 INFO:tasks.rados.rados.2.smithi057.stdout:3593: copy_from oid 36 from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 422 2020-11-16T22:15:21.259 INFO:tasks.rados.rados.2.smithi057.stdout:3594: snap_create 2020-11-16T22:15:21.264 INFO:tasks.rados.rados.2.smithi057.stdout:3593: finishing copy_from to smithi05720651-36 2020-11-16T22:15:21.264 INFO:tasks.rados.rados.2.smithi057.stdout:3593: got expected ENOENT (src dne) 2020-11-16T22:15:21.265 INFO:tasks.rados.rados.2.smithi057.stdout:3593: finishing copy_from racing read to smithi05720651-36 2020-11-16T22:15:21.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:21 smithi016 bash[10302]: cluster 2020-11-16T22:15:19.853836+0000 mgr.x (mgr.24115) 681 : cluster [DBG] pgmap v1501: 17 pgs: 17 active+clean; 475 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.4 MiB/s wr, 3 op/s 2020-11-16T22:15:21.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:21 smithi195 bash[10218]: cluster 2020-11-16T22:15:19.853836+0000 mgr.x (mgr.24115) 681 : cluster [DBG] pgmap v1501: 17 pgs: 17 active+clean; 475 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.4 MiB/s wr, 3 op/s 2020-11-16T22:15:21.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:21 smithi057 bash[10301]: cluster 2020-11-16T22:15:19.853836+0000 mgr.x (mgr.24115) 681 : cluster [DBG] pgmap v1501: 17 pgs: 17 active+clean; 475 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.4 MiB/s wr, 3 op/s 2020-11-16T22:15:22.261 INFO:tasks.rados.rados.2.smithi057.stdout:3593: done (1 left) 2020-11-16T22:15:22.261 INFO:tasks.rados.rados.2.smithi057.stdout:3594: done (0 left) 2020-11-16T22:15:22.261 INFO:tasks.rados.rados.2.smithi057.stdout:3595: copy_from oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 46 current snap is 423 2020-11-16T22:15:22.262 INFO:tasks.rados.rados.2.smithi057.stdout:3596: write oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 423 2020-11-16T22:15:22.262 INFO:tasks.rados.rados.2.smithi057.stdout:3596: seq_num 1210 ranges {736470=751417,2022859=313611} 2020-11-16T22:15:22.275 INFO:tasks.rados.rados.2.smithi057.stdout:3596: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 736470 to 1487887 tid 1 2020-11-16T22:15:22.281 INFO:tasks.rados.rados.2.smithi057.stdout:3596: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2022859 to 2336470 tid 2 2020-11-16T22:15:22.281 INFO:tasks.rados.rados.2.smithi057.stdout:3597: snap_create 2020-11-16T22:15:22.289 INFO:tasks.rados.rados.2.smithi057.stdout:3596: finishing write tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:22.290 INFO:tasks.rados.rados.2.smithi057.stdout:3596: finishing write tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:22.290 INFO:tasks.rados.rados.2.smithi057.stdout:3596: finishing write tid 4 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:22.290 INFO:tasks.rados.rados.2.smithi057.stdout:3596: finishing write tid 5 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:22.291 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2615 (ObjNum 1210 snap 423 seq_num 1210) dirty exists 2020-11-16T22:15:22.291 INFO:tasks.rados.rados.2.smithi057.stdout:3596: left oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1210 snap 423 seq_num 1210) 2020-11-16T22:15:22.301 INFO:tasks.rados.rados.2.smithi057.stdout:3595: finishing copy_from to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:22.301 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2558 (ObjNum 949 snap 328 seq_num 949) dirty exists 2020-11-16T22:15:22.301 INFO:tasks.rados.rados.2.smithi057.stdout:3595: finishing copy_from racing read to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:22.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:22 smithi016 bash[10302]: cluster 2020-11-16T22:15:21.268226+0000 mon.a (mon.0) 1568 : cluster [DBG] osdmap e892: 12 total, 12 up, 12 in 2020-11-16T22:15:22.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:22 smithi195 bash[10218]: cluster 2020-11-16T22:15:21.268226+0000 mon.a (mon.0) 1568 : cluster [DBG] osdmap e892: 12 total, 12 up, 12 in 2020-11-16T22:15:22.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:22 smithi057 bash[10301]: cluster 2020-11-16T22:15:21.268226+0000 mon.a (mon.0) 1568 : cluster [DBG] osdmap e892: 12 total, 12 up, 12 in 2020-11-16T22:15:23.289 INFO:tasks.rados.rados.2.smithi057.stdout:3595: done (2 left) 2020-11-16T22:15:23.290 INFO:tasks.rados.rados.2.smithi057.stdout:3596: done (1 left) 2020-11-16T22:15:23.290 INFO:tasks.rados.rados.2.smithi057.stdout:3597: done (0 left) 2020-11-16T22:15:23.290 INFO:tasks.rados.rados.2.smithi057.stdout:3598: delete oid 36 current snap is 424 2020-11-16T22:15:23.299 INFO:tasks.rados.rados.2.smithi057.stdout:3598: done (0 left) 2020-11-16T22:15:23.299 INFO:tasks.rados.rados.2.smithi057.stdout:3599: rollback oid 22 current snap is 424 2020-11-16T22:15:23.299 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 22 to 366 2020-11-16T22:15:23.300 INFO:tasks.rados.rados.2.smithi057.stdout:3600: copy_from oid 20 from oid 26 current snap is 424 2020-11-16T22:15:23.300 INFO:tasks.rados.rados.2.smithi057.stdout:3601: snap_create 2020-11-16T22:15:23.307 INFO:tasks.rados.rados.2.smithi057.stdout:3599: finishing rollback tid 0 to smithi05720651-22 2020-11-16T22:15:23.307 INFO:tasks.rados.rados.2.smithi057.stdout:3599: finishing rollback tid 1 to smithi05720651-22 2020-11-16T22:15:23.308 INFO:tasks.rados.rados.2.smithi057.stdout:3599: finishing rollback tid 2 to smithi05720651-22 2020-11-16T22:15:23.308 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 2532 (ObjNum 958 snap 329 seq_num 958) dirty exists 2020-11-16T22:15:23.309 INFO:tasks.rados.rados.2.smithi057.stdout:3600: finishing copy_from to smithi05720651-20 2020-11-16T22:15:23.309 INFO:tasks.rados.rados.2.smithi057.stdout:3600: got expected ENOENT (src dne) 2020-11-16T22:15:23.309 INFO:tasks.rados.rados.2.smithi057.stdout:3600: finishing copy_from racing read to smithi05720651-20 2020-11-16T22:15:23.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:23 smithi016 bash[10302]: cluster 2020-11-16T22:15:21.854568+0000 mgr.x (mgr.24115) 682 : cluster [DBG] pgmap v1504: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 482 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 4.4 MiB/s wr, 14 op/s 2020-11-16T22:15:23.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:23 smithi016 bash[10302]: cluster 2020-11-16T22:15:22.271203+0000 mon.a (mon.0) 1569 : cluster [DBG] osdmap e893: 12 total, 12 up, 12 in 2020-11-16T22:15:23.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:23 smithi195 bash[10218]: cluster 2020-11-16T22:15:21.854568+0000 mgr.x (mgr.24115) 682 : cluster [DBG] pgmap v1504: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 482 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 4.4 MiB/s wr, 14 op/s 2020-11-16T22:15:23.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:23 smithi195 bash[10218]: cluster 2020-11-16T22:15:22.271203+0000 mon.a (mon.0) 1569 : cluster [DBG] osdmap e893: 12 total, 12 up, 12 in 2020-11-16T22:15:23.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:23 smithi057 bash[10301]: cluster 2020-11-16T22:15:21.854568+0000 mgr.x (mgr.24115) 682 : cluster [DBG] pgmap v1504: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 482 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 4.4 MiB/s wr, 14 op/s 2020-11-16T22:15:23.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:23 smithi057 bash[10301]: cluster 2020-11-16T22:15:22.271203+0000 mon.a (mon.0) 1569 : cluster [DBG] osdmap e893: 12 total, 12 up, 12 in 2020-11-16T22:15:24.300 INFO:tasks.rados.rados.2.smithi057.stdout:3599: done (2 left) 2020-11-16T22:15:24.300 INFO:tasks.rados.rados.2.smithi057.stdout:3600: done (1 left) 2020-11-16T22:15:24.300 INFO:tasks.rados.rados.2.smithi057.stdout:3601: done (0 left) 2020-11-16T22:15:24.301 INFO:tasks.rados.rados.2.smithi057.stdout:3602: snap_remove snap 383 2020-11-16T22:15:24.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:24 smithi016 bash[10302]: cluster 2020-11-16T22:15:23.300744+0000 mon.a (mon.0) 1570 : cluster [DBG] osdmap e894: 12 total, 12 up, 12 in 2020-11-16T22:15:24.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:24 smithi195 bash[10218]: cluster 2020-11-16T22:15:23.300744+0000 mon.a (mon.0) 1570 : cluster [DBG] osdmap e894: 12 total, 12 up, 12 in 2020-11-16T22:15:24.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:24 smithi057 bash[10301]: cluster 2020-11-16T22:15:23.300744+0000 mon.a (mon.0) 1570 : cluster [DBG] osdmap e894: 12 total, 12 up, 12 in 2020-11-16T22:15:25.204 INFO:tasks.rados.rados.2.smithi057.stdout:3602: done (0 left) 2020-11-16T22:15:25.204 INFO:tasks.rados.rados.2.smithi057.stdout:3603: write (excl) oid 48 current snap is 425 2020-11-16T22:15:25.204 INFO:tasks.rados.rados.2.smithi057.stdout:3603: seq_num 1212 ranges {770084=501915,2023470=346614} 2020-11-16T22:15:25.218 INFO:tasks.rados.rados.2.smithi057.stdout:3603: writing smithi05720651-48 from 770084 to 1271999 tid 1 2020-11-16T22:15:25.225 INFO:tasks.rados.rados.2.smithi057.stdout:3603: writing smithi05720651-48 from 2023470 to 2370084 tid 2 2020-11-16T22:15:25.225 INFO:tasks.rados.rados.2.smithi057.stdout:3604: read oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 399 2020-11-16T22:15:25.225 INFO:tasks.rados.rados.2.smithi057.stdout:3604: expect (ObjNum 1094 snap 380 seq_num 1094) 2020-11-16T22:15:25.226 INFO:tasks.rados.rados.2.smithi057.stdout:3605: rollback oid 28 current snap is 425 2020-11-16T22:15:25.226 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 28 to 415 2020-11-16T22:15:25.226 INFO:tasks.rados.rados.2.smithi057.stdout:3606: delete oid 18 current snap is 425 2020-11-16T22:15:25.233 INFO:tasks.rados.rados.2.smithi057.stdout:3603: finishing write tid 1 to smithi05720651-48 2020-11-16T22:15:25.236 INFO:tasks.rados.rados.2.smithi057.stdout:3606: done (3 left) 2020-11-16T22:15:25.236 INFO:tasks.rados.rados.2.smithi057.stdout:3607: delete oid 14 current snap is 425 2020-11-16T22:15:25.238 INFO:tasks.rados.rados.2.smithi057.stdout:3603: finishing write tid 2 to smithi05720651-48 2020-11-16T22:15:25.239 INFO:tasks.rados.rados.2.smithi057.stdout:3603: finishing write tid 4 to smithi05720651-48 2020-11-16T22:15:25.239 INFO:tasks.rados.rados.2.smithi057.stdout:3603: finishing write tid 5 to smithi05720651-48 2020-11-16T22:15:25.239 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 2851 (ObjNum 1212 snap 425 seq_num 1212) dirty exists 2020-11-16T22:15:25.239 INFO:tasks.rados.rados.2.smithi057.stdout:3603: left oid 48 (ObjNum 1212 snap 425 seq_num 1212) 2020-11-16T22:15:25.242 INFO:tasks.rados.rados.2.smithi057.stdout:3605: finishing rollback tid 0 to smithi05720651-28 2020-11-16T22:15:25.242 INFO:tasks.rados.rados.2.smithi057.stdout:3605: finishing rollback tid 1 to smithi05720651-28 2020-11-16T22:15:25.243 INFO:tasks.rados.rados.2.smithi057.stdout:3605: finishing rollback tid 2 to smithi05720651-28 2020-11-16T22:15:25.243 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 2535 (ObjNum 1114 snap 387 seq_num 1114) dirty exists 2020-11-16T22:15:25.245 INFO:tasks.rados.rados.2.smithi057.stdout:3603: done (3 left) 2020-11-16T22:15:25.245 INFO:tasks.rados.rados.2.smithi057.stdout:3605: done (2 left) 2020-11-16T22:15:25.245 INFO:tasks.rados.rados.2.smithi057.stdout:3607: done (1 left) 2020-11-16T22:15:25.245 INFO:tasks.rados.rados.2.smithi057.stdout:3608: delete oid 36 current snap is 425 2020-11-16T22:15:25.248 INFO:tasks.rados.rados.2.smithi057.stdout:3608: done (1 left) 2020-11-16T22:15:25.248 INFO:tasks.rados.rados.2.smithi057.stdout:3609: snap_create 2020-11-16T22:15:25.250 INFO:tasks.rados.rados.2.smithi057.stdout:3604: expect (ObjNum 1094 snap 380 seq_num 1094) 2020-11-16T22:15:25.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:25 smithi016 bash[10302]: cluster 2020-11-16T22:15:23.855209+0000 mgr.x (mgr.24115) 683 : cluster [DBG] pgmap v1507: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 482 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 4.1 MiB/s wr, 12 op/s 2020-11-16T22:15:25.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:25 smithi016 bash[10302]: cluster 2020-11-16T22:15:24.310985+0000 mon.a (mon.0) 1571 : cluster [DBG] osdmap e895: 12 total, 12 up, 12 in 2020-11-16T22:15:25.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:25 smithi016 bash[10302]: cluster 2020-11-16T22:15:25.214944+0000 mon.a (mon.0) 1572 : cluster [DBG] osdmap e896: 12 total, 12 up, 12 in 2020-11-16T22:15:25.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:25 smithi195 bash[10218]: cluster 2020-11-16T22:15:23.855209+0000 mgr.x (mgr.24115) 683 : cluster [DBG] pgmap v1507: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 482 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 4.1 MiB/s wr, 12 op/s 2020-11-16T22:15:25.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:25 smithi195 bash[10218]: cluster 2020-11-16T22:15:24.310985+0000 mon.a (mon.0) 1571 : cluster [DBG] osdmap e895: 12 total, 12 up, 12 in 2020-11-16T22:15:25.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:25 smithi195 bash[10218]: cluster 2020-11-16T22:15:25.214944+0000 mon.a (mon.0) 1572 : cluster [DBG] osdmap e896: 12 total, 12 up, 12 in 2020-11-16T22:15:25.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:25 smithi057 bash[10301]: cluster 2020-11-16T22:15:23.855209+0000 mgr.x (mgr.24115) 683 : cluster [DBG] pgmap v1507: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 482 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 4.1 MiB/s wr, 12 op/s 2020-11-16T22:15:25.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:25 smithi057 bash[10301]: cluster 2020-11-16T22:15:24.310985+0000 mon.a (mon.0) 1571 : cluster [DBG] osdmap e895: 12 total, 12 up, 12 in 2020-11-16T22:15:25.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:25 smithi057 bash[10301]: cluster 2020-11-16T22:15:25.214944+0000 mon.a (mon.0) 1572 : cluster [DBG] osdmap e896: 12 total, 12 up, 12 in 2020-11-16T22:15:26.215 INFO:tasks.rados.rados.2.smithi057.stdout:3604: done (1 left) 2020-11-16T22:15:26.215 INFO:tasks.rados.rados.2.smithi057.stdout:3609: done (0 left) 2020-11-16T22:15:26.215 INFO:tasks.rados.rados.2.smithi057.stdout:3610: read oid 12 snap -1 2020-11-16T22:15:26.215 INFO:tasks.rados.rados.2.smithi057.stdout:3610: expect (ObjNum 1133 snap 393 seq_num 1133) 2020-11-16T22:15:26.215 INFO:tasks.rados.rados.2.smithi057.stdout:3611: rollback oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 426 2020-11-16T22:15:26.216 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 404 2020-11-16T22:15:26.216 INFO:tasks.rados.rados.2.smithi057.stdout:3612: rollback oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 426 2020-11-16T22:15:26.216 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 417 2020-11-16T22:15:26.216 INFO:tasks.rados.rados.2.smithi057.stdout:3613: snap_create 2020-11-16T22:15:26.220 INFO:tasks.rados.rados.2.smithi057.stdout:3612: finishing rollback tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:26.221 INFO:tasks.rados.rados.2.smithi057.stdout:3612: finishing rollback tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:26.221 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2600 (ObjNum 1194 snap 413 seq_num 1194) dirty exists 2020-11-16T22:15:26.227 INFO:tasks.rados.rados.2.smithi057.stdout:3610: expect (ObjNum 1133 snap 393 seq_num 1133) 2020-11-16T22:15:26.327 INFO:tasks.rados.rados.2.smithi057.stdout:3611: finishing rollback tid 0 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:26.327 INFO:tasks.rados.rados.2.smithi057.stdout:3611: finishing rollback tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:26.327 INFO:tasks.rados.rados.2.smithi057.stdout:3611: finishing rollback tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:26.328 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2538 (ObjNum 1068 snap 375 seq_num 1068) dirty exists 2020-11-16T22:15:27.217 INFO:tasks.rados.rados.2.smithi057.stdout:3610: done (3 left) 2020-11-16T22:15:27.217 INFO:tasks.rados.rados.2.smithi057.stdout:3611: done (2 left) 2020-11-16T22:15:27.218 INFO:tasks.rados.rados.2.smithi057.stdout:3612: done (1 left) 2020-11-16T22:15:27.218 INFO:tasks.rados.rados.2.smithi057.stdout:3613: done (0 left) 2020-11-16T22:15:27.218 INFO:tasks.rados.rados.2.smithi057.stdout:3614: snap_remove snap 394 2020-11-16T22:15:27.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:27 smithi016 bash[10302]: cluster 2020-11-16T22:15:25.855922+0000 mgr.x (mgr.24115) 684 : cluster [DBG] pgmap v1510: 17 pgs: 17 active+clean; 487 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 504 KiB/s wr, 5 op/s 2020-11-16T22:15:27.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:27 smithi016 bash[10302]: cluster 2020-11-16T22:15:26.226117+0000 mon.a (mon.0) 1573 : cluster [DBG] osdmap e897: 12 total, 12 up, 12 in 2020-11-16T22:15:27.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:27 smithi195 bash[10218]: cluster 2020-11-16T22:15:25.855922+0000 mgr.x (mgr.24115) 684 : cluster [DBG] pgmap v1510: 17 pgs: 17 active+clean; 487 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 504 KiB/s wr, 5 op/s 2020-11-16T22:15:27.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:27 smithi195 bash[10218]: cluster 2020-11-16T22:15:26.226117+0000 mon.a (mon.0) 1573 : cluster [DBG] osdmap e897: 12 total, 12 up, 12 in 2020-11-16T22:15:27.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:27 smithi057 bash[10301]: cluster 2020-11-16T22:15:25.855922+0000 mgr.x (mgr.24115) 684 : cluster [DBG] pgmap v1510: 17 pgs: 17 active+clean; 487 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 504 KiB/s wr, 5 op/s 2020-11-16T22:15:27.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:27 smithi057 bash[10301]: cluster 2020-11-16T22:15:26.226117+0000 mon.a (mon.0) 1573 : cluster [DBG] osdmap e897: 12 total, 12 up, 12 in 2020-11-16T22:15:28.220 INFO:tasks.rados.rados.2.smithi057.stdout:3614: done (0 left) 2020-11-16T22:15:28.220 INFO:tasks.rados.rados.2.smithi057.stdout:3615: read oid 40 snap -1 2020-11-16T22:15:28.221 INFO:tasks.rados.rados.2.smithi057.stdout:3615: expect (ObjNum 1179 snap 407 seq_num 1179) 2020-11-16T22:15:28.221 INFO:tasks.rados.rados.2.smithi057.stdout:3616: copy_from oid 12 from oid 16 current snap is 427 2020-11-16T22:15:28.221 INFO:tasks.rados.rados.2.smithi057.stdout:3617: snap_create 2020-11-16T22:15:28.247 INFO:tasks.rados.rados.2.smithi057.stdout:3615: expect (ObjNum 1179 snap 407 seq_num 1179) 2020-11-16T22:15:28.506 INFO:tasks.rados.rados.2.smithi057.stdout:3616: finishing copy_from to smithi05720651-12 2020-11-16T22:15:28.507 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 2608 (ObjNum 1187 snap 410 seq_num 1187) dirty exists 2020-11-16T22:15:28.507 INFO:tasks.rados.rados.2.smithi057.stdout:3616: finishing copy_from racing read to smithi05720651-12 2020-11-16T22:15:28.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:28 smithi016 bash[10302]: cluster 2020-11-16T22:15:27.227430+0000 mon.a (mon.0) 1574 : cluster [DBG] osdmap e898: 12 total, 12 up, 12 in 2020-11-16T22:15:28.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:28 smithi016 bash[10302]: cluster 2020-11-16T22:15:28.231061+0000 mon.a (mon.0) 1575 : cluster [DBG] osdmap e899: 12 total, 12 up, 12 in 2020-11-16T22:15:28.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:28 smithi195 bash[10218]: cluster 2020-11-16T22:15:27.227430+0000 mon.a (mon.0) 1574 : cluster [DBG] osdmap e898: 12 total, 12 up, 12 in 2020-11-16T22:15:28.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:28 smithi195 bash[10218]: cluster 2020-11-16T22:15:28.231061+0000 mon.a (mon.0) 1575 : cluster [DBG] osdmap e899: 12 total, 12 up, 12 in 2020-11-16T22:15:28.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:28 smithi057 bash[10301]: cluster 2020-11-16T22:15:27.227430+0000 mon.a (mon.0) 1574 : cluster [DBG] osdmap e898: 12 total, 12 up, 12 in 2020-11-16T22:15:28.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:28 smithi057 bash[10301]: cluster 2020-11-16T22:15:28.231061+0000 mon.a (mon.0) 1575 : cluster [DBG] osdmap e899: 12 total, 12 up, 12 in 2020-11-16T22:15:29.222 INFO:tasks.rados.rados.2.smithi057.stdout:3615: done (2 left) 2020-11-16T22:15:29.222 INFO:tasks.rados.rados.2.smithi057.stdout:3616: done (1 left) 2020-11-16T22:15:29.222 INFO:tasks.rados.rados.2.smithi057.stdout:3617: done (0 left) 2020-11-16T22:15:29.223 INFO:tasks.rados.rados.2.smithi057.stdout:3618: delete oid 2 current snap is 428 2020-11-16T22:15:29.229 INFO:tasks.rados.rados.2.smithi057.stdout:3618: done (0 left) 2020-11-16T22:15:29.229 INFO:tasks.rados.rados.2.smithi057.stdout:3619: snap_create 2020-11-16T22:15:29.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:29 smithi016 bash[10302]: cluster 2020-11-16T22:15:27.856605+0000 mgr.x (mgr.24115) 685 : cluster [DBG] pgmap v1513: 17 pgs: 17 active+clean; 494 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2020-11-16T22:15:29.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:29 smithi016 bash[10302]: cluster 2020-11-16T22:15:29.233457+0000 mon.a (mon.0) 1576 : cluster [DBG] osdmap e900: 12 total, 12 up, 12 in 2020-11-16T22:15:29.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:29 smithi195 bash[10218]: cluster 2020-11-16T22:15:27.856605+0000 mgr.x (mgr.24115) 685 : cluster [DBG] pgmap v1513: 17 pgs: 17 active+clean; 494 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2020-11-16T22:15:29.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:29 smithi195 bash[10218]: cluster 2020-11-16T22:15:29.233457+0000 mon.a (mon.0) 1576 : cluster [DBG] osdmap e900: 12 total, 12 up, 12 in 2020-11-16T22:15:29.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:29 smithi057 bash[10301]: cluster 2020-11-16T22:15:27.856605+0000 mgr.x (mgr.24115) 685 : cluster [DBG] pgmap v1513: 17 pgs: 17 active+clean; 494 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 1.6 MiB/s wr, 10 op/s 2020-11-16T22:15:29.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:29 smithi057 bash[10301]: cluster 2020-11-16T22:15:29.233457+0000 mon.a (mon.0) 1576 : cluster [DBG] osdmap e900: 12 total, 12 up, 12 in 2020-11-16T22:15:30.206 INFO:tasks.rados.rados.2.smithi057.stdout:3619: done (0 left) 2020-11-16T22:15:30.206 INFO:tasks.rados.rados.2.smithi057.stdout:3620: snap_create 2020-11-16T22:15:30.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:30 smithi016 bash[10302]: audit 2020-11-16T22:15:29.812310+0000 mon.b (mon.1) 318 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:15:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:30 smithi016 bash[10302]: audit 2020-11-16T22:15:29.812695+0000 mon.b (mon.1) 319 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:15:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:30 smithi016 bash[10302]: audit 2020-11-16T22:15:29.813157+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:15:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:30 smithi016 bash[10302]: audit 2020-11-16T22:15:29.813700+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:15:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:30 smithi016 bash[10302]: cluster 2020-11-16T22:15:30.216730+0000 mon.a (mon.0) 1579 : cluster [DBG] osdmap e901: 12 total, 12 up, 12 in 2020-11-16T22:15:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:30 smithi195 bash[10218]: audit 2020-11-16T22:15:29.812310+0000 mon.b (mon.1) 318 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:15:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:30 smithi195 bash[10218]: audit 2020-11-16T22:15:29.812695+0000 mon.b (mon.1) 319 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:15:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:30 smithi195 bash[10218]: audit 2020-11-16T22:15:29.813157+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:15:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:30 smithi195 bash[10218]: audit 2020-11-16T22:15:29.813700+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:15:30.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:30 smithi195 bash[10218]: cluster 2020-11-16T22:15:30.216730+0000 mon.a (mon.0) 1579 : cluster [DBG] osdmap e901: 12 total, 12 up, 12 in 2020-11-16T22:15:30.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:30 smithi057 bash[10301]: audit 2020-11-16T22:15:29.812310+0000 mon.b (mon.1) 318 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:15:30.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:30 smithi057 bash[10301]: audit 2020-11-16T22:15:29.812695+0000 mon.b (mon.1) 319 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:15:30.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:30 smithi057 bash[10301]: audit 2020-11-16T22:15:29.813157+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:15:30.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:30 smithi057 bash[10301]: audit 2020-11-16T22:15:29.813700+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:15:30.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:30 smithi057 bash[10301]: cluster 2020-11-16T22:15:30.216730+0000 mon.a (mon.0) 1579 : cluster [DBG] osdmap e901: 12 total, 12 up, 12 in 2020-11-16T22:15:31.208 INFO:tasks.rados.rados.2.smithi057.stdout:3620: done (0 left) 2020-11-16T22:15:31.208 INFO:tasks.rados.rados.2.smithi057.stdout:3621: snap_create 2020-11-16T22:15:31.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:31 smithi016 bash[10302]: cluster 2020-11-16T22:15:29.857343+0000 mgr.x (mgr.24115) 686 : cluster [DBG] pgmap v1516: 17 pgs: 17 active+clean; 497 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.1 MiB/s wr, 8 op/s 2020-11-16T22:15:31.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:31 smithi016 bash[10302]: cluster 2020-11-16T22:15:31.219065+0000 mon.a (mon.0) 1580 : cluster [DBG] osdmap e902: 12 total, 12 up, 12 in 2020-11-16T22:15:31.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:31 smithi195 bash[10218]: cluster 2020-11-16T22:15:29.857343+0000 mgr.x (mgr.24115) 686 : cluster [DBG] pgmap v1516: 17 pgs: 17 active+clean; 497 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.1 MiB/s wr, 8 op/s 2020-11-16T22:15:31.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:31 smithi195 bash[10218]: cluster 2020-11-16T22:15:31.219065+0000 mon.a (mon.0) 1580 : cluster [DBG] osdmap e902: 12 total, 12 up, 12 in 2020-11-16T22:15:31.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:31 smithi057 bash[10301]: cluster 2020-11-16T22:15:29.857343+0000 mgr.x (mgr.24115) 686 : cluster [DBG] pgmap v1516: 17 pgs: 17 active+clean; 497 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 2.1 MiB/s wr, 8 op/s 2020-11-16T22:15:31.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:31 smithi057 bash[10301]: cluster 2020-11-16T22:15:31.219065+0000 mon.a (mon.0) 1580 : cluster [DBG] osdmap e902: 12 total, 12 up, 12 in 2020-11-16T22:15:32.212 INFO:tasks.rados.rados.2.smithi057.stdout:3621: done (0 left) 2020-11-16T22:15:32.212 INFO:tasks.rados.rados.2.smithi057.stdout:3622: read oid 28 snap 415 2020-11-16T22:15:32.212 INFO:tasks.rados.rados.2.smithi057.stdout:3622: expect (ObjNum 1114 snap 387 seq_num 1114) 2020-11-16T22:15:32.212 INFO:tasks.rados.rados.2.smithi057.stdout:3623: write oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 431 2020-11-16T22:15:32.212 INFO:tasks.rados.rados.2.smithi057.stdout:3623: seq_num 1217 ranges {454119=594513,1515880=556760} 2020-11-16T22:15:32.225 INFO:tasks.rados.rados.2.smithi057.stdout:3623: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 454119 to 1048632 tid 1 2020-11-16T22:15:32.232 INFO:tasks.rados.rados.2.smithi057.stdout:3623: writing smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1515880 to 2072640 tid 2 2020-11-16T22:15:32.232 INFO:tasks.rados.rados.2.smithi057.stdout:3624: read oid 12 snap 418 2020-11-16T22:15:32.232 INFO:tasks.rados.rados.2.smithi057.stdout:3624: expect (ObjNum 1133 snap 393 seq_num 1133) 2020-11-16T22:15:32.232 INFO:tasks.rados.rados.2.smithi057.stdout:3625: snap_create 2020-11-16T22:15:32.232 INFO:tasks.rados.rados.2.smithi057.stdout:3622: expect (ObjNum 1114 snap 387 seq_num 1114) 2020-11-16T22:15:32.511 INFO:tasks.rados.rados.2.smithi057.stdout:3623: finishing write tid 1 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:32.511 INFO:tasks.rados.rados.2.smithi057.stdout:3624: expect (ObjNum 1133 snap 393 seq_num 1133) 2020-11-16T22:15:32.602 INFO:tasks.rados.rados.2.smithi057.stdout:3623: finishing write tid 2 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:32.602 INFO:tasks.rados.rados.2.smithi057.stdout:3623: finishing write tid 4 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:32.602 INFO:tasks.rados.rados.2.smithi057.stdout:3623: finishing write tid 5 to smithi05720651-23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:32.603 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2723 (ObjNum 1217 snap 431 seq_num 1217) dirty exists 2020-11-16T22:15:32.603 INFO:tasks.rados.rados.2.smithi057.stdout:3623: left oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1217 snap 431 seq_num 1217) 2020-11-16T22:15:33.219 INFO:tasks.rados.rados.2.smithi057.stdout:3622: done (3 left) 2020-11-16T22:15:33.220 INFO:tasks.rados.rados.2.smithi057.stdout:3623: done (2 left) 2020-11-16T22:15:33.220 INFO:tasks.rados.rados.2.smithi057.stdout:3624: done (1 left) 2020-11-16T22:15:33.220 INFO:tasks.rados.rados.2.smithi057.stdout:3625: done (0 left) 2020-11-16T22:15:33.220 INFO:tasks.rados.rados.2.smithi057.stdout:3626: copy_from oid 16 from oid 18 current snap is 432 2020-11-16T22:15:33.220 INFO:tasks.rados.rados.2.smithi057.stdout:3627: read oid 10 snap -1 2020-11-16T22:15:33.220 INFO:tasks.rados.rados.2.smithi057.stdout:3627: expect deleted 2020-11-16T22:15:33.221 INFO:tasks.rados.rados.2.smithi057.stdout:3628: write oid 46 current snap is 432 2020-11-16T22:15:33.221 INFO:tasks.rados.rados.2.smithi057.stdout:3628: seq_num 1218 ranges {470926=669762,1574362=700418} 2020-11-16T22:15:33.229 INFO:tasks.rados.rados.2.smithi057.stdout:3628: writing smithi05720651-46 from 470926 to 1140688 tid 1 2020-11-16T22:15:33.237 INFO:tasks.rados.rados.2.smithi057.stdout:3628: writing smithi05720651-46 from 1574362 to 2274780 tid 2 2020-11-16T22:15:33.237 INFO:tasks.rados.rados.2.smithi057.stdout:3629: read oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:15:33.238 INFO:tasks.rados.rados.2.smithi057.stdout:3629: expect (ObjNum 1195 snap 413 seq_num 1195) 2020-11-16T22:15:33.238 INFO:tasks.rados.rados.2.smithi057.stdout:3630: delete oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 432 2020-11-16T22:15:33.238 INFO:tasks.rados.rados.2.smithi057.stdout:3626: finishing copy_from to smithi05720651-16 2020-11-16T22:15:33.238 INFO:tasks.rados.rados.2.smithi057.stdout:3626: got expected ENOENT (src dne) 2020-11-16T22:15:33.238 INFO:tasks.rados.rados.2.smithi057.stdout:3626: finishing copy_from racing read to smithi05720651-16 2020-11-16T22:15:33.238 INFO:tasks.rados.rados.2.smithi057.stdout:3628: finishing write tid 1 to smithi05720651-46 2020-11-16T22:15:33.242 INFO:tasks.rados.rados.2.smithi057.stdout:3626: done (4 left) 2020-11-16T22:15:33.242 INFO:tasks.rados.rados.2.smithi057.stdout:3627: done (3 left) 2020-11-16T22:15:33.242 INFO:tasks.rados.rados.2.smithi057.stdout:3630: done (2 left) 2020-11-16T22:15:33.242 INFO:tasks.rados.rados.2.smithi057.stdout:3631: snap_create 2020-11-16T22:15:33.248 INFO:tasks.rados.rados.2.smithi057.stdout:3628: finishing write tid 2 to smithi05720651-46 2020-11-16T22:15:33.249 INFO:tasks.rados.rados.2.smithi057.stdout:3628: finishing write tid 4 to smithi05720651-46 2020-11-16T22:15:33.249 INFO:tasks.rados.rados.2.smithi057.stdout:3628: finishing write tid 5 to smithi05720651-46 2020-11-16T22:15:33.249 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 2618 (ObjNum 1218 snap 432 seq_num 1218) dirty exists 2020-11-16T22:15:33.249 INFO:tasks.rados.rados.2.smithi057.stdout:3628: left oid 46 (ObjNum 1218 snap 432 seq_num 1218) 2020-11-16T22:15:33.249 INFO:tasks.rados.rados.2.smithi057.stdout:3629: expect (ObjNum 1195 snap 413 seq_num 1195) 2020-11-16T22:15:33.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:33 smithi016 bash[10302]: cluster 2020-11-16T22:15:31.858058+0000 mgr.x (mgr.24115) 687 : cluster [DBG] pgmap v1519: 17 pgs: 17 active+clean; 491 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 964 KiB/s wr, 6 op/s 2020-11-16T22:15:33.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:33 smithi016 bash[10302]: cluster 2020-11-16T22:15:32.222046+0000 mon.a (mon.0) 1581 : cluster [DBG] osdmap e903: 12 total, 12 up, 12 in 2020-11-16T22:15:33.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:33 smithi195 bash[10218]: cluster 2020-11-16T22:15:31.858058+0000 mgr.x (mgr.24115) 687 : cluster [DBG] pgmap v1519: 17 pgs: 17 active+clean; 491 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 964 KiB/s wr, 6 op/s 2020-11-16T22:15:33.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:33 smithi195 bash[10218]: cluster 2020-11-16T22:15:32.222046+0000 mon.a (mon.0) 1581 : cluster [DBG] osdmap e903: 12 total, 12 up, 12 in 2020-11-16T22:15:33.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:33 smithi057 bash[10301]: cluster 2020-11-16T22:15:31.858058+0000 mgr.x (mgr.24115) 687 : cluster [DBG] pgmap v1519: 17 pgs: 17 active+clean; 491 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 964 KiB/s wr, 6 op/s 2020-11-16T22:15:33.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:33 smithi057 bash[10301]: cluster 2020-11-16T22:15:32.222046+0000 mon.a (mon.0) 1581 : cluster [DBG] osdmap e903: 12 total, 12 up, 12 in 2020-11-16T22:15:34.230 INFO:tasks.rados.rados.2.smithi057.stdout:3628: done (2 left) 2020-11-16T22:15:34.231 INFO:tasks.rados.rados.2.smithi057.stdout:3629: done (1 left) 2020-11-16T22:15:34.231 INFO:tasks.rados.rados.2.smithi057.stdout:3631: done (0 left) 2020-11-16T22:15:34.231 INFO:tasks.rados.rados.2.smithi057.stdout:3632: rollback oid 50 current snap is 433 2020-11-16T22:15:34.231 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 50 to 427 2020-11-16T22:15:34.231 INFO:tasks.rados.rados.2.smithi057.stdout:3633: read oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:15:34.231 INFO:tasks.rados.rados.2.smithi057.stdout:3633: expect (ObjNum 1202 snap 419 seq_num 1202) 2020-11-16T22:15:34.231 INFO:tasks.rados.rados.2.smithi057.stdout:3634: write oid 28 current snap is 433 2020-11-16T22:15:34.232 INFO:tasks.rados.rados.2.smithi057.stdout:3634: seq_num 1220 ranges {504540=420260,1574973=704087} 2020-11-16T22:15:34.243 INFO:tasks.rados.rados.2.smithi057.stdout:3634: writing smithi05720651-28 from 504540 to 924800 tid 1 2020-11-16T22:15:34.251 INFO:tasks.rados.rados.2.smithi057.stdout:3634: writing smithi05720651-28 from 1574973 to 2279060 tid 2 2020-11-16T22:15:34.252 INFO:tasks.rados.rados.2.smithi057.stdout:3635: read oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 418 2020-11-16T22:15:34.252 INFO:tasks.rados.rados.2.smithi057.stdout:3635: expect (ObjNum 1162 snap 402 seq_num 1162) 2020-11-16T22:15:34.252 INFO:tasks.rados.rados.2.smithi057.stdout:3636: rollback oid 38 current snap is 433 2020-11-16T22:15:34.252 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 38 to 366 2020-11-16T22:15:34.252 INFO:tasks.rados.rados.2.smithi057.stdout:3632: finishing rollback tid 1 to smithi05720651-50 2020-11-16T22:15:34.252 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 2707 (ObjNum 321 snap 0 seq_num 0) dirty dne 2020-11-16T22:15:34.253 INFO:tasks.rados.rados.2.smithi057.stdout:3633: expect (ObjNum 1202 snap 419 seq_num 1202) 2020-11-16T22:15:34.373 INFO:tasks.rados.rados.2.smithi057.stdout:3634: finishing write tid 1 to smithi05720651-28 2020-11-16T22:15:34.373 INFO:tasks.rados.rados.2.smithi057.stdout:3634: finishing write tid 2 to smithi05720651-28 2020-11-16T22:15:34.374 INFO:tasks.rados.rados.2.smithi057.stdout:3634: finishing write tid 4 to smithi05720651-28 2020-11-16T22:15:34.374 INFO:tasks.rados.rados.2.smithi057.stdout:3634: finishing write tid 5 to smithi05720651-28 2020-11-16T22:15:34.374 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 2541 (ObjNum 1220 snap 433 seq_num 1220) dirty exists 2020-11-16T22:15:34.374 INFO:tasks.rados.rados.2.smithi057.stdout:3634: left oid 28 (ObjNum 1220 snap 433 seq_num 1220) 2020-11-16T22:15:34.374 INFO:tasks.rados.rados.2.smithi057.stdout:3632: done (4 left) 2020-11-16T22:15:34.374 INFO:tasks.rados.rados.2.smithi057.stdout:3633: done (3 left) 2020-11-16T22:15:34.374 INFO:tasks.rados.rados.2.smithi057.stdout:3634: done (2 left) 2020-11-16T22:15:34.375 INFO:tasks.rados.rados.2.smithi057.stdout:3637: read oid 14 snap 430 2020-11-16T22:15:34.375 INFO:tasks.rados.rados.2.smithi057.stdout:3637: expect deleted 2020-11-16T22:15:34.375 INFO:tasks.rados.rados.2.smithi057.stdout:3638: delete oid 20 current snap is 433 2020-11-16T22:15:34.375 INFO:tasks.rados.rados.2.smithi057.stdout:3635: expect (ObjNum 1162 snap 402 seq_num 1162) 2020-11-16T22:15:34.529 INFO:tasks.rados.rados.2.smithi057.stdout:3636: finishing rollback tid 0 to smithi05720651-38 2020-11-16T22:15:34.529 INFO:tasks.rados.rados.2.smithi057.stdout:3636: finishing rollback tid 1 to smithi05720651-38 2020-11-16T22:15:34.529 INFO:tasks.rados.rados.2.smithi057.stdout:3636: finishing rollback tid 2 to smithi05720651-38 2020-11-16T22:15:34.530 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 2414 (ObjNum 941 snap 324 seq_num 941) dirty exists 2020-11-16T22:15:34.530 INFO:tasks.rados.rados.2.smithi057.stdout:3635: done (3 left) 2020-11-16T22:15:34.530 INFO:tasks.rados.rados.2.smithi057.stdout:3636: done (2 left) 2020-11-16T22:15:34.530 INFO:tasks.rados.rados.2.smithi057.stdout:3637: done (1 left) 2020-11-16T22:15:34.530 INFO:tasks.rados.rados.2.smithi057.stdout:3638: done (0 left) 2020-11-16T22:15:34.530 INFO:tasks.rados.rados.2.smithi057.stdout:3639: write (excl) oid 44 current snap is 433 2020-11-16T22:15:34.530 INFO:tasks.rados.rados.2.smithi057.stdout:3639: seq_num 1222 ranges {538154=570758,1691937=707756} 2020-11-16T22:15:34.541 INFO:tasks.rados.rados.2.smithi057.stdout:3639: writing smithi05720651-44 from 538154 to 1108912 tid 1 2020-11-16T22:15:34.549 INFO:tasks.rados.rados.2.smithi057.stdout:3639: writing smithi05720651-44 from 1691937 to 2399693 tid 2 2020-11-16T22:15:34.549 INFO:tasks.rados.rados.2.smithi057.stdout:3640: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 366 2020-11-16T22:15:34.549 INFO:tasks.rados.rados.2.smithi057.stdout:3640: expect (ObjNum 1007 snap 351 seq_num 1007) 2020-11-16T22:15:34.549 INFO:tasks.rados.rados.2.smithi057.stdout:3641: read oid 6 snap -1 2020-11-16T22:15:34.550 INFO:tasks.rados.rados.2.smithi057.stdout:3641: expect (ObjNum 1203 snap 419 seq_num 1203) 2020-11-16T22:15:34.550 INFO:tasks.rados.rados.2.smithi057.stdout:3642: read oid 20 snap -1 2020-11-16T22:15:34.550 INFO:tasks.rados.rados.2.smithi057.stdout:3642: expect deleted 2020-11-16T22:15:34.550 INFO:tasks.rados.rados.2.smithi057.stdout:3643: delete oid 12 current snap is 433 2020-11-16T22:15:34.554 INFO:tasks.rados.rados.2.smithi057.stdout:3639: finishing write tid 1 to smithi05720651-44 2020-11-16T22:15:34.558 INFO:tasks.rados.rados.2.smithi057.stdout:3642: done (4 left) 2020-11-16T22:15:34.559 INFO:tasks.rados.rados.2.smithi057.stdout:3643: done (3 left) 2020-11-16T22:15:34.559 INFO:tasks.rados.rados.2.smithi057.stdout:3644: read oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 381 2020-11-16T22:15:34.559 INFO:tasks.rados.rados.2.smithi057.stdout:3644: expect (ObjNum 1059 snap 372 seq_num 1059) 2020-11-16T22:15:34.559 INFO:tasks.rados.rados.2.smithi057.stdout:3645: write oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 433 2020-11-16T22:15:34.559 INFO:tasks.rados.rados.2.smithi057.stdout:3645: seq_num 1224 ranges {571768=437609,1808901=711425} 2020-11-16T22:15:34.566 INFO:tasks.rados.rados.2.smithi057.stdout:3645: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 571768 to 1009377 tid 1 2020-11-16T22:15:34.575 INFO:tasks.rados.rados.2.smithi057.stdout:3645: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1808901 to 2520326 tid 2 2020-11-16T22:15:34.575 INFO:tasks.rados.rados.2.smithi057.stdout:3646: write (excl) oid 10 current snap is 433 2020-11-16T22:15:34.575 INFO:tasks.rados.rados.2.smithi057.stdout:3646: seq_num 1225 ranges {588575=512858,1867383=455083} 2020-11-16T22:15:34.581 INFO:tasks.rados.rados.2.smithi057.stdout:3646: writing smithi05720651-10 from 588575 to 1101433 tid 1 2020-11-16T22:15:34.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:34 smithi016 bash[10302]: cluster 2020-11-16T22:15:33.230734+0000 mon.a (mon.0) 1582 : cluster [DBG] osdmap e904: 12 total, 12 up, 12 in 2020-11-16T22:15:34.588 INFO:tasks.rados.rados.2.smithi057.stdout:3646: writing smithi05720651-10 from 1867383 to 2322466 tid 2 2020-11-16T22:15:34.588 INFO:tasks.rados.rados.2.smithi057.stdout:3647: snap_remove snap 407 2020-11-16T22:15:34.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:34 smithi195 bash[10218]: cluster 2020-11-16T22:15:33.230734+0000 mon.a (mon.0) 1582 : cluster [DBG] osdmap e904: 12 total, 12 up, 12 in 2020-11-16T22:15:34.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:34 smithi057 bash[10301]: cluster 2020-11-16T22:15:33.230734+0000 mon.a (mon.0) 1582 : cluster [DBG] osdmap e904: 12 total, 12 up, 12 in 2020-11-16T22:15:35.207 INFO:tasks.rados.rados.2.smithi057.stdout:3647: done (6 left) 2020-11-16T22:15:35.207 INFO:tasks.rados.rados.2.smithi057.stdout:3648: read oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:15:35.208 INFO:tasks.rados.rados.2.smithi057.stdout:3648: expect deleted 2020-11-16T22:15:35.208 INFO:tasks.rados.rados.2.smithi057.stdout:3649: write oid 36 current snap is 433 2020-11-16T22:15:35.208 INFO:tasks.rados.rados.2.smithi057.stdout:3649: seq_num 1226 ranges {605382=588107,1925865=679517} 2020-11-16T22:15:35.219 INFO:tasks.rados.rados.2.smithi057.stdout:3649: writing smithi05720651-36 from 605382 to 1193489 tid 1 2020-11-16T22:15:35.228 INFO:tasks.rados.rados.2.smithi057.stdout:3649: writing smithi05720651-36 from 1925865 to 2605382 tid 2 2020-11-16T22:15:35.228 INFO:tasks.rados.rados.2.smithi057.stdout:3639: finishing write tid 2 to smithi05720651-44 2020-11-16T22:15:35.228 INFO:tasks.rados.rados.2.smithi057.stdout:3650: rollback oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 433 2020-11-16T22:15:35.228 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 428 2020-11-16T22:15:35.228 INFO:tasks.rados.rados.2.smithi057.stdout:3640: expect (ObjNum 1007 snap 351 seq_num 1007) 2020-11-16T22:15:35.407 INFO:tasks.rados.rados.2.smithi057.stdout:3641: expect (ObjNum 1203 snap 419 seq_num 1203) 2020-11-16T22:15:35.474 INFO:tasks.rados.rados.2.smithi057.stdout:3644: expect (ObjNum 1059 snap 372 seq_num 1059) 2020-11-16T22:15:35.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:35 smithi016 bash[10302]: cluster 2020-11-16T22:15:33.858717+0000 mgr.x (mgr.24115) 688 : cluster [DBG] pgmap v1522: 17 pgs: 17 active+clean; 491 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 0 B/s wr, 2 op/s 2020-11-16T22:15:35.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:35 smithi016 bash[10302]: cluster 2020-11-16T22:15:34.241255+0000 mon.a (mon.0) 1583 : cluster [DBG] osdmap e905: 12 total, 12 up, 12 in 2020-11-16T22:15:35.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:35 smithi016 bash[10302]: cluster 2020-11-16T22:15:35.218786+0000 mon.a (mon.0) 1584 : cluster [DBG] osdmap e906: 12 total, 12 up, 12 in 2020-11-16T22:15:35.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:35 smithi195 bash[10218]: cluster 2020-11-16T22:15:33.858717+0000 mgr.x (mgr.24115) 688 : cluster [DBG] pgmap v1522: 17 pgs: 17 active+clean; 491 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 0 B/s wr, 2 op/s 2020-11-16T22:15:35.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:35 smithi195 bash[10218]: cluster 2020-11-16T22:15:34.241255+0000 mon.a (mon.0) 1583 : cluster [DBG] osdmap e905: 12 total, 12 up, 12 in 2020-11-16T22:15:35.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:35 smithi195 bash[10218]: cluster 2020-11-16T22:15:35.218786+0000 mon.a (mon.0) 1584 : cluster [DBG] osdmap e906: 12 total, 12 up, 12 in 2020-11-16T22:15:35.644 INFO:tasks.rados.rados.2.smithi057.stdout:3645: finishing write tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:35.644 INFO:tasks.rados.rados.2.smithi057.stdout:3645: finishing write tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:35.644 INFO:tasks.rados.rados.2.smithi057.stdout:3646: finishing write tid 1 to smithi05720651-10 2020-11-16T22:15:35.644 INFO:tasks.rados.rados.2.smithi057.stdout:3646: finishing write tid 2 to smithi05720651-10 2020-11-16T22:15:35.645 INFO:tasks.rados.rados.2.smithi057.stdout:3646: finishing write tid 4 to smithi05720651-10 2020-11-16T22:15:35.645 INFO:tasks.rados.rados.2.smithi057.stdout:3646: finishing write tid 5 to smithi05720651-10 2020-11-16T22:15:35.645 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 2544 (ObjNum 1225 snap 433 seq_num 1225) dirty exists 2020-11-16T22:15:35.645 INFO:tasks.rados.rados.2.smithi057.stdout:3646: left oid 10 (ObjNum 1225 snap 433 seq_num 1225) 2020-11-16T22:15:35.645 INFO:tasks.rados.rados.2.smithi057.stdout:3639: finishing write tid 4 to smithi05720651-44 2020-11-16T22:15:35.645 INFO:tasks.rados.rados.2.smithi057.stdout:3639: finishing write tid 5 to smithi05720651-44 2020-11-16T22:15:35.645 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 2612 (ObjNum 1222 snap 433 seq_num 1222) dirty exists 2020-11-16T22:15:35.646 INFO:tasks.rados.rados.2.smithi057.stdout:3639: left oid 44 (ObjNum 1222 snap 433 seq_num 1222) 2020-11-16T22:15:35.646 INFO:tasks.rados.rados.2.smithi057.stdout:3645: finishing write tid 4 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:35.646 INFO:tasks.rados.rados.2.smithi057.stdout:3645: finishing write tid 5 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:35.646 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2621 (ObjNum 1224 snap 433 seq_num 1224) dirty exists 2020-11-16T22:15:35.646 INFO:tasks.rados.rados.2.smithi057.stdout:3645: left oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1224 snap 433 seq_num 1224) 2020-11-16T22:15:35.646 INFO:tasks.rados.rados.2.smithi057.stdout:3639: done (8 left) 2020-11-16T22:15:35.647 INFO:tasks.rados.rados.2.smithi057.stdout:3640: done (7 left) 2020-11-16T22:15:35.647 INFO:tasks.rados.rados.2.smithi057.stdout:3641: done (6 left) 2020-11-16T22:15:35.647 INFO:tasks.rados.rados.2.smithi057.stdout:3644: done (5 left) 2020-11-16T22:15:35.647 INFO:tasks.rados.rados.2.smithi057.stdout:3645: done (4 left) 2020-11-16T22:15:35.647 INFO:tasks.rados.rados.2.smithi057.stdout:3646: done (3 left) 2020-11-16T22:15:35.647 INFO:tasks.rados.rados.2.smithi057.stdout:3651: snap_remove snap 432 2020-11-16T22:15:35.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:35 smithi057 bash[10301]: cluster 2020-11-16T22:15:33.858717+0000 mgr.x (mgr.24115) 688 : cluster [DBG] pgmap v1522: 17 pgs: 17 active+clean; 491 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 0 B/s wr, 2 op/s 2020-11-16T22:15:35.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:35 smithi057 bash[10301]: cluster 2020-11-16T22:15:34.241255+0000 mon.a (mon.0) 1583 : cluster [DBG] osdmap e905: 12 total, 12 up, 12 in 2020-11-16T22:15:35.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:35 smithi057 bash[10301]: cluster 2020-11-16T22:15:35.218786+0000 mon.a (mon.0) 1584 : cluster [DBG] osdmap e906: 12 total, 12 up, 12 in 2020-11-16T22:15:36.240 INFO:tasks.rados.rados.2.smithi057.stdout:3651: done (3 left) 2020-11-16T22:15:36.240 INFO:tasks.rados.rados.2.smithi057.stdout:3652: write (excl) oid 40 current snap is 433 2020-11-16T22:15:36.240 INFO:tasks.rados.rados.2.smithi057.stdout:3652: seq_num 1227 ranges {622189=663356,1984347=458752} 2020-11-16T22:15:36.254 INFO:tasks.rados.rados.2.smithi057.stdout:3652: writing smithi05720651-40 from 622189 to 1285545 tid 1 2020-11-16T22:15:36.260 INFO:tasks.rados.rados.2.smithi057.stdout:3652: writing smithi05720651-40 from 1984347 to 2443099 tid 2 2020-11-16T22:15:36.261 INFO:tasks.rados.rados.2.smithi057.stdout:3653: delete oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 433 2020-11-16T22:15:36.261 INFO:tasks.rados.rados.2.smithi057.stdout:3649: finishing write tid 1 to smithi05720651-36 2020-11-16T22:15:36.261 INFO:tasks.rados.rados.2.smithi057.stdout:3650: finishing rollback tid 0 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:36.261 INFO:tasks.rados.rados.2.smithi057.stdout:3650: finishing rollback tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:36.261 INFO:tasks.rados.rados.2.smithi057.stdout:3649: finishing write tid 2 to smithi05720651-36 2020-11-16T22:15:36.261 INFO:tasks.rados.rados.2.smithi057.stdout:3650: finishing rollback tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:36.261 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2243 (ObjNum 1202 snap 419 seq_num 1202) dirty exists 2020-11-16T22:15:36.262 INFO:tasks.rados.rados.2.smithi057.stdout:3649: finishing write tid 4 to smithi05720651-36 2020-11-16T22:15:36.262 INFO:tasks.rados.rados.2.smithi057.stdout:3649: finishing write tid 5 to smithi05720651-36 2020-11-16T22:15:36.262 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 2547 (ObjNum 1226 snap 433 seq_num 1226) dirty exists 2020-11-16T22:15:36.262 INFO:tasks.rados.rados.2.smithi057.stdout:3649: left oid 36 (ObjNum 1226 snap 433 seq_num 1226) 2020-11-16T22:15:36.270 INFO:tasks.rados.rados.2.smithi057.stdout:3652: finishing write tid 1 to smithi05720651-40 2020-11-16T22:15:36.271 INFO:tasks.rados.rados.2.smithi057.stdout:3648: done (4 left) 2020-11-16T22:15:36.271 INFO:tasks.rados.rados.2.smithi057.stdout:3649: done (3 left) 2020-11-16T22:15:36.271 INFO:tasks.rados.rados.2.smithi057.stdout:3650: done (2 left) 2020-11-16T22:15:36.271 INFO:tasks.rados.rados.2.smithi057.stdout:3653: done (1 left) 2020-11-16T22:15:36.272 INFO:tasks.rados.rados.2.smithi057.stdout:3654: write (excl) oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 433 2020-11-16T22:15:36.272 INFO:tasks.rados.rados.2.smithi057.stdout:3654: seq_num 1229 ranges {655803=413854,1584958=462421} 2020-11-16T22:15:36.278 INFO:tasks.rados.rados.2.smithi057.stdout:3654: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 655803 to 1069657 tid 1 2020-11-16T22:15:36.287 INFO:tasks.rados.rados.2.smithi057.stdout:3654: writing smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1584958 to 2047379 tid 2 2020-11-16T22:15:36.287 INFO:tasks.rados.rados.2.smithi057.stdout:3655: delete oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 433 2020-11-16T22:15:36.287 INFO:tasks.rados.rados.2.smithi057.stdout:3652: finishing write tid 2 to smithi05720651-40 2020-11-16T22:15:36.287 INFO:tasks.rados.rados.2.smithi057.stdout:3652: finishing write tid 4 to smithi05720651-40 2020-11-16T22:15:36.287 INFO:tasks.rados.rados.2.smithi057.stdout:3652: finishing write tid 5 to smithi05720651-40 2020-11-16T22:15:36.288 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 3046 (ObjNum 1227 snap 433 seq_num 1227) dirty exists 2020-11-16T22:15:36.288 INFO:tasks.rados.rados.2.smithi057.stdout:3652: left oid 40 (ObjNum 1227 snap 433 seq_num 1227) 2020-11-16T22:15:36.288 INFO:tasks.rados.rados.2.smithi057.stdout:3654: finishing write tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:36.295 INFO:tasks.rados.rados.2.smithi057.stdout:3654: finishing write tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:36.295 INFO:tasks.rados.rados.2.smithi057.stdout:3654: finishing write tid 4 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:36.296 INFO:tasks.rados.rados.2.smithi057.stdout:3654: finishing write tid 5 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:36.296 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2713 (ObjNum 1229 snap 433 seq_num 1229) dirty exists 2020-11-16T22:15:36.296 INFO:tasks.rados.rados.2.smithi057.stdout:3654: left oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1229 snap 433 seq_num 1229) 2020-11-16T22:15:36.298 INFO:tasks.rados.rados.2.smithi057.stdout:3652: done (2 left) 2020-11-16T22:15:36.298 INFO:tasks.rados.rados.2.smithi057.stdout:3654: done (1 left) 2020-11-16T22:15:36.299 INFO:tasks.rados.rados.2.smithi057.stdout:3655: done (0 left) 2020-11-16T22:15:36.299 INFO:tasks.rados.rados.2.smithi057.stdout:3656: copy_from oid 4 from oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 433 2020-11-16T22:15:36.299 INFO:tasks.rados.rados.2.smithi057.stdout:3657: write oid 12 current snap is 433 2020-11-16T22:15:36.299 INFO:tasks.rados.rados.2.smithi057.stdout:3657: seq_num 1231 ranges {689417=564352,1701922=466090} 2020-11-16T22:15:36.311 INFO:tasks.rados.rados.2.smithi057.stdout:3657: writing smithi05720651-12 from 689417 to 1253769 tid 1 2020-11-16T22:15:36.317 INFO:tasks.rados.rados.2.smithi057.stdout:3657: writing smithi05720651-12 from 1701922 to 2168012 tid 2 2020-11-16T22:15:36.317 INFO:tasks.rados.rados.2.smithi057.stdout:3658: copy_from oid 22 from oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 433 2020-11-16T22:15:36.317 INFO:tasks.rados.rados.2.smithi057.stdout:3657: finishing write tid 1 to smithi05720651-12 2020-11-16T22:15:36.317 INFO:tasks.rados.rados.2.smithi057.stdout:3659: write oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 433 2020-11-16T22:15:36.317 INFO:tasks.rados.rados.2.smithi057.stdout:3659: seq_num 1232 ranges {706224=755954,2160404=545820} 2020-11-16T22:15:36.325 INFO:tasks.rados.rados.2.smithi057.stdout:3659: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 706224 to 1462178 tid 1 2020-11-16T22:15:36.332 INFO:tasks.rados.rados.2.smithi057.stdout:3659: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2160404 to 2706224 tid 2 2020-11-16T22:15:36.333 INFO:tasks.rados.rados.2.smithi057.stdout:3660: write oid 18 current snap is 433 2020-11-16T22:15:36.333 INFO:tasks.rados.rados.2.smithi057.stdout:3660: seq_num 1233 ranges {723031=431203,1818886=469759} 2020-11-16T22:15:36.339 INFO:tasks.rados.rados.2.smithi057.stdout:3660: writing smithi05720651-18 from 723031 to 1154234 tid 1 2020-11-16T22:15:36.346 INFO:tasks.rados.rados.2.smithi057.stdout:3660: writing smithi05720651-18 from 1818886 to 2288645 tid 2 2020-11-16T22:15:36.346 INFO:tasks.rados.rados.2.smithi057.stdout:3661: snap_create 2020-11-16T22:15:36.346 INFO:tasks.rados.rados.2.smithi057.stdout:3656: finishing copy_from to smithi05720651-4 2020-11-16T22:15:36.346 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 2823 (ObjNum 1137 snap 394 seq_num 1137) dirty exists 2020-11-16T22:15:36.346 INFO:tasks.rados.rados.2.smithi057.stdout:3656: finishing copy_from racing read to smithi05720651-4 2020-11-16T22:15:36.346 INFO:tasks.rados.rados.2.smithi057.stdout:3657: finishing write tid 2 to smithi05720651-12 2020-11-16T22:15:36.347 INFO:tasks.rados.rados.2.smithi057.stdout:3657: finishing write tid 4 to smithi05720651-12 2020-11-16T22:15:36.347 INFO:tasks.rados.rados.2.smithi057.stdout:3657: finishing write tid 5 to smithi05720651-12 2020-11-16T22:15:36.347 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 2615 (ObjNum 1231 snap 433 seq_num 1231) dirty exists 2020-11-16T22:15:36.347 INFO:tasks.rados.rados.2.smithi057.stdout:3657: left oid 12 (ObjNum 1231 snap 433 seq_num 1231) 2020-11-16T22:15:36.347 INFO:tasks.rados.rados.2.smithi057.stdout:3658: finishing copy_from to smithi05720651-22 2020-11-16T22:15:36.347 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 2983 (ObjNum 1079 snap 377 seq_num 1079) dirty exists 2020-11-16T22:15:36.347 INFO:tasks.rados.rados.2.smithi057.stdout:3658: finishing copy_from racing read to smithi05720651-22 2020-11-16T22:15:36.348 INFO:tasks.rados.rados.2.smithi057.stdout:3659: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:36.348 INFO:tasks.rados.rados.2.smithi057.stdout:3659: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:36.348 INFO:tasks.rados.rados.2.smithi057.stdout:3659: finishing write tid 4 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:36.348 INFO:tasks.rados.rados.2.smithi057.stdout:3659: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:36.348 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2716 (ObjNum 1232 snap 433 seq_num 1232) dirty exists 2020-11-16T22:15:36.348 INFO:tasks.rados.rados.2.smithi057.stdout:3659: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1232 snap 433 seq_num 1232) 2020-11-16T22:15:36.348 INFO:tasks.rados.rados.2.smithi057.stdout:3660: finishing write tid 1 to smithi05720651-18 2020-11-16T22:15:36.351 INFO:tasks.rados.rados.2.smithi057.stdout:3660: finishing write tid 2 to smithi05720651-18 2020-11-16T22:15:36.352 INFO:tasks.rados.rados.2.smithi057.stdout:3660: finishing write tid 4 to smithi05720651-18 2020-11-16T22:15:36.352 INFO:tasks.rados.rados.2.smithi057.stdout:3660: finishing write tid 5 to smithi05720651-18 2020-11-16T22:15:36.352 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 2726 (ObjNum 1233 snap 433 seq_num 1233) dirty exists 2020-11-16T22:15:36.353 INFO:tasks.rados.rados.2.smithi057.stdout:3660: left oid 18 (ObjNum 1233 snap 433 seq_num 1233) 2020-11-16T22:15:37.251 INFO:tasks.rados.rados.2.smithi057.stdout:3656: done (5 left) 2020-11-16T22:15:37.251 INFO:tasks.rados.rados.2.smithi057.stdout:3657: done (4 left) 2020-11-16T22:15:37.251 INFO:tasks.rados.rados.2.smithi057.stdout:3658: done (3 left) 2020-11-16T22:15:37.252 INFO:tasks.rados.rados.2.smithi057.stdout:3659: done (2 left) 2020-11-16T22:15:37.252 INFO:tasks.rados.rados.2.smithi057.stdout:3660: done (1 left) 2020-11-16T22:15:37.252 INFO:tasks.rados.rados.2.smithi057.stdout:3661: done (0 left) 2020-11-16T22:15:37.252 INFO:tasks.rados.rados.2.smithi057.stdout:3662: read oid 50 snap -1 2020-11-16T22:15:37.252 INFO:tasks.rados.rados.2.smithi057.stdout:3662: expect deleted 2020-11-16T22:15:37.252 INFO:tasks.rados.rados.2.smithi057.stdout:3663: snap_remove snap 424 2020-11-16T22:15:37.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:37 smithi016 bash[10302]: cluster 2020-11-16T22:15:35.859466+0000 mgr.x (mgr.24115) 689 : cluster [DBG] pgmap v1525: 17 pgs: 17 active+clean; 503 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2020-11-16T22:15:37.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:37 smithi016 bash[10302]: cluster 2020-11-16T22:15:36.251017+0000 mon.a (mon.0) 1585 : cluster [DBG] osdmap e907: 12 total, 12 up, 12 in 2020-11-16T22:15:37.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:37 smithi195 bash[10218]: cluster 2020-11-16T22:15:35.859466+0000 mgr.x (mgr.24115) 689 : cluster [DBG] pgmap v1525: 17 pgs: 17 active+clean; 503 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2020-11-16T22:15:37.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:37 smithi195 bash[10218]: cluster 2020-11-16T22:15:36.251017+0000 mon.a (mon.0) 1585 : cluster [DBG] osdmap e907: 12 total, 12 up, 12 in 2020-11-16T22:15:37.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:37 smithi057 bash[10301]: cluster 2020-11-16T22:15:35.859466+0000 mgr.x (mgr.24115) 689 : cluster [DBG] pgmap v1525: 17 pgs: 17 active+clean; 503 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 1.4 MiB/s wr, 26 op/s 2020-11-16T22:15:37.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:37 smithi057 bash[10301]: cluster 2020-11-16T22:15:36.251017+0000 mon.a (mon.0) 1585 : cluster [DBG] osdmap e907: 12 total, 12 up, 12 in 2020-11-16T22:15:38.259 INFO:tasks.rados.rados.2.smithi057.stdout:3663: done (1 left) 2020-11-16T22:15:38.259 INFO:tasks.rados.rados.2.smithi057.stdout:3664: snap_remove snap 429 2020-11-16T22:15:38.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:38 smithi016 bash[10302]: cluster 2020-11-16T22:15:37.261885+0000 mon.a (mon.0) 1586 : cluster [DBG] osdmap e908: 12 total, 12 up, 12 in 2020-11-16T22:15:38.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:38 smithi195 bash[10218]: cluster 2020-11-16T22:15:37.261885+0000 mon.a (mon.0) 1586 : cluster [DBG] osdmap e908: 12 total, 12 up, 12 in 2020-11-16T22:15:38.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:38 smithi057 bash[10301]: cluster 2020-11-16T22:15:37.261885+0000 mon.a (mon.0) 1586 : cluster [DBG] osdmap e908: 12 total, 12 up, 12 in 2020-11-16T22:15:39.270 INFO:tasks.rados.rados.2.smithi057.stdout:3664: done (1 left) 2020-11-16T22:15:39.271 INFO:tasks.rados.rados.2.smithi057.stdout:3665: snap_create 2020-11-16T22:15:39.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:39 smithi016 bash[10302]: cluster 2020-11-16T22:15:37.860172+0000 mgr.x (mgr.24115) 690 : cluster [DBG] pgmap v1528: 17 pgs: 17 active+clean; 511 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 2.9 MiB/s wr, 31 op/s 2020-11-16T22:15:39.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:39 smithi016 bash[10302]: cluster 2020-11-16T22:15:38.270087+0000 mon.a (mon.0) 1587 : cluster [DBG] osdmap e909: 12 total, 12 up, 12 in 2020-11-16T22:15:39.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:39 smithi195 bash[10218]: cluster 2020-11-16T22:15:37.860172+0000 mgr.x (mgr.24115) 690 : cluster [DBG] pgmap v1528: 17 pgs: 17 active+clean; 511 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 2.9 MiB/s wr, 31 op/s 2020-11-16T22:15:39.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:39 smithi195 bash[10218]: cluster 2020-11-16T22:15:38.270087+0000 mon.a (mon.0) 1587 : cluster [DBG] osdmap e909: 12 total, 12 up, 12 in 2020-11-16T22:15:39.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:39 smithi057 bash[10301]: cluster 2020-11-16T22:15:37.860172+0000 mgr.x (mgr.24115) 690 : cluster [DBG] pgmap v1528: 17 pgs: 17 active+clean; 511 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 2.9 MiB/s wr, 31 op/s 2020-11-16T22:15:39.696 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:39 smithi057 bash[10301]: cluster 2020-11-16T22:15:38.270087+0000 mon.a (mon.0) 1587 : cluster [DBG] osdmap e909: 12 total, 12 up, 12 in 2020-11-16T22:15:40.278 INFO:tasks.rados.rados.2.smithi057.stdout:3662: done (1 left) 2020-11-16T22:15:40.279 INFO:tasks.rados.rados.2.smithi057.stdout:3665: done (0 left) 2020-11-16T22:15:40.279 INFO:tasks.rados.rados.2.smithi057.stdout:3666: snap_create 2020-11-16T22:15:40.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:40 smithi016 bash[10302]: cluster 2020-11-16T22:15:39.281242+0000 mon.a (mon.0) 1588 : cluster [DBG] osdmap e910: 12 total, 12 up, 12 in 2020-11-16T22:15:40.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:40 smithi195 bash[10218]: cluster 2020-11-16T22:15:39.281242+0000 mon.a (mon.0) 1588 : cluster [DBG] osdmap e910: 12 total, 12 up, 12 in 2020-11-16T22:15:40.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:40 smithi057 bash[10301]: cluster 2020-11-16T22:15:39.281242+0000 mon.a (mon.0) 1588 : cluster [DBG] osdmap e910: 12 total, 12 up, 12 in 2020-11-16T22:15:41.282 INFO:tasks.rados.rados.2.smithi057.stdout:3666: done (0 left) 2020-11-16T22:15:41.282 INFO:tasks.rados.rados.2.smithi057.stdout:3667: copy_from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 436 2020-11-16T22:15:41.283 INFO:tasks.rados.rados.2.smithi057.stdout:3668: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:15:41.283 INFO:tasks.rados.rados.2.smithi057.stdout:3668: expect deleted 2020-11-16T22:15:41.283 INFO:tasks.rados.rados.2.smithi057.stdout:3669: write (excl) oid 20 current snap is 436 2020-11-16T22:15:41.283 INFO:tasks.rados.rados.2.smithi057.stdout:3669: seq_num 1234 ranges {739838=506452,1877368=613417} 2020-11-16T22:15:41.295 INFO:tasks.rados.rados.2.smithi057.stdout:3669: writing smithi05720651-20 from 739838 to 1246290 tid 1 2020-11-16T22:15:41.303 INFO:tasks.rados.rados.2.smithi057.stdout:3669: writing smithi05720651-20 from 1877368 to 2490785 tid 2 2020-11-16T22:15:41.303 INFO:tasks.rados.rados.2.smithi057.stdout:3670: read oid 16 snap -1 2020-11-16T22:15:41.303 INFO:tasks.rados.rados.2.smithi057.stdout:3670: expect (ObjNum 1187 snap 410 seq_num 1187) 2020-11-16T22:15:41.303 INFO:tasks.rados.rados.2.smithi057.stdout:3671: copy_from oid 48 from oid 42 current snap is 436 2020-11-16T22:15:41.303 INFO:tasks.rados.rados.2.smithi057.stdout:3667: finishing copy_from to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:41.304 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2243 (ObjNum 1202 snap 419 seq_num 1202) dirty exists 2020-11-16T22:15:41.304 INFO:tasks.rados.rados.2.smithi057.stdout:3667: finishing copy_from racing read to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:41.304 INFO:tasks.rados.rados.2.smithi057.stdout:3667: done (4 left) 2020-11-16T22:15:41.304 INFO:tasks.rados.rados.2.smithi057.stdout:3668: done (3 left) 2020-11-16T22:15:41.304 INFO:tasks.rados.rados.2.smithi057.stdout:3672: write (excl) oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 436 2020-11-16T22:15:41.304 INFO:tasks.rados.rados.2.smithi057.stdout:3672: seq_num 1235 ranges {756645=581701,1935850=473428} 2020-11-16T22:15:41.310 INFO:tasks.rados.rados.2.smithi057.stdout:3672: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 756645 to 1338346 tid 1 2020-11-16T22:15:41.316 INFO:tasks.rados.rados.2.smithi057.stdout:3672: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1935850 to 2409278 tid 2 2020-11-16T22:15:41.317 INFO:tasks.rados.rados.2.smithi057.stdout:3673: snap_remove snap 397 2020-11-16T22:15:41.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:41 smithi016 bash[10302]: cluster 2020-11-16T22:15:39.860932+0000 mgr.x (mgr.24115) 691 : cluster [DBG] pgmap v1531: 17 pgs: 17 active+clean; 518 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.6 MiB/s wr, 8 op/s 2020-11-16T22:15:41.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:41 smithi016 bash[10302]: cluster 2020-11-16T22:15:40.289558+0000 mon.a (mon.0) 1589 : cluster [DBG] osdmap e911: 12 total, 12 up, 12 in 2020-11-16T22:15:41.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:41 smithi195 bash[10218]: cluster 2020-11-16T22:15:39.860932+0000 mgr.x (mgr.24115) 691 : cluster [DBG] pgmap v1531: 17 pgs: 17 active+clean; 518 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.6 MiB/s wr, 8 op/s 2020-11-16T22:15:41.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:41 smithi195 bash[10218]: cluster 2020-11-16T22:15:40.289558+0000 mon.a (mon.0) 1589 : cluster [DBG] osdmap e911: 12 total, 12 up, 12 in 2020-11-16T22:15:41.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:41 smithi057 bash[10301]: cluster 2020-11-16T22:15:39.860932+0000 mgr.x (mgr.24115) 691 : cluster [DBG] pgmap v1531: 17 pgs: 17 active+clean; 518 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.6 MiB/s wr, 8 op/s 2020-11-16T22:15:41.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:41 smithi057 bash[10301]: cluster 2020-11-16T22:15:40.289558+0000 mon.a (mon.0) 1589 : cluster [DBG] osdmap e911: 12 total, 12 up, 12 in 2020-11-16T22:15:42.299 INFO:tasks.rados.rados.2.smithi057.stdout:3673: done (4 left) 2020-11-16T22:15:42.300 INFO:tasks.rados.rados.2.smithi057.stdout:3674: snap_remove snap 428 2020-11-16T22:15:42.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:42 smithi016 bash[10302]: cluster 2020-11-16T22:15:41.292325+0000 mon.a (mon.0) 1590 : cluster [DBG] osdmap e912: 12 total, 12 up, 12 in 2020-11-16T22:15:42.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:42 smithi195 bash[10218]: cluster 2020-11-16T22:15:41.292325+0000 mon.a (mon.0) 1590 : cluster [DBG] osdmap e912: 12 total, 12 up, 12 in 2020-11-16T22:15:42.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:42 smithi057 bash[10301]: cluster 2020-11-16T22:15:41.292325+0000 mon.a (mon.0) 1590 : cluster [DBG] osdmap e912: 12 total, 12 up, 12 in 2020-11-16T22:15:43.309 INFO:tasks.rados.rados.2.smithi057.stdout:3674: done (4 left) 2020-11-16T22:15:43.309 INFO:tasks.rados.rados.2.smithi057.stdout:3675: rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 436 2020-11-16T22:15:43.309 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 360 2020-11-16T22:15:43.310 INFO:tasks.rados.rados.2.smithi057.stdout:3669: finishing write tid 1 to smithi05720651-20 2020-11-16T22:15:43.310 INFO:tasks.rados.rados.2.smithi057.stdout:3669: finishing write tid 2 to smithi05720651-20 2020-11-16T22:15:43.310 INFO:tasks.rados.rados.2.smithi057.stdout:3669: finishing write tid 4 to smithi05720651-20 2020-11-16T22:15:43.310 INFO:tasks.rados.rados.2.smithi057.stdout:3669: finishing write tid 5 to smithi05720651-20 2020-11-16T22:15:43.310 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 2826 (ObjNum 1234 snap 436 seq_num 1234) dirty exists 2020-11-16T22:15:43.310 INFO:tasks.rados.rados.2.smithi057.stdout:3669: left oid 20 (ObjNum 1234 snap 436 seq_num 1234) 2020-11-16T22:15:43.311 INFO:tasks.rados.rados.2.smithi057.stdout:3672: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:43.311 INFO:tasks.rados.rados.2.smithi057.stdout:3670: expect (ObjNum 1187 snap 410 seq_num 1187) 2020-11-16T22:15:43.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:43 smithi016 bash[10302]: cluster 2020-11-16T22:15:41.861648+0000 mgr.x (mgr.24115) 692 : cluster [DBG] pgmap v1534: 17 pgs: 17 active+clean; 522 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.6 MiB/s wr, 6 op/s 2020-11-16T22:15:43.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:43 smithi016 bash[10302]: cluster 2020-11-16T22:15:42.310699+0000 mon.a (mon.0) 1591 : cluster [DBG] osdmap e913: 12 total, 12 up, 12 in 2020-11-16T22:15:43.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:43 smithi195 bash[10218]: cluster 2020-11-16T22:15:41.861648+0000 mgr.x (mgr.24115) 692 : cluster [DBG] pgmap v1534: 17 pgs: 17 active+clean; 522 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.6 MiB/s wr, 6 op/s 2020-11-16T22:15:43.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:43 smithi195 bash[10218]: cluster 2020-11-16T22:15:42.310699+0000 mon.a (mon.0) 1591 : cluster [DBG] osdmap e913: 12 total, 12 up, 12 in 2020-11-16T22:15:43.635 INFO:tasks.rados.rados.2.smithi057.stdout:3672: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:43.635 INFO:tasks.rados.rados.2.smithi057.stdout:3672: finishing write tid 4 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:43.635 INFO:tasks.rados.rados.2.smithi057.stdout:3672: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:43.635 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2246 (ObjNum 1235 snap 436 seq_num 1235) dirty exists 2020-11-16T22:15:43.635 INFO:tasks.rados.rados.2.smithi057.stdout:3672: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1235 snap 436 seq_num 1235) 2020-11-16T22:15:43.635 INFO:tasks.rados.rados.2.smithi057.stdout:3671: finishing copy_from to smithi05720651-48 2020-11-16T22:15:43.636 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 2408 (ObjNum 1162 snap 402 seq_num 1162) dirty exists 2020-11-16T22:15:43.636 INFO:tasks.rados.rados.2.smithi057.stdout:3671: finishing copy_from racing read to smithi05720651-48 2020-11-16T22:15:43.636 INFO:tasks.rados.rados.2.smithi057.stdout:3669: done (4 left) 2020-11-16T22:15:43.636 INFO:tasks.rados.rados.2.smithi057.stdout:3670: done (3 left) 2020-11-16T22:15:43.636 INFO:tasks.rados.rados.2.smithi057.stdout:3671: done (2 left) 2020-11-16T22:15:43.636 INFO:tasks.rados.rados.2.smithi057.stdout:3672: done (1 left) 2020-11-16T22:15:43.636 INFO:tasks.rados.rados.2.smithi057.stdout:3676: copy_from oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 24 current snap is 436 2020-11-16T22:15:43.637 INFO:tasks.rados.rados.2.smithi057.stdout:3675: finishing rollback tid 0 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:43.637 INFO:tasks.rados.rados.2.smithi057.stdout:3675: finishing rollback tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:43.637 INFO:tasks.rados.rados.2.smithi057.stdout:3675: finishing rollback tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:43.637 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2719 (ObjNum 899 snap 303 seq_num 899) dirty exists 2020-11-16T22:15:43.637 INFO:tasks.rados.rados.2.smithi057.stdout:3675: done (1 left) 2020-11-16T22:15:43.637 INFO:tasks.rados.rados.2.smithi057.stdout:3677: snap_create 2020-11-16T22:15:43.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:43 smithi057 bash[10301]: cluster 2020-11-16T22:15:41.861648+0000 mgr.x (mgr.24115) 692 : cluster [DBG] pgmap v1534: 17 pgs: 17 active+clean; 522 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1.6 MiB/s wr, 6 op/s 2020-11-16T22:15:43.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:43 smithi057 bash[10301]: cluster 2020-11-16T22:15:42.310699+0000 mon.a (mon.0) 1591 : cluster [DBG] osdmap e913: 12 total, 12 up, 12 in 2020-11-16T22:15:43.886 INFO:tasks.rados.rados.2.smithi057.stdout:3676: finishing copy_from to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:43.886 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2329 (ObjNum 1138 snap 394 seq_num 1138) dirty exists 2020-11-16T22:15:43.887 INFO:tasks.rados.rados.2.smithi057.stdout:3676: finishing copy_from racing read to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:44.319 INFO:tasks.rados.rados.2.smithi057.stdout:3676: done (1 left) 2020-11-16T22:15:44.319 INFO:tasks.rados.rados.2.smithi057.stdout:3677: done (0 left) 2020-11-16T22:15:44.319 INFO:tasks.rados.rados.2.smithi057.stdout:3678: write oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 437 2020-11-16T22:15:44.319 INFO:tasks.rados.rados.2.smithi057.stdout:3678: seq_num 1236 ranges {773452=656950,1877979=617086} 2020-11-16T22:15:44.334 INFO:tasks.rados.rados.2.smithi057.stdout:3678: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 773452 to 1430402 tid 1 2020-11-16T22:15:44.340 INFO:tasks.rados.rados.2.smithi057.stdout:3678: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1877979 to 2495065 tid 2 2020-11-16T22:15:44.341 INFO:tasks.rados.rados.2.smithi057.stdout:3679: delete oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 437 2020-11-16T22:15:44.346 INFO:tasks.rados.rados.2.smithi057.stdout:3679: done (1 left) 2020-11-16T22:15:44.346 INFO:tasks.rados.rados.2.smithi057.stdout:3680: read oid 2 snap 425 2020-11-16T22:15:44.347 INFO:tasks.rados.rados.2.smithi057.stdout:3680: expect (ObjNum 1143 snap 397 seq_num 1143) 2020-11-16T22:15:44.347 INFO:tasks.rados.rados.2.smithi057.stdout:3681: read oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:15:44.347 INFO:tasks.rados.rados.2.smithi057.stdout:3681: expect (ObjNum 1175 snap 407 seq_num 1175) 2020-11-16T22:15:44.347 INFO:tasks.rados.rados.2.smithi057.stdout:3682: rollback oid 30 current snap is 437 2020-11-16T22:15:44.347 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 30 to 427 2020-11-16T22:15:44.347 INFO:tasks.rados.rados.2.smithi057.stdout:3683: write (excl) oid 4 current snap is 437 2020-11-16T22:15:44.348 INFO:tasks.rados.rados.2.smithi057.stdout:3683: seq_num 1238 ranges {407066=407448,1594943=620755} 2020-11-16T22:15:44.351 INFO:tasks.rados.rados.2.smithi057.stdout:3683: writing smithi05720651-4 from 407066 to 814514 tid 1 2020-11-16T22:15:44.360 INFO:tasks.rados.rados.2.smithi057.stdout:3683: writing smithi05720651-4 from 1594943 to 2215698 tid 2 2020-11-16T22:15:44.360 INFO:tasks.rados.rados.2.smithi057.stdout:3684: write oid 8 current snap is 437 2020-11-16T22:15:44.361 INFO:tasks.rados.rados.2.smithi057.stdout:3684: seq_num 1239 ranges {423873=482697,1653425=480766,2691441=132432} 2020-11-16T22:15:44.367 INFO:tasks.rados.rados.2.smithi057.stdout:3684: writing smithi05720651-8 from 423873 to 906570 tid 1 2020-11-16T22:15:44.374 INFO:tasks.rados.rados.2.smithi057.stdout:3684: writing smithi05720651-8 from 1653425 to 2134191 tid 2 2020-11-16T22:15:44.378 INFO:tasks.rados.rados.2.smithi057.stdout:3684: writing smithi05720651-8 from 2691441 to 2823873 tid 3 2020-11-16T22:15:44.379 INFO:tasks.rados.rados.2.smithi057.stdout:3685: delete oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 437 2020-11-16T22:15:44.379 INFO:tasks.rados.rados.2.smithi057.stdout:3678: finishing write tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:44.379 INFO:tasks.rados.rados.2.smithi057.stdout:3678: finishing write tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:44.379 INFO:tasks.rados.rados.2.smithi057.stdout:3678: finishing write tid 4 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:44.379 INFO:tasks.rados.rados.2.smithi057.stdout:3678: finishing write tid 5 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:44.379 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2624 (ObjNum 1236 snap 437 seq_num 1236) dirty exists 2020-11-16T22:15:44.380 INFO:tasks.rados.rados.2.smithi057.stdout:3678: left oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1236 snap 437 seq_num 1236) 2020-11-16T22:15:44.380 INFO:tasks.rados.rados.2.smithi057.stdout:3683: finishing write tid 1 to smithi05720651-4 2020-11-16T22:15:44.380 INFO:tasks.rados.rados.2.smithi057.stdout:3680: expect (ObjNum 1143 snap 397 seq_num 1143) 2020-11-16T22:15:44.560 INFO:tasks.rados.rados.2.smithi057.stdout:3681: expect (ObjNum 1175 snap 407 seq_num 1175) 2020-11-16T22:15:44.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:44 smithi016 bash[10302]: cluster 2020-11-16T22:15:43.319987+0000 mon.a (mon.0) 1592 : cluster [DBG] osdmap e914: 12 total, 12 up, 12 in 2020-11-16T22:15:44.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:44 smithi195 bash[10218]: cluster 2020-11-16T22:15:43.319987+0000 mon.a (mon.0) 1592 : cluster [DBG] osdmap e914: 12 total, 12 up, 12 in 2020-11-16T22:15:44.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:44 smithi057 bash[10301]: cluster 2020-11-16T22:15:43.319987+0000 mon.a (mon.0) 1592 : cluster [DBG] osdmap e914: 12 total, 12 up, 12 in 2020-11-16T22:15:44.727 INFO:tasks.rados.rados.2.smithi057.stdout:3682: finishing rollback tid 0 to smithi05720651-30 2020-11-16T22:15:44.728 INFO:tasks.rados.rados.2.smithi057.stdout:3682: finishing rollback tid 1 to smithi05720651-30 2020-11-16T22:15:44.728 INFO:tasks.rados.rados.2.smithi057.stdout:3682: finishing rollback tid 2 to smithi05720651-30 2020-11-16T22:15:44.728 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 30 v 2627 (ObjNum 1180 snap 407 seq_num 1180) dirty exists 2020-11-16T22:15:44.728 INFO:tasks.rados.rados.2.smithi057.stdout:3683: finishing write tid 2 to smithi05720651-4 2020-11-16T22:15:44.728 INFO:tasks.rados.rados.2.smithi057.stdout:3683: finishing write tid 4 to smithi05720651-4 2020-11-16T22:15:44.729 INFO:tasks.rados.rados.2.smithi057.stdout:3683: finishing write tid 5 to smithi05720651-4 2020-11-16T22:15:44.729 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 2829 (ObjNum 1238 snap 437 seq_num 1238) dirty exists 2020-11-16T22:15:44.729 INFO:tasks.rados.rados.2.smithi057.stdout:3683: left oid 4 (ObjNum 1238 snap 437 seq_num 1238) 2020-11-16T22:15:44.729 INFO:tasks.rados.rados.2.smithi057.stdout:3678: done (6 left) 2020-11-16T22:15:44.729 INFO:tasks.rados.rados.2.smithi057.stdout:3680: done (5 left) 2020-11-16T22:15:44.729 INFO:tasks.rados.rados.2.smithi057.stdout:3681: done (4 left) 2020-11-16T22:15:44.729 INFO:tasks.rados.rados.2.smithi057.stdout:3682: done (3 left) 2020-11-16T22:15:44.730 INFO:tasks.rados.rados.2.smithi057.stdout:3683: done (2 left) 2020-11-16T22:15:44.730 INFO:tasks.rados.rados.2.smithi057.stdout:3685: done (1 left) 2020-11-16T22:15:44.730 INFO:tasks.rados.rados.2.smithi057.stdout:3686: read oid 20 snap 413 2020-11-16T22:15:44.730 INFO:tasks.rados.rados.2.smithi057.stdout:3686: expect (ObjNum 1190 snap 412 seq_num 1190) 2020-11-16T22:15:44.730 INFO:tasks.rados.rados.2.smithi057.stdout:3687: write (excl) oid 6 current snap is 437 2020-11-16T22:15:44.730 INFO:tasks.rados.rados.2.smithi057.stdout:3687: seq_num 1241 ranges {457487=749548,1770389=484435,2746287=111200} 2020-11-16T22:15:44.734 INFO:tasks.rados.rados.2.smithi057.stdout:3687: writing smithi05720651-6 from 457487 to 1207035 tid 1 2020-11-16T22:15:44.740 INFO:tasks.rados.rados.2.smithi057.stdout:3687: writing smithi05720651-6 from 1770389 to 2254824 tid 2 2020-11-16T22:15:44.743 INFO:tasks.rados.rados.2.smithi057.stdout:3687: writing smithi05720651-6 from 2746287 to 2857487 tid 3 2020-11-16T22:15:44.743 INFO:tasks.rados.rados.2.smithi057.stdout:3688: read oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 341 2020-11-16T22:15:44.744 INFO:tasks.rados.rados.2.smithi057.stdout:3688: expect (ObjNum 965 snap 333 seq_num 965) 2020-11-16T22:15:44.744 INFO:tasks.rados.rados.2.smithi057.stdout:3689: copy_from oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 16 current snap is 437 2020-11-16T22:15:44.744 INFO:tasks.rados.rados.2.smithi057.stdout:3684: finishing write tid 1 to smithi05720651-8 2020-11-16T22:15:44.744 INFO:tasks.rados.rados.2.smithi057.stdout:3684: finishing write tid 2 to smithi05720651-8 2020-11-16T22:15:44.744 INFO:tasks.rados.rados.2.smithi057.stdout:3684: finishing write tid 3 to smithi05720651-8 2020-11-16T22:15:44.744 INFO:tasks.rados.rados.2.smithi057.stdout:3684: finishing write tid 5 to smithi05720651-8 2020-11-16T22:15:44.745 INFO:tasks.rados.rados.2.smithi057.stdout:3684: finishing write tid 6 to smithi05720651-8 2020-11-16T22:15:44.745 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 2876 (ObjNum 1239 snap 437 seq_num 1239) dirty exists 2020-11-16T22:15:44.745 INFO:tasks.rados.rados.2.smithi057.stdout:3684: left oid 8 (ObjNum 1239 snap 437 seq_num 1239) 2020-11-16T22:15:44.745 INFO:tasks.rados.rados.2.smithi057.stdout:3686: expect (ObjNum 1190 snap 412 seq_num 1190) 2020-11-16T22:15:44.818 INFO:tasks.rados.rados.2.smithi057.stdout:3687: finishing write tid 1 to smithi05720651-6 2020-11-16T22:15:44.818 INFO:tasks.rados.rados.2.smithi057.stdout:3688: expect (ObjNum 965 snap 333 seq_num 965) 2020-11-16T22:15:44.909 INFO:tasks.rados.rados.2.smithi057.stdout:3687: finishing write tid 2 to smithi05720651-6 2020-11-16T22:15:44.909 INFO:tasks.rados.rados.2.smithi057.stdout:3687: finishing write tid 3 to smithi05720651-6 2020-11-16T22:15:44.909 INFO:tasks.rados.rados.2.smithi057.stdout:3684: done (4 left) 2020-11-16T22:15:44.909 INFO:tasks.rados.rados.2.smithi057.stdout:3686: done (3 left) 2020-11-16T22:15:44.909 INFO:tasks.rados.rados.2.smithi057.stdout:3688: done (2 left) 2020-11-16T22:15:44.910 INFO:tasks.rados.rados.2.smithi057.stdout:3690: rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 437 2020-11-16T22:15:44.910 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 427 2020-11-16T22:15:44.910 INFO:tasks.rados.rados.2.smithi057.stdout:3687: finishing write tid 5 to smithi05720651-6 2020-11-16T22:15:44.910 INFO:tasks.rados.rados.2.smithi057.stdout:3687: finishing write tid 6 to smithi05720651-6 2020-11-16T22:15:44.910 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 2723 (ObjNum 1241 snap 437 seq_num 1241) dirty exists 2020-11-16T22:15:44.910 INFO:tasks.rados.rados.2.smithi057.stdout:3687: left oid 6 (ObjNum 1241 snap 437 seq_num 1241) 2020-11-16T22:15:44.910 INFO:tasks.rados.rados.2.smithi057.stdout:3689: finishing copy_from to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:44.911 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2608 (ObjNum 1187 snap 410 seq_num 1187) dirty exists 2020-11-16T22:15:44.911 INFO:tasks.rados.rados.2.smithi057.stdout:3689: finishing copy_from racing read to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:44.911 INFO:tasks.rados.rados.2.smithi057.stdout:3687: done (2 left) 2020-11-16T22:15:44.911 INFO:tasks.rados.rados.2.smithi057.stdout:3689: done (1 left) 2020-11-16T22:15:44.911 INFO:tasks.rados.rados.2.smithi057.stdout:3691: snap_create 2020-11-16T22:15:44.920 INFO:tasks.rados.rados.2.smithi057.stdout:3690: finishing rollback tid 0 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:44.920 INFO:tasks.rados.rados.2.smithi057.stdout:3690: finishing rollback tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:44.921 INFO:tasks.rados.rados.2.smithi057.stdout:3690: finishing rollback tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:44.921 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2726 (ObjNum 1162 snap 402 seq_num 1162) dirty exists 2020-11-16T22:15:45.210 INFO:tasks.rados.rados.2.smithi057.stdout:3690: done (1 left) 2020-11-16T22:15:45.211 INFO:tasks.rados.rados.2.smithi057.stdout:3691: done (0 left) 2020-11-16T22:15:45.211 INFO:tasks.rados.rados.2.smithi057.stdout:3692: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:15:45.211 INFO:tasks.rados.rados.2.smithi057.stdout:3692: expect (ObjNum 1162 snap 402 seq_num 1162) 2020-11-16T22:15:45.211 INFO:tasks.rados.rados.2.smithi057.stdout:3693: read oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 413 2020-11-16T22:15:45.211 INFO:tasks.rados.rados.2.smithi057.stdout:3693: expect deleted 2020-11-16T22:15:45.211 INFO:tasks.rados.rados.2.smithi057.stdout:3694: write oid 14 current snap is 438 2020-11-16T22:15:45.212 INFO:tasks.rados.rados.2.smithi057.stdout:3694: seq_num 1242 ranges {474294=424797,1428871=628093,2657357=216937} 2020-11-16T22:15:45.217 INFO:tasks.rados.rados.2.smithi057.stdout:3694: writing smithi05720651-14 from 474294 to 899091 tid 1 2020-11-16T22:15:45.227 INFO:tasks.rados.rados.2.smithi057.stdout:3694: writing smithi05720651-14 from 1428871 to 2056964 tid 2 2020-11-16T22:15:45.232 INFO:tasks.rados.rados.2.smithi057.stdout:3694: writing smithi05720651-14 from 2657357 to 2874294 tid 3 2020-11-16T22:15:45.233 INFO:tasks.rados.rados.2.smithi057.stdout:3695: read oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:15:45.233 INFO:tasks.rados.rados.2.smithi057.stdout:3695: expect (ObjNum 1236 snap 437 seq_num 1236) 2020-11-16T22:15:45.233 INFO:tasks.rados.rados.2.smithi057.stdout:3696: write oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 438 2020-11-16T22:15:45.233 INFO:tasks.rados.rados.2.smithi057.stdout:3696: seq_num 1243 ranges {491101=500046,1487353=488104,2401133=489968} 2020-11-16T22:15:45.238 INFO:tasks.rados.rados.2.smithi057.stdout:3696: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 491101 to 991147 tid 1 2020-11-16T22:15:45.244 INFO:tasks.rados.rados.2.smithi057.stdout:3696: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1487353 to 1975457 tid 2 2020-11-16T22:15:45.249 INFO:tasks.rados.rados.2.smithi057.stdout:3696: writing smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2401133 to 2891101 tid 3 2020-11-16T22:15:45.250 INFO:tasks.rados.rados.2.smithi057.stdout:3697: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:15:45.250 INFO:tasks.rados.rados.2.smithi057.stdout:3697: expect (ObjNum 1179 snap 407 seq_num 1179) 2020-11-16T22:15:45.250 INFO:tasks.rados.rados.2.smithi057.stdout:3698: copy_from oid 4 from oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 438 2020-11-16T22:15:45.250 INFO:tasks.rados.rados.2.smithi057.stdout:3694: finishing write tid 1 to smithi05720651-14 2020-11-16T22:15:45.250 INFO:tasks.rados.rados.2.smithi057.stdout:3692: expect (ObjNum 1162 snap 402 seq_num 1162) 2020-11-16T22:15:45.414 INFO:tasks.rados.rados.2.smithi057.stdout:3694: finishing write tid 2 to smithi05720651-14 2020-11-16T22:15:45.414 INFO:tasks.rados.rados.2.smithi057.stdout:3694: finishing write tid 3 to smithi05720651-14 2020-11-16T22:15:45.414 INFO:tasks.rados.rados.2.smithi057.stdout:3694: finishing write tid 5 to smithi05720651-14 2020-11-16T22:15:45.414 INFO:tasks.rados.rados.2.smithi057.stdout:3694: finishing write tid 6 to smithi05720651-14 2020-11-16T22:15:45.414 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 3072 (ObjNum 1242 snap 438 seq_num 1242) dirty exists 2020-11-16T22:15:45.414 INFO:tasks.rados.rados.2.smithi057.stdout:3694: left oid 14 (ObjNum 1242 snap 438 seq_num 1242) 2020-11-16T22:15:45.415 INFO:tasks.rados.rados.2.smithi057.stdout:3695: expect (ObjNum 1236 snap 437 seq_num 1236) 2020-11-16T22:15:45.540 INFO:tasks.rados.rados.2.smithi057.stdout:3696: finishing write tid 1 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:45.540 INFO:tasks.rados.rados.2.smithi057.stdout:3696: finishing write tid 2 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:45.540 INFO:tasks.rados.rados.2.smithi057.stdout:3696: finishing write tid 3 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:45.540 INFO:tasks.rados.rados.2.smithi057.stdout:3697: expect (ObjNum 1179 snap 407 seq_num 1179) 2020-11-16T22:15:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:45 smithi016 bash[10302]: cluster 2020-11-16T22:15:43.862330+0000 mgr.x (mgr.24115) 693 : cluster [DBG] pgmap v1537: 17 pgs: 17 active+clean; 528 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.6 MiB/s wr, 5 op/s 2020-11-16T22:15:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:45 smithi016 bash[10302]: cluster 2020-11-16T22:15:44.329750+0000 mon.a (mon.0) 1593 : cluster [DBG] osdmap e915: 12 total, 12 up, 12 in 2020-11-16T22:15:45.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:45 smithi016 bash[10302]: cluster 2020-11-16T22:15:45.221395+0000 mon.a (mon.0) 1594 : cluster [DBG] osdmap e916: 12 total, 12 up, 12 in 2020-11-16T22:15:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:45 smithi195 bash[10218]: cluster 2020-11-16T22:15:43.862330+0000 mgr.x (mgr.24115) 693 : cluster [DBG] pgmap v1537: 17 pgs: 17 active+clean; 528 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.6 MiB/s wr, 5 op/s 2020-11-16T22:15:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:45 smithi195 bash[10218]: cluster 2020-11-16T22:15:44.329750+0000 mon.a (mon.0) 1593 : cluster [DBG] osdmap e915: 12 total, 12 up, 12 in 2020-11-16T22:15:45.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:45 smithi195 bash[10218]: cluster 2020-11-16T22:15:45.221395+0000 mon.a (mon.0) 1594 : cluster [DBG] osdmap e916: 12 total, 12 up, 12 in 2020-11-16T22:15:45.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:45 smithi057 bash[10301]: cluster 2020-11-16T22:15:43.862330+0000 mgr.x (mgr.24115) 693 : cluster [DBG] pgmap v1537: 17 pgs: 17 active+clean; 528 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.6 MiB/s wr, 5 op/s 2020-11-16T22:15:45.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:45 smithi057 bash[10301]: cluster 2020-11-16T22:15:44.329750+0000 mon.a (mon.0) 1593 : cluster [DBG] osdmap e915: 12 total, 12 up, 12 in 2020-11-16T22:15:45.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:45 smithi057 bash[10301]: cluster 2020-11-16T22:15:45.221395+0000 mon.a (mon.0) 1594 : cluster [DBG] osdmap e916: 12 total, 12 up, 12 in 2020-11-16T22:15:45.788 INFO:tasks.rados.rados.2.smithi057.stdout:3696: finishing write tid 5 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:45.788 INFO:tasks.rados.rados.2.smithi057.stdout:3698: finishing copy_from to smithi05720651-4 2020-11-16T22:15:45.788 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 2590 (ObjNum 1175 snap 407 seq_num 1175) dirty exists 2020-11-16T22:15:45.788 INFO:tasks.rados.rados.2.smithi057.stdout:3698: finishing copy_from racing read to smithi05720651-4 2020-11-16T22:15:45.788 INFO:tasks.rados.rados.2.smithi057.stdout:3696: finishing write tid 6 to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:45.789 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2552 (ObjNum 1243 snap 438 seq_num 1243) dirty exists 2020-11-16T22:15:45.789 INFO:tasks.rados.rados.2.smithi057.stdout:3696: left oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1243 snap 438 seq_num 1243) 2020-11-16T22:15:45.789 INFO:tasks.rados.rados.2.smithi057.stdout:3692: done (6 left) 2020-11-16T22:15:45.789 INFO:tasks.rados.rados.2.smithi057.stdout:3693: done (5 left) 2020-11-16T22:15:45.789 INFO:tasks.rados.rados.2.smithi057.stdout:3694: done (4 left) 2020-11-16T22:15:45.789 INFO:tasks.rados.rados.2.smithi057.stdout:3695: done (3 left) 2020-11-16T22:15:45.789 INFO:tasks.rados.rados.2.smithi057.stdout:3696: done (2 left) 2020-11-16T22:15:45.790 INFO:tasks.rados.rados.2.smithi057.stdout:3697: done (1 left) 2020-11-16T22:15:45.790 INFO:tasks.rados.rados.2.smithi057.stdout:3698: done (0 left) 2020-11-16T22:15:45.790 INFO:tasks.rados.rados.2.smithi057.stdout:3699: snap_remove snap 413 2020-11-16T22:15:46.329 INFO:tasks.rados.rados.2.smithi057.stdout:3699: done (0 left) 2020-11-16T22:15:46.329 INFO:tasks.rados.rados.2.smithi057.stdout:3700: snap_remove snap 427 2020-11-16T22:15:47.340 INFO:tasks.rados.rados.2.smithi057.stdout:3700: done (0 left) 2020-11-16T22:15:47.341 INFO:tasks.rados.rados.2.smithi057.stdout:3701: read oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:15:47.341 INFO:tasks.rados.rados.2.smithi057.stdout:3701: expect (ObjNum 1175 snap 407 seq_num 1175) 2020-11-16T22:15:47.341 INFO:tasks.rados.rados.2.smithi057.stdout:3702: delete oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 438 2020-11-16T22:15:47.358 INFO:tasks.rados.rados.2.smithi057.stdout:3701: expect (ObjNum 1175 snap 407 seq_num 1175) 2020-11-16T22:15:47.524 INFO:tasks.rados.rados.2.smithi057.stdout:3701: done (1 left) 2020-11-16T22:15:47.525 INFO:tasks.rados.rados.2.smithi057.stdout:3702: done (0 left) 2020-11-16T22:15:47.525 INFO:tasks.rados.rados.2.smithi057.stdout:3703: write (excl) oid 12 current snap is 438 2020-11-16T22:15:47.525 INFO:tasks.rados.rados.2.smithi057.stdout:3703: seq_num 1245 ranges {524715=650544,1887964=491773} 2020-11-16T22:15:47.540 INFO:tasks.rados.rados.2.smithi057.stdout:3703: writing smithi05720651-12 from 524715 to 1175259 tid 1 2020-11-16T22:15:47.546 INFO:tasks.rados.rados.2.smithi057.stdout:3703: writing smithi05720651-12 from 1887964 to 2379737 tid 2 2020-11-16T22:15:47.547 INFO:tasks.rados.rados.2.smithi057.stdout:3703: finishing write tid 1 to smithi05720651-12 2020-11-16T22:15:47.547 INFO:tasks.rados.rados.2.smithi057.stdout:3704: rollback oid 18 current snap is 438 2020-11-16T22:15:47.547 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 18 to 377 2020-11-16T22:15:47.547 INFO:tasks.rados.rados.2.smithi057.stdout:3705: delete oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 438 2020-11-16T22:15:47.555 INFO:tasks.rados.rados.2.smithi057.stdout:3705: done (2 left) 2020-11-16T22:15:47.556 INFO:tasks.rados.rados.2.smithi057.stdout:3706: copy_from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 42 current snap is 438 2020-11-16T22:15:47.556 INFO:tasks.rados.rados.2.smithi057.stdout:3707: write (excl) oid 20 current snap is 438 2020-11-16T22:15:47.556 INFO:tasks.rados.rados.2.smithi057.stdout:3707: seq_num 1247 ranges {558329=517395,1721281=779089} 2020-11-16T22:15:47.557 INFO:tasks.rados.rados.2.smithi057.stdout:3707: writing smithi05720651-20 from 558329 to 1075724 tid 1 2020-11-16T22:15:47.565 INFO:tasks.rados.rados.2.smithi057.stdout:3707: writing smithi05720651-20 from 1721281 to 2500370 tid 2 2020-11-16T22:15:47.565 INFO:tasks.rados.rados.2.smithi057.stdout:3708: snap_remove snap 419 2020-11-16T22:15:47.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:47 smithi016 bash[10302]: cluster 2020-11-16T22:15:45.863049+0000 mgr.x (mgr.24115) 694 : cluster [DBG] pgmap v1540: 17 pgs: 17 active+clean; 540 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.8 MiB/s wr, 20 op/s 2020-11-16T22:15:47.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:47 smithi016 bash[10302]: cluster 2020-11-16T22:15:46.340004+0000 mon.a (mon.0) 1595 : cluster [DBG] osdmap e917: 12 total, 12 up, 12 in 2020-11-16T22:15:47.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:47 smithi195 bash[10218]: cluster 2020-11-16T22:15:45.863049+0000 mgr.x (mgr.24115) 694 : cluster [DBG] pgmap v1540: 17 pgs: 17 active+clean; 540 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.8 MiB/s wr, 20 op/s 2020-11-16T22:15:47.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:47 smithi195 bash[10218]: cluster 2020-11-16T22:15:46.340004+0000 mon.a (mon.0) 1595 : cluster [DBG] osdmap e917: 12 total, 12 up, 12 in 2020-11-16T22:15:47.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:47 smithi057 bash[10301]: cluster 2020-11-16T22:15:45.863049+0000 mgr.x (mgr.24115) 694 : cluster [DBG] pgmap v1540: 17 pgs: 17 active+clean; 540 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 2.8 MiB/s wr, 20 op/s 2020-11-16T22:15:47.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:47 smithi057 bash[10301]: cluster 2020-11-16T22:15:46.340004+0000 mon.a (mon.0) 1595 : cluster [DBG] osdmap e917: 12 total, 12 up, 12 in 2020-11-16T22:15:48.358 INFO:tasks.rados.rados.2.smithi057.stdout:3708: done (4 left) 2020-11-16T22:15:48.358 INFO:tasks.rados.rados.2.smithi057.stdout:3709: read oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:15:48.358 INFO:tasks.rados.rados.2.smithi057.stdout:3709: expect (ObjNum 1243 snap 438 seq_num 1243) 2020-11-16T22:15:48.358 INFO:tasks.rados.rados.2.smithi057.stdout:3710: delete oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 438 2020-11-16T22:15:48.359 INFO:tasks.rados.rados.2.smithi057.stdout:3703: finishing write tid 2 to smithi05720651-12 2020-11-16T22:15:48.359 INFO:tasks.rados.rados.2.smithi057.stdout:3703: finishing write tid 4 to smithi05720651-12 2020-11-16T22:15:48.359 INFO:tasks.rados.rados.2.smithi057.stdout:3703: finishing write tid 5 to smithi05720651-12 2020-11-16T22:15:48.359 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 2986 (ObjNum 1245 snap 438 seq_num 1245) dirty exists 2020-11-16T22:15:48.359 INFO:tasks.rados.rados.2.smithi057.stdout:3703: left oid 12 (ObjNum 1245 snap 438 seq_num 1245) 2020-11-16T22:15:48.359 INFO:tasks.rados.rados.2.smithi057.stdout:3704: finishing rollback tid 0 to smithi05720651-18 2020-11-16T22:15:48.359 INFO:tasks.rados.rados.2.smithi057.stdout:3704: finishing rollback tid 1 to smithi05720651-18 2020-11-16T22:15:48.360 INFO:tasks.rados.rados.2.smithi057.stdout:3704: finishing rollback tid 2 to smithi05720651-18 2020-11-16T22:15:48.360 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 2729 (ObjNum 1055 snap 371 seq_num 1055) dirty exists 2020-11-16T22:15:48.360 INFO:tasks.rados.rados.2.smithi057.stdout:3707: finishing write tid 1 to smithi05720651-20 2020-11-16T22:15:48.360 INFO:tasks.rados.rados.2.smithi057.stdout:3706: finishing copy_from to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:48.360 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2408 (ObjNum 1162 snap 402 seq_num 1162) dirty exists 2020-11-16T22:15:48.360 INFO:tasks.rados.rados.2.smithi057.stdout:3707: finishing write tid 2 to smithi05720651-20 2020-11-16T22:15:48.360 INFO:tasks.rados.rados.2.smithi057.stdout:3706: finishing copy_from racing read to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:48.361 INFO:tasks.rados.rados.2.smithi057.stdout:3707: finishing write tid 4 to smithi05720651-20 2020-11-16T22:15:48.361 INFO:tasks.rados.rados.2.smithi057.stdout:3707: finishing write tid 5 to smithi05720651-20 2020-11-16T22:15:48.361 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 2832 (ObjNum 1247 snap 438 seq_num 1247) dirty exists 2020-11-16T22:15:48.361 INFO:tasks.rados.rados.2.smithi057.stdout:3707: left oid 20 (ObjNum 1247 snap 438 seq_num 1247) 2020-11-16T22:15:48.368 INFO:tasks.rados.rados.2.smithi057.stdout:3709: expect (ObjNum 1243 snap 438 seq_num 1243) 2020-11-16T22:15:48.455 INFO:tasks.rados.rados.2.smithi057.stdout:3703: done (5 left) 2020-11-16T22:15:48.456 INFO:tasks.rados.rados.2.smithi057.stdout:3704: done (4 left) 2020-11-16T22:15:48.456 INFO:tasks.rados.rados.2.smithi057.stdout:3706: done (3 left) 2020-11-16T22:15:48.456 INFO:tasks.rados.rados.2.smithi057.stdout:3707: done (2 left) 2020-11-16T22:15:48.456 INFO:tasks.rados.rados.2.smithi057.stdout:3709: done (1 left) 2020-11-16T22:15:48.456 INFO:tasks.rados.rados.2.smithi057.stdout:3710: done (0 left) 2020-11-16T22:15:48.456 INFO:tasks.rados.rados.2.smithi057.stdout:3711: copy_from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 438 2020-11-16T22:15:48.456 INFO:tasks.rados.rados.2.smithi057.stdout:3712: snap_remove snap 366 2020-11-16T22:15:48.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:48 smithi057 bash[10301]: cluster 2020-11-16T22:15:47.351381+0000 mon.a (mon.0) 1596 : cluster [DBG] osdmap e918: 12 total, 12 up, 12 in 2020-11-16T22:15:48.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:48 smithi016 bash[10302]: cluster 2020-11-16T22:15:47.351381+0000 mon.a (mon.0) 1596 : cluster [DBG] osdmap e918: 12 total, 12 up, 12 in 2020-11-16T22:15:48.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:48 smithi195 bash[10218]: cluster 2020-11-16T22:15:47.351381+0000 mon.a (mon.0) 1596 : cluster [DBG] osdmap e918: 12 total, 12 up, 12 in 2020-11-16T22:15:49.365 INFO:tasks.rados.rados.2.smithi057.stdout:3712: done (1 left) 2020-11-16T22:15:49.365 INFO:tasks.rados.rados.2.smithi057.stdout:3713: write (excl) oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 438 2020-11-16T22:15:49.365 INFO:tasks.rados.rados.2.smithi057.stdout:3711: finishing copy_from to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:49.365 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2988 (ObjNum 1206 snap 420 seq_num 1206) dirty exists 2020-11-16T22:15:49.366 INFO:tasks.rados.rados.2.smithi057.stdout:3713: seq_num 1249 ranges {591943=667893,1721892=782758} 2020-11-16T22:15:49.379 INFO:tasks.rados.rados.2.smithi057.stdout:3713: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 591943 to 1259836 tid 1 2020-11-16T22:15:49.388 INFO:tasks.rados.rados.2.smithi057.stdout:3713: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1721892 to 2504650 tid 2 2020-11-16T22:15:49.388 INFO:tasks.rados.rados.2.smithi057.stdout:3714: copy_from oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 32 current snap is 438 2020-11-16T22:15:49.388 INFO:tasks.rados.rados.2.smithi057.stdout:3711: finishing copy_from racing read to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:49.388 INFO:tasks.rados.rados.2.smithi057.stdout:3713: finishing write tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:49.389 INFO:tasks.rados.rados.2.smithi057.stdout:3711: done (2 left) 2020-11-16T22:15:49.389 INFO:tasks.rados.rados.2.smithi057.stdout:3715: snap_create 2020-11-16T22:15:49.394 INFO:tasks.rados.rados.2.smithi057.stdout:3713: finishing write tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:49.395 INFO:tasks.rados.rados.2.smithi057.stdout:3713: finishing write tid 4 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:49.396 INFO:tasks.rados.rados.2.smithi057.stdout:3713: finishing write tid 5 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:49.396 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2991 (ObjNum 1249 snap 438 seq_num 1249) dirty exists 2020-11-16T22:15:49.396 INFO:tasks.rados.rados.2.smithi057.stdout:3713: left oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1249 snap 438 seq_num 1249) 2020-11-16T22:15:49.400 INFO:tasks.rados.rados.2.smithi057.stdout:3714: finishing copy_from to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:49.400 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2710 (ObjNum 1203 snap 419 seq_num 1203) dirty exists 2020-11-16T22:15:49.401 INFO:tasks.rados.rados.2.smithi057.stdout:3714: finishing copy_from racing read to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:49.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:49 smithi057 bash[10301]: cluster 2020-11-16T22:15:47.863756+0000 mgr.x (mgr.24115) 695 : cluster [DBG] pgmap v1543: 17 pgs: 17 active+clean; 554 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 5.1 MiB/s wr, 31 op/s 2020-11-16T22:15:49.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:49 smithi057 bash[10301]: cluster 2020-11-16T22:15:48.366923+0000 mon.a (mon.0) 1597 : cluster [DBG] osdmap e919: 12 total, 12 up, 12 in 2020-11-16T22:15:49.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:49 smithi016 bash[10302]: cluster 2020-11-16T22:15:47.863756+0000 mgr.x (mgr.24115) 695 : cluster [DBG] pgmap v1543: 17 pgs: 17 active+clean; 554 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 5.1 MiB/s wr, 31 op/s 2020-11-16T22:15:49.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:49 smithi016 bash[10302]: cluster 2020-11-16T22:15:48.366923+0000 mon.a (mon.0) 1597 : cluster [DBG] osdmap e919: 12 total, 12 up, 12 in 2020-11-16T22:15:49.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:49 smithi195 bash[10218]: cluster 2020-11-16T22:15:47.863756+0000 mgr.x (mgr.24115) 695 : cluster [DBG] pgmap v1543: 17 pgs: 17 active+clean; 554 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 5.1 MiB/s wr, 31 op/s 2020-11-16T22:15:49.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:49 smithi195 bash[10218]: cluster 2020-11-16T22:15:48.366923+0000 mon.a (mon.0) 1597 : cluster [DBG] osdmap e919: 12 total, 12 up, 12 in 2020-11-16T22:15:50.212 INFO:tasks.rados.rados.2.smithi057.stdout:3713: done (2 left) 2020-11-16T22:15:50.212 INFO:tasks.rados.rados.2.smithi057.stdout:3714: done (1 left) 2020-11-16T22:15:50.212 INFO:tasks.rados.rados.2.smithi057.stdout:3715: done (0 left) 2020-11-16T22:15:50.212 INFO:tasks.rados.rados.2.smithi057.stdout:3716: write oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 439 2020-11-16T22:15:50.212 INFO:tasks.rados.rados.2.smithi057.stdout:3716: seq_num 1250 ranges {608750=743142,1780374=642769} 2020-11-16T22:15:50.223 INFO:tasks.rados.rados.2.smithi057.stdout:3716: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 608750 to 1351892 tid 1 2020-11-16T22:15:50.229 INFO:tasks.rados.rados.2.smithi057.stdout:3716: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1780374 to 2423143 tid 2 2020-11-16T22:15:50.230 INFO:tasks.rados.rados.2.smithi057.stdout:3717: snap_remove snap 360 2020-11-16T22:15:50.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:50 smithi057 bash[10301]: cluster 2020-11-16T22:15:49.375604+0000 mon.a (mon.0) 1598 : cluster [DBG] osdmap e920: 12 total, 12 up, 12 in 2020-11-16T22:15:50.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:50 smithi057 bash[10301]: cluster 2020-11-16T22:15:49.864470+0000 mgr.x (mgr.24115) 696 : cluster [DBG] pgmap v1546: 17 pgs: 17 active+clean; 558 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.1 MiB/s wr, 17 op/s 2020-11-16T22:15:50.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:50 smithi057 bash[10301]: cluster 2020-11-16T22:15:50.222629+0000 mon.a (mon.0) 1599 : cluster [DBG] osdmap e921: 12 total, 12 up, 12 in 2020-11-16T22:15:50.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:50 smithi016 bash[10302]: cluster 2020-11-16T22:15:49.375604+0000 mon.a (mon.0) 1598 : cluster [DBG] osdmap e920: 12 total, 12 up, 12 in 2020-11-16T22:15:50.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:50 smithi016 bash[10302]: cluster 2020-11-16T22:15:49.864470+0000 mgr.x (mgr.24115) 696 : cluster [DBG] pgmap v1546: 17 pgs: 17 active+clean; 558 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.1 MiB/s wr, 17 op/s 2020-11-16T22:15:50.838 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:50 smithi016 bash[10302]: cluster 2020-11-16T22:15:50.222629+0000 mon.a (mon.0) 1599 : cluster [DBG] osdmap e921: 12 total, 12 up, 12 in 2020-11-16T22:15:50.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:50 smithi195 bash[10218]: cluster 2020-11-16T22:15:49.375604+0000 mon.a (mon.0) 1598 : cluster [DBG] osdmap e920: 12 total, 12 up, 12 in 2020-11-16T22:15:50.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:50 smithi195 bash[10218]: cluster 2020-11-16T22:15:49.864470+0000 mgr.x (mgr.24115) 696 : cluster [DBG] pgmap v1546: 17 pgs: 17 active+clean; 558 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.1 MiB/s wr, 17 op/s 2020-11-16T22:15:50.851 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:50 smithi195 bash[10218]: cluster 2020-11-16T22:15:50.222629+0000 mon.a (mon.0) 1599 : cluster [DBG] osdmap e921: 12 total, 12 up, 12 in 2020-11-16T22:15:51.223 INFO:tasks.rados.rados.2.smithi057.stdout:3717: done (1 left) 2020-11-16T22:15:51.224 INFO:tasks.rados.rados.2.smithi057.stdout:3718: snap_create 2020-11-16T22:15:51.224 INFO:tasks.rados.rados.2.smithi057.stdout:3716: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:51.224 INFO:tasks.rados.rados.2.smithi057.stdout:3716: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:51.224 INFO:tasks.rados.rados.2.smithi057.stdout:3716: finishing write tid 4 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:51.224 INFO:tasks.rados.rados.2.smithi057.stdout:3716: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:51.224 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2735 (ObjNum 1250 snap 439 seq_num 1250) dirty exists 2020-11-16T22:15:51.225 INFO:tasks.rados.rados.2.smithi057.stdout:3716: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1250 snap 439 seq_num 1250) 2020-11-16T22:15:52.231 INFO:tasks.rados.rados.2.smithi057.stdout:3716: done (1 left) 2020-11-16T22:15:52.231 INFO:tasks.rados.rados.2.smithi057.stdout:3718: done (0 left) 2020-11-16T22:15:52.231 INFO:tasks.rados.rados.2.smithi057.stdout:3719: rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 440 2020-11-16T22:15:52.232 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 426 2020-11-16T22:15:52.232 INFO:tasks.rados.rados.2.smithi057.stdout:3720: snap_create 2020-11-16T22:15:52.237 INFO:tasks.rados.rados.2.smithi057.stdout:3719: finishing rollback tid 0 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:52.237 INFO:tasks.rados.rados.2.smithi057.stdout:3719: finishing rollback tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:52.238 INFO:tasks.rados.rados.2.smithi057.stdout:3719: finishing rollback tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:52.238 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2411 (ObjNum 1158 snap 401 seq_num 1158) dirty exists 2020-11-16T22:15:52.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:52 smithi016 bash[10302]: cluster 2020-11-16T22:15:51.233325+0000 mon.a (mon.0) 1600 : cluster [DBG] osdmap e922: 12 total, 12 up, 12 in 2020-11-16T22:15:52.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:52 smithi195 bash[10218]: cluster 2020-11-16T22:15:51.233325+0000 mon.a (mon.0) 1600 : cluster [DBG] osdmap e922: 12 total, 12 up, 12 in 2020-11-16T22:15:52.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:52 smithi057 bash[10301]: cluster 2020-11-16T22:15:51.233325+0000 mon.a (mon.0) 1600 : cluster [DBG] osdmap e922: 12 total, 12 up, 12 in 2020-11-16T22:15:53.242 INFO:tasks.rados.rados.2.smithi057.stdout:3719: done (1 left) 2020-11-16T22:15:53.242 INFO:tasks.rados.rados.2.smithi057.stdout:3720: done (0 left) 2020-11-16T22:15:53.242 INFO:tasks.rados.rados.2.smithi057.stdout:3721: snap_create 2020-11-16T22:15:53.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:53 smithi016 bash[10302]: cluster 2020-11-16T22:15:51.865225+0000 mgr.x (mgr.24115) 697 : cluster [DBG] pgmap v1549: 17 pgs: 17 active+clean; 570 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 2.7 MiB/s wr, 12 op/s 2020-11-16T22:15:53.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:53 smithi016 bash[10302]: cluster 2020-11-16T22:15:52.241979+0000 mon.a (mon.0) 1601 : cluster [DBG] osdmap e923: 12 total, 12 up, 12 in 2020-11-16T22:15:53.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:53 smithi195 bash[10218]: cluster 2020-11-16T22:15:51.865225+0000 mgr.x (mgr.24115) 697 : cluster [DBG] pgmap v1549: 17 pgs: 17 active+clean; 570 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 2.7 MiB/s wr, 12 op/s 2020-11-16T22:15:53.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:53 smithi195 bash[10218]: cluster 2020-11-16T22:15:52.241979+0000 mon.a (mon.0) 1601 : cluster [DBG] osdmap e923: 12 total, 12 up, 12 in 2020-11-16T22:15:53.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:53 smithi057 bash[10301]: cluster 2020-11-16T22:15:51.865225+0000 mgr.x (mgr.24115) 697 : cluster [DBG] pgmap v1549: 17 pgs: 17 active+clean; 570 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 2.7 MiB/s wr, 12 op/s 2020-11-16T22:15:53.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:53 smithi057 bash[10301]: cluster 2020-11-16T22:15:52.241979+0000 mon.a (mon.0) 1601 : cluster [DBG] osdmap e923: 12 total, 12 up, 12 in 2020-11-16T22:15:54.254 INFO:tasks.rados.rados.2.smithi057.stdout:3721: done (0 left) 2020-11-16T22:15:54.254 INFO:tasks.rados.rados.2.smithi057.stdout:3722: snap_create 2020-11-16T22:15:54.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:54 smithi016 bash[10302]: cluster 2020-11-16T22:15:53.253042+0000 mon.a (mon.0) 1602 : cluster [DBG] osdmap e924: 12 total, 12 up, 12 in 2020-11-16T22:15:54.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:54 smithi195 bash[10218]: cluster 2020-11-16T22:15:53.253042+0000 mon.a (mon.0) 1602 : cluster [DBG] osdmap e924: 12 total, 12 up, 12 in 2020-11-16T22:15:54.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:54 smithi057 bash[10301]: cluster 2020-11-16T22:15:53.253042+0000 mon.a (mon.0) 1602 : cluster [DBG] osdmap e924: 12 total, 12 up, 12 in 2020-11-16T22:15:55.214 INFO:tasks.rados.rados.2.smithi057.stdout:3722: done (0 left) 2020-11-16T22:15:55.214 INFO:tasks.rados.rados.2.smithi057.stdout:3723: copy_from oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 6 current snap is 443 2020-11-16T22:15:55.214 INFO:tasks.rados.rados.2.smithi057.stdout:3724: rollback oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 443 2020-11-16T22:15:55.214 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 439 2020-11-16T22:15:55.214 INFO:tasks.rados.rados.2.smithi057.stdout:3725: rollback oid 8 current snap is 443 2020-11-16T22:15:55.215 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 8 to 412 2020-11-16T22:15:55.215 INFO:tasks.rados.rados.2.smithi057.stdout:3726: rollback oid 14 current snap is 443 2020-11-16T22:15:55.215 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 14 to 370 2020-11-16T22:15:55.215 INFO:tasks.rados.rados.2.smithi057.stdout:3727: write (excl) oid 32 current snap is 443 2020-11-16T22:15:55.215 INFO:tasks.rados.rados.2.smithi057.stdout:3727: seq_num 1251 ranges {625557=418391,1838856=786427} 2020-11-16T22:15:55.225 INFO:tasks.rados.rados.2.smithi057.stdout:3727: writing smithi05720651-32 from 625557 to 1043948 tid 1 2020-11-16T22:15:55.234 INFO:tasks.rados.rados.2.smithi057.stdout:3727: writing smithi05720651-32 from 1838856 to 2625283 tid 2 2020-11-16T22:15:55.234 INFO:tasks.rados.rados.2.smithi057.stdout:3728: read oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:15:55.234 INFO:tasks.rados.rados.2.smithi057.stdout:3728: expect (ObjNum 1250 snap 439 seq_num 1250) 2020-11-16T22:15:55.235 INFO:tasks.rados.rados.2.smithi057.stdout:3729: delete oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 443 2020-11-16T22:15:55.235 INFO:tasks.rados.rados.2.smithi057.stdout:3725: finishing rollback tid 0 to smithi05720651-8 2020-11-16T22:15:55.235 INFO:tasks.rados.rados.2.smithi057.stdout:3725: finishing rollback tid 1 to smithi05720651-8 2020-11-16T22:15:55.235 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 2878 (ObjNum 321 snap 0 seq_num 1) dirty dne 2020-11-16T22:15:55.235 INFO:tasks.rados.rados.2.smithi057.stdout:3724: finishing rollback tid 0 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:55.236 INFO:tasks.rados.rados.2.smithi057.stdout:3724: finishing rollback tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:55.236 INFO:tasks.rados.rados.2.smithi057.stdout:3724: finishing rollback tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:55.236 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3120 (ObjNum 1187 snap 410 seq_num 1187) dirty exists 2020-11-16T22:15:55.236 INFO:tasks.rados.rados.2.smithi057.stdout:3726: finishing rollback tid 0 to smithi05720651-14 2020-11-16T22:15:55.236 INFO:tasks.rados.rados.2.smithi057.stdout:3726: finishing rollback tid 1 to smithi05720651-14 2020-11-16T22:15:55.237 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 3123 (ObjNum 33 snap 0 seq_num 2932679216) dirty dne 2020-11-16T22:15:55.237 INFO:tasks.rados.rados.2.smithi057.stdout:3727: finishing write tid 1 to smithi05720651-32 2020-11-16T22:15:55.240 INFO:tasks.rados.rados.2.smithi057.stdout:3723: finishing copy_from to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:55.241 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2723 (ObjNum 1241 snap 437 seq_num 1241) dirty exists 2020-11-16T22:15:55.241 INFO:tasks.rados.rados.2.smithi057.stdout:3723: finishing copy_from racing read to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:55.242 INFO:tasks.rados.rados.2.smithi057.stdout:3727: finishing write tid 2 to smithi05720651-32 2020-11-16T22:15:55.243 INFO:tasks.rados.rados.2.smithi057.stdout:3723: done (6 left) 2020-11-16T22:15:55.243 INFO:tasks.rados.rados.2.smithi057.stdout:3724: done (5 left) 2020-11-16T22:15:55.243 INFO:tasks.rados.rados.2.smithi057.stdout:3725: done (4 left) 2020-11-16T22:15:55.243 INFO:tasks.rados.rados.2.smithi057.stdout:3726: done (3 left) 2020-11-16T22:15:55.243 INFO:tasks.rados.rados.2.smithi057.stdout:3729: done (2 left) 2020-11-16T22:15:55.243 INFO:tasks.rados.rados.2.smithi057.stdout:3730: rollback oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 443 2020-11-16T22:15:55.244 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 430 2020-11-16T22:15:55.244 INFO:tasks.rados.rados.2.smithi057.stdout:3731: snap_remove snap 434 2020-11-16T22:15:55.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:55 smithi016 bash[10302]: cluster 2020-11-16T22:15:53.865892+0000 mgr.x (mgr.24115) 698 : cluster [DBG] pgmap v1552: 17 pgs: 17 active+clean; 569 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.6 MiB/s wr, 7 op/s 2020-11-16T22:15:55.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:55 smithi016 bash[10302]: cluster 2020-11-16T22:15:54.264846+0000 mon.a (mon.0) 1603 : cluster [DBG] osdmap e925: 12 total, 12 up, 12 in 2020-11-16T22:15:55.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:55 smithi016 bash[10302]: cluster 2020-11-16T22:15:55.224359+0000 mon.a (mon.0) 1604 : cluster [DBG] osdmap e926: 12 total, 12 up, 12 in 2020-11-16T22:15:55.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:55 smithi195 bash[10218]: cluster 2020-11-16T22:15:53.865892+0000 mgr.x (mgr.24115) 698 : cluster [DBG] pgmap v1552: 17 pgs: 17 active+clean; 569 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.6 MiB/s wr, 7 op/s 2020-11-16T22:15:55.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:55 smithi195 bash[10218]: cluster 2020-11-16T22:15:54.264846+0000 mon.a (mon.0) 1603 : cluster [DBG] osdmap e925: 12 total, 12 up, 12 in 2020-11-16T22:15:55.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:55 smithi195 bash[10218]: cluster 2020-11-16T22:15:55.224359+0000 mon.a (mon.0) 1604 : cluster [DBG] osdmap e926: 12 total, 12 up, 12 in 2020-11-16T22:15:55.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:55 smithi057 bash[10301]: cluster 2020-11-16T22:15:53.865892+0000 mgr.x (mgr.24115) 698 : cluster [DBG] pgmap v1552: 17 pgs: 17 active+clean; 569 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 2.6 MiB/s wr, 7 op/s 2020-11-16T22:15:55.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:55 smithi057 bash[10301]: cluster 2020-11-16T22:15:54.264846+0000 mon.a (mon.0) 1603 : cluster [DBG] osdmap e925: 12 total, 12 up, 12 in 2020-11-16T22:15:55.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:55 smithi057 bash[10301]: cluster 2020-11-16T22:15:55.224359+0000 mon.a (mon.0) 1604 : cluster [DBG] osdmap e926: 12 total, 12 up, 12 in 2020-11-16T22:15:56.222 INFO:tasks.rados.rados.2.smithi057.stdout:3731: done (3 left) 2020-11-16T22:15:56.223 INFO:tasks.rados.rados.2.smithi057.stdout:3732: write (excl) oid 2 current snap is 443 2020-11-16T22:15:56.223 INFO:tasks.rados.rados.2.smithi057.stdout:3732: seq_num 1253 ranges {659171=568889,1839467=790096} 2020-11-16T22:15:56.235 INFO:tasks.rados.rados.2.smithi057.stdout:3732: writing smithi05720651-2 from 659171 to 1228060 tid 1 2020-11-16T22:15:56.245 INFO:tasks.rados.rados.2.smithi057.stdout:3732: writing smithi05720651-2 from 1839467 to 2629563 tid 2 2020-11-16T22:15:56.246 INFO:tasks.rados.rados.2.smithi057.stdout:3733: snap_create 2020-11-16T22:15:56.246 INFO:tasks.rados.rados.2.smithi057.stdout:3727: finishing write tid 4 to smithi05720651-32 2020-11-16T22:15:56.246 INFO:tasks.rados.rados.2.smithi057.stdout:3727: finishing write tid 5 to smithi05720651-32 2020-11-16T22:15:56.246 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 3129 (ObjNum 1251 snap 443 seq_num 1251) dirty exists 2020-11-16T22:15:56.246 INFO:tasks.rados.rados.2.smithi057.stdout:3727: left oid 32 (ObjNum 1251 snap 443 seq_num 1251) 2020-11-16T22:15:56.246 INFO:tasks.rados.rados.2.smithi057.stdout:3728: expect (ObjNum 1250 snap 439 seq_num 1250) 2020-11-16T22:15:56.436 INFO:tasks.rados.rados.2.smithi057.stdout:3730: finishing rollback tid 0 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:56.436 INFO:tasks.rados.rados.2.smithi057.stdout:3730: finishing rollback tid 1 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:56.437 INFO:tasks.rados.rados.2.smithi057.stdout:3730: finishing rollback tid 2 to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:56.437 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2753 (ObjNum 1189 snap 412 seq_num 1189) dirty exists 2020-11-16T22:15:56.437 INFO:tasks.rados.rados.2.smithi057.stdout:3732: finishing write tid 1 to smithi05720651-2 2020-11-16T22:15:56.437 INFO:tasks.rados.rados.2.smithi057.stdout:3732: finishing write tid 2 to smithi05720651-2 2020-11-16T22:15:56.437 INFO:tasks.rados.rados.2.smithi057.stdout:3732: finishing write tid 4 to smithi05720651-2 2020-11-16T22:15:56.437 INFO:tasks.rados.rados.2.smithi057.stdout:3732: finishing write tid 5 to smithi05720651-2 2020-11-16T22:15:56.437 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 3136 (ObjNum 1253 snap 443 seq_num 1253) dirty exists 2020-11-16T22:15:56.438 INFO:tasks.rados.rados.2.smithi057.stdout:3732: left oid 2 (ObjNum 1253 snap 443 seq_num 1253) 2020-11-16T22:15:57.233 INFO:tasks.rados.rados.2.smithi057.stdout:3727: done (4 left) 2020-11-16T22:15:57.233 INFO:tasks.rados.rados.2.smithi057.stdout:3728: done (3 left) 2020-11-16T22:15:57.233 INFO:tasks.rados.rados.2.smithi057.stdout:3730: done (2 left) 2020-11-16T22:15:57.233 INFO:tasks.rados.rados.2.smithi057.stdout:3732: done (1 left) 2020-11-16T22:15:57.233 INFO:tasks.rados.rados.2.smithi057.stdout:3733: done (0 left) 2020-11-16T22:15:57.234 INFO:tasks.rados.rados.2.smithi057.stdout:3734: rollback oid 42 current snap is 444 2020-11-16T22:15:57.234 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 42 to 381 2020-11-16T22:15:57.234 INFO:tasks.rados.rados.2.smithi057.stdout:3735: write (excl) oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 444 2020-11-16T22:15:57.234 INFO:tasks.rados.rados.2.smithi057.stdout:3735: seq_num 1254 ranges {675978=644138,1897949=650107} 2020-11-16T22:15:57.249 INFO:tasks.rados.rados.2.smithi057.stdout:3735: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 675978 to 1320116 tid 1 2020-11-16T22:15:57.256 INFO:tasks.rados.rados.2.smithi057.stdout:3735: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1897949 to 2548056 tid 2 2020-11-16T22:15:57.256 INFO:tasks.rados.rados.2.smithi057.stdout:3736: snap_create 2020-11-16T22:15:57.256 INFO:tasks.rados.rados.2.smithi057.stdout:3734: finishing rollback tid 0 to smithi05720651-42 2020-11-16T22:15:57.257 INFO:tasks.rados.rados.2.smithi057.stdout:3734: finishing rollback tid 1 to smithi05720651-42 2020-11-16T22:15:57.257 INFO:tasks.rados.rados.2.smithi057.stdout:3734: finishing rollback tid 2 to smithi05720651-42 2020-11-16T22:15:57.257 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 2411 (ObjNum 1093 snap 380 seq_num 1093) dirty exists 2020-11-16T22:15:57.257 INFO:tasks.rados.rados.2.smithi057.stdout:3735: finishing write tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:57.264 INFO:tasks.rados.rados.2.smithi057.stdout:3735: finishing write tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:57.264 INFO:tasks.rados.rados.2.smithi057.stdout:3735: finishing write tid 4 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:57.265 INFO:tasks.rados.rados.2.smithi057.stdout:3735: finishing write tid 5 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:15:57.265 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2994 (ObjNum 1254 snap 444 seq_num 1254) dirty exists 2020-11-16T22:15:57.265 INFO:tasks.rados.rados.2.smithi057.stdout:3735: left oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1254 snap 444 seq_num 1254) 2020-11-16T22:15:57.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:57 smithi016 bash[10302]: cluster 2020-11-16T22:15:55.866625+0000 mgr.x (mgr.24115) 699 : cluster [DBG] pgmap v1555: 17 pgs: 17 active+clean; 564 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 542 KiB/s wr, 3 op/s 2020-11-16T22:15:57.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:57 smithi016 bash[10302]: cluster 2020-11-16T22:15:56.233575+0000 mon.a (mon.0) 1605 : cluster [DBG] osdmap e927: 12 total, 12 up, 12 in 2020-11-16T22:15:57.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:57 smithi195 bash[10218]: cluster 2020-11-16T22:15:55.866625+0000 mgr.x (mgr.24115) 699 : cluster [DBG] pgmap v1555: 17 pgs: 17 active+clean; 564 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 542 KiB/s wr, 3 op/s 2020-11-16T22:15:57.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:57 smithi195 bash[10218]: cluster 2020-11-16T22:15:56.233575+0000 mon.a (mon.0) 1605 : cluster [DBG] osdmap e927: 12 total, 12 up, 12 in 2020-11-16T22:15:57.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:57 smithi057 bash[10301]: cluster 2020-11-16T22:15:55.866625+0000 mgr.x (mgr.24115) 699 : cluster [DBG] pgmap v1555: 17 pgs: 17 active+clean; 564 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 542 KiB/s wr, 3 op/s 2020-11-16T22:15:57.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:57 smithi057 bash[10301]: cluster 2020-11-16T22:15:56.233575+0000 mon.a (mon.0) 1605 : cluster [DBG] osdmap e927: 12 total, 12 up, 12 in 2020-11-16T22:15:58.242 INFO:tasks.rados.rados.2.smithi057.stdout:3734: done (2 left) 2020-11-16T22:15:58.243 INFO:tasks.rados.rados.2.smithi057.stdout:3735: done (1 left) 2020-11-16T22:15:58.243 INFO:tasks.rados.rados.2.smithi057.stdout:3736: done (0 left) 2020-11-16T22:15:58.243 INFO:tasks.rados.rados.2.smithi057.stdout:3737: snap_create 2020-11-16T22:15:58.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:58 smithi016 bash[10302]: cluster 2020-11-16T22:15:57.243590+0000 mon.a (mon.0) 1606 : cluster [DBG] osdmap e928: 12 total, 12 up, 12 in 2020-11-16T22:15:58.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:58 smithi195 bash[10218]: cluster 2020-11-16T22:15:57.243590+0000 mon.a (mon.0) 1606 : cluster [DBG] osdmap e928: 12 total, 12 up, 12 in 2020-11-16T22:15:58.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:58 smithi057 bash[10301]: cluster 2020-11-16T22:15:57.243590+0000 mon.a (mon.0) 1606 : cluster [DBG] osdmap e928: 12 total, 12 up, 12 in 2020-11-16T22:15:59.246 INFO:tasks.rados.rados.2.smithi057.stdout:3737: done (0 left) 2020-11-16T22:15:59.246 INFO:tasks.rados.rados.2.smithi057.stdout:3738: snap_create 2020-11-16T22:15:59.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:59 smithi016 bash[10302]: cluster 2020-11-16T22:15:57.867337+0000 mgr.x (mgr.24115) 700 : cluster [DBG] pgmap v1558: 17 pgs: 17 active+clean; 559 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 7 op/s 2020-11-16T22:15:59.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:15:59 smithi016 bash[10302]: cluster 2020-11-16T22:15:58.253248+0000 mon.a (mon.0) 1607 : cluster [DBG] osdmap e929: 12 total, 12 up, 12 in 2020-11-16T22:15:59.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:59 smithi195 bash[10218]: cluster 2020-11-16T22:15:57.867337+0000 mgr.x (mgr.24115) 700 : cluster [DBG] pgmap v1558: 17 pgs: 17 active+clean; 559 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 7 op/s 2020-11-16T22:15:59.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:15:59 smithi195 bash[10218]: cluster 2020-11-16T22:15:58.253248+0000 mon.a (mon.0) 1607 : cluster [DBG] osdmap e929: 12 total, 12 up, 12 in 2020-11-16T22:15:59.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:59 smithi057 bash[10301]: cluster 2020-11-16T22:15:57.867337+0000 mgr.x (mgr.24115) 700 : cluster [DBG] pgmap v1558: 17 pgs: 17 active+clean; 559 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 7 op/s 2020-11-16T22:15:59.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:15:59 smithi057 bash[10301]: cluster 2020-11-16T22:15:58.253248+0000 mon.a (mon.0) 1607 : cluster [DBG] osdmap e929: 12 total, 12 up, 12 in 2020-11-16T22:16:00.215 INFO:tasks.rados.rados.2.smithi057.stdout:3738: done (0 left) 2020-11-16T22:16:00.215 INFO:tasks.rados.rados.2.smithi057.stdout:3739: copy_from oid 48 from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 447 2020-11-16T22:16:00.215 INFO:tasks.rados.rados.2.smithi057.stdout:3740: read oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 372 2020-11-16T22:16:00.215 INFO:tasks.rados.rados.2.smithi057.stdout:3740: expect deleted 2020-11-16T22:16:00.216 INFO:tasks.rados.rados.2.smithi057.stdout:3741: copy_from oid 18 from oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 447 2020-11-16T22:16:00.216 INFO:tasks.rados.rados.2.smithi057.stdout:3742: write (excl) oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 447 2020-11-16T22:16:00.216 INFO:tasks.rados.rados.2.smithi057.stdout:3742: seq_num 1255 ranges {692785=435740,1672784=793765,2897503=195282} 2020-11-16T22:16:00.229 INFO:tasks.rados.rados.2.smithi057.stdout:3742: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 692785 to 1128525 tid 1 2020-11-16T22:16:00.237 INFO:tasks.rados.rados.2.smithi057.stdout:3742: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1672784 to 2466549 tid 2 2020-11-16T22:16:00.241 INFO:tasks.rados.rados.2.smithi057.stdout:3742: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2897503 to 3092785 tid 3 2020-11-16T22:16:00.241 INFO:tasks.rados.rados.2.smithi057.stdout:3743: read oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:00.241 INFO:tasks.rados.rados.2.smithi057.stdout:3743: expect (ObjNum 1243 snap 438 seq_num 1243) 2020-11-16T22:16:00.241 INFO:tasks.rados.rados.2.smithi057.stdout:3744: delete oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 447 2020-11-16T22:16:00.241 INFO:tasks.rados.rados.2.smithi057.stdout:3741: finishing copy_from to smithi05720651-18 2020-11-16T22:16:00.241 INFO:tasks.rados.rados.2.smithi057.stdout:3741: got expected ENOENT (src dne) 2020-11-16T22:16:00.242 INFO:tasks.rados.rados.2.smithi057.stdout:3741: finishing copy_from racing read to smithi05720651-18 2020-11-16T22:16:00.242 INFO:tasks.rados.rados.2.smithi057.stdout:3742: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:00.244 INFO:tasks.rados.rados.2.smithi057.stdout:3739: finishing copy_from to smithi05720651-48 2020-11-16T22:16:00.245 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 2713 (ObjNum 1229 snap 433 seq_num 1229) dirty exists 2020-11-16T22:16:00.245 INFO:tasks.rados.rados.2.smithi057.stdout:3739: finishing copy_from racing read to smithi05720651-48 2020-11-16T22:16:00.246 INFO:tasks.rados.rados.2.smithi057.stdout:3739: done (5 left) 2020-11-16T22:16:00.246 INFO:tasks.rados.rados.2.smithi057.stdout:3740: done (4 left) 2020-11-16T22:16:00.247 INFO:tasks.rados.rados.2.smithi057.stdout:3741: done (3 left) 2020-11-16T22:16:00.247 INFO:tasks.rados.rados.2.smithi057.stdout:3744: done (2 left) 2020-11-16T22:16:00.247 INFO:tasks.rados.rados.2.smithi057.stdout:3745: snap_create 2020-11-16T22:16:00.249 INFO:tasks.rados.rados.2.smithi057.stdout:3743: expect (ObjNum 1243 snap 438 seq_num 1243) 2020-11-16T22:16:00.342 INFO:tasks.rados.rados.2.smithi057.stdout:3742: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:00.342 INFO:tasks.rados.rados.2.smithi057.stdout:3742: finishing write tid 3 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:00.342 INFO:tasks.rados.rados.2.smithi057.stdout:3742: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:00.342 INFO:tasks.rados.rados.2.smithi057.stdout:3742: finishing write tid 6 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:00.343 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3143 (ObjNum 1255 snap 447 seq_num 1255) dirty exists 2020-11-16T22:16:00.343 INFO:tasks.rados.rados.2.smithi057.stdout:3742: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1255 snap 447 seq_num 1255) 2020-11-16T22:16:00.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:00 smithi016 bash[10302]: cluster 2020-11-16T22:15:59.256006+0000 mon.a (mon.0) 1608 : cluster [DBG] osdmap e930: 12 total, 12 up, 12 in 2020-11-16T22:16:00.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:00 smithi016 bash[10302]: cluster 2020-11-16T22:16:00.225490+0000 mon.a (mon.0) 1609 : cluster [DBG] osdmap e931: 12 total, 12 up, 12 in 2020-11-16T22:16:00.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:00 smithi195 bash[10218]: cluster 2020-11-16T22:15:59.256006+0000 mon.a (mon.0) 1608 : cluster [DBG] osdmap e930: 12 total, 12 up, 12 in 2020-11-16T22:16:00.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:00 smithi195 bash[10218]: cluster 2020-11-16T22:16:00.225490+0000 mon.a (mon.0) 1609 : cluster [DBG] osdmap e931: 12 total, 12 up, 12 in 2020-11-16T22:16:00.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:00 smithi057 bash[10301]: cluster 2020-11-16T22:15:59.256006+0000 mon.a (mon.0) 1608 : cluster [DBG] osdmap e930: 12 total, 12 up, 12 in 2020-11-16T22:16:00.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:00 smithi057 bash[10301]: cluster 2020-11-16T22:16:00.225490+0000 mon.a (mon.0) 1609 : cluster [DBG] osdmap e931: 12 total, 12 up, 12 in 2020-11-16T22:16:01.224 INFO:tasks.rados.rados.2.smithi057.stdout:3742: done (2 left) 2020-11-16T22:16:01.225 INFO:tasks.rados.rados.2.smithi057.stdout:3743: done (1 left) 2020-11-16T22:16:01.225 INFO:tasks.rados.rados.2.smithi057.stdout:3745: done (0 left) 2020-11-16T22:16:01.225 INFO:tasks.rados.rados.2.smithi057.stdout:3746: read oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:01.225 INFO:tasks.rados.rados.2.smithi057.stdout:3746: expect (ObjNum 1175 snap 407 seq_num 1175) 2020-11-16T22:16:01.225 INFO:tasks.rados.rados.2.smithi057.stdout:3747: delete oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:01.232 INFO:tasks.rados.rados.2.smithi057.stdout:3747: done (1 left) 2020-11-16T22:16:01.233 INFO:tasks.rados.rados.2.smithi057.stdout:3748: snap_remove snap 409 2020-11-16T22:16:01.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:01 smithi016 bash[10302]: cluster 2020-11-16T22:15:59.868026+0000 mgr.x (mgr.24115) 701 : cluster [DBG] pgmap v1561: 17 pgs: 17 active+clean; 559 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.3 MiB/s wr, 4 op/s 2020-11-16T22:16:01.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:01 smithi016 bash[10302]: cluster 2020-11-16T22:16:01.235447+0000 mon.a (mon.0) 1610 : cluster [DBG] osdmap e932: 12 total, 12 up, 12 in 2020-11-16T22:16:01.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:01 smithi195 bash[10218]: cluster 2020-11-16T22:15:59.868026+0000 mgr.x (mgr.24115) 701 : cluster [DBG] pgmap v1561: 17 pgs: 17 active+clean; 559 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.3 MiB/s wr, 4 op/s 2020-11-16T22:16:01.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:01 smithi195 bash[10218]: cluster 2020-11-16T22:16:01.235447+0000 mon.a (mon.0) 1610 : cluster [DBG] osdmap e932: 12 total, 12 up, 12 in 2020-11-16T22:16:01.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:01 smithi057 bash[10301]: cluster 2020-11-16T22:15:59.868026+0000 mgr.x (mgr.24115) 701 : cluster [DBG] pgmap v1561: 17 pgs: 17 active+clean; 559 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.3 MiB/s wr, 4 op/s 2020-11-16T22:16:01.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:01 smithi057 bash[10301]: cluster 2020-11-16T22:16:01.235447+0000 mon.a (mon.0) 1610 : cluster [DBG] osdmap e932: 12 total, 12 up, 12 in 2020-11-16T22:16:02.227 INFO:tasks.rados.rados.2.smithi057.stdout:3748: done (1 left) 2020-11-16T22:16:02.228 INFO:tasks.rados.rados.2.smithi057.stdout:3749: snap_remove snap 447 2020-11-16T22:16:03.237 INFO:tasks.rados.rados.2.smithi057.stdout:3749: done (1 left) 2020-11-16T22:16:03.238 INFO:tasks.rados.rados.2.smithi057.stdout:3750: write (excl) oid 22 current snap is 448 2020-11-16T22:16:03.238 INFO:tasks.rados.rados.2.smithi057.stdout:3750: seq_num 1258 ranges {743206=661487,2131877=541092} 2020-11-16T22:16:03.248 INFO:tasks.rados.rados.2.smithi057.stdout:3750: writing smithi05720651-22 from 743206 to 1404693 tid 1 2020-11-16T22:16:03.256 INFO:tasks.rados.rados.2.smithi057.stdout:3750: writing smithi05720651-22 from 2131877 to 2672969 tid 2 2020-11-16T22:16:03.256 INFO:tasks.rados.rados.2.smithi057.stdout:3751: write (excl) oid 4 current snap is 448 2020-11-16T22:16:03.256 INFO:tasks.rados.rados.2.smithi057.stdout:3751: seq_num 1259 ranges {760013=736736,2190359=401103} 2020-11-16T22:16:03.264 INFO:tasks.rados.rados.2.smithi057.stdout:3751: writing smithi05720651-4 from 760013 to 1496749 tid 1 2020-11-16T22:16:03.271 INFO:tasks.rados.rados.2.smithi057.stdout:3751: writing smithi05720651-4 from 2190359 to 2591462 tid 2 2020-11-16T22:16:03.271 INFO:tasks.rados.rados.2.smithi057.stdout:3752: read oid 26 snap -1 2020-11-16T22:16:03.271 INFO:tasks.rados.rados.2.smithi057.stdout:3752: expect deleted 2020-11-16T22:16:03.271 INFO:tasks.rados.rados.2.smithi057.stdout:3753: snap_remove snap 442 2020-11-16T22:16:03.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:03 smithi016 bash[10302]: cluster 2020-11-16T22:16:01.868808+0000 mgr.x (mgr.24115) 702 : cluster [DBG] pgmap v1564: 17 pgs: 17 active+clean; 566 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 664 KiB/s wr, 4 op/s 2020-11-16T22:16:03.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:03 smithi016 bash[10302]: cluster 2020-11-16T22:16:02.238670+0000 mon.a (mon.0) 1611 : cluster [DBG] osdmap e933: 12 total, 12 up, 12 in 2020-11-16T22:16:03.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:03 smithi195 bash[10218]: cluster 2020-11-16T22:16:01.868808+0000 mgr.x (mgr.24115) 702 : cluster [DBG] pgmap v1564: 17 pgs: 17 active+clean; 566 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 664 KiB/s wr, 4 op/s 2020-11-16T22:16:03.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:03 smithi195 bash[10218]: cluster 2020-11-16T22:16:02.238670+0000 mon.a (mon.0) 1611 : cluster [DBG] osdmap e933: 12 total, 12 up, 12 in 2020-11-16T22:16:03.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:03 smithi057 bash[10301]: cluster 2020-11-16T22:16:01.868808+0000 mgr.x (mgr.24115) 702 : cluster [DBG] pgmap v1564: 17 pgs: 17 active+clean; 566 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 664 KiB/s wr, 4 op/s 2020-11-16T22:16:03.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:03 smithi057 bash[10301]: cluster 2020-11-16T22:16:02.238670+0000 mon.a (mon.0) 1611 : cluster [DBG] osdmap e933: 12 total, 12 up, 12 in 2020-11-16T22:16:04.259 INFO:tasks.rados.rados.2.smithi057.stdout:3753: done (4 left) 2020-11-16T22:16:04.259 INFO:tasks.rados.rados.2.smithi057.stdout:3754: write oid 8 current snap is 448 2020-11-16T22:16:04.259 INFO:tasks.rados.rados.2.smithi057.stdout:3754: seq_num 1260 ranges {776820=411985,1848841=544761,2918265=258555} 2020-11-16T22:16:04.271 INFO:tasks.rados.rados.2.smithi057.stdout:3754: writing smithi05720651-8 from 776820 to 1188805 tid 1 2020-11-16T22:16:04.278 INFO:tasks.rados.rados.2.smithi057.stdout:3754: writing smithi05720651-8 from 1848841 to 2393602 tid 2 2020-11-16T22:16:04.282 INFO:tasks.rados.rados.2.smithi057.stdout:3754: writing smithi05720651-8 from 2918265 to 3176820 tid 3 2020-11-16T22:16:04.283 INFO:tasks.rados.rados.2.smithi057.stdout:3755: snap_remove snap 445 2020-11-16T22:16:04.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:04 smithi016 bash[10302]: cluster 2020-11-16T22:16:03.248247+0000 mon.a (mon.0) 1612 : cluster [DBG] osdmap e934: 12 total, 12 up, 12 in 2020-11-16T22:16:04.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:04 smithi195 bash[10218]: cluster 2020-11-16T22:16:03.248247+0000 mon.a (mon.0) 1612 : cluster [DBG] osdmap e934: 12 total, 12 up, 12 in 2020-11-16T22:16:04.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:04 smithi057 bash[10301]: cluster 2020-11-16T22:16:03.248247+0000 mon.a (mon.0) 1612 : cluster [DBG] osdmap e934: 12 total, 12 up, 12 in 2020-11-16T22:16:05.214 INFO:tasks.rados.rados.2.smithi057.stdout:3755: done (5 left) 2020-11-16T22:16:05.215 INFO:tasks.rados.rados.2.smithi057.stdout:3756: rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:05.215 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 381 2020-11-16T22:16:05.215 INFO:tasks.rados.rados.2.smithi057.stdout:3746: expect (ObjNum 1175 snap 407 seq_num 1175) 2020-11-16T22:16:05.396 INFO:tasks.rados.rados.2.smithi057.stdout:3750: finishing write tid 1 to smithi05720651-22 2020-11-16T22:16:05.396 INFO:tasks.rados.rados.2.smithi057.stdout:3750: finishing write tid 2 to smithi05720651-22 2020-11-16T22:16:05.396 INFO:tasks.rados.rados.2.smithi057.stdout:3750: finishing write tid 4 to smithi05720651-22 2020-11-16T22:16:05.396 INFO:tasks.rados.rados.2.smithi057.stdout:3750: finishing write tid 5 to smithi05720651-22 2020-11-16T22:16:05.397 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 2989 (ObjNum 1258 snap 448 seq_num 1258) dirty exists 2020-11-16T22:16:05.397 INFO:tasks.rados.rados.2.smithi057.stdout:3750: left oid 22 (ObjNum 1258 snap 448 seq_num 1258) 2020-11-16T22:16:05.397 INFO:tasks.rados.rados.2.smithi057.stdout:3751: finishing write tid 1 to smithi05720651-4 2020-11-16T22:16:05.397 INFO:tasks.rados.rados.2.smithi057.stdout:3746: done (5 left) 2020-11-16T22:16:05.397 INFO:tasks.rados.rados.2.smithi057.stdout:3750: done (4 left) 2020-11-16T22:16:05.397 INFO:tasks.rados.rados.2.smithi057.stdout:3752: done (3 left) 2020-11-16T22:16:05.398 INFO:tasks.rados.rados.2.smithi057.stdout:3757: read oid 16 snap -1 2020-11-16T22:16:05.398 INFO:tasks.rados.rados.2.smithi057.stdout:3757: expect (ObjNum 1187 snap 410 seq_num 1187) 2020-11-16T22:16:05.398 INFO:tasks.rados.rados.2.smithi057.stdout:3758: copy_from oid 26 from oid 30 current snap is 448 2020-11-16T22:16:05.398 INFO:tasks.rados.rados.2.smithi057.stdout:3751: finishing write tid 2 to smithi05720651-4 2020-11-16T22:16:05.398 INFO:tasks.rados.rados.2.smithi057.stdout:3751: finishing write tid 4 to smithi05720651-4 2020-11-16T22:16:05.398 INFO:tasks.rados.rados.2.smithi057.stdout:3751: finishing write tid 5 to smithi05720651-4 2020-11-16T22:16:05.398 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 2835 (ObjNum 1259 snap 448 seq_num 1259) dirty exists 2020-11-16T22:16:05.399 INFO:tasks.rados.rados.2.smithi057.stdout:3751: left oid 4 (ObjNum 1259 snap 448 seq_num 1259) 2020-11-16T22:16:05.399 INFO:tasks.rados.rados.2.smithi057.stdout:3754: finishing write tid 1 to smithi05720651-8 2020-11-16T22:16:05.399 INFO:tasks.rados.rados.2.smithi057.stdout:3754: finishing write tid 2 to smithi05720651-8 2020-11-16T22:16:05.399 INFO:tasks.rados.rados.2.smithi057.stdout:3754: finishing write tid 3 to smithi05720651-8 2020-11-16T22:16:05.399 INFO:tasks.rados.rados.2.smithi057.stdout:3754: finishing write tid 5 to smithi05720651-8 2020-11-16T22:16:05.399 INFO:tasks.rados.rados.2.smithi057.stdout:3754: finishing write tid 6 to smithi05720651-8 2020-11-16T22:16:05.399 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 2882 (ObjNum 1260 snap 448 seq_num 1260) dirty exists 2020-11-16T22:16:05.400 INFO:tasks.rados.rados.2.smithi057.stdout:3754: left oid 8 (ObjNum 1260 snap 448 seq_num 1260) 2020-11-16T22:16:05.400 INFO:tasks.rados.rados.2.smithi057.stdout:3751: done (4 left) 2020-11-16T22:16:05.400 INFO:tasks.rados.rados.2.smithi057.stdout:3754: done (3 left) 2020-11-16T22:16:05.400 INFO:tasks.rados.rados.2.smithi057.stdout:3759: read oid 14 snap -1 2020-11-16T22:16:05.400 INFO:tasks.rados.rados.2.smithi057.stdout:3759: expect deleted 2020-11-16T22:16:05.400 INFO:tasks.rados.rados.2.smithi057.stdout:3760: snap_remove snap 417 2020-11-16T22:16:05.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:05 smithi016 bash[10302]: cluster 2020-11-16T22:16:03.869512+0000 mgr.x (mgr.24115) 703 : cluster [DBG] pgmap v1567: 17 pgs: 17 active+clean; 568 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.3 MiB/s wr, 5 op/s 2020-11-16T22:16:05.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:05 smithi016 bash[10302]: cluster 2020-11-16T22:16:04.270372+0000 mon.a (mon.0) 1613 : cluster [DBG] osdmap e935: 12 total, 12 up, 12 in 2020-11-16T22:16:05.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:05 smithi016 bash[10302]: cluster 2020-11-16T22:16:05.225281+0000 mon.a (mon.0) 1614 : cluster [DBG] osdmap e936: 12 total, 12 up, 12 in 2020-11-16T22:16:05.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:05 smithi195 bash[10218]: cluster 2020-11-16T22:16:03.869512+0000 mgr.x (mgr.24115) 703 : cluster [DBG] pgmap v1567: 17 pgs: 17 active+clean; 568 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.3 MiB/s wr, 5 op/s 2020-11-16T22:16:05.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:05 smithi195 bash[10218]: cluster 2020-11-16T22:16:04.270372+0000 mon.a (mon.0) 1613 : cluster [DBG] osdmap e935: 12 total, 12 up, 12 in 2020-11-16T22:16:05.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:05 smithi195 bash[10218]: cluster 2020-11-16T22:16:05.225281+0000 mon.a (mon.0) 1614 : cluster [DBG] osdmap e936: 12 total, 12 up, 12 in 2020-11-16T22:16:05.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:05 smithi057 bash[10301]: cluster 2020-11-16T22:16:03.869512+0000 mgr.x (mgr.24115) 703 : cluster [DBG] pgmap v1567: 17 pgs: 17 active+clean; 568 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.3 MiB/s wr, 5 op/s 2020-11-16T22:16:05.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:05 smithi057 bash[10301]: cluster 2020-11-16T22:16:04.270372+0000 mon.a (mon.0) 1613 : cluster [DBG] osdmap e935: 12 total, 12 up, 12 in 2020-11-16T22:16:05.699 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:05 smithi057 bash[10301]: cluster 2020-11-16T22:16:05.225281+0000 mon.a (mon.0) 1614 : cluster [DBG] osdmap e936: 12 total, 12 up, 12 in 2020-11-16T22:16:06.269 INFO:tasks.rados.rados.2.smithi057.stdout:3760: done (4 left) 2020-11-16T22:16:06.269 INFO:tasks.rados.rados.2.smithi057.stdout:3761: delete oid 36 current snap is 448 2020-11-16T22:16:06.270 INFO:tasks.rados.rados.2.smithi057.stdout:3756: finishing rollback tid 0 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.270 INFO:tasks.rados.rados.2.smithi057.stdout:3756: finishing rollback tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.270 INFO:tasks.rados.rados.2.smithi057.stdout:3756: finishing rollback tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.270 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3165 (ObjNum 1079 snap 377 seq_num 1079) dirty exists 2020-11-16T22:16:06.270 INFO:tasks.rados.rados.2.smithi057.stdout:3757: expect (ObjNum 1187 snap 410 seq_num 1187) 2020-11-16T22:16:06.600 INFO:tasks.rados.rados.2.smithi057.stdout:3758: finishing copy_from to smithi05720651-26 2020-11-16T22:16:06.600 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 2627 (ObjNum 1180 snap 407 seq_num 1180) dirty exists 2020-11-16T22:16:06.600 INFO:tasks.rados.rados.2.smithi057.stdout:3758: finishing copy_from racing read to smithi05720651-26 2020-11-16T22:16:06.600 INFO:tasks.rados.rados.2.smithi057.stdout:3756: done (4 left) 2020-11-16T22:16:06.601 INFO:tasks.rados.rados.2.smithi057.stdout:3757: done (3 left) 2020-11-16T22:16:06.601 INFO:tasks.rados.rados.2.smithi057.stdout:3758: done (2 left) 2020-11-16T22:16:06.601 INFO:tasks.rados.rados.2.smithi057.stdout:3759: done (1 left) 2020-11-16T22:16:06.601 INFO:tasks.rados.rados.2.smithi057.stdout:3761: done (0 left) 2020-11-16T22:16:06.601 INFO:tasks.rados.rados.2.smithi057.stdout:3762: delete oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:06.606 INFO:tasks.rados.rados.2.smithi057.stdout:3762: done (0 left) 2020-11-16T22:16:06.606 INFO:tasks.rados.rados.2.smithi057.stdout:3763: write (excl) oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:06.606 INFO:tasks.rados.rados.2.smithi057.stdout:3763: seq_num 1263 ranges {427241=754085,1624287=408441,2600534=549964} 2020-11-16T22:16:06.623 INFO:tasks.rados.rados.2.smithi057.stdout:3763: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 427241 to 1181326 tid 1 2020-11-16T22:16:06.628 INFO:tasks.rados.rados.2.smithi057.stdout:3763: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1624287 to 2032728 tid 2 2020-11-16T22:16:06.635 INFO:tasks.rados.rados.2.smithi057.stdout:3763: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2600534 to 3150498 tid 3 2020-11-16T22:16:06.635 INFO:tasks.rados.rados.2.smithi057.stdout:3764: rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:06.635 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 415 2020-11-16T22:16:06.635 INFO:tasks.rados.rados.2.smithi057.stdout:3763: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.635 INFO:tasks.rados.rados.2.smithi057.stdout:3765: write oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:06.635 INFO:tasks.rados.rados.2.smithi057.stdout:3765: seq_num 1264 ranges {444048=429334,1282769=552099,2627957=616091} 2020-11-16T22:16:06.640 INFO:tasks.rados.rados.2.smithi057.stdout:3765: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 444048 to 873382 tid 1 2020-11-16T22:16:06.645 INFO:tasks.rados.rados.2.smithi057.stdout:3765: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1282769 to 1834868 tid 2 2020-11-16T22:16:06.654 INFO:tasks.rados.rados.2.smithi057.stdout:3765: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2627957 to 3244048 tid 3 2020-11-16T22:16:06.654 INFO:tasks.rados.rados.2.smithi057.stdout:3766: delete oid 32 current snap is 448 2020-11-16T22:16:06.654 INFO:tasks.rados.rados.2.smithi057.stdout:3763: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.654 INFO:tasks.rados.rados.2.smithi057.stdout:3763: finishing write tid 3 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.654 INFO:tasks.rados.rados.2.smithi057.stdout:3763: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.655 INFO:tasks.rados.rados.2.smithi057.stdout:3763: finishing write tid 6 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.655 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2605 (ObjNum 1263 snap 448 seq_num 1263) dirty exists 2020-11-16T22:16:06.655 INFO:tasks.rados.rados.2.smithi057.stdout:3763: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1263 snap 448 seq_num 1263) 2020-11-16T22:16:06.655 INFO:tasks.rados.rados.2.smithi057.stdout:3765: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.655 INFO:tasks.rados.rados.2.smithi057.stdout:3764: finishing rollback tid 0 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.655 INFO:tasks.rados.rados.2.smithi057.stdout:3764: finishing rollback tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.655 INFO:tasks.rados.rados.2.smithi057.stdout:3764: finishing rollback tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.656 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2787 (ObjNum 1094 snap 380 seq_num 1094) dirty exists 2020-11-16T22:16:06.656 INFO:tasks.rados.rados.2.smithi057.stdout:3765: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.660 INFO:tasks.rados.rados.2.smithi057.stdout:3763: done (3 left) 2020-11-16T22:16:06.660 INFO:tasks.rados.rados.2.smithi057.stdout:3764: done (2 left) 2020-11-16T22:16:06.660 INFO:tasks.rados.rados.2.smithi057.stdout:3766: done (1 left) 2020-11-16T22:16:06.660 INFO:tasks.rados.rados.2.smithi057.stdout:3767: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 441 2020-11-16T22:16:06.660 INFO:tasks.rados.rados.2.smithi057.stdout:3767: expect deleted 2020-11-16T22:16:06.661 INFO:tasks.rados.rados.2.smithi057.stdout:3768: delete oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:06.663 INFO:tasks.rados.rados.2.smithi057.stdout:3765: finishing write tid 3 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.663 INFO:tasks.rados.rados.2.smithi057.stdout:3765: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.664 INFO:tasks.rados.rados.2.smithi057.stdout:3765: finishing write tid 6 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.664 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2531 (ObjNum 1264 snap 448 seq_num 1264) dirty exists 2020-11-16T22:16:06.664 INFO:tasks.rados.rados.2.smithi057.stdout:3765: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1264 snap 448 seq_num 1264) 2020-11-16T22:16:06.666 INFO:tasks.rados.rados.2.smithi057.stdout:3765: done (2 left) 2020-11-16T22:16:06.666 INFO:tasks.rados.rados.2.smithi057.stdout:3767: done (1 left) 2020-11-16T22:16:06.666 INFO:tasks.rados.rados.2.smithi057.stdout:3768: done (0 left) 2020-11-16T22:16:06.666 INFO:tasks.rados.rados.2.smithi057.stdout:3769: write (excl) oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:06.666 INFO:tasks.rados.rados.2.smithi057.stdout:3769: seq_num 1267 ranges {494469=655081,1741862=415779,2710226=584243} 2020-11-16T22:16:06.673 INFO:tasks.rados.rados.2.smithi057.stdout:3769: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 494469 to 1149550 tid 1 2020-11-16T22:16:06.680 INFO:tasks.rados.rados.2.smithi057.stdout:3769: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1741862 to 2157641 tid 2 2020-11-16T22:16:06.688 INFO:tasks.rados.rados.2.smithi057.stdout:3769: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2710226 to 3294469 tid 3 2020-11-16T22:16:06.688 INFO:tasks.rados.rados.2.smithi057.stdout:3770: write oid 42 current snap is 448 2020-11-16T22:16:06.688 INFO:tasks.rados.rados.2.smithi057.stdout:3770: seq_num 1268 ranges {511276=730330,1800344=559437,3021296=289980} 2020-11-16T22:16:06.695 INFO:tasks.rados.rados.2.smithi057.stdout:3770: writing smithi05720651-42 from 511276 to 1241606 tid 1 2020-11-16T22:16:06.701 INFO:tasks.rados.rados.2.smithi057.stdout:3770: writing smithi05720651-42 from 1800344 to 2359781 tid 2 2020-11-16T22:16:06.707 INFO:tasks.rados.rados.2.smithi057.stdout:3770: writing smithi05720651-42 from 3021296 to 3311276 tid 3 2020-11-16T22:16:06.707 INFO:tasks.rados.rados.2.smithi057.stdout:3771: read oid 44 snap -1 2020-11-16T22:16:06.707 INFO:tasks.rados.rados.2.smithi057.stdout:3771: expect (ObjNum 1222 snap 433 seq_num 1222) 2020-11-16T22:16:06.707 INFO:tasks.rados.rados.2.smithi057.stdout:3772: write oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:06.707 INFO:tasks.rados.rados.2.smithi057.stdout:3772: seq_num 1269 ranges {528083=405579,1342473=419448,2248719=733949} 2020-11-16T22:16:06.712 INFO:tasks.rados.rados.2.smithi057.stdout:3772: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 528083 to 933662 tid 1 2020-11-16T22:16:06.717 INFO:tasks.rados.rados.2.smithi057.stdout:3772: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1342473 to 1761921 tid 2 2020-11-16T22:16:06.724 INFO:tasks.rados.rados.2.smithi057.stdout:3772: writing smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2248719 to 2982668 tid 3 2020-11-16T22:16:06.724 INFO:tasks.rados.rados.2.smithi057.stdout:3773: rollback oid 48 current snap is 448 2020-11-16T22:16:06.725 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 48 to 426 2020-11-16T22:16:06.725 INFO:tasks.rados.rados.2.smithi057.stdout:3769: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.725 INFO:tasks.rados.rados.2.smithi057.stdout:3769: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.725 INFO:tasks.rados.rados.2.smithi057.stdout:3769: finishing write tid 3 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.725 INFO:tasks.rados.rados.2.smithi057.stdout:3769: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.725 INFO:tasks.rados.rados.2.smithi057.stdout:3770: finishing write tid 1 to smithi05720651-42 2020-11-16T22:16:06.725 INFO:tasks.rados.rados.2.smithi057.stdout:3770: finishing write tid 2 to smithi05720651-42 2020-11-16T22:16:06.726 INFO:tasks.rados.rados.2.smithi057.stdout:3770: finishing write tid 3 to smithi05720651-42 2020-11-16T22:16:06.726 INFO:tasks.rados.rados.2.smithi057.stdout:3774: write oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:06.726 INFO:tasks.rados.rados.2.smithi057.stdout:3774: seq_num 1270 ranges {544890=597181,1917308=563106,3076142=268748} 2020-11-16T22:16:06.731 INFO:tasks.rados.rados.2.smithi057.stdout:3774: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 544890 to 1142071 tid 1 2020-11-16T22:16:06.739 INFO:tasks.rados.rados.2.smithi057.stdout:3774: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1917308 to 2480414 tid 2 2020-11-16T22:16:06.744 INFO:tasks.rados.rados.2.smithi057.stdout:3774: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3076142 to 3344890 tid 3 2020-11-16T22:16:06.745 INFO:tasks.rados.rados.2.smithi057.stdout:3775: read oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:06.745 INFO:tasks.rados.rados.2.smithi057.stdout:3775: expect (ObjNum 1243 snap 438 seq_num 1243) 2020-11-16T22:16:06.745 INFO:tasks.rados.rados.2.smithi057.stdout:3776: read oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:06.745 INFO:tasks.rados.rados.2.smithi057.stdout:3776: expect (ObjNum 1263 snap 448 seq_num 1263) 2020-11-16T22:16:06.745 INFO:tasks.rados.rados.2.smithi057.stdout:3777: copy_from oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 50 current snap is 448 2020-11-16T22:16:06.745 INFO:tasks.rados.rados.2.smithi057.stdout:3770: finishing write tid 5 to smithi05720651-42 2020-11-16T22:16:06.746 INFO:tasks.rados.rados.2.smithi057.stdout:3769: finishing write tid 6 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.746 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2535 (ObjNum 1267 snap 448 seq_num 1267) dirty exists 2020-11-16T22:16:06.746 INFO:tasks.rados.rados.2.smithi057.stdout:3769: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1267 snap 448 seq_num 1267) 2020-11-16T22:16:06.746 INFO:tasks.rados.rados.2.smithi057.stdout:3770: finishing write tid 6 to smithi05720651-42 2020-11-16T22:16:06.746 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 2415 (ObjNum 1268 snap 448 seq_num 1268) dirty exists 2020-11-16T22:16:06.746 INFO:tasks.rados.rados.2.smithi057.stdout:3770: left oid 42 (ObjNum 1268 snap 448 seq_num 1268) 2020-11-16T22:16:06.747 INFO:tasks.rados.rados.2.smithi057.stdout:3772: finishing write tid 1 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.747 INFO:tasks.rados.rados.2.smithi057.stdout:3772: finishing write tid 2 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.747 INFO:tasks.rados.rados.2.smithi057.stdout:3773: finishing rollback tid 0 to smithi05720651-48 2020-11-16T22:16:06.747 INFO:tasks.rados.rados.2.smithi057.stdout:3773: finishing rollback tid 1 to smithi05720651-48 2020-11-16T22:16:06.747 INFO:tasks.rados.rados.2.smithi057.stdout:3773: finishing rollback tid 2 to smithi05720651-48 2020-11-16T22:16:06.747 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 2854 (ObjNum 1212 snap 425 seq_num 1212) dirty exists 2020-11-16T22:16:06.747 INFO:tasks.rados.rados.2.smithi057.stdout:3772: finishing write tid 3 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.748 INFO:tasks.rados.rados.2.smithi057.stdout:3772: finishing write tid 5 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.748 INFO:tasks.rados.rados.2.smithi057.stdout:3772: finishing write tid 6 to smithi05720651-35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.748 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2791 (ObjNum 1269 snap 448 seq_num 1269) dirty exists 2020-11-16T22:16:06.748 INFO:tasks.rados.rados.2.smithi057.stdout:3772: left oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1269 snap 448 seq_num 1269) 2020-11-16T22:16:06.748 INFO:tasks.rados.rados.2.smithi057.stdout:3774: finishing write tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.748 INFO:tasks.rados.rados.2.smithi057.stdout:3769: done (8 left) 2020-11-16T22:16:06.748 INFO:tasks.rados.rados.2.smithi057.stdout:3770: done (7 left) 2020-11-16T22:16:06.749 INFO:tasks.rados.rados.2.smithi057.stdout:3772: done (6 left) 2020-11-16T22:16:06.749 INFO:tasks.rados.rados.2.smithi057.stdout:3773: done (5 left) 2020-11-16T22:16:06.749 INFO:tasks.rados.rados.2.smithi057.stdout:3778: read oid 14 snap -1 2020-11-16T22:16:06.749 INFO:tasks.rados.rados.2.smithi057.stdout:3778: expect deleted 2020-11-16T22:16:06.749 INFO:tasks.rados.rados.2.smithi057.stdout:3779: write oid 16 current snap is 448 2020-11-16T22:16:06.749 INFO:tasks.rados.rados.2.smithi057.stdout:3779: seq_num 1271 ranges {561697=672430,1975790=706764,3103565=258132} 2020-11-16T22:16:06.752 INFO:tasks.rados.rados.2.smithi057.stdout:3779: writing smithi05720651-16 from 561697 to 1234127 tid 1 2020-11-16T22:16:06.760 INFO:tasks.rados.rados.2.smithi057.stdout:3779: writing smithi05720651-16 from 1975790 to 2682554 tid 2 2020-11-16T22:16:06.764 INFO:tasks.rados.rados.2.smithi057.stdout:3779: writing smithi05720651-16 from 3103565 to 3361697 tid 3 2020-11-16T22:16:06.765 INFO:tasks.rados.rados.2.smithi057.stdout:3780: read oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 400 2020-11-16T22:16:06.765 INFO:tasks.rados.rados.2.smithi057.stdout:3780: expect (ObjNum 1137 snap 394 seq_num 1137) 2020-11-16T22:16:06.765 INFO:tasks.rados.rados.2.smithi057.stdout:3781: write (excl) oid 34 current snap is 448 2020-11-16T22:16:06.765 INFO:tasks.rados.rados.2.smithi057.stdout:3781: seq_num 1272 ranges {578504=747679,2034272=566775,3130988=247516} 2020-11-16T22:16:06.772 INFO:tasks.rados.rados.2.smithi057.stdout:3781: writing smithi05720651-34 from 578504 to 1326183 tid 1 2020-11-16T22:16:06.779 INFO:tasks.rados.rados.2.smithi057.stdout:3781: writing smithi05720651-34 from 2034272 to 2601047 tid 2 2020-11-16T22:16:06.784 INFO:tasks.rados.rados.2.smithi057.stdout:3781: writing smithi05720651-34 from 3130988 to 3378504 tid 3 2020-11-16T22:16:06.784 INFO:tasks.rados.rados.2.smithi057.stdout:3782: delete oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:06.784 INFO:tasks.rados.rados.2.smithi057.stdout:3774: finishing write tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.785 INFO:tasks.rados.rados.2.smithi057.stdout:3771: expect (ObjNum 1222 snap 433 seq_num 1222) 2020-11-16T22:16:06.907 INFO:tasks.rados.rados.2.smithi057.stdout:3777: finishing copy_from to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.907 INFO:tasks.rados.rados.2.smithi057.stdout:3777: got expected ENOENT (src dne) 2020-11-16T22:16:06.908 INFO:tasks.rados.rados.2.smithi057.stdout:3777: finishing copy_from racing read to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.908 INFO:tasks.rados.rados.2.smithi057.stdout:3774: finishing write tid 3 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.908 INFO:tasks.rados.rados.2.smithi057.stdout:3774: finishing write tid 5 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.908 INFO:tasks.rados.rados.2.smithi057.stdout:3774: finishing write tid 6 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:06.908 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2999 (ObjNum 1270 snap 448 seq_num 1270) dirty exists 2020-11-16T22:16:06.908 INFO:tasks.rados.rados.2.smithi057.stdout:3774: left oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1270 snap 448 seq_num 1270) 2020-11-16T22:16:06.908 INFO:tasks.rados.rados.2.smithi057.stdout:3776: expect (ObjNum 1263 snap 448 seq_num 1263) 2020-11-16T22:16:07.176 INFO:tasks.rados.rados.2.smithi057.stdout:3779: finishing write tid 1 to smithi05720651-16 2020-11-16T22:16:07.176 INFO:tasks.rados.rados.2.smithi057.stdout:3779: finishing write tid 2 to smithi05720651-16 2020-11-16T22:16:07.177 INFO:tasks.rados.rados.2.smithi057.stdout:3780: expect (ObjNum 1137 snap 394 seq_num 1137) 2020-11-16T22:16:07.271 INFO:tasks.rados.rados.2.smithi057.stdout:3779: finishing write tid 3 to smithi05720651-16 2020-11-16T22:16:07.271 INFO:tasks.rados.rados.2.smithi057.stdout:3779: finishing write tid 5 to smithi05720651-16 2020-11-16T22:16:07.271 INFO:tasks.rados.rados.2.smithi057.stdout:3779: finishing write tid 6 to smithi05720651-16 2020-11-16T22:16:07.271 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 16 v 3003 (ObjNum 1271 snap 448 seq_num 1271) dirty exists 2020-11-16T22:16:07.272 INFO:tasks.rados.rados.2.smithi057.stdout:3779: left oid 16 (ObjNum 1271 snap 448 seq_num 1271) 2020-11-16T22:16:07.272 INFO:tasks.rados.rados.2.smithi057.stdout:3781: finishing write tid 1 to smithi05720651-34 2020-11-16T22:16:07.272 INFO:tasks.rados.rados.2.smithi057.stdout:3781: finishing write tid 2 to smithi05720651-34 2020-11-16T22:16:07.272 INFO:tasks.rados.rados.2.smithi057.stdout:3781: finishing write tid 3 to smithi05720651-34 2020-11-16T22:16:07.272 INFO:tasks.rados.rados.2.smithi057.stdout:3781: finishing write tid 5 to smithi05720651-34 2020-11-16T22:16:07.272 INFO:tasks.rados.rados.2.smithi057.stdout:3781: finishing write tid 6 to smithi05720651-34 2020-11-16T22:16:07.272 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 2839 (ObjNum 1272 snap 448 seq_num 1272) dirty exists 2020-11-16T22:16:07.273 INFO:tasks.rados.rados.2.smithi057.stdout:3781: left oid 34 (ObjNum 1272 snap 448 seq_num 1272) 2020-11-16T22:16:07.273 INFO:tasks.rados.rados.2.smithi057.stdout:3775: expect (ObjNum 1243 snap 438 seq_num 1243) 2020-11-16T22:16:07.355 INFO:tasks.rados.rados.2.smithi057.stdout:3771: done (9 left) 2020-11-16T22:16:07.355 INFO:tasks.rados.rados.2.smithi057.stdout:3774: done (8 left) 2020-11-16T22:16:07.355 INFO:tasks.rados.rados.2.smithi057.stdout:3775: done (7 left) 2020-11-16T22:16:07.355 INFO:tasks.rados.rados.2.smithi057.stdout:3776: done (6 left) 2020-11-16T22:16:07.356 INFO:tasks.rados.rados.2.smithi057.stdout:3777: done (5 left) 2020-11-16T22:16:07.356 INFO:tasks.rados.rados.2.smithi057.stdout:3778: done (4 left) 2020-11-16T22:16:07.356 INFO:tasks.rados.rados.2.smithi057.stdout:3779: done (3 left) 2020-11-16T22:16:07.356 INFO:tasks.rados.rados.2.smithi057.stdout:3780: done (2 left) 2020-11-16T22:16:07.356 INFO:tasks.rados.rados.2.smithi057.stdout:3781: done (1 left) 2020-11-16T22:16:07.356 INFO:tasks.rados.rados.2.smithi057.stdout:3782: done (0 left) 2020-11-16T22:16:07.356 INFO:tasks.rados.rados.2.smithi057.stdout:3783: snap_remove snap 412 2020-11-16T22:16:07.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:07 smithi016 bash[10302]: cluster 2020-11-16T22:16:05.870382+0000 mgr.x (mgr.24115) 704 : cluster [DBG] pgmap v1570: 17 pgs: 17 active+clean; 573 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2020-11-16T22:16:07.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:07 smithi016 bash[10302]: cluster 2020-11-16T22:16:06.280160+0000 mon.a (mon.0) 1615 : cluster [DBG] osdmap e937: 12 total, 12 up, 12 in 2020-11-16T22:16:07.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:07 smithi195 bash[10218]: cluster 2020-11-16T22:16:05.870382+0000 mgr.x (mgr.24115) 704 : cluster [DBG] pgmap v1570: 17 pgs: 17 active+clean; 573 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2020-11-16T22:16:07.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:07 smithi195 bash[10218]: cluster 2020-11-16T22:16:06.280160+0000 mon.a (mon.0) 1615 : cluster [DBG] osdmap e937: 12 total, 12 up, 12 in 2020-11-16T22:16:07.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:07 smithi057 bash[10301]: cluster 2020-11-16T22:16:05.870382+0000 mgr.x (mgr.24115) 704 : cluster [DBG] pgmap v1570: 17 pgs: 17 active+clean; 573 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.2 MiB/s wr, 9 op/s 2020-11-16T22:16:07.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:07 smithi057 bash[10301]: cluster 2020-11-16T22:16:06.280160+0000 mon.a (mon.0) 1615 : cluster [DBG] osdmap e937: 12 total, 12 up, 12 in 2020-11-16T22:16:08.281 INFO:tasks.rados.rados.2.smithi057.stdout:3783: done (0 left) 2020-11-16T22:16:08.282 INFO:tasks.rados.rados.2.smithi057.stdout:3784: copy_from oid 46 from oid 14 current snap is 448 2020-11-16T22:16:08.282 INFO:tasks.rados.rados.2.smithi057.stdout:3785: write oid 36 current snap is 448 2020-11-16T22:16:08.282 INFO:tasks.rados.rados.2.smithi057.stdout:3785: seq_num 1274 ranges {612118=498177,1634883=570444,2669481=706662} 2020-11-16T22:16:08.294 INFO:tasks.rados.rados.2.smithi057.stdout:3785: writing smithi05720651-36 from 612118 to 1110295 tid 1 2020-11-16T22:16:08.301 INFO:tasks.rados.rados.2.smithi057.stdout:3785: writing smithi05720651-36 from 1634883 to 2205327 tid 2 2020-11-16T22:16:08.308 INFO:tasks.rados.rados.2.smithi057.stdout:3785: writing smithi05720651-36 from 2669481 to 3376143 tid 3 2020-11-16T22:16:08.309 INFO:tasks.rados.rados.2.smithi057.stdout:3786: read oid 50 snap -1 2020-11-16T22:16:08.309 INFO:tasks.rados.rados.2.smithi057.stdout:3786: expect deleted 2020-11-16T22:16:08.309 INFO:tasks.rados.rados.2.smithi057.stdout:3787: snap_remove snap 341 2020-11-16T22:16:09.286 INFO:tasks.rados.rados.2.smithi057.stdout:3787: done (3 left) 2020-11-16T22:16:09.287 INFO:tasks.rados.rados.2.smithi057.stdout:3788: delete oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:09.287 INFO:tasks.rados.rados.2.smithi057.stdout:3784: finishing copy_from to smithi05720651-46 2020-11-16T22:16:09.287 INFO:tasks.rados.rados.2.smithi057.stdout:3784: got expected ENOENT (src dne) 2020-11-16T22:16:09.288 INFO:tasks.rados.rados.2.smithi057.stdout:3784: finishing copy_from racing read to smithi05720651-46 2020-11-16T22:16:09.288 INFO:tasks.rados.rados.2.smithi057.stdout:3785: finishing write tid 1 to smithi05720651-36 2020-11-16T22:16:09.288 INFO:tasks.rados.rados.2.smithi057.stdout:3785: finishing write tid 2 to smithi05720651-36 2020-11-16T22:16:09.288 INFO:tasks.rados.rados.2.smithi057.stdout:3785: finishing write tid 3 to smithi05720651-36 2020-11-16T22:16:09.288 INFO:tasks.rados.rados.2.smithi057.stdout:3785: finishing write tid 5 to smithi05720651-36 2020-11-16T22:16:09.289 INFO:tasks.rados.rados.2.smithi057.stdout:3785: finishing write tid 6 to smithi05720651-36 2020-11-16T22:16:09.289 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 2558 (ObjNum 1274 snap 448 seq_num 1274) dirty exists 2020-11-16T22:16:09.289 INFO:tasks.rados.rados.2.smithi057.stdout:3785: left oid 36 (ObjNum 1274 snap 448 seq_num 1274) 2020-11-16T22:16:09.298 INFO:tasks.rados.rados.2.smithi057.stdout:3784: done (3 left) 2020-11-16T22:16:09.298 INFO:tasks.rados.rados.2.smithi057.stdout:3785: done (2 left) 2020-11-16T22:16:09.298 INFO:tasks.rados.rados.2.smithi057.stdout:3786: done (1 left) 2020-11-16T22:16:09.298 INFO:tasks.rados.rados.2.smithi057.stdout:3788: done (0 left) 2020-11-16T22:16:09.299 INFO:tasks.rados.rados.2.smithi057.stdout:3789: snap_remove snap 420 2020-11-16T22:16:09.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:09 smithi016 bash[10302]: cluster 2020-11-16T22:16:07.871207+0000 mgr.x (mgr.24115) 705 : cluster [DBG] pgmap v1572: 17 pgs: 17 active+clean; 582 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2020-11-16T22:16:09.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:09 smithi016 bash[10302]: cluster 2020-11-16T22:16:08.293184+0000 mon.a (mon.0) 1616 : cluster [DBG] osdmap e938: 12 total, 12 up, 12 in 2020-11-16T22:16:09.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:09 smithi195 bash[10218]: cluster 2020-11-16T22:16:07.871207+0000 mgr.x (mgr.24115) 705 : cluster [DBG] pgmap v1572: 17 pgs: 17 active+clean; 582 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2020-11-16T22:16:09.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:09 smithi195 bash[10218]: cluster 2020-11-16T22:16:08.293184+0000 mon.a (mon.0) 1616 : cluster [DBG] osdmap e938: 12 total, 12 up, 12 in 2020-11-16T22:16:09.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:09 smithi057 bash[10301]: cluster 2020-11-16T22:16:07.871207+0000 mgr.x (mgr.24115) 705 : cluster [DBG] pgmap v1572: 17 pgs: 17 active+clean; 582 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 1.8 MiB/s wr, 12 op/s 2020-11-16T22:16:09.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:09 smithi057 bash[10301]: cluster 2020-11-16T22:16:08.293184+0000 mon.a (mon.0) 1616 : cluster [DBG] osdmap e938: 12 total, 12 up, 12 in 2020-11-16T22:16:10.217 INFO:tasks.rados.rados.2.smithi057.stdout:3789: done (0 left) 2020-11-16T22:16:10.217 INFO:tasks.rados.rados.2.smithi057.stdout:3790: read oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 415 2020-11-16T22:16:10.217 INFO:tasks.rados.rados.2.smithi057.stdout:3790: expect deleted 2020-11-16T22:16:10.217 INFO:tasks.rados.rados.2.smithi057.stdout:3791: read oid 36 snap 378 2020-11-16T22:16:10.218 INFO:tasks.rados.rados.2.smithi057.stdout:3791: expect deleted 2020-11-16T22:16:10.218 INFO:tasks.rados.rados.2.smithi057.stdout:3792: write (excl) oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:10.218 INFO:tasks.rados.rados.2.smithi057.stdout:3792: seq_num 1276 ranges {645732=648675,1751847=574113,3124327=321405} 2020-11-16T22:16:10.233 INFO:tasks.rados.rados.2.smithi057.stdout:3792: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 645732 to 1294407 tid 1 2020-11-16T22:16:10.239 INFO:tasks.rados.rados.2.smithi057.stdout:3792: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1751847 to 2325960 tid 2 2020-11-16T22:16:10.246 INFO:tasks.rados.rados.2.smithi057.stdout:3792: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3124327 to 3445732 tid 3 2020-11-16T22:16:10.246 INFO:tasks.rados.rados.2.smithi057.stdout:3793: delete oid 48 current snap is 448 2020-11-16T22:16:10.248 INFO:tasks.rados.rados.2.smithi057.stdout:3790: done (3 left) 2020-11-16T22:16:10.248 INFO:tasks.rados.rados.2.smithi057.stdout:3791: done (2 left) 2020-11-16T22:16:10.248 INFO:tasks.rados.rados.2.smithi057.stdout:3793: done (1 left) 2020-11-16T22:16:10.249 INFO:tasks.rados.rados.2.smithi057.stdout:3794: write oid 4 current snap is 448 2020-11-16T22:16:10.249 INFO:tasks.rados.rados.2.smithi057.stdout:3794: seq_num 1278 ranges {679346=515526,1868811=577782,3179173=300173} 2020-11-16T22:16:10.255 INFO:tasks.rados.rados.2.smithi057.stdout:3794: writing smithi05720651-4 from 679346 to 1194872 tid 1 2020-11-16T22:16:10.262 INFO:tasks.rados.rados.2.smithi057.stdout:3794: writing smithi05720651-4 from 1868811 to 2446593 tid 2 2020-11-16T22:16:10.268 INFO:tasks.rados.rados.2.smithi057.stdout:3794: writing smithi05720651-4 from 3179173 to 3479346 tid 3 2020-11-16T22:16:10.268 INFO:tasks.rados.rados.2.smithi057.stdout:3795: write oid 10 current snap is 448 2020-11-16T22:16:10.269 INFO:tasks.rados.rados.2.smithi057.stdout:3795: seq_num 1279 ranges {696153=590775,1927293=721440,3206596=289557} 2020-11-16T22:16:10.276 INFO:tasks.rados.rados.2.smithi057.stdout:3795: writing smithi05720651-10 from 696153 to 1286928 tid 1 2020-11-16T22:16:10.284 INFO:tasks.rados.rados.2.smithi057.stdout:3795: writing smithi05720651-10 from 1927293 to 2648733 tid 2 2020-11-16T22:16:10.289 INFO:tasks.rados.rados.2.smithi057.stdout:3795: writing smithi05720651-10 from 3206596 to 3496153 tid 3 2020-11-16T22:16:10.289 INFO:tasks.rados.rados.2.smithi057.stdout:3796: rollback oid 36 current snap is 448 2020-11-16T22:16:10.289 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 36 to 377 2020-11-16T22:16:10.290 INFO:tasks.rados.rados.2.smithi057.stdout:3794: finishing write tid 1 to smithi05720651-4 2020-11-16T22:16:10.290 INFO:tasks.rados.rados.2.smithi057.stdout:3794: finishing write tid 2 to smithi05720651-4 2020-11-16T22:16:10.290 INFO:tasks.rados.rados.2.smithi057.stdout:3794: finishing write tid 3 to smithi05720651-4 2020-11-16T22:16:10.290 INFO:tasks.rados.rados.2.smithi057.stdout:3795: finishing write tid 1 to smithi05720651-10 2020-11-16T22:16:10.290 INFO:tasks.rados.rados.2.smithi057.stdout:3797: write (excl) oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:10.290 INFO:tasks.rados.rados.2.smithi057.stdout:3797: seq_num 1280 ranges {712960=666024,1985775=581451,3234019=278941} 2020-11-16T22:16:10.297 INFO:tasks.rados.rados.2.smithi057.stdout:3797: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 712960 to 1378984 tid 1 2020-11-16T22:16:10.304 INFO:tasks.rados.rados.2.smithi057.stdout:3797: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1985775 to 2567226 tid 2 2020-11-16T22:16:10.310 INFO:tasks.rados.rados.2.smithi057.stdout:3797: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3234019 to 3512960 tid 3 2020-11-16T22:16:10.310 INFO:tasks.rados.rados.2.smithi057.stdout:3798: write oid 6 current snap is 448 2020-11-16T22:16:10.311 INFO:tasks.rados.rados.2.smithi057.stdout:3798: seq_num 1281 ranges {729767=741273,1927904=725109,3145089=384678} 2020-11-16T22:16:10.318 INFO:tasks.rados.rados.2.smithi057.stdout:3798: writing smithi05720651-6 from 729767 to 1471040 tid 1 2020-11-16T22:16:10.325 INFO:tasks.rados.rados.2.smithi057.stdout:3798: writing smithi05720651-6 from 1927904 to 2653013 tid 2 2020-11-16T22:16:10.330 INFO:tasks.rados.rados.2.smithi057.stdout:3798: writing smithi05720651-6 from 3145089 to 3529767 tid 3 2020-11-16T22:16:10.330 INFO:tasks.rados.rados.2.smithi057.stdout:3799: write (excl) oid 24 current snap is 448 2020-11-16T22:16:10.330 INFO:tasks.rados.rados.2.smithi057.stdout:3799: seq_num 1282 ranges {746574=416522,1586386=468767,2772512=629544} 2020-11-16T22:16:10.337 INFO:tasks.rados.rados.2.smithi057.stdout:3799: writing smithi05720651-24 from 746574 to 1163096 tid 1 2020-11-16T22:16:10.342 INFO:tasks.rados.rados.2.smithi057.stdout:3799: writing smithi05720651-24 from 1586386 to 2055153 tid 2 2020-11-16T22:16:10.351 INFO:tasks.rados.rados.2.smithi057.stdout:3799: writing smithi05720651-24 from 2772512 to 3402056 tid 3 2020-11-16T22:16:10.351 INFO:tasks.rados.rados.2.smithi057.stdout:3800: copy_from oid 42 from oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:10.351 INFO:tasks.rados.rados.2.smithi057.stdout:3795: finishing write tid 2 to smithi05720651-10 2020-11-16T22:16:10.351 INFO:tasks.rados.rados.2.smithi057.stdout:3795: finishing write tid 3 to smithi05720651-10 2020-11-16T22:16:10.351 INFO:tasks.rados.rados.2.smithi057.stdout:3795: finishing write tid 5 to smithi05720651-10 2020-11-16T22:16:10.352 INFO:tasks.rados.rados.2.smithi057.stdout:3795: finishing write tid 6 to smithi05720651-10 2020-11-16T22:16:10.352 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 2562 (ObjNum 1279 snap 448 seq_num 1279) dirty exists 2020-11-16T22:16:10.352 INFO:tasks.rados.rados.2.smithi057.stdout:3795: left oid 10 (ObjNum 1279 snap 448 seq_num 1279) 2020-11-16T22:16:10.352 INFO:tasks.rados.rados.2.smithi057.stdout:3796: finishing rollback tid 0 to smithi05720651-36 2020-11-16T22:16:10.352 INFO:tasks.rados.rados.2.smithi057.stdout:3795: done (7 left) 2020-11-16T22:16:10.352 INFO:tasks.rados.rados.2.smithi057.stdout:3801: read oid 50 snap 370 2020-11-16T22:16:10.352 INFO:tasks.rados.rados.2.smithi057.stdout:3801: expect (ObjNum 1024 snap 360 seq_num 1024) 2020-11-16T22:16:10.353 INFO:tasks.rados.rados.2.smithi057.stdout:3802: rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:10.353 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 399 2020-11-16T22:16:10.353 INFO:tasks.rados.rados.2.smithi057.stdout:3796: finishing rollback tid 1 to smithi05720651-36 2020-11-16T22:16:10.353 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 2564 (ObjNum 81 snap 0 seq_num 0) dirty dne 2020-11-16T22:16:10.353 INFO:tasks.rados.rados.2.smithi057.stdout:3797: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.353 INFO:tasks.rados.rados.2.smithi057.stdout:3797: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.353 INFO:tasks.rados.rados.2.smithi057.stdout:3797: finishing write tid 3 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.354 INFO:tasks.rados.rados.2.smithi057.stdout:3797: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.354 INFO:tasks.rados.rados.2.smithi057.stdout:3797: finishing write tid 6 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.354 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2609 (ObjNum 1280 snap 448 seq_num 1280) dirty exists 2020-11-16T22:16:10.354 INFO:tasks.rados.rados.2.smithi057.stdout:3797: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1280 snap 448 seq_num 1280) 2020-11-16T22:16:10.354 INFO:tasks.rados.rados.2.smithi057.stdout:3792: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.354 INFO:tasks.rados.rados.2.smithi057.stdout:3799: finishing write tid 1 to smithi05720651-24 2020-11-16T22:16:10.354 INFO:tasks.rados.rados.2.smithi057.stdout:3799: finishing write tid 2 to smithi05720651-24 2020-11-16T22:16:10.355 INFO:tasks.rados.rados.2.smithi057.stdout:3796: done (8 left) 2020-11-16T22:16:10.355 INFO:tasks.rados.rados.2.smithi057.stdout:3797: done (7 left) 2020-11-16T22:16:10.355 INFO:tasks.rados.rados.2.smithi057.stdout:3803: copy_from oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 16 current snap is 448 2020-11-16T22:16:10.355 INFO:tasks.rados.rados.2.smithi057.stdout:3792: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.355 INFO:tasks.rados.rados.2.smithi057.stdout:3804: read oid 34 snap -1 2020-11-16T22:16:10.355 INFO:tasks.rados.rados.2.smithi057.stdout:3804: expect (ObjNum 1272 snap 448 seq_num 1272) 2020-11-16T22:16:10.355 INFO:tasks.rados.rados.2.smithi057.stdout:3805: rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:10.356 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 414 2020-11-16T22:16:10.356 INFO:tasks.rados.rados.2.smithi057.stdout:3798: finishing write tid 1 to smithi05720651-6 2020-11-16T22:16:10.356 INFO:tasks.rados.rados.2.smithi057.stdout:3798: finishing write tid 2 to smithi05720651-6 2020-11-16T22:16:10.356 INFO:tasks.rados.rados.2.smithi057.stdout:3806: write (excl) oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:10.356 INFO:tasks.rados.rados.2.smithi057.stdout:3806: seq_num 1283 ranges {763381=491771,2044868=728778,3199935=363446} 2020-11-16T22:16:10.358 INFO:tasks.rados.rados.2.smithi057.stdout:3806: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 763381 to 1255152 tid 1 2020-11-16T22:16:10.367 INFO:tasks.rados.rados.2.smithi057.stdout:3806: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2044868 to 2773646 tid 2 2020-11-16T22:16:10.372 INFO:tasks.rados.rados.2.smithi057.stdout:3806: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3199935 to 3563381 tid 3 2020-11-16T22:16:10.372 INFO:tasks.rados.rados.2.smithi057.stdout:3807: write (excl) oid 36 current snap is 448 2020-11-16T22:16:10.372 INFO:tasks.rados.rados.2.smithi057.stdout:3807: seq_num 1284 ranges {780188=567020,2103350=472436,3227358=352830} 2020-11-16T22:16:10.380 INFO:tasks.rados.rados.2.smithi057.stdout:3807: writing smithi05720651-36 from 780188 to 1347208 tid 1 2020-11-16T22:16:10.387 INFO:tasks.rados.rados.2.smithi057.stdout:3807: writing smithi05720651-36 from 2103350 to 2575786 tid 2 2020-11-16T22:16:10.393 INFO:tasks.rados.rados.2.smithi057.stdout:3807: writing smithi05720651-36 from 3227358 to 3580188 tid 3 2020-11-16T22:16:10.393 INFO:tasks.rados.rados.2.smithi057.stdout:3808: copy_from oid 22 from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:10.394 INFO:tasks.rados.rados.2.smithi057.stdout:3792: finishing write tid 3 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.394 INFO:tasks.rados.rados.2.smithi057.stdout:3802: finishing rollback tid 0 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.394 INFO:tasks.rados.rados.2.smithi057.stdout:3800: finishing copy_from to smithi05720651-42 2020-11-16T22:16:10.394 INFO:tasks.rados.rados.2.smithi057.stdout:3800: got expected ENOENT (src dne) 2020-11-16T22:16:10.394 INFO:tasks.rados.rados.2.smithi057.stdout:3799: finishing write tid 3 to smithi05720651-24 2020-11-16T22:16:10.394 INFO:tasks.rados.rados.2.smithi057.stdout:3809: rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 448 2020-11-16T22:16:10.394 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 415 2020-11-16T22:16:10.395 INFO:tasks.rados.rados.2.smithi057.stdout:3800: finishing copy_from racing read to smithi05720651-42 2020-11-16T22:16:10.395 INFO:tasks.rados.rados.2.smithi057.stdout:3799: finishing write tid 5 to smithi05720651-24 2020-11-16T22:16:10.395 INFO:tasks.rados.rados.2.smithi057.stdout:3805: finishing rollback tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.395 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2201 (ObjNum 33 snap 0 seq_num 1131374913) dirty dne 2020-11-16T22:16:10.395 INFO:tasks.rados.rados.2.smithi057.stdout:3799: finishing write tid 6 to smithi05720651-24 2020-11-16T22:16:10.395 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 24 v 2886 (ObjNum 1282 snap 448 seq_num 1282) dirty exists 2020-11-16T22:16:10.395 INFO:tasks.rados.rados.2.smithi057.stdout:3799: left oid 24 (ObjNum 1282 snap 448 seq_num 1282) 2020-11-16T22:16:10.396 INFO:tasks.rados.rados.2.smithi057.stdout:3804: expect (ObjNum 1272 snap 448 seq_num 1272) 2020-11-16T22:16:10.501 INFO:tasks.rados.rados.2.smithi057.stdout:3802: finishing rollback tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.501 INFO:tasks.rados.rados.2.smithi057.stdout:3802: finishing rollback tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.501 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3006 (ObjNum 1068 snap 375 seq_num 1068) dirty exists 2020-11-16T22:16:10.502 INFO:tasks.rados.rados.2.smithi057.stdout:3806: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.502 INFO:tasks.rados.rados.2.smithi057.stdout:3799: done (13 left) 2020-11-16T22:16:10.502 INFO:tasks.rados.rados.2.smithi057.stdout:3800: done (12 left) 2020-11-16T22:16:10.502 INFO:tasks.rados.rados.2.smithi057.stdout:3802: done (11 left) 2020-11-16T22:16:10.502 INFO:tasks.rados.rados.2.smithi057.stdout:3804: done (10 left) 2020-11-16T22:16:10.502 INFO:tasks.rados.rados.2.smithi057.stdout:3805: done (9 left) 2020-11-16T22:16:10.502 INFO:tasks.rados.rados.2.smithi057.stdout:3810: read oid 10 snap -1 2020-11-16T22:16:10.503 INFO:tasks.rados.rados.2.smithi057.stdout:3810: expect (ObjNum 1279 snap 448 seq_num 1279) 2020-11-16T22:16:10.503 INFO:tasks.rados.rados.2.smithi057.stdout:3811: snap_create 2020-11-16T22:16:10.503 INFO:tasks.rados.rados.2.smithi057.stdout:3792: finishing write tid 5 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.503 INFO:tasks.rados.rados.2.smithi057.stdout:3792: finishing write tid 6 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.503 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2825 (ObjNum 1276 snap 448 seq_num 1276) dirty exists 2020-11-16T22:16:10.503 INFO:tasks.rados.rados.2.smithi057.stdout:3792: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1276 snap 448 seq_num 1276) 2020-11-16T22:16:10.503 INFO:tasks.rados.rados.2.smithi057.stdout:3798: finishing write tid 3 to smithi05720651-6 2020-11-16T22:16:10.504 INFO:tasks.rados.rados.2.smithi057.stdout:3801: expect (ObjNum 1024 snap 360 seq_num 1024) 2020-11-16T22:16:10.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:10 smithi016 bash[10302]: cluster 2020-11-16T22:16:09.295066+0000 mon.a (mon.0) 1617 : cluster [DBG] osdmap e939: 12 total, 12 up, 12 in 2020-11-16T22:16:10.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:10 smithi016 bash[10302]: cluster 2020-11-16T22:16:10.227607+0000 mon.a (mon.0) 1618 : cluster [DBG] osdmap e940: 12 total, 12 up, 12 in 2020-11-16T22:16:10.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:10 smithi195 bash[10218]: cluster 2020-11-16T22:16:09.295066+0000 mon.a (mon.0) 1617 : cluster [DBG] osdmap e939: 12 total, 12 up, 12 in 2020-11-16T22:16:10.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:10 smithi195 bash[10218]: cluster 2020-11-16T22:16:10.227607+0000 mon.a (mon.0) 1618 : cluster [DBG] osdmap e940: 12 total, 12 up, 12 in 2020-11-16T22:16:10.643 INFO:tasks.rados.rados.2.smithi057.stdout:3798: finishing write tid 5 to smithi05720651-6 2020-11-16T22:16:10.643 INFO:tasks.rados.rados.2.smithi057.stdout:3803: finishing copy_from to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.643 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3003 (ObjNum 1271 snap 448 seq_num 1271) dirty exists 2020-11-16T22:16:10.643 INFO:tasks.rados.rados.2.smithi057.stdout:3803: finishing copy_from racing read to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.644 INFO:tasks.rados.rados.2.smithi057.stdout:3806: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.644 INFO:tasks.rados.rados.2.smithi057.stdout:3806: finishing write tid 3 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.644 INFO:tasks.rados.rados.2.smithi057.stdout:3806: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.644 INFO:tasks.rados.rados.2.smithi057.stdout:3806: finishing write tid 6 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.644 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3218 (ObjNum 1283 snap 448 seq_num 1283) dirty exists 2020-11-16T22:16:10.644 INFO:tasks.rados.rados.2.smithi057.stdout:3806: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1283 snap 448 seq_num 1283) 2020-11-16T22:16:10.645 INFO:tasks.rados.rados.2.smithi057.stdout:3807: finishing write tid 1 to smithi05720651-36 2020-11-16T22:16:10.645 INFO:tasks.rados.rados.2.smithi057.stdout:3809: finishing rollback tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:10.645 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2325 (ObjNum 385 snap 0 seq_num 2932381168) dirty dne 2020-11-16T22:16:10.645 INFO:tasks.rados.rados.2.smithi057.stdout:3807: finishing write tid 2 to smithi05720651-36 2020-11-16T22:16:10.645 INFO:tasks.rados.rados.2.smithi057.stdout:3807: finishing write tid 3 to smithi05720651-36 2020-11-16T22:16:10.645 INFO:tasks.rados.rados.2.smithi057.stdout:3807: finishing write tid 5 to smithi05720651-36 2020-11-16T22:16:10.645 INFO:tasks.rados.rados.2.smithi057.stdout:3807: finishing write tid 6 to smithi05720651-36 2020-11-16T22:16:10.645 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 2568 (ObjNum 1284 snap 448 seq_num 1284) dirty exists 2020-11-16T22:16:10.646 INFO:tasks.rados.rados.2.smithi057.stdout:3807: left oid 36 (ObjNum 1284 snap 448 seq_num 1284) 2020-11-16T22:16:10.646 INFO:tasks.rados.rados.2.smithi057.stdout:3794: finishing write tid 5 to smithi05720651-4 2020-11-16T22:16:10.646 INFO:tasks.rados.rados.2.smithi057.stdout:3794: finishing write tid 6 to smithi05720651-4 2020-11-16T22:16:10.646 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 2843 (ObjNum 1278 snap 448 seq_num 1278) dirty exists 2020-11-16T22:16:10.646 INFO:tasks.rados.rados.2.smithi057.stdout:3794: left oid 4 (ObjNum 1278 snap 448 seq_num 1278) 2020-11-16T22:16:10.646 INFO:tasks.rados.rados.2.smithi057.stdout:3808: finishing copy_from to smithi05720651-22 2020-11-16T22:16:10.646 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 2713 (ObjNum 1229 snap 433 seq_num 1229) dirty exists 2020-11-16T22:16:10.647 INFO:tasks.rados.rados.2.smithi057.stdout:3808: finishing copy_from racing read to smithi05720651-22 2020-11-16T22:16:10.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:10 smithi057 bash[10301]: cluster 2020-11-16T22:16:09.295066+0000 mon.a (mon.0) 1617 : cluster [DBG] osdmap e939: 12 total, 12 up, 12 in 2020-11-16T22:16:10.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:10 smithi057 bash[10301]: cluster 2020-11-16T22:16:10.227607+0000 mon.a (mon.0) 1618 : cluster [DBG] osdmap e940: 12 total, 12 up, 12 in 2020-11-16T22:16:11.280 INFO:tasks.rados.rados.2.smithi057.stdout:3810: expect (ObjNum 1279 snap 448 seq_num 1279) 2020-11-16T22:16:11.440 INFO:tasks.rados.rados.2.smithi057.stdout:3798: finishing write tid 6 to smithi05720651-6 2020-11-16T22:16:11.441 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 6 v 2827 (ObjNum 1281 snap 448 seq_num 1281) dirty exists 2020-11-16T22:16:11.441 INFO:tasks.rados.rados.2.smithi057.stdout:3798: left oid 6 (ObjNum 1281 snap 448 seq_num 1281) 2020-11-16T22:16:11.441 INFO:tasks.rados.rados.2.smithi057.stdout:3792: done (10 left) 2020-11-16T22:16:11.441 INFO:tasks.rados.rados.2.smithi057.stdout:3794: done (9 left) 2020-11-16T22:16:11.441 INFO:tasks.rados.rados.2.smithi057.stdout:3798: done (8 left) 2020-11-16T22:16:11.442 INFO:tasks.rados.rados.2.smithi057.stdout:3801: done (7 left) 2020-11-16T22:16:11.442 INFO:tasks.rados.rados.2.smithi057.stdout:3803: done (6 left) 2020-11-16T22:16:11.442 INFO:tasks.rados.rados.2.smithi057.stdout:3806: done (5 left) 2020-11-16T22:16:11.442 INFO:tasks.rados.rados.2.smithi057.stdout:3807: done (4 left) 2020-11-16T22:16:11.442 INFO:tasks.rados.rados.2.smithi057.stdout:3808: done (3 left) 2020-11-16T22:16:11.442 INFO:tasks.rados.rados.2.smithi057.stdout:3809: done (2 left) 2020-11-16T22:16:11.442 INFO:tasks.rados.rados.2.smithi057.stdout:3810: done (1 left) 2020-11-16T22:16:11.443 INFO:tasks.rados.rados.2.smithi057.stdout:3811: done (0 left) 2020-11-16T22:16:11.443 INFO:tasks.rados.rados.2.smithi057.stdout:3812: snap_create 2020-11-16T22:16:11.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:11 smithi016 bash[10302]: cluster 2020-11-16T22:16:09.871896+0000 mgr.x (mgr.24115) 706 : cluster [DBG] pgmap v1575: 17 pgs: 17 active+clean; 567 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 2.4 MiB/s wr, 15 op/s 2020-11-16T22:16:11.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:11 smithi195 bash[10218]: cluster 2020-11-16T22:16:09.871896+0000 mgr.x (mgr.24115) 706 : cluster [DBG] pgmap v1575: 17 pgs: 17 active+clean; 567 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 2.4 MiB/s wr, 15 op/s 2020-11-16T22:16:11.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:11 smithi057 bash[10301]: cluster 2020-11-16T22:16:09.871896+0000 mgr.x (mgr.24115) 706 : cluster [DBG] pgmap v1575: 17 pgs: 17 active+clean; 567 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 2.4 MiB/s wr, 15 op/s 2020-11-16T22:16:12.325 INFO:tasks.rados.rados.2.smithi057.stdout:3812: done (0 left) 2020-11-16T22:16:12.325 INFO:tasks.rados.rados.2.smithi057.stdout:3813: write oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 450 2020-11-16T22:16:12.325 INFO:tasks.rados.rados.2.smithi057.stdout:3813: seq_num 1285 ranges {796995=758622,2161832=732447} 2020-11-16T22:16:12.339 INFO:tasks.rados.rados.2.smithi057.stdout:3813: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 796995 to 1555617 tid 1 2020-11-16T22:16:12.348 INFO:tasks.rados.rados.2.smithi057.stdout:3813: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2161832 to 2894279 tid 2 2020-11-16T22:16:12.348 INFO:tasks.rados.rados.2.smithi057.stdout:3814: snap_remove snap 430 2020-11-16T22:16:12.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:12 smithi016 bash[10302]: cluster 2020-11-16T22:16:11.318300+0000 mon.a (mon.0) 1619 : cluster [DBG] osdmap e941: 12 total, 12 up, 12 in 2020-11-16T22:16:12.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:12 smithi195 bash[10218]: cluster 2020-11-16T22:16:11.318300+0000 mon.a (mon.0) 1619 : cluster [DBG] osdmap e941: 12 total, 12 up, 12 in 2020-11-16T22:16:12.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:12 smithi057 bash[10301]: cluster 2020-11-16T22:16:11.318300+0000 mon.a (mon.0) 1619 : cluster [DBG] osdmap e941: 12 total, 12 up, 12 in 2020-11-16T22:16:13.325 INFO:tasks.rados.rados.2.smithi057.stdout:3814: done (1 left) 2020-11-16T22:16:13.325 INFO:tasks.rados.rados.2.smithi057.stdout:3815: read oid 23 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 425 2020-11-16T22:16:13.325 INFO:tasks.rados.rados.2.smithi057.stdout:3815: expect (ObjNum 1168 snap 404 seq_num 1168) 2020-11-16T22:16:13.326 INFO:tasks.rados.rados.2.smithi057.stdout:3816: snap_remove snap 440 2020-11-16T22:16:13.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:13 smithi016 bash[10302]: cluster 2020-11-16T22:16:11.872750+0000 mgr.x (mgr.24115) 707 : cluster [DBG] pgmap v1578: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 545 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 4.6 MiB/s wr, 33 op/s 2020-11-16T22:16:13.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:13 smithi016 bash[10302]: cluster 2020-11-16T22:16:12.335661+0000 mon.a (mon.0) 1620 : cluster [DBG] osdmap e942: 12 total, 12 up, 12 in 2020-11-16T22:16:13.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:13 smithi195 bash[10218]: cluster 2020-11-16T22:16:11.872750+0000 mgr.x (mgr.24115) 707 : cluster [DBG] pgmap v1578: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 545 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 4.6 MiB/s wr, 33 op/s 2020-11-16T22:16:13.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:13 smithi195 bash[10218]: cluster 2020-11-16T22:16:12.335661+0000 mon.a (mon.0) 1620 : cluster [DBG] osdmap e942: 12 total, 12 up, 12 in 2020-11-16T22:16:13.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:13 smithi057 bash[10301]: cluster 2020-11-16T22:16:11.872750+0000 mgr.x (mgr.24115) 707 : cluster [DBG] pgmap v1578: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 545 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 4.6 MiB/s wr, 33 op/s 2020-11-16T22:16:13.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:13 smithi057 bash[10301]: cluster 2020-11-16T22:16:12.335661+0000 mon.a (mon.0) 1620 : cluster [DBG] osdmap e942: 12 total, 12 up, 12 in 2020-11-16T22:16:14.330 INFO:tasks.rados.rados.2.smithi057.stdout:3816: done (2 left) 2020-11-16T22:16:14.330 INFO:tasks.rados.rados.2.smithi057.stdout:3817: read oid 12 snap -1 2020-11-16T22:16:14.330 INFO:tasks.rados.rados.2.smithi057.stdout:3817: expect (ObjNum 1245 snap 438 seq_num 1245) 2020-11-16T22:16:14.330 INFO:tasks.rados.rados.2.smithi057.stdout:3818: read oid 22 snap 381 2020-11-16T22:16:14.331 INFO:tasks.rados.rados.2.smithi057.stdout:3818: expect (ObjNum 1027 snap 361 seq_num 1027) 2020-11-16T22:16:14.331 INFO:tasks.rados.rados.2.smithi057.stdout:3819: snap_remove snap 372 2020-11-16T22:16:14.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:14 smithi195 bash[10218]: cluster 2020-11-16T22:16:13.335593+0000 mon.a (mon.0) 1621 : cluster [DBG] osdmap e943: 12 total, 12 up, 12 in 2020-11-16T22:16:14.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:14 smithi195 bash[10218]: cluster 2020-11-16T22:16:14.340559+0000 mon.a (mon.0) 1622 : cluster [DBG] osdmap e944: 12 total, 12 up, 12 in 2020-11-16T22:16:14.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:14 smithi057 bash[10301]: cluster 2020-11-16T22:16:13.335593+0000 mon.a (mon.0) 1621 : cluster [DBG] osdmap e943: 12 total, 12 up, 12 in 2020-11-16T22:16:14.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:14 smithi057 bash[10301]: cluster 2020-11-16T22:16:14.340559+0000 mon.a (mon.0) 1622 : cluster [DBG] osdmap e944: 12 total, 12 up, 12 in 2020-11-16T22:16:14.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:14 smithi016 bash[10302]: cluster 2020-11-16T22:16:13.335593+0000 mon.a (mon.0) 1621 : cluster [DBG] osdmap e943: 12 total, 12 up, 12 in 2020-11-16T22:16:14.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:14 smithi016 bash[10302]: cluster 2020-11-16T22:16:14.340559+0000 mon.a (mon.0) 1622 : cluster [DBG] osdmap e944: 12 total, 12 up, 12 in 2020-11-16T22:16:15.219 INFO:tasks.rados.rados.2.smithi057.stdout:3819: done (4 left) 2020-11-16T22:16:15.219 INFO:tasks.rados.rados.2.smithi057.stdout:3820: write oid 20 current snap is 450 2020-11-16T22:16:15.219 INFO:tasks.rados.rados.2.smithi057.stdout:3820: seq_num 1286 ranges {413802=433871,1420314=476105,2482204=790985} 2020-11-16T22:16:15.229 INFO:tasks.rados.rados.2.smithi057.stdout:3820: writing smithi05720651-20 from 413802 to 847673 tid 1 2020-11-16T22:16:15.236 INFO:tasks.rados.rados.2.smithi057.stdout:3820: writing smithi05720651-20 from 1420314 to 1896419 tid 2 2020-11-16T22:16:15.245 INFO:tasks.rados.rados.2.smithi057.stdout:3820: writing smithi05720651-20 from 2482204 to 3273189 tid 3 2020-11-16T22:16:15.245 INFO:tasks.rados.rados.2.smithi057.stdout:3821: rollback oid 10 current snap is 450 2020-11-16T22:16:15.245 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 10 to 377 2020-11-16T22:16:15.245 INFO:tasks.rados.rados.2.smithi057.stdout:3813: finishing write tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:15.245 INFO:tasks.rados.rados.2.smithi057.stdout:3813: finishing write tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:15.245 INFO:tasks.rados.rados.2.smithi057.stdout:3813: finishing write tid 4 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:15.246 INFO:tasks.rados.rados.2.smithi057.stdout:3813: finishing write tid 5 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:15.246 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2414 (ObjNum 1285 snap 450 seq_num 1285) dirty exists 2020-11-16T22:16:15.246 INFO:tasks.rados.rados.2.smithi057.stdout:3813: left oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1285 snap 450 seq_num 1285) 2020-11-16T22:16:15.246 INFO:tasks.rados.rados.2.smithi057.stdout:3815: expect (ObjNum 1168 snap 404 seq_num 1168) 2020-11-16T22:16:15.456 INFO:tasks.rados.rados.2.smithi057.stdout:3817: expect (ObjNum 1245 snap 438 seq_num 1245) 2020-11-16T22:16:15.590 INFO:tasks.rados.rados.2.smithi057.stdout:3818: expect (ObjNum 1027 snap 361 seq_num 1027) 2020-11-16T22:16:15.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:15 smithi195 bash[10218]: cluster 2020-11-16T22:16:13.873501+0000 mgr.x (mgr.24115) 708 : cluster [DBG] pgmap v1581: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 542 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 4.6 MiB/s wr, 28 op/s 2020-11-16T22:16:15.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:15 smithi195 bash[10218]: cluster 2020-11-16T22:16:15.230250+0000 mon.a (mon.0) 1623 : cluster [DBG] osdmap e945: 12 total, 12 up, 12 in 2020-11-16T22:16:15.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:15 smithi057 bash[10301]: cluster 2020-11-16T22:16:13.873501+0000 mgr.x (mgr.24115) 708 : cluster [DBG] pgmap v1581: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 542 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 4.6 MiB/s wr, 28 op/s 2020-11-16T22:16:15.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:15 smithi057 bash[10301]: cluster 2020-11-16T22:16:15.230250+0000 mon.a (mon.0) 1623 : cluster [DBG] osdmap e945: 12 total, 12 up, 12 in 2020-11-16T22:16:15.780 INFO:tasks.rados.rados.2.smithi057.stdout:3820: finishing write tid 1 to smithi05720651-20 2020-11-16T22:16:15.780 INFO:tasks.rados.rados.2.smithi057.stdout:3820: finishing write tid 2 to smithi05720651-20 2020-11-16T22:16:15.780 INFO:tasks.rados.rados.2.smithi057.stdout:3820: finishing write tid 3 to smithi05720651-20 2020-11-16T22:16:15.780 INFO:tasks.rados.rados.2.smithi057.stdout:3820: finishing write tid 5 to smithi05720651-20 2020-11-16T22:16:15.781 INFO:tasks.rados.rados.2.smithi057.stdout:3820: finishing write tid 6 to smithi05720651-20 2020-11-16T22:16:15.781 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 2847 (ObjNum 1286 snap 450 seq_num 1286) dirty exists 2020-11-16T22:16:15.781 INFO:tasks.rados.rados.2.smithi057.stdout:3820: left oid 20 (ObjNum 1286 snap 450 seq_num 1286) 2020-11-16T22:16:15.781 INFO:tasks.rados.rados.2.smithi057.stdout:3821: finishing rollback tid 0 to smithi05720651-10 2020-11-16T22:16:15.781 INFO:tasks.rados.rados.2.smithi057.stdout:3821: finishing rollback tid 1 to smithi05720651-10 2020-11-16T22:16:15.781 INFO:tasks.rados.rados.2.smithi057.stdout:3821: finishing rollback tid 2 to smithi05720651-10 2020-11-16T22:16:15.781 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 10 v 2571 (ObjNum 1028 snap 361 seq_num 1028) dirty exists 2020-11-16T22:16:15.782 INFO:tasks.rados.rados.2.smithi057.stdout:3813: done (5 left) 2020-11-16T22:16:15.782 INFO:tasks.rados.rados.2.smithi057.stdout:3815: done (4 left) 2020-11-16T22:16:15.782 INFO:tasks.rados.rados.2.smithi057.stdout:3817: done (3 left) 2020-11-16T22:16:15.782 INFO:tasks.rados.rados.2.smithi057.stdout:3818: done (2 left) 2020-11-16T22:16:15.782 INFO:tasks.rados.rados.2.smithi057.stdout:3820: done (1 left) 2020-11-16T22:16:15.782 INFO:tasks.rados.rados.2.smithi057.stdout:3821: done (0 left) 2020-11-16T22:16:15.783 INFO:tasks.rados.rados.2.smithi057.stdout:3822: copy_from oid 12 from oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 450 2020-11-16T22:16:15.783 INFO:tasks.rados.rados.2.smithi057.stdout:3823: write oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 450 2020-11-16T22:16:15.783 INFO:tasks.rados.rados.2.smithi057.stdout:3823: seq_num 1287 ranges {430609=509120,1478796=736116,2909627=602257} 2020-11-16T22:16:15.791 INFO:tasks.rados.rados.2.smithi057.stdout:3823: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 430609 to 939729 tid 1 2020-11-16T22:16:15.798 INFO:tasks.rados.rados.2.smithi057.stdout:3823: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1478796 to 2214912 tid 2 2020-11-16T22:16:15.806 INFO:tasks.rados.rados.2.smithi057.stdout:3823: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2909627 to 3511884 tid 3 2020-11-16T22:16:15.806 INFO:tasks.rados.rados.2.smithi057.stdout:3824: write (excl) oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 450 2020-11-16T22:16:15.806 INFO:tasks.rados.rados.2.smithi057.stdout:3824: seq_num 1288 ranges {447416=584369,1537278=479774,2537050=529882,3524784=122632} 2020-11-16T22:16:15.812 INFO:tasks.rados.rados.2.smithi057.stdout:3824: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 447416 to 1031785 tid 1 2020-11-16T22:16:15.817 INFO:tasks.rados.rados.2.smithi057.stdout:3824: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1537278 to 2017052 tid 2 2020-11-16T22:16:15.824 INFO:tasks.rados.rados.2.smithi057.stdout:3824: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2537050 to 3066932 tid 3 2020-11-16T22:16:15.827 INFO:tasks.rados.rados.2.smithi057.stdout:3824: writing smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3524784 to 3647416 tid 4 2020-11-16T22:16:15.827 INFO:tasks.rados.rados.2.smithi057.stdout:3825: read oid 16 snap -1 2020-11-16T22:16:15.828 INFO:tasks.rados.rados.2.smithi057.stdout:3825: expect (ObjNum 1271 snap 448 seq_num 1271) 2020-11-16T22:16:15.828 INFO:tasks.rados.rados.2.smithi057.stdout:3826: snap_remove snap 399 2020-11-16T22:16:15.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:15 smithi016 bash[10302]: cluster 2020-11-16T22:16:13.873501+0000 mgr.x (mgr.24115) 708 : cluster [DBG] pgmap v1581: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 542 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 4.6 MiB/s wr, 28 op/s 2020-11-16T22:16:15.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:15 smithi016 bash[10302]: cluster 2020-11-16T22:16:15.230250+0000 mon.a (mon.0) 1623 : cluster [DBG] osdmap e945: 12 total, 12 up, 12 in 2020-11-16T22:16:16.371 INFO:tasks.rados.rados.2.smithi057.stdout:3826: done (4 left) 2020-11-16T22:16:16.371 INFO:tasks.rados.rados.2.smithi057.stdout:3827: read oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:16.371 INFO:tasks.rados.rados.2.smithi057.stdout:3827: expect (ObjNum 1229 snap 433 seq_num 1229) 2020-11-16T22:16:16.372 INFO:tasks.rados.rados.2.smithi057.stdout:3828: snap_create 2020-11-16T22:16:16.372 INFO:tasks.rados.rados.2.smithi057.stdout:3822: finishing copy_from to smithi05720651-12 2020-11-16T22:16:16.372 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 2991 (ObjNum 1249 snap 438 seq_num 1249) dirty exists 2020-11-16T22:16:16.372 INFO:tasks.rados.rados.2.smithi057.stdout:3822: finishing copy_from racing read to smithi05720651-12 2020-11-16T22:16:16.372 INFO:tasks.rados.rados.2.smithi057.stdout:3823: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:16.372 INFO:tasks.rados.rados.2.smithi057.stdout:3823: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:16.372 INFO:tasks.rados.rados.2.smithi057.stdout:3823: finishing write tid 3 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:16.373 INFO:tasks.rados.rados.2.smithi057.stdout:3823: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:16.373 INFO:tasks.rados.rados.2.smithi057.stdout:3823: finishing write tid 6 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:16.373 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3252 (ObjNum 1287 snap 450 seq_num 1287) dirty exists 2020-11-16T22:16:16.373 INFO:tasks.rados.rados.2.smithi057.stdout:3823: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1287 snap 450 seq_num 1287) 2020-11-16T22:16:16.373 INFO:tasks.rados.rados.2.smithi057.stdout:3824: finishing write tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:16.373 INFO:tasks.rados.rados.2.smithi057.stdout:3824: finishing write tid 2 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:16.373 INFO:tasks.rados.rados.2.smithi057.stdout:3824: finishing write tid 3 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:16.374 INFO:tasks.rados.rados.2.smithi057.stdout:3824: finishing write tid 4 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:16.374 INFO:tasks.rados.rados.2.smithi057.stdout:3824: finishing write tid 6 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:16.374 INFO:tasks.rados.rados.2.smithi057.stdout:3824: finishing write tid 7 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:16.374 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2419 (ObjNum 1288 snap 450 seq_num 1288) dirty exists 2020-11-16T22:16:16.374 INFO:tasks.rados.rados.2.smithi057.stdout:3824: left oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1288 snap 450 seq_num 1288) 2020-11-16T22:16:16.374 INFO:tasks.rados.rados.2.smithi057.stdout:3825: expect (ObjNum 1271 snap 448 seq_num 1271) 2020-11-16T22:16:16.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:16 smithi057 bash[10301]: cluster 2020-11-16T22:16:15.874289+0000 mgr.x (mgr.24115) 709 : cluster [DBG] pgmap v1584: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 548 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 3.5 MiB/s wr, 18 op/s 2020-11-16T22:16:16.701 INFO:tasks.rados.rados.2.smithi057.stdout:3827: expect (ObjNum 1229 snap 433 seq_num 1229) 2020-11-16T22:16:16.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:16 smithi016 bash[10302]: cluster 2020-11-16T22:16:15.874289+0000 mgr.x (mgr.24115) 709 : cluster [DBG] pgmap v1584: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 548 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 3.5 MiB/s wr, 18 op/s 2020-11-16T22:16:16.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:16 smithi195 bash[10218]: cluster 2020-11-16T22:16:15.874289+0000 mgr.x (mgr.24115) 709 : cluster [DBG] pgmap v1584: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 548 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 3.5 MiB/s wr, 18 op/s 2020-11-16T22:16:17.371 INFO:tasks.rados.rados.2.smithi057.stdout:3822: done (5 left) 2020-11-16T22:16:17.372 INFO:tasks.rados.rados.2.smithi057.stdout:3823: done (4 left) 2020-11-16T22:16:17.372 INFO:tasks.rados.rados.2.smithi057.stdout:3824: done (3 left) 2020-11-16T22:16:17.372 INFO:tasks.rados.rados.2.smithi057.stdout:3825: done (2 left) 2020-11-16T22:16:17.372 INFO:tasks.rados.rados.2.smithi057.stdout:3827: done (1 left) 2020-11-16T22:16:17.372 INFO:tasks.rados.rados.2.smithi057.stdout:3828: done (0 left) 2020-11-16T22:16:17.373 INFO:tasks.rados.rados.2.smithi057.stdout:3829: snap_create 2020-11-16T22:16:17.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:17 smithi057 bash[10301]: cluster 2020-11-16T22:16:16.381391+0000 mon.a (mon.0) 1624 : cluster [DBG] osdmap e946: 12 total, 12 up, 12 in 2020-11-16T22:16:17.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:17 smithi016 bash[10302]: cluster 2020-11-16T22:16:16.381391+0000 mon.a (mon.0) 1624 : cluster [DBG] osdmap e946: 12 total, 12 up, 12 in 2020-11-16T22:16:17.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:17 smithi195 bash[10218]: cluster 2020-11-16T22:16:16.381391+0000 mon.a (mon.0) 1624 : cluster [DBG] osdmap e946: 12 total, 12 up, 12 in 2020-11-16T22:16:18.374 INFO:tasks.rados.rados.2.smithi057.stdout:3829: done (0 left) 2020-11-16T22:16:18.374 INFO:tasks.rados.rados.2.smithi057.stdout:3830: read oid 42 snap -1 2020-11-16T22:16:18.374 INFO:tasks.rados.rados.2.smithi057.stdout:3830: expect (ObjNum 1268 snap 448 seq_num 1268) 2020-11-16T22:16:18.375 INFO:tasks.rados.rados.2.smithi057.stdout:3831: copy_from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 24 current snap is 452 2020-11-16T22:16:18.375 INFO:tasks.rados.rados.2.smithi057.stdout:3832: rollback oid 4 current snap is 452 2020-11-16T22:16:18.375 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 4 to 403 2020-11-16T22:16:18.375 INFO:tasks.rados.rados.2.smithi057.stdout:3833: snap_remove snap 404 2020-11-16T22:16:18.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:18 smithi057 bash[10301]: cluster 2020-11-16T22:16:17.381962+0000 mon.a (mon.0) 1625 : cluster [DBG] osdmap e947: 12 total, 12 up, 12 in 2020-11-16T22:16:18.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:18 smithi057 bash[10301]: cluster 2020-11-16T22:16:17.875035+0000 mgr.x (mgr.24115) 710 : cluster [DBG] pgmap v1587: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 547 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 3.2 MiB/s wr, 19 op/s 2020-11-16T22:16:18.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:18 smithi057 bash[10301]: cluster 2020-11-16T22:16:18.384738+0000 mon.a (mon.0) 1626 : cluster [DBG] osdmap e948: 12 total, 12 up, 12 in 2020-11-16T22:16:18.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:18 smithi016 bash[10302]: cluster 2020-11-16T22:16:17.381962+0000 mon.a (mon.0) 1625 : cluster [DBG] osdmap e947: 12 total, 12 up, 12 in 2020-11-16T22:16:18.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:18 smithi016 bash[10302]: cluster 2020-11-16T22:16:17.875035+0000 mgr.x (mgr.24115) 710 : cluster [DBG] pgmap v1587: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 547 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 3.2 MiB/s wr, 19 op/s 2020-11-16T22:16:18.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:18 smithi016 bash[10302]: cluster 2020-11-16T22:16:18.384738+0000 mon.a (mon.0) 1626 : cluster [DBG] osdmap e948: 12 total, 12 up, 12 in 2020-11-16T22:16:18.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:18 smithi195 bash[10218]: cluster 2020-11-16T22:16:17.381962+0000 mon.a (mon.0) 1625 : cluster [DBG] osdmap e947: 12 total, 12 up, 12 in 2020-11-16T22:16:18.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:18 smithi195 bash[10218]: cluster 2020-11-16T22:16:17.875035+0000 mgr.x (mgr.24115) 710 : cluster [DBG] pgmap v1587: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 547 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 3.2 MiB/s wr, 19 op/s 2020-11-16T22:16:18.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:18 smithi195 bash[10218]: cluster 2020-11-16T22:16:18.384738+0000 mon.a (mon.0) 1626 : cluster [DBG] osdmap e948: 12 total, 12 up, 12 in 2020-11-16T22:16:19.376 INFO:tasks.rados.rados.2.smithi057.stdout:3833: done (3 left) 2020-11-16T22:16:19.376 INFO:tasks.rados.rados.2.smithi057.stdout:3834: write oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 452 2020-11-16T22:16:19.377 INFO:tasks.rados.rados.2.smithi057.stdout:3834: seq_num 1289 ranges {464223=659618,1879407=739785,3248120=416103} 2020-11-16T22:16:19.388 INFO:tasks.rados.rados.2.smithi057.stdout:3834: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 464223 to 1123841 tid 1 2020-11-16T22:16:19.397 INFO:tasks.rados.rados.2.smithi057.stdout:3834: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1879407 to 2619192 tid 2 2020-11-16T22:16:19.403 INFO:tasks.rados.rados.2.smithi057.stdout:3834: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3248120 to 3664223 tid 3 2020-11-16T22:16:19.403 INFO:tasks.rados.rados.2.smithi057.stdout:3835: write oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 452 2020-11-16T22:16:19.404 INFO:tasks.rados.rados.2.smithi057.stdout:3835: seq_num 1290 ranges {481030=734867,1937889=483443,2875543=552426} 2020-11-16T22:16:19.410 INFO:tasks.rados.rados.2.smithi057.stdout:3835: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 481030 to 1215897 tid 1 2020-11-16T22:16:19.417 INFO:tasks.rados.rados.2.smithi057.stdout:3835: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1937889 to 2421332 tid 2 2020-11-16T22:16:19.424 INFO:tasks.rados.rados.2.smithi057.stdout:3835: writing smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2875543 to 3427969 tid 3 2020-11-16T22:16:19.424 INFO:tasks.rados.rados.2.smithi057.stdout:3836: write oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 452 2020-11-16T22:16:19.424 INFO:tasks.rados.rados.2.smithi057.stdout:3836: seq_num 1291 ranges {497837=410116,1596371=743454,2902966=763698} 2020-11-16T22:16:19.429 INFO:tasks.rados.rados.2.smithi057.stdout:3836: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 497837 to 907953 tid 1 2020-11-16T22:16:19.438 INFO:tasks.rados.rados.2.smithi057.stdout:3836: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1596371 to 2339825 tid 2 2020-11-16T22:16:19.445 INFO:tasks.rados.rados.2.smithi057.stdout:3836: writing smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2902966 to 3666664 tid 3 2020-11-16T22:16:19.446 INFO:tasks.rados.rados.2.smithi057.stdout:3837: rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 452 2020-11-16T22:16:19.446 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 421 2020-11-16T22:16:19.446 INFO:tasks.rados.rados.2.smithi057.stdout:3832: finishing rollback tid 0 to smithi05720651-4 2020-11-16T22:16:19.446 INFO:tasks.rados.rados.2.smithi057.stdout:3832: finishing rollback tid 1 to smithi05720651-4 2020-11-16T22:16:19.446 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 2849 (ObjNum 321 snap 0 seq_num 1864381234) dirty dne 2020-11-16T22:16:19.446 INFO:tasks.rados.rados.2.smithi057.stdout:3830: expect (ObjNum 1268 snap 448 seq_num 1268) 2020-11-16T22:16:19.682 INFO:tasks.rados.rados.2.smithi057.stdout:3831: finishing copy_from to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.682 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2886 (ObjNum 1282 snap 448 seq_num 1282) dirty exists 2020-11-16T22:16:19.682 INFO:tasks.rados.rados.2.smithi057.stdout:3831: finishing copy_from racing read to smithi05720651-11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.683 INFO:tasks.rados.rados.2.smithi057.stdout:3834: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.683 INFO:tasks.rados.rados.2.smithi057.stdout:3834: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.683 INFO:tasks.rados.rados.2.smithi057.stdout:3834: finishing write tid 3 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.683 INFO:tasks.rados.rados.2.smithi057.stdout:3834: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.683 INFO:tasks.rados.rados.2.smithi057.stdout:3834: finishing write tid 6 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.683 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2418 (ObjNum 1289 snap 452 seq_num 1289) dirty exists 2020-11-16T22:16:19.683 INFO:tasks.rados.rados.2.smithi057.stdout:3834: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1289 snap 452 seq_num 1289) 2020-11-16T22:16:19.684 INFO:tasks.rados.rados.2.smithi057.stdout:3835: finishing write tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.684 INFO:tasks.rados.rados.2.smithi057.stdout:3835: finishing write tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.684 INFO:tasks.rados.rados.2.smithi057.stdout:3835: finishing write tid 3 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.684 INFO:tasks.rados.rados.2.smithi057.stdout:3835: finishing write tid 5 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.684 INFO:tasks.rados.rados.2.smithi057.stdout:3835: finishing write tid 6 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.684 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3275 (ObjNum 1290 snap 452 seq_num 1290) dirty exists 2020-11-16T22:16:19.684 INFO:tasks.rados.rados.2.smithi057.stdout:3835: left oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1290 snap 452 seq_num 1290) 2020-11-16T22:16:19.685 INFO:tasks.rados.rados.2.smithi057.stdout:3836: finishing write tid 1 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.685 INFO:tasks.rados.rados.2.smithi057.stdout:3836: finishing write tid 2 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.685 INFO:tasks.rados.rados.2.smithi057.stdout:3830: done (6 left) 2020-11-16T22:16:19.685 INFO:tasks.rados.rados.2.smithi057.stdout:3831: done (5 left) 2020-11-16T22:16:19.685 INFO:tasks.rados.rados.2.smithi057.stdout:3832: done (4 left) 2020-11-16T22:16:19.685 INFO:tasks.rados.rados.2.smithi057.stdout:3834: done (3 left) 2020-11-16T22:16:19.685 INFO:tasks.rados.rados.2.smithi057.stdout:3835: done (2 left) 2020-11-16T22:16:19.686 INFO:tasks.rados.rados.2.smithi057.stdout:3838: rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 452 2020-11-16T22:16:19.686 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 414 2020-11-16T22:16:19.686 INFO:tasks.rados.rados.2.smithi057.stdout:3837: finishing rollback tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.686 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2411 (ObjNum 321 snap 0 seq_num 1864382772) dirty dne 2020-11-16T22:16:19.686 INFO:tasks.rados.rados.2.smithi057.stdout:3836: finishing write tid 3 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.686 INFO:tasks.rados.rados.2.smithi057.stdout:3836: finishing write tid 5 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.686 INFO:tasks.rados.rados.2.smithi057.stdout:3836: finishing write tid 6 to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.687 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2419 (ObjNum 1291 snap 452 seq_num 1291) dirty exists 2020-11-16T22:16:19.687 INFO:tasks.rados.rados.2.smithi057.stdout:3836: left oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1291 snap 452 seq_num 1291) 2020-11-16T22:16:19.687 INFO:tasks.rados.rados.2.smithi057.stdout:3836: done (2 left) 2020-11-16T22:16:19.687 INFO:tasks.rados.rados.2.smithi057.stdout:3837: done (1 left) 2020-11-16T22:16:19.687 INFO:tasks.rados.rados.2.smithi057.stdout:3839: write oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 452 2020-11-16T22:16:19.687 INFO:tasks.rados.rados.2.smithi057.stdout:3839: seq_num 1292 ranges {514644=485365,1654853=487112,2930389=574970} 2020-11-16T22:16:19.698 INFO:tasks.rados.rados.2.smithi057.stdout:3839: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 514644 to 1000009 tid 1 2020-11-16T22:16:19.704 INFO:tasks.rados.rados.2.smithi057.stdout:3839: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1654853 to 2141965 tid 2 2020-11-16T22:16:19.712 INFO:tasks.rados.rados.2.smithi057.stdout:3839: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2930389 to 3505359 tid 3 2020-11-16T22:16:19.712 INFO:tasks.rados.rados.2.smithi057.stdout:3840: write (excl) oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 452 2020-11-16T22:16:19.712 INFO:tasks.rados.rados.2.smithi057.stdout:3840: seq_num 1293 ranges {531451=676967,1713335=747123,2957812=502595} 2020-11-16T22:16:19.719 INFO:tasks.rados.rados.2.smithi057.stdout:3840: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 531451 to 1208418 tid 1 2020-11-16T22:16:19.728 INFO:tasks.rados.rados.2.smithi057.stdout:3840: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1713335 to 2460458 tid 2 2020-11-16T22:16:19.732 INFO:tasks.rados.rados.2.smithi057.stdout:3840: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2957812 to 3460407 tid 3 2020-11-16T22:16:19.732 INFO:tasks.rados.rados.2.smithi057.stdout:3841: write oid 44 current snap is 452 2020-11-16T22:16:19.733 INFO:tasks.rados.rados.2.smithi057.stdout:3841: seq_num 1294 ranges {548258=752216,1771817=490781,2985235=713867} 2020-11-16T22:16:19.740 INFO:tasks.rados.rados.2.smithi057.stdout:3841: writing smithi05720651-44 from 548258 to 1300474 tid 1 2020-11-16T22:16:19.746 INFO:tasks.rados.rados.2.smithi057.stdout:3841: writing smithi05720651-44 from 1771817 to 2262598 tid 2 2020-11-16T22:16:19.754 INFO:tasks.rados.rados.2.smithi057.stdout:3841: writing smithi05720651-44 from 2985235 to 3699102 tid 3 2020-11-16T22:16:19.755 INFO:tasks.rados.rados.2.smithi057.stdout:3842: snap_create 2020-11-16T22:16:19.755 INFO:tasks.rados.rados.2.smithi057.stdout:3838: finishing rollback tid 0 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.755 INFO:tasks.rados.rados.2.smithi057.stdout:3838: finishing rollback tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.755 INFO:tasks.rados.rados.2.smithi057.stdout:3838: finishing rollback tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.755 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2899 (ObjNum 1162 snap 402 seq_num 1162) dirty exists 2020-11-16T22:16:19.755 INFO:tasks.rados.rados.2.smithi057.stdout:3839: finishing write tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.756 INFO:tasks.rados.rados.2.smithi057.stdout:3839: finishing write tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.756 INFO:tasks.rados.rados.2.smithi057.stdout:3839: finishing write tid 3 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.756 INFO:tasks.rados.rados.2.smithi057.stdout:3839: finishing write tid 5 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.756 INFO:tasks.rados.rados.2.smithi057.stdout:3839: finishing write tid 6 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.756 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2903 (ObjNum 1292 snap 452 seq_num 1292) dirty exists 2020-11-16T22:16:19.756 INFO:tasks.rados.rados.2.smithi057.stdout:3839: left oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1292 snap 452 seq_num 1292) 2020-11-16T22:16:19.756 INFO:tasks.rados.rados.2.smithi057.stdout:3840: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.757 INFO:tasks.rados.rados.2.smithi057.stdout:3840: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.757 INFO:tasks.rados.rados.2.smithi057.stdout:3840: finishing write tid 3 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.757 INFO:tasks.rados.rados.2.smithi057.stdout:3840: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.757 INFO:tasks.rados.rados.2.smithi057.stdout:3840: finishing write tid 6 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:19.757 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2539 (ObjNum 1293 snap 452 seq_num 1293) dirty exists 2020-11-16T22:16:19.757 INFO:tasks.rados.rados.2.smithi057.stdout:3840: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1293 snap 452 seq_num 1293) 2020-11-16T22:16:19.757 INFO:tasks.rados.rados.2.smithi057.stdout:3841: finishing write tid 1 to smithi05720651-44 2020-11-16T22:16:19.758 INFO:tasks.rados.rados.2.smithi057.stdout:3841: finishing write tid 2 to smithi05720651-44 2020-11-16T22:16:19.760 INFO:tasks.rados.rados.2.smithi057.stdout:3841: finishing write tid 3 to smithi05720651-44 2020-11-16T22:16:20.220 INFO:tasks.rados.rados.2.smithi057.stdout:3838: done (4 left) 2020-11-16T22:16:20.221 INFO:tasks.rados.rados.2.smithi057.stdout:3839: done (3 left) 2020-11-16T22:16:20.221 INFO:tasks.rados.rados.2.smithi057.stdout:3840: done (2 left) 2020-11-16T22:16:20.221 INFO:tasks.rados.rados.2.smithi057.stdout:3842: done (1 left) 2020-11-16T22:16:20.221 INFO:tasks.rados.rados.2.smithi057.stdout:3843: rollback oid 14 current snap is 453 2020-11-16T22:16:20.221 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 14 to 408 2020-11-16T22:16:20.221 INFO:tasks.rados.rados.2.smithi057.stdout:3844: rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 453 2020-11-16T22:16:20.221 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 449 2020-11-16T22:16:20.222 INFO:tasks.rados.rados.2.smithi057.stdout:3845: rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 453 2020-11-16T22:16:20.222 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 401 2020-11-16T22:16:20.222 INFO:tasks.rados.rados.2.smithi057.stdout:3846: read oid 6 snap -1 2020-11-16T22:16:20.222 INFO:tasks.rados.rados.2.smithi057.stdout:3846: expect (ObjNum 1281 snap 448 seq_num 1281) 2020-11-16T22:16:20.222 INFO:tasks.rados.rados.2.smithi057.stdout:3847: copy_from oid 36 from oid 26 current snap is 453 2020-11-16T22:16:20.222 INFO:tasks.rados.rados.2.smithi057.stdout:3848: read oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:20.222 INFO:tasks.rados.rados.2.smithi057.stdout:3848: expect (ObjNum 1292 snap 452 seq_num 1292) 2020-11-16T22:16:20.223 INFO:tasks.rados.rados.2.smithi057.stdout:3849: write oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 453 2020-11-16T22:16:20.223 INFO:tasks.rados.rados.2.smithi057.stdout:3849: seq_num 1295 ranges {565065=427465,1430299=634439,2496305=525139,3472104=292961} 2020-11-16T22:16:20.230 INFO:tasks.rados.rados.2.smithi057.stdout:3849: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 565065 to 992530 tid 1 2020-11-16T22:16:20.237 INFO:tasks.rados.rados.2.smithi057.stdout:3849: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1430299 to 2064738 tid 2 2020-11-16T22:16:20.242 INFO:tasks.rados.rados.2.smithi057.stdout:3849: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2496305 to 3021444 tid 3 2020-11-16T22:16:20.247 INFO:tasks.rados.rados.2.smithi057.stdout:3849: writing smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3472104 to 3765065 tid 4 2020-11-16T22:16:20.247 INFO:tasks.rados.rados.2.smithi057.stdout:3850: rollback oid 22 current snap is 453 2020-11-16T22:16:20.248 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 22 to 381 2020-11-16T22:16:20.248 INFO:tasks.rados.rados.2.smithi057.stdout:3844: finishing rollback tid 0 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:20.248 INFO:tasks.rados.rados.2.smithi057.stdout:3844: finishing rollback tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:20.248 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2421 (ObjNum 1869573999 snap 28527 seq_num 336) dirty dne 2020-11-16T22:16:20.248 INFO:tasks.rados.rados.2.smithi057.stdout:3843: finishing rollback tid 1 to smithi05720651-14 2020-11-16T22:16:20.248 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 3123 (ObjNum 33 snap 0 seq_num 0) dirty dne 2020-11-16T22:16:20.249 INFO:tasks.rados.rados.2.smithi057.stdout:3843: done (8 left) 2020-11-16T22:16:20.249 INFO:tasks.rados.rados.2.smithi057.stdout:3844: done (7 left) 2020-11-16T22:16:20.249 INFO:tasks.rados.rados.2.smithi057.stdout:3851: write (excl) oid 12 current snap is 453 2020-11-16T22:16:20.249 INFO:tasks.rados.rados.2.smithi057.stdout:3851: seq_num 1296 ranges {581872=502714,1488781=494450,2640081=736411} 2020-11-16T22:16:20.254 INFO:tasks.rados.rados.2.smithi057.stdout:3851: writing smithi05720651-12 from 581872 to 1084586 tid 1 2020-11-16T22:16:20.259 INFO:tasks.rados.rados.2.smithi057.stdout:3851: writing smithi05720651-12 from 1488781 to 1983231 tid 2 2020-11-16T22:16:20.267 INFO:tasks.rados.rados.2.smithi057.stdout:3851: writing smithi05720651-12 from 2640081 to 3376492 tid 3 2020-11-16T22:16:20.267 INFO:tasks.rados.rados.2.smithi057.stdout:3852: rollback oid 40 current snap is 453 2020-11-16T22:16:20.267 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 40 to 435 2020-11-16T22:16:20.268 INFO:tasks.rados.rados.2.smithi057.stdout:3846: expect (ObjNum 1281 snap 448 seq_num 1281) 2020-11-16T22:16:20.458 INFO:tasks.rados.rados.2.smithi057.stdout:3845: finishing rollback tid 0 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:20.458 INFO:tasks.rados.rados.2.smithi057.stdout:3845: finishing rollback tid 1 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:20.458 INFO:tasks.rados.rados.2.smithi057.stdout:3845: finishing rollback tid 2 to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:20.458 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3286 (ObjNum 1079 snap 377 seq_num 1079) dirty exists 2020-11-16T22:16:20.459 INFO:tasks.rados.rados.2.smithi057.stdout:3848: expect (ObjNum 1292 snap 452 seq_num 1292) 2020-11-16T22:16:20.573 INFO:tasks.rados.rados.2.smithi057.stdout:3849: finishing write tid 1 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.674 INFO:tasks.rados.rados.2.smithi057.stdout:3849: finishing write tid 2 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.674 INFO:tasks.rados.rados.2.smithi057.stdout:3849: finishing write tid 3 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.675 INFO:tasks.rados.rados.2.smithi057.stdout:3849: finishing write tid 4 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.675 INFO:tasks.rados.rados.2.smithi057.stdout:3849: finishing write tid 6 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.675 INFO:tasks.rados.rados.2.smithi057.stdout:3841: finishing write tid 5 to smithi05720651-44 2020-11-16T22:16:24.675 INFO:tasks.rados.rados.2.smithi057.stdout:3849: finishing write tid 7 to smithi05720651-39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.675 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2909 (ObjNum 1295 snap 453 seq_num 1295) dirty exists 2020-11-16T22:16:24.675 INFO:tasks.rados.rados.2.smithi057.stdout:3849: left oid 39 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1295 snap 453 seq_num 1295) 2020-11-16T22:16:24.676 INFO:tasks.rados.rados.2.smithi057.stdout:3841: finishing write tid 6 to smithi05720651-44 2020-11-16T22:16:24.676 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 2995 (ObjNum 1294 snap 452 seq_num 1294) dirty exists 2020-11-16T22:16:24.676 INFO:tasks.rados.rados.2.smithi057.stdout:3841: left oid 44 (ObjNum 1294 snap 452 seq_num 1294) 2020-11-16T22:16:24.676 INFO:tasks.rados.rados.2.smithi057.stdout:3850: finishing rollback tid 0 to smithi05720651-22 2020-11-16T22:16:24.676 INFO:tasks.rados.rados.2.smithi057.stdout:3850: finishing rollback tid 1 to smithi05720651-22 2020-11-16T22:16:24.676 INFO:tasks.rados.rados.2.smithi057.stdout:3850: finishing rollback tid 2 to smithi05720651-22 2020-11-16T22:16:24.676 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 2998 (ObjNum 1027 snap 361 seq_num 1027) dirty exists 2020-11-16T22:16:24.677 INFO:tasks.rados.rados.2.smithi057.stdout:3847: finishing copy_from to smithi05720651-36 2020-11-16T22:16:24.677 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 2627 (ObjNum 1180 snap 407 seq_num 1180) dirty exists 2020-11-16T22:16:24.677 INFO:tasks.rados.rados.2.smithi057.stdout:3847: finishing copy_from racing read to smithi05720651-36 2020-11-16T22:16:24.677 INFO:tasks.rados.rados.2.smithi057.stdout:3852: finishing rollback tid 0 to smithi05720651-40 2020-11-16T22:16:24.677 INFO:tasks.rados.rados.2.smithi057.stdout:3852: finishing rollback tid 1 to smithi05720651-40 2020-11-16T22:16:24.677 INFO:tasks.rados.rados.2.smithi057.stdout:3852: finishing rollback tid 2 to smithi05720651-40 2020-11-16T22:16:24.677 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 3290 (ObjNum 1227 snap 433 seq_num 1227) dirty exists 2020-11-16T22:16:24.678 INFO:tasks.rados.rados.2.smithi057.stdout:3841: done (8 left) 2020-11-16T22:16:24.678 INFO:tasks.rados.rados.2.smithi057.stdout:3845: done (7 left) 2020-11-16T22:16:24.678 INFO:tasks.rados.rados.2.smithi057.stdout:3846: done (6 left) 2020-11-16T22:16:24.678 INFO:tasks.rados.rados.2.smithi057.stdout:3847: done (5 left) 2020-11-16T22:16:24.678 INFO:tasks.rados.rados.2.smithi057.stdout:3848: done (4 left) 2020-11-16T22:16:24.679 INFO:tasks.rados.rados.2.smithi057.stdout:3849: done (3 left) 2020-11-16T22:16:24.679 INFO:tasks.rados.rados.2.smithi057.stdout:3850: done (2 left) 2020-11-16T22:16:24.679 INFO:tasks.rados.rados.2.smithi057.stdout:3852: done (1 left) 2020-11-16T22:16:24.679 INFO:tasks.rados.rados.2.smithi057.stdout:3853: rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 453 2020-11-16T22:16:24.679 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 437 2020-11-16T22:16:24.679 INFO:tasks.rados.rados.2.smithi057.stdout:3854: rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 453 2020-11-16T22:16:24.680 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 426 2020-11-16T22:16:24.680 INFO:tasks.rados.rados.2.smithi057.stdout:3855: write oid 48 current snap is 453 2020-11-16T22:16:24.680 INFO:tasks.rados.rados.2.smithi057.stdout:3855: seq_num 1297 ranges {598679=577963,1947263=638108,3351151=447528} 2020-11-16T22:16:24.685 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:20 smithi195 bash[10218]: cluster 2020-11-16T22:16:19.387158+0000 mon.a (mon.0) 1627 : cluster [DBG] osdmap e949: 12 total, 12 up, 12 in 2020-11-16T22:16:24.685 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:20 smithi195 bash[10218]: cluster 2020-11-16T22:16:19.875702+0000 mgr.x (mgr.24115) 711 : cluster [DBG] pgmap v1590: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 559 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.9 MiB/s wr, 10 op/s 2020-11-16T22:16:24.685 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:20 smithi195 bash[10218]: cluster 2020-11-16T22:16:20.230557+0000 mon.a (mon.0) 1628 : cluster [DBG] osdmap e950: 12 total, 12 up, 12 in 2020-11-16T22:16:24.686 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:22 smithi195 bash[10218]: cluster 2020-11-16T22:16:21.397853+0000 mon.a (mon.0) 1629 : cluster [DBG] osdmap e951: 12 total, 12 up, 12 in 2020-11-16T22:16:24.686 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:22 smithi195 bash[10218]: cluster 2020-11-16T22:16:21.876434+0000 mgr.x (mgr.24115) 712 : cluster [DBG] pgmap v1593: 17 pgs: 17 active+clean; 579 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 4.8 MiB/s wr, 28 op/s 2020-11-16T22:16:24.686 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:23 smithi195 bash[10218]: cluster 2020-11-16T22:16:22.408118+0000 mon.a (mon.0) 1630 : cluster [DBG] osdmap e952: 12 total, 12 up, 12 in 2020-11-16T22:16:24.686 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:20 smithi016 bash[10302]: cluster 2020-11-16T22:16:19.387158+0000 mon.a (mon.0) 1627 : cluster [DBG] osdmap e949: 12 total, 12 up, 12 in 2020-11-16T22:16:24.686 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:20 smithi016 bash[10302]: cluster 2020-11-16T22:16:19.875702+0000 mgr.x (mgr.24115) 711 : cluster [DBG] pgmap v1590: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 559 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.9 MiB/s wr, 10 op/s 2020-11-16T22:16:24.686 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:20 smithi016 bash[10302]: cluster 2020-11-16T22:16:20.230557+0000 mon.a (mon.0) 1628 : cluster [DBG] osdmap e950: 12 total, 12 up, 12 in 2020-11-16T22:16:24.687 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:22 smithi016 bash[10302]: cluster 2020-11-16T22:16:21.397853+0000 mon.a (mon.0) 1629 : cluster [DBG] osdmap e951: 12 total, 12 up, 12 in 2020-11-16T22:16:24.687 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:22 smithi016 bash[10302]: cluster 2020-11-16T22:16:21.876434+0000 mgr.x (mgr.24115) 712 : cluster [DBG] pgmap v1593: 17 pgs: 17 active+clean; 579 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 4.8 MiB/s wr, 28 op/s 2020-11-16T22:16:24.687 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:23 smithi016 bash[10302]: cluster 2020-11-16T22:16:22.408118+0000 mon.a (mon.0) 1630 : cluster [DBG] osdmap e952: 12 total, 12 up, 12 in 2020-11-16T22:16:24.687 INFO:tasks.rados.rados.2.smithi057.stdout:3855: writing smithi05720651-48 from 598679 to 1176642 tid 1 2020-11-16T22:16:24.687 INFO:tasks.rados.rados.2.smithi057.stdout:3855: writing smithi05720651-48 from 1947263 to 2585371 tid 2 2020-11-16T22:16:24.687 INFO:tasks.rados.rados.2.smithi057.stdout:3855: writing smithi05720651-48 from 3351151 to 3798679 tid 3 2020-11-16T22:16:24.687 INFO:tasks.rados.rados.2.smithi057.stdout:3856: read oid 42 snap -1 2020-11-16T22:16:24.688 INFO:tasks.rados.rados.2.smithi057.stdout:3856: expect (ObjNum 1268 snap 448 seq_num 1268) 2020-11-16T22:16:24.688 INFO:tasks.rados.rados.2.smithi057.stdout:3857: snap_create 2020-11-16T22:16:24.688 INFO:tasks.rados.rados.2.smithi057.stdout:3854: finishing rollback tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.688 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2325 (ObjNum 1869573999 snap 28527 seq_num 336) dirty dne 2020-11-16T22:16:24.688 INFO:tasks.rados.rados.2.smithi057.stdout:3853: finishing rollback tid 0 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.688 INFO:tasks.rados.rados.2.smithi057.stdout:3853: finishing rollback tid 1 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.689 INFO:tasks.rados.rados.2.smithi057.stdout:3853: finishing rollback tid 2 to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.689 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2913 (ObjNum 1229 snap 433 seq_num 1229) dirty exists 2020-11-16T22:16:24.689 INFO:tasks.rados.rados.2.smithi057.stdout:3855: finishing write tid 1 to smithi05720651-48 2020-11-16T22:16:24.689 INFO:tasks.rados.rados.2.smithi057.stdout:3855: finishing write tid 2 to smithi05720651-48 2020-11-16T22:16:24.689 INFO:tasks.rados.rados.2.smithi057.stdout:3851: finishing write tid 1 to smithi05720651-12 2020-11-16T22:16:24.689 INFO:tasks.rados.rados.2.smithi057.stdout:3855: finishing write tid 3 to smithi05720651-48 2020-11-16T22:16:24.689 INFO:tasks.rados.rados.2.smithi057.stdout:3855: finishing write tid 5 to smithi05720651-48 2020-11-16T22:16:24.689 INFO:tasks.rados.rados.2.smithi057.stdout:3855: finishing write tid 6 to smithi05720651-48 2020-11-16T22:16:24.690 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 3007 (ObjNum 1297 snap 453 seq_num 1297) dirty exists 2020-11-16T22:16:24.690 INFO:tasks.rados.rados.2.smithi057.stdout:3855: left oid 48 (ObjNum 1297 snap 453 seq_num 1297) 2020-11-16T22:16:24.690 INFO:tasks.rados.rados.2.smithi057.stdout:3851: finishing write tid 2 to smithi05720651-12 2020-11-16T22:16:24.690 INFO:tasks.rados.rados.2.smithi057.stdout:3851: finishing write tid 3 to smithi05720651-12 2020-11-16T22:16:24.690 INFO:tasks.rados.rados.2.smithi057.stdout:3851: finishing write tid 5 to smithi05720651-12 2020-11-16T22:16:24.690 INFO:tasks.rados.rados.2.smithi057.stdout:3851: finishing write tid 6 to smithi05720651-12 2020-11-16T22:16:24.690 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 12 v 3002 (ObjNum 1296 snap 453 seq_num 1296) dirty exists 2020-11-16T22:16:24.691 INFO:tasks.rados.rados.2.smithi057.stdout:3851: left oid 12 (ObjNum 1296 snap 453 seq_num 1296) 2020-11-16T22:16:24.691 INFO:tasks.rados.rados.2.smithi057.stdout:3856: expect (ObjNum 1268 snap 448 seq_num 1268) 2020-11-16T22:16:24.691 INFO:tasks.rados.rados.2.smithi057.stdout:3851: done (5 left) 2020-11-16T22:16:24.691 INFO:tasks.rados.rados.2.smithi057.stdout:3853: done (4 left) 2020-11-16T22:16:24.691 INFO:tasks.rados.rados.2.smithi057.stdout:3854: done (3 left) 2020-11-16T22:16:24.691 INFO:tasks.rados.rados.2.smithi057.stdout:3855: done (2 left) 2020-11-16T22:16:24.691 INFO:tasks.rados.rados.2.smithi057.stdout:3856: done (1 left) 2020-11-16T22:16:24.692 INFO:tasks.rados.rados.2.smithi057.stdout:3857: done (0 left) 2020-11-16T22:16:24.692 INFO:tasks.rados.rados.2.smithi057.stdout:3858: snap_create 2020-11-16T22:16:24.692 INFO:tasks.rados.rados.2.smithi057.stdout:3858: done (0 left) 2020-11-16T22:16:24.692 INFO:tasks.rados.rados.2.smithi057.stdout:3859: read oid 4 snap 408 2020-11-16T22:16:24.692 INFO:tasks.rados.rados.2.smithi057.stdout:3859: expect (ObjNum 1182 snap 408 seq_num 1182) 2020-11-16T22:16:24.692 INFO:tasks.rados.rados.2.smithi057.stdout:3860: snap_create 2020-11-16T22:16:24.692 INFO:tasks.rados.rados.2.smithi057.stdout:3859: expect (ObjNum 1182 snap 408 seq_num 1182) 2020-11-16T22:16:24.693 INFO:tasks.rados.rados.2.smithi057.stdout:3859: done (1 left) 2020-11-16T22:16:24.693 INFO:tasks.rados.rados.2.smithi057.stdout:3860: done (0 left) 2020-11-16T22:16:24.693 INFO:tasks.rados.rados.2.smithi057.stdout:3861: write oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 456 2020-11-16T22:16:24.693 INFO:tasks.rados.rados.2.smithi057.stdout:3861: seq_num 1298 ranges {615486=653212,1889392=498119,2978574=475308} 2020-11-16T22:16:24.693 INFO:tasks.rados.rados.2.smithi057.stdout:3861: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 615486 to 1268698 tid 1 2020-11-16T22:16:24.693 INFO:tasks.rados.rados.2.smithi057.stdout:3861: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1889392 to 2387511 tid 2 2020-11-16T22:16:24.693 INFO:tasks.rados.rados.2.smithi057.stdout:3861: writing smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2978574 to 3453882 tid 3 2020-11-16T22:16:24.693 INFO:tasks.rados.rados.2.smithi057.stdout:3862: write (excl) oid 44 current snap is 456 2020-11-16T22:16:24.694 INFO:tasks.rados.rados.2.smithi057.stdout:3862: seq_num 1299 ranges {632293=728461,1947874=641777,3005997=686580} 2020-11-16T22:16:24.694 INFO:tasks.rados.rados.2.smithi057.stdout:3862: writing smithi05720651-44 from 632293 to 1360754 tid 1 2020-11-16T22:16:24.694 INFO:tasks.rados.rados.2.smithi057.stdout:3862: writing smithi05720651-44 from 1947874 to 2589651 tid 2 2020-11-16T22:16:24.694 INFO:tasks.rados.rados.2.smithi057.stdout:3862: writing smithi05720651-44 from 3005997 to 3692577 tid 3 2020-11-16T22:16:24.694 INFO:tasks.rados.rados.2.smithi057.stdout:3863: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 456 2020-11-16T22:16:24.694 INFO:tasks.rados.rados.2.smithi057.stdout:3863: seq_num 1300 ranges {649100=403710,1606356=501788,2633420=497852,3636005=213095} 2020-11-16T22:16:24.694 INFO:tasks.rados.rados.2.smithi057.stdout:3863: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 649100 to 1052810 tid 1 2020-11-16T22:16:24.695 INFO:tasks.rados.rados.2.smithi057.stdout:3863: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1606356 to 2108144 tid 2 2020-11-16T22:16:24.695 INFO:tasks.rados.rados.2.smithi057.stdout:3863: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2633420 to 3131272 tid 3 2020-11-16T22:16:24.695 INFO:tasks.rados.rados.2.smithi057.stdout:3863: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3636005 to 3849100 tid 4 2020-11-16T22:16:24.695 INFO:tasks.rados.rados.2.smithi057.stdout:3864: copy_from oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 4 current snap is 456 2020-11-16T22:16:24.695 INFO:tasks.rados.rados.2.smithi057.stdout:3861: finishing write tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.695 INFO:tasks.rados.rados.2.smithi057.stdout:3861: finishing write tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.695 INFO:tasks.rados.rados.2.smithi057.stdout:3861: finishing write tid 3 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.696 INFO:tasks.rados.rados.2.smithi057.stdout:3861: finishing write tid 5 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.696 INFO:tasks.rados.rados.2.smithi057.stdout:3861: finishing write tid 6 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.696 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2613 (ObjNum 1298 snap 456 seq_num 1298) dirty exists 2020-11-16T22:16:24.696 INFO:tasks.rados.rados.2.smithi057.stdout:3861: left oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1298 snap 456 seq_num 1298) 2020-11-16T22:16:24.696 INFO:tasks.rados.rados.2.smithi057.stdout:3862: finishing write tid 1 to smithi05720651-44 2020-11-16T22:16:24.696 INFO:tasks.rados.rados.2.smithi057.stdout:3862: finishing write tid 2 to smithi05720651-44 2020-11-16T22:16:24.696 INFO:tasks.rados.rados.2.smithi057.stdout:3862: finishing write tid 3 to smithi05720651-44 2020-11-16T22:16:24.697 INFO:tasks.rados.rados.2.smithi057.stdout:3862: finishing write tid 5 to smithi05720651-44 2020-11-16T22:16:24.697 INFO:tasks.rados.rados.2.smithi057.stdout:3862: finishing write tid 6 to smithi05720651-44 2020-11-16T22:16:24.697 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 44 v 3006 (ObjNum 1299 snap 456 seq_num 1299) dirty exists 2020-11-16T22:16:24.697 INFO:tasks.rados.rados.2.smithi057.stdout:3862: left oid 44 (ObjNum 1299 snap 456 seq_num 1299) 2020-11-16T22:16:24.697 INFO:tasks.rados.rados.2.smithi057.stdout:3863: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.697 INFO:tasks.rados.rados.2.smithi057.stdout:3861: done (3 left) 2020-11-16T22:16:24.697 INFO:tasks.rados.rados.2.smithi057.stdout:3862: done (2 left) 2020-11-16T22:16:24.698 INFO:tasks.rados.rados.2.smithi057.stdout:3865: write oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 456 2020-11-16T22:16:24.698 INFO:tasks.rados.rados.2.smithi057.stdout:3865: seq_num 1301 ranges {665907=595312,1781191=645446,3177196=688711} 2020-11-16T22:16:24.698 INFO:tasks.rados.rados.2.smithi057.stdout:3865: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 665907 to 1261219 tid 1 2020-11-16T22:16:24.698 INFO:tasks.rados.rados.2.smithi057.stdout:3865: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1781191 to 2426637 tid 2 2020-11-16T22:16:24.698 INFO:tasks.rados.rados.2.smithi057.stdout:3865: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3177196 to 3865907 tid 3 2020-11-16T22:16:24.698 INFO:tasks.rados.rados.2.smithi057.stdout:3866: read oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:24.698 INFO:tasks.rados.rados.2.smithi057.stdout:3866: expect (ObjNum 1175 snap 407 seq_num 1175) 2020-11-16T22:16:24.699 INFO:tasks.rados.rados.2.smithi057.stdout:3867: snap_remove snap 454 2020-11-16T22:16:24.699 INFO:tasks.rados.rados.2.smithi057.stdout:3867: done (4 left) 2020-11-16T22:16:24.699 INFO:tasks.rados.rados.2.smithi057.stdout:3868: write (excl) oid 20 current snap is 456 2020-11-16T22:16:24.699 INFO:tasks.rados.rados.2.smithi057.stdout:3868: seq_num 1302 ranges {682714=670561,2123320=505457,3088266=636749} 2020-11-16T22:16:24.699 INFO:tasks.rados.rados.2.smithi057.stdout:3868: writing smithi05720651-20 from 682714 to 1353275 tid 1 2020-11-16T22:16:24.699 INFO:tasks.rados.rados.2.smithi057.stdout:3868: writing smithi05720651-20 from 2123320 to 2628777 tid 2 2020-11-16T22:16:24.699 INFO:tasks.rados.rados.2.smithi057.stdout:3868: writing smithi05720651-20 from 3088266 to 3725015 tid 3 2020-11-16T22:16:24.700 INFO:tasks.rados.rados.2.smithi057.stdout:3869: snap_create 2020-11-16T22:16:24.700 INFO:tasks.rados.rados.2.smithi057.stdout:3864: finishing copy_from to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.700 INFO:tasks.rados.rados.2.smithi057.stdout:3864: got expected ENOENT (src dne) 2020-11-16T22:16:24.700 INFO:tasks.rados.rados.2.smithi057.stdout:3864: finishing copy_from racing read to smithi05720651-1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.700 INFO:tasks.rados.rados.2.smithi057.stdout:3863: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.700 INFO:tasks.rados.rados.2.smithi057.stdout:3863: finishing write tid 3 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.700 INFO:tasks.rados.rados.2.smithi057.stdout:3863: finishing write tid 4 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.700 INFO:tasks.rados.rados.2.smithi057.stdout:3863: finishing write tid 6 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.701 INFO:tasks.rados.rados.2.smithi057.stdout:3863: finishing write tid 7 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.701 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3296 (ObjNum 1300 snap 456 seq_num 1300) dirty exists 2020-11-16T22:16:24.701 INFO:tasks.rados.rados.2.smithi057.stdout:3863: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1300 snap 456 seq_num 1300) 2020-11-16T22:16:24.701 INFO:tasks.rados.rados.2.smithi057.stdout:3865: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.701 INFO:tasks.rados.rados.2.smithi057.stdout:3865: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.701 INFO:tasks.rados.rados.2.smithi057.stdout:3865: finishing write tid 3 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.702 INFO:tasks.rados.rados.2.smithi057.stdout:3865: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.702 INFO:tasks.rados.rados.2.smithi057.stdout:3865: finishing write tid 6 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:24.702 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2422 (ObjNum 1301 snap 456 seq_num 1301) dirty exists 2020-11-16T22:16:24.702 INFO:tasks.rados.rados.2.smithi057.stdout:3865: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1301 snap 456 seq_num 1301) 2020-11-16T22:16:24.702 INFO:tasks.rados.rados.2.smithi057.stdout:3866: expect (ObjNum 1175 snap 407 seq_num 1175) 2020-11-16T22:16:24.702 INFO:tasks.rados.rados.2.smithi057.stdout:3868: finishing write tid 1 to smithi05720651-20 2020-11-16T22:16:24.702 INFO:tasks.rados.rados.2.smithi057.stdout:3868: finishing write tid 2 to smithi05720651-20 2020-11-16T22:16:24.703 INFO:tasks.rados.rados.2.smithi057.stdout:3868: finishing write tid 3 to smithi05720651-20 2020-11-16T22:16:24.703 INFO:tasks.rados.rados.2.smithi057.stdout:3868: finishing write tid 5 to smithi05720651-20 2020-11-16T22:16:24.703 INFO:tasks.rados.rados.2.smithi057.stdout:3868: finishing write tid 6 to smithi05720651-20 2020-11-16T22:16:24.703 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 2853 (ObjNum 1302 snap 456 seq_num 1302) dirty exists 2020-11-16T22:16:24.703 INFO:tasks.rados.rados.2.smithi057.stdout:3868: left oid 20 (ObjNum 1302 snap 456 seq_num 1302) 2020-11-16T22:16:24.703 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:20 smithi057 bash[10301]: cluster 2020-11-16T22:16:19.387158+0000 mon.a (mon.0) 1627 : cluster [DBG] osdmap e949: 12 total, 12 up, 12 in 2020-11-16T22:16:24.703 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:20 smithi057 bash[10301]: cluster 2020-11-16T22:16:19.875702+0000 mgr.x (mgr.24115) 711 : cluster [DBG] pgmap v1590: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 559 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.9 MiB/s wr, 10 op/s 2020-11-16T22:16:24.704 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:20 smithi057 bash[10301]: cluster 2020-11-16T22:16:20.230557+0000 mon.a (mon.0) 1628 : cluster [DBG] osdmap e950: 12 total, 12 up, 12 in 2020-11-16T22:16:24.704 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:22 smithi057 bash[10301]: cluster 2020-11-16T22:16:21.397853+0000 mon.a (mon.0) 1629 : cluster [DBG] osdmap e951: 12 total, 12 up, 12 in 2020-11-16T22:16:24.704 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:22 smithi057 bash[10301]: cluster 2020-11-16T22:16:21.876434+0000 mgr.x (mgr.24115) 712 : cluster [DBG] pgmap v1593: 17 pgs: 17 active+clean; 579 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 MiB/s rd, 4.8 MiB/s wr, 28 op/s 2020-11-16T22:16:24.704 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:23 smithi057 bash[10301]: cluster 2020-11-16T22:16:22.408118+0000 mon.a (mon.0) 1630 : cluster [DBG] osdmap e952: 12 total, 12 up, 12 in 2020-11-16T22:16:24.704 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:24 smithi057 bash[10301]: cluster 2020-11-16T22:16:23.410204+0000 mon.a (mon.0) 1631 : cluster [DBG] osdmap e953: 12 total, 12 up, 12 in 2020-11-16T22:16:24.705 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:24 smithi057 bash[10301]: cluster 2020-11-16T22:16:23.877150+0000 mgr.x (mgr.24115) 713 : cluster [DBG] pgmap v1596: 17 pgs: 17 active+clean; 582 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.1 MiB/s wr, 26 op/s 2020-11-16T22:16:24.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:24 smithi016 bash[10302]: cluster 2020-11-16T22:16:23.410204+0000 mon.a (mon.0) 1631 : cluster [DBG] osdmap e953: 12 total, 12 up, 12 in 2020-11-16T22:16:24.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:24 smithi016 bash[10302]: cluster 2020-11-16T22:16:23.877150+0000 mgr.x (mgr.24115) 713 : cluster [DBG] pgmap v1596: 17 pgs: 17 active+clean; 582 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.1 MiB/s wr, 26 op/s 2020-11-16T22:16:24.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:24 smithi195 bash[10218]: cluster 2020-11-16T22:16:23.410204+0000 mon.a (mon.0) 1631 : cluster [DBG] osdmap e953: 12 total, 12 up, 12 in 2020-11-16T22:16:24.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:24 smithi195 bash[10218]: cluster 2020-11-16T22:16:23.877150+0000 mgr.x (mgr.24115) 713 : cluster [DBG] pgmap v1596: 17 pgs: 17 active+clean; 582 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 3.1 MiB/s wr, 26 op/s 2020-11-16T22:16:25.221 INFO:tasks.rados.rados.2.smithi057.stdout:3863: done (5 left) 2020-11-16T22:16:25.222 INFO:tasks.rados.rados.2.smithi057.stdout:3864: done (4 left) 2020-11-16T22:16:25.222 INFO:tasks.rados.rados.2.smithi057.stdout:3865: done (3 left) 2020-11-16T22:16:25.222 INFO:tasks.rados.rados.2.smithi057.stdout:3866: done (2 left) 2020-11-16T22:16:25.222 INFO:tasks.rados.rados.2.smithi057.stdout:3868: done (1 left) 2020-11-16T22:16:25.222 INFO:tasks.rados.rados.2.smithi057.stdout:3869: done (0 left) 2020-11-16T22:16:25.222 INFO:tasks.rados.rados.2.smithi057.stdout:3870: snap_create 2020-11-16T22:16:25.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:25 smithi057 bash[10301]: cluster 2020-11-16T22:16:24.428404+0000 mon.a (mon.0) 1632 : cluster [DBG] osdmap e954: 12 total, 12 up, 12 in 2020-11-16T22:16:25.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:25 smithi057 bash[10301]: cluster 2020-11-16T22:16:25.232353+0000 mon.a (mon.0) 1633 : cluster [DBG] osdmap e955: 12 total, 12 up, 12 in 2020-11-16T22:16:25.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:25 smithi016 bash[10302]: cluster 2020-11-16T22:16:24.428404+0000 mon.a (mon.0) 1632 : cluster [DBG] osdmap e954: 12 total, 12 up, 12 in 2020-11-16T22:16:25.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:25 smithi016 bash[10302]: cluster 2020-11-16T22:16:25.232353+0000 mon.a (mon.0) 1633 : cluster [DBG] osdmap e955: 12 total, 12 up, 12 in 2020-11-16T22:16:25.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:25 smithi195 bash[10218]: cluster 2020-11-16T22:16:24.428404+0000 mon.a (mon.0) 1632 : cluster [DBG] osdmap e954: 12 total, 12 up, 12 in 2020-11-16T22:16:25.850 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:25 smithi195 bash[10218]: cluster 2020-11-16T22:16:25.232353+0000 mon.a (mon.0) 1633 : cluster [DBG] osdmap e955: 12 total, 12 up, 12 in 2020-11-16T22:16:26.226 INFO:tasks.rados.rados.2.smithi057.stdout:3870: done (0 left) 2020-11-16T22:16:26.227 INFO:tasks.rados.rados.2.smithi057.stdout:3871: delete oid 20 current snap is 458 2020-11-16T22:16:26.237 INFO:tasks.rados.rados.2.smithi057.stdout:3871: done (0 left) 2020-11-16T22:16:26.237 INFO:tasks.rados.rados.2.smithi057.stdout:3872: snap_remove snap 452 2020-11-16T22:16:27.235 INFO:tasks.rados.rados.2.smithi057.stdout:3872: done (0 left) 2020-11-16T22:16:27.236 INFO:tasks.rados.rados.2.smithi057.stdout:3873: snap_remove snap 438 2020-11-16T22:16:27.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:27 smithi016 bash[10302]: cluster 2020-11-16T22:16:25.877892+0000 mgr.x (mgr.24115) 714 : cluster [DBG] pgmap v1599: 17 pgs: 17 active+clean; 595 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.7 MiB/s wr, 12 op/s 2020-11-16T22:16:27.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:27 smithi016 bash[10302]: cluster 2020-11-16T22:16:26.237549+0000 mon.a (mon.0) 1634 : cluster [DBG] osdmap e956: 12 total, 12 up, 12 in 2020-11-16T22:16:27.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:27 smithi195 bash[10218]: cluster 2020-11-16T22:16:25.877892+0000 mgr.x (mgr.24115) 714 : cluster [DBG] pgmap v1599: 17 pgs: 17 active+clean; 595 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.7 MiB/s wr, 12 op/s 2020-11-16T22:16:27.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:27 smithi195 bash[10218]: cluster 2020-11-16T22:16:26.237549+0000 mon.a (mon.0) 1634 : cluster [DBG] osdmap e956: 12 total, 12 up, 12 in 2020-11-16T22:16:27.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:27 smithi057 bash[10301]: cluster 2020-11-16T22:16:25.877892+0000 mgr.x (mgr.24115) 714 : cluster [DBG] pgmap v1599: 17 pgs: 17 active+clean; 595 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 2.7 MiB/s wr, 12 op/s 2020-11-16T22:16:27.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:27 smithi057 bash[10301]: cluster 2020-11-16T22:16:26.237549+0000 mon.a (mon.0) 1634 : cluster [DBG] osdmap e956: 12 total, 12 up, 12 in 2020-11-16T22:16:28.245 INFO:tasks.rados.rados.2.smithi057.stdout:3873: done (0 left) 2020-11-16T22:16:28.246 INFO:tasks.rados.rados.2.smithi057.stdout:3874: rollback oid 40 current snap is 458 2020-11-16T22:16:28.246 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 40 to 435 2020-11-16T22:16:28.246 INFO:tasks.rados.rados.2.smithi057.stdout:3875: snap_create 2020-11-16T22:16:28.263 INFO:tasks.rados.rados.2.smithi057.stdout:3874: finishing rollback tid 0 to smithi05720651-40 2020-11-16T22:16:28.263 INFO:tasks.rados.rados.2.smithi057.stdout:3874: finishing rollback tid 1 to smithi05720651-40 2020-11-16T22:16:28.264 INFO:tasks.rados.rados.2.smithi057.stdout:3874: finishing rollback tid 2 to smithi05720651-40 2020-11-16T22:16:28.264 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 3308 (ObjNum 1227 snap 433 seq_num 1227) dirty exists 2020-11-16T22:16:28.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:28 smithi016 bash[10302]: cluster 2020-11-16T22:16:27.246804+0000 mon.a (mon.0) 1635 : cluster [DBG] osdmap e957: 12 total, 12 up, 12 in 2020-11-16T22:16:28.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:28 smithi195 bash[10218]: cluster 2020-11-16T22:16:27.246804+0000 mon.a (mon.0) 1635 : cluster [DBG] osdmap e957: 12 total, 12 up, 12 in 2020-11-16T22:16:28.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:28 smithi057 bash[10301]: cluster 2020-11-16T22:16:27.246804+0000 mon.a (mon.0) 1635 : cluster [DBG] osdmap e957: 12 total, 12 up, 12 in 2020-11-16T22:16:29.249 INFO:tasks.rados.rados.2.smithi057.stdout:3874: done (1 left) 2020-11-16T22:16:29.249 INFO:tasks.rados.rados.2.smithi057.stdout:3875: done (0 left) 2020-11-16T22:16:29.250 INFO:tasks.rados.rados.2.smithi057.stdout:3876: write oid 28 current snap is 459 2020-11-16T22:16:29.250 INFO:tasks.rados.rados.2.smithi057.stdout:3876: seq_num 1304 ranges {716328=421059,1840284=509126,3143112=659293} 2020-11-16T22:16:29.260 INFO:tasks.rados.rados.2.smithi057.stdout:3876: writing smithi05720651-28 from 716328 to 1137387 tid 1 2020-11-16T22:16:29.269 INFO:tasks.rados.rados.2.smithi057.stdout:3876: writing smithi05720651-28 from 1840284 to 2349410 tid 2 2020-11-16T22:16:29.278 INFO:tasks.rados.rados.2.smithi057.stdout:3876: writing smithi05720651-28 from 3143112 to 3802405 tid 3 2020-11-16T22:16:29.278 INFO:tasks.rados.rados.2.smithi057.stdout:3877: rollback oid 26 current snap is 459 2020-11-16T22:16:29.279 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 26 to 451 2020-11-16T22:16:29.279 INFO:tasks.rados.rados.2.smithi057.stdout:3876: finishing write tid 1 to smithi05720651-28 2020-11-16T22:16:29.279 INFO:tasks.rados.rados.2.smithi057.stdout:3876: finishing write tid 2 to smithi05720651-28 2020-11-16T22:16:29.279 INFO:tasks.rados.rados.2.smithi057.stdout:3878: read oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 443 2020-11-16T22:16:29.279 INFO:tasks.rados.rados.2.smithi057.stdout:3878: expect deleted 2020-11-16T22:16:29.279 INFO:tasks.rados.rados.2.smithi057.stdout:3879: rollback oid 46 current snap is 459 2020-11-16T22:16:29.279 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 46 to 444 2020-11-16T22:16:29.280 INFO:tasks.rados.rados.2.smithi057.stdout:3880: write oid 14 current snap is 459 2020-11-16T22:16:29.280 INFO:tasks.rados.rados.2.smithi057.stdout:3880: seq_num 1305 ranges {733135=496308,1898766=652784,3170535=470565} 2020-11-16T22:16:29.285 INFO:tasks.rados.rados.2.smithi057.stdout:3880: writing smithi05720651-14 from 733135 to 1229443 tid 1 2020-11-16T22:16:29.293 INFO:tasks.rados.rados.2.smithi057.stdout:3880: writing smithi05720651-14 from 1898766 to 2551550 tid 2 2020-11-16T22:16:29.300 INFO:tasks.rados.rados.2.smithi057.stdout:3880: writing smithi05720651-14 from 3170535 to 3641100 tid 3 2020-11-16T22:16:29.300 INFO:tasks.rados.rados.2.smithi057.stdout:3881: copy_from oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 459 2020-11-16T22:16:29.300 INFO:tasks.rados.rados.2.smithi057.stdout:3876: finishing write tid 3 to smithi05720651-28 2020-11-16T22:16:29.301 INFO:tasks.rados.rados.2.smithi057.stdout:3876: finishing write tid 5 to smithi05720651-28 2020-11-16T22:16:29.301 INFO:tasks.rados.rados.2.smithi057.stdout:3876: finishing write tid 6 to smithi05720651-28 2020-11-16T22:16:29.301 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 2631 (ObjNum 1304 snap 459 seq_num 1304) dirty exists 2020-11-16T22:16:29.301 INFO:tasks.rados.rados.2.smithi057.stdout:3876: left oid 28 (ObjNum 1304 snap 459 seq_num 1304) 2020-11-16T22:16:29.301 INFO:tasks.rados.rados.2.smithi057.stdout:3879: finishing rollback tid 0 to smithi05720651-46 2020-11-16T22:16:29.301 INFO:tasks.rados.rados.2.smithi057.stdout:3879: finishing rollback tid 1 to smithi05720651-46 2020-11-16T22:16:29.301 INFO:tasks.rados.rados.2.smithi057.stdout:3879: finishing rollback tid 2 to smithi05720651-46 2020-11-16T22:16:29.302 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 46 v 3009 (ObjNum 1218 snap 432 seq_num 1218) dirty exists 2020-11-16T22:16:29.302 INFO:tasks.rados.rados.2.smithi057.stdout:3877: finishing rollback tid 0 to smithi05720651-26 2020-11-16T22:16:29.302 INFO:tasks.rados.rados.2.smithi057.stdout:3877: finishing rollback tid 1 to smithi05720651-26 2020-11-16T22:16:29.302 INFO:tasks.rados.rados.2.smithi057.stdout:3877: finishing rollback tid 2 to smithi05720651-26 2020-11-16T22:16:29.302 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 3324 (ObjNum 1180 snap 407 seq_num 1180) dirty exists 2020-11-16T22:16:29.302 INFO:tasks.rados.rados.2.smithi057.stdout:3880: finishing write tid 1 to smithi05720651-14 2020-11-16T22:16:29.302 INFO:tasks.rados.rados.2.smithi057.stdout:3876: done (5 left) 2020-11-16T22:16:29.303 INFO:tasks.rados.rados.2.smithi057.stdout:3877: done (4 left) 2020-11-16T22:16:29.303 INFO:tasks.rados.rados.2.smithi057.stdout:3878: done (3 left) 2020-11-16T22:16:29.303 INFO:tasks.rados.rados.2.smithi057.stdout:3879: done (2 left) 2020-11-16T22:16:29.303 INFO:tasks.rados.rados.2.smithi057.stdout:3882: copy_from oid 34 from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 459 2020-11-16T22:16:29.303 INFO:tasks.rados.rados.2.smithi057.stdout:3883: write oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 459 2020-11-16T22:16:29.303 INFO:tasks.rados.rados.2.smithi057.stdout:3883: seq_num 1306 ranges {749942=571557,1840895=796442,3365252=584690} 2020-11-16T22:16:29.308 INFO:tasks.rados.rados.2.smithi057.stdout:3883: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 749942 to 1321499 tid 1 2020-11-16T22:16:29.317 INFO:tasks.rados.rados.2.smithi057.stdout:3883: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1840895 to 2637337 tid 2 2020-11-16T22:16:29.325 INFO:tasks.rados.rados.2.smithi057.stdout:3883: writing smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 3365252 to 3949942 tid 3 2020-11-16T22:16:29.325 INFO:tasks.rados.rados.2.smithi057.stdout:3884: write oid 20 current snap is 459 2020-11-16T22:16:29.325 INFO:tasks.rados.rados.2.smithi057.stdout:3884: seq_num 1307 ranges {766749=646806,1899377=656453,3109028=609462} 2020-11-16T22:16:29.333 INFO:tasks.rados.rados.2.smithi057.stdout:3884: writing smithi05720651-20 from 766749 to 1413555 tid 1 2020-11-16T22:16:29.339 INFO:tasks.rados.rados.2.smithi057.stdout:3884: writing smithi05720651-20 from 1899377 to 2555830 tid 2 2020-11-16T22:16:29.346 INFO:tasks.rados.rados.2.smithi057.stdout:3884: writing smithi05720651-20 from 3109028 to 3718490 tid 3 2020-11-16T22:16:29.346 INFO:tasks.rados.rados.2.smithi057.stdout:3885: snap_remove snap 411 2020-11-16T22:16:29.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:29 smithi016 bash[10302]: cluster 2020-11-16T22:16:27.878577+0000 mgr.x (mgr.24115) 715 : cluster [DBG] pgmap v1602: 17 pgs: 17 active+clean; 600 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 13 op/s 2020-11-16T22:16:29.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:29 smithi016 bash[10302]: cluster 2020-11-16T22:16:28.256499+0000 mon.a (mon.0) 1636 : cluster [DBG] osdmap e958: 12 total, 12 up, 12 in 2020-11-16T22:16:29.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:29 smithi195 bash[10218]: cluster 2020-11-16T22:16:27.878577+0000 mgr.x (mgr.24115) 715 : cluster [DBG] pgmap v1602: 17 pgs: 17 active+clean; 600 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 13 op/s 2020-11-16T22:16:29.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:29 smithi195 bash[10218]: cluster 2020-11-16T22:16:28.256499+0000 mon.a (mon.0) 1636 : cluster [DBG] osdmap e958: 12 total, 12 up, 12 in 2020-11-16T22:16:29.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:29 smithi057 bash[10301]: cluster 2020-11-16T22:16:27.878577+0000 mgr.x (mgr.24115) 715 : cluster [DBG] pgmap v1602: 17 pgs: 17 active+clean; 600 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.5 MiB/s wr, 13 op/s 2020-11-16T22:16:29.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:29 smithi057 bash[10301]: cluster 2020-11-16T22:16:28.256499+0000 mon.a (mon.0) 1636 : cluster [DBG] osdmap e958: 12 total, 12 up, 12 in 2020-11-16T22:16:30.227 INFO:tasks.rados.rados.2.smithi057.stdout:3885: done (5 left) 2020-11-16T22:16:30.228 INFO:tasks.rados.rados.2.smithi057.stdout:3886: snap_remove snap 415 2020-11-16T22:16:30.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:30 smithi016 bash[10302]: cluster 2020-11-16T22:16:29.259380+0000 mon.a (mon.0) 1637 : cluster [DBG] osdmap e959: 12 total, 12 up, 12 in 2020-11-16T22:16:30.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:30 smithi016 bash[10302]: audit 2020-11-16T22:16:29.824051+0000 mon.b (mon.1) 320 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:16:30.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:30 smithi016 bash[10302]: audit 2020-11-16T22:16:29.824474+0000 mon.b (mon.1) 321 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:16:30.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:30 smithi016 bash[10302]: audit 2020-11-16T22:16:29.824644+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:16:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:30 smithi016 bash[10302]: audit 2020-11-16T22:16:29.825237+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:16:30.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:30 smithi016 bash[10302]: cluster 2020-11-16T22:16:30.237430+0000 mon.a (mon.0) 1640 : cluster [DBG] osdmap e960: 12 total, 12 up, 12 in 2020-11-16T22:16:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:30 smithi195 bash[10218]: cluster 2020-11-16T22:16:29.259380+0000 mon.a (mon.0) 1637 : cluster [DBG] osdmap e959: 12 total, 12 up, 12 in 2020-11-16T22:16:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:30 smithi195 bash[10218]: audit 2020-11-16T22:16:29.824051+0000 mon.b (mon.1) 320 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:16:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:30 smithi195 bash[10218]: audit 2020-11-16T22:16:29.824474+0000 mon.b (mon.1) 321 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:16:30.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:30 smithi195 bash[10218]: audit 2020-11-16T22:16:29.824644+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:16:30.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:30 smithi195 bash[10218]: audit 2020-11-16T22:16:29.825237+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:16:30.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:30 smithi195 bash[10218]: cluster 2020-11-16T22:16:30.237430+0000 mon.a (mon.0) 1640 : cluster [DBG] osdmap e960: 12 total, 12 up, 12 in 2020-11-16T22:16:30.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:30 smithi057 bash[10301]: cluster 2020-11-16T22:16:29.259380+0000 mon.a (mon.0) 1637 : cluster [DBG] osdmap e959: 12 total, 12 up, 12 in 2020-11-16T22:16:30.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:30 smithi057 bash[10301]: audit 2020-11-16T22:16:29.824051+0000 mon.b (mon.1) 320 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:16:30.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:30 smithi057 bash[10301]: audit 2020-11-16T22:16:29.824474+0000 mon.b (mon.1) 321 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:16:30.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:30 smithi057 bash[10301]: audit 2020-11-16T22:16:29.824644+0000 mon.a (mon.0) 1638 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2020-11-16T22:16:30.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:30 smithi057 bash[10301]: audit 2020-11-16T22:16:29.825237+0000 mon.a (mon.0) 1639 : audit [INF] from='mgr.24115 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2020-11-16T22:16:30.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:30 smithi057 bash[10301]: cluster 2020-11-16T22:16:30.237430+0000 mon.a (mon.0) 1640 : cluster [DBG] osdmap e960: 12 total, 12 up, 12 in 2020-11-16T22:16:31.236 INFO:tasks.rados.rados.2.smithi057.stdout:3886: done (5 left) 2020-11-16T22:16:31.236 INFO:tasks.rados.rados.2.smithi057.stdout:3887: snap_remove snap 453 2020-11-16T22:16:31.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:31 smithi016 bash[10302]: cluster 2020-11-16T22:16:29.879245+0000 mgr.x (mgr.24115) 716 : cluster [DBG] pgmap v1605: 17 pgs: 17 active+clean; 605 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.1 MiB/s wr, 7 op/s 2020-11-16T22:16:31.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:31 smithi016 bash[10302]: cluster 2020-11-16T22:16:31.246776+0000 mon.a (mon.0) 1641 : cluster [DBG] osdmap e961: 12 total, 12 up, 12 in 2020-11-16T22:16:31.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:31 smithi195 bash[10218]: cluster 2020-11-16T22:16:29.879245+0000 mgr.x (mgr.24115) 716 : cluster [DBG] pgmap v1605: 17 pgs: 17 active+clean; 605 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.1 MiB/s wr, 7 op/s 2020-11-16T22:16:31.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:31 smithi195 bash[10218]: cluster 2020-11-16T22:16:31.246776+0000 mon.a (mon.0) 1641 : cluster [DBG] osdmap e961: 12 total, 12 up, 12 in 2020-11-16T22:16:31.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:31 smithi057 bash[10301]: cluster 2020-11-16T22:16:29.879245+0000 mgr.x (mgr.24115) 716 : cluster [DBG] pgmap v1605: 17 pgs: 17 active+clean; 605 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.1 MiB/s wr, 7 op/s 2020-11-16T22:16:31.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:31 smithi057 bash[10301]: cluster 2020-11-16T22:16:31.246776+0000 mon.a (mon.0) 1641 : cluster [DBG] osdmap e961: 12 total, 12 up, 12 in 2020-11-16T22:16:32.239 INFO:tasks.rados.rados.2.smithi057.stdout:3887: done (5 left) 2020-11-16T22:16:32.240 INFO:tasks.rados.rados.2.smithi057.stdout:3888: snap_create 2020-11-16T22:16:32.240 INFO:tasks.rados.rados.2.smithi057.stdout:3880: finishing write tid 2 to smithi05720651-14 2020-11-16T22:16:32.240 INFO:tasks.rados.rados.2.smithi057.stdout:3880: finishing write tid 3 to smithi05720651-14 2020-11-16T22:16:32.240 INFO:tasks.rados.rados.2.smithi057.stdout:3880: finishing write tid 5 to smithi05720651-14 2020-11-16T22:16:32.240 INFO:tasks.rados.rados.2.smithi057.stdout:3880: finishing write tid 6 to smithi05720651-14 2020-11-16T22:16:32.241 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 14 v 3328 (ObjNum 1305 snap 459 seq_num 1305) dirty exists 2020-11-16T22:16:32.241 INFO:tasks.rados.rados.2.smithi057.stdout:3880: left oid 14 (ObjNum 1305 snap 459 seq_num 1305) 2020-11-16T22:16:32.241 INFO:tasks.rados.rados.2.smithi057.stdout:3883: finishing write tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:32.241 INFO:tasks.rados.rados.2.smithi057.stdout:3881: finishing copy_from to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:32.241 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3286 (ObjNum 1079 snap 377 seq_num 1079) dirty exists 2020-11-16T22:16:32.241 INFO:tasks.rados.rados.2.smithi057.stdout:3882: finishing copy_from to smithi05720651-34 2020-11-16T22:16:32.241 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 2913 (ObjNum 1229 snap 433 seq_num 1229) dirty exists 2020-11-16T22:16:32.242 INFO:tasks.rados.rados.2.smithi057.stdout:3881: finishing copy_from racing read to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:32.242 INFO:tasks.rados.rados.2.smithi057.stdout:3882: finishing copy_from racing read to smithi05720651-34 2020-11-16T22:16:32.242 INFO:tasks.rados.rados.2.smithi057.stdout:3883: finishing write tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:32.242 INFO:tasks.rados.rados.2.smithi057.stdout:3883: finishing write tid 3 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:32.242 INFO:tasks.rados.rados.2.smithi057.stdout:3883: finishing write tid 5 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:32.242 INFO:tasks.rados.rados.2.smithi057.stdout:3883: finishing write tid 6 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:32.242 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3013 (ObjNum 1306 snap 459 seq_num 1306) dirty exists 2020-11-16T22:16:32.243 INFO:tasks.rados.rados.2.smithi057.stdout:3883: left oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1306 snap 459 seq_num 1306) 2020-11-16T22:16:32.243 INFO:tasks.rados.rados.2.smithi057.stdout:3884: finishing write tid 1 to smithi05720651-20 2020-11-16T22:16:32.243 INFO:tasks.rados.rados.2.smithi057.stdout:3884: finishing write tid 2 to smithi05720651-20 2020-11-16T22:16:32.243 INFO:tasks.rados.rados.2.smithi057.stdout:3884: finishing write tid 3 to smithi05720651-20 2020-11-16T22:16:32.243 INFO:tasks.rados.rados.2.smithi057.stdout:3884: finishing write tid 5 to smithi05720651-20 2020-11-16T22:16:32.243 INFO:tasks.rados.rados.2.smithi057.stdout:3884: finishing write tid 6 to smithi05720651-20 2020-11-16T22:16:32.243 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 20 v 2917 (ObjNum 1307 snap 459 seq_num 1307) dirty exists 2020-11-16T22:16:32.243 INFO:tasks.rados.rados.2.smithi057.stdout:3884: left oid 20 (ObjNum 1307 snap 459 seq_num 1307) 2020-11-16T22:16:33.242 INFO:tasks.rados.rados.2.smithi057.stdout:3880: done (5 left) 2020-11-16T22:16:33.242 INFO:tasks.rados.rados.2.smithi057.stdout:3881: done (4 left) 2020-11-16T22:16:33.242 INFO:tasks.rados.rados.2.smithi057.stdout:3882: done (3 left) 2020-11-16T22:16:33.242 INFO:tasks.rados.rados.2.smithi057.stdout:3883: done (2 left) 2020-11-16T22:16:33.243 INFO:tasks.rados.rados.2.smithi057.stdout:3884: done (1 left) 2020-11-16T22:16:33.243 INFO:tasks.rados.rados.2.smithi057.stdout:3888: done (0 left) 2020-11-16T22:16:33.243 INFO:tasks.rados.rados.2.smithi057.stdout:3889: snap_create 2020-11-16T22:16:33.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:33 smithi016 bash[10302]: cluster 2020-11-16T22:16:31.879759+0000 mgr.x (mgr.24115) 717 : cluster [DBG] pgmap v1608: 17 pgs: 2 active+clean+snaptrim, 15 active+clean; 607 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.7 MiB/s wr, 6 op/s 2020-11-16T22:16:33.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:33 smithi016 bash[10302]: cluster 2020-11-16T22:16:32.250188+0000 mon.a (mon.0) 1642 : cluster [DBG] osdmap e962: 12 total, 12 up, 12 in 2020-11-16T22:16:33.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:33 smithi195 bash[10218]: cluster 2020-11-16T22:16:31.879759+0000 mgr.x (mgr.24115) 717 : cluster [DBG] pgmap v1608: 17 pgs: 2 active+clean+snaptrim, 15 active+clean; 607 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.7 MiB/s wr, 6 op/s 2020-11-16T22:16:33.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:33 smithi195 bash[10218]: cluster 2020-11-16T22:16:32.250188+0000 mon.a (mon.0) 1642 : cluster [DBG] osdmap e962: 12 total, 12 up, 12 in 2020-11-16T22:16:33.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:33 smithi057 bash[10301]: cluster 2020-11-16T22:16:31.879759+0000 mgr.x (mgr.24115) 717 : cluster [DBG] pgmap v1608: 17 pgs: 2 active+clean+snaptrim, 15 active+clean; 607 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.7 MiB/s wr, 6 op/s 2020-11-16T22:16:33.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:33 smithi057 bash[10301]: cluster 2020-11-16T22:16:32.250188+0000 mon.a (mon.0) 1642 : cluster [DBG] osdmap e962: 12 total, 12 up, 12 in 2020-11-16T22:16:34.243 INFO:tasks.rados.rados.2.smithi057.stdout:3889: done (0 left) 2020-11-16T22:16:34.244 INFO:tasks.rados.rados.2.smithi057.stdout:3890: copy_from oid 40 from oid 26 current snap is 461 2020-11-16T22:16:34.244 INFO:tasks.rados.rados.2.smithi057.stdout:3891: write oid 36 current snap is 461 2020-11-16T22:16:34.244 INFO:tasks.rados.rados.2.smithi057.stdout:3891: seq_num 1308 ranges {783556=438408,1674212=400111,2736451=420734,3882270=101286} 2020-11-16T22:16:34.256 INFO:tasks.rados.rados.2.smithi057.stdout:3891: writing smithi05720651-36 from 783556 to 1221964 tid 1 2020-11-16T22:16:34.263 INFO:tasks.rados.rados.2.smithi057.stdout:3891: writing smithi05720651-36 from 1674212 to 2074323 tid 2 2020-11-16T22:16:34.269 INFO:tasks.rados.rados.2.smithi057.stdout:3891: writing smithi05720651-36 from 2736451 to 3157185 tid 3 2020-11-16T22:16:34.274 INFO:tasks.rados.rados.2.smithi057.stdout:3891: writing smithi05720651-36 from 3882270 to 3983556 tid 4 2020-11-16T22:16:34.275 INFO:tasks.rados.rados.2.smithi057.stdout:3892: snap_remove snap 377 2020-11-16T22:16:34.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:34 smithi016 bash[10302]: cluster 2020-11-16T22:16:33.252348+0000 mon.a (mon.0) 1643 : cluster [DBG] osdmap e963: 12 total, 12 up, 12 in 2020-11-16T22:16:34.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:34 smithi016 bash[10302]: cluster 2020-11-16T22:16:34.254213+0000 mon.a (mon.0) 1644 : cluster [DBG] osdmap e964: 12 total, 12 up, 12 in 2020-11-16T22:16:34.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:34 smithi195 bash[10218]: cluster 2020-11-16T22:16:33.252348+0000 mon.a (mon.0) 1643 : cluster [DBG] osdmap e963: 12 total, 12 up, 12 in 2020-11-16T22:16:34.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:34 smithi195 bash[10218]: cluster 2020-11-16T22:16:34.254213+0000 mon.a (mon.0) 1644 : cluster [DBG] osdmap e964: 12 total, 12 up, 12 in 2020-11-16T22:16:34.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:34 smithi057 bash[10301]: cluster 2020-11-16T22:16:33.252348+0000 mon.a (mon.0) 1643 : cluster [DBG] osdmap e963: 12 total, 12 up, 12 in 2020-11-16T22:16:34.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:34 smithi057 bash[10301]: cluster 2020-11-16T22:16:34.254213+0000 mon.a (mon.0) 1644 : cluster [DBG] osdmap e964: 12 total, 12 up, 12 in 2020-11-16T22:16:35.227 INFO:tasks.rados.rados.2.smithi057.stdout:3892: done (2 left) 2020-11-16T22:16:35.227 INFO:tasks.rados.rados.2.smithi057.stdout:3893: rollback oid 8 current snap is 461 2020-11-16T22:16:35.228 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 8 to 418 2020-11-16T22:16:35.228 INFO:tasks.rados.rados.2.smithi057.stdout:3891: finishing write tid 1 to smithi05720651-36 2020-11-16T22:16:35.228 INFO:tasks.rados.rados.2.smithi057.stdout:3891: finishing write tid 2 to smithi05720651-36 2020-11-16T22:16:35.228 INFO:tasks.rados.rados.2.smithi057.stdout:3891: finishing write tid 3 to smithi05720651-36 2020-11-16T22:16:35.228 INFO:tasks.rados.rados.2.smithi057.stdout:3891: finishing write tid 4 to smithi05720651-36 2020-11-16T22:16:35.229 INFO:tasks.rados.rados.2.smithi057.stdout:3891: finishing write tid 6 to smithi05720651-36 2020-11-16T22:16:35.229 INFO:tasks.rados.rados.2.smithi057.stdout:3891: finishing write tid 7 to smithi05720651-36 2020-11-16T22:16:35.229 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 3291 (ObjNum 1308 snap 461 seq_num 1308) dirty exists 2020-11-16T22:16:35.229 INFO:tasks.rados.rados.2.smithi057.stdout:3891: left oid 36 (ObjNum 1308 snap 461 seq_num 1308) 2020-11-16T22:16:35.229 INFO:tasks.rados.rados.2.smithi057.stdout:3890: finishing copy_from to smithi05720651-40 2020-11-16T22:16:35.229 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 3324 (ObjNum 1180 snap 407 seq_num 1180) dirty exists 2020-11-16T22:16:35.229 INFO:tasks.rados.rados.2.smithi057.stdout:3890: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:16:35.229 INFO:tasks.rados.rados.2.smithi057.stdout:3890: done (2 left) 2020-11-16T22:16:35.230 INFO:tasks.rados.rados.2.smithi057.stdout:3891: done (1 left) 2020-11-16T22:16:35.230 INFO:tasks.rados.rados.2.smithi057.stdout:3894: snap_remove snap 433 2020-11-16T22:16:35.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:35 smithi016 bash[10302]: cluster 2020-11-16T22:16:33.880367+0000 mgr.x (mgr.24115) 718 : cluster [DBG] pgmap v1611: 17 pgs: 2 active+clean+snaptrim, 15 active+clean; 613 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.9 MiB/s wr, 6 op/s 2020-11-16T22:16:35.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:35 smithi016 bash[10302]: cluster 2020-11-16T22:16:35.237784+0000 mon.a (mon.0) 1645 : cluster [DBG] osdmap e965: 12 total, 12 up, 12 in 2020-11-16T22:16:35.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:35 smithi195 bash[10218]: cluster 2020-11-16T22:16:33.880367+0000 mgr.x (mgr.24115) 718 : cluster [DBG] pgmap v1611: 17 pgs: 2 active+clean+snaptrim, 15 active+clean; 613 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.9 MiB/s wr, 6 op/s 2020-11-16T22:16:35.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:35 smithi195 bash[10218]: cluster 2020-11-16T22:16:35.237784+0000 mon.a (mon.0) 1645 : cluster [DBG] osdmap e965: 12 total, 12 up, 12 in 2020-11-16T22:16:35.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:35 smithi057 bash[10301]: cluster 2020-11-16T22:16:33.880367+0000 mgr.x (mgr.24115) 718 : cluster [DBG] pgmap v1611: 17 pgs: 2 active+clean+snaptrim, 15 active+clean; 613 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1.9 MiB/s wr, 6 op/s 2020-11-16T22:16:35.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:35 smithi057 bash[10301]: cluster 2020-11-16T22:16:35.237784+0000 mon.a (mon.0) 1645 : cluster [DBG] osdmap e965: 12 total, 12 up, 12 in 2020-11-16T22:16:36.230 INFO:tasks.rados.rados.2.smithi057.stdout:3894: done (1 left) 2020-11-16T22:16:36.230 INFO:tasks.rados.rados.2.smithi057.stdout:3895: write oid 40 current snap is 461 2020-11-16T22:16:36.231 INFO:tasks.rados.rados.2.smithi057.stdout:3893: finishing rollback tid 0 to smithi05720651-8 2020-11-16T22:16:36.231 INFO:tasks.rados.rados.2.smithi057.stdout:3893: finishing rollback tid 1 to smithi05720651-8 2020-11-16T22:16:36.231 INFO:tasks.rados.rados.2.smithi057.stdout:3893: finishing rollback tid 2 to smithi05720651-8 2020-11-16T22:16:36.231 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 2889 (ObjNum 1098 snap 381 seq_num 1098) dirty exists 2020-11-16T22:16:36.231 INFO:tasks.rados.rados.2.smithi057.stdout:3895: seq_num 1309 ranges {400363=513657,1332694=660122} 2020-11-16T22:16:36.241 INFO:tasks.rados.rados.2.smithi057.stdout:3895: writing smithi05720651-40 from 400363 to 914020 tid 1 2020-11-16T22:16:36.247 INFO:tasks.rados.rados.2.smithi057.stdout:3895: writing smithi05720651-40 from 1332694 to 1992816 tid 2 2020-11-16T22:16:36.247 INFO:tasks.rados.rados.2.smithi057.stdout:3893: done (1 left) 2020-11-16T22:16:36.247 INFO:tasks.rados.rados.2.smithi057.stdout:3896: rollback oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 461 2020-11-16T22:16:36.247 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 443 2020-11-16T22:16:36.248 INFO:tasks.rados.rados.2.smithi057.stdout:3897: snap_create 2020-11-16T22:16:36.259 INFO:tasks.rados.rados.2.smithi057.stdout:3896: finishing rollback tid 0 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:36.259 INFO:tasks.rados.rados.2.smithi057.stdout:3896: finishing rollback tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:36.260 INFO:tasks.rados.rados.2.smithi057.stdout:3896: finishing rollback tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:36.260 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2425 (ObjNum 1202 snap 419 seq_num 1202) dirty exists 2020-11-16T22:16:36.261 INFO:tasks.rados.rados.2.smithi057.stdout:3895: finishing write tid 1 to smithi05720651-40 2020-11-16T22:16:36.261 INFO:tasks.rados.rados.2.smithi057.stdout:3895: finishing write tid 2 to smithi05720651-40 2020-11-16T22:16:36.263 INFO:tasks.rados.rados.2.smithi057.stdout:3895: finishing write tid 4 to smithi05720651-40 2020-11-16T22:16:36.263 INFO:tasks.rados.rados.2.smithi057.stdout:3895: finishing write tid 5 to smithi05720651-40 2020-11-16T22:16:36.263 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 40 v 3369 (ObjNum 1309 snap 461 seq_num 1309) dirty exists 2020-11-16T22:16:36.264 INFO:tasks.rados.rados.2.smithi057.stdout:3895: left oid 40 (ObjNum 1309 snap 461 seq_num 1309) 2020-11-16T22:16:37.241 INFO:tasks.rados.rados.2.smithi057.stdout:3895: done (2 left) 2020-11-16T22:16:37.241 INFO:tasks.rados.rados.2.smithi057.stdout:3896: done (1 left) 2020-11-16T22:16:37.241 INFO:tasks.rados.rados.2.smithi057.stdout:3897: done (0 left) 2020-11-16T22:16:37.242 INFO:tasks.rados.rados.2.smithi057.stdout:3898: read oid 1 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 423 2020-11-16T22:16:37.242 INFO:tasks.rados.rados.2.smithi057.stdout:3898: expect deleted 2020-11-16T22:16:37.242 INFO:tasks.rados.rados.2.smithi057.stdout:3899: snap_create 2020-11-16T22:16:37.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:37 smithi016 bash[10302]: cluster 2020-11-16T22:16:35.881178+0000 mgr.x (mgr.24115) 719 : cluster [DBG] pgmap v1614: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 614 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.4 MiB/s wr, 3 op/s 2020-11-16T22:16:37.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:37 smithi016 bash[10302]: cluster 2020-11-16T22:16:36.240577+0000 mon.a (mon.0) 1646 : cluster [DBG] osdmap e966: 12 total, 12 up, 12 in 2020-11-16T22:16:37.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:37 smithi195 bash[10218]: cluster 2020-11-16T22:16:35.881178+0000 mgr.x (mgr.24115) 719 : cluster [DBG] pgmap v1614: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 614 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.4 MiB/s wr, 3 op/s 2020-11-16T22:16:37.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:37 smithi195 bash[10218]: cluster 2020-11-16T22:16:36.240577+0000 mon.a (mon.0) 1646 : cluster [DBG] osdmap e966: 12 total, 12 up, 12 in 2020-11-16T22:16:37.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:37 smithi057 bash[10301]: cluster 2020-11-16T22:16:35.881178+0000 mgr.x (mgr.24115) 719 : cluster [DBG] pgmap v1614: 17 pgs: 1 active+clean+snaptrim, 16 active+clean; 614 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.4 MiB/s wr, 3 op/s 2020-11-16T22:16:37.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:37 smithi057 bash[10301]: cluster 2020-11-16T22:16:36.240577+0000 mon.a (mon.0) 1646 : cluster [DBG] osdmap e966: 12 total, 12 up, 12 in 2020-11-16T22:16:38.250 INFO:tasks.rados.rados.2.smithi057.stdout:3898: done (1 left) 2020-11-16T22:16:38.250 INFO:tasks.rados.rados.2.smithi057.stdout:3899: done (0 left) 2020-11-16T22:16:38.251 INFO:tasks.rados.rados.2.smithi057.stdout:3900: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 410 2020-11-16T22:16:38.251 INFO:tasks.rados.rados.2.smithi057.stdout:3900: expect (ObjNum 1112 snap 385 seq_num 1112) 2020-11-16T22:16:38.251 INFO:tasks.rados.rados.2.smithi057.stdout:3901: snap_create 2020-11-16T22:16:38.264 INFO:tasks.rados.rados.2.smithi057.stdout:3900: expect (ObjNum 1112 snap 385 seq_num 1112) 2020-11-16T22:16:38.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:38 smithi016 bash[10302]: cluster 2020-11-16T22:16:37.252008+0000 mon.a (mon.0) 1647 : cluster [DBG] osdmap e967: 12 total, 12 up, 12 in 2020-11-16T22:16:38.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:38 smithi195 bash[10218]: cluster 2020-11-16T22:16:37.252008+0000 mon.a (mon.0) 1647 : cluster [DBG] osdmap e967: 12 total, 12 up, 12 in 2020-11-16T22:16:38.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:38 smithi057 bash[10301]: cluster 2020-11-16T22:16:37.252008+0000 mon.a (mon.0) 1647 : cluster [DBG] osdmap e967: 12 total, 12 up, 12 in 2020-11-16T22:16:39.253 INFO:tasks.rados.rados.2.smithi057.stdout:3900: done (1 left) 2020-11-16T22:16:39.253 INFO:tasks.rados.rados.2.smithi057.stdout:3901: done (0 left) 2020-11-16T22:16:39.253 INFO:tasks.rados.rados.2.smithi057.stdout:3902: snap_remove snap 449 2020-11-16T22:16:39.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:39 smithi016 bash[10302]: cluster 2020-11-16T22:16:37.881847+0000 mgr.x (mgr.24115) 720 : cluster [DBG] pgmap v1617: 17 pgs: 17 active+clean; 616 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.5 MiB/s wr, 3 op/s 2020-11-16T22:16:39.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:39 smithi016 bash[10302]: cluster 2020-11-16T22:16:38.260846+0000 mon.a (mon.0) 1648 : cluster [DBG] osdmap e968: 12 total, 12 up, 12 in 2020-11-16T22:16:39.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:39 smithi195 bash[10218]: cluster 2020-11-16T22:16:37.881847+0000 mgr.x (mgr.24115) 720 : cluster [DBG] pgmap v1617: 17 pgs: 17 active+clean; 616 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.5 MiB/s wr, 3 op/s 2020-11-16T22:16:39.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:39 smithi195 bash[10218]: cluster 2020-11-16T22:16:38.260846+0000 mon.a (mon.0) 1648 : cluster [DBG] osdmap e968: 12 total, 12 up, 12 in 2020-11-16T22:16:39.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:39 smithi057 bash[10301]: cluster 2020-11-16T22:16:37.881847+0000 mgr.x (mgr.24115) 720 : cluster [DBG] pgmap v1617: 17 pgs: 17 active+clean; 616 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 1.5 MiB/s wr, 3 op/s 2020-11-16T22:16:39.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:39 smithi057 bash[10301]: cluster 2020-11-16T22:16:38.260846+0000 mon.a (mon.0) 1648 : cluster [DBG] osdmap e968: 12 total, 12 up, 12 in 2020-11-16T22:16:40.230 INFO:tasks.rados.rados.2.smithi057.stdout:3902: done (0 left) 2020-11-16T22:16:40.231 INFO:tasks.rados.rados.2.smithi057.stdout:3903: write (excl) oid 28 current snap is 464 2020-11-16T22:16:40.231 INFO:tasks.rados.rados.2.smithi057.stdout:3903: seq_num 1310 ranges {417170=588906,1674823=342347} 2020-11-16T22:16:40.242 INFO:tasks.rados.rados.2.smithi057.stdout:3903: writing smithi05720651-28 from 417170 to 1006076 tid 1 2020-11-16T22:16:40.249 INFO:tasks.rados.rados.2.smithi057.stdout:3903: writing smithi05720651-28 from 1674823 to 2017170 tid 2 2020-11-16T22:16:40.249 INFO:tasks.rados.rados.2.smithi057.stdout:3904: write (excl) oid 4 current snap is 464 2020-11-16T22:16:40.250 INFO:tasks.rados.rados.2.smithi057.stdout:3904: seq_num 1311 ranges {433977=664155,1733305=300672} 2020-11-16T22:16:40.256 INFO:tasks.rados.rados.2.smithi057.stdout:3904: writing smithi05720651-4 from 433977 to 1098132 tid 1 2020-11-16T22:16:40.262 INFO:tasks.rados.rados.2.smithi057.stdout:3904: writing smithi05720651-4 from 1733305 to 2033977 tid 2 2020-11-16T22:16:40.262 INFO:tasks.rados.rados.2.smithi057.stdout:3905: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:40.262 INFO:tasks.rados.rados.2.smithi057.stdout:3905: expect (ObjNum 1282 snap 448 seq_num 1282) 2020-11-16T22:16:40.262 INFO:tasks.rados.rados.2.smithi057.stdout:3906: read oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:40.262 INFO:tasks.rados.rados.2.smithi057.stdout:3906: expect (ObjNum 1249 snap 438 seq_num 1249) 2020-11-16T22:16:40.263 INFO:tasks.rados.rados.2.smithi057.stdout:3907: copy_from oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 464 2020-11-16T22:16:40.263 INFO:tasks.rados.rados.2.smithi057.stdout:3908: write oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 464 2020-11-16T22:16:40.263 INFO:tasks.rados.rados.2.smithi057.stdout:3908: seq_num 1312 ranges {450784=739404,1791787=258997} 2020-11-16T22:16:40.269 INFO:tasks.rados.rados.2.smithi057.stdout:3908: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 450784 to 1190188 tid 1 2020-11-16T22:16:40.274 INFO:tasks.rados.rados.2.smithi057.stdout:3908: writing smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1791787 to 2050784 tid 2 2020-11-16T22:16:40.275 INFO:tasks.rados.rados.2.smithi057.stdout:3909: snap_create 2020-11-16T22:16:40.275 INFO:tasks.rados.rados.2.smithi057.stdout:3903: finishing write tid 1 to smithi05720651-28 2020-11-16T22:16:40.275 INFO:tasks.rados.rados.2.smithi057.stdout:3903: finishing write tid 2 to smithi05720651-28 2020-11-16T22:16:40.275 INFO:tasks.rados.rados.2.smithi057.stdout:3903: finishing write tid 4 to smithi05720651-28 2020-11-16T22:16:40.275 INFO:tasks.rados.rados.2.smithi057.stdout:3903: finishing write tid 5 to smithi05720651-28 2020-11-16T22:16:40.275 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 3294 (ObjNum 1310 snap 464 seq_num 1310) dirty exists 2020-11-16T22:16:40.275 INFO:tasks.rados.rados.2.smithi057.stdout:3903: left oid 28 (ObjNum 1310 snap 464 seq_num 1310) 2020-11-16T22:16:40.276 INFO:tasks.rados.rados.2.smithi057.stdout:3904: finishing write tid 1 to smithi05720651-4 2020-11-16T22:16:40.276 INFO:tasks.rados.rados.2.smithi057.stdout:3904: finishing write tid 2 to smithi05720651-4 2020-11-16T22:16:40.276 INFO:tasks.rados.rados.2.smithi057.stdout:3904: finishing write tid 4 to smithi05720651-4 2020-11-16T22:16:40.276 INFO:tasks.rados.rados.2.smithi057.stdout:3904: finishing write tid 5 to smithi05720651-4 2020-11-16T22:16:40.276 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 2920 (ObjNum 1311 snap 464 seq_num 1311) dirty exists 2020-11-16T22:16:40.276 INFO:tasks.rados.rados.2.smithi057.stdout:3904: left oid 4 (ObjNum 1311 snap 464 seq_num 1311) 2020-11-16T22:16:40.277 INFO:tasks.rados.rados.2.smithi057.stdout:3906: expect (ObjNum 1249 snap 438 seq_num 1249) 2020-11-16T22:16:40.370 INFO:tasks.rados.rados.2.smithi057.stdout:3908: finishing write tid 1 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:40.370 INFO:tasks.rados.rados.2.smithi057.stdout:3908: finishing write tid 2 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:40.370 INFO:tasks.rados.rados.2.smithi057.stdout:3905: expect (ObjNum 1282 snap 448 seq_num 1282) 2020-11-16T22:16:40.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:40 smithi016 bash[10302]: cluster 2020-11-16T22:16:39.263179+0000 mon.a (mon.0) 1649 : cluster [DBG] osdmap e969: 12 total, 12 up, 12 in 2020-11-16T22:16:40.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:40 smithi016 bash[10302]: cluster 2020-11-16T22:16:40.240920+0000 mon.a (mon.0) 1650 : cluster [DBG] osdmap e970: 12 total, 12 up, 12 in 2020-11-16T22:16:40.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:40 smithi195 bash[10218]: cluster 2020-11-16T22:16:39.263179+0000 mon.a (mon.0) 1649 : cluster [DBG] osdmap e969: 12 total, 12 up, 12 in 2020-11-16T22:16:40.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:40 smithi195 bash[10218]: cluster 2020-11-16T22:16:40.240920+0000 mon.a (mon.0) 1650 : cluster [DBG] osdmap e970: 12 total, 12 up, 12 in 2020-11-16T22:16:40.633 INFO:tasks.rados.rados.2.smithi057.stdout:3907: finishing copy_from to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:40.633 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2422 (ObjNum 1301 snap 456 seq_num 1301) dirty exists 2020-11-16T22:16:40.633 INFO:tasks.rados.rados.2.smithi057.stdout:3907: finishing copy_from racing read to smithi05720651-9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:40.634 INFO:tasks.rados.rados.2.smithi057.stdout:3908: finishing write tid 4 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:40.634 INFO:tasks.rados.rados.2.smithi057.stdout:3908: finishing write tid 5 to smithi05720651-47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:40.634 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3383 (ObjNum 1312 snap 464 seq_num 1312) dirty exists 2020-11-16T22:16:40.634 INFO:tasks.rados.rados.2.smithi057.stdout:3908: left oid 47 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1312 snap 464 seq_num 1312) 2020-11-16T22:16:40.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:40 smithi057 bash[10301]: cluster 2020-11-16T22:16:39.263179+0000 mon.a (mon.0) 1649 : cluster [DBG] osdmap e969: 12 total, 12 up, 12 in 2020-11-16T22:16:40.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:40 smithi057 bash[10301]: cluster 2020-11-16T22:16:40.240920+0000 mon.a (mon.0) 1650 : cluster [DBG] osdmap e970: 12 total, 12 up, 12 in 2020-11-16T22:16:41.281 INFO:tasks.rados.rados.2.smithi057.stdout:3903: done (6 left) 2020-11-16T22:16:41.281 INFO:tasks.rados.rados.2.smithi057.stdout:3904: done (5 left) 2020-11-16T22:16:41.281 INFO:tasks.rados.rados.2.smithi057.stdout:3905: done (4 left) 2020-11-16T22:16:41.282 INFO:tasks.rados.rados.2.smithi057.stdout:3906: done (3 left) 2020-11-16T22:16:41.282 INFO:tasks.rados.rados.2.smithi057.stdout:3907: done (2 left) 2020-11-16T22:16:41.282 INFO:tasks.rados.rados.2.smithi057.stdout:3908: done (1 left) 2020-11-16T22:16:41.282 INFO:tasks.rados.rados.2.smithi057.stdout:3909: done (0 left) 2020-11-16T22:16:41.282 INFO:tasks.rados.rados.2.smithi057.stdout:3910: write oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 465 2020-11-16T22:16:41.282 INFO:tasks.rados.rados.2.smithi057.stdout:3910: seq_num 1313 ranges {467591=414653,1450269=617322} 2020-11-16T22:16:41.289 INFO:tasks.rados.rados.2.smithi057.stdout:3910: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 467591 to 882244 tid 1 2020-11-16T22:16:41.296 INFO:tasks.rados.rados.2.smithi057.stdout:3910: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1450269 to 2067591 tid 2 2020-11-16T22:16:41.297 INFO:tasks.rados.rados.2.smithi057.stdout:3911: read oid 30 snap -1 2020-11-16T22:16:41.297 INFO:tasks.rados.rados.2.smithi057.stdout:3911: expect (ObjNum 1180 snap 407 seq_num 1180) 2020-11-16T22:16:41.297 INFO:tasks.rados.rados.2.smithi057.stdout:3912: read oid 9 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:41.297 INFO:tasks.rados.rados.2.smithi057.stdout:3912: expect (ObjNum 1301 snap 456 seq_num 1301) 2020-11-16T22:16:41.297 INFO:tasks.rados.rados.2.smithi057.stdout:3913: snap_create 2020-11-16T22:16:41.304 INFO:tasks.rados.rados.2.smithi057.stdout:3910: finishing write tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:41.306 INFO:tasks.rados.rados.2.smithi057.stdout:3910: finishing write tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:41.323 INFO:tasks.rados.rados.2.smithi057.stdout:3911: expect (ObjNum 1180 snap 407 seq_num 1180) 2020-11-16T22:16:41.528 INFO:tasks.rados.rados.2.smithi057.stdout:3912: expect (ObjNum 1301 snap 456 seq_num 1301) 2020-11-16T22:16:41.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:41 smithi016 bash[10302]: cluster 2020-11-16T22:16:39.882556+0000 mgr.x (mgr.24115) 721 : cluster [DBG] pgmap v1620: 17 pgs: 17 active+clean; 619 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.2 MiB/s wr, 2 op/s 2020-11-16T22:16:41.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:41 smithi195 bash[10218]: cluster 2020-11-16T22:16:39.882556+0000 mgr.x (mgr.24115) 721 : cluster [DBG] pgmap v1620: 17 pgs: 17 active+clean; 619 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.2 MiB/s wr, 2 op/s 2020-11-16T22:16:41.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:41 smithi057 bash[10301]: cluster 2020-11-16T22:16:39.882556+0000 mgr.x (mgr.24115) 721 : cluster [DBG] pgmap v1620: 17 pgs: 17 active+clean; 619 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 1.2 MiB/s wr, 2 op/s 2020-11-16T22:16:41.746 INFO:tasks.rados.rados.2.smithi057.stdout:3910: finishing write tid 4 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:41.746 INFO:tasks.rados.rados.2.smithi057.stdout:3910: finishing write tid 5 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:41.746 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2428 (ObjNum 1313 snap 465 seq_num 1313) dirty exists 2020-11-16T22:16:41.746 INFO:tasks.rados.rados.2.smithi057.stdout:3910: left oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1313 snap 465 seq_num 1313) 2020-11-16T22:16:42.291 INFO:tasks.rados.rados.2.smithi057.stdout:3910: done (3 left) 2020-11-16T22:16:42.292 INFO:tasks.rados.rados.2.smithi057.stdout:3911: done (2 left) 2020-11-16T22:16:42.292 INFO:tasks.rados.rados.2.smithi057.stdout:3912: done (1 left) 2020-11-16T22:16:42.292 INFO:tasks.rados.rados.2.smithi057.stdout:3913: done (0 left) 2020-11-16T22:16:42.292 INFO:tasks.rados.rados.2.smithi057.stdout:3914: copy_from oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 466 2020-11-16T22:16:42.292 INFO:tasks.rados.rados.2.smithi057.stdout:3915: write (excl) oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 466 2020-11-16T22:16:42.293 INFO:tasks.rados.rados.2.smithi057.stdout:3915: seq_num 1314 ranges {484398=489902,1392398=411118} 2020-11-16T22:16:42.307 INFO:tasks.rados.rados.2.smithi057.stdout:3915: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 484398 to 974300 tid 1 2020-11-16T22:16:42.312 INFO:tasks.rados.rados.2.smithi057.stdout:3915: writing smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1392398 to 1803516 tid 2 2020-11-16T22:16:42.312 INFO:tasks.rados.rados.2.smithi057.stdout:3916: snap_create 2020-11-16T22:16:42.314 INFO:tasks.rados.rados.2.smithi057.stdout:3915: finishing write tid 1 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:42.319 INFO:tasks.rados.rados.2.smithi057.stdout:3915: finishing write tid 2 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:42.319 INFO:tasks.rados.rados.2.smithi057.stdout:3915: finishing write tid 4 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:42.320 INFO:tasks.rados.rados.2.smithi057.stdout:3914: finishing copy_from to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:42.321 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2552 (ObjNum 1243 snap 438 seq_num 1243) dirty exists 2020-11-16T22:16:42.321 INFO:tasks.rados.rados.2.smithi057.stdout:3914: finishing copy_from racing read to smithi05720651-27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:42.324 INFO:tasks.rados.rados.2.smithi057.stdout:3915: finishing write tid 5 to smithi05720651-29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:42.324 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2616 (ObjNum 1314 snap 466 seq_num 1314) dirty exists 2020-11-16T22:16:42.324 INFO:tasks.rados.rados.2.smithi057.stdout:3915: left oid 29 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1314 snap 466 seq_num 1314) 2020-11-16T22:16:42.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:42 smithi016 bash[10302]: cluster 2020-11-16T22:16:41.292083+0000 mon.a (mon.0) 1651 : cluster [DBG] osdmap e971: 12 total, 12 up, 12 in 2020-11-16T22:16:42.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:42 smithi195 bash[10218]: cluster 2020-11-16T22:16:41.292083+0000 mon.a (mon.0) 1651 : cluster [DBG] osdmap e971: 12 total, 12 up, 12 in 2020-11-16T22:16:42.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:42 smithi057 bash[10301]: cluster 2020-11-16T22:16:41.292083+0000 mon.a (mon.0) 1651 : cluster [DBG] osdmap e971: 12 total, 12 up, 12 in 2020-11-16T22:16:43.293 INFO:tasks.rados.rados.2.smithi057.stdout:3914: done (2 left) 2020-11-16T22:16:43.294 INFO:tasks.rados.rados.2.smithi057.stdout:3915: done (1 left) 2020-11-16T22:16:43.294 INFO:tasks.rados.rados.2.smithi057.stdout:3916: done (0 left) 2020-11-16T22:16:43.294 INFO:tasks.rados.rados.2.smithi057.stdout:3917: delete oid 6 current snap is 467 2020-11-16T22:16:43.305 INFO:tasks.rados.rados.2.smithi057.stdout:3917: done (0 left) 2020-11-16T22:16:43.305 INFO:tasks.rados.rados.2.smithi057.stdout:3918: snap_create 2020-11-16T22:16:43.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:43 smithi016 bash[10302]: cluster 2020-11-16T22:16:41.883277+0000 mgr.x (mgr.24115) 722 : cluster [DBG] pgmap v1623: 17 pgs: 17 active+clean; 624 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2020-11-16T22:16:43.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:43 smithi016 bash[10302]: cluster 2020-11-16T22:16:42.302062+0000 mon.a (mon.0) 1652 : cluster [DBG] osdmap e972: 12 total, 12 up, 12 in 2020-11-16T22:16:43.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:43 smithi195 bash[10218]: cluster 2020-11-16T22:16:41.883277+0000 mgr.x (mgr.24115) 722 : cluster [DBG] pgmap v1623: 17 pgs: 17 active+clean; 624 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2020-11-16T22:16:43.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:43 smithi195 bash[10218]: cluster 2020-11-16T22:16:42.302062+0000 mon.a (mon.0) 1652 : cluster [DBG] osdmap e972: 12 total, 12 up, 12 in 2020-11-16T22:16:43.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:43 smithi057 bash[10301]: cluster 2020-11-16T22:16:41.883277+0000 mgr.x (mgr.24115) 722 : cluster [DBG] pgmap v1623: 17 pgs: 17 active+clean; 624 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.2 MiB/s wr, 11 op/s 2020-11-16T22:16:43.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:43 smithi057 bash[10301]: cluster 2020-11-16T22:16:42.302062+0000 mon.a (mon.0) 1652 : cluster [DBG] osdmap e972: 12 total, 12 up, 12 in 2020-11-16T22:16:44.313 INFO:tasks.rados.rados.2.smithi057.stdout:3918: done (0 left) 2020-11-16T22:16:44.313 INFO:tasks.rados.rados.2.smithi057.stdout:3919: write (excl) oid 34 current snap is 468 2020-11-16T22:16:44.314 INFO:tasks.rados.rados.2.smithi057.stdout:3919: seq_num 1316 ranges {518012=756753,2025715=92297} 2020-11-16T22:16:44.326 INFO:tasks.rados.rados.2.smithi057.stdout:3919: writing smithi05720651-34 from 518012 to 1274765 tid 1 2020-11-16T22:16:44.332 INFO:tasks.rados.rados.2.smithi057.stdout:3919: writing smithi05720651-34 from 2025715 to 2118012 tid 2 2020-11-16T22:16:44.332 INFO:tasks.rados.rados.2.smithi057.stdout:3920: write oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 468 2020-11-16T22:16:44.332 INFO:tasks.rados.rados.2.smithi057.stdout:3920: seq_num 1317 ranges {534819=432002,1684197=450622} 2020-11-16T22:16:44.337 INFO:tasks.rados.rados.2.smithi057.stdout:3920: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 534819 to 966821 tid 1 2020-11-16T22:16:44.344 INFO:tasks.rados.rados.2.smithi057.stdout:3920: writing smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1684197 to 2134819 tid 2 2020-11-16T22:16:44.344 INFO:tasks.rados.rados.2.smithi057.stdout:3921: write oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 468 2020-11-16T22:16:44.344 INFO:tasks.rados.rados.2.smithi057.stdout:3921: seq_num 1318 ranges {551626=507251,1626326=418456} 2020-11-16T22:16:44.350 INFO:tasks.rados.rados.2.smithi057.stdout:3921: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 551626 to 1058877 tid 1 2020-11-16T22:16:44.355 INFO:tasks.rados.rados.2.smithi057.stdout:3921: writing smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1626326 to 2044782 tid 2 2020-11-16T22:16:44.356 INFO:tasks.rados.rados.2.smithi057.stdout:3922: read oid 16 snap -1 2020-11-16T22:16:44.356 INFO:tasks.rados.rados.2.smithi057.stdout:3922: expect (ObjNum 1271 snap 448 seq_num 1271) 2020-11-16T22:16:44.356 INFO:tasks.rados.rados.2.smithi057.stdout:3923: write (excl) oid 4 current snap is 468 2020-11-16T22:16:44.356 INFO:tasks.rados.rados.2.smithi057.stdout:3923: seq_num 1319 ranges {568433=582500,1684808=483625} 2020-11-16T22:16:44.362 INFO:tasks.rados.rados.2.smithi057.stdout:3923: writing smithi05720651-4 from 568433 to 1150933 tid 1 2020-11-16T22:16:44.369 INFO:tasks.rados.rados.2.smithi057.stdout:3923: writing smithi05720651-4 from 1684808 to 2168433 tid 2 2020-11-16T22:16:44.369 INFO:tasks.rados.rados.2.smithi057.stdout:3924: read oid 27 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:44.369 INFO:tasks.rados.rados.2.smithi057.stdout:3924: expect (ObjNum 1243 snap 438 seq_num 1243) 2020-11-16T22:16:44.370 INFO:tasks.rados.rados.2.smithi057.stdout:3925: rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 468 2020-11-16T22:16:44.370 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 425 2020-11-16T22:16:44.370 INFO:tasks.rados.rados.2.smithi057.stdout:3919: finishing write tid 1 to smithi05720651-34 2020-11-16T22:16:44.370 INFO:tasks.rados.rados.2.smithi057.stdout:3926: delete oid 44 current snap is 468 2020-11-16T22:16:44.370 INFO:tasks.rados.rados.2.smithi057.stdout:3919: finishing write tid 2 to smithi05720651-34 2020-11-16T22:16:44.370 INFO:tasks.rados.rados.2.smithi057.stdout:3919: finishing write tid 4 to smithi05720651-34 2020-11-16T22:16:44.370 INFO:tasks.rados.rados.2.smithi057.stdout:3919: finishing write tid 5 to smithi05720651-34 2020-11-16T22:16:44.371 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 34 v 2923 (ObjNum 1316 snap 468 seq_num 1316) dirty exists 2020-11-16T22:16:44.371 INFO:tasks.rados.rados.2.smithi057.stdout:3919: left oid 34 (ObjNum 1316 snap 468 seq_num 1316) 2020-11-16T22:16:44.371 INFO:tasks.rados.rados.2.smithi057.stdout:3920: finishing write tid 1 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:44.371 INFO:tasks.rados.rados.2.smithi057.stdout:3920: finishing write tid 2 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:44.371 INFO:tasks.rados.rados.2.smithi057.stdout:3920: finishing write tid 4 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:44.371 INFO:tasks.rados.rados.2.smithi057.stdout:3920: finishing write tid 5 to smithi05720651-43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:44.371 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3016 (ObjNum 1317 snap 468 seq_num 1317) dirty exists 2020-11-16T22:16:44.372 INFO:tasks.rados.rados.2.smithi057.stdout:3920: left oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1317 snap 468 seq_num 1317) 2020-11-16T22:16:44.372 INFO:tasks.rados.rados.2.smithi057.stdout:3921: finishing write tid 1 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:44.372 INFO:tasks.rados.rados.2.smithi057.stdout:3921: finishing write tid 2 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:44.372 INFO:tasks.rados.rados.2.smithi057.stdout:3921: finishing write tid 4 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:44.372 INFO:tasks.rados.rados.2.smithi057.stdout:3921: finishing write tid 5 to smithi05720651-13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:44.372 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2989 (ObjNum 1318 snap 468 seq_num 1318) dirty exists 2020-11-16T22:16:44.372 INFO:tasks.rados.rados.2.smithi057.stdout:3921: left oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1318 snap 468 seq_num 1318) 2020-11-16T22:16:44.373 INFO:tasks.rados.rados.2.smithi057.stdout:3922: expect (ObjNum 1271 snap 448 seq_num 1271) 2020-11-16T22:16:44.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:44 smithi016 bash[10302]: cluster 2020-11-16T22:16:43.304763+0000 mon.a (mon.0) 1653 : cluster [DBG] osdmap e973: 12 total, 12 up, 12 in 2020-11-16T22:16:44.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:44 smithi195 bash[10218]: cluster 2020-11-16T22:16:43.304763+0000 mon.a (mon.0) 1653 : cluster [DBG] osdmap e973: 12 total, 12 up, 12 in 2020-11-16T22:16:44.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:44 smithi057 bash[10301]: cluster 2020-11-16T22:16:43.304763+0000 mon.a (mon.0) 1653 : cluster [DBG] osdmap e973: 12 total, 12 up, 12 in 2020-11-16T22:16:44.703 INFO:tasks.rados.rados.2.smithi057.stdout:3923: finishing write tid 1 to smithi05720651-4 2020-11-16T22:16:44.703 INFO:tasks.rados.rados.2.smithi057.stdout:3923: finishing write tid 2 to smithi05720651-4 2020-11-16T22:16:44.703 INFO:tasks.rados.rados.2.smithi057.stdout:3923: finishing write tid 4 to smithi05720651-4 2020-11-16T22:16:44.704 INFO:tasks.rados.rados.2.smithi057.stdout:3923: finishing write tid 5 to smithi05720651-4 2020-11-16T22:16:44.704 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 4 v 2926 (ObjNum 1319 snap 468 seq_num 1319) dirty exists 2020-11-16T22:16:44.704 INFO:tasks.rados.rados.2.smithi057.stdout:3923: left oid 4 (ObjNum 1319 snap 468 seq_num 1319) 2020-11-16T22:16:44.704 INFO:tasks.rados.rados.2.smithi057.stdout:3925: finishing rollback tid 0 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:44.704 INFO:tasks.rados.rados.2.smithi057.stdout:3925: finishing rollback tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:44.704 INFO:tasks.rados.rados.2.smithi057.stdout:3925: finishing rollback tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:44.704 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3019 (ObjNum 1175 snap 407 seq_num 1175) dirty exists 2020-11-16T22:16:44.705 INFO:tasks.rados.rados.2.smithi057.stdout:3924: expect (ObjNum 1243 snap 438 seq_num 1243) 2020-11-16T22:16:44.787 INFO:tasks.rados.rados.2.smithi057.stdout:3919: done (7 left) 2020-11-16T22:16:44.787 INFO:tasks.rados.rados.2.smithi057.stdout:3920: done (6 left) 2020-11-16T22:16:44.787 INFO:tasks.rados.rados.2.smithi057.stdout:3921: done (5 left) 2020-11-16T22:16:44.788 INFO:tasks.rados.rados.2.smithi057.stdout:3922: done (4 left) 2020-11-16T22:16:44.788 INFO:tasks.rados.rados.2.smithi057.stdout:3923: done (3 left) 2020-11-16T22:16:44.788 INFO:tasks.rados.rados.2.smithi057.stdout:3924: done (2 left) 2020-11-16T22:16:44.788 INFO:tasks.rados.rados.2.smithi057.stdout:3925: done (1 left) 2020-11-16T22:16:44.788 INFO:tasks.rados.rados.2.smithi057.stdout:3926: done (0 left) 2020-11-16T22:16:44.788 INFO:tasks.rados.rados.2.smithi057.stdout:3927: read oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:44.788 INFO:tasks.rados.rados.2.smithi057.stdout:3927: expect (ObjNum 1313 snap 465 seq_num 1313) 2020-11-16T22:16:44.789 INFO:tasks.rados.rados.2.smithi057.stdout:3928: delete oid 44 current snap is 468 2020-11-16T22:16:44.793 INFO:tasks.rados.rados.2.smithi057.stdout:3928: done (1 left) 2020-11-16T22:16:44.793 INFO:tasks.rados.rados.2.smithi057.stdout:3929: snap_create 2020-11-16T22:16:44.796 INFO:tasks.rados.rados.2.smithi057.stdout:3927: expect (ObjNum 1313 snap 465 seq_num 1313) 2020-11-16T22:16:45.230 INFO:tasks.rados.rados.2.smithi057.stdout:3927: done (1 left) 2020-11-16T22:16:45.230 INFO:tasks.rados.rados.2.smithi057.stdout:3929: done (0 left) 2020-11-16T22:16:45.434 INFO:tasks.rados.rados.2.smithi057.stdout:3930: snap_create 2020-11-16T22:16:45.638 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:45 smithi195 bash[10218]: cluster 2020-11-16T22:16:43.883954+0000 mgr.x (mgr.24115) 723 : cluster [DBG] pgmap v1626: 17 pgs: 17 active+clean; 626 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2020-11-16T22:16:45.846 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:45 smithi195 bash[10218]: cluster 2020-11-16T22:16:44.324183+0000 mon.a (mon.0) 1654 : cluster [DBG] osdmap e974: 12 total, 12 up, 12 in 2020-11-16T22:16:46.050 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:45 smithi195 bash[10218]: cluster 2020-11-16T22:16:45.240812+0000 mon.a (mon.0) 1655 : cluster [DBG] osdmap e975: 12 total, 12 up, 12 in 2020-11-16T22:16:46.254 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:45 smithi016 bash[10302]: cluster 2020-11-16T22:16:43.883954+0000 mgr.x (mgr.24115) 723 : cluster [DBG] pgmap v1626: 17 pgs: 17 active+clean; 626 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2020-11-16T22:16:46.254 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:45 smithi016 bash[10302]: cluster 2020-11-16T22:16:44.324183+0000 mon.a (mon.0) 1654 : cluster [DBG] osdmap e974: 12 total, 12 up, 12 in 2020-11-16T22:16:46.254 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:45 smithi016 bash[10302]: cluster 2020-11-16T22:16:45.240812+0000 mon.a (mon.0) 1655 : cluster [DBG] osdmap e975: 12 total, 12 up, 12 in 2020-11-16T22:16:46.256 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:45 smithi057 bash[10301]: cluster 2020-11-16T22:16:43.883954+0000 mgr.x (mgr.24115) 723 : cluster [DBG] pgmap v1626: 17 pgs: 17 active+clean; 626 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.4 MiB/s wr, 11 op/s 2020-11-16T22:16:46.256 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:45 smithi057 bash[10301]: cluster 2020-11-16T22:16:44.324183+0000 mon.a (mon.0) 1654 : cluster [DBG] osdmap e974: 12 total, 12 up, 12 in 2020-11-16T22:16:46.256 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:45 smithi057 bash[10301]: cluster 2020-11-16T22:16:45.240812+0000 mon.a (mon.0) 1655 : cluster [DBG] osdmap e975: 12 total, 12 up, 12 in 2020-11-16T22:16:46.256 INFO:tasks.rados.rados.2.smithi057.stdout:3930: done (0 left) 2020-11-16T22:16:46.256 INFO:tasks.rados.rados.2.smithi057.stdout:3931: rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 470 2020-11-16T22:16:46.257 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 437 2020-11-16T22:16:46.257 INFO:tasks.rados.rados.2.smithi057.stdout:3932: snap_create 2020-11-16T22:16:46.257 INFO:tasks.rados.rados.2.smithi057.stdout:3931: finishing rollback tid 0 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:46.458 INFO:tasks.rados.rados.2.smithi057.stdout:3931: finishing rollback tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:46.458 INFO:tasks.rados.rados.2.smithi057.stdout:3931: finishing rollback tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:46.458 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3022 (ObjNum 1236 snap 437 seq_num 1236) dirty exists 2020-11-16T22:16:47.243 INFO:tasks.rados.rados.2.smithi057.stdout:3931: done (1 left) 2020-11-16T22:16:47.244 INFO:tasks.rados.rados.2.smithi057.stdout:3932: done (0 left) 2020-11-16T22:16:47.244 INFO:tasks.rados.rados.2.smithi057.stdout:3933: rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 471 2020-11-16T22:16:47.244 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 462 2020-11-16T22:16:47.244 INFO:tasks.rados.rados.2.smithi057.stdout:3934: snap_create 2020-11-16T22:16:47.250 INFO:tasks.rados.rados.2.smithi057.stdout:3933: finishing rollback tid 1 to smithi05720651-21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:47.250 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2421 (ObjNum 1869573999 snap 28527 seq_num 336) dirty dne 2020-11-16T22:16:47.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:47 smithi016 bash[10302]: cluster 2020-11-16T22:16:45.884680+0000 mgr.x (mgr.24115) 724 : cluster [DBG] pgmap v1629: 17 pgs: 17 active+clean; 631 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2020-11-16T22:16:47.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:47 smithi016 bash[10302]: cluster 2020-11-16T22:16:46.243488+0000 mon.a (mon.0) 1656 : cluster [DBG] osdmap e976: 12 total, 12 up, 12 in 2020-11-16T22:16:47.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:47 smithi195 bash[10218]: cluster 2020-11-16T22:16:45.884680+0000 mgr.x (mgr.24115) 724 : cluster [DBG] pgmap v1629: 17 pgs: 17 active+clean; 631 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2020-11-16T22:16:47.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:47 smithi195 bash[10218]: cluster 2020-11-16T22:16:46.243488+0000 mon.a (mon.0) 1656 : cluster [DBG] osdmap e976: 12 total, 12 up, 12 in 2020-11-16T22:16:47.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:47 smithi057 bash[10301]: cluster 2020-11-16T22:16:45.884680+0000 mgr.x (mgr.24115) 724 : cluster [DBG] pgmap v1629: 17 pgs: 17 active+clean; 631 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2020-11-16T22:16:47.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:47 smithi057 bash[10301]: cluster 2020-11-16T22:16:46.243488+0000 mon.a (mon.0) 1656 : cluster [DBG] osdmap e976: 12 total, 12 up, 12 in 2020-11-16T22:16:48.253 INFO:tasks.rados.rados.2.smithi057.stdout:3933: done (1 left) 2020-11-16T22:16:48.254 INFO:tasks.rados.rados.2.smithi057.stdout:3934: done (0 left) 2020-11-16T22:16:48.254 INFO:tasks.rados.rados.2.smithi057.stdout:3935: read oid 28 snap -1 2020-11-16T22:16:48.254 INFO:tasks.rados.rados.2.smithi057.stdout:3935: expect (ObjNum 1310 snap 464 seq_num 1310) 2020-11-16T22:16:48.254 INFO:tasks.rados.rados.2.smithi057.stdout:3936: read oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:48.254 INFO:tasks.rados.rados.2.smithi057.stdout:3936: expect (ObjNum 1282 snap 448 seq_num 1282) 2020-11-16T22:16:48.254 INFO:tasks.rados.rados.2.smithi057.stdout:3937: snap_remove snap 465 2020-11-16T22:16:48.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:48 smithi016 bash[10302]: cluster 2020-11-16T22:16:47.254007+0000 mon.a (mon.0) 1657 : cluster [DBG] osdmap e977: 12 total, 12 up, 12 in 2020-11-16T22:16:48.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:48 smithi195 bash[10218]: cluster 2020-11-16T22:16:47.254007+0000 mon.a (mon.0) 1657 : cluster [DBG] osdmap e977: 12 total, 12 up, 12 in 2020-11-16T22:16:48.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:48 smithi057 bash[10301]: cluster 2020-11-16T22:16:47.254007+0000 mon.a (mon.0) 1657 : cluster [DBG] osdmap e977: 12 total, 12 up, 12 in 2020-11-16T22:16:49.263 INFO:tasks.rados.rados.2.smithi057.stdout:3937: done (2 left) 2020-11-16T22:16:49.263 INFO:tasks.rados.rados.2.smithi057.stdout:3938: write (excl) oid 38 current snap is 472 2020-11-16T22:16:49.264 INFO:tasks.rados.rados.2.smithi057.stdout:3938: seq_num 1322 ranges {618854=408247,1743901=425794} 2020-11-16T22:16:49.276 INFO:tasks.rados.rados.2.smithi057.stdout:3938: writing smithi05720651-38 from 618854 to 1027101 tid 1 2020-11-16T22:16:49.283 INFO:tasks.rados.rados.2.smithi057.stdout:3938: writing smithi05720651-38 from 1743901 to 2169695 tid 2 2020-11-16T22:16:49.283 INFO:tasks.rados.rados.2.smithi057.stdout:3939: read oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:49.283 INFO:tasks.rados.rados.2.smithi057.stdout:3939: expect (ObjNum 1301 snap 456 seq_num 1301) 2020-11-16T22:16:49.283 INFO:tasks.rados.rados.2.smithi057.stdout:3940: read oid 32 snap -1 2020-11-16T22:16:49.284 INFO:tasks.rados.rados.2.smithi057.stdout:3940: expect deleted 2020-11-16T22:16:49.284 INFO:tasks.rados.rados.2.smithi057.stdout:3941: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:49.284 INFO:tasks.rados.rados.2.smithi057.stdout:3941: expect deleted 2020-11-16T22:16:49.284 INFO:tasks.rados.rados.2.smithi057.stdout:3942: delete oid 26 current snap is 472 2020-11-16T22:16:49.284 INFO:tasks.rados.rados.2.smithi057.stdout:3935: expect (ObjNum 1310 snap 464 seq_num 1310) 2020-11-16T22:16:49.488 INFO:tasks.rados.rados.2.smithi057.stdout:3936: expect (ObjNum 1282 snap 448 seq_num 1282) 2020-11-16T22:16:49.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:49 smithi016 bash[10302]: cluster 2020-11-16T22:16:47.885393+0000 mgr.x (mgr.24115) 725 : cluster [DBG] pgmap v1632: 17 pgs: 17 active+clean; 637 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.3 MiB/s wr, 20 op/s 2020-11-16T22:16:49.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:49 smithi016 bash[10302]: cluster 2020-11-16T22:16:48.263961+0000 mon.a (mon.0) 1658 : cluster [DBG] osdmap e978: 12 total, 12 up, 12 in 2020-11-16T22:16:49.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:49 smithi195 bash[10218]: cluster 2020-11-16T22:16:47.885393+0000 mgr.x (mgr.24115) 725 : cluster [DBG] pgmap v1632: 17 pgs: 17 active+clean; 637 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.3 MiB/s wr, 20 op/s 2020-11-16T22:16:49.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:49 smithi195 bash[10218]: cluster 2020-11-16T22:16:48.263961+0000 mon.a (mon.0) 1658 : cluster [DBG] osdmap e978: 12 total, 12 up, 12 in 2020-11-16T22:16:49.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:49 smithi057 bash[10301]: cluster 2020-11-16T22:16:47.885393+0000 mgr.x (mgr.24115) 725 : cluster [DBG] pgmap v1632: 17 pgs: 17 active+clean; 637 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 2.3 MiB/s wr, 20 op/s 2020-11-16T22:16:49.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:49 smithi057 bash[10301]: cluster 2020-11-16T22:16:48.263961+0000 mon.a (mon.0) 1658 : cluster [DBG] osdmap e978: 12 total, 12 up, 12 in 2020-11-16T22:16:49.747 INFO:tasks.rados.rados.2.smithi057.stdout:3938: finishing write tid 1 to smithi05720651-38 2020-11-16T22:16:49.747 INFO:tasks.rados.rados.2.smithi057.stdout:3938: finishing write tid 2 to smithi05720651-38 2020-11-16T22:16:49.748 INFO:tasks.rados.rados.2.smithi057.stdout:3938: finishing write tid 4 to smithi05720651-38 2020-11-16T22:16:49.748 INFO:tasks.rados.rados.2.smithi057.stdout:3938: finishing write tid 5 to smithi05720651-38 2020-11-16T22:16:49.748 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 38 v 2424 (ObjNum 1322 snap 472 seq_num 1322) dirty exists 2020-11-16T22:16:49.748 INFO:tasks.rados.rados.2.smithi057.stdout:3938: left oid 38 (ObjNum 1322 snap 472 seq_num 1322) 2020-11-16T22:16:49.748 INFO:tasks.rados.rados.2.smithi057.stdout:3939: expect (ObjNum 1301 snap 456 seq_num 1301) 2020-11-16T22:16:49.964 INFO:tasks.rados.rados.2.smithi057.stdout:3935: done (6 left) 2020-11-16T22:16:49.964 INFO:tasks.rados.rados.2.smithi057.stdout:3936: done (5 left) 2020-11-16T22:16:49.964 INFO:tasks.rados.rados.2.smithi057.stdout:3938: done (4 left) 2020-11-16T22:16:49.964 INFO:tasks.rados.rados.2.smithi057.stdout:3939: done (3 left) 2020-11-16T22:16:49.964 INFO:tasks.rados.rados.2.smithi057.stdout:3940: done (2 left) 2020-11-16T22:16:49.965 INFO:tasks.rados.rados.2.smithi057.stdout:3941: done (1 left) 2020-11-16T22:16:49.965 INFO:tasks.rados.rados.2.smithi057.stdout:3942: done (0 left) 2020-11-16T22:16:49.965 INFO:tasks.rados.rados.2.smithi057.stdout:3943: delete oid 48 current snap is 472 2020-11-16T22:16:49.969 INFO:tasks.rados.rados.2.smithi057.stdout:3943: done (0 left) 2020-11-16T22:16:49.969 INFO:tasks.rados.rados.2.smithi057.stdout:3944: read oid 20 snap 470 2020-11-16T22:16:49.969 INFO:tasks.rados.rados.2.smithi057.stdout:3944: expect (ObjNum 1307 snap 459 seq_num 1307) 2020-11-16T22:16:49.970 INFO:tasks.rados.rados.2.smithi057.stdout:3945: read oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:49.970 INFO:tasks.rados.rados.2.smithi057.stdout:3945: expect (ObjNum 1318 snap 468 seq_num 1318) 2020-11-16T22:16:49.970 INFO:tasks.rados.rados.2.smithi057.stdout:3946: rollback oid 22 current snap is 472 2020-11-16T22:16:49.970 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 22 to 403 2020-11-16T22:16:49.970 INFO:tasks.rados.rados.2.smithi057.stdout:3947: copy_from oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 48 current snap is 472 2020-11-16T22:16:49.971 INFO:tasks.rados.rados.2.smithi057.stdout:3948: write oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 472 2020-11-16T22:16:49.971 INFO:tasks.rados.rados.2.smithi057.stdout:3948: seq_num 1325 ranges {669275=750347,2035700=233575} 2020-11-16T22:16:49.982 INFO:tasks.rados.rados.2.smithi057.stdout:3948: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 669275 to 1419622 tid 1 2020-11-16T22:16:49.989 INFO:tasks.rados.rados.2.smithi057.stdout:3948: writing smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2035700 to 2269275 tid 2 2020-11-16T22:16:49.989 INFO:tasks.rados.rados.2.smithi057.stdout:3949: delete oid 18 current snap is 472 2020-11-16T22:16:49.989 INFO:tasks.rados.rados.2.smithi057.stdout:3947: finishing copy_from to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:49.989 INFO:tasks.rados.rados.2.smithi057.stdout:3947: got expected ENOENT (src dne) 2020-11-16T22:16:49.989 INFO:tasks.rados.rados.2.smithi057.stdout:3947: finishing copy_from racing read to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:49.989 INFO:tasks.rados.rados.2.smithi057.stdout:3946: finishing rollback tid 0 to smithi05720651-22 2020-11-16T22:16:49.990 INFO:tasks.rados.rados.2.smithi057.stdout:3946: finishing rollback tid 1 to smithi05720651-22 2020-11-16T22:16:49.990 INFO:tasks.rados.rados.2.smithi057.stdout:3945: expect (ObjNum 1318 snap 468 seq_num 1318) 2020-11-16T22:16:50.093 INFO:tasks.rados.rados.2.smithi057.stdout:3946: finishing rollback tid 2 to smithi05720651-22 2020-11-16T22:16:50.093 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 3010 (ObjNum 1027 snap 361 seq_num 1027) dirty exists 2020-11-16T22:16:50.093 INFO:tasks.rados.rados.2.smithi057.stdout:3944: expect (ObjNum 1307 snap 459 seq_num 1307) 2020-11-16T22:16:50.209 INFO:tasks.rados.rados.2.smithi057.stdout:3948: finishing write tid 1 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:50.210 INFO:tasks.rados.rados.2.smithi057.stdout:3948: finishing write tid 2 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:50.210 INFO:tasks.rados.rados.2.smithi057.stdout:3948: finishing write tid 4 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:50.210 INFO:tasks.rados.rados.2.smithi057.stdout:3948: finishing write tid 5 to smithi05720651-25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:50.210 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3297 (ObjNum 1325 snap 472 seq_num 1325) dirty exists 2020-11-16T22:16:50.210 INFO:tasks.rados.rados.2.smithi057.stdout:3948: left oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1325 snap 472 seq_num 1325) 2020-11-16T22:16:50.210 INFO:tasks.rados.rados.2.smithi057.stdout:3944: done (5 left) 2020-11-16T22:16:50.211 INFO:tasks.rados.rados.2.smithi057.stdout:3945: done (4 left) 2020-11-16T22:16:50.211 INFO:tasks.rados.rados.2.smithi057.stdout:3946: done (3 left) 2020-11-16T22:16:50.211 INFO:tasks.rados.rados.2.smithi057.stdout:3947: done (2 left) 2020-11-16T22:16:50.211 INFO:tasks.rados.rados.2.smithi057.stdout:3948: done (1 left) 2020-11-16T22:16:50.211 INFO:tasks.rados.rados.2.smithi057.stdout:3949: done (0 left) 2020-11-16T22:16:50.211 INFO:tasks.rados.rados.2.smithi057.stdout:3950: write (excl) oid 32 current snap is 472 2020-11-16T22:16:50.211 INFO:tasks.rados.rados.2.smithi057.stdout:3950: seq_num 1327 ranges {702889=500845,1636311=576790} 2020-11-16T22:16:50.225 INFO:tasks.rados.rados.2.smithi057.stdout:3950: writing smithi05720651-32 from 702889 to 1203734 tid 1 2020-11-16T22:16:50.231 INFO:tasks.rados.rados.2.smithi057.stdout:3950: writing smithi05720651-32 from 1636311 to 2213101 tid 2 2020-11-16T22:16:50.231 INFO:tasks.rados.rados.2.smithi057.stdout:3951: rollback oid 28 current snap is 472 2020-11-16T22:16:50.231 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 28 to 455 2020-11-16T22:16:50.231 INFO:tasks.rados.rados.2.smithi057.stdout:3952: read oid 42 snap -1 2020-11-16T22:16:50.231 INFO:tasks.rados.rados.2.smithi057.stdout:3952: expect (ObjNum 1268 snap 448 seq_num 1268) 2020-11-16T22:16:50.232 INFO:tasks.rados.rados.2.smithi057.stdout:3953: delete oid 25 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 472 2020-11-16T22:16:50.239 INFO:tasks.rados.rados.2.smithi057.stdout:3950: finishing write tid 1 to smithi05720651-32 2020-11-16T22:16:50.241 INFO:tasks.rados.rados.2.smithi057.stdout:3951: finishing rollback tid 0 to smithi05720651-28 2020-11-16T22:16:50.241 INFO:tasks.rados.rados.2.smithi057.stdout:3951: finishing rollback tid 1 to smithi05720651-28 2020-11-16T22:16:50.242 INFO:tasks.rados.rados.2.smithi057.stdout:3951: finishing rollback tid 2 to smithi05720651-28 2020-11-16T22:16:50.242 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 28 v 3300 (ObjNum 1220 snap 433 seq_num 1220) dirty exists 2020-11-16T22:16:50.242 INFO:tasks.rados.rados.2.smithi057.stdout:3951: done (3 left) 2020-11-16T22:16:50.243 INFO:tasks.rados.rados.2.smithi057.stdout:3953: done (2 left) 2020-11-16T22:16:50.243 INFO:tasks.rados.rados.2.smithi057.stdout:3954: write (excl) oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 472 2020-11-16T22:16:50.243 INFO:tasks.rados.rados.2.smithi057.stdout:3954: seq_num 1329 ranges {736503=651343,2153275=183228} 2020-11-16T22:16:50.250 INFO:tasks.rados.rados.2.smithi057.stdout:3954: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 736503 to 1387846 tid 1 2020-11-16T22:16:50.256 INFO:tasks.rados.rados.2.smithi057.stdout:3954: writing smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 2153275 to 2336503 tid 2 2020-11-16T22:16:50.257 INFO:tasks.rados.rados.2.smithi057.stdout:3952: expect (ObjNum 1268 snap 448 seq_num 1268) 2020-11-16T22:16:50.489 INFO:tasks.rados.rados.2.smithi057.stdout:3952: done (2 left) 2020-11-16T22:16:50.490 INFO:tasks.rados.rados.2.smithi057.stdout:3955: snap_create 2020-11-16T22:16:50.490 INFO:tasks.rados.rados.2.smithi057.stdout:3950: finishing write tid 2 to smithi05720651-32 2020-11-16T22:16:50.490 INFO:tasks.rados.rados.2.smithi057.stdout:3950: finishing write tid 4 to smithi05720651-32 2020-11-16T22:16:50.490 INFO:tasks.rados.rados.2.smithi057.stdout:3950: finishing write tid 5 to smithi05720651-32 2020-11-16T22:16:50.491 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 32 v 3396 (ObjNum 1327 snap 472 seq_num 1327) dirty exists 2020-11-16T22:16:50.491 INFO:tasks.rados.rados.2.smithi057.stdout:3950: left oid 32 (ObjNum 1327 snap 472 seq_num 1327) 2020-11-16T22:16:50.491 INFO:tasks.rados.rados.2.smithi057.stdout:3954: finishing write tid 1 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:50.491 INFO:tasks.rados.rados.2.smithi057.stdout:3954: finishing write tid 2 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:50.491 INFO:tasks.rados.rados.2.smithi057.stdout:3954: finishing write tid 4 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:50.491 INFO:tasks.rados.rados.2.smithi057.stdout:3954: finishing write tid 5 to smithi05720651-37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:50.492 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2431 (ObjNum 1329 snap 472 seq_num 1329) dirty exists 2020-11-16T22:16:50.492 INFO:tasks.rados.rados.2.smithi057.stdout:3954: left oid 37 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1329 snap 472 seq_num 1329) 2020-11-16T22:16:50.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:50 smithi016 bash[10302]: cluster 2020-11-16T22:16:49.273971+0000 mon.a (mon.0) 1659 : cluster [DBG] osdmap e979: 12 total, 12 up, 12 in 2020-11-16T22:16:50.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:50 smithi016 bash[10302]: cluster 2020-11-16T22:16:50.241028+0000 mon.a (mon.0) 1660 : cluster [DBG] osdmap e980: 12 total, 12 up, 12 in 2020-11-16T22:16:50.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:50 smithi195 bash[10218]: cluster 2020-11-16T22:16:49.273971+0000 mon.a (mon.0) 1659 : cluster [DBG] osdmap e979: 12 total, 12 up, 12 in 2020-11-16T22:16:50.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:50 smithi195 bash[10218]: cluster 2020-11-16T22:16:50.241028+0000 mon.a (mon.0) 1660 : cluster [DBG] osdmap e980: 12 total, 12 up, 12 in 2020-11-16T22:16:50.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:50 smithi057 bash[10301]: cluster 2020-11-16T22:16:49.273971+0000 mon.a (mon.0) 1659 : cluster [DBG] osdmap e979: 12 total, 12 up, 12 in 2020-11-16T22:16:50.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:50 smithi057 bash[10301]: cluster 2020-11-16T22:16:50.241028+0000 mon.a (mon.0) 1660 : cluster [DBG] osdmap e980: 12 total, 12 up, 12 in 2020-11-16T22:16:51.283 INFO:tasks.rados.rados.2.smithi057.stdout:3950: done (2 left) 2020-11-16T22:16:51.283 INFO:tasks.rados.rados.2.smithi057.stdout:3954: done (1 left) 2020-11-16T22:16:51.283 INFO:tasks.rados.rados.2.smithi057.stdout:3955: done (0 left) 2020-11-16T22:16:51.283 INFO:tasks.rados.rados.2.smithi057.stdout:3956: snap_create 2020-11-16T22:16:51.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:51 smithi016 bash[10302]: audit 2020-11-16T22:16:50.629182+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733536\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T22:11:14.733718\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733818\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734372\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734775\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_id\": \"78c6be68ad72\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.735173\", \"created\": \"2020-11-16T21:57:35.868755\", \"started\": \"2020-11-16T21:57:39.078945\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.735687\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:16:50.627259\"}"}]: dispatch 2020-11-16T22:16:51.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:51 smithi016 bash[10302]: audit 2020-11-16T22:16:50.630147+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644082\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644301\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645006\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645593\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_id\": \"515cac7965a8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.646143\", \"created\": \"2020-11-16T21:59:17.849548\", \"started\": \"2020-11-16T21:59:21.095277\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.646886\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:16:50.629179\"}"}]: dispatch 2020-11-16T22:16:51.588 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:51 smithi016 bash[10302]: audit 2020-11-16T22:16:50.630851+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649152\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649249\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649590\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649873\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_id\": \"845c4348cafa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.650209\", \"created\": \"2020-11-16T21:55:56.917880\", \"started\": \"2020-11-16T21:55:59.862159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.650622\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:16:50.630355\"}"}]: dispatch 2020-11-16T22:16:51.589 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:51 smithi016 bash[10302]: audit 2020-11-16T22:16:50.635072+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733536\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T22:11:14.733718\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733818\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734372\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734775\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_id\": \"78c6be68ad72\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.735173\", \"created\": \"2020-11-16T21:57:35.868755\", \"started\": \"2020-11-16T21:57:39.078945\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.735687\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:16:50.627259\"}"}]': finished 2020-11-16T22:16:51.589 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:51 smithi016 bash[10302]: audit 2020-11-16T22:16:50.640680+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644082\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644301\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645006\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645593\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_id\": \"515cac7965a8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.646143\", \"created\": \"2020-11-16T21:59:17.849548\", \"started\": \"2020-11-16T21:59:21.095277\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.646886\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:16:50.629179\"}"}]': finished 2020-11-16T22:16:51.589 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:51 smithi016 bash[10302]: audit 2020-11-16T22:16:50.640793+0000 mon.a (mon.0) 1666 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649152\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649249\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649590\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649873\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_id\": \"845c4348cafa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.650209\", \"created\": \"2020-11-16T21:55:56.917880\", \"started\": \"2020-11-16T21:55:59.862159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.650622\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:16:50.630355\"}"}]': finished 2020-11-16T22:16:51.590 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:51 smithi016 bash[10302]: audit 2020-11-16T22:16:50.643018+0000 mon.a (mon.0) 1667 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:16:51.590 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:51 smithi016 bash[10302]: audit 2020-11-16T22:16:50.646581+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:16:51.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:51 smithi195 bash[10218]: audit 2020-11-16T22:16:50.629182+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733536\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T22:11:14.733718\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733818\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734372\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734775\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_id\": \"78c6be68ad72\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.735173\", \"created\": \"2020-11-16T21:57:35.868755\", \"started\": \"2020-11-16T21:57:39.078945\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.735687\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:16:50.627259\"}"}]: dispatch 2020-11-16T22:16:51.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:51 smithi195 bash[10218]: audit 2020-11-16T22:16:50.630147+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644082\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644301\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645006\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645593\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_id\": \"515cac7965a8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.646143\", \"created\": \"2020-11-16T21:59:17.849548\", \"started\": \"2020-11-16T21:59:21.095277\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.646886\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:16:50.629179\"}"}]: dispatch 2020-11-16T22:16:51.802 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:51 smithi195 bash[10218]: audit 2020-11-16T22:16:50.630851+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649152\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649249\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649590\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649873\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_id\": \"845c4348cafa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.650209\", \"created\": \"2020-11-16T21:55:56.917880\", \"started\": \"2020-11-16T21:55:59.862159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.650622\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:16:50.630355\"}"}]: dispatch 2020-11-16T22:16:51.802 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:51 smithi195 bash[10218]: audit 2020-11-16T22:16:50.635072+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733536\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T22:11:14.733718\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733818\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734372\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734775\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_id\": \"78c6be68ad72\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.735173\", \"created\": \"2020-11-16T21:57:35.868755\", \"started\": \"2020-11-16T21:57:39.078945\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.735687\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:16:50.627259\"}"}]': finished 2020-11-16T22:16:51.804 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:51 smithi057 bash[10301]: audit 2020-11-16T22:16:50.629182+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733536\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T22:11:14.733718\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733818\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734372\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734775\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_id\": \"78c6be68ad72\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.735173\", \"created\": \"2020-11-16T21:57:35.868755\", \"started\": \"2020-11-16T21:57:39.078945\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.735687\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:16:50.627259\"}"}]: dispatch 2020-11-16T22:16:51.804 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:51 smithi057 bash[10301]: audit 2020-11-16T22:16:50.630147+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644082\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644301\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645006\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645593\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_id\": \"515cac7965a8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.646143\", \"created\": \"2020-11-16T21:59:17.849548\", \"started\": \"2020-11-16T21:59:21.095277\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.646886\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:16:50.629179\"}"}]: dispatch 2020-11-16T22:16:51.805 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:51 smithi057 bash[10301]: audit 2020-11-16T22:16:50.630851+0000 mon.a (mon.0) 1663 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649152\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649249\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649590\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649873\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_id\": \"845c4348cafa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.650209\", \"created\": \"2020-11-16T21:55:56.917880\", \"started\": \"2020-11-16T21:55:59.862159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.650622\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:16:50.630355\"}"}]: dispatch 2020-11-16T22:16:51.805 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:51 smithi057 bash[10301]: audit 2020-11-16T22:16:50.635072+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi016","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"smithi016\", \"container_id\": \"4eb5763eea67\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733536\", \"created\": \"2020-11-16T21:53:23.654525\", \"started\": \"2020-11-16T21:53:23.764851\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"smithi016\", \"container_id\": \"9870d9d1f5e7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2020-11-16T22:11:14.733718\", \"created\": \"2020-11-16T21:53:58.686525\", \"started\": \"2020-11-16T21:53:58.794212\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"smithi016\", \"container_id\": \"04d33b8244c7\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.733818\", \"created\": \"2020-11-16T21:56:19.366523\", \"started\": \"2020-11-16T21:56:23.300361\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"smithi016\", \"container_id\": \"46864df6b7ea\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734372\", \"created\": \"2020-11-16T21:56:44.762523\", \"started\": \"2020-11-16T21:56:48.485438\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"smithi016\", \"container_id\": \"ff2e09658025\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.734775\", \"created\": \"2020-11-16T21:57:09.870522\", \"started\": \"2020-11-16T21:57:13.570033\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"smithi016\", \"container_id\": \"78c6be68ad72\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.735173\", \"created\": \"2020-11-16T21:57:35.868755\", \"started\": \"2020-11-16T21:57:39.078945\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"2329bb51-31d3-4e24-89eb-dd4269482cb0\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"Y9eKA3-eKee-mnow-9cAW-Ej0K-iAlU-JGV3si\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a6fae614-5672-4ca8-bd91-5625e1525a60\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"nQnTox-AzQ0-ymDo-izTo-I1Br-7kHO-bV03Ha\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b114510c-b7e9-48b0-8056-0a0fd4299259\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"r9jZv3-d2x0-RJba-xRnd-9XdP-0KMu-bnxPSX\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4bd595de-1740-4bdb-97b2-c346b366d299\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ctn6aS-9piX-HJ74-oDF3-ANvu-F6E1-KH1cmL\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB7513002C480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"SCSI VPD page 0xb1 is not supported\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"Not a SCSI compatible device\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:47.626257\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:56.149875\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:16.895879\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2020-11-16T21:56:42.419978\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:07.503176\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:33.615071\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.735687\", \"last_device_update\": \"2020-11-16T21:57:43.490734\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.16\"], \"172.21.15.254\": [\"172.21.15.16\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1564\"]}, \"last_host_check\": \"2020-11-16T22:16:50.627259\"}"}]': finished 2020-11-16T22:16:51.805 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:51 smithi057 bash[10301]: audit 2020-11-16T22:16:50.640680+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644082\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644301\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645006\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645593\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_id\": \"515cac7965a8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.646143\", \"created\": \"2020-11-16T21:59:17.849548\", \"started\": \"2020-11-16T21:59:21.095277\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.646886\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:16:50.629179\"}"}]': finished 2020-11-16T22:16:51.805 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:51 smithi057 bash[10301]: audit 2020-11-16T22:16:50.640793+0000 mon.a (mon.0) 1666 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649152\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649249\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649590\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649873\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_id\": \"845c4348cafa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.650209\", \"created\": \"2020-11-16T21:55:56.917880\", \"started\": \"2020-11-16T21:55:59.862159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.650622\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:16:50.630355\"}"}]': finished 2020-11-16T22:16:51.805 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:51 smithi057 bash[10301]: audit 2020-11-16T22:16:50.643018+0000 mon.a (mon.0) 1667 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:16:51.806 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:51 smithi057 bash[10301]: audit 2020-11-16T22:16:50.646581+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:16:51.806 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:51 smithi195 bash[10218]: audit 2020-11-16T22:16:50.640680+0000 mon.a (mon.0) 1665 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi057","val":"{\"daemons\": {\"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"smithi057\", \"container_id\": \"9929baae6aaa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644082\", \"created\": \"2020-11-16T21:53:38.542344\", \"started\": \"2020-11-16T21:53:38.653339\"}, \"osd.8\": {\"daemon_type\": \"osd\", \"daemon_id\": \"8\", \"hostname\": \"smithi057\", \"container_id\": \"9d6a946f5b4e\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.644301\", \"created\": \"2020-11-16T21:57:59.192190\", \"started\": \"2020-11-16T21:58:02.963775\"}, \"osd.9\": {\"daemon_type\": \"osd\", \"daemon_id\": \"9\", \"hostname\": \"smithi057\", \"container_id\": \"c598f05c6483\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645006\", \"created\": \"2020-11-16T21:58:25.883143\", \"started\": \"2020-11-16T21:58:30.226695\"}, \"osd.10\": {\"daemon_type\": \"osd\", \"daemon_id\": \"10\", \"hostname\": \"smithi057\", \"container_id\": \"050110ae0aa4\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.645593\", \"created\": \"2020-11-16T21:58:51.794258\", \"started\": \"2020-11-16T21:58:55.526215\"}, \"osd.11\": {\"daemon_type\": \"osd\", \"daemon_id\": \"11\", \"hostname\": \"smithi057\", \"container_id\": \"515cac7965a8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.646143\", \"created\": \"2020-11-16T21:59:17.849548\", \"started\": \"2020-11-16T21:59:21.095277\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDKE040T7\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 4000787030016.0, \"human_readable_size\": \"3.64 TB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"11\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ac30fc92-b414-4fe6-8ca4-f3f4bab38156\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"ec5i9O-IhCB-Yelm-2QFk-zLSK-m62j-GjhAvp\"}, {\"name\": \"lv_2\", \"osd_id\": \"10\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f96ec9f0-97cf-4382-a66a-eddbe351df6f\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"dbe7Js-oEkG-jsly-ZUkT-yFlU-Wwog-3kVA6K\"}, {\"name\": \"lv_3\", \"osd_id\": \"9\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"fcb83bc5-7834-4510-8fe9-40074b8dc739\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"fK3PRq-NKTs-Y2ks-Oe1l-fBLw-MWMW-amFW27\"}, {\"name\": \"lv_4\", \"osd_id\": \"8\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"4eaa536f-253e-460d-a65d-221dd0924d00\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"1dx1Gw-Aby9-bzXc-TIYa-z4CK-T1Mw-0a1s7T\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_BTLE7361049H4P0KGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0x83 is not supported\", \"SCSI VPD page 0xb1 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:49.772602\"}, \"osd.8\": {\"deps\": [], \"last_config\": \"2020-11-16T21:57:56.798271\"}, \"osd.9\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:23.489990\"}, \"osd.10\": {\"deps\": [], \"last_config\": \"2020-11-16T21:58:49.493989\"}, \"osd.11\": {\"deps\": [], \"last_config\": \"2020-11-16T21:59:15.613661\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.646886\", \"last_device_update\": \"2020-11-16T21:59:25.296378\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.57\"], \"172.21.15.254\": [\"172.21.15.57\"], \"fe80::/64\": [\"fe80::ec4:7aff:febd:1562\"]}, \"last_host_check\": \"2020-11-16T22:16:50.629179\"}"}]': finished 2020-11-16T22:16:51.806 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:51 smithi195 bash[10218]: audit 2020-11-16T22:16:50.640793+0000 mon.a (mon.0) 1666 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi195","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"smithi195\", \"container_id\": \"486d992e67e3\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649152\", \"created\": \"2020-11-16T21:51:01.532235\", \"started\": \"2020-11-16T21:51:08.149570\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"smithi195\", \"container_id\": \"473ecb8a4e45\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649249\", \"created\": \"2020-11-16T21:54:43.217881\", \"started\": \"2020-11-16T21:54:46.458774\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"smithi195\", \"container_id\": \"71717489cdee\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649590\", \"created\": \"2020-11-16T21:55:06.485881\", \"started\": \"2020-11-16T21:55:09.702535\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"smithi195\", \"container_id\": \"542938666bb8\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.649873\", \"created\": \"2020-11-16T21:55:30.721880\", \"started\": \"2020-11-16T21:55:33.913755\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"smithi195\", \"container_id\": \"845c4348cafa\", \"container_image_id\": \"ed3493334a5ef62c79faf249c532aa3c94b10d4fd91f561be0c17f6f5c1a513e\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b\", \"version\": \"16.0.0-7219-g911cc357\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"None\", \"is_active\": false, \"last_refresh\": \"2020-11-16T22:11:14.650209\", \"created\": \"2020-11-16T21:55:56.917880\", \"started\": \"2020-11-16T21:55:59.862159\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"8832539b-0ff5-4887-a8a1-005008fd830a\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"zCIzOb-Pkug-S8K2-Ayq1-Fjq6-KdlT-dCIWee\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"25dcebff-95d0-47a0-8efb-c3b66ee68eb5\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"iR8E68-bbQ8-Lt7O-RA39-1h32-cC0g-rlgfUT\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"k8qdhN-GEgw-tutb-Q9Vf-yobR-aNWC-k31ryh\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e17765a8-0ee0-47d6-8c45-96b8e46dbd03\", \"cluster_fsid\": \"bcd5108e-2855-11eb-a2b2-001a4aab830c\", \"osdspec_affinity\": \"None\", \"block_uuid\": \"yb6QZf-omZA-Onxd-0xwC-2hW1-4SwM-uCii3H\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"_PHMB751300FS480DGN\", \"lsm_data\": {\"serialNum\": \"Unknown\", \"transport\": \"Unknown\", \"mediaType\": \"Unknown\", \"rpm\": \"Unknown\", \"linkSpeed\": \"Unknown\", \"health\": \"Unknown\", \"ledSupport\": {\"IDENTsupport\": \"Unknown\", \"IDENTstatus\": \"Unsupported\", \"FAILsupport\": \"Unknown\", \"FAILstatus\": \"Unsupported\"}, \"errors\": [\"Not a SCSI compatible device\", \"we only support disk path start with '/dev/sd' today\", \"SCSI VPD page 0xb1 is not supported\", \"SCSI VPD page 0x83 is not supported\"]}}], \"osdspec_previews\": [], \"daemon_config_deps\": {\"mon.a\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:53.366763\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2020-11-16T21:53:45.277174\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2020-11-16T21:54:41.114841\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:04.233469\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:28.476535\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2020-11-16T21:55:54.623662\"}}, \"last_daemon_update\": \"2020-11-16T22:11:14.650622\", \"last_device_update\": \"2020-11-16T21:56:03.872610\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.15.195\"], \"fe80::/64\": [\"fe80::ec4:7aff:fe88:8081\"]}, \"last_host_check\": \"2020-11-16T22:16:50.630355\"}"}]': finished 2020-11-16T22:16:51.806 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:51 smithi195 bash[10218]: audit 2020-11-16T22:16:50.643018+0000 mon.a (mon.0) 1667 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2020-11-16T22:16:51.806 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:51 smithi195 bash[10218]: audit 2020-11-16T22:16:50.646581+0000 mon.a (mon.0) 1668 : audit [INF] from='mgr.24115 v1:172.21.15.16:0/1999113858' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2020-11-16T22:16:52.296 INFO:tasks.rados.rados.2.smithi057.stdout:3956: done (0 left) 2020-11-16T22:16:52.296 INFO:tasks.rados.rados.2.smithi057.stdout:3957: read oid 40 snap -1 2020-11-16T22:16:52.297 INFO:tasks.rados.rados.2.smithi057.stdout:3957: expect (ObjNum 1309 snap 461 seq_num 1309) 2020-11-16T22:16:52.297 INFO:tasks.rados.rados.2.smithi057.stdout:3958: write oid 22 current snap is 474 2020-11-16T22:16:52.297 INFO:tasks.rados.rados.2.smithi057.stdout:3958: seq_num 1330 ranges {753310=726592,2095404=257906} 2020-11-16T22:16:52.314 INFO:tasks.rados.rados.2.smithi057.stdout:3958: writing smithi05720651-22 from 753310 to 1479902 tid 1 2020-11-16T22:16:52.319 INFO:tasks.rados.rados.2.smithi057.stdout:3958: writing smithi05720651-22 from 2095404 to 2353310 tid 2 2020-11-16T22:16:52.319 INFO:tasks.rados.rados.2.smithi057.stdout:3959: copy_from oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 10 current snap is 474 2020-11-16T22:16:52.319 INFO:tasks.rados.rados.2.smithi057.stdout:3957: expect (ObjNum 1309 snap 461 seq_num 1309) 2020-11-16T22:16:52.430 INFO:tasks.rados.rados.2.smithi057.stdout:3958: finishing write tid 1 to smithi05720651-22 2020-11-16T22:16:52.430 INFO:tasks.rados.rados.2.smithi057.stdout:3958: finishing write tid 2 to smithi05720651-22 2020-11-16T22:16:52.430 INFO:tasks.rados.rados.2.smithi057.stdout:3958: finishing write tid 4 to smithi05720651-22 2020-11-16T22:16:52.430 INFO:tasks.rados.rados.2.smithi057.stdout:3958: finishing write tid 5 to smithi05720651-22 2020-11-16T22:16:52.431 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 3013 (ObjNum 1330 snap 474 seq_num 1330) dirty exists 2020-11-16T22:16:52.431 INFO:tasks.rados.rados.2.smithi057.stdout:3958: left oid 22 (ObjNum 1330 snap 474 seq_num 1330) 2020-11-16T22:16:52.431 INFO:tasks.rados.rados.2.smithi057.stdout:3959: finishing copy_from to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:52.431 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2571 (ObjNum 1028 snap 361 seq_num 1028) dirty exists 2020-11-16T22:16:52.431 INFO:tasks.rados.rados.2.smithi057.stdout:3959: finishing copy_from racing read to smithi05720651-19 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:52.431 INFO:tasks.rados.rados.2.smithi057.stdout:3957: done (2 left) 2020-11-16T22:16:52.432 INFO:tasks.rados.rados.2.smithi057.stdout:3958: done (1 left) 2020-11-16T22:16:52.432 INFO:tasks.rados.rados.2.smithi057.stdout:3959: done (0 left) 2020-11-16T22:16:52.432 INFO:tasks.rados.rados.2.smithi057.stdout:3960: snap_create 2020-11-16T22:16:52.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:52 smithi016 bash[10302]: cluster 2020-11-16T22:16:51.293939+0000 mon.a (mon.0) 1669 : cluster [DBG] osdmap e981: 12 total, 12 up, 12 in 2020-11-16T22:16:52.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:52 smithi195 bash[10218]: cluster 2020-11-16T22:16:51.293939+0000 mon.a (mon.0) 1669 : cluster [DBG] osdmap e981: 12 total, 12 up, 12 in 2020-11-16T22:16:52.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:52 smithi057 bash[10301]: cluster 2020-11-16T22:16:51.293939+0000 mon.a (mon.0) 1669 : cluster [DBG] osdmap e981: 12 total, 12 up, 12 in 2020-11-16T22:16:53.306 INFO:tasks.rados.rados.2.smithi057.stdout:3960: done (0 left) 2020-11-16T22:16:53.306 INFO:tasks.rados.rados.2.smithi057.stdout:3961: rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 475 2020-11-16T22:16:53.307 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 470 2020-11-16T22:16:53.307 INFO:tasks.rados.rados.2.smithi057.stdout:3962: snap_create 2020-11-16T22:16:53.314 INFO:tasks.rados.rados.2.smithi057.stdout:3961: finishing rollback tid 0 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:53.314 INFO:tasks.rados.rados.2.smithi057.stdout:3961: finishing rollback tid 1 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:53.315 INFO:tasks.rados.rados.2.smithi057.stdout:3961: finishing rollback tid 2 to smithi05720651-5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:53.315 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3025 (ObjNum 1236 snap 437 seq_num 1236) dirty exists 2020-11-16T22:16:53.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:53 smithi016 bash[10302]: cluster 2020-11-16T22:16:51.886810+0000 mgr.x (mgr.24115) 727 : cluster [DBG] pgmap v1638: 17 pgs: 17 active+clean; 643 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 467 KiB/s wr, 15 op/s 2020-11-16T22:16:53.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:53 smithi016 bash[10302]: cluster 2020-11-16T22:16:52.306495+0000 mon.a (mon.0) 1670 : cluster [DBG] osdmap e982: 12 total, 12 up, 12 in 2020-11-16T22:16:53.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:53 smithi195 bash[10218]: cluster 2020-11-16T22:16:51.886810+0000 mgr.x (mgr.24115) 727 : cluster [DBG] pgmap v1638: 17 pgs: 17 active+clean; 643 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 467 KiB/s wr, 15 op/s 2020-11-16T22:16:53.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:53 smithi195 bash[10218]: cluster 2020-11-16T22:16:52.306495+0000 mon.a (mon.0) 1670 : cluster [DBG] osdmap e982: 12 total, 12 up, 12 in 2020-11-16T22:16:53.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:53 smithi057 bash[10301]: cluster 2020-11-16T22:16:51.886810+0000 mgr.x (mgr.24115) 727 : cluster [DBG] pgmap v1638: 17 pgs: 17 active+clean; 643 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 467 KiB/s wr, 15 op/s 2020-11-16T22:16:53.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:53 smithi057 bash[10301]: cluster 2020-11-16T22:16:52.306495+0000 mon.a (mon.0) 1670 : cluster [DBG] osdmap e982: 12 total, 12 up, 12 in 2020-11-16T22:16:54.316 INFO:tasks.rados.rados.2.smithi057.stdout:3961: done (1 left) 2020-11-16T22:16:54.316 INFO:tasks.rados.rados.2.smithi057.stdout:3962: done (0 left) 2020-11-16T22:16:54.317 INFO:tasks.rados.rados.2.smithi057.stdout:3963: snap_create 2020-11-16T22:16:54.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:54 smithi016 bash[10302]: cluster 2020-11-16T22:16:53.316759+0000 mon.a (mon.0) 1671 : cluster [DBG] osdmap e983: 12 total, 12 up, 12 in 2020-11-16T22:16:54.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:54 smithi195 bash[10218]: cluster 2020-11-16T22:16:53.316759+0000 mon.a (mon.0) 1671 : cluster [DBG] osdmap e983: 12 total, 12 up, 12 in 2020-11-16T22:16:54.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:54 smithi057 bash[10301]: cluster 2020-11-16T22:16:53.316759+0000 mon.a (mon.0) 1671 : cluster [DBG] osdmap e983: 12 total, 12 up, 12 in 2020-11-16T22:16:55.234 INFO:tasks.rados.rados.2.smithi057.stdout:3963: done (0 left) 2020-11-16T22:16:55.234 INFO:tasks.rados.rados.2.smithi057.stdout:3964: write oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 477 2020-11-16T22:16:55.234 INFO:tasks.rados.rados.2.smithi057.stdout:3964: seq_num 1331 ranges {770117=518194,1870239=499878} 2020-11-16T22:16:55.246 INFO:tasks.rados.rados.2.smithi057.stdout:3964: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 770117 to 1288311 tid 1 2020-11-16T22:16:55.253 INFO:tasks.rados.rados.2.smithi057.stdout:3964: writing smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1870239 to 2370117 tid 2 2020-11-16T22:16:55.253 INFO:tasks.rados.rados.2.smithi057.stdout:3965: delete oid 22 current snap is 477 2020-11-16T22:16:55.254 INFO:tasks.rados.rados.2.smithi057.stdout:3964: finishing write tid 1 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:55.259 INFO:tasks.rados.rados.2.smithi057.stdout:3964: finishing write tid 2 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:55.260 INFO:tasks.rados.rados.2.smithi057.stdout:3964: finishing write tid 4 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:55.260 INFO:tasks.rados.rados.2.smithi057.stdout:3964: finishing write tid 5 to smithi05720651-31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:55.261 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2434 (ObjNum 1331 snap 477 seq_num 1331) dirty exists 2020-11-16T22:16:55.261 INFO:tasks.rados.rados.2.smithi057.stdout:3964: left oid 31 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1331 snap 477 seq_num 1331) 2020-11-16T22:16:55.262 INFO:tasks.rados.rados.2.smithi057.stdout:3964: done (1 left) 2020-11-16T22:16:55.262 INFO:tasks.rados.rados.2.smithi057.stdout:3965: done (0 left) 2020-11-16T22:16:55.262 INFO:tasks.rados.rados.2.smithi057.stdout:3966: write (excl) oid 42 current snap is 477 2020-11-16T22:16:55.263 INFO:tasks.rados.rados.2.smithi057.stdout:3966: seq_num 1333 ranges {403731=668692,1587203=587797} 2020-11-16T22:16:55.272 INFO:tasks.rados.rados.2.smithi057.stdout:3966: writing smithi05720651-42 from 403731 to 1072423 tid 1 2020-11-16T22:16:55.280 INFO:tasks.rados.rados.2.smithi057.stdout:3966: writing smithi05720651-42 from 1587203 to 2175000 tid 2 2020-11-16T22:16:55.280 INFO:tasks.rados.rados.2.smithi057.stdout:3967: write (excl) oid 36 current snap is 477 2020-11-16T22:16:55.280 INFO:tasks.rados.rados.2.smithi057.stdout:3967: seq_num 1334 ranges {420538=743941,1929332=491206} 2020-11-16T22:16:55.286 INFO:tasks.rados.rados.2.smithi057.stdout:3967: writing smithi05720651-36 from 420538 to 1164479 tid 1 2020-11-16T22:16:55.294 INFO:tasks.rados.rados.2.smithi057.stdout:3967: writing smithi05720651-36 from 1929332 to 2420538 tid 2 2020-11-16T22:16:55.294 INFO:tasks.rados.rados.2.smithi057.stdout:3968: read oid 21 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:55.294 INFO:tasks.rados.rados.2.smithi057.stdout:3968: expect deleted 2020-11-16T22:16:55.294 INFO:tasks.rados.rados.2.smithi057.stdout:3969: read oid 24 snap -1 2020-11-16T22:16:55.295 INFO:tasks.rados.rados.2.smithi057.stdout:3969: expect (ObjNum 1282 snap 448 seq_num 1282) 2020-11-16T22:16:55.295 INFO:tasks.rados.rados.2.smithi057.stdout:3970: read oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:55.295 INFO:tasks.rados.rados.2.smithi057.stdout:3970: expect (ObjNum 1269 snap 448 seq_num 1269) 2020-11-16T22:16:55.295 INFO:tasks.rados.rados.2.smithi057.stdout:3971: delete oid 5 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 477 2020-11-16T22:16:55.295 INFO:tasks.rados.rados.2.smithi057.stdout:3966: finishing write tid 1 to smithi05720651-42 2020-11-16T22:16:55.295 INFO:tasks.rados.rados.2.smithi057.stdout:3966: finishing write tid 2 to smithi05720651-42 2020-11-16T22:16:55.295 INFO:tasks.rados.rados.2.smithi057.stdout:3966: finishing write tid 4 to smithi05720651-42 2020-11-16T22:16:55.296 INFO:tasks.rados.rados.2.smithi057.stdout:3966: finishing write tid 5 to smithi05720651-42 2020-11-16T22:16:55.296 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 42 v 2425 (ObjNum 1333 snap 477 seq_num 1333) dirty exists 2020-11-16T22:16:55.296 INFO:tasks.rados.rados.2.smithi057.stdout:3966: left oid 42 (ObjNum 1333 snap 477 seq_num 1333) 2020-11-16T22:16:55.296 INFO:tasks.rados.rados.2.smithi057.stdout:3967: finishing write tid 1 to smithi05720651-36 2020-11-16T22:16:55.301 INFO:tasks.rados.rados.2.smithi057.stdout:3967: finishing write tid 2 to smithi05720651-36 2020-11-16T22:16:55.305 INFO:tasks.rados.rados.2.smithi057.stdout:3966: done (5 left) 2020-11-16T22:16:55.305 INFO:tasks.rados.rados.2.smithi057.stdout:3968: done (4 left) 2020-11-16T22:16:55.305 INFO:tasks.rados.rados.2.smithi057.stdout:3971: done (3 left) 2020-11-16T22:16:55.306 INFO:tasks.rados.rados.2.smithi057.stdout:3972: copy_from oid 40 from oid 50 current snap is 477 2020-11-16T22:16:55.306 INFO:tasks.rados.rados.2.smithi057.stdout:3967: finishing write tid 4 to smithi05720651-36 2020-11-16T22:16:55.306 INFO:tasks.rados.rados.2.smithi057.stdout:3973: write (excl) oid 26 current snap is 477 2020-11-16T22:16:55.306 INFO:tasks.rados.rados.2.smithi057.stdout:3973: seq_num 1336 ranges {454152=494439,1646296=735124} 2020-11-16T22:16:55.312 INFO:tasks.rados.rados.2.smithi057.stdout:3973: writing smithi05720651-26 from 454152 to 948591 tid 1 2020-11-16T22:16:55.321 INFO:tasks.rados.rados.2.smithi057.stdout:3973: writing smithi05720651-26 from 1646296 to 2381420 tid 2 2020-11-16T22:16:55.321 INFO:tasks.rados.rados.2.smithi057.stdout:3974: read oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:55.321 INFO:tasks.rados.rados.2.smithi057.stdout:3974: expect (ObjNum 1249 snap 438 seq_num 1249) 2020-11-16T22:16:55.322 INFO:tasks.rados.rados.2.smithi057.stdout:3975: write (excl) oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 477 2020-11-16T22:16:55.322 INFO:tasks.rados.rados.2.smithi057.stdout:3975: seq_num 1337 ranges {470959=569688,1704778=595135} 2020-11-16T22:16:55.327 INFO:tasks.rados.rados.2.smithi057.stdout:3975: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 470959 to 1040647 tid 1 2020-11-16T22:16:55.334 INFO:tasks.rados.rados.2.smithi057.stdout:3975: writing smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1704778 to 2299913 tid 2 2020-11-16T22:16:55.334 INFO:tasks.rados.rados.2.smithi057.stdout:3976: snap_create 2020-11-16T22:16:55.335 INFO:tasks.rados.rados.2.smithi057.stdout:3969: expect (ObjNum 1282 snap 448 seq_num 1282) 2020-11-16T22:16:55.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:55 smithi016 bash[10302]: cluster 2020-11-16T22:16:53.887421+0000 mgr.x (mgr.24115) 728 : cluster [DBG] pgmap v1641: 17 pgs: 17 active+clean; 643 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 467 KiB/s wr, 13 op/s 2020-11-16T22:16:55.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:55 smithi016 bash[10302]: cluster 2020-11-16T22:16:54.327174+0000 mon.a (mon.0) 1672 : cluster [DBG] osdmap e984: 12 total, 12 up, 12 in 2020-11-16T22:16:55.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:55 smithi016 bash[10302]: cluster 2020-11-16T22:16:55.244618+0000 mon.a (mon.0) 1673 : cluster [DBG] osdmap e985: 12 total, 12 up, 12 in 2020-11-16T22:16:55.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:55 smithi195 bash[10218]: cluster 2020-11-16T22:16:53.887421+0000 mgr.x (mgr.24115) 728 : cluster [DBG] pgmap v1641: 17 pgs: 17 active+clean; 643 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 467 KiB/s wr, 13 op/s 2020-11-16T22:16:55.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:55 smithi195 bash[10218]: cluster 2020-11-16T22:16:54.327174+0000 mon.a (mon.0) 1672 : cluster [DBG] osdmap e984: 12 total, 12 up, 12 in 2020-11-16T22:16:55.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:55 smithi195 bash[10218]: cluster 2020-11-16T22:16:55.244618+0000 mon.a (mon.0) 1673 : cluster [DBG] osdmap e985: 12 total, 12 up, 12 in 2020-11-16T22:16:55.606 INFO:tasks.rados.rados.2.smithi057.stdout:3967: finishing write tid 5 to smithi05720651-36 2020-11-16T22:16:55.607 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 36 v 3304 (ObjNum 1334 snap 477 seq_num 1334) dirty exists 2020-11-16T22:16:55.607 INFO:tasks.rados.rados.2.smithi057.stdout:3967: left oid 36 (ObjNum 1334 snap 477 seq_num 1334) 2020-11-16T22:16:55.607 INFO:tasks.rados.rados.2.smithi057.stdout:3972: finishing copy_from to smithi05720651-40 2020-11-16T22:16:55.607 INFO:tasks.rados.rados.2.smithi057.stdout:3972: got expected ENOENT (src dne) 2020-11-16T22:16:55.607 INFO:tasks.rados.rados.2.smithi057.stdout:3972: finishing copy_from racing read to smithi05720651-40 2020-11-16T22:16:55.607 INFO:tasks.rados.rados.2.smithi057.stdout:3970: expect (ObjNum 1269 snap 448 seq_num 1269) 2020-11-16T22:16:55.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:55 smithi057 bash[10301]: cluster 2020-11-16T22:16:53.887421+0000 mgr.x (mgr.24115) 728 : cluster [DBG] pgmap v1641: 17 pgs: 17 active+clean; 643 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 467 KiB/s wr, 13 op/s 2020-11-16T22:16:55.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:55 smithi057 bash[10301]: cluster 2020-11-16T22:16:54.327174+0000 mon.a (mon.0) 1672 : cluster [DBG] osdmap e984: 12 total, 12 up, 12 in 2020-11-16T22:16:55.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:55 smithi057 bash[10301]: cluster 2020-11-16T22:16:55.244618+0000 mon.a (mon.0) 1673 : cluster [DBG] osdmap e985: 12 total, 12 up, 12 in 2020-11-16T22:16:55.746 INFO:tasks.rados.rados.2.smithi057.stdout:3973: finishing write tid 1 to smithi05720651-26 2020-11-16T22:16:55.746 INFO:tasks.rados.rados.2.smithi057.stdout:3974: expect (ObjNum 1249 snap 438 seq_num 1249) 2020-11-16T22:16:55.833 INFO:tasks.rados.rados.2.smithi057.stdout:3973: finishing write tid 2 to smithi05720651-26 2020-11-16T22:16:55.833 INFO:tasks.rados.rados.2.smithi057.stdout:3973: finishing write tid 4 to smithi05720651-26 2020-11-16T22:16:55.834 INFO:tasks.rados.rados.2.smithi057.stdout:3973: finishing write tid 5 to smithi05720651-26 2020-11-16T22:16:55.834 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 26 v 3399 (ObjNum 1336 snap 477 seq_num 1336) dirty exists 2020-11-16T22:16:55.834 INFO:tasks.rados.rados.2.smithi057.stdout:3973: left oid 26 (ObjNum 1336 snap 477 seq_num 1336) 2020-11-16T22:16:55.834 INFO:tasks.rados.rados.2.smithi057.stdout:3975: finishing write tid 1 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:55.834 INFO:tasks.rados.rados.2.smithi057.stdout:3975: finishing write tid 2 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:55.834 INFO:tasks.rados.rados.2.smithi057.stdout:3975: finishing write tid 4 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:55.835 INFO:tasks.rados.rados.2.smithi057.stdout:3975: finishing write tid 5 to smithi05720651-15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:55.835 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3029 (ObjNum 1337 snap 477 seq_num 1337) dirty exists 2020-11-16T22:16:55.835 INFO:tasks.rados.rados.2.smithi057.stdout:3975: left oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1337 snap 477 seq_num 1337) 2020-11-16T22:16:56.327 INFO:tasks.rados.rados.2.smithi057.stdout:3967: done (7 left) 2020-11-16T22:16:56.328 INFO:tasks.rados.rados.2.smithi057.stdout:3969: done (6 left) 2020-11-16T22:16:56.328 INFO:tasks.rados.rados.2.smithi057.stdout:3970: done (5 left) 2020-11-16T22:16:56.328 INFO:tasks.rados.rados.2.smithi057.stdout:3972: done (4 left) 2020-11-16T22:16:56.328 INFO:tasks.rados.rados.2.smithi057.stdout:3973: done (3 left) 2020-11-16T22:16:56.329 INFO:tasks.rados.rados.2.smithi057.stdout:3974: done (2 left) 2020-11-16T22:16:56.329 INFO:tasks.rados.rados.2.smithi057.stdout:3975: done (1 left) 2020-11-16T22:16:56.329 INFO:tasks.rados.rados.2.smithi057.stdout:3976: done (0 left) 2020-11-16T22:16:56.329 INFO:tasks.rados.rados.2.smithi057.stdout:3977: copy_from oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from oid 35 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 478 2020-11-16T22:16:56.329 INFO:tasks.rados.rados.2.smithi057.stdout:3978: write oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 478 2020-11-16T22:16:56.329 INFO:tasks.rados.rados.2.smithi057.stdout:3978: seq_num 1338 ranges {487766=644937,1646907=738793} 2020-11-16T22:16:56.339 INFO:tasks.rados.rados.2.smithi057.stdout:3978: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 487766 to 1132703 tid 1 2020-11-16T22:16:56.347 INFO:tasks.rados.rados.2.smithi057.stdout:3978: writing smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1646907 to 2385700 tid 2 2020-11-16T22:16:56.347 INFO:tasks.rados.rados.2.smithi057.stdout:3979: write oid 8 current snap is 478 2020-11-16T22:16:56.347 INFO:tasks.rados.rados.2.smithi057.stdout:3979: seq_num 1339 ranges {504573=436539,1421742=598804,2437505=67068} 2020-11-16T22:16:56.352 INFO:tasks.rados.rados.2.smithi057.stdout:3979: writing smithi05720651-8 from 504573 to 941112 tid 1 2020-11-16T22:16:56.358 INFO:tasks.rados.rados.2.smithi057.stdout:3979: writing smithi05720651-8 from 1421742 to 2020546 tid 2 2020-11-16T22:16:56.362 INFO:tasks.rados.rados.2.smithi057.stdout:3979: writing smithi05720651-8 from 2437505 to 2504573 tid 3 2020-11-16T22:16:56.362 INFO:tasks.rados.rados.2.smithi057.stdout:3980: read oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:56.362 INFO:tasks.rados.rados.2.smithi057.stdout:3980: expect deleted 2020-11-16T22:16:56.362 INFO:tasks.rados.rados.2.smithi057.stdout:3981: copy_from oid 2 from oid 10 current snap is 478 2020-11-16T22:16:56.362 INFO:tasks.rados.rados.2.smithi057.stdout:3978: finishing write tid 1 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:56.362 INFO:tasks.rados.rados.2.smithi057.stdout:3978: finishing write tid 2 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:56.363 INFO:tasks.rados.rados.2.smithi057.stdout:3982: delete oid 20 current snap is 478 2020-11-16T22:16:56.363 INFO:tasks.rados.rados.2.smithi057.stdout:3978: finishing write tid 4 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:56.363 INFO:tasks.rados.rados.2.smithi057.stdout:3978: finishing write tid 5 to smithi05720651-33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:56.363 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2542 (ObjNum 1338 snap 478 seq_num 1338) dirty exists 2020-11-16T22:16:56.363 INFO:tasks.rados.rados.2.smithi057.stdout:3978: left oid 33 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1338 snap 478 seq_num 1338) 2020-11-16T22:16:56.363 INFO:tasks.rados.rados.2.smithi057.stdout:3977: finishing copy_from to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:56.363 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2791 (ObjNum 1269 snap 448 seq_num 1269) dirty exists 2020-11-16T22:16:56.364 INFO:tasks.rados.rados.2.smithi057.stdout:3977: finishing copy_from racing read to smithi05720651-49 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:56.364 INFO:tasks.rados.rados.2.smithi057.stdout:3979: finishing write tid 1 to smithi05720651-8 2020-11-16T22:16:56.368 INFO:tasks.rados.rados.2.smithi057.stdout:3979: finishing write tid 2 to smithi05720651-8 2020-11-16T22:16:56.368 INFO:tasks.rados.rados.2.smithi057.stdout:3979: finishing write tid 3 to smithi05720651-8 2020-11-16T22:16:56.368 INFO:tasks.rados.rados.2.smithi057.stdout:3977: done (5 left) 2020-11-16T22:16:56.368 INFO:tasks.rados.rados.2.smithi057.stdout:3978: done (4 left) 2020-11-16T22:16:56.368 INFO:tasks.rados.rados.2.smithi057.stdout:3980: done (3 left) 2020-11-16T22:16:56.368 INFO:tasks.rados.rados.2.smithi057.stdout:3982: done (2 left) 2020-11-16T22:16:56.369 INFO:tasks.rados.rados.2.smithi057.stdout:3983: read oid 43 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap -1 2020-11-16T22:16:56.369 INFO:tasks.rados.rados.2.smithi057.stdout:3983: expect (ObjNum 1317 snap 468 seq_num 1317) 2020-11-16T22:16:56.369 INFO:tasks.rados.rados.2.smithi057.stdout:3984: write oid 22 current snap is 478 2020-11-16T22:16:56.369 INFO:tasks.rados.rados.2.smithi057.stdout:3984: seq_num 1341 ranges {538187=587037,1538706=602473} 2020-11-16T22:16:56.374 INFO:tasks.rados.rados.2.smithi057.stdout:3984: writing smithi05720651-22 from 538187 to 1125224 tid 1 2020-11-16T22:16:56.381 INFO:tasks.rados.rados.2.smithi057.stdout:3984: writing smithi05720651-22 from 1538706 to 2141179 tid 2 2020-11-16T22:16:56.382 INFO:tasks.rados.rados.2.smithi057.stdout:3985: rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 478 2020-11-16T22:16:56.382 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 441 2020-11-16T22:16:56.382 INFO:tasks.rados.rados.2.smithi057.stdout:3979: finishing write tid 5 to smithi05720651-8 2020-11-16T22:16:56.382 INFO:tasks.rados.rados.2.smithi057.stdout:3979: finishing write tid 6 to smithi05720651-8 2020-11-16T22:16:56.382 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 8 v 2893 (ObjNum 1339 snap 478 seq_num 1339) dirty exists 2020-11-16T22:16:56.383 INFO:tasks.rados.rados.2.smithi057.stdout:3979: left oid 8 (ObjNum 1339 snap 478 seq_num 1339) 2020-11-16T22:16:56.383 INFO:tasks.rados.rados.2.smithi057.stdout:3984: finishing write tid 1 to smithi05720651-22 2020-11-16T22:16:56.383 INFO:tasks.rados.rados.2.smithi057.stdout:3983: expect (ObjNum 1317 snap 468 seq_num 1317) 2020-11-16T22:16:56.452 INFO:tasks.rados.rados.2.smithi057.stdout:3981: finishing copy_from to smithi05720651-2 2020-11-16T22:16:56.453 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 2 v 2571 (ObjNum 1028 snap 361 seq_num 1028) dirty exists 2020-11-16T22:16:56.453 INFO:tasks.rados.rados.2.smithi057.stdout:3981: finishing copy_from racing read to smithi05720651-2 2020-11-16T22:16:56.453 INFO:tasks.rados.rados.2.smithi057.stdout:3985: finishing rollback tid 0 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:56.453 INFO:tasks.rados.rados.2.smithi057.stdout:3984: finishing write tid 2 to smithi05720651-22 2020-11-16T22:16:56.453 INFO:tasks.rados.rados.2.smithi057.stdout:3984: finishing write tid 4 to smithi05720651-22 2020-11-16T22:16:56.453 INFO:tasks.rados.rados.2.smithi057.stdout:3984: finishing write tid 5 to smithi05720651-22 2020-11-16T22:16:56.453 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 22 v 3017 (ObjNum 1341 snap 478 seq_num 1341) dirty exists 2020-11-16T22:16:56.454 INFO:tasks.rados.rados.2.smithi057.stdout:3984: left oid 22 (ObjNum 1341 snap 478 seq_num 1341) 2020-11-16T22:16:56.454 INFO:tasks.rados.rados.2.smithi057.stdout:3985: finishing rollback tid 1 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:56.454 INFO:tasks.rados.rados.2.smithi057.stdout:3979: done (4 left) 2020-11-16T22:16:56.454 INFO:tasks.rados.rados.2.smithi057.stdout:3981: done (3 left) 2020-11-16T22:16:56.454 INFO:tasks.rados.rados.2.smithi057.stdout:3983: done (2 left) 2020-11-16T22:16:56.454 INFO:tasks.rados.rados.2.smithi057.stdout:3984: done (1 left) 2020-11-16T22:16:56.454 INFO:tasks.rados.rados.2.smithi057.stdout:3986: write (excl) oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 478 2020-11-16T22:16:56.455 INFO:tasks.rados.rados.2.smithi057.stdout:3986: seq_num 1342 ranges {554994=662286,1997188=557806} 2020-11-16T22:16:56.463 INFO:tasks.rados.rados.2.smithi057.stdout:3986: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 554994 to 1217280 tid 1 2020-11-16T22:16:56.472 INFO:tasks.rados.rados.2.smithi057.stdout:3986: writing smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1997188 to 2554994 tid 2 2020-11-16T22:16:56.472 INFO:tasks.rados.rados.2.smithi057.stdout:3987: write (excl) oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 478 2020-11-16T22:16:56.472 INFO:tasks.rados.rados.2.smithi057.stdout:3987: seq_num 1343 ranges {571801=737535,1939317=489789} 2020-11-16T22:16:56.479 INFO:tasks.rados.rados.2.smithi057.stdout:3987: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 571801 to 1309336 tid 1 2020-11-16T22:16:56.486 INFO:tasks.rados.rados.2.smithi057.stdout:3987: writing smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1939317 to 2429106 tid 2 2020-11-16T22:16:56.486 INFO:tasks.rados.rados.2.smithi057.stdout:3988: snap_create 2020-11-16T22:16:56.486 INFO:tasks.rados.rados.2.smithi057.stdout:3985: finishing rollback tid 2 to smithi05720651-45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:56.487 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 45 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2619 (ObjNum 1179 snap 407 seq_num 1179) dirty exists 2020-11-16T22:16:56.487 INFO:tasks.rados.rados.2.smithi057.stdout:3986: finishing write tid 1 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:56.487 INFO:tasks.rados.rados.2.smithi057.stdout:3986: finishing write tid 2 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:56.487 INFO:tasks.rados.rados.2.smithi057.stdout:3986: finishing write tid 4 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:56.487 INFO:tasks.rados.rados.2.smithi057.stdout:3986: finishing write tid 5 to smithi05720651-3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:56.487 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2896 (ObjNum 1342 snap 478 seq_num 1342) dirty exists 2020-11-16T22:16:56.487 INFO:tasks.rados.rados.2.smithi057.stdout:3986: left oid 3 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1342 snap 478 seq_num 1342) 2020-11-16T22:16:56.488 INFO:tasks.rados.rados.2.smithi057.stdout:3987: finishing write tid 1 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:56.493 INFO:tasks.rados.rados.2.smithi057.stdout:3987: finishing write tid 2 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:56.493 INFO:tasks.rados.rados.2.smithi057.stdout:3987: finishing write tid 4 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:56.494 INFO:tasks.rados.rados.2.smithi057.stdout:3987: finishing write tid 5 to smithi05720651-41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:56.494 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3032 (ObjNum 1343 snap 478 seq_num 1343) dirty exists 2020-11-16T22:16:56.494 INFO:tasks.rados.rados.2.smithi057.stdout:3987: left oid 41 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1343 snap 478 seq_num 1343) 2020-11-16T22:16:57.339 INFO:tasks.rados.rados.2.smithi057.stdout:3985: done (3 left) 2020-11-16T22:16:57.339 INFO:tasks.rados.rados.2.smithi057.stdout:3986: done (2 left) 2020-11-16T22:16:57.339 INFO:tasks.rados.rados.2.smithi057.stdout:3987: done (1 left) 2020-11-16T22:16:57.340 INFO:tasks.rados.rados.2.smithi057.stdout:3988: done (0 left) 2020-11-16T22:16:57.340 INFO:tasks.rados.rados.2.smithi057.stdout:3989: rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 479 2020-11-16T22:16:57.340 INFO:tasks.rados.rados.2.smithi057.stdout:rollback oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo to 400 2020-11-16T22:16:57.340 INFO:tasks.rados.rados.2.smithi057.stdout:3990: read oid 32 snap -1 2020-11-16T22:16:57.340 INFO:tasks.rados.rados.2.smithi057.stdout:3990: expect (ObjNum 1327 snap 472 seq_num 1327) 2020-11-16T22:16:57.340 INFO:tasks.rados.rados.2.smithi057.stdout:3991: write oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 479 2020-11-16T22:16:57.340 INFO:tasks.rados.rados.2.smithi057.stdout:3991: seq_num 1344 ranges {588608=412784,1597799=749800} 2020-11-16T22:16:57.349 INFO:tasks.rados.rados.2.smithi057.stdout:3991: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 588608 to 1001392 tid 1 2020-11-16T22:16:57.358 INFO:tasks.rados.rados.2.smithi057.stdout:3991: writing smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo from 1597799 to 2347599 tid 2 2020-11-16T22:16:57.359 INFO:tasks.rados.rados.2.smithi057.stdout:3992: write (excl) oid 18 current snap is 479 2020-11-16T22:16:57.359 INFO:tasks.rados.rados.2.smithi057.stdout:3992: seq_num 1345 ranges {605415=488033,1656281=493458} 2020-11-16T22:16:57.365 INFO:tasks.rados.rados.2.smithi057.stdout:3992: writing smithi05720651-18 from 605415 to 1093448 tid 1 2020-11-16T22:16:57.371 INFO:tasks.rados.rados.2.smithi057.stdout:3992: writing smithi05720651-18 from 1656281 to 2149739 tid 2 2020-11-16T22:16:57.371 INFO:tasks.rados.rados.2.smithi057.stdout:3993: snap_remove snap 464 2020-11-16T22:16:57.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:57 smithi016 bash[10302]: cluster 2020-11-16T22:16:55.888143+0000 mgr.x (mgr.24115) 729 : cluster [DBG] pgmap v1644: 17 pgs: 17 active+clean; 653 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2020-11-16T22:16:57.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:57 smithi016 bash[10302]: cluster 2020-11-16T22:16:56.338646+0000 mon.a (mon.0) 1674 : cluster [DBG] osdmap e986: 12 total, 12 up, 12 in 2020-11-16T22:16:57.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:57 smithi195 bash[10218]: cluster 2020-11-16T22:16:55.888143+0000 mgr.x (mgr.24115) 729 : cluster [DBG] pgmap v1644: 17 pgs: 17 active+clean; 653 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2020-11-16T22:16:57.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:57 smithi195 bash[10218]: cluster 2020-11-16T22:16:56.338646+0000 mon.a (mon.0) 1674 : cluster [DBG] osdmap e986: 12 total, 12 up, 12 in 2020-11-16T22:16:57.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:57 smithi057 bash[10301]: cluster 2020-11-16T22:16:55.888143+0000 mgr.x (mgr.24115) 729 : cluster [DBG] pgmap v1644: 17 pgs: 17 active+clean; 653 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 1.7 MiB/s wr, 14 op/s 2020-11-16T22:16:57.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:57 smithi057 bash[10301]: cluster 2020-11-16T22:16:56.338646+0000 mon.a (mon.0) 1674 : cluster [DBG] osdmap e986: 12 total, 12 up, 12 in 2020-11-16T22:16:58.353 INFO:tasks.rados.rados.2.smithi057.stdout:3993: done (4 left) 2020-11-16T22:16:58.353 INFO:tasks.rados.rados.2.smithi057.stdout:3994: snap_create 2020-11-16T22:16:58.354 INFO:tasks.rados.rados.2.smithi057.stdout:3989: finishing rollback tid 1 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:58.354 INFO:tasks.rados.rados.2.smithi057.stdout:3989: finishing rollback tid 2 to smithi05720651-17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:58.354 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 17 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 2426 (ObjNum 1140 snap 396 seq_num 1140) dirty exists 2020-11-16T22:16:58.354 INFO:tasks.rados.rados.2.smithi057.stdout:3990: expect (ObjNum 1327 snap 472 seq_num 1327) 2020-11-16T22:16:58.432 INFO:tasks.rados.rados.2.smithi057.stdout:3991: finishing write tid 1 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:58.432 INFO:tasks.rados.rados.2.smithi057.stdout:3991: finishing write tid 2 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:58.433 INFO:tasks.rados.rados.2.smithi057.stdout:3991: finishing write tid 4 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:58.433 INFO:tasks.rados.rados.2.smithi057.stdout:3991: finishing write tid 5 to smithi05720651-7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 2020-11-16T22:16:58.433 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo v 3405 (ObjNum 1344 snap 479 seq_num 1344) dirty exists 2020-11-16T22:16:58.433 INFO:tasks.rados.rados.2.smithi057.stdout:3991: left oid 7 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo (ObjNum 1344 snap 479 seq_num 1344) 2020-11-16T22:16:58.433 INFO:tasks.rados.rados.2.smithi057.stdout:3992: finishing write tid 1 to smithi05720651-18 2020-11-16T22:16:58.433 INFO:tasks.rados.rados.2.smithi057.stdout:3992: finishing write tid 2 to smithi05720651-18 2020-11-16T22:16:58.434 INFO:tasks.rados.rados.2.smithi057.stdout:3992: finishing write tid 4 to smithi05720651-18 2020-11-16T22:16:58.434 INFO:tasks.rados.rados.2.smithi057.stdout:3992: finishing write tid 5 to smithi05720651-18 2020-11-16T22:16:58.434 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 18 v 2733 (ObjNum 1345 snap 479 seq_num 1345) dirty exists 2020-11-16T22:16:58.434 INFO:tasks.rados.rados.2.smithi057.stdout:3992: left oid 18 (ObjNum 1345 snap 479 seq_num 1345) 2020-11-16T22:16:58.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:58 smithi195 bash[10218]: cluster 2020-11-16T22:16:57.349817+0000 mon.a (mon.0) 1675 : cluster [DBG] osdmap e987: 12 total, 12 up, 12 in 2020-11-16T22:16:58.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:58 smithi057 bash[10301]: cluster 2020-11-16T22:16:57.349817+0000 mon.a (mon.0) 1675 : cluster [DBG] osdmap e987: 12 total, 12 up, 12 in 2020-11-16T22:16:58.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:58 smithi016 bash[10302]: cluster 2020-11-16T22:16:57.349817+0000 mon.a (mon.0) 1675 : cluster [DBG] osdmap e987: 12 total, 12 up, 12 in 2020-11-16T22:16:59.362 INFO:tasks.rados.rados.2.smithi057.stdout:3989: done (4 left) 2020-11-16T22:16:59.363 INFO:tasks.rados.rados.2.smithi057.stdout:3990: done (3 left) 2020-11-16T22:16:59.363 INFO:tasks.rados.rados.2.smithi057.stdout:3991: done (2 left) 2020-11-16T22:16:59.363 INFO:tasks.rados.rados.2.smithi057.stdout:3992: done (1 left) 2020-11-16T22:16:59.363 INFO:tasks.rados.rados.2.smithi057.stdout:3994: done (0 left) 2020-11-16T22:16:59.363 INFO:tasks.rados.rados.2.smithi057.stdout:3995: copy_from oid 48 from oid 13 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 480 2020-11-16T22:16:59.364 INFO:tasks.rados.rados.2.smithi057.stdout:3996: copy_from oid 50 from oid 11 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo current snap is 480 2020-11-16T22:16:59.364 INFO:tasks.rados.rados.2.smithi057.stdout:3997: snap_create 2020-11-16T22:16:59.385 INFO:tasks.rados.rados.2.smithi057.stdout:3995: finishing copy_from to smithi05720651-48 2020-11-16T22:16:59.385 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 48 v 2989 (ObjNum 1318 snap 468 seq_num 1318) dirty exists 2020-11-16T22:16:59.386 INFO:tasks.rados.rados.2.smithi057.stdout:3995: finishing copy_from racing read to smithi05720651-48 2020-11-16T22:16:59.388 INFO:tasks.rados.rados.2.smithi057.stdout:3996: finishing copy_from to smithi05720651-50 2020-11-16T22:16:59.389 INFO:tasks.rados.rados.2.smithi057.stdout:update_object_version oid 50 v 2886 (ObjNum 1282 snap 448 seq_num 1282) dirty exists 2020-11-16T22:16:59.389 INFO:tasks.rados.rados.2.smithi057.stdout:3996: finishing copy_from racing read to smithi05720651-50 2020-11-16T22:16:59.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:59 smithi195 bash[10218]: cluster 2020-11-16T22:16:57.888847+0000 mgr.x (mgr.24115) 730 : cluster [DBG] pgmap v1647: 17 pgs: 17 active+clean; 663 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 3.1 MiB/s wr, 18 op/s 2020-11-16T22:16:59.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:16:59 smithi195 bash[10218]: cluster 2020-11-16T22:16:58.362168+0000 mon.a (mon.0) 1676 : cluster [DBG] osdmap e988: 12 total, 12 up, 12 in 2020-11-16T22:16:59.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:59 smithi057 bash[10301]: cluster 2020-11-16T22:16:57.888847+0000 mgr.x (mgr.24115) 730 : cluster [DBG] pgmap v1647: 17 pgs: 17 active+clean; 663 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 3.1 MiB/s wr, 18 op/s 2020-11-16T22:16:59.695 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:16:59 smithi057 bash[10301]: cluster 2020-11-16T22:16:58.362168+0000 mon.a (mon.0) 1676 : cluster [DBG] osdmap e988: 12 total, 12 up, 12 in 2020-11-16T22:16:59.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:59 smithi016 bash[10302]: cluster 2020-11-16T22:16:57.888847+0000 mgr.x (mgr.24115) 730 : cluster [DBG] pgmap v1647: 17 pgs: 17 active+clean; 663 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 3.1 MiB/s wr, 18 op/s 2020-11-16T22:16:59.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:16:59 smithi016 bash[10302]: cluster 2020-11-16T22:16:58.362168+0000 mon.a (mon.0) 1676 : cluster [DBG] osdmap e988: 12 total, 12 up, 12 in 2020-11-16T22:17:00.371 INFO:tasks.rados.rados.2.smithi057.stdout:3995: done (2 left) 2020-11-16T22:17:00.371 INFO:tasks.rados.rados.2.smithi057.stdout:3996: done (1 left) 2020-11-16T22:17:00.372 INFO:tasks.rados.rados.2.smithi057.stdout:3997: done (0 left) 2020-11-16T22:17:00.372 INFO:tasks.rados.rados.2.smithi057.stdout:3998: read oid 15 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo snap 436 2020-11-16T22:17:00.372 INFO:tasks.rados.rados.2.smithi057.stdout:3998: expect (ObjNum 1175 snap 407 seq_num 1175) 2020-11-16T22:17:00.372 INFO:tasks.rados.rados.2.smithi057.stdout:3999: read oid 14 snap -1 2020-11-16T22:17:00.372 INFO:tasks.rados.rados.2.smithi057.stdout:3999: expect (ObjNum 1305 snap 459 seq_num 1305) 2020-11-16T22:17:00.372 INFO:tasks.rados.rados.2.smithi057.stdout: waiting on 2 2020-11-16T22:17:00.390 INFO:tasks.rados.rados.2.smithi057.stdout:3998: expect (ObjNum 1175 snap 407 seq_num 1175) 2020-11-16T22:17:00.570 INFO:tasks.rados.rados.2.smithi057.stdout:3999: expect (ObjNum 1305 snap 459 seq_num 1305) 2020-11-16T22:17:00.690 INFO:tasks.rados.rados.2.smithi057.stdout:3998: done (1 left) 2020-11-16T22:17:00.690 INFO:tasks.rados.rados.2.smithi057.stdout:3999: done (0 left) 2020-11-16T22:17:00.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:17:00 smithi057 bash[10301]: cluster 2020-11-16T22:16:59.373158+0000 mon.a (mon.0) 1677 : cluster [DBG] osdmap e989: 12 total, 12 up, 12 in 2020-11-16T22:17:00.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:17:00 smithi057 bash[10301]: cluster 2020-11-16T22:16:59.889572+0000 mgr.x (mgr.24115) 731 : cluster [DBG] pgmap v1650: 17 pgs: 17 active+clean; 676 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 3.9 MiB/s wr, 17 op/s 2020-11-16T22:17:00.697 INFO:tasks.rados.rados.2.smithi057.stderr:0 errors. 2020-11-16T22:17:00.697 INFO:tasks.rados.rados.2.smithi057.stderr: 2020-11-16T22:17:00.700 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd dump --format=json 2020-11-16T22:17:00.713 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:17:00 smithi195 bash[10218]: cluster 2020-11-16T22:16:59.373158+0000 mon.a (mon.0) 1677 : cluster [DBG] osdmap e989: 12 total, 12 up, 12 in 2020-11-16T22:17:00.714 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:17:00 smithi195 bash[10218]: cluster 2020-11-16T22:16:59.889572+0000 mgr.x (mgr.24115) 731 : cluster [DBG] pgmap v1650: 17 pgs: 17 active+clean; 676 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 3.9 MiB/s wr, 17 op/s 2020-11-16T22:17:00.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:17:00 smithi016 bash[10302]: cluster 2020-11-16T22:16:59.373158+0000 mon.a (mon.0) 1677 : cluster [DBG] osdmap e989: 12 total, 12 up, 12 in 2020-11-16T22:17:00.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:17:00 smithi016 bash[10302]: cluster 2020-11-16T22:16:59.889572+0000 mgr.x (mgr.24115) 731 : cluster [DBG] pgmap v1650: 17 pgs: 17 active+clean; 676 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 3.9 MiB/s wr, 17 op/s 2020-11-16T22:17:00.842 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:17:01.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:17:01 smithi195 bash[10218]: cluster 2020-11-16T22:17:00.381894+0000 mon.a (mon.0) 1678 : cluster [DBG] osdmap e990: 12 total, 12 up, 12 in 2020-11-16T22:17:01.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:17:01 smithi057 bash[10301]: cluster 2020-11-16T22:17:00.381894+0000 mon.a (mon.0) 1678 : cluster [DBG] osdmap e990: 12 total, 12 up, 12 in 2020-11-16T22:17:01.718 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:17:01 smithi016 bash[10302]: cluster 2020-11-16T22:17:00.381894+0000 mon.a (mon.0) 1678 : cluster [DBG] osdmap e990: 12 total, 12 up, 12 in 2020-11-16T22:17:02.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:17:02 smithi195 bash[10218]: cluster 2020-11-16T22:17:01.890346+0000 mgr.x (mgr.24115) 732 : cluster [DBG] pgmap v1652: 17 pgs: 17 active+clean; 687 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.7 MiB/s wr, 21 op/s 2020-11-16T22:17:02.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:17:02 smithi057 bash[10301]: cluster 2020-11-16T22:17:01.890346+0000 mgr.x (mgr.24115) 732 : cluster [DBG] pgmap v1652: 17 pgs: 17 active+clean; 687 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.7 MiB/s wr, 21 op/s 2020-11-16T22:17:02.837 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:17:02 smithi016 bash[10302]: cluster 2020-11-16T22:17:01.890346+0000 mgr.x (mgr.24115) 732 : cluster [DBG] pgmap v1652: 17 pgs: 17 active+clean; 687 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 3.7 MiB/s wr, 21 op/s 2020-11-16T22:17:04.087 INFO:teuthology.orchestra.run.smithi195.stdout: 2020-11-16T22:17:04.088 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":990,"fsid":"bcd5108e-2855-11eb-a2b2-001a4aab830c","created":"2020-11-16T21:51:02.722809+0000","modified":"2020-11-16T22:17:00.369332+0000","last_up_change":"2020-11-16T21:59:26.574799+0000","last_in_change":"2020-11-16T21:59:26.574799+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-16T21:53:15.914744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"unique_pool_0","create_time":"2020-11-16T22:01:34.845906+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"990","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":912,"snap_epoch":990,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"e17765a8-0ee0-47d6-8c45-96b8e46dbd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6800","nonce":3519378370}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6801","nonce":3519378370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6803","nonce":3519378370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6802","nonce":3519378370}]},"public_addr":"172.21.15.195:6800/3519378370","cluster_addr":"172.21.15.195:6801/3519378370","heartbeat_back_addr":"172.21.15.195:6803/3519378370","heartbeat_front_addr":"172.21.15.195:6802/3519378370","state":["exists","up"]},{"osd":1,"uuid":"965e7b51-8fa3-49b5-b5b7-05a69f5e1fd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6804","nonce":2842524876}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6805","nonce":2842524876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6807","nonce":2842524876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6806","nonce":2842524876}]},"public_addr":"172.21.15.195:6804/2842524876","cluster_addr":"172.21.15.195:6805/2842524876","heartbeat_back_addr":"172.21.15.195:6807/2842524876","heartbeat_front_addr":"172.21.15.195:6806/2842524876","state":["exists","up"]},{"osd":2,"uuid":"25dcebff-95d0-47a0-8efb-c3b66ee68eb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6808","nonce":2181977746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6809","nonce":2181977746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6811","nonce":2181977746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6810","nonce":2181977746}]},"public_addr":"172.21.15.195:6808/2181977746","cluster_addr":"172.21.15.195:6809/2181977746","heartbeat_back_addr":"172.21.15.195:6811/2181977746","heartbeat_front_addr":"172.21.15.195:6810/2181977746","state":["exists","up"]},{"osd":3,"uuid":"8832539b-0ff5-4887-a8a1-005008fd830a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6812","nonce":825751928}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6813","nonce":825751928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6815","nonce":825751928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.195:6814","nonce":825751928}]},"public_addr":"172.21.15.195:6812/825751928","cluster_addr":"172.21.15.195:6813/825751928","heartbeat_back_addr":"172.21.15.195:6815/825751928","heartbeat_front_addr":"172.21.15.195:6814/825751928","state":["exists","up"]},{"osd":4,"uuid":"4bd595de-1740-4bdb-97b2-c346b366d299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6801","nonce":1979089250}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6802","nonce":1979089250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6804","nonce":1979089250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6803","nonce":1979089250}]},"public_addr":"172.21.15.16:6801/1979089250","cluster_addr":"172.21.15.16:6802/1979089250","heartbeat_back_addr":"172.21.15.16:6804/1979089250","heartbeat_front_addr":"172.21.15.16:6803/1979089250","state":["exists","up"]},{"osd":5,"uuid":"b114510c-b7e9-48b0-8056-0a0fd4299259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6805","nonce":4180994375}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6806","nonce":4180994375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6808","nonce":4180994375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6807","nonce":4180994375}]},"public_addr":"172.21.15.16:6805/4180994375","cluster_addr":"172.21.15.16:6806/4180994375","heartbeat_back_addr":"172.21.15.16:6808/4180994375","heartbeat_front_addr":"172.21.15.16:6807/4180994375","state":["exists","up"]},{"osd":6,"uuid":"a6fae614-5672-4ca8-bd91-5625e1525a60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6809","nonce":1747555876}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6810","nonce":1747555876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6812","nonce":1747555876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6811","nonce":1747555876}]},"public_addr":"172.21.15.16:6809/1747555876","cluster_addr":"172.21.15.16:6810/1747555876","heartbeat_back_addr":"172.21.15.16:6812/1747555876","heartbeat_front_addr":"172.21.15.16:6811/1747555876","state":["exists","up"]},{"osd":7,"uuid":"2329bb51-31d3-4e24-89eb-dd4269482cb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6813","nonce":4071463289}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6814","nonce":4071463289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6816","nonce":4071463289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.16:6815","nonce":4071463289}]},"public_addr":"172.21.15.16:6813/4071463289","cluster_addr":"172.21.15.16:6814/4071463289","heartbeat_back_addr":"172.21.15.16:6816/4071463289","heartbeat_front_addr":"172.21.15.16:6815/4071463289","state":["exists","up"]},{"osd":8,"uuid":"4eaa536f-253e-460d-a65d-221dd0924d00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":2452828964}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":2452828964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":2452828964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":2452828964}]},"public_addr":"172.21.15.57:6800/2452828964","cluster_addr":"172.21.15.57:6801/2452828964","heartbeat_back_addr":"172.21.15.57:6803/2452828964","heartbeat_front_addr":"172.21.15.57:6802/2452828964","state":["exists","up"]},{"osd":9,"uuid":"fcb83bc5-7834-4510-8fe9-40074b8dc739","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":1543210377}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":1543210377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":1543210377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":1543210377}]},"public_addr":"172.21.15.57:6804/1543210377","cluster_addr":"172.21.15.57:6805/1543210377","heartbeat_back_addr":"172.21.15.57:6807/1543210377","heartbeat_front_addr":"172.21.15.57:6806/1543210377","state":["exists","up"]},{"osd":10,"uuid":"f96ec9f0-97cf-4382-a66a-eddbe351df6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":12217522}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":12217522}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":12217522}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":12217522}]},"public_addr":"172.21.15.57:6808/12217522","cluster_addr":"172.21.15.57:6809/12217522","heartbeat_back_addr":"172.21.15.57:6811/12217522","heartbeat_front_addr":"172.21.15.57:6810/12217522","state":["exists","up"]},{"osd":11,"uuid":"ac30fc92-b414-4fe6-8ca4-f3f4bab38156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":3378371863}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":3378371863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":3378371863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":3378371863}]},"public_addr":"172.21.15.57:6812/3378371863","cluster_addr":"172.21.15.57:6813/3378371863","heartbeat_back_addr":"172.21.15.57:6815/3378371863","heartbeat_front_addr":"172.21.15.57:6814/3378371863","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:54:50.400290+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:55:13.927068+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:55:37.004032+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:56:03.418071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:56:27.665747+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:56:52.959802+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:57:17.918719+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:57:42.763793+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:58:07.409888+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:58:34.395975+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:58:59.712301+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-16T21:59:24.926548+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.195:6800/2315309247":"2020-11-17T21:54:29.414415+0000","172.21.15.195:0/3155915619":"2020-11-17T21:54:29.414415+0000","172.21.15.195:0/1371401498":"2020-11-17T21:54:29.414415+0000","172.21.15.195:6800/3473350336":"2020-11-17T21:51:47.874337+0000","172.21.15.195:0/2605686555":"2020-11-17T21:51:47.874337+0000","172.21.15.195:0/2944342344":"2020-11-17T21:51:47.874337+0000","172.21.15.195:0/3952937853":"2020-11-17T21:51:27.690720+0000","172.21.15.195:0/4048385390":"2020-11-17T21:51:27.690720+0000","172.21.15.195:6800/4059900539":"2020-11-17T21:51:27.690720+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":894,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-16T22:17:04.695 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph pg dump --format=json 2020-11-16T22:17:04.874 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:17:05.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:17:04 smithi195 bash[10218]: cluster 2020-11-16T22:17:03.891054+0000 mgr.x (mgr.24115) 733 : cluster [DBG] pgmap v1653: 17 pgs: 17 active+clean; 689 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 3.1 MiB/s wr, 16 op/s 2020-11-16T22:17:05.100 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:17:04 smithi195 bash[10218]: audit 2020-11-16T22:17:04.096281+0000 mon.a (mon.0) 1679 : audit [DBG] from='client.? v1:172.21.15.195:0/2721662397' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-11-16T22:17:05.194 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:17:04 smithi057 bash[10301]: cluster 2020-11-16T22:17:03.891054+0000 mgr.x (mgr.24115) 733 : cluster [DBG] pgmap v1653: 17 pgs: 17 active+clean; 689 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 3.1 MiB/s wr, 16 op/s 2020-11-16T22:17:05.194 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:17:04 smithi057 bash[10301]: audit 2020-11-16T22:17:04.096281+0000 mon.a (mon.0) 1679 : audit [DBG] from='client.? v1:172.21.15.195:0/2721662397' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-11-16T22:17:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:17:04 smithi016 bash[10302]: cluster 2020-11-16T22:17:03.891054+0000 mgr.x (mgr.24115) 733 : cluster [DBG] pgmap v1653: 17 pgs: 17 active+clean; 689 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 3.1 MiB/s wr, 16 op/s 2020-11-16T22:17:05.337 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:17:04 smithi016 bash[10302]: audit 2020-11-16T22:17:04.096281+0000 mon.a (mon.0) 1679 : audit [DBG] from='client.? v1:172.21.15.195:0/2721662397' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2020-11-16T22:17:06.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:17:06 smithi016 bash[10302]: cluster 2020-11-16T22:17:05.247589+0000 mon.a (mon.0) 1680 : cluster [DBG] osdmap e991: 12 total, 12 up, 12 in 2020-11-16T22:17:06.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:17:06 smithi195 bash[10218]: cluster 2020-11-16T22:17:05.247589+0000 mon.a (mon.0) 1680 : cluster [DBG] osdmap e991: 12 total, 12 up, 12 in 2020-11-16T22:17:06.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:17:06 smithi057 bash[10301]: cluster 2020-11-16T22:17:05.247589+0000 mon.a (mon.0) 1680 : cluster [DBG] osdmap e991: 12 total, 12 up, 12 in 2020-11-16T22:17:07.581 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:17:07 smithi195 bash[10218]: cluster 2020-11-16T22:17:05.891792+0000 mgr.x (mgr.24115) 734 : cluster [DBG] pgmap v1655: 17 pgs: 17 active+clean; 689 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.9 MiB/s wr, 15 op/s 2020-11-16T22:17:07.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:17:07 smithi016 bash[10302]: cluster 2020-11-16T22:17:05.891792+0000 mgr.x (mgr.24115) 734 : cluster [DBG] pgmap v1655: 17 pgs: 17 active+clean; 689 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.9 MiB/s wr, 15 op/s 2020-11-16T22:17:07.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:17:07 smithi057 bash[10301]: cluster 2020-11-16T22:17:05.891792+0000 mgr.x (mgr.24115) 734 : cluster [DBG] pgmap v1655: 17 pgs: 17 active+clean; 689 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.9 MiB/s wr, 15 op/s 2020-11-16T22:17:07.937 INFO:teuthology.orchestra.run.smithi195.stdout: 2020-11-16T22:17:07.941 INFO:teuthology.orchestra.run.smithi195.stderr:dumped all 2020-11-16T22:17:08.581 INFO:teuthology.orchestra.run.smithi195.stdout:{"pg_ready":true,"pg_map":{"version":1656,"stamp":"2020-11-16T22:17:07.892127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":722283224,"num_objects":317,"num_object_clones":267,"num_object_copies":634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":6,"num_read":7532,"num_read_kb":7790318,"num_write":5423,"num_write_kb":2088340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20165,"ondisk_log_size":20165,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":1476616,"kb_used_data":1078632,"kb_used_omap":0,"kb_used_meta":397888,"kb_avail":1123465208,"statfs":{"total":1151940427776,"available":1150428372992,"internally_reserved":0,"allocated":1104519168,"data_stored":1552057122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":407437312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13853503,"num_objects":2,"num_object_clones":2,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":-4,"num_read":38,"num_read_kb":33614,"num_write":15,"num_write_kb":8862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002937"},"pg_stats":[{"pgid":"2.f","version":"988'366","reported_seq":"3204","reported_epoch":"989","state":"active+clean","last_fresh":"2020-11-16T22:16:59.498151+0000","last_change":"2020-11-16T22:16:58.376056+0000","last_active":"2020-11-16T22:16:59.498151+0000","last_peered":"2020-11-16T22:16:59.498151+0000","last_clean":"2020-11-16T22:16:59.498151+0000","last_became_active":"2020-11-16T22:01:35.916463+0000","last_became_peered":"2020-11-16T22:01:35.916463+0000","last_unstale":"2020-11-16T22:16:59.498151+0000","last_undegraded":"2020-11-16T22:16:59.498151+0000","last_fullsized":"2020-11-16T22:16:59.498151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_clean_scrub_stamp":"2020-11-16T22:01:34.896129+0000","log_size":366,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18709046,"num_objects":8,"num_object_clones":7,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":94,"num_read_kb":89270,"num_write":113,"num_write_kb":37392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"37e","length":"1"}]},{"pgid":"2.4","version":"988'919","reported_seq":"3714","reported_epoch":"991","state":"active+clean","last_fresh":"2020-11-16T22:17:05.262366+0000","last_change":"2020-11-16T22:16:58.371107+0000","last_active":"2020-11-16T22:17:05.262366+0000","last_peered":"2020-11-16T22:17:05.262366+0000","last_clean":"2020-11-16T22:17:05.262366+0000","last_became_active":"2020-11-16T22:01:35.999185+0000","last_became_peered":"2020-11-16T22:01:35.999185+0000","last_unstale":"2020-11-16T22:17:05.262366+0000","last_undegraded":"2020-11-16T22:17:05.262366+0000","last_fullsized":"2020-11-16T22:17:05.262366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_clean_scrub_stamp":"2020-11-16T22:01:34.896129+0000","log_size":919,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29128339,"num_objects":11,"num_object_clones":9,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":261,"num_read_kb":253355,"num_write":252,"num_write_kb":108117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"2801","reported_epoch":"991","state":"active+clean","last_fresh":"2020-11-16T22:17:05.264443+0000","last_change":"2020-11-16T22:16:59.060979+0000","last_active":"2020-11-16T22:17:05.264443+0000","last_peered":"2020-11-16T22:17:05.264443+0000","last_clean":"2020-11-16T22:17:05.264443+0000","last_became_active":"2020-11-16T22:01:35.915746+0000","last_became_peered":"2020-11-16T22:01:35.915746+0000","last_unstale":"2020-11-16T22:17:05.264443+0000","last_undegraded":"2020-11-16T22:17:05.264443+0000","last_fullsized":"2020-11-16T22:17:05.264443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_clean_scrub_stamp":"2020-11-16T22:01:34.896129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"988'714","reported_seq":"3566","reported_epoch":"989","state":"active+clean","last_fresh":"2020-11-16T22:16:59.388986+0000","last_change":"2020-11-16T22:16:58.367829+0000","last_active":"2020-11-16T22:16:59.388986+0000","last_peered":"2020-11-16T22:16:59.388986+0000","last_clean":"2020-11-16T22:16:59.388986+0000","last_became_active":"2020-11-16T22:01:36.000393+0000","last_became_peered":"2020-11-16T22:01:36.000393+0000","last_unstale":"2020-11-16T22:16:59.388986+0000","last_undegraded":"2020-11-16T22:16:59.388986+0000","last_fullsized":"2020-11-16T22:16:59.388986+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_clean_scrub_stamp":"2020-11-16T22:01:34.896129+0000","log_size":714,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35223024,"num_objects":19,"num_object_clones":17,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":319,"num_read_kb":338406,"num_write":193,"num_write_kb":85167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"37e","length":"1"}]},{"pgid":"2.3","version":"989'3002","reported_seq":"5732","reported_epoch":"991","state":"active+clean","last_fresh":"2020-11-16T22:17:05.264448+0000","last_change":"2020-11-16T22:16:59.072399+0000","last_active":"2020-11-16T22:17:05.264448+0000","last_peered":"2020-11-16T22:17:05.264448+0000","last_clean":"2020-11-16T22:17:05.264448+0000","last_became_active":"2020-11-16T22:01:35.917104+0000","last_became_peered":"2020-11-16T22:01:35.917104+0000","last_unstale":"2020-11-16T22:17:05.264448+0000","last_undegraded":"2020-11-16T22:17:05.264448+0000","last_fullsized":"2020-11-16T22:17:05.264448+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_clean_scrub_stamp":"2020-11-16T22:01:34.896129+0000","log_size":3002,"ondisk_log_size":3002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110440291,"num_objects":47,"num_object_clones":40,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":1120,"num_read_kb":1158340,"num_write":779,"num_write_kb":284139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"962","reported_epoch":"990","state":"active+clean","last_fresh":"2020-11-16T22:17:00.388319+0000","last_change":"2020-11-16T21:59:27.603441+0000","last_active":"2020-11-16T22:17:00.388319+0000","last_peered":"2020-11-16T22:17:00.388319+0000","last_clean":"2020-11-16T22:17:00.388319+0000","last_became_active":"2020-11-16T21:59:27.603020+0000","last_became_peered":"2020-11-16T21:59:27.603020+0000","last_unstale":"2020-11-16T22:17:00.388319+0000","last_undegraded":"2020-11-16T22:17:00.388319+0000","last_fullsized":"2020-11-16T22:17:00.388319+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":5,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T21:53:16.485896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T21:53:16.485896+0000","last_clean_scrub_stamp":"2020-11-16T21:53:16.485896+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"2815","reported_epoch":"991","state":"active+clean","last_fresh":"2020-11-16T22:17:05.263723+0000","last_change":"2020-11-16T22:16:58.368675+0000","last_active":"2020-11-16T22:17:05.263723+0000","last_peered":"2020-11-16T22:17:05.263723+0000","last_clean":"2020-11-16T22:17:05.263723+0000","last_became_active":"2020-11-16T22:01:36.003266+0000","last_became_peered":"2020-11-16T22:01:36.003266+0000","last_unstale":"2020-11-16T22:17:05.263723+0000","last_undegraded":"2020-11-16T22:17:05.263723+0000","last_fullsized":"2020-11-16T22:17:05.263723+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_clean_scrub_stamp":"2020-11-16T22:01:34.896129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10],"acting":[7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"988'1981","reported_seq":"4724","reported_epoch":"989","state":"active+clean","last_fresh":"2020-11-16T22:16:59.497979+0000","last_change":"2020-11-16T22:16:58.387329+0000","last_active":"2020-11-16T22:16:59.497979+0000","last_peered":"2020-11-16T22:16:59.497979+0000","last_clean":"2020-11-16T22:16:59.497979+0000","last_became_active":"2020-11-16T22:01:36.000331+0000","last_became_peered":"2020-11-16T22:01:36.000331+0000","last_unstale":"2020-11-16T22:16:59.497979+0000","last_undegraded":"2020-11-16T22:16:59.497979+0000","last_fullsized":"2020-11-16T22:16:59.497979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_clean_scrub_stamp":"2020-11-16T22:01:34.896129+0000","log_size":1981,"ondisk_log_size":1981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70628722,"num_objects":32,"num_object_clones":27,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":1,"num_read":607,"num_read_kb":561439,"num_write":555,"num_write_kb":196966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"37e","length":"1"}]},{"pgid":"2.6","version":"988'784","reported_seq":"3600","reported_epoch":"991","state":"active+clean","last_fresh":"2020-11-16T22:17:05.262327+0000","last_change":"2020-11-16T22:16:58.367936+0000","last_active":"2020-11-16T22:17:05.262327+0000","last_peered":"2020-11-16T22:17:05.262327+0000","last_clean":"2020-11-16T22:17:05.262327+0000","last_became_active":"2020-11-16T22:01:35.912827+0000","last_became_peered":"2020-11-16T22:01:35.912827+0000","last_unstale":"2020-11-16T22:17:05.262327+0000","last_undegraded":"2020-11-16T22:17:05.262327+0000","last_fullsized":"2020-11-16T22:17:05.262327+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_clean_scrub_stamp":"2020-11-16T22:01:34.896129+0000","log_size":784,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28068442,"num_objects":12,"num_object_clones":10,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":307,"num_read_kb":317639,"num_write":211,"num_write_kb":93525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"988'1181","reported_seq":"4001","reported_epoch":"991","state":"active+clean","last_fresh":"2020-11-16T22:17:05.264135+0000","last_change":"2020-11-16T22:16:59.066532+0000","last_active":"2020-11-16T22:17:05.264135+0000","last_peered":"2020-11-16T22:17:05.264135+0000","last_clean":"2020-11-16T22:17:05.264135+0000","last_became_active":"2020-11-16T22:01:36.000437+0000","last_became_peered":"2020-11-16T22:01:36.000437+0000","last_unstale":"2020-11-16T22:17:05.264135+0000","last_undegraded":"2020-11-16T22:17:05.264135+0000","last_fullsized":"2020-11-16T22:17:05.264135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_clean_scrub_stamp":"2020-11-16T22:01:34.896129+0000","log_size":1181,"ondisk_log_size":1181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":39028379,"num_objects":14,"num_object_clones":11,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":1,"num_read":439,"num_read_kb":453224,"num_write":298,"num_write_kb":105198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.8","version":"988'2738","reported_seq":"5533","reported_epoch":"991","state":"active+clean","last_fresh":"2020-11-16T22:17:05.263333+0000","last_change":"2020-11-16T22:16:58.383097+0000","last_active":"2020-11-16T22:17:05.263333+0000","last_peered":"2020-11-16T22:17:05.263333+0000","last_clean":"2020-11-16T22:17:05.263333+0000","last_became_active":"2020-11-16T22:01:35.918709+0000","last_became_peered":"2020-11-16T22:01:35.918709+0000","last_unstale":"2020-11-16T22:17:05.263333+0000","last_undegraded":"2020-11-16T22:17:05.263333+0000","last_fullsized":"2020-11-16T22:17:05.263333+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_clean_scrub_stamp":"2020-11-16T22:01:34.896129+0000","log_size":2738,"ondisk_log_size":2738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93356397,"num_objects":47,"num_object_clones":40,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":1127,"num_read_kb":1300898,"num_write":746,"num_write_kb":276886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.9","version":"988'3413","reported_seq":"6113","reported_epoch":"991","state":"active+clean","last_fresh":"2020-11-16T22:17:05.263149+0000","last_change":"2020-11-16T22:16:58.375169+0000","last_active":"2020-11-16T22:17:05.263149+0000","last_peered":"2020-11-16T22:17:05.263149+0000","last_clean":"2020-11-16T22:17:05.263149+0000","last_became_active":"2020-11-16T22:01:35.917339+0000","last_became_peered":"2020-11-16T22:01:35.917339+0000","last_unstale":"2020-11-16T22:17:05.263149+0000","last_undegraded":"2020-11-16T22:17:05.263149+0000","last_fullsized":"2020-11-16T22:17:05.263149+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_clean_scrub_stamp":"2020-11-16T22:01:34.896129+0000","log_size":3413,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108818886,"num_objects":49,"num_object_clones":41,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":1271,"num_read_kb":1257056,"num_write":900,"num_write_kb":369929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"988'1144","reported_seq":"3968","reported_epoch":"991","state":"active+clean","last_fresh":"2020-11-16T22:17:05.268197+0000","last_change":"2020-11-16T22:16:58.386502+0000","last_active":"2020-11-16T22:17:05.268197+0000","last_peered":"2020-11-16T22:17:05.268197+0000","last_clean":"2020-11-16T22:17:05.268197+0000","last_became_active":"2020-11-16T22:01:36.000113+0000","last_became_peered":"2020-11-16T22:01:36.000113+0000","last_unstale":"2020-11-16T22:17:05.268197+0000","last_undegraded":"2020-11-16T22:17:05.268197+0000","last_fullsized":"2020-11-16T22:17:05.268197+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_clean_scrub_stamp":"2020-11-16T22:01:34.896129+0000","log_size":1144,"ondisk_log_size":1144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46103562,"num_objects":21,"num_object_clones":18,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":463,"num_read_kb":460043,"num_write":327,"num_write_kb":105777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.b","version":"988'1288","reported_seq":"4122","reported_epoch":"989","state":"active+clean","last_fresh":"2020-11-16T22:16:59.498073+0000","last_change":"2020-11-16T22:16:58.385865+0000","last_active":"2020-11-16T22:16:59.498073+0000","last_peered":"2020-11-16T22:16:59.498073+0000","last_clean":"2020-11-16T22:16:59.498073+0000","last_became_active":"2020-11-16T22:01:35.916237+0000","last_became_peered":"2020-11-16T22:01:35.916237+0000","last_unstale":"2020-11-16T22:16:59.498073+0000","last_undegraded":"2020-11-16T22:16:59.498073+0000","last_fullsized":"2020-11-16T22:16:59.498073+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_clean_scrub_stamp":"2020-11-16T22:01:34.896129+0000","log_size":1288,"ondisk_log_size":1288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54701935,"num_objects":23,"num_object_clones":20,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":1,"num_read":506,"num_read_kb":560871,"num_write":356,"num_write_kb":142041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"37e","length":"1"}]},{"pgid":"2.c","version":"989'649","reported_seq":"3479","reported_epoch":"991","state":"active+clean","last_fresh":"2020-11-16T22:17:05.268111+0000","last_change":"2020-11-16T22:16:58.382660+0000","last_active":"2020-11-16T22:17:05.268111+0000","last_peered":"2020-11-16T22:17:05.268111+0000","last_clean":"2020-11-16T22:17:05.268111+0000","last_became_active":"2020-11-16T22:01:35.999581+0000","last_became_peered":"2020-11-16T22:01:35.999581+0000","last_unstale":"2020-11-16T22:17:05.268111+0000","last_undegraded":"2020-11-16T22:17:05.268111+0000","last_fullsized":"2020-11-16T22:17:05.268111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_clean_scrub_stamp":"2020-11-16T22:01:34.896129+0000","log_size":649,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":27893467,"num_objects":10,"num_object_clones":8,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":212,"num_read_kb":190901,"num_write":173,"num_write_kb":72554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.d","version":"988'927","reported_seq":"3776","reported_epoch":"991","state":"active+clean","last_fresh":"2020-11-16T22:17:05.250305+0000","last_change":"2020-11-16T22:16:58.381004+0000","last_active":"2020-11-16T22:17:05.250305+0000","last_peered":"2020-11-16T22:17:05.250305+0000","last_clean":"2020-11-16T22:17:05.250305+0000","last_became_active":"2020-11-16T22:01:35.999631+0000","last_became_peered":"2020-11-16T22:01:35.999631+0000","last_unstale":"2020-11-16T22:17:05.250305+0000","last_undegraded":"2020-11-16T22:17:05.250305+0000","last_fullsized":"2020-11-16T22:17:05.250305+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_clean_scrub_stamp":"2020-11-16T22:01:34.896129+0000","log_size":927,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":27274992,"num_objects":11,"num_object_clones":9,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":395,"num_read_kb":409602,"num_write":247,"num_write_kb":90342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4],"acting":[9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.e","version":"988'1059","reported_seq":"3896","reported_epoch":"989","state":"active+clean","last_fresh":"2020-11-16T22:16:59.388978+0000","last_change":"2020-11-16T22:16:58.366339+0000","last_active":"2020-11-16T22:16:59.388978+0000","last_peered":"2020-11-16T22:16:59.388978+0000","last_clean":"2020-11-16T22:16:59.388978+0000","last_became_active":"2020-11-16T22:01:36.000362+0000","last_became_peered":"2020-11-16T22:01:36.000362+0000","last_unstale":"2020-11-16T22:16:59.388978+0000","last_undegraded":"2020-11-16T22:16:59.388978+0000","last_fullsized":"2020-11-16T22:16:59.388978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-16T22:01:34.896129+0000","last_clean_scrub_stamp":"2020-11-16T22:01:34.896129+0000","log_size":1059,"ondisk_log_size":1059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32907742,"num_objects":13,"num_object_clones":10,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":411,"num_read_kb":439274,"num_write":273,"num_write_kb":120307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"37e","length":"1"}]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":722283224,"num_objects":317,"num_object_clones":267,"num_object_copies":634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":6,"num_read":7532,"num_read_kb":7790318,"num_write":5423,"num_write_kb":2088340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1015726080,"data_stored":1503605826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20165,"ondisk_log_size":20165,"up":32,"acting":32,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":7}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776344,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":124032,"kb_used_data":101112,"kb_used_omap":0,"kb_used_meta":22912,"kb_avail":93621120,"statfs":{"total":95995035648,"available":95868026880,"internally_reserved":0,"allocated":103538688,"data_stored":124557552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":23461888},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:17:06 2020","interfaces":[{"interface":"back","average":{"1min":1.843,"5min":4.718,"15min":5.1829999999999998},"min":{"1min":0.98299999999999998,"5min":0.94199999999999995,"15min":0.92900000000000005},"max":{"1min":4.194,"5min":228.47200000000001,"15min":391.82100000000003},"last":1.716},{"interface":"front","average":{"1min":2.7080000000000002,"5min":2.6360000000000001,"15min":4.1219999999999999},"min":{"1min":1.4730000000000001,"5min":1.2210000000000001,"15min":0.98099999999999998},"max":{"1min":4.891,"5min":4.891,"15min":481.82100000000003},"last":2.4100000000000001}]},{"osd":1,"last update":"Mon Nov 16 22:17:06 2020","interfaces":[{"interface":"back","average":{"1min":2.0859999999999999,"5min":2.1869999999999998,"15min":2.3380000000000001},"min":{"1min":1.4570000000000001,"5min":1.1279999999999999,"15min":0.71899999999999997},"max":{"1min":4.444,"5min":4.444,"15min":6.2300000000000004},"last":1.8080000000000001},{"interface":"front","average":{"1min":2.972,"5min":20.274000000000001,"15min":10.369999999999999},"min":{"1min":1.7410000000000001,"5min":1.3500000000000001,"15min":1.012},"max":{"1min":5.1150000000000002,"5min":997.09799999999996,"15min":997.09799999999996},"last":2.302}]},{"osd":2,"last update":"Mon Nov 16 22:17:06 2020","interfaces":[{"interface":"back","average":{"1min":2.8780000000000001,"5min":11.497,"15min":8.734},"min":{"1min":1.7509999999999999,"5min":1.3700000000000001,"15min":1.1499999999999999},"max":{"1min":4.9649999999999999,"5min":824.11800000000005,"15min":824.11800000000005},"last":1.8879999999999999},{"interface":"front","average":{"1min":2.742,"5min":6.0229999999999997,"15min":4.6689999999999996},"min":{"1min":1.667,"5min":1.6379999999999999,"15min":0.78500000000000003},"max":{"1min":5.218,"5min":281.24200000000002,"15min":281.24200000000002},"last":2.1389999999999998}]},{"osd":3,"last update":"Mon Nov 16 22:17:06 2020","interfaces":[{"interface":"back","average":{"1min":3.145,"5min":7.5519999999999996,"15min":5.8239999999999998},"min":{"1min":1.595,"5min":1.5009999999999999,"15min":1.1870000000000001},"max":{"1min":5.2699999999999996,"5min":435.07400000000001,"15min":435.07400000000001},"last":2.2429999999999999},{"interface":"front","average":{"1min":3.3330000000000002,"5min":3.4260000000000002,"15min":3.0899999999999999},"min":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":0.97199999999999998},"max":{"1min":5.6020000000000003,"5min":17.207999999999998,"15min":17.207999999999998},"last":2.5190000000000001}]},{"osd":4,"last update":"Mon Nov 16 22:17:06 2020","interfaces":[{"interface":"back","average":{"1min":3.6440000000000001,"5min":10.464,"15min":11.000999999999999},"min":{"1min":1.8140000000000001,"5min":1.5129999999999999,"15min":1.5109999999999999},"max":{"1min":5.3849999999999998,"5min":522.88599999999997,"15min":570.28399999999999},"last":3.2429999999999999},{"interface":"front","average":{"1min":3.2850000000000001,"5min":11.654,"15min":6.1360000000000001},"min":{"1min":1.71,"5min":1.71,"15min":1.405},"max":{"1min":5.3410000000000002,"5min":776.90499999999997,"15min":776.90499999999997},"last":3.2959999999999998}]},{"osd":5,"last update":"Mon Nov 16 22:17:06 2020","interfaces":[{"interface":"back","average":{"1min":2.6930000000000001,"5min":15.994999999999999,"15min":8.8119999999999994},"min":{"1min":1.708,"5min":1.708,"15min":1.1180000000000001},"max":{"1min":4.0679999999999996,"5min":644.40499999999997,"15min":644.40499999999997},"last":1.9770000000000001},{"interface":"front","average":{"1min":3.8479999999999999,"5min":3.9009999999999998,"15min":11.435},"min":{"1min":1.927,"5min":1.927,"15min":1.73},"max":{"1min":5.4939999999999998,"5min":19.792999999999999,"15min":896.12800000000004},"last":3.3620000000000001}]},{"osd":6,"last update":"Mon Nov 16 22:17:06 2020","interfaces":[{"interface":"back","average":{"1min":3.2890000000000001,"5min":7.9279999999999999,"15min":10.691000000000001},"min":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"max":{"1min":5.4480000000000004,"5min":355.65600000000001,"15min":600.42399999999998},"last":3.1200000000000001},{"interface":"front","average":{"1min":3.2389999999999999,"5min":12.210000000000001,"15min":8.7539999999999996},"min":{"1min":2.073,"5min":1.7649999999999999,"15min":1.49},"max":{"1min":4.8369999999999997,"5min":782.34500000000003,"15min":782.34500000000003},"last":2.7080000000000002}]},{"osd":7,"last update":"Mon Nov 16 22:17:06 2020","interfaces":[{"interface":"back","average":{"1min":3.621,"5min":8.7170000000000005,"15min":8.2970000000000006},"min":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"max":{"1min":5.5529999999999999,"5min":450.35599999999999,"15min":884.70399999999995},"last":3.4510000000000001},{"interface":"front","average":{"1min":3.3300000000000001,"5min":3.4199999999999999,"15min":3.5209999999999999},"min":{"1min":2.1469999999999998,"5min":1.919,"15min":1.357},"max":{"1min":5.1299999999999999,"5min":6.0119999999999996,"15min":6.4740000000000002},"last":2.8090000000000002}]},{"osd":8,"last update":"Mon Nov 16 22:17:06 2020","interfaces":[{"interface":"back","average":{"1min":3.964,"5min":4.1559999999999997,"15min":7.4550000000000001},"min":{"1min":1.899,"5min":1.899,"15min":1.129},"max":{"1min":6.1139999999999999,"5min":7.5810000000000004,"15min":947.25300000000004},"last":3.524},{"interface":"front","average":{"1min":3.8010000000000002,"5min":3.8620000000000001,"15min":5.5679999999999996},"min":{"1min":1.853,"5min":1.6819999999999999,"15min":0.82599999999999996},"max":{"1min":5.6459999999999999,"5min":6.1020000000000003,"15min":646.95299999999997},"last":3.1920000000000002}]},{"osd":10,"last update":"Mon Nov 16 22:17:06 2020","interfaces":[{"interface":"back","average":{"1min":4.1420000000000003,"5min":3.9870000000000001,"15min":8.4440000000000008},"min":{"1min":2.3759999999999999,"5min":1.554,"15min":1.1899999999999999},"max":{"1min":6.1820000000000004,"5min":6.1820000000000004,"15min":1004.091},"last":3.617},{"interface":"front","average":{"1min":3.891,"5min":11.662000000000001,"15min":6.5919999999999996},"min":{"1min":1.516,"5min":1.516,"15min":0.91300000000000003},"max":{"1min":6.0469999999999997,"5min":709.80899999999997,"15min":709.80899999999997},"last":3.5819999999999999}]}]},{"osd":10,"up_from":63,"seq":270582939868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":56700,"kb_used_data":25780,"kb_used_omap":0,"kb_used_meta":30912,"kb_avail":93688452,"statfs":{"total":95995035648,"available":95936974848,"internally_reserved":0,"allocated":26398720,"data_stored":32229192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31653888},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4289999999999998}]},{"osd":1,"last update":"Mon Nov 16 22:16:39 2020","interfaces":[{"interface":"back","average":{"1min":2.6720000000000002,"5min":2.3650000000000002,"15min":4.0910000000000002},"min":{"1min":1.4510000000000001,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":3.5699999999999998,"5min":27.731000000000002,"15min":492.39299999999997},"last":3.6739999999999999},{"interface":"front","average":{"1min":2.9940000000000002,"5min":21.905000000000001,"15min":8.9990000000000006},"min":{"1min":1.5169999999999999,"5min":1.282,"15min":0.99399999999999999},"max":{"1min":3.9569999999999999,"5min":794.95899999999995,"15min":794.95899999999995},"last":3.6000000000000001}]},{"osd":2,"last update":"Mon Nov 16 22:16:39 2020","interfaces":[{"interface":"back","average":{"1min":2.653,"5min":2.7069999999999999,"15min":5.1139999999999999},"min":{"1min":1.859,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":3.512,"5min":3.9300000000000002,"15min":448.68400000000003},"last":2.29},{"interface":"front","average":{"1min":3.581,"5min":3.4489999999999998,"15min":10.256},"min":{"1min":2.0910000000000002,"5min":1.79,"15min":0.95299999999999996},"max":{"1min":4.4690000000000003,"5min":5.5309999999999997,"15min":984.19399999999996},"last":3.8929999999999998}]},{"osd":3,"last update":"Mon Nov 16 22:16:39 2020","interfaces":[{"interface":"back","average":{"1min":2.5739999999999998,"5min":4.8689999999999998,"15min":14.494},"min":{"1min":1.718,"5min":1.294,"15min":1.294},"max":{"1min":3.4390000000000001,"5min":295.82100000000003,"15min":955.65999999999997},"last":2.0880000000000001},{"interface":"front","average":{"1min":28.539999999999999,"5min":8.5649999999999995,"15min":5.2590000000000003},"min":{"1min":1.9379999999999999,"5min":1.5760000000000001,"15min":1.2809999999999999},"max":{"1min":457.65600000000001,"5min":457.65600000000001,"15min":457.65600000000001},"last":3.73}]},{"osd":4,"last update":"Mon Nov 16 22:16:39 2020","interfaces":[{"interface":"back","average":{"1min":2.6429999999999998,"5min":7.3200000000000003,"15min":4.8570000000000002},"min":{"1min":1.452,"5min":1.452,"15min":1.452},"max":{"1min":4.2759999999999998,"5min":504.65100000000001,"15min":504.65100000000001},"last":2.3849999999999998},{"interface":"front","average":{"1min":2.944,"5min":14.718,"15min":7.9969999999999999},"min":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"max":{"1min":4.8789999999999996,"5min":504.71100000000001,"15min":504.71100000000001},"last":2.5009999999999999}]},{"osd":5,"last update":"Mon Nov 16 22:16:39 2020","interfaces":[{"interface":"back","average":{"1min":3.117,"5min":3.3420000000000001,"15min":6.2999999999999998},"min":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.409},"max":{"1min":4.4370000000000003,"5min":11.169,"15min":383.40800000000002},"last":2.6619999999999999},{"interface":"front","average":{"1min":54.204999999999998,"5min":15.565,"15min":9.1050000000000004},"min":{"1min":2.9340000000000002,"5min":1.9039999999999999,"15min":1.9039999999999999},"max":{"1min":911.23199999999997,"5min":911.23199999999997,"15min":911.23199999999997},"last":3.7789999999999999}]},{"osd":6,"last update":"Mon Nov 16 22:16:39 2020","interfaces":[{"interface":"back","average":{"1min":3.2949999999999999,"5min":3.2309999999999999,"15min":9.8109999999999999},"min":{"1min":2.0649999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"max":{"1min":4.141,"5min":4.4870000000000001,"15min":661.84699999999998},"last":3.427},{"interface":"front","average":{"1min":3.9369999999999998,"5min":3.9849999999999999,"15min":11.436999999999999},"min":{"1min":2.786,"5min":2.254,"15min":1.873},"max":{"1min":5.2919999999999998,"5min":6.0460000000000003,"15min":826.97699999999998},"last":3.8319999999999999}]},{"osd":7,"last update":"Mon Nov 16 22:16:39 2020","interfaces":[{"interface":"back","average":{"1min":3.4870000000000001,"5min":5.3399999999999999,"15min":7.157},"min":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"max":{"1min":4.3520000000000003,"5min":184.15899999999999,"15min":504.86099999999999},"last":3.206},{"interface":"front","average":{"1min":4.2949999999999999,"5min":5.319,"15min":9.7530000000000001},"min":{"1min":2.7109999999999999,"5min":2.3039999999999998,"15min":1.847},"max":{"1min":5.3470000000000004,"5min":136.97399999999999,"15min":534.83900000000006},"last":492.846}]},{"osd":8,"last update":"Mon Nov 16 22:16:39 2020","interfaces":[{"interface":"back","average":{"1min":3.5510000000000002,"5min":3.6539999999999999,"15min":6.2460000000000004},"min":{"1min":1.409,"5min":1.409,"15min":1.143},"max":{"1min":5.1059999999999999,"5min":11.000999999999999,"15min":637.40800000000002},"last":3.343},{"interface":"front","average":{"1min":3.7309999999999999,"5min":3.6600000000000001,"15min":5.7210000000000001},"min":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"max":{"1min":4.5529999999999999,"5min":4.9989999999999997,"15min":561.17700000000002},"last":3.3010000000000002}]},{"osd":9,"last update":"Mon Nov 16 22:16:39 2020","interfaces":[{"interface":"back","average":{"1min":3.5819999999999999,"5min":4.8680000000000003,"15min":7.0590000000000002},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"max":{"1min":4.8440000000000003,"5min":133.56,"15min":784.62199999999996},"last":3.5419999999999998},{"interface":"front","average":{"1min":4.5469999999999997,"5min":17.398,"15min":14.287000000000001},"min":{"1min":2.8319999999999999,"5min":2.5790000000000002,"15min":1.3919999999999999},"max":{"1min":5.7149999999999999,"5min":498.36500000000001,"15min":763.63599999999997},"last":4.2309999999999999}]},{"osd":11,"last update":"Mon Nov 16 22:16:49 2020","interfaces":[{"interface":"back","average":{"1min":3.847,"5min":3.762,"15min":8.3019999999999996},"min":{"1min":2.944,"5min":1.1259999999999999,"15min":1.1259999999999999},"max":{"1min":4.3470000000000004,"5min":5.4390000000000001,"15min":641.029},"last":3.4769999999999999},{"interface":"front","average":{"1min":45.094999999999999,"5min":24.984000000000002,"15min":14.81},"min":{"1min":4.0780000000000003,"5min":2.3340000000000001,"15min":1.712},"max":{"1min":730.11099999999999,"5min":749.88800000000003,"15min":859.61300000000006},"last":4.2779999999999996}]}]},{"osd":9,"up_from":58,"seq":249108103393,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":141396,"kb_used_data":105804,"kb_used_omap":0,"kb_used_meta":35584,"kb_avail":93603756,"statfs":{"total":95995035648,"available":95850246144,"internally_reserved":0,"allocated":108343296,"data_stored":167133396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":36438016},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:16:03 2020","interfaces":[{"interface":"back","average":{"1min":2.3479999999999999,"5min":4.4290000000000003,"15min":6.923},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":3.9649999999999999,"5min":164.28200000000001,"15min":871.47699999999998},"last":2.4889999999999999},{"interface":"front","average":{"1min":2.6110000000000002,"5min":2.3639999999999999,"15min":5.9290000000000003},"min":{"1min":1.5600000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":4.4009999999999998,"5min":4.4009999999999998,"15min":842.32000000000005},"last":1.3100000000000001}]},{"osd":1,"last update":"Mon Nov 16 22:16:07 2020","interfaces":[{"interface":"back","average":{"1min":51.665999999999997,"5min":12.492000000000001,"15min":7.1429999999999998},"min":{"1min":1.5,"5min":1.2869999999999999,"15min":1.1379999999999999},"max":{"1min":845.47000000000003,"5min":845.47000000000003,"15min":845.47000000000003},"last":3.4980000000000002},{"interface":"front","average":{"1min":2.8519999999999999,"5min":11.641999999999999,"15min":7.3899999999999997},"min":{"1min":1.6259999999999999,"5min":1.163,"15min":1.1559999999999999},"max":{"1min":4.6550000000000002,"5min":938.447,"15min":938.447},"last":3.778}]},{"osd":2,"last update":"Mon Nov 16 22:16:03 2020","interfaces":[{"interface":"back","average":{"1min":13.615,"5min":28.213999999999999,"15min":11.465},"min":{"1min":1.708,"5min":1.123,"15min":1.123},"max":{"1min":184.833,"5min":873.81600000000003,"15min":873.81600000000003},"last":2.7370000000000001},{"interface":"front","average":{"1min":2.9980000000000002,"5min":4.0019999999999998,"15min":5.798},"min":{"1min":1.7829999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"max":{"1min":3.8599999999999999,"5min":110.795,"15min":668.72199999999998},"last":4.0759999999999996}]},{"osd":3,"last update":"Mon Nov 16 22:16:03 2020","interfaces":[{"interface":"back","average":{"1min":3.1669999999999998,"5min":6.9089999999999998,"15min":6.3929999999999998},"min":{"1min":1.6799999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"max":{"1min":3.7890000000000001,"5min":349.95600000000002,"15min":427.22300000000001},"last":4.1920000000000002},{"interface":"front","average":{"1min":2.2629999999999999,"5min":2.4700000000000002,"15min":3.7250000000000001},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":3.5499999999999998,"5min":5.2649999999999997,"15min":415.89400000000001},"last":3.363}]},{"osd":4,"last update":"Mon Nov 16 22:16:03 2020","interfaces":[{"interface":"back","average":{"1min":2.9580000000000002,"5min":7.5670000000000002,"15min":6.7069999999999999},"min":{"1min":1.411,"5min":1.411,"15min":1.407},"max":{"1min":4.1139999999999999,"5min":436.00299999999999,"15min":479.101},"last":4.2400000000000002},{"interface":"front","average":{"1min":53.122999999999998,"5min":13.223000000000001,"15min":8.5389999999999997},"min":{"1min":2.4159999999999999,"5min":1.6719999999999999,"15min":1.6499999999999999},"max":{"1min":847.42100000000005,"5min":847.42100000000005,"15min":847.42100000000005},"last":3.9740000000000002}]},{"osd":5,"last update":"Mon Nov 16 22:16:03 2020","interfaces":[{"interface":"back","average":{"1min":3.3260000000000001,"5min":21.446999999999999,"15min":14.802},"min":{"1min":2.077,"5min":1.7110000000000001,"15min":1.6499999999999999},"max":{"1min":4.5389999999999997,"5min":783.78899999999999,"15min":783.78899999999999},"last":4.3049999999999997},{"interface":"front","average":{"1min":3.0270000000000001,"5min":3.2050000000000001,"15min":8.6940000000000008},"min":{"1min":1.952,"5min":1.474,"15min":1.421},"max":{"1min":3.859,"5min":17.100000000000001,"15min":724.01900000000001},"last":3.6099999999999999}]},{"osd":6,"last update":"Mon Nov 16 22:16:03 2020","interfaces":[{"interface":"back","average":{"1min":3.125,"5min":8.9670000000000005,"15min":9.1489999999999991},"min":{"1min":2.298,"5min":1.7949999999999999,"15min":1.5449999999999999},"max":{"1min":3.7759999999999998,"5min":588.80799999999999,"15min":588.80799999999999},"last":3.714},{"interface":"front","average":{"1min":3.6560000000000001,"5min":7.8019999999999996,"15min":5.8799999999999999},"min":{"1min":2.4550000000000001,"5min":1.7969999999999999,"15min":1.403},"max":{"1min":4.7699999999999996,"5min":400.06200000000001,"15min":400.06200000000001},"last":4.1420000000000003}]},{"osd":7,"last update":"Mon Nov 16 22:16:14 2020","interfaces":[{"interface":"back","average":{"1min":3.3090000000000002,"5min":3.6320000000000001,"15min":4.8780000000000001},"min":{"1min":2.6469999999999998,"5min":1.9790000000000001,"15min":1.496},"max":{"1min":3.8580000000000001,"5min":5.6870000000000003,"15min":263.06099999999998},"last":3.839},{"interface":"front","average":{"1min":3.7629999999999999,"5min":12.055999999999999,"15min":11.260999999999999},"min":{"1min":2.226,"5min":2.1110000000000002,"15min":2.0419999999999998},"max":{"1min":4.4390000000000001,"5min":488.41500000000002,"15min":551.404},"last":4.4119999999999999}]},{"osd":8,"last update":"Mon Nov 16 22:16:07 2020","interfaces":[{"interface":"back","average":{"1min":3.6970000000000001,"5min":11.406000000000001,"15min":6.6669999999999998},"min":{"1min":2.1749999999999998,"5min":2.0259999999999998,"15min":0.85799999999999998},"max":{"1min":4.2210000000000001,"5min":566.952,"15min":566.952},"last":4.024},{"interface":"front","average":{"1min":3.7799999999999998,"5min":3.7269999999999999,"15min":5.093},"min":{"1min":2.6259999999999999,"5min":1.8280000000000001,"15min":1.6839999999999999},"max":{"1min":4.7380000000000004,"5min":5.7949999999999999,"15min":360.70100000000002},"last":4.359}]},{"osd":10,"last update":"Mon Nov 16 22:16:36 2020","interfaces":[{"interface":"back","average":{"1min":3.8319999999999999,"5min":3.9049999999999998,"15min":5.4020000000000001},"min":{"1min":2.4940000000000002,"5min":1.7370000000000001,"15min":1.7130000000000001},"max":{"1min":4.5970000000000004,"5min":5.8869999999999996,"15min":384.60000000000002},"last":4.7930000000000001},{"interface":"front","average":{"1min":4.0030000000000001,"5min":4.0430000000000001,"15min":10.244999999999999},"min":{"1min":2.5960000000000001,"5min":1.8360000000000001,"15min":1.7769999999999999},"max":{"1min":4.6820000000000004,"5min":6.077,"15min":966.72199999999998},"last":4.8460000000000001}]}]},{"osd":8,"up_from":53,"seq":227633266917,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":151608,"kb_used_data":116976,"kb_used_omap":0,"kb_used_meta":34624,"kb_avail":93593544,"statfs":{"total":95995035648,"available":95839789056,"internally_reserved":0,"allocated":119783424,"data_stored":180914081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35454976},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:16:44 2020","interfaces":[{"interface":"back","average":{"1min":1.9730000000000001,"5min":9.6820000000000004,"15min":4.9219999999999997},"min":{"1min":1.4239999999999999,"5min":1.1200000000000001,"15min":0.92700000000000005},"max":{"1min":3.2000000000000002,"5min":399.78399999999999,"15min":399.78399999999999},"last":1.585},{"interface":"front","average":{"1min":2.7189999999999999,"5min":2.6469999999999998,"15min":5.6150000000000002},"min":{"1min":1.371,"5min":1.1870000000000001,"15min":1.1870000000000001},"max":{"1min":3.8260000000000001,"5min":4.4489999999999998,"15min":501.06999999999999},"last":2.407}]},{"osd":1,"last update":"Mon Nov 16 22:01:14 2020","interfaces":[{"interface":"back","average":{"1min":2.6739999999999999,"5min":2.6909999999999998,"15min":2.6629999999999998},"min":{"1min":1.5700000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"max":{"1min":3.9940000000000002,"5min":9.6679999999999993,"15min":9.6679999999999993},"last":1.883},{"interface":"front","average":{"1min":2.5950000000000002,"5min":2.8490000000000002,"15min":2.9950000000000001},"min":{"1min":1.837,"5min":1.1559999999999999,"15min":1.1559999999999999},"max":{"1min":3.98,"5min":16.106999999999999,"15min":16.106999999999999},"last":2.363}]},{"osd":2,"last update":"Mon Nov 16 22:16:44 2020","interfaces":[{"interface":"back","average":{"1min":47.351999999999997,"5min":11.631,"15min":5.8680000000000003},"min":{"1min":1.8839999999999999,"5min":1.238,"15min":1.1080000000000001},"max":{"1min":713.28700000000003,"5min":713.28700000000003,"15min":713.28700000000003},"last":2.847},{"interface":"front","average":{"1min":2.9220000000000002,"5min":8.4350000000000005,"15min":4.7539999999999996},"min":{"1min":1.4910000000000001,"5min":1.375,"15min":1.343},"max":{"1min":4.6550000000000002,"5min":434.57900000000001,"15min":434.57900000000001},"last":3.7029999999999998}]},{"osd":3,"last update":"Mon Nov 16 22:16:44 2020","interfaces":[{"interface":"back","average":{"1min":36.345999999999997,"5min":13.872,"15min":9.8960000000000008},"min":{"1min":2.0379999999999998,"5min":1.5149999999999999,"15min":1.514},"max":{"1min":533.12,"5min":533.12,"15min":989.77200000000005},"last":4.2569999999999997},{"interface":"front","average":{"1min":3.4849999999999999,"5min":3.391,"15min":3.1389999999999998},"min":{"1min":1.115,"5min":1.115,"15min":1.115},"max":{"1min":5.9269999999999996,"5min":7.4509999999999996,"15min":7.4509999999999996},"last":4.3150000000000004}]},{"osd":4,"last update":"Mon Nov 16 22:16:44 2020","interfaces":[{"interface":"back","average":{"1min":2.9689999999999999,"5min":7.7130000000000001,"15min":6.266},"min":{"1min":1.8300000000000001,"5min":1.4039999999999999,"15min":1.1719999999999999},"max":{"1min":3.9449999999999998,"5min":329.46899999999999,"15min":476.27100000000002},"last":3.29},{"interface":"front","average":{"1min":2.9289999999999998,"5min":4.819,"15min":8.6910000000000007},"min":{"1min":1.27,"5min":1.27,"15min":1.27},"max":{"1min":4.0369999999999999,"5min":122.087,"15min":942.99400000000003},"last":3.5110000000000001}]},{"osd":5,"last update":"Mon Nov 16 22:16:44 2020","interfaces":[{"interface":"back","average":{"1min":3.9039999999999999,"5min":3.7879999999999998,"15min":6.1970000000000001},"min":{"1min":2.145,"5min":2.093,"15min":1.5620000000000001},"max":{"1min":6.0650000000000004,"5min":7.3339999999999996,"15min":771.30399999999997},"last":4.4290000000000003},{"interface":"front","average":{"1min":2.9569999999999999,"5min":5.7750000000000004,"15min":12.683999999999999},"min":{"1min":2.1779999999999999,"5min":1.863,"15min":1.863},"max":{"1min":3.8929999999999998,"5min":274.17200000000003,"15min":847.55700000000002},"last":3.1749999999999998}]},{"osd":6,"last update":"Mon Nov 16 22:16:44 2020","interfaces":[{"interface":"back","average":{"1min":3.2360000000000002,"5min":6.6459999999999999,"15min":7.2469999999999999},"min":{"1min":2.2770000000000001,"5min":1.615,"15min":1.615},"max":{"1min":4.9630000000000001,"5min":261.94499999999999,"15min":928.58399999999995},"last":2.46},{"interface":"front","average":{"1min":4.0229999999999997,"5min":4.1399999999999997,"15min":6.7119999999999997},"min":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":1.748},"max":{"1min":6.2619999999999996,"5min":9.1210000000000004,"15min":683.76999999999998},"last":4.3730000000000002}]},{"osd":7,"last update":"Mon Nov 16 22:16:44 2020","interfaces":[{"interface":"back","average":{"1min":4.0999999999999996,"5min":15.718,"15min":9.1370000000000005},"min":{"1min":2.7949999999999999,"5min":2.5139999999999998,"15min":1.3600000000000001},"max":{"1min":6.4550000000000001,"5min":698.25400000000002,"15min":698.25400000000002},"last":4.4850000000000003},{"interface":"front","average":{"1min":3.4809999999999999,"5min":3.8050000000000002,"15min":9.9149999999999991},"min":{"1min":2.548,"5min":1.861,"15min":1.7749999999999999},"max":{"1min":6.202,"5min":7.9279999999999999,"15min":816.34100000000001},"last":2.5289999999999999}]},{"osd":9,"last update":"Mon Nov 16 22:16:05 2020","interfaces":[{"interface":"back","average":{"1min":4.609,"5min":10.887,"15min":6.1710000000000003},"min":{"1min":2.419,"5min":2.153,"15min":1.1279999999999999},"max":{"1min":9.2720000000000002,"5min":493.48899999999998,"15min":493.48899999999998},"last":4.5300000000000002},{"interface":"front","average":{"1min":3.7229999999999999,"5min":14.467000000000001,"15min":12.263999999999999},"min":{"1min":2.4260000000000002,"5min":1.1890000000000001,"15min":1.1850000000000001},"max":{"1min":6.1479999999999997,"5min":817.65200000000004,"15min":834.30600000000004},"last":3.4049999999999998}]},{"osd":10,"last update":"Mon Nov 16 22:16:31 2020","interfaces":[{"interface":"back","average":{"1min":4.5800000000000001,"5min":4.391,"15min":4.0330000000000004},"min":{"1min":2.4580000000000002,"5min":1.427,"15min":1.397},"max":{"1min":9.3170000000000002,"5min":9.3170000000000002,"15min":9.3170000000000002},"last":4.5789999999999997},{"interface":"front","average":{"1min":3.8220000000000001,"5min":3.8820000000000001,"15min":10.452999999999999},"min":{"1min":2.609,"5min":1.667,"15min":1.22},"max":{"1min":6.3470000000000004,"5min":6.3470000000000004,"15min":891.85299999999995},"last":2.5630000000000002}]},{"osd":11,"last update":"Mon Nov 16 22:17:01 2020","interfaces":[{"interface":"back","average":{"1min":3.9780000000000002,"5min":3.879,"15min":12.038},"min":{"1min":2.8300000000000001,"5min":1.857,"15min":1.1599999999999999},"max":{"1min":6.5670000000000002,"5min":6.5670000000000002,"15min":849.24099999999999},"last":2.5939999999999999},{"interface":"front","average":{"1min":3.5129999999999999,"5min":3.8530000000000002,"15min":6.7320000000000002},"min":{"1min":2.101,"5min":1.3580000000000001,"15min":1.3580000000000001},"max":{"1min":4.5519999999999996,"5min":7.0430000000000001,"15min":660.82000000000005},"last":3.9119999999999999}]}]},{"osd":7,"up_from":48,"seq":206158430446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":195512,"kb_used_data":150320,"kb_used_omap":0,"kb_used_meta":45184,"kb_avail":93549640,"statfs":{"total":95995035648,"available":95794831360,"internally_reserved":0,"allocated":153927680,"data_stored":234258629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46268416},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 21:58:44 2020","interfaces":[{"interface":"back","average":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"min":{"1min":1.385,"5min":1.385,"15min":1.385},"max":{"1min":4.5209999999999999,"5min":4.5209999999999999,"15min":4.5209999999999999},"last":1.165},{"interface":"front","average":{"1min":43.802999999999997,"5min":43.802999999999997,"15min":43.802999999999997},"min":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"max":{"1min":819.04200000000003,"5min":819.04200000000003,"15min":819.04200000000003},"last":1.8200000000000001}]},{"osd":1,"last update":"Mon Nov 16 22:16:22 2020","interfaces":[{"interface":"back","average":{"1min":3.1749999999999998,"5min":9.1969999999999992,"15min":4.9829999999999997},"min":{"1min":2.2549999999999999,"5min":1.1879999999999999,"15min":0.78800000000000003},"max":{"1min":4.1619999999999999,"5min":657.05700000000002,"15min":657.05700000000002},"last":3.7269999999999999},{"interface":"front","average":{"1min":2.9540000000000002,"5min":2.698,"15min":2.6840000000000002},"min":{"1min":1.9570000000000001,"5min":1.405,"15min":1.26},"max":{"1min":3.8490000000000002,"5min":4.6589999999999998,"15min":5.601},"last":1.716}]},{"osd":2,"last update":"Mon Nov 16 22:16:22 2020","interfaces":[{"interface":"back","average":{"1min":3.3119999999999998,"5min":11.548999999999999,"15min":6.5140000000000002},"min":{"1min":2.3319999999999999,"5min":1.5329999999999999,"15min":1.4339999999999999},"max":{"1min":5.8700000000000001,"5min":504.76999999999998,"15min":504.76999999999998},"last":4.2309999999999999},{"interface":"front","average":{"1min":2.2269999999999999,"5min":11.547000000000001,"15min":14.176},"min":{"1min":1.6659999999999999,"5min":1.6060000000000001,"15min":1.3779999999999999},"max":{"1min":3.1179999999999999,"5min":505.10500000000002,"15min":989.93100000000004},"last":2.1339999999999999}]},{"osd":3,"last update":"Mon Nov 16 22:16:22 2020","interfaces":[{"interface":"back","average":{"1min":3.7010000000000001,"5min":3.343,"15min":5.508},"min":{"1min":2.633,"5min":1.925,"15min":1.0700000000000001},"max":{"1min":6.0629999999999997,"5min":6.0629999999999997,"15min":606.76800000000003},"last":4.0739999999999998},{"interface":"front","average":{"1min":3.2890000000000001,"5min":2.9910000000000001,"15min":9.5969999999999995},"min":{"1min":2.1200000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":4.3760000000000003,"5min":4.8559999999999999,"15min":895.86800000000005},"last":3.52}]},{"osd":4,"last update":"Mon Nov 16 22:16:22 2020","interfaces":[{"interface":"back","average":{"1min":53.033999999999999,"5min":16.879999999999999,"15min":12.141999999999999},"min":{"1min":2.762,"5min":2.2160000000000002,"15min":1.3560000000000001},"max":{"1min":940.18799999999999,"5min":940.18799999999999,"15min":940.18799999999999},"last":4.444},{"interface":"front","average":{"1min":21.815999999999999,"5min":6.7119999999999997,"15min":10.353},"min":{"1min":2.3319999999999999,"5min":1.5169999999999999,"15min":1.107},"max":{"1min":349.74299999999999,"5min":349.74299999999999,"15min":839.59900000000005},"last":3.641}]},{"osd":5,"last update":"Mon Nov 16 22:16:22 2020","interfaces":[{"interface":"back","average":{"1min":3.706,"5min":12.433,"15min":11.763},"min":{"1min":2.915,"5min":2.657,"15min":1.673},"max":{"1min":6.4649999999999999,"5min":784.16300000000001,"15min":955.30700000000002},"last":3.915},{"interface":"front","average":{"1min":3.52,"5min":3.496,"15min":8.843},"min":{"1min":2.4300000000000002,"5min":1.829,"15min":1.339},"max":{"1min":5.2939999999999996,"5min":6.5620000000000003,"15min":855.18399999999997},"last":4.1459999999999999}]},{"osd":6,"last update":"Mon Nov 16 22:16:22 2020","interfaces":[{"interface":"back","average":{"1min":3.7749999999999999,"5min":4.9180000000000001,"15min":4.258},"min":{"1min":2.661,"5min":1.345,"15min":1.345},"max":{"1min":5.9950000000000001,"5min":117.926,"15min":168.02799999999999},"last":3.8210000000000002},{"interface":"front","average":{"1min":3.1520000000000001,"5min":12.003,"15min":9.8230000000000004},"min":{"1min":2.133,"5min":1.6539999999999999,"15min":1.401},"max":{"1min":7.1760000000000002,"5min":692.19299999999998,"15min":754.23500000000001},"last":2.2269999999999999}]},{"osd":8,"last update":"Mon Nov 16 22:16:57 2020","interfaces":[{"interface":"back","average":{"1min":4.2960000000000003,"5min":10.013999999999999,"15min":6.9199999999999999},"min":{"1min":3.2959999999999998,"5min":2.7069999999999999,"15min":1.6359999999999999},"max":{"1min":5.7800000000000002,"5min":665.99400000000003,"15min":665.99400000000003},"last":4.3920000000000003},{"interface":"front","average":{"1min":50.317,"5min":13.445,"15min":10.243},"min":{"1min":3.218,"5min":2.407,"15min":1.7},"max":{"1min":787.06100000000004,"5min":787.06100000000004,"15min":833},"last":3.9990000000000001}]},{"osd":9,"last update":"Mon Nov 16 22:17:03 2020","interfaces":[{"interface":"back","average":{"1min":3.778,"5min":18.039999999999999,"15min":15.99},"min":{"1min":2.1909999999999998,"5min":1.77,"15min":1.77},"max":{"1min":5.0730000000000004,"5min":871.72000000000003,"15min":871.72000000000003},"last":4.319},{"interface":"front","average":{"1min":4.0430000000000001,"5min":4.375,"15min":4.3520000000000003},"min":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":1.9530000000000001},"max":{"1min":5.6890000000000001,"5min":7.9249999999999998,"15min":7.9249999999999998},"last":3.3639999999999999}]},{"osd":10,"last update":"Mon Nov 16 22:16:34 2020","interfaces":[{"interface":"back","average":{"1min":4.7539999999999996,"5min":4.641,"15min":4.2199999999999998},"min":{"1min":3.6880000000000002,"5min":3.1890000000000001,"15min":1.946},"max":{"1min":6.569,"5min":7.2460000000000004,"15min":7.4740000000000002},"last":5.2359999999999998},{"interface":"front","average":{"1min":4.0780000000000003,"5min":3.8500000000000001,"15min":7.577},"min":{"1min":2.7309999999999999,"5min":2.1600000000000001,"15min":2.0390000000000001},"max":{"1min":9.7699999999999996,"5min":9.7699999999999996,"15min":605.80999999999995},"last":3.2650000000000001}]},{"osd":11,"last update":"Mon Nov 16 22:17:03 2020","interfaces":[{"interface":"back","average":{"1min":4.3369999999999997,"5min":4.3380000000000001,"15min":4.2190000000000003},"min":{"1min":3.359,"5min":2.7440000000000002,"15min":2.085},"max":{"1min":5.141,"5min":6.6379999999999999,"15min":7.1509999999999998},"last":4.5780000000000003},{"interface":"front","average":{"1min":3.9529999999999998,"5min":26.859000000000002,"15min":11.815},"min":{"1min":2.9940000000000002,"5min":2.0579999999999998,"15min":2.0579999999999998},"max":{"1min":4.9020000000000001,"5min":999.28499999999997,"15min":999.28499999999997},"last":3.4470000000000001}]}]},{"osd":6,"up_from":43,"seq":184683593971,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":51964,"kb_used_data":25780,"kb_used_omap":0,"kb_used_meta":26176,"kb_avail":93693188,"statfs":{"total":95995035648,"available":95941824512,"internally_reserved":0,"allocated":26398720,"data_stored":32229192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26804224},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:17:02 2020","interfaces":[{"interface":"back","average":{"1min":12.337999999999999,"5min":12.972,"15min":13.378},"min":{"1min":2.2200000000000002,"5min":1.4670000000000001,"15min":1.4670000000000001},"max":{"1min":191.685,"5min":968.54499999999996,"15min":968.54499999999996},"last":2.1480000000000001},{"interface":"front","average":{"1min":3.1269999999999998,"5min":18.832999999999998,"15min":15.109999999999999},"min":{"1min":1.8919999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"max":{"1min":4.1689999999999996,"5min":588.19799999999998,"15min":839.14400000000001},"last":1.5189999999999999}]},{"osd":1,"last update":"Mon Nov 16 22:17:02 2020","interfaces":[{"interface":"back","average":{"1min":2.5419999999999998,"5min":6.3680000000000003,"15min":7.6040000000000001},"min":{"1min":1.147,"5min":1.147,"15min":1.147},"max":{"1min":5.0170000000000003,"5min":310.93400000000003,"15min":785.346},"last":3.0249999999999999},{"interface":"front","average":{"1min":3.024,"5min":5.1479999999999997,"15min":6.5369999999999999},"min":{"1min":1.234,"5min":1.234,"15min":0.872},"max":{"1min":5.2140000000000004,"5min":236.05099999999999,"15min":695.26099999999997},"last":2.9700000000000002}]},{"osd":2,"last update":"Mon Nov 16 22:17:02 2020","interfaces":[{"interface":"back","average":{"1min":2.7240000000000002,"5min":2.6560000000000001,"15min":6.7270000000000003},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":3.681,"5min":4.0330000000000004,"15min":593.40200000000004},"last":2.6749999999999998},{"interface":"front","average":{"1min":3.218,"5min":3.1600000000000001,"15min":4.5640000000000001},"min":{"1min":2.274,"5min":1.631,"15min":1.359},"max":{"1min":4.024,"5min":4.9960000000000004,"15min":503.733},"last":2.766}]},{"osd":3,"last update":"Mon Nov 16 22:17:02 2020","interfaces":[{"interface":"back","average":{"1min":3.1869999999999998,"5min":3.0110000000000001,"15min":18.376000000000001},"min":{"1min":1.325,"5min":1.325,"15min":1.325},"max":{"1min":5.04,"5min":6.2450000000000001,"15min":998.029},"last":2.278},{"interface":"front","average":{"1min":39.332000000000001,"5min":19.59,"15min":16.817},"min":{"1min":2.206,"5min":1.681,"15min":1.681},"max":{"1min":507.12,"5min":961.83500000000004,"15min":961.83500000000004},"last":2.9049999999999998}]},{"osd":4,"last update":"Mon Nov 16 22:17:02 2020","interfaces":[{"interface":"back","average":{"1min":31.617999999999999,"5min":13.010999999999999,"15min":7.0899999999999999},"min":{"1min":2.1099999999999999,"5min":1.5229999999999999,"15min":1.518},"max":{"1min":590.66600000000005,"5min":590.66600000000005,"15min":590.66600000000005},"last":2.4089999999999998},{"interface":"front","average":{"1min":3.1899999999999999,"5min":8.2449999999999992,"15min":5.1040000000000001},"min":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.425},"max":{"1min":4.5960000000000001,"5min":598.77499999999998,"15min":598.77499999999998},"last":2.8479999999999999}]},{"osd":5,"last update":"Mon Nov 16 22:17:02 2020","interfaces":[{"interface":"back","average":{"1min":3.2040000000000002,"5min":3.395,"15min":6.2030000000000003},"min":{"1min":1.853,"5min":1.853,"15min":1.853},"max":{"1min":4.4000000000000004,"5min":5.7830000000000004,"15min":874.41999999999996},"last":3.6720000000000002},{"interface":"front","average":{"1min":3.8359999999999999,"5min":9.1989999999999998,"15min":8.0139999999999993},"min":{"1min":2.1709999999999998,"5min":1.754,"15min":1.5089999999999999},"max":{"1min":5.3979999999999997,"5min":621.63199999999995,"15min":638.77599999999995},"last":3.0720000000000001}]},{"osd":7,"last update":"Mon Nov 16 22:16:28 2020","interfaces":[{"interface":"back","average":{"1min":3.9249999999999998,"5min":3.8700000000000001,"15min":5.7240000000000002},"min":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"max":{"1min":5.7560000000000002,"5min":7.2309999999999999,"15min":326.67899999999997},"last":3.1219999999999999},{"interface":"front","average":{"1min":4.0839999999999996,"5min":4.0339999999999998,"15min":4.0789999999999997},"min":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":1.5640000000000001},"max":{"1min":5.4820000000000002,"5min":7.1710000000000003,"15min":8.5760000000000005},"last":3.5049999999999999}]},{"osd":8,"last update":"Mon Nov 16 22:16:37 2020","interfaces":[{"interface":"back","average":{"1min":4.2130000000000001,"5min":9.875,"15min":10.532},"min":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9370000000000001},"max":{"1min":5.6280000000000001,"5min":532.30999999999995,"15min":532.30999999999995},"last":3.5680000000000001},{"interface":"front","average":{"1min":4.1050000000000004,"5min":12.532,"15min":12.958},"min":{"1min":2.3359999999999999,"5min":2.3140000000000001,"15min":1.605},"max":{"1min":5.4189999999999996,"5min":723.22000000000003,"15min":723.22000000000003},"last":3.738}]},{"osd":9,"last update":"Mon Nov 16 22:17:02 2020","interfaces":[{"interface":"back","average":{"1min":4.2539999999999996,"5min":5.8419999999999996,"15min":11.972},"min":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"max":{"1min":6.0540000000000003,"5min":194.36799999999999,"15min":971.06899999999996},"last":3.3660000000000001},{"interface":"front","average":{"1min":4.1680000000000001,"5min":4.2560000000000002,"15min":13.577},"min":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"max":{"1min":5.2560000000000002,"5min":6.351,"15min":864.35799999999995},"last":3.9209999999999998}]},{"osd":10,"last update":"Mon Nov 16 22:16:28 2020","interfaces":[{"interface":"back","average":{"1min":4.3959999999999999,"5min":9.9629999999999992,"15min":7.2240000000000002},"min":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.718},"max":{"1min":5.9690000000000003,"5min":579.27700000000004,"15min":579.27700000000004},"last":3.855},{"interface":"front","average":{"1min":4.2409999999999997,"5min":4.2759999999999998,"15min":6.585},"min":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":1.9690000000000001},"max":{"1min":5.875,"5min":6.4349999999999996,"15min":630.06899999999996},"last":3.8109999999999999}]}]},{"osd":1,"up_from":18,"seq":77309411594,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":164896,"kb_used_data":122584,"kb_used_omap":0,"kb_used_meta":42304,"kb_avail":93580256,"statfs":{"total":95995035648,"available":95826182144,"internally_reserved":0,"allocated":125526016,"data_stored":176004768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":43319296},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:16:05 2020","interfaces":[{"interface":"back","average":{"1min":29.603000000000002,"5min":7.7130000000000001,"15min":4.0730000000000004},"min":{"1min":1.825,"5min":1.2829999999999999,"15min":0.81699999999999995},"max":{"1min":426.02499999999998,"5min":426.02499999999998,"15min":426.02499999999998},"last":2.5760000000000001},{"interface":"front","average":{"1min":2.4350000000000001,"5min":2.5,"15min":9.4900000000000002},"min":{"1min":1.772,"5min":1.5389999999999999,"15min":1.1200000000000001},"max":{"1min":3.2000000000000002,"5min":4.3810000000000002,"15min":747.08399999999995},"last":2.153}]},{"osd":2,"last update":"Mon Nov 16 22:16:14 2020","interfaces":[{"interface":"back","average":{"1min":2.1749999999999998,"5min":2.403,"15min":7.4340000000000002},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":0.78300000000000003},"max":{"1min":3.6629999999999998,"5min":3.7280000000000002,"15min":751.33100000000002},"last":2.355},{"interface":"front","average":{"1min":2.5790000000000002,"5min":2.5270000000000001,"15min":8.0329999999999995},"min":{"1min":1.952,"5min":1.2869999999999999,"15min":1.167},"max":{"1min":3.8319999999999999,"5min":4.8810000000000002,"15min":931.13300000000004},"last":3.1869999999999998}]},{"osd":3,"last update":"Mon Nov 16 22:16:58 2020","interfaces":[{"interface":"back","average":{"1min":2.032,"5min":6.649,"15min":5.2990000000000004},"min":{"1min":1.5600000000000001,"5min":1.532,"15min":0.99399999999999999},"max":{"1min":3.5539999999999998,"5min":305.65600000000001,"15min":503.56099999999998},"last":3.6360000000000001},{"interface":"front","average":{"1min":2.6070000000000002,"5min":10.81,"15min":10.545},"min":{"1min":1.698,"5min":1.347,"15min":1.296},"max":{"1min":4.1420000000000003,"5min":673.99300000000005,"15min":673.99300000000005},"last":2.2349999999999999}]},{"osd":4,"last update":"Mon Nov 16 22:16:05 2020","interfaces":[{"interface":"back","average":{"1min":2.7109999999999999,"5min":2.6179999999999999,"15min":10.178000000000001},"min":{"1min":1.879,"5min":1.46,"15min":1.46},"max":{"1min":3.5619999999999998,"5min":3.823,"15min":977.678},"last":5.077},{"interface":"front","average":{"1min":2.9239999999999999,"5min":3.0739999999999998,"15min":7.194},"min":{"1min":1.784,"5min":1.484,"15min":1.484},"max":{"1min":4.3540000000000001,"5min":5.4980000000000002,"15min":724.28999999999996},"last":4.0350000000000001}]},{"osd":5,"last update":"Mon Nov 16 22:16:39 2020","interfaces":[{"interface":"back","average":{"1min":2.8380000000000001,"5min":2.8100000000000001,"15min":7.8780000000000001},"min":{"1min":2.2349999999999999,"5min":1.734,"15min":1.5860000000000001},"max":{"1min":3.7170000000000001,"5min":3.8530000000000002,"15min":929.25999999999999},"last":5.1769999999999996},{"interface":"front","average":{"1min":3.5249999999999999,"5min":3.556,"15min":5.3090000000000002},"min":{"1min":2.1989999999999998,"5min":2.016,"15min":1.6679999999999999},"max":{"1min":4.8840000000000003,"5min":5.5880000000000001,"15min":370.435},"last":4.444}]},{"osd":6,"last update":"Mon Nov 16 22:16:58 2020","interfaces":[{"interface":"back","average":{"1min":3.9119999999999999,"5min":3.778,"15min":10.231},"min":{"1min":2.5819999999999999,"5min":2.5640000000000001,"15min":1.859},"max":{"1min":5.0579999999999998,"5min":5.5650000000000004,"15min":890.07000000000005},"last":4.7119999999999997},{"interface":"front","average":{"1min":12.468999999999999,"5min":7.5880000000000001,"15min":5.8410000000000002},"min":{"1min":2.5609999999999999,"5min":2.04,"15min":1.2949999999999999},"max":{"1min":188.30000000000001,"5min":270.11799999999999,"15min":319.89999999999998},"last":3.9350000000000001}]},{"osd":7,"last update":"Mon Nov 16 22:16:14 2020","interfaces":[{"interface":"back","average":{"1min":3.839,"5min":4.0279999999999996,"15min":5.3129999999999997},"min":{"1min":3.2290000000000001,"5min":2.9079999999999999,"15min":1.766},"max":{"1min":5.2000000000000002,"5min":6.3209999999999997,"15min":354.358},"last":4.6189999999999998},{"interface":"front","average":{"1min":22.280000000000001,"5min":7.5140000000000002,"15min":5.819},"min":{"1min":2.532,"5min":2.512,"15min":1.8180000000000001},"max":{"1min":338.142,"5min":338.142,"15min":338.142},"last":4.9199999999999999}]},{"osd":8,"last update":"Mon Nov 16 22:16:39 2020","interfaces":[{"interface":"back","average":{"1min":4.0800000000000001,"5min":11.808999999999999,"15min":11.260999999999999},"min":{"1min":2.722,"5min":2.722,"15min":1.837},"max":{"1min":5.2610000000000001,"5min":660.52300000000002,"15min":880.32399999999996},"last":4.524},{"interface":"front","average":{"1min":3.8159999999999998,"5min":3.8340000000000001,"15min":4.7779999999999996},"min":{"1min":2.5609999999999999,"5min":1.4450000000000001,"15min":1.4450000000000001},"max":{"1min":6.2850000000000001,"5min":6.2850000000000001,"15min":269.16500000000002},"last":4.1399999999999997}]},{"osd":9,"last update":"Mon Nov 16 22:16:14 2020","interfaces":[{"interface":"back","average":{"1min":3.1920000000000002,"5min":3.1779999999999999,"15min":3.7810000000000001},"min":{"1min":2.5649999999999999,"5min":2.052,"15min":1.8600000000000001},"max":{"1min":3.823,"5min":5.1159999999999997,"15min":6.8099999999999996},"last":5.2779999999999996},{"interface":"front","average":{"1min":3.7690000000000001,"5min":7.4699999999999998,"15min":8.5809999999999995},"min":{"1min":1.744,"5min":1.744,"15min":1.1919999999999999},"max":{"1min":4.6870000000000003,"5min":375.12700000000001,"15min":508.07900000000001},"last":4.9950000000000001}]},{"osd":10,"last update":"Mon Nov 16 22:16:39 2020","interfaces":[{"interface":"back","average":{"1min":4.2030000000000003,"5min":4.1589999999999998,"15min":7.4160000000000004},"min":{"1min":3.177,"5min":2.4769999999999999,"15min":2.2559999999999998},"max":{"1min":6.069,"5min":6.0970000000000004,"15min":352.06200000000001},"last":4.8300000000000001},{"interface":"front","average":{"1min":4.0830000000000002,"5min":5.2919999999999998,"15min":10.417999999999999},"min":{"1min":3.1989999999999998,"5min":2.141,"15min":2.141},"max":{"1min":5.9580000000000002,"5min":118.101,"15min":783.74599999999998},"last":4.2359999999999998}]}]},{"osd":0,"up_from":12,"seq":51539607822,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":122556,"kb_used_data":94772,"kb_used_omap":0,"kb_used_meta":27776,"kb_avail":93622596,"statfs":{"total":95995035648,"available":95869538304,"internally_reserved":0,"allocated":97046528,"data_stored":138551356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":28442624},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 16 22:16:55 2020","interfaces":[{"interface":"back","average":{"1min":2.8029999999999999,"5min":2.9329999999999998,"15min":2.6699999999999999},"min":{"1min":1.661,"5min":1.3440000000000001,"15min":1.1539999999999999},"max":{"1min":4.2350000000000003,"5min":6.665,"15min":6.665},"last":1.825},{"interface":"front","average":{"1min":3.294,"5min":3.27,"15min":6.0510000000000002},"min":{"1min":2.2749999999999999,"5min":1.75,"15min":0.98799999999999999},"max":{"1min":4.2789999999999999,"5min":6.7560000000000002,"15min":684.23400000000004},"last":6.0999999999999996}]},{"osd":2,"last update":"Mon Nov 16 21:58:46 2020","interfaces":[{"interface":"back","average":{"1min":1.8540000000000001,"5min":1.6439999999999999,"15min":1.5600000000000001},"min":{"1min":1.506,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.1589999999999998,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":2.7029999999999998},{"interface":"front","average":{"1min":2.226,"5min":21.937999999999999,"15min":30.780000000000001},"min":{"1min":1.7110000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":3.0169999999999999,"5min":674.01900000000001,"15min":674.01900000000001},"last":2.0339999999999998}]},{"osd":3,"last update":"Mon Nov 16 22:16:30 2020","interfaces":[{"interface":"back","average":{"1min":2.621,"5min":8.5999999999999996,"15min":5.673},"min":{"1min":1.4399999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":4.1600000000000001,"5min":668.01099999999997,"15min":668.01099999999997},"last":6.2229999999999999},{"interface":"front","average":{"1min":1.929,"5min":1.8799999999999999,"15min":10.4},"min":{"1min":1.5249999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.7730000000000001,"5min":4.851,"15min":809.00099999999998},"last":1.9450000000000001}]},{"osd":4,"last update":"Mon Nov 16 22:16:06 2020","interfaces":[{"interface":"back","average":{"1min":2.238,"5min":2.181,"15min":8.5259999999999998},"min":{"1min":1.4690000000000001,"5min":1.3460000000000001,"15min":1.2350000000000001},"max":{"1min":3.1880000000000002,"5min":5.0609999999999999,"15min":932.76300000000003},"last":3.29},{"interface":"front","average":{"1min":3.899,"5min":3.9009999999999998,"15min":6.7880000000000003},"min":{"1min":2.7010000000000001,"5min":2.4929999999999999,"15min":1.794},"max":{"1min":5.5129999999999999,"5min":6.8689999999999998,"15min":601.33500000000004},"last":6.0049999999999999}]},{"osd":5,"last update":"Mon Nov 16 22:16:30 2020","interfaces":[{"interface":"back","average":{"1min":3.274,"5min":11.000999999999999,"15min":6.1500000000000004},"min":{"1min":2.0910000000000002,"5min":1.635,"15min":1.635},"max":{"1min":4.7320000000000002,"5min":677.50999999999999,"15min":677.50999999999999},"last":5.8899999999999997},{"interface":"front","average":{"1min":2.7280000000000002,"5min":16.074999999999999,"15min":13.278},"min":{"1min":1.498,"5min":1.4950000000000001,"15min":1.044},"max":{"1min":4.734,"5min":503.25599999999997,"15min":742.673},"last":2.9009999999999998}]},{"osd":6,"last update":"Mon Nov 16 22:16:55 2020","interfaces":[{"interface":"back","average":{"1min":3.8439999999999999,"5min":3.863,"15min":3.629},"min":{"1min":2.8570000000000002,"5min":1.71,"15min":1.71},"max":{"1min":5.0960000000000001,"5min":8.8960000000000008,"15min":8.8960000000000008},"last":6.3109999999999999},{"interface":"front","average":{"1min":2.6499999999999999,"5min":7.5030000000000001,"15min":8.0899999999999999},"min":{"1min":1.9750000000000001,"5min":1.6180000000000001,"15min":1.3720000000000001},"max":{"1min":4.5640000000000001,"5min":504.697,"15min":852.73000000000002},"last":3.0910000000000002}]},{"osd":7,"last update":"Mon Nov 16 22:16:21 2020","interfaces":[{"interface":"back","average":{"1min":2.629,"5min":4.2519999999999998,"15min":3.1640000000000001},"min":{"1min":1.9930000000000001,"5min":1.7609999999999999,"15min":1.2030000000000001},"max":{"1min":3.7450000000000001,"5min":195.452,"15min":195.452},"last":3.4249999999999998},{"interface":"front","average":{"1min":4.3049999999999997,"5min":5.3369999999999997,"15min":11.957000000000001},"min":{"1min":3.1890000000000001,"5min":2.8580000000000001,"15min":1.7569999999999999},"max":{"1min":5.6070000000000002,"5min":145.267,"15min":857.74800000000005},"last":6.4000000000000004}]},{"osd":8,"last update":"Mon Nov 16 22:16:43 2020","interfaces":[{"interface":"back","average":{"1min":2.8519999999999999,"5min":18.155999999999999,"15min":9.5749999999999993},"min":{"1min":2,"5min":1.7310000000000001,"15min":1.3140000000000001},"max":{"1min":3.8929999999999998,"5min":762.36099999999999,"15min":762.36099999999999},"last":3.7440000000000002},{"interface":"front","average":{"1min":4.4269999999999996,"5min":13.891999999999999,"15min":7.4219999999999997},"min":{"1min":3.0750000000000002,"5min":2.9220000000000002,"15min":2.4169999999999998},"max":{"1min":5.5330000000000004,"5min":1003.175,"15min":1003.175},"last":6.593}]},{"osd":9,"last update":"Mon Nov 16 22:16:12 2020","interfaces":[{"interface":"back","average":{"1min":4.3970000000000002,"5min":4.5190000000000001,"15min":4.3689999999999998},"min":{"1min":3.3260000000000001,"5min":1.226,"15min":1.226},"max":{"1min":5.6980000000000004,"5min":8.9480000000000004,"15min":8.9480000000000004},"last":6.6820000000000004},{"interface":"front","average":{"1min":3.2240000000000002,"5min":3.194,"15min":7.1319999999999997},"min":{"1min":2.246,"5min":1.984,"15min":1.482},"max":{"1min":4.452,"5min":5.7510000000000003,"15min":984.20000000000005},"last":3.673}]},{"osd":10,"last update":"Mon Nov 16 22:16:30 2020","interfaces":[{"interface":"back","average":{"1min":3.3290000000000002,"5min":17.920000000000002,"15min":9.5150000000000006},"min":{"1min":2.7719999999999998,"5min":1.8959999999999999,"15min":1.3979999999999999},"max":{"1min":4.7510000000000003,"5min":1137.4639999999999,"15min":1137.4639999999999},"last":4.1120000000000001},{"interface":"front","average":{"1min":4.75,"5min":4.7309999999999999,"15min":5.5229999999999997},"min":{"1min":3.5190000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"max":{"1min":5.8739999999999997,"5min":9.016,"15min":247.25800000000001},"last":6.7759999999999998}]},{"osd":11,"last update":"Mon Nov 16 22:16:06 2020","interfaces":[{"interface":"back","average":{"1min":4.585,"5min":4.7249999999999996,"15min":5.6890000000000001},"min":{"1min":3.3730000000000002,"5min":3.0209999999999999,"15min":2.3079999999999998},"max":{"1min":5.9610000000000003,"5min":8.9909999999999997,"15min":284.46300000000002},"last":6.484},{"interface":"front","average":{"1min":14.244999999999999,"5min":10.75,"15min":5.7839999999999998},"min":{"1min":2.121,"5min":1.946,"15min":1.661},"max":{"1min":221.10300000000001,"5min":611.70799999999997,"15min":611.70799999999997},"last":4.274}]}]},{"osd":2,"up_from":23,"seq":98784248068,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":172908,"kb_used_data":134436,"kb_used_omap":0,"kb_used_meta":38464,"kb_avail":93572244,"statfs":{"total":95995035648,"available":95817977856,"internally_reserved":0,"allocated":137662464,"data_stored":193458399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39387136},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:16:23 2020","interfaces":[{"interface":"back","average":{"1min":2.8460000000000001,"5min":13.396000000000001,"15min":6.4359999999999999},"min":{"1min":1.1459999999999999,"5min":1.111,"15min":0.82199999999999995},"max":{"1min":4.8029999999999999,"5min":968.76999999999998,"15min":968.76999999999998},"last":2.2530000000000001},{"interface":"front","average":{"1min":2.677,"5min":2.6880000000000002,"15min":11.689},"min":{"1min":1.7549999999999999,"5min":1.359,"15min":1.359},"max":{"1min":4.7119999999999997,"5min":4.7119999999999997,"15min":996.27999999999997},"last":2.1429999999999998}]},{"osd":1,"last update":"Mon Nov 16 22:16:24 2020","interfaces":[{"interface":"back","average":{"1min":45.189999999999998,"5min":15.611000000000001,"15min":8.8610000000000007},"min":{"1min":1.3169999999999999,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":896.55399999999997,"5min":896.55399999999997,"15min":896.55399999999997},"last":2.202},{"interface":"front","average":{"1min":2.597,"5min":18.390999999999998,"15min":8.1850000000000005},"min":{"1min":1.619,"5min":1.355,"15min":1.1279999999999999},"max":{"1min":4.5709999999999997,"5min":834.10900000000004,"15min":834.10900000000004},"last":1.581}]},{"osd":3,"last update":"Mon Nov 16 22:16:47 2020","interfaces":[{"interface":"back","average":{"1min":2.234,"5min":5.976,"15min":6.3529999999999998},"min":{"1min":1.046,"5min":1.046,"15min":0.76300000000000001},"max":{"1min":6.4169999999999998,"5min":391.89400000000001,"15min":996.125},"last":3.427},{"interface":"front","average":{"1min":34.994,"5min":9.1359999999999992,"15min":8.4309999999999992},"min":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"max":{"1min":521.00599999999997,"5min":521.00599999999997,"15min":735.61599999999999},"last":2.3159999999999998}]},{"osd":4,"last update":"Mon Nov 16 22:16:11 2020","interfaces":[{"interface":"back","average":{"1min":3.1589999999999998,"5min":3.0619999999999998,"15min":4.5309999999999997},"min":{"1min":1.9990000000000001,"5min":1.218,"15min":1.218},"max":{"1min":4.766,"5min":6.1550000000000002,"15min":259.55799999999999},"last":2.3700000000000001},{"interface":"front","average":{"1min":38.081000000000003,"5min":10.398999999999999,"15min":7.8019999999999996},"min":{"1min":1.72,"5min":1.72,"15min":1.617},"max":{"1min":735.82600000000002,"5min":735.82600000000002,"15min":735.82600000000002},"last":2.4580000000000002}]},{"osd":5,"last update":"Mon Nov 16 22:16:41 2020","interfaces":[{"interface":"back","average":{"1min":3.484,"5min":12.712999999999999,"15min":9.8170000000000002},"min":{"1min":2.6520000000000001,"5min":1.7270000000000001,"15min":1.669},"max":{"1min":5.1449999999999996,"5min":986.96699999999998,"15min":986.96699999999998},"last":2.4159999999999999},{"interface":"front","average":{"1min":3.6880000000000002,"5min":9.7810000000000006,"15min":9.6809999999999992},"min":{"1min":2.948,"5min":2.0880000000000001,"15min":1.673},"max":{"1min":5.6550000000000002,"5min":435.06,"15min":637.029},"last":3.5840000000000001}]},{"osd":6,"last update":"Mon Nov 16 22:16:06 2020","interfaces":[{"interface":"back","average":{"1min":4.1660000000000004,"5min":4.133,"15min":4.7409999999999997},"min":{"1min":3.0129999999999999,"5min":2.2829999999999999,"15min":1.798},"max":{"1min":5.0300000000000002,"5min":6.1310000000000002,"15min":152.41399999999999},"last":3.5390000000000001},{"interface":"front","average":{"1min":3.3410000000000002,"5min":3.512,"15min":6.5810000000000004},"min":{"1min":2.2930000000000001,"5min":2.044,"15min":1.9990000000000001},"max":{"1min":5.2560000000000002,"5min":5.6200000000000001,"15min":603.71799999999996},"last":3.097}]},{"osd":7,"last update":"Mon Nov 16 22:16:23 2020","interfaces":[{"interface":"back","average":{"1min":3.6680000000000001,"5min":8.2089999999999996,"15min":8.0250000000000004},"min":{"1min":2.4260000000000002,"5min":2.2040000000000002,"15min":1.982},"max":{"1min":5.2229999999999999,"5min":378.81700000000001,"15min":429.55000000000001},"last":3.145},{"interface":"front","average":{"1min":13.066000000000001,"5min":5.6779999999999999,"15min":6.6550000000000002},"min":{"1min":2.6469999999999998,"5min":2.0819999999999999,"15min":1.881},"max":{"1min":187.12899999999999,"5min":187.12899999999999,"15min":402.78399999999999},"last":3.1930000000000001}]},{"osd":8,"last update":"Mon Nov 16 22:16:47 2020","interfaces":[{"interface":"back","average":{"1min":4.0590000000000002,"5min":23.202999999999999,"15min":10.661},"min":{"1min":2.9790000000000001,"5min":2.367,"15min":1.835},"max":{"1min":5.7460000000000004,"5min":665.55700000000002,"15min":665.55700000000002},"last":3.4910000000000001},{"interface":"front","average":{"1min":50.853000000000002,"5min":13.388,"15min":9.2479999999999993},"min":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"max":{"1min":800.06399999999996,"5min":800.06399999999996,"15min":800.06399999999996},"last":3.258}]},{"osd":9,"last update":"Mon Nov 16 22:16:11 2020","interfaces":[{"interface":"back","average":{"1min":3.8799999999999999,"5min":4.0739999999999998,"15min":4.3049999999999997},"min":{"1min":2.601,"5min":2.238,"15min":1.5740000000000001},"max":{"1min":5.8399999999999999,"5min":6.2080000000000002,"15min":12.59},"last":3.7240000000000002},{"interface":"front","average":{"1min":2.6459999999999999,"5min":2.802,"15min":7.1219999999999999},"min":{"1min":1.486,"5min":1.486,"15min":1.486},"max":{"1min":3.1299999999999999,"5min":5.7309999999999999,"15min":504.43099999999998},"last":2.8380000000000001}]},{"osd":10,"last update":"Mon Nov 16 22:16:41 2020","interfaces":[{"interface":"back","average":{"1min":91.355999999999995,"5min":34.637999999999998,"15min":20.134},"min":{"1min":3.0790000000000002,"5min":2.508,"15min":2.3170000000000002},"max":{"1min":792.80999999999995,"5min":973.39999999999998,"15min":1000.6559999999999},"last":3.6779999999999999},{"interface":"front","average":{"1min":4.1369999999999996,"5min":11.391999999999999,"15min":8.6699999999999999},"min":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"max":{"1min":6.7009999999999996,"5min":505.41800000000001,"15min":505.41800000000001},"last":3.6389999999999998}]}]},{"osd":3,"up_from":28,"seq":120259084544,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":112248,"kb_used_data":87536,"kb_used_omap":0,"kb_used_meta":24704,"kb_avail":93632904,"statfs":{"total":95995035648,"available":95880093696,"internally_reserved":0,"allocated":89636864,"data_stored":122471358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25296896},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 21:59:06 2020","interfaces":[{"interface":"back","average":{"1min":2.2469999999999999,"5min":1.7609999999999999,"15min":1.639},"min":{"1min":1.367,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":3.1549999999999998,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":3.0249999999999999},{"interface":"front","average":{"1min":12.419,"5min":3.9289999999999998,"15min":2.4940000000000002},"min":{"1min":1.502,"5min":1.266,"15min":1.266},"max":{"1min":208.25899999999999,"5min":208.25899999999999,"15min":208.25899999999999},"last":1.9450000000000001}]},{"osd":1,"last update":"Mon Nov 16 22:16:50 2020","interfaces":[{"interface":"back","average":{"1min":1.7430000000000001,"5min":10.124000000000001,"15min":10.113},"min":{"1min":0.91900000000000004,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":4.7640000000000002,"5min":412.65100000000001,"15min":988.66200000000003},"last":1.766},{"interface":"front","average":{"1min":2.5089999999999999,"5min":6.4189999999999996,"15min":7.3739999999999997},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":3.5960000000000001,"5min":473.01499999999999,"15min":989.46100000000001},"last":3.226}]},{"osd":2,"last update":"Mon Nov 16 22:16:50 2020","interfaces":[{"interface":"back","average":{"1min":2.04,"5min":2.0409999999999999,"15min":4.875},"min":{"1min":1.218,"5min":1.105,"15min":1.105},"max":{"1min":5.508,"5min":5.508,"15min":763.53399999999999},"last":1.6599999999999999},{"interface":"front","average":{"1min":2.5350000000000001,"5min":17.571999999999999,"15min":11.380000000000001},"min":{"1min":1.25,"5min":1.069,"15min":0.84299999999999997},"max":{"1min":6.085,"5min":548.36800000000005,"15min":911.75999999999999},"last":3.387}]},{"osd":4,"last update":"Mon Nov 16 22:16:08 2020","interfaces":[{"interface":"back","average":{"1min":1.9139999999999999,"5min":11.696999999999999,"15min":7.5750000000000002},"min":{"1min":1.145,"5min":1.145,"15min":1.145},"max":{"1min":2.6440000000000001,"5min":870.42600000000004,"15min":870.42600000000004},"last":1.9119999999999999},{"interface":"front","average":{"1min":2.5760000000000001,"5min":9.0640000000000001,"15min":8.1989999999999998},"min":{"1min":1.496,"5min":1.496,"15min":1.23},"max":{"1min":4.1390000000000002,"5min":573.99099999999999,"15min":974.81799999999998},"last":3.3170000000000002}]},{"osd":5,"last update":"Mon Nov 16 22:16:29 2020","interfaces":[{"interface":"back","average":{"1min":3.1549999999999998,"5min":4.0549999999999997,"15min":3.6139999999999999},"min":{"1min":2.585,"5min":1.262,"15min":1.262},"max":{"1min":4.3730000000000002,"5min":92.468000000000004,"15min":102.782},"last":3.6030000000000002},{"interface":"front","average":{"1min":3.5539999999999998,"5min":14.225,"15min":15.449999999999999},"min":{"1min":2.468,"5min":1.75,"15min":1.4399999999999999},"max":{"1min":5.4160000000000004,"5min":924.74400000000003,"15min":924.74400000000003},"last":3.8220000000000001}]},{"osd":6,"last update":"Mon Nov 16 22:17:01 2020","interfaces":[{"interface":"back","average":{"1min":3.4350000000000001,"5min":3.008,"15min":3.2679999999999998},"min":{"1min":2.3900000000000001,"5min":1.7629999999999999,"15min":1.7250000000000001},"max":{"1min":5.6100000000000003,"5min":5.6100000000000003,"15min":62.537999999999997},"last":3.9100000000000001},{"interface":"front","average":{"1min":3.6459999999999999,"5min":10.922000000000001,"15min":8.7080000000000002},"min":{"1min":2.4990000000000001,"5min":1.9530000000000001,"15min":1.2709999999999999},"max":{"1min":5.7240000000000002,"5min":707.16099999999994,"15min":834.505},"last":3.9940000000000002}]},{"osd":7,"last update":"Mon Nov 16 22:16:29 2020","interfaces":[{"interface":"back","average":{"1min":2.8330000000000002,"5min":3.117,"15min":8.4749999999999996},"min":{"1min":2.0270000000000001,"5min":1.96,"15min":1.4239999999999999},"max":{"1min":5.157,"5min":5.4660000000000002,"15min":661.26400000000001},"last":2.7280000000000002},{"interface":"front","average":{"1min":3.258,"5min":3.395,"15min":10.003},"min":{"1min":2.4169999999999998,"5min":2.1459999999999999,"15min":1.359},"max":{"1min":5.9790000000000001,"5min":5.9790000000000001,"15min":808.52999999999997},"last":2.9079999999999999}]},{"osd":8,"last update":"Mon Nov 16 22:16:50 2020","interfaces":[{"interface":"back","average":{"1min":3.3100000000000001,"5min":3.528,"15min":10.659000000000001},"min":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"max":{"1min":5.3540000000000001,"5min":5.8070000000000004,"15min":665.24800000000005},"last":2.8109999999999999},{"interface":"front","average":{"1min":38.935000000000002,"5min":16.917999999999999,"15min":7.5910000000000002},"min":{"1min":1.8080000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"max":{"1min":654.84799999999996,"5min":686.25999999999999,"15min":686.25999999999999},"last":2.2650000000000001}]},{"osd":9,"last update":"Mon Nov 16 22:16:08 2020","interfaces":[{"interface":"back","average":{"1min":3.7090000000000001,"5min":3.8969999999999998,"15min":4.0800000000000001},"min":{"1min":2.8300000000000001,"5min":2.597,"15min":1.381},"max":{"1min":5.2519999999999998,"5min":6.1109999999999998,"15min":10.442},"last":4.7110000000000003},{"interface":"front","average":{"1min":4.0279999999999996,"5min":11.859,"15min":16.963000000000001},"min":{"1min":3.1480000000000001,"5min":2.2360000000000002,"15min":1.7310000000000001},"max":{"1min":4.8120000000000003,"5min":850.19000000000005,"15min":899.25599999999997},"last":4.3929999999999998}]},{"osd":10,"last update":"Mon Nov 16 22:16:29 2020","interfaces":[{"interface":"back","average":{"1min":4.0149999999999997,"5min":8.8610000000000007,"15min":9.4339999999999993},"min":{"1min":2.6459999999999999,"5min":2.6459999999999999,"15min":2.3100000000000001},"max":{"1min":6.391,"5min":520.41600000000005,"15min":769.399},"last":4.9139999999999997},{"interface":"front","average":{"1min":3.3050000000000002,"5min":5.226,"15min":9.6099999999999994},"min":{"1min":2.4809999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"max":{"1min":4.681,"5min":198.49000000000001,"15min":932.55600000000004},"last":3.7170000000000001}]},{"osd":11,"last update":"Mon Nov 16 22:17:01 2020","interfaces":[{"interface":"back","average":{"1min":4.2400000000000002,"5min":8.7599999999999998,"15min":12.561999999999999},"min":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"max":{"1min":11.874000000000001,"5min":452.85300000000001,"15min":947.09799999999996},"last":4.8090000000000002},{"interface":"front","average":{"1min":46.878999999999998,"5min":17.550000000000001,"15min":10.782999999999999},"min":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"max":{"1min":832.58900000000006,"5min":832.58900000000006,"15min":832.58900000000006},"last":3.476}]}]},{"osd":4,"up_from":33,"seq":141733921019,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":52276,"kb_used_data":25964,"kb_used_omap":0,"kb_used_meta":26304,"kb_avail":93692876,"statfs":{"total":95995035648,"available":95941505024,"internally_reserved":0,"allocated":26587136,"data_stored":31609194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26935296},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:16:21 2020","interfaces":[{"interface":"back","average":{"1min":2.2130000000000001,"5min":11.523,"15min":6.3929999999999998},"min":{"1min":1.5049999999999999,"5min":1.3560000000000001,"15min":1.2210000000000001},"max":{"1min":3.6539999999999999,"5min":504.87400000000002,"15min":504.87400000000002},"last":2.4159999999999999},{"interface":"front","average":{"1min":2.2890000000000001,"5min":22.199000000000002,"15min":14.689},"min":{"1min":1.175,"5min":1.175,"15min":1.175},"max":{"1min":3.27,"5min":939.35000000000002,"15min":939.35000000000002},"last":2.871}]},{"osd":1,"last update":"Mon Nov 16 22:16:21 2020","interfaces":[{"interface":"back","average":{"1min":2.9430000000000001,"5min":2.6320000000000001,"15min":3.9710000000000001},"min":{"1min":1.552,"5min":1.3169999999999999,"15min":1.3169999999999999},"max":{"1min":4.2679999999999998,"5min":4.7450000000000001,"15min":234.36199999999999},"last":3.1739999999999999},{"interface":"front","average":{"1min":30.353999999999999,"5min":8.4870000000000001,"15min":5.4249999999999998},"min":{"1min":2.0790000000000002,"5min":1.5760000000000001,"15min":1.5760000000000001},"max":{"1min":468.077,"5min":468.077,"15min":468.077},"last":3.0409999999999999}]},{"osd":2,"last update":"Mon Nov 16 22:16:22 2020","interfaces":[{"interface":"back","average":{"1min":2.9159999999999999,"5min":3.0030000000000001,"15min":5.2400000000000002},"min":{"1min":1.786,"5min":1.786,"15min":1.5760000000000001},"max":{"1min":3.4550000000000001,"5min":6.3209999999999997,"15min":505.13400000000001},"last":3},{"interface":"front","average":{"1min":3.0990000000000002,"5min":11.403,"15min":8.4100000000000001},"min":{"1min":1.925,"5min":1.925,"15min":1.393},"max":{"1min":3.7690000000000001,"5min":818.73699999999997,"15min":818.73699999999997},"last":3.0960000000000001}]},{"osd":3,"last update":"Mon Nov 16 22:16:21 2020","interfaces":[{"interface":"back","average":{"1min":3.3959999999999999,"5min":3.395,"15min":8.8919999999999995},"min":{"1min":2.1779999999999999,"5min":2.024,"15min":2.024},"max":{"1min":4.532,"5min":5.0940000000000003,"15min":808.91700000000003},"last":3.2829999999999999},{"interface":"front","average":{"1min":3.2480000000000002,"5min":3.4049999999999998,"15min":8.0489999999999995},"min":{"1min":2.3380000000000001,"5min":2.2770000000000001,"15min":1.887},"max":{"1min":3.8799999999999999,"5min":6.9729999999999999,"15min":574.32399999999996},"last":3.234}]},{"osd":5,"last update":"Mon Nov 16 22:16:33 2020","interfaces":[{"interface":"back","average":{"1min":3.0779999999999998,"5min":3.073,"15min":4.9850000000000003},"min":{"1min":2.137,"5min":1.423,"15min":1.423},"max":{"1min":3.8279999999999998,"5min":5.5880000000000001,"15min":582.37800000000004},"last":2.5600000000000001},{"interface":"front","average":{"1min":3.7490000000000001,"5min":3.6739999999999999,"15min":8.3209999999999997},"min":{"1min":2.7949999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"max":{"1min":4.6100000000000003,"5min":5.359,"15min":716.35900000000004},"last":3.3879999999999999}]},{"osd":6,"last update":"Mon Nov 16 22:17:04 2020","interfaces":[{"interface":"back","average":{"1min":2.9340000000000002,"5min":3.0129999999999999,"15min":14.798999999999999},"min":{"1min":1.7370000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"max":{"1min":4.2629999999999999,"5min":5.5119999999999996,"15min":943.82399999999996},"last":2.5070000000000001},{"interface":"front","average":{"1min":3.2839999999999998,"5min":7.4420000000000002,"15min":6.282},"min":{"1min":1.4279999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"max":{"1min":4.9950000000000001,"5min":340.29300000000001,"15min":504.68900000000002},"last":3.339}]},{"osd":7,"last update":"Mon Nov 16 22:16:27 2020","interfaces":[{"interface":"back","average":{"1min":31.219999999999999,"5min":9.0459999999999994,"15min":11.77},"min":{"1min":2.6859999999999999,"5min":2.2050000000000001,"15min":2.125},"max":{"1min":418.553,"5min":418.553,"15min":505.10599999999999},"last":2.6099999999999999},{"interface":"front","average":{"1min":56.292000000000002,"5min":14.568,"15min":9.3480000000000008},"min":{"1min":3.1400000000000001,"5min":1.849,"15min":1.849},"max":{"1min":998.899,"5min":998.899,"15min":998.899},"last":4.1130000000000004}]},{"osd":8,"last update":"Mon Nov 16 22:16:39 2020","interfaces":[{"interface":"back","average":{"1min":3.48,"5min":3.5910000000000002,"15min":4.4240000000000004},"min":{"1min":2.7669999999999999,"5min":2.383,"15min":2.173},"max":{"1min":4.4900000000000002,"5min":5.6900000000000004,"15min":194.994},"last":2.6589999999999998},{"interface":"front","average":{"1min":4.0119999999999996,"5min":12.629,"15min":8.4160000000000004},"min":{"1min":2.653,"5min":2.653,"15min":2.6480000000000001},"max":{"1min":5.6040000000000001,"5min":721.20799999999997,"15min":721.20799999999997},"last":4.0549999999999997}]},{"osd":9,"last update":"Mon Nov 16 22:16:21 2020","interfaces":[{"interface":"back","average":{"1min":68.367000000000004,"5min":17.298999999999999,"15min":11.297000000000001},"min":{"1min":2.4630000000000001,"5min":2.3599999999999999,"15min":2.3599999999999999},"max":{"1min":892.56500000000005,"5min":892.56500000000005,"15min":892.56500000000005},"last":4.21},{"interface":"front","average":{"1min":3.7200000000000002,"5min":3.9990000000000001,"15min":6.1440000000000001},"min":{"1min":2.722,"5min":2.629,"15min":1.8380000000000001},"max":{"1min":4.5979999999999999,"5min":7.4669999999999996,"15min":497.57499999999999},"last":3.597}]},{"osd":10,"last update":"Mon Nov 16 22:16:39 2020","interfaces":[{"interface":"back","average":{"1min":3.633,"5min":3.9430000000000001,"15min":5.774},"min":{"1min":2.8719999999999999,"5min":2.5230000000000001,"15min":2.5230000000000001},"max":{"1min":4.8540000000000001,"5min":5.9279999999999999,"15min":439.07100000000003},"last":2.9380000000000002},{"interface":"front","average":{"1min":4.524,"5min":4.5780000000000003,"15min":5.4669999999999996},"min":{"1min":3.8239999999999998,"5min":2.4380000000000002,"15min":2.4380000000000002},"max":{"1min":6.1929999999999996,"5min":6.71,"15min":272.98599999999999},"last":4.1639999999999997}]}]},{"osd":5,"up_from":38,"seq":163208757493,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":130520,"kb_used_data":87568,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":93614632,"statfs":{"total":95995035648,"available":95861383168,"internally_reserved":0,"allocated":89669632,"data_stored":118640005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 16 22:16:46 2020","interfaces":[{"interface":"back","average":{"1min":2.3660000000000001,"5min":14.992000000000001,"15min":14.917},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":4.0460000000000003,"5min":629.39200000000005,"15min":980.71799999999996},"last":4.4640000000000004},{"interface":"front","average":{"1min":2.4609999999999999,"5min":5.4779999999999998,"15min":10.192},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":3.1669999999999998,"5min":287.44900000000001,"15min":761.03399999999999},"last":2.4430000000000001}]},{"osd":1,"last update":"Mon Nov 16 22:16:46 2020","interfaces":[{"interface":"back","average":{"1min":2.5019999999999998,"5min":2.528,"15min":3.0249999999999999},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":3.371,"5min":4.4210000000000003,"15min":90.531000000000006},"last":2.5790000000000002},{"interface":"front","average":{"1min":3.0219999999999998,"5min":12.053000000000001,"15min":11.483000000000001},"min":{"1min":1.6890000000000001,"5min":1.228,"15min":1.131},"max":{"1min":4.0880000000000001,"5min":869.15899999999999,"15min":869.15899999999999},"last":3.3940000000000001}]},{"osd":2,"last update":"Mon Nov 16 22:16:46 2020","interfaces":[{"interface":"back","average":{"1min":26.805,"5min":26.039999999999999,"15min":10.593999999999999},"min":{"1min":1.825,"5min":1.548,"15min":1.0760000000000001},"max":{"1min":359.19099999999997,"5min":943.75999999999999,"15min":943.75999999999999},"last":3.5680000000000001},{"interface":"front","average":{"1min":26.468,"5min":7.8550000000000004,"15min":10.956},"min":{"1min":2.016,"5min":1.3680000000000001,"15min":1.129},"max":{"1min":350.11000000000001,"5min":350.11000000000001,"15min":958.97900000000004},"last":1.609}]},{"osd":3,"last update":"Mon Nov 16 22:16:46 2020","interfaces":[{"interface":"back","average":{"1min":3.5910000000000002,"5min":10.321999999999999,"15min":6.8150000000000004},"min":{"1min":1.9319999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"max":{"1min":4.9039999999999999,"5min":575.03599999999994,"15min":575.03599999999994},"last":3.8109999999999999},{"interface":"front","average":{"1min":2.7799999999999998,"5min":2.9790000000000001,"15min":6.4299999999999997},"min":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"max":{"1min":3.5379999999999998,"5min":5.3920000000000003,"15min":648.38900000000001},"last":2.6579999999999999}]},{"osd":4,"last update":"Mon Nov 16 22:16:46 2020","interfaces":[{"interface":"back","average":{"1min":2.6880000000000002,"5min":11.834,"15min":9.2889999999999997},"min":{"1min":0.96799999999999997,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":4.2069999999999999,"5min":867.05200000000002,"15min":867.05200000000002},"last":4.0949999999999998},{"interface":"front","average":{"1min":3.3740000000000001,"5min":11.984999999999999,"15min":8.2569999999999997},"min":{"1min":2.0510000000000002,"5min":1.083,"15min":1.083},"max":{"1min":4.3129999999999997,"5min":881.35900000000004,"15min":881.35900000000004},"last":3.6989999999999998}]},{"osd":6,"last update":"Mon Nov 16 22:16:49 2020","interfaces":[{"interface":"back","average":{"1min":3.0339999999999998,"5min":3.2069999999999999,"15min":6.1509999999999998},"min":{"1min":1.786,"5min":1.512,"15min":1.3839999999999999},"max":{"1min":4.3659999999999997,"5min":6.2960000000000003,"15min":545.88199999999995},"last":4.2130000000000001},{"interface":"front","average":{"1min":3.379,"5min":3.661,"15min":6.867},"min":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.0309999999999999},"max":{"1min":4.4909999999999997,"5min":6.5019999999999998,"15min":665.70299999999997},"last":4.3070000000000004}]},{"osd":7,"last update":"Mon Nov 16 22:16:39 2020","interfaces":[{"interface":"back","average":{"1min":3.6619999999999999,"5min":4.0789999999999997,"15min":11.609},"min":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"max":{"1min":4.6029999999999998,"5min":6.5960000000000001,"15min":974.45100000000002},"last":4.5359999999999996},{"interface":"front","average":{"1min":3.6299999999999999,"5min":22.123000000000001,"15min":13.16},"min":{"1min":1.4830000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":4.3940000000000001,"5min":837.66099999999994,"15min":841.404},"last":3.5299999999999998}]},{"osd":8,"last update":"Mon Nov 16 22:16:49 2020","interfaces":[{"interface":"back","average":{"1min":4.0149999999999997,"5min":4.1749999999999998,"15min":11.177},"min":{"1min":1.54,"5min":1.54,"15min":1.54},"max":{"1min":5.032,"5min":6.7439999999999998,"15min":986.25900000000001},"last":4.5949999999999998},{"interface":"front","average":{"1min":3.6640000000000001,"5min":17.27,"15min":10.289},"min":{"1min":1.833,"5min":1.429,"15min":1.429},"max":{"1min":5.6429999999999998,"5min":955.78999999999996,"15min":955.78999999999996},"last":3.7570000000000001}]},{"osd":9,"last update":"Mon Nov 16 22:16:18 2020","interfaces":[{"interface":"back","average":{"1min":21.904,"5min":13.130000000000001,"15min":16.457000000000001},"min":{"1min":2.3340000000000001,"5min":1.625,"15min":1.625},"max":{"1min":271.36399999999998,"5min":553.35299999999995,"15min":756.26400000000001},"last":3.9119999999999999},{"interface":"front","average":{"1min":3.706,"5min":15.907999999999999,"15min":9.1129999999999995},"min":{"1min":1.744,"5min":1.744,"15min":1.744},"max":{"1min":4.601,"5min":1004.2569999999999,"15min":1004.2569999999999},"last":3.6539999999999999}]},{"osd":10,"last update":"Mon Nov 16 22:16:46 2020","interfaces":[{"interface":"back","average":{"1min":4.133,"5min":11.961,"15min":6.9180000000000001},"min":{"1min":1.597,"5min":1.597,"15min":1.597},"max":{"1min":5.1630000000000003,"5min":758.51400000000001,"15min":758.51400000000001},"last":4.6399999999999997},{"interface":"front","average":{"1min":4.1790000000000003,"5min":4.2889999999999997,"15min":8.8170000000000002},"min":{"1min":2.0859999999999999,"5min":2.0030000000000001,"15min":2.0030000000000001},"max":{"1min":5.141,"5min":6.2779999999999996,"15min":657.98699999999997},"last":4.3769999999999998}]}]}]}} 2020-11-16T22:17:09.401 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_0 2020-11-16T22:17:09.402 INFO:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:911cc35794d871071a8bebfb0919482263b1d18b shell --fsid bcd5108e-2855-11eb-a2b2-001a4aab830c -- ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2020-11-16T22:17:09.541 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/mon.a/config 2020-11-16T22:17:09.586 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:17:09 smithi016 bash[10302]: cluster 2020-11-16T22:17:07.892529+0000 mgr.x (mgr.24115) 735 : cluster [DBG] pgmap v1656: 17 pgs: 17 active+clean; 689 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.1 MiB/s wr, 6 op/s 2020-11-16T22:17:09.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:17:09 smithi016 bash[10302]: audit 2020-11-16T22:17:07.933060+0000 mgr.x (mgr.24115) 736 : audit [DBG] from='client.14769 v1:172.21.15.195:0/2941705127' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-11-16T22:17:09.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:17:09 smithi195 bash[10218]: cluster 2020-11-16T22:17:07.892529+0000 mgr.x (mgr.24115) 735 : cluster [DBG] pgmap v1656: 17 pgs: 17 active+clean; 689 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.1 MiB/s wr, 6 op/s 2020-11-16T22:17:09.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:17:09 smithi195 bash[10218]: audit 2020-11-16T22:17:07.933060+0000 mgr.x (mgr.24115) 736 : audit [DBG] from='client.14769 v1:172.21.15.195:0/2941705127' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-11-16T22:17:09.693 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:17:09 smithi057 bash[10301]: cluster 2020-11-16T22:17:07.892529+0000 mgr.x (mgr.24115) 735 : cluster [DBG] pgmap v1656: 17 pgs: 17 active+clean; 689 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 1.1 MiB/s wr, 6 op/s 2020-11-16T22:17:09.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:17:09 smithi057 bash[10301]: audit 2020-11-16T22:17:07.933060+0000 mgr.x (mgr.24115) 736 : audit [DBG] from='client.14769 v1:172.21.15.195:0/2941705127' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2020-11-16T22:17:11.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:17:11 smithi016 bash[10302]: cluster 2020-11-16T22:17:09.893291+0000 mgr.x (mgr.24115) 737 : cluster [DBG] pgmap v1657: 17 pgs: 17 active+clean; 689 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 932 KiB/s wr, 5 op/s 2020-11-16T22:17:11.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:17:11 smithi195 bash[10218]: cluster 2020-11-16T22:17:09.893291+0000 mgr.x (mgr.24115) 737 : cluster [DBG] pgmap v1657: 17 pgs: 17 active+clean; 689 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 932 KiB/s wr, 5 op/s 2020-11-16T22:17:11.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:17:11 smithi057 bash[10301]: cluster 2020-11-16T22:17:09.893291+0000 mgr.x (mgr.24115) 737 : cluster [DBG] pgmap v1657: 17 pgs: 17 active+clean; 689 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 932 KiB/s wr, 5 op/s 2020-11-16T22:17:13.286 INFO:teuthology.orchestra.run.smithi195.stderr:pool 'unique_pool_0' removed 2020-11-16T22:17:13.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:17:13 smithi016 bash[10302]: cluster 2020-11-16T22:17:11.894117+0000 mgr.x (mgr.24115) 738 : cluster [DBG] pgmap v1658: 17 pgs: 17 active+clean; 689 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 210 KiB/s wr, 0 op/s 2020-11-16T22:17:13.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:17:13 smithi016 bash[10302]: audit 2020-11-16T22:17:12.515218+0000 mon.b (mon.1) 322 : audit [INF] from='client.? v1:172.21.15.195:0/3045424693' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2020-11-16T22:17:13.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:17:13 smithi016 bash[10302]: audit 2020-11-16T22:17:12.515453+0000 mon.a (mon.0) 1681 : audit [INF] from='client.24697 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2020-11-16T22:17:13.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:17:13 smithi195 bash[10218]: cluster 2020-11-16T22:17:11.894117+0000 mgr.x (mgr.24115) 738 : cluster [DBG] pgmap v1658: 17 pgs: 17 active+clean; 689 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 210 KiB/s wr, 0 op/s 2020-11-16T22:17:13.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:17:13 smithi195 bash[10218]: audit 2020-11-16T22:17:12.515218+0000 mon.b (mon.1) 322 : audit [INF] from='client.? v1:172.21.15.195:0/3045424693' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2020-11-16T22:17:13.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:17:13 smithi195 bash[10218]: audit 2020-11-16T22:17:12.515453+0000 mon.a (mon.0) 1681 : audit [INF] from='client.24697 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2020-11-16T22:17:13.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:17:13 smithi057 bash[10301]: cluster 2020-11-16T22:17:11.894117+0000 mgr.x (mgr.24115) 738 : cluster [DBG] pgmap v1658: 17 pgs: 17 active+clean; 689 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s rd, 210 KiB/s wr, 0 op/s 2020-11-16T22:17:13.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:17:13 smithi057 bash[10301]: audit 2020-11-16T22:17:12.515218+0000 mon.b (mon.1) 322 : audit [INF] from='client.? v1:172.21.15.195:0/3045424693' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2020-11-16T22:17:13.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:17:13 smithi057 bash[10301]: audit 2020-11-16T22:17:12.515453+0000 mon.a (mon.0) 1681 : audit [INF] from='client.24697 ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2020-11-16T22:17:13.987 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2020-11-16T22:17:13.996 INFO:tasks.cephadm:Teardown begin 2020-11-16T22:17:13.997 INFO:teuthology.orchestra.run.smithi016:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2020-11-16T22:17:14.011 INFO:teuthology.orchestra.run.smithi057:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2020-11-16T22:17:14.022 INFO:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2020-11-16T22:17:14.037 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2020-11-16T22:17:14.038 INFO:teuthology.orchestra.run.smithi016:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2020-11-16T22:17:14.057 INFO:teuthology.orchestra.run.smithi057:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2020-11-16T22:17:14.071 INFO:teuthology.orchestra.run.smithi195:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2020-11-16T22:17:14.086 INFO:tasks.cephadm:Stopping all daemons... 2020-11-16T22:17:14.086 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2020-11-16T22:17:14.087 INFO:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mon.a 2020-11-16T22:17:14.270 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:17:14 smithi195 systemd[1]: Stopping Ceph mon.a for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T22:17:14.600 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:17:14 smithi195 bash[10218]: debug 2020-11-16T22:17:14.277+0000 7f5d4aee0700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-11-16T22:17:14.601 INFO:journalctl@ceph.mon.a.smithi195.stdout:Nov 16 22:17:14 smithi195 bash[10218]: debug 2020-11-16T22:17:14.277+0000 7f5d4aee0700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2020-11-16T22:17:15.118 INFO:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mon.a.service' 2020-11-16T22:17:15.135 DEBUG:teuthology.orchestra.run:got remote process result: None 2020-11-16T22:17:15.136 INFO:tasks.cephadm.mon.a:Stopped mon.a 2020-11-16T22:17:15.136 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2020-11-16T22:17:15.136 INFO:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mon.b 2020-11-16T22:17:15.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:17:15 smithi016 systemd[1]: Stopping Ceph mon.b for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T22:17:15.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:17:15 smithi016 bash[10302]: debug 2020-11-16T22:17:15.300+0000 7fca0aae9700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-11-16T22:17:15.587 INFO:journalctl@ceph.mon.b.smithi016.stdout:Nov 16 22:17:15 smithi016 bash[10302]: debug 2020-11-16T22:17:15.300+0000 7fca0aae9700 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2020-11-16T22:17:16.270 INFO:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mon.b.service' 2020-11-16T22:17:16.298 DEBUG:teuthology.orchestra.run:got remote process result: None 2020-11-16T22:17:16.298 INFO:tasks.cephadm.mon.b:Stopped mon.b 2020-11-16T22:17:16.299 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2020-11-16T22:17:16.299 INFO:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mon.c 2020-11-16T22:17:16.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:17:16 smithi057 systemd[1]: Stopping Ceph mon.c for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T22:17:16.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:17:16 smithi057 bash[10301]: debug 2020-11-16T22:17:16.445+0000 7fe42cb70700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-11-16T22:17:16.694 INFO:journalctl@ceph.mon.c.smithi057.stdout:Nov 16 22:17:16 smithi057 bash[10301]: debug 2020-11-16T22:17:16.445+0000 7fe42cb70700 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2020-11-16T22:17:17.441 INFO:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mon.c.service' 2020-11-16T22:17:17.467 DEBUG:teuthology.orchestra.run:got remote process result: None 2020-11-16T22:17:17.467 INFO:tasks.cephadm.mon.c:Stopped mon.c 2020-11-16T22:17:17.468 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2020-11-16T22:17:17.468 INFO:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mgr.y 2020-11-16T22:17:17.496 INFO:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mgr.y.service' 2020-11-16T22:17:17.561 DEBUG:teuthology.orchestra.run:got remote process result: None 2020-11-16T22:17:17.561 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2020-11-16T22:17:17.561 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2020-11-16T22:17:17.562 INFO:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mgr.x 2020-11-16T22:17:17.837 INFO:journalctl@ceph.mgr.x.smithi016.stdout:Nov 16 22:17:17 smithi016 systemd[1]: Stopping Ceph mgr.x for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T22:17:18.480 INFO:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@mgr.x.service' 2020-11-16T22:17:18.500 DEBUG:teuthology.orchestra.run:got remote process result: None 2020-11-16T22:17:18.500 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2020-11-16T22:17:18.501 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2020-11-16T22:17:18.501 INFO:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.0 2020-11-16T22:17:18.769 INFO:journalctl@ceph.osd.0.smithi195.stdout:Nov 16 22:17:18 smithi195 systemd[1]: Stopping Ceph osd.0 for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T22:17:18.770 INFO:journalctl@ceph.osd.0.smithi195.stdout:Nov 16 22:17:18 smithi195 bash[16359]: debug 2020-11-16T22:17:18.669+0000 7fa9570b2700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-11-16T22:17:18.770 INFO:journalctl@ceph.osd.0.smithi195.stdout:Nov 16 22:17:18 smithi195 bash[16359]: debug 2020-11-16T22:17:18.669+0000 7fa9570b2700 -1 osd.0 992 *** Got signal Terminated *** 2020-11-16T22:17:18.770 INFO:journalctl@ceph.osd.0.smithi195.stdout:Nov 16 22:17:18 smithi195 bash[16359]: debug 2020-11-16T22:17:18.669+0000 7fa9570b2700 -1 osd.0 992 *** Immediate shutdown (osd_fast_shutdown=true) *** 2020-11-16T22:17:19.850 INFO:journalctl@ceph.osd.0.smithi195.stdout:Nov 16 22:17:19 smithi195 docker[31680]: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.0 2020-11-16T22:17:19.850 INFO:journalctl@ceph.osd.0.smithi195.stdout:Nov 16 22:17:19 smithi195 bash[31718]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.0-deactivate 2020-11-16T22:17:21.392 INFO:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.0.service' 2020-11-16T22:17:21.414 DEBUG:teuthology.orchestra.run:got remote process result: None 2020-11-16T22:17:21.415 INFO:tasks.cephadm.osd.0:Stopped osd.0 2020-11-16T22:17:21.415 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2020-11-16T22:17:21.415 INFO:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.1 2020-11-16T22:17:21.704 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:17:21 smithi195 systemd[1]: Stopping Ceph osd.1 for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T22:17:21.704 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:17:21 smithi195 bash[18679]: debug 2020-11-16T22:17:21.593+0000 7f9967e73700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-11-16T22:17:21.705 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:17:21 smithi195 bash[18679]: debug 2020-11-16T22:17:21.593+0000 7f9967e73700 -1 osd.1 992 *** Got signal Terminated *** 2020-11-16T22:17:21.705 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:17:21 smithi195 bash[18679]: debug 2020-11-16T22:17:21.593+0000 7f9967e73700 -1 osd.1 992 *** Immediate shutdown (osd_fast_shutdown=true) *** 2020-11-16T22:17:22.603 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:17:22 smithi195 docker[31831]: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.1 2020-11-16T22:17:22.603 INFO:journalctl@ceph.osd.1.smithi195.stdout:Nov 16 22:17:22 smithi195 bash[31872]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.1-deactivate 2020-11-16T22:17:24.292 INFO:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.1.service' 2020-11-16T22:17:24.318 DEBUG:teuthology.orchestra.run:got remote process result: None 2020-11-16T22:17:24.318 INFO:tasks.cephadm.osd.1:Stopped osd.1 2020-11-16T22:17:24.319 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2020-11-16T22:17:24.319 INFO:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.2 2020-11-16T22:17:24.600 INFO:journalctl@ceph.osd.2.smithi195.stdout:Nov 16 22:17:24 smithi195 systemd[1]: Stopping Ceph osd.2 for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T22:17:24.600 INFO:journalctl@ceph.osd.2.smithi195.stdout:Nov 16 22:17:24 smithi195 bash[21024]: debug 2020-11-16T22:17:24.497+0000 7f3c36f9c700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-11-16T22:17:24.601 INFO:journalctl@ceph.osd.2.smithi195.stdout:Nov 16 22:17:24 smithi195 bash[21024]: debug 2020-11-16T22:17:24.497+0000 7f3c36f9c700 -1 osd.2 992 *** Got signal Terminated *** 2020-11-16T22:17:24.601 INFO:journalctl@ceph.osd.2.smithi195.stdout:Nov 16 22:17:24 smithi195 bash[21024]: debug 2020-11-16T22:17:24.497+0000 7f3c36f9c700 -1 osd.2 992 *** Immediate shutdown (osd_fast_shutdown=true) *** 2020-11-16T22:17:25.600 INFO:journalctl@ceph.osd.2.smithi195.stdout:Nov 16 22:17:25 smithi195 docker[31978]: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.2 2020-11-16T22:17:25.600 INFO:journalctl@ceph.osd.2.smithi195.stdout:Nov 16 22:17:25 smithi195 bash[32018]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.2-deactivate 2020-11-16T22:17:26.999 INFO:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.2.service' 2020-11-16T22:17:27.025 DEBUG:teuthology.orchestra.run:got remote process result: None 2020-11-16T22:17:27.026 INFO:tasks.cephadm.osd.2:Stopped osd.2 2020-11-16T22:17:27.026 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2020-11-16T22:17:27.026 INFO:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.3 2020-11-16T22:17:27.310 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 22:17:27 smithi195 systemd[1]: Stopping Ceph osd.3 for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T22:17:27.310 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 22:17:27 smithi195 bash[23354]: debug 2020-11-16T22:17:27.205+0000 7fb4e0506700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-11-16T22:17:27.310 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 22:17:27 smithi195 bash[23354]: debug 2020-11-16T22:17:27.205+0000 7fb4e0506700 -1 osd.3 992 *** Got signal Terminated *** 2020-11-16T22:17:27.310 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 22:17:27 smithi195 bash[23354]: debug 2020-11-16T22:17:27.205+0000 7fb4e0506700 -1 osd.3 992 *** Immediate shutdown (osd_fast_shutdown=true) *** 2020-11-16T22:17:28.354 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 22:17:27 smithi195 docker[32128]: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.3 2020-11-16T22:17:28.355 INFO:journalctl@ceph.osd.3.smithi195.stdout:Nov 16 22:17:27 smithi195 bash[32172]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.3-deactivate 2020-11-16T22:17:29.711 INFO:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.3.service' 2020-11-16T22:17:29.734 DEBUG:teuthology.orchestra.run:got remote process result: None 2020-11-16T22:17:29.734 INFO:tasks.cephadm.osd.3:Stopped osd.3 2020-11-16T22:17:29.735 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2020-11-16T22:17:29.735 INFO:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.4 2020-11-16T22:17:30.041 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 22:17:29 smithi016 systemd[1]: Stopping Ceph osd.4 for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T22:17:30.041 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 22:17:29 smithi016 bash[12795]: debug 2020-11-16T22:17:29.896+0000 7f730909c700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-11-16T22:17:30.041 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 22:17:29 smithi016 bash[12795]: debug 2020-11-16T22:17:29.896+0000 7f730909c700 -1 osd.4 992 *** Got signal Terminated *** 2020-11-16T22:17:30.041 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 22:17:29 smithi016 bash[12795]: debug 2020-11-16T22:17:29.896+0000 7f730909c700 -1 osd.4 992 *** Immediate shutdown (osd_fast_shutdown=true) *** 2020-11-16T22:17:31.086 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 22:17:30 smithi016 docker[21299]: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.4 2020-11-16T22:17:31.087 INFO:journalctl@ceph.osd.4.smithi016.stdout:Nov 16 22:17:30 smithi016 bash[21343]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.4-deactivate 2020-11-16T22:17:33.038 INFO:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.4.service' 2020-11-16T22:17:33.061 DEBUG:teuthology.orchestra.run:got remote process result: None 2020-11-16T22:17:33.062 INFO:tasks.cephadm.osd.4:Stopped osd.4 2020-11-16T22:17:33.062 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2020-11-16T22:17:33.062 INFO:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.5 2020-11-16T22:17:33.336 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 22:17:33 smithi016 systemd[1]: Stopping Ceph osd.5 for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T22:17:33.337 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 22:17:33 smithi016 bash[15120]: debug 2020-11-16T22:17:33.248+0000 7f8fe261b700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-11-16T22:17:33.337 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 22:17:33 smithi016 bash[15120]: debug 2020-11-16T22:17:33.248+0000 7f8fe261b700 -1 osd.5 992 *** Got signal Terminated *** 2020-11-16T22:17:33.337 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 22:17:33 smithi016 bash[15120]: debug 2020-11-16T22:17:33.248+0000 7f8fe261b700 -1 osd.5 992 *** Immediate shutdown (osd_fast_shutdown=true) *** 2020-11-16T22:17:34.336 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 22:17:33 smithi016 docker[21453]: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.5 2020-11-16T22:17:34.337 INFO:journalctl@ceph.osd.5.smithi016.stdout:Nov 16 22:17:34 smithi016 bash[21492]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.5-deactivate 2020-11-16T22:17:36.038 INFO:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.5.service' 2020-11-16T22:17:36.063 DEBUG:teuthology.orchestra.run:got remote process result: None 2020-11-16T22:17:36.064 INFO:tasks.cephadm.osd.5:Stopped osd.5 2020-11-16T22:17:36.064 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2020-11-16T22:17:36.064 INFO:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.6 2020-11-16T22:17:36.336 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 22:17:36 smithi016 systemd[1]: Stopping Ceph osd.6 for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T22:17:36.337 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 22:17:36 smithi016 bash[17468]: debug 2020-11-16T22:17:36.248+0000 7fd684f4a700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-11-16T22:17:36.337 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 22:17:36 smithi016 bash[17468]: debug 2020-11-16T22:17:36.248+0000 7fd684f4a700 -1 osd.6 992 *** Got signal Terminated *** 2020-11-16T22:17:36.337 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 22:17:36 smithi016 bash[17468]: debug 2020-11-16T22:17:36.248+0000 7fd684f4a700 -1 osd.6 992 *** Immediate shutdown (osd_fast_shutdown=true) *** 2020-11-16T22:17:37.586 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 22:17:37 smithi016 docker[21601]: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.6 2020-11-16T22:17:37.587 INFO:journalctl@ceph.osd.6.smithi016.stdout:Nov 16 22:17:37 smithi016 bash[21641]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.6-deactivate 2020-11-16T22:17:39.156 INFO:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.6.service' 2020-11-16T22:17:39.176 DEBUG:teuthology.orchestra.run:got remote process result: None 2020-11-16T22:17:39.177 INFO:tasks.cephadm.osd.6:Stopped osd.6 2020-11-16T22:17:39.177 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2020-11-16T22:17:39.178 INFO:teuthology.orchestra.run.smithi016:> sudo systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.7 2020-11-16T22:17:39.498 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:17:39 smithi016 systemd[1]: Stopping Ceph osd.7 for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T22:17:39.498 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:17:39 smithi016 bash[19825]: debug 2020-11-16T22:17:39.364+0000 7f0e34c89700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-11-16T22:17:39.498 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:17:39 smithi016 bash[19825]: debug 2020-11-16T22:17:39.364+0000 7f0e34c89700 -1 osd.7 992 *** Got signal Terminated *** 2020-11-16T22:17:39.498 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:17:39 smithi016 bash[19825]: debug 2020-11-16T22:17:39.368+0000 7f0e34c89700 -1 osd.7 992 *** Immediate shutdown (osd_fast_shutdown=true) *** 2020-11-16T22:17:40.336 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:17:40 smithi016 docker[21747]: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.7 2020-11-16T22:17:40.337 INFO:journalctl@ceph.osd.7.smithi016.stdout:Nov 16 22:17:40 smithi016 bash[21785]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.7-deactivate 2020-11-16T22:17:40.944 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:17:40 smithi057 bash[12595]: debug 2020-11-16T22:17:40.689+0000 7f7396989700 -1 osd.8 992 heartbeat_check: no reply from 172.21.15.195:6802 osd.0 since back 2020-11-16T22:17:15.375336+0000 front 2020-11-16T22:17:15.373962+0000 (oldest deadline 2020-11-16T22:17:40.073247+0000) 2020-11-16T22:17:41.944 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:17:41 smithi057 bash[12595]: debug 2020-11-16T22:17:41.669+0000 7f7396989700 -1 osd.8 992 heartbeat_check: no reply from 172.21.15.195:6802 osd.0 since back 2020-11-16T22:17:15.375336+0000 front 2020-11-16T22:17:15.373962+0000 (oldest deadline 2020-11-16T22:17:40.073247+0000) 2020-11-16T22:17:41.944 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:41 smithi057 bash[19569]: debug 2020-11-16T22:17:41.737+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6802 osd.0 since back 2020-11-16T22:17:15.391709+0000 front 2020-11-16T22:17:15.391330+0000 (oldest deadline 2020-11-16T22:17:41.291465+0000) 2020-11-16T22:17:42.083 INFO:teuthology.orchestra.run.smithi016:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.7.service' 2020-11-16T22:17:42.113 DEBUG:teuthology.orchestra.run:got remote process result: None 2020-11-16T22:17:42.114 INFO:tasks.cephadm.osd.7:Stopped osd.7 2020-11-16T22:17:42.114 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2020-11-16T22:17:42.114 INFO:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.8 2020-11-16T22:17:42.395 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 22:17:42 smithi057 bash[14912]: debug 2020-11-16T22:17:42.333+0000 7faa8b309700 -1 osd.9 992 heartbeat_check: no reply from 172.21.15.195:6802 osd.0 since back 2020-11-16T22:17:18.143927+0000 front 2020-11-16T22:17:18.144890+0000 (oldest deadline 2020-11-16T22:17:41.644123+0000) 2020-11-16T22:17:42.395 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:17:42 smithi057 systemd[1]: Stopping Ceph osd.8 for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T22:17:42.395 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:17:42 smithi057 bash[12595]: debug 2020-11-16T22:17:42.273+0000 7f7399a08700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-11-16T22:17:42.395 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:17:42 smithi057 bash[12595]: debug 2020-11-16T22:17:42.273+0000 7f7399a08700 -1 osd.8 992 *** Got signal Terminated *** 2020-11-16T22:17:42.395 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:17:42 smithi057 bash[12595]: debug 2020-11-16T22:17:42.273+0000 7f7399a08700 -1 osd.8 992 *** Immediate shutdown (osd_fast_shutdown=true) *** 2020-11-16T22:17:43.043 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:42 smithi057 bash[19569]: debug 2020-11-16T22:17:42.761+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6802 osd.0 since back 2020-11-16T22:17:15.391709+0000 front 2020-11-16T22:17:15.391330+0000 (oldest deadline 2020-11-16T22:17:41.291465+0000) 2020-11-16T22:17:43.043 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:42 smithi057 bash[19569]: debug 2020-11-16T22:17:42.761+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6806 osd.1 since back 2020-11-16T22:17:21.293003+0000 front 2020-11-16T22:17:21.293088+0000 (oldest deadline 2020-11-16T22:17:42.392960+0000) 2020-11-16T22:17:43.044 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 22:17:42 smithi057 bash[17237]: debug 2020-11-16T22:17:42.901+0000 7f18114ab700 -1 osd.10 992 heartbeat_check: no reply from 172.21.15.195:6806 osd.1 since back 2020-11-16T22:17:18.626520+0000 front 2020-11-16T22:17:18.628135+0000 (oldest deadline 2020-11-16T22:17:42.726748+0000) 2020-11-16T22:17:43.331 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:17:43 smithi057 docker[20982]: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.8 2020-11-16T22:17:43.331 INFO:journalctl@ceph.osd.8.smithi057.stdout:Nov 16 22:17:43 smithi057 bash[21023]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.8-deactivate 2020-11-16T22:17:43.694 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 22:17:43 smithi057 bash[14912]: debug 2020-11-16T22:17:43.345+0000 7faa8b309700 -1 osd.9 992 heartbeat_check: no reply from 172.21.15.195:6802 osd.0 since back 2020-11-16T22:17:18.143927+0000 front 2020-11-16T22:17:18.144890+0000 (oldest deadline 2020-11-16T22:17:41.644123+0000) 2020-11-16T22:17:44.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 22:17:43 smithi057 bash[17237]: debug 2020-11-16T22:17:43.897+0000 7f18114ab700 -1 osd.10 992 heartbeat_check: no reply from 172.21.15.195:6806 osd.1 since back 2020-11-16T22:17:18.626520+0000 front 2020-11-16T22:17:18.628135+0000 (oldest deadline 2020-11-16T22:17:42.726748+0000) 2020-11-16T22:17:44.194 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:43 smithi057 bash[19569]: debug 2020-11-16T22:17:43.801+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6802 osd.0 since back 2020-11-16T22:17:15.391709+0000 front 2020-11-16T22:17:15.391330+0000 (oldest deadline 2020-11-16T22:17:41.291465+0000) 2020-11-16T22:17:44.195 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:43 smithi057 bash[19569]: debug 2020-11-16T22:17:43.801+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6806 osd.1 since back 2020-11-16T22:17:21.293003+0000 front 2020-11-16T22:17:21.293088+0000 (oldest deadline 2020-11-16T22:17:42.392960+0000) 2020-11-16T22:17:44.694 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 22:17:44 smithi057 bash[14912]: debug 2020-11-16T22:17:44.385+0000 7faa8b309700 -1 osd.9 992 heartbeat_check: no reply from 172.21.15.195:6802 osd.0 since back 2020-11-16T22:17:18.143927+0000 front 2020-11-16T22:17:18.144890+0000 (oldest deadline 2020-11-16T22:17:41.644123+0000) 2020-11-16T22:17:45.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 22:17:44 smithi057 bash[17237]: debug 2020-11-16T22:17:44.941+0000 7f18114ab700 -1 osd.10 992 heartbeat_check: no reply from 172.21.15.195:6806 osd.1 since back 2020-11-16T22:17:18.626520+0000 front 2020-11-16T22:17:18.628135+0000 (oldest deadline 2020-11-16T22:17:42.726748+0000) 2020-11-16T22:17:45.194 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:44 smithi057 bash[19569]: debug 2020-11-16T22:17:44.773+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6802 osd.0 since back 2020-11-16T22:17:15.391709+0000 front 2020-11-16T22:17:15.391330+0000 (oldest deadline 2020-11-16T22:17:41.291465+0000) 2020-11-16T22:17:45.195 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:44 smithi057 bash[19569]: debug 2020-11-16T22:17:44.773+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6806 osd.1 since back 2020-11-16T22:17:21.293003+0000 front 2020-11-16T22:17:21.293088+0000 (oldest deadline 2020-11-16T22:17:42.392960+0000) 2020-11-16T22:17:45.195 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:44 smithi057 bash[19569]: debug 2020-11-16T22:17:44.773+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6810 osd.2 since back 2020-11-16T22:17:22.394896+0000 front 2020-11-16T22:17:22.394769+0000 (oldest deadline 2020-11-16T22:17:44.694064+0000) 2020-11-16T22:17:45.514 INFO:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.8.service' 2020-11-16T22:17:45.538 DEBUG:teuthology.orchestra.run:got remote process result: None 2020-11-16T22:17:45.538 INFO:tasks.cephadm.osd.8:Stopped osd.8 2020-11-16T22:17:45.539 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2020-11-16T22:17:45.539 INFO:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.9 2020-11-16T22:17:45.694 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 22:17:45 smithi057 bash[14912]: debug 2020-11-16T22:17:45.417+0000 7faa8b309700 -1 osd.9 992 heartbeat_check: no reply from 172.21.15.195:6802 osd.0 since back 2020-11-16T22:17:18.143927+0000 front 2020-11-16T22:17:18.144890+0000 (oldest deadline 2020-11-16T22:17:41.644123+0000) 2020-11-16T22:17:45.694 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 22:17:45 smithi057 bash[14912]: debug 2020-11-16T22:17:45.417+0000 7faa8b309700 -1 osd.9 992 heartbeat_check: no reply from 172.21.15.195:6806 osd.1 since back 2020-11-16T22:17:18.145064+0000 front 2020-11-16T22:17:18.144843+0000 (oldest deadline 2020-11-16T22:17:44.545344+0000) 2020-11-16T22:17:45.694 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 22:17:45 smithi057 systemd[1]: Stopping Ceph osd.9 for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T22:17:46.194 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 22:17:45 smithi057 bash[14912]: debug 2020-11-16T22:17:45.753+0000 7faa8e388700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-11-16T22:17:46.195 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 22:17:45 smithi057 bash[14912]: debug 2020-11-16T22:17:45.753+0000 7faa8e388700 -1 osd.9 992 *** Got signal Terminated *** 2020-11-16T22:17:46.195 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 22:17:45 smithi057 bash[14912]: debug 2020-11-16T22:17:45.753+0000 7faa8e388700 -1 osd.9 992 *** Immediate shutdown (osd_fast_shutdown=true) *** 2020-11-16T22:17:46.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 22:17:45 smithi057 bash[17237]: debug 2020-11-16T22:17:45.913+0000 7f18114ab700 -1 osd.10 992 heartbeat_check: no reply from 172.21.15.195:6806 osd.1 since back 2020-11-16T22:17:18.626520+0000 front 2020-11-16T22:17:18.628135+0000 (oldest deadline 2020-11-16T22:17:42.726748+0000) 2020-11-16T22:17:46.195 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 22:17:45 smithi057 bash[17237]: debug 2020-11-16T22:17:45.913+0000 7f18114ab700 -1 osd.10 992 heartbeat_check: no reply from 172.21.15.195:6810 osd.2 since back 2020-11-16T22:17:23.830339+0000 front 2020-11-16T22:17:23.830186+0000 (oldest deadline 2020-11-16T22:17:45.530352+0000) 2020-11-16T22:17:46.195 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:45 smithi057 bash[19569]: debug 2020-11-16T22:17:45.749+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6802 osd.0 since back 2020-11-16T22:17:15.391709+0000 front 2020-11-16T22:17:15.391330+0000 (oldest deadline 2020-11-16T22:17:41.291465+0000) 2020-11-16T22:17:46.195 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:45 smithi057 bash[19569]: debug 2020-11-16T22:17:45.749+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6806 osd.1 since back 2020-11-16T22:17:21.293003+0000 front 2020-11-16T22:17:21.293088+0000 (oldest deadline 2020-11-16T22:17:42.392960+0000) 2020-11-16T22:17:46.196 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:45 smithi057 bash[19569]: debug 2020-11-16T22:17:45.749+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6810 osd.2 since back 2020-11-16T22:17:22.394896+0000 front 2020-11-16T22:17:22.394769+0000 (oldest deadline 2020-11-16T22:17:44.694064+0000) 2020-11-16T22:17:46.944 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 22:17:46 smithi057 docker[21128]: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.9 2020-11-16T22:17:46.944 INFO:journalctl@ceph.osd.9.smithi057.stdout:Nov 16 22:17:46 smithi057 bash[21168]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.9-deactivate 2020-11-16T22:17:46.945 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:46 smithi057 bash[19569]: debug 2020-11-16T22:17:46.721+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6802 osd.0 since back 2020-11-16T22:17:15.391709+0000 front 2020-11-16T22:17:15.391330+0000 (oldest deadline 2020-11-16T22:17:41.291465+0000) 2020-11-16T22:17:46.945 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:46 smithi057 bash[19569]: debug 2020-11-16T22:17:46.721+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6806 osd.1 since back 2020-11-16T22:17:21.293003+0000 front 2020-11-16T22:17:21.293088+0000 (oldest deadline 2020-11-16T22:17:42.392960+0000) 2020-11-16T22:17:46.945 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:46 smithi057 bash[19569]: debug 2020-11-16T22:17:46.721+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6810 osd.2 since back 2020-11-16T22:17:22.394896+0000 front 2020-11-16T22:17:22.394769+0000 (oldest deadline 2020-11-16T22:17:44.694064+0000) 2020-11-16T22:17:47.444 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 22:17:46 smithi057 bash[17237]: debug 2020-11-16T22:17:46.961+0000 7f18114ab700 -1 osd.10 992 heartbeat_check: no reply from 172.21.15.195:6806 osd.1 since back 2020-11-16T22:17:18.626520+0000 front 2020-11-16T22:17:18.628135+0000 (oldest deadline 2020-11-16T22:17:42.726748+0000) 2020-11-16T22:17:47.444 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 22:17:46 smithi057 bash[17237]: debug 2020-11-16T22:17:46.961+0000 7f18114ab700 -1 osd.10 992 heartbeat_check: no reply from 172.21.15.195:6810 osd.2 since back 2020-11-16T22:17:23.830339+0000 front 2020-11-16T22:17:23.830186+0000 (oldest deadline 2020-11-16T22:17:45.530352+0000) 2020-11-16T22:17:47.922 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:47 smithi057 bash[19569]: debug 2020-11-16T22:17:47.753+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6802 osd.0 since back 2020-11-16T22:17:15.391709+0000 front 2020-11-16T22:17:15.391330+0000 (oldest deadline 2020-11-16T22:17:41.291465+0000) 2020-11-16T22:17:47.923 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:47 smithi057 bash[19569]: debug 2020-11-16T22:17:47.753+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6806 osd.1 since back 2020-11-16T22:17:21.293003+0000 front 2020-11-16T22:17:21.293088+0000 (oldest deadline 2020-11-16T22:17:42.392960+0000) 2020-11-16T22:17:47.923 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:47 smithi057 bash[19569]: debug 2020-11-16T22:17:47.753+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6810 osd.2 since back 2020-11-16T22:17:22.394896+0000 front 2020-11-16T22:17:22.394769+0000 (oldest deadline 2020-11-16T22:17:44.694064+0000) 2020-11-16T22:17:48.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 22:17:47 smithi057 bash[17237]: debug 2020-11-16T22:17:47.933+0000 7f18114ab700 -1 osd.10 992 heartbeat_check: no reply from 172.21.15.195:6806 osd.1 since back 2020-11-16T22:17:18.626520+0000 front 2020-11-16T22:17:18.628135+0000 (oldest deadline 2020-11-16T22:17:42.726748+0000) 2020-11-16T22:17:48.194 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 22:17:47 smithi057 bash[17237]: debug 2020-11-16T22:17:47.933+0000 7f18114ab700 -1 osd.10 992 heartbeat_check: no reply from 172.21.15.195:6810 osd.2 since back 2020-11-16T22:17:23.830339+0000 front 2020-11-16T22:17:23.830186+0000 (oldest deadline 2020-11-16T22:17:45.530352+0000) 2020-11-16T22:17:48.650 INFO:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.9.service' 2020-11-16T22:17:48.675 DEBUG:teuthology.orchestra.run:got remote process result: None 2020-11-16T22:17:48.675 INFO:tasks.cephadm.osd.9:Stopped osd.9 2020-11-16T22:17:48.676 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2020-11-16T22:17:48.676 INFO:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.10 2020-11-16T22:17:48.944 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:48 smithi057 bash[19569]: debug 2020-11-16T22:17:48.749+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6802 osd.0 since back 2020-11-16T22:17:15.391709+0000 front 2020-11-16T22:17:15.391330+0000 (oldest deadline 2020-11-16T22:17:41.291465+0000) 2020-11-16T22:17:48.944 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:48 smithi057 bash[19569]: debug 2020-11-16T22:17:48.749+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6806 osd.1 since back 2020-11-16T22:17:21.293003+0000 front 2020-11-16T22:17:21.293088+0000 (oldest deadline 2020-11-16T22:17:42.392960+0000) 2020-11-16T22:17:48.944 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:48 smithi057 bash[19569]: debug 2020-11-16T22:17:48.749+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6810 osd.2 since back 2020-11-16T22:17:22.394896+0000 front 2020-11-16T22:17:22.394769+0000 (oldest deadline 2020-11-16T22:17:44.694064+0000) 2020-11-16T22:17:48.944 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 22:17:48 smithi057 systemd[1]: Stopping Ceph osd.10 for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T22:17:48.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 22:17:48 smithi057 bash[17237]: debug 2020-11-16T22:17:48.869+0000 7f181452a700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-11-16T22:17:48.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 22:17:48 smithi057 bash[17237]: debug 2020-11-16T22:17:48.869+0000 7f181452a700 -1 osd.10 992 *** Got signal Terminated *** 2020-11-16T22:17:48.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 22:17:48 smithi057 bash[17237]: debug 2020-11-16T22:17:48.869+0000 7f181452a700 -1 osd.10 992 *** Immediate shutdown (osd_fast_shutdown=true) *** 2020-11-16T22:17:49.944 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 22:17:49 smithi057 docker[21281]: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.10 2020-11-16T22:17:49.945 INFO:journalctl@ceph.osd.10.smithi057.stdout:Nov 16 22:17:49 smithi057 bash[21320]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.10-deactivate 2020-11-16T22:17:49.945 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:49 smithi057 bash[19569]: debug 2020-11-16T22:17:49.745+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6802 osd.0 since back 2020-11-16T22:17:15.391709+0000 front 2020-11-16T22:17:15.391330+0000 (oldest deadline 2020-11-16T22:17:41.291465+0000) 2020-11-16T22:17:49.945 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:49 smithi057 bash[19569]: debug 2020-11-16T22:17:49.745+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6806 osd.1 since back 2020-11-16T22:17:21.293003+0000 front 2020-11-16T22:17:21.293088+0000 (oldest deadline 2020-11-16T22:17:42.392960+0000) 2020-11-16T22:17:49.945 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:49 smithi057 bash[19569]: debug 2020-11-16T22:17:49.745+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6810 osd.2 since back 2020-11-16T22:17:22.394896+0000 front 2020-11-16T22:17:22.394769+0000 (oldest deadline 2020-11-16T22:17:44.694064+0000) 2020-11-16T22:17:49.945 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:49 smithi057 bash[19569]: debug 2020-11-16T22:17:49.745+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6814 osd.3 since back 2020-11-16T22:17:25.197038+0000 front 2020-11-16T22:17:25.197656+0000 (oldest deadline 2020-11-16T22:17:49.296932+0000) 2020-11-16T22:17:50.944 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:50 smithi057 bash[19569]: debug 2020-11-16T22:17:50.784+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6802 osd.0 since back 2020-11-16T22:17:15.391709+0000 front 2020-11-16T22:17:15.391330+0000 (oldest deadline 2020-11-16T22:17:41.291465+0000) 2020-11-16T22:17:50.944 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:50 smithi057 bash[19569]: debug 2020-11-16T22:17:50.784+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6806 osd.1 since back 2020-11-16T22:17:21.293003+0000 front 2020-11-16T22:17:21.293088+0000 (oldest deadline 2020-11-16T22:17:42.392960+0000) 2020-11-16T22:17:50.945 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:50 smithi057 bash[19569]: debug 2020-11-16T22:17:50.784+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6810 osd.2 since back 2020-11-16T22:17:22.394896+0000 front 2020-11-16T22:17:22.394769+0000 (oldest deadline 2020-11-16T22:17:44.694064+0000) 2020-11-16T22:17:50.945 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:50 smithi057 bash[19569]: debug 2020-11-16T22:17:50.784+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6814 osd.3 since back 2020-11-16T22:17:25.197038+0000 front 2020-11-16T22:17:25.197656+0000 (oldest deadline 2020-11-16T22:17:49.296932+0000) 2020-11-16T22:17:51.776 INFO:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.10.service' 2020-11-16T22:17:51.800 DEBUG:teuthology.orchestra.run:got remote process result: None 2020-11-16T22:17:51.800 INFO:tasks.cephadm.osd.10:Stopped osd.10 2020-11-16T22:17:51.801 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2020-11-16T22:17:51.801 INFO:teuthology.orchestra.run.smithi057:> sudo systemctl stop ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.11 2020-11-16T22:17:52.080 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:51 smithi057 bash[19569]: debug 2020-11-16T22:17:51.788+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6802 osd.0 since back 2020-11-16T22:17:15.391709+0000 front 2020-11-16T22:17:15.391330+0000 (oldest deadline 2020-11-16T22:17:41.291465+0000) 2020-11-16T22:17:52.080 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:51 smithi057 bash[19569]: debug 2020-11-16T22:17:51.788+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6806 osd.1 since back 2020-11-16T22:17:21.293003+0000 front 2020-11-16T22:17:21.293088+0000 (oldest deadline 2020-11-16T22:17:42.392960+0000) 2020-11-16T22:17:52.081 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:51 smithi057 bash[19569]: debug 2020-11-16T22:17:51.788+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6810 osd.2 since back 2020-11-16T22:17:22.394896+0000 front 2020-11-16T22:17:22.394769+0000 (oldest deadline 2020-11-16T22:17:44.694064+0000) 2020-11-16T22:17:52.081 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:51 smithi057 bash[19569]: debug 2020-11-16T22:17:51.788+0000 7f5e2a0f9700 -1 osd.11 992 heartbeat_check: no reply from 172.21.15.195:6814 osd.3 since back 2020-11-16T22:17:25.197038+0000 front 2020-11-16T22:17:25.197656+0000 (oldest deadline 2020-11-16T22:17:49.296932+0000) 2020-11-16T22:17:52.081 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:51 smithi057 systemd[1]: Stopping Ceph osd.11 for bcd5108e-2855-11eb-a2b2-001a4aab830c... 2020-11-16T22:17:52.081 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:51 smithi057 bash[19569]: debug 2020-11-16T22:17:51.980+0000 7f5e31180700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-11-16T22:17:52.081 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:51 smithi057 bash[19569]: debug 2020-11-16T22:17:51.980+0000 7f5e31180700 -1 osd.11 992 *** Got signal Terminated *** 2020-11-16T22:17:52.081 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:51 smithi057 bash[19569]: debug 2020-11-16T22:17:51.980+0000 7f5e31180700 -1 osd.11 992 *** Immediate shutdown (osd_fast_shutdown=true) *** 2020-11-16T22:17:52.945 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:52 smithi057 docker[21422]: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.11 2020-11-16T22:17:52.946 INFO:journalctl@ceph.osd.11.smithi057.stdout:Nov 16 22:17:52 smithi057 bash[21462]: Error: No such container: ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c-osd.11-deactivate 2020-11-16T22:17:54.730 INFO:teuthology.orchestra.run.smithi057:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bcd5108e-2855-11eb-a2b2-001a4aab830c@osd.11.service' 2020-11-16T22:17:54.755 DEBUG:teuthology.orchestra.run:got remote process result: None 2020-11-16T22:17:54.756 INFO:tasks.cephadm.osd.11:Stopped osd.11 2020-11-16T22:17:54.756 INFO:teuthology.orchestra.run.smithi016:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2020-11-16T22:17:54.771 INFO:teuthology.orchestra.run.smithi057:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2020-11-16T22:17:54.813 INFO:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2020-11-16T22:17:54.828 INFO:tasks.cephadm:Archiving crash dumps... 2020-11-16T22:17:54.831 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/crash to /home/teuthworker/archive/kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi/5631168/remote/ubuntu@smithi195.front.sepia.ceph.com/crash 2020-11-16T22:17:54.832 INFO:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/crash -- . 2020-11-16T22:17:54.887 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/crash to /home/teuthworker/archive/kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi/5631168/remote/ubuntu@smithi016.front.sepia.ceph.com/crash 2020-11-16T22:17:54.889 INFO:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/crash -- . 2020-11-16T22:17:54.907 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/crash to /home/teuthworker/archive/kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi/5631168/remote/ubuntu@smithi057.front.sepia.ceph.com/crash 2020-11-16T22:17:54.908 INFO:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/crash -- . 2020-11-16T22:17:54.925 INFO:tasks.cephadm:Checking cluster log for badness... 2020-11-16T22:17:54.926 INFO:teuthology.orchestra.run.smithi195:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'Health detail' | egrep -v '\(REQUEST_STUCK\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | head -n 1 2020-11-16T22:17:54.943 INFO:teuthology.orchestra.run.smithi195.stderr:grep: /var/log/ceph/bcd5108e-2855-11eb-a2b2-001a4aab830c/ceph.log: No such file or directory 2020-11-16T22:17:54.946 INFO:tasks.cephadm:Compressing logs... 2020-11-16T22:17:54.946 INFO:teuthology.orchestra.run.smithi016:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-11-16T22:17:54.949 INFO:teuthology.orchestra.run.smithi057:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-11-16T22:17:54.963 INFO:teuthology.orchestra.run.smithi016.stderr:find: '/var/log/rbd-target-api': No such file or directory 2020-11-16T22:17:54.967 INFO:teuthology.orchestra.run.smithi195:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-11-16T22:17:54.980 INFO:teuthology.orchestra.run.smithi057.stderr:find: '/var/log/rbd-target-api': No such file or directory 2020-11-16T22:17:55.002 INFO:teuthology.orchestra.run.smithi195.stderr:find: '/var/log/rbd-target-api': No such file or directory 2020-11-16T22:18:07.760 INFO:tasks.cephadm:Archiving logs... 2020-11-16T22:18:07.761 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi/5631168/remote/ubuntu@smithi195.front.sepia.ceph.com/log 2020-11-16T22:18:07.762 INFO:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/log/ceph -- . 2020-11-16T22:32:53.686 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/kchai-2020-11-16_12:11:03-rados-wip-kefu-testing-2020-11-16-1845-distro-basic-smithi/5631168/remote/ubuntu@smithi016.front.sepia.ceph.com/log 2020-11-16T22:32:53.689 INFO:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/log/ceph -- .